U.S. Pat. No. 10,220,311
SYSTEM AND METHOD FOR GAME PLAYING USING VESTIBULAR STIMULATION
AssigneeGearbox LLC
Issue DateAugust 10, 2016
Illustrative Figure
Abstract
A method of gaming is generally described which includes detecting motions associated with the user by a feedback sensor device and providing motion information from the feedback sensor device to the game device. The method also includes providing a vestibular stimulation signal to a user, by a vestibular stimulation device in communication with a game device in response to the motion information and the game content.
Description
DETAILED DESCRIPTION In the following detailed description, reference is made to the accompanying drawings, which form a part hereof. In the drawings, similar symbols typically identify similar components, unless context dictates otherwise. The illustrative embodiments described in the detailed description, drawings, and claims are not meant to be limiting. Other embodiments may be utilized, and other changes may be made, without departing from the spirit or scope of the subject matter presented here. Those having skill in the art will recognize that the state of the art has progressed to the point where there is little distinction left between hardware and software implementations of aspects of systems; the use of hardware or software is generally (but not always, in that in certain contexts the choice between hardware and software can become significant) a design choice representing cost vs. efficiency tradeoffs. Those having skill in the art will appreciate that there are various vehicles by which processes and/or systems and/or other technologies described herein can be effected (e.g., hardware, software, and/or firmware), and that the preferred vehicle will vary with the context in which the processes and/or systems and/or other technologies are deployed. For example, if an implementer determines that speed and accuracy are paramount, the implementer may opt for a mainly hardware and/or firmware vehicle; alternatively, if flexibility is paramount, the implementer may opt for a mainly software implementation; or, yet again alternatively, the implementer may opt for some combination of hardware, software, and/or firmware. Hence, there are several possible vehicles by which the processes and/or devices and/or other technologies described herein may be effected, none of which is inherently superior to the other in that any vehicle to be utilized is a choice dependent upon the context in which the vehicle will be deployed and the specific concerns (e.g., ...
DETAILED DESCRIPTION
In the following detailed description, reference is made to the accompanying drawings, which form a part hereof. In the drawings, similar symbols typically identify similar components, unless context dictates otherwise. The illustrative embodiments described in the detailed description, drawings, and claims are not meant to be limiting. Other embodiments may be utilized, and other changes may be made, without departing from the spirit or scope of the subject matter presented here. Those having skill in the art will recognize that the state of the art has progressed to the point where there is little distinction left between hardware and software implementations of aspects of systems; the use of hardware or software is generally (but not always, in that in certain contexts the choice between hardware and software can become significant) a design choice representing cost vs. efficiency tradeoffs. Those having skill in the art will appreciate that there are various vehicles by which processes and/or systems and/or other technologies described herein can be effected (e.g., hardware, software, and/or firmware), and that the preferred vehicle will vary with the context in which the processes and/or systems and/or other technologies are deployed. For example, if an implementer determines that speed and accuracy are paramount, the implementer may opt for a mainly hardware and/or firmware vehicle; alternatively, if flexibility is paramount, the implementer may opt for a mainly software implementation; or, yet again alternatively, the implementer may opt for some combination of hardware, software, and/or firmware. Hence, there are several possible vehicles by which the processes and/or devices and/or other technologies described herein may be effected, none of which is inherently superior to the other in that any vehicle to be utilized is a choice dependent upon the context in which the vehicle will be deployed and the specific concerns (e.g., speed, flexibility, or predictability) of the implementer, any of which may vary. Those skilled in the art will recognize that optical aspects of implementations will typically employ optically-oriented hardware, software, and or firmware.
The foregoing detailed description has set forth various embodiments of the devices and/or processes via the use of block diagrams, flowcharts, and/or examples. Insofar as such block diagrams, flowcharts, and/or examples contain one or more functions and/or operations, it will be understood by those within the art that each function and/or operation within such block diagrams, flowcharts, or examples can be implemented, individually and/or collectively, by a wide range of hardware, software, firmware, or virtually any combination thereof. In one embodiment, several portions of the subject matter described herein may be implemented via Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs), digital signal processors (DSPs), or other integrated formats. However, those skilled in the art will recognize that some aspects of the embodiments disclosed herein, in whole or in part, can be equivalently implemented in integrated circuits, as one or more computer programs running on one or more computers (e.g., as one or more programs running on one or more computer systems), as one or more programs running on one or more processors (e.g., as one or more programs running on one or more microprocessors), as firmware, or as virtually any combination thereof, and that designing the circuitry and/or writing the code for the software and or firmware would be well within the skill of one of skill in the art in light of this disclosure. In addition, those skilled in the art will appreciate that the mechanisms of the subject matter described herein are capable of being distributed as a program product in a variety of forms, and that an illustrative embodiment of the subject matter described herein applies regardless of the particular type of signal bearing medium used to actually carry out the distribution. Examples of a signal bearing medium include, but are not limited to, the following: a recordable type medium such as a floppy disk, a hard disk drive, a Compact Disc (CD), a Digital Video Disk (DVD), a digital tape, a computer memory, etc.; and a transmission type medium such as a digital and/or an analog communication medium (e.g., a fiber optic cable, a waveguide, a wired communications link, a wireless communication link, etc.). Further, those skilled in the art will recognize that the mechanical structures disclosed are exemplary structures and many other forms and materials may be employed in constructing such structures.
Galvanic vestibular stimulation is a method in which a stimulus current is provided to the vestibular system of the human body. This is accomplished by providing electrical contacts or otherwise providing electrical stimulation of the nerves near the vestibular site. For example, the contacts may be provided near the mastoid processes on the human head. Galvanic stimulation of the vestibular organs may be achieved by passing a small current between the mastoid processes. In some studies, it has been shown that a large galvanic body sway can be evoked by galvanic vestibular stimulation. Further, it has been shown that rocking or bobbing of the head may also be accomplished.
Further, by providing stimulation at different frequencies, patterns, and magnitudes, other movements may be achieved. In general, the vestibular system detects head movement by sensing head acceleration with specialized peripheral receptors in the inner ear that comprise semicircular canals and otolith organs. The vestibular system is important in virtually every aspect of daily life, because head acceleration information is essential for adequate behavior in three-dimensional space not only through vestibular reflexes that act constantly on somatic muscles and autonomic organs, but also through various cognitive functions such as perception of self movement. In galvanic vestibular stimulation, small-amplitude galvanic current is delivered transcutaneously or via other methods to the vestibular afferents that lie directly below the mastoid bones.
Galvanic vestibular stimulation has many uses. For example, galvanic vestibular stimulation may be used for game playing, therapy, movement training, music enjoyment, and other varied uses. Galvanic vestibular stimulation may be accomplished through, methods and structures. Such methods and structures may include different control algorithms, sensors, inputs, programs, etc. and may be applied in order to enable galvanic vestibular stimulation in an application setting. Referring now toFIG. 1, a generalized schematic of a vestibular stimulation system for a user is depicted. System100includes a headset110having earphones or earbuds115and a control unit120attached thereto. Earbuds110include a speaker122, a feedback sensor124, stimulator contacts126, a stimulation device128and a current source130. Any or all of these structures may be included in headset110or may be elsewhere such as in control unit120or associated with a computer150or other processing device. Control unit120may include control algorithms132, user parameter settings134, learning or adaptive algorithms136, and a database including music and/or a score or other reference information138. Control unit120may also include a communications interface140. Communications interface140may be used to communicate with any of a variety of devices including but not limited to a processing device, such as a computer150.
In use, headset110may be worn by a user105. Headset110may include vestibular stimulator contacts126which may be surface electrodes, which may or may not use a contact conductive gel or other chemical placed between the skin and the electrodes. In an exemplary embodiment, it may be possible to induce or influence user motion by using any of a variety of protocols resulting in different performance. For example it may be possible to stimulate the user by using a sine wave current with a frequency in the range of 1 to 2 Hz. The amplitude of such stimulation may be in the range of a few tenths of a milliamp to a few milliamps. The stimulation may occur over a period of just a few seconds to several seconds. All of these factors depend on the performance to be achieved. Such performance may be discovered through training, modeling or through experimentation.
In accordance with an exemplary embodiment, galvanic vestibular stimulation system100or like systems may be used to stimulate the vestibular system of a user and cause various motional effects including, but not limited to rocking or swaying of the head, rocking or swaying of the body, induce walking or change of direction of walking, among others.
Referring now toFIG. 2, a system200for altering a user's motional response to music or to other sounds is depicted. System200includes, but is not limited to a user210, having a sensor220associated therewith. Sensor220may be any of a variety of sensors including accelerometers, strain gauges gyros, laser gyros, MEMS gyros, current sensors, magnetic field sensor, velocity sensors, angular orientation sensors, etc. In one exemplary embodiment a music source215is provided to user210. Music source215may include any of a variety of musical pieces or other sounds, sequences of sounds, or patterns of sounds. Also, in an exemplary embodiment the music being played by music source215may correspond to certain characteristics which are reflected in an information source218that contains various characteristics of the music being played by music source215. Sensor220may be coupled to a control algorithm230that receives tracking information from tracking information240. Traffic tracking information240is related to the characteristics of the musical piece or sounds that are stored in information source218. In one exemplary embodiment an observer, a model, or an estimator may be used in control algorithm230to model the user reaction210. Controller260may also be used to control the processes in order to drive the user's reaction to music source215towards a predetermined or pre-generated goal. In accordance with exemplary system200, controller260is coupled to a current source270. Controller260provides control signals to current source270in order to vary the current delivered by the vestibular stimulation system, such as vestibular stimulation system100, in order to alter or induce alteration of the motional response of user210.
In one exemplary embodiment, music may be delivered through a sound delivering device which may include any of a variety of sound delivering mechanisms such as but not limited to earphones, earbuds, speakers, etc. Further, in another exemplary embodiment controller260may be defined by control algorithms230and may include user definable settings, user adjustable settings, adaptive settings, adaptive settings that may be different for various users or may be individualized or customized for individual users, etc. Various characteristics may be adapted from the music or sound source, such as but not limited to beats, rhythms, notes, rests, note types, etc. In one exemplary embodiment it may be desired to have a user react in a certain way to a series of sounds such as music. For example, it may be desired to induce a user to rock or sway to a specific beat. It may be that the user is incapable of keeping a proper beat, or a proper rhythm and therefore is encouraged or induced to do so by the stimulation provided by system200. Such a system may be used in an effort to improve the user's response to music, to provide a more enjoyable experience or to provide an entertainment experience.
In accordance with one exemplary embodiment control algorithm230may include an objective function. Further, control algorithm230maybe used to track the information such as the beat information or the rhythm information. Further still, control algorithm230may include any of or any combination of an observer250, a classical control algorithm, a nonlinear control algorithm, an optimal control algorithm, a state estimator, an adaptive control algorithm, a Kalman filter, etc. In one exemplary embodiment, control algorithm230may include a model of the user's response to electrical current stimulus to the vestibular system in order to estimate the needed stimulation signals. Further, in an exemplary embodiment, the controller260may include user definable settings, user adjustable settings, adaptive settings, adaptive settings that may be different for each user, etc. In another exemplary embodiment, sensor220may include any of or any combination of at least one accelerometer, at least one strain gauge, at least one gyro, at least one MEMS gyro, at least one laser gyro, at least one current sensor, magnetic field sensors, etc. In one exemplary embodiment, the user may be encouraged to follow any of a variety of characteristics including following beats, rhythms, notes, rests, note types, or any combination of these or or other characteristics of the sounds. Further still, such characteristics may be selectable and the magnitude of the current delivered may be adjustable.
Referring now toFIG. 8, a process800for altering a user's motional response to sound may include receiving a sound produced by a device capable of producing sound (process810). A sound device may be in communication with a sound data source. The sound data source may include information associated with at least one set of sounds. Movement may be created in response to the received sound (process820). The movement may be detected by a feedback sensor device and compared to information from an information source including information associated with at least one characteristic of the at least one set of sounds. The comparison information may be provided to a control program. The control program may have a control algorithm configured to generate control data based on the comparison. In one exemplary embodiment movement may be detected by a sensor (process830). A current may be received by a vestibular system from electrical contacts coupled to a current source (process840). The current may be delivered based on the control data and output control signals. The created movement may be altered in response to the current (process850).
In one exemplary embodiment the altered movement may be involuntary in response to the current. In another exemplary embodiment the control algorithm may include an objective function, may be configured to track the information, may include an observer, may include a classical control algorithm, may include a nonlinear control algorithm, may include an optimal control algorithm, may include a State estimator, may include an adaptive control algorithm, may include a Kalman filter, etc. Further, in exemplary embodiment, the control algorithm may include a model of the user's response to electrical current stimulus to the vestibular system in order to calculate the amount of current needed.
In accordance with another exemplary embodiment, a process900is depicted inFIG. 9for altering a users motional response to sound. Process900includes producing a sound from a sound device capable of producing sound (process910). A sound device may be in communication with the sound data source. The sound data source includes information associated with at least one set of sounds. Process900also includes detecting motions by a feedback sensor device (process920). The motions may be associated with the user. Further, process900includes providing information from an information source including information associated with at least one characteristic of the at least one set of sounds (process930). The information may be provided to a control program configured to receive data representative of the detected motions and to receive the information. Further still, process900includes generating, by the control program, control data based on the data representative of the detected motions and the information (process940). The control program is configured to receive data representative of the detected motions and to receive the information. The control program has a control algorithm that is configured to generate control data based on the data that is representative of the detected motions and the information. The control program is run by the controller and is configured to output control signals based on the control data. Current may then be delivered from the current source to electrical contacts (process950). The electrical contacts may be configured to contact flesh of the user, to deliver current to the vestibular system of the user in response to the control signals.
Referring now toFIG. 3, a block diagram300of an exemplary system for altering a user's motions is depicted. System300includes a user310, and a sensor320. that is configured to detect motions associated with the user. In one exemplary embodiment, a control algorithm330receives information from sensor320. Such information may be in the form of an error signal reporting error between the user's actual motions and specified tracking information340. Control algorithm330also receives information from an observer, a model, or an estimator350. In one exemplary embodiment, control algorithm330may receive information from an objective355. Further, in an exemplary embodiment the error may be used to make adjustments to the observer, the model or the estimator350. The object of the observer, model, or estimator350and its adaptability or adjustability is to improve the action of control algorithm330run by controller360to output currents signals from the current source370back to user310.
Referring now toFIG. 4, a block diagram400of an exemplary system for altering a user's motions is depicted. System400may include a user410, and a sensor420that is configured to detect motions associated with the user. An objective information source such as tracking information440, may be configured to receive data representative of the detect motions and to receive the information. The control program may have a control algorithm430that is configured to generate control data based on the data representative of the detected motions and the information. A controller460may be configured to run the control program and to output control signals based on the control data. Electrical contacts may be configured to contact flesh of the user410and deliver current from the current source470to the vestibular system of the user410in response to the control signals.
In one exemplary embodiment, the objective information may be provided by a computer program based on characteristics of the user. The objectives may be provided by a healthcare provider or other source. Further, in one exemplary embodiment, control algorithm430receives error feedback and parameters of the control algorithm or the controller may be altered or adapted. Such an adaptive system having adaptive control algorithm430may be an effective way to generate initial control algorithms that may be useful when parameters of such control algorithms are unknown or modeling of the processes may be difficult as well as providing high performance systems.
Referring again toFIG. 4, an adaptive system400for altering a user's motional response to sound is depicted. System400includes a user410and a sensor420is configured to detect motions associated with the user. A sound source may provide sounds to a user. An information source which may include information associated with at least one characteristic of the at least one set of sounds may be but is not limited to tracking information source440. A control program is configured to receive data that is representative of the detected motions and to receive the information. The control program has a control algorithm configured to generate control data based on the data representative of the detected motions and the information. Controller460is configured to run the control program and output control signals based on the control data. Control algorithm430may be an adaptive system configured to adjust parameters of at least one of the controller, the feedback sensor, the sound source, the information, or the control algorithm. A vestibular stimulation device may be configured to deliver current from the current source to the vestibular system of the user in response to the control signals. In one exemplary embodiment, the adaptive system includes a self-learning system. In other exemplary embodiments, the self-learning system may be an artificial intelligence program, a fuzzy logic program, a neural network program, an adaptive control law, an artificial intelligence program, etc. In such an adaptive system, the parameters which are adapted may include any of a variety of parameters including but not limited to control law parameters, speed parameters, intensity parameters, and user specific parameters, among others. The adaptive system may be an on-line self-learning system such that it may be trained and learning may occur during the use phase. In other exemplary embodiments, the self-learning system learns off-line during a training phase in such a configuration it may use a training set of data to learn.
Referring now toFIG. 5, a system500for altering a user's motional response to sound is depicted. User510may have a sensor device520configured to detect motions associated with user510. An objective information source or a reference source540is configured to provide information related to an objective of the user's motion. A control program550may be configured to receive data representative of the detected motions and receive the information. The control program may be a variety of control algorithms530configured to generate control data based on the data representative of the detected motions and the information. A controller560may be configured to run the control program and output control signals based on the control data. An adaptive system is configured to adjust parameters of at least one of controller561, feedback sensor520, a sound source, reference source540, control algorithm530, controller560, current source570, or vestibular stimulation device590. Vestibular stimulation device590is configured to deliver current from the current source to the vestibular system of user510in response to the control signals.
Referring now toFIG. 10, a process1000for altering a user's motional response to sound, is depicted. Process1000includes producing a sound from a sound device capable of producing sound (process1010). The sound device is in communication with a sound data source. The sound data source includes information associated with at least one set of sounds. Motions are detected from the user by a feedback sensor device. The motions are associated with the user (process1020). Information is provided from an information source (process1030). The information includes information that is associated with at least one characteristic of the at least one set of sounds. The information is provided to a control program that is configured to receive data representative of the detected motions and to receive the information. Control data is generated by the control program (process1040). Control data is based on the data representative of the detect motions and the information. The control program is configured to receive data representative of the detect motions and to receive the information. The control program has a control algorithm that is configured to generate control data based on the data representative of the detected motions and the information. Parameters of the system are adjusted (process1050). Parameters of the at least one controller, the feedback sensor, the sound source, the information, or the control algorithm may be adjusted by the adaptive system. Current is delivered from the current source to the vestibular system of the user in response to the control signals by a vestibular stimulation device (process1060).
Referring again toFIG. 5, system500may be a system which is used to provide therapy for a user. Such therapy may be for any of a variety of conditions of the user such as, but not limited to users having various diseases, users who have lost function of certain muscles, users who need rehabilitation for walking and other motor control issues. System500includes the use of a current source570, a reference source540that includes information associated with desired motions of the user. Such desired motion's may be formulated through experiment or may be provided from a care provider such as a doctor, a therapist, or the like. A recording device550may be used to maintain a record of motions of the user. Such a recording device550may be used by a doctor, a therapist, or an analysis program580who may use the recorded information to determine if further therapy is needed or similarly if a change in therapy is needed. A feedback sensor device520is configured to detect motions associated with the user during therapeutic use. Feedback sensor520provides sensor information to recording device550. A control program is configured to receive data representative of the detected motions and to receive the information from the reference source. The control program has a control algorithm530that is configured to generate control data based on the data representative of the detected motions and the information. For example, sensor520may detect motions of the user and communicate those motions to control algorithm530likewise, reference source540may communicate desired motions to a control algorithm530. Control algorithm530determines whether the user is making the desired motions or not and then sends control signals via controller560. Controller560is configured to run the control program and output control signals which are based on the control data to a current source and a vestibular stimulation device590. Vestibular stimulation device590provides stimulation to the user to alter or induce the user's motions. Once the user's motions are altered, the user's body may be trained to perform such motions. Such training may be done in a repetitious manner whereby the motions are induced over and over after the user is prompted to perform the motions. An analysis program580is configured to analyze information from the recording device and is related to a user's therapeutic progress and to provide changes to at least one of the reference source, the control algorithm, the controller, the current source, or the vestibular stimulation device, depending on the user's progress in therapy.
In accordance with an exemplary embodiment, the analysis program580may include an objective function, a target, a performance score, or the like. Such metrics may be used to determine whether the user is improving given the therapy. In another exemplary embodiment, analysis program580includes instructions for the user. Such instructions may be instructions to repeat a previous action, or to modify a previous action. Further, in an exemplary embodiment, the analysis program includes functionality to make changes to the information from the reference source, parameters of the control algorithm, parameters of the controller, changes in current magnitude, current frequency, or changes to the vestibular stimulation device.
Referring now toFIG. 6, a system600for providing therapy for a user610by altering a user's motional response is depicted. System600includes a user610having a sensor620associated therewith to detect motions of user610. A recording device650may be coupled to sensor620. Sensor620may also deliver information to control algorithm630. Control algorithm630may also receive reference information for reference source640. Control algorithm630is configured to generate control data based on the information from reference source640and the sensor information. Controller660may be configured to run the control program and output control signals based on the control data generated. The vestibular stimulation device690is configured to deliver current from the current source670to the vestibular system of the user in response to the control signals. In an exemplary embodiment, a schedule680is configured to provide scheduling information to user610to attempt to provide therapy for a user condition. Such scheduling information may include information that is scheduled during a period of time in a periodic manner. Further, scheduling information may include a schedule which is not periodic. Further still, such scheduling information may include scheduling therapy at different times of day, at different days of the week, or at different times of the year, etc. The scheduling information may be dictated automatically or may be derived from physicians instructions or the like.
Referring now toFIG. 7, a system700for gaming is depicted. System700includes a game device such as a video game system, a computer, or the like. Gaming device710includes any of a variety of output devices730in communication with the game device. Such devices include, but are not limited to video devices, audio devices, tactile devices, etc. Game device720may receive input from an input device such as a game controller720or other types of input devices. In accordance with an exemplary embodiment, game device710may be coupled to a vestibular stimulation device740that is configured to provide vestibular stimulation to a player or other user. In one exemplary embodiment, a feedback sensor device is configured to detect motions associated with the user and the feedback sensor device may provide information. A game program runs on game device710. The game program may provide output to the output device, such as video output, and may receive input from the input device or the team controller720. Motion information may be detected by a sensor. Control signals provided to the vestibular stimulation device are provided to include motions of a user or a game player in response to at least one of the output or the input. In one exemplary embodiment, the feedback sensor may be coupled to be a part of the body of the user. In another exemplary embodiment, the game program, running on the game device710, may be configured to provide output to the game device and may selectively provide control signals to the vestibular stimulation device to influence motions of the user during first days and then provide the output and receive input from the sensor device during a second phase. This enables games in which the user or the player is provided a certain stimulus and in response to that stimulus should attempt to repeat a set of motions to prevent be during the first phase.
Referring now toFIG. 11, a process1100for providing motor control therapy for a user by altering the user's motional response, is depicted. Process1100includes directing a user to perform a specified motion in accordance with a schedule (process1110). Process1100also includes detecting the user's motions in response to the directions, by a feedback sensor device (process1120). Further, process1100includes providing information associated with a target motion (process1130). A control program generates control data based on the data that is representative of the motions expected by the sensor and the reference information. The control program is configured to receive data that is representative of the detected motions and to receive the information. The control program has a control algorithm that is configured to generate control data based on the data representative of the detected motions and the information (process1140). The control program is run by the controller and is configured to output control signals based on the control data. Current is delivered from the current source to the vestibular stimulation device (process1150). The vestibular stimulation device is configured to deliver a stimulation current to the least one electrical contacts in response to the control signals. The at least one electrical contacts are configured to contact flesh of the user.
Referring now toFIG. 12, a process1200for providing motor control therapy for a user by altering a user's motional response, is depicted. Process1200includes directing patients to perform specified motions (process1210). A patient's motions may be detected by a sensor device (process1220). Information from an information source is provided to a control output (process1230). Control data is generated by control program (process1240). Current is delivered to a vestibular system (process1250). Analysis is then made of a patient's therapeutic progress (process1260).
Systems may be provided for training of individual users by altering user's motional responses. Such systems may include many configurations including, but not limited to those inFIGS. 1-6. Such a system may include a current source, and a reference source that has information associated with the sequence of desired motions of a user. The sequence of desired motions may be those on which the user is to be trained. A sensor may be configured to detect motions associated with the user. A control may be configured to receive data representative of the detected motions and also to receive information. The control program has a control algorithm that is configured to generate control data based on the data representative of the subject motions and the information from the reference source. The controller runs the control program and determines control signals based on the control data. The vestibular stimulation device is configured to deliver current from the current source to the vestibular system of the user in response to the control signals, in order to induce a response in the user. The control data effectuate's vestibular stimulation of the user if the user is not in the process of performing the sequence of motions provided by the the reference source. In other words, the control data effectuates vestibular stimulation of the user when the user does not perform, either exactly or approximately, motions on which the user is being trained. In accordance with alternative embodiments, the training systems may include evaluation programs which are configured to provide invalidation to a user as to the performance of the user compared with the desired motions. Such evaluation training programs may be valuable in the training process and may be helpful in order to provide the feedback needed by a user to learn the desired motions. Such a system of training may be useful in a variety of situations including, but not limited to learning a set of desired user actions or motions, learning a series of dance steps or motions, learning a set of motions used to operate machinery, learning an athletic movement, or a variety of other situations. In one exemplary embodiment, the vestibular stimulation is provided during the time in which they user is attempting to perform the desired motions. However, in another exemplary embodiment, the user is prompted with vestibular stimulation in a separate training phase. For example, the user may be induced to perform the motion through vestibular stimulation in a first phase and then may try to repeat the motions in a second phase. After the second phase, the performance of the user may be evaluated, scored, etc.
Referring now toFIG. 13, a system1300is depicted. Process1300includes directing a user to perform a specified motion during a training sequence (process1310). The user's motions are detected by a sensor (process1320). After the user's motions are detected, control data may be generated based on the detected motions and on the training sequence (process1330). A control program generates control data which is provided to a controller. Current is then delivered during a repeating phase in which a user attempts to repeat the training sequence (process1340).
Referring now toFIG. 14, a system for altering a user's motional response to sensory input is depicted as system1400. System1400includes a user1410receiving sensory input from a first sensory input1420and simultaneously receiving a second sensory input from a second sensory input1430. A sensor device1440is configured to detect motions associated with the user. A control unit is configured to receive signals from the sensor and receive sensory signals that are related to the first and second sensory inputs. Control unit1450generates control signals based on the signals and the sensory signals. Control unit1450outputs information to vestibular stimulation device1460. The vestibular stimulation device1460provides vestibular stimulation to a user's vestibular stimulation system in order to induce movement of the user in a desired manner. In one exemplary embodiment, the current from vestibular stimulation device1460may be used to induce the user to move in a predetermined manner if the user is not in the process of making the predetermined motions. In another exemplary embodiment, the current is configured to induce the user to move in a predetermined manner after the user fails to make predetermined motions. For example, if the user performs a series of motions that are imprecise or incorrect, the vestibular stimulation device will provide current to produce or induce the predetermined motions in the user. Further, in another exemplary embodiment, the first sensor input device may be provided to provide a combined first and second sensory input to the user. For example, the device may be a video/audio device in which both video and audio are provided to the user. The second sensory input device may still be provided as a third sensory input to the user, for example may provide a tactile input. Such a tactile input device may be provided on the hand of the user, or any other portion of the body in which the user may feel some input or receive a tactile input.
Referring now toFIG. 15, a system1500is depicted. System1500is for altering a user's motional response to motional input. A current source may provide vestibular stimulation through a vestibular stimulation device1560, as described earlier. In an exemplary embodiment, a motion inducement platform such as a moving source1530, may induce motion of at least a portion of user1510. A first sensor device may be configured to detect motions associated with user1510. A control unit1540maybe configured to receive signals from a sensor1520and generate control signals based on the signals from sensor1520. Electrical contacts are configured to contact flesh of user1510and deliver current from vestibular stimulation device1560in response to the control signals. Current is configured to induce the user to move in a manner that is responsive to the induced motion of at least a portion of the user. In one exemplary embodiment, moving source1530may include a vehicle, a road vehicle, an aircraft, a spacecraft, a military vehicle, or the like. Further, in an exemplary embodiment, the goal of vestibular stimulation device1560may be too induce cancellation of the induced motion. In another exemplary embodiment, the inducement may be to augment the induced motion by moving source1530. In another exemplary embodiment, a second sensor may be used that is configured to detect motions of moving source1530. Such information may be fed directly to control unit1540. In one or more exemplary embodiments, it may be useful to have such a system in order to provide control of portions of a person's body in a moving environment. For example, it may be desirable to maintain a stable motion of an aircraft pilots head during piloting of an aircraft such as a military aircraft or other performance aircraft. Similarly, such stability of a portion of a person's body may be desired for a spacecraft pilot, a vehicle driver, or the like.
In yet another exemplary embodiment, a system for altering a user's motions may include an objective information source. The objective information source may be configured to provide information related to an objective of the user's motion. For example, the objective may be to perform a certain task. Further, the objective may be to reach a specified goal. In another exemplary embodiment, the objective may be too performed a specified task in a certain amount of time. Further, other objectives may be equally applicable without departing from the scope of the invention. Referring again toFIG. 12,FIG. 12embodies a process in which an objective may be used. The objective may be provided as information from an information source. Such information source would be an objective information source having at objective user information therein.
In a general sense, those skilled in the art will recognize that the various embodiments described herein can be implemented, individually and/or collectively, by various types of electro-mechanical systems having a wide range of electrical components such as hardware, software, firmware, or virtually any combination thereof; and a wide range of components that may impart mechanical force or motion such as rigid bodies, spring or torsional bodies, hydraulics, and electro-magnetically actuated devices, or virtually any combination thereof. Consequently, as used herein “electro-mechanical system” includes, but is not limited to, electrical circuitry operably coupled with a transducer (e.g., an actuator, a motor, a piezoelectric crystal, etc.), electrical circuitry having at least one discrete electrical circuit, electrical circuitry having at least one integrated circuit, electrical circuitry having at least one application specific integrated circuit, electrical circuitry forming a general purpose computing device configured by a computer program (e.g., a general purpose computer configured by a computer program which at least partially carries out processes and/or devices described herein, or a microprocessor configured by a computer program which at least partially carries out processes and/or devices described herein), electrical circuitry forming a memory device (e.g., forms of random access memory), electrical circuitry forming a communications device (e.g., a modem, communications switch, or optical-electrical equipment), and any non-electrical analog thereto, such as optical or other analogs. Those skilled in the art will also appreciate that examples of electro-mechanical systems include but are not limited to a variety of consumer electronics systems, as well as other systems such as motorized transport systems, factory automation systems, security systems, and communication/computing systems. Those skilled in the art will recognize that electro-mechanical as used herein is not necessarily limited to a system that has both electrical and mechanical actuation except as context may dictate otherwise.
In a general sense, those skilled in the art will recognize that the various aspects described herein which can be implemented, individually and/or collectively, by a wide range of hardware, software, firmware, or any combination thereof can be viewed as being composed of various types of “electrical circuitry.” Consequently, as used herein “electrical circuitry” includes, but is not limited to, electrical circuitry having at least one discrete electrical circuit, electrical circuitry having at least one integrated circuit, electrical circuitry having at least one application specific integrated circuit, electrical circuitry forming a general purpose computing device configured by a computer program (e.g., a general purpose computer configured by a computer program which at least partially carries out processes and/or devices described herein, or a microprocessor configured by a computer program which at least partially carries out processes and/or devices described herein), electrical circuitry forming a memory device (e.g., forms of random access memory), and/or electrical circuitry forming a communications device (e.g., a modem, communications switch, or optical-electrical equipment). Those having skill in the art will recognize that the subject matter described herein may be implemented in an analog or digital fashion or some combination thereof.
Those skilled in the art will recognize that it is common within the art to implement devices and/or processes and/or systems in the fashion(s) set forth herein, and thereafter use engineering and/or business practices to integrate such implemented devices and/or processes and/or systems into more comprehensive devices and/or processes and/or systems. That is, at least a portion of the devices and/or processes and/or systems described herein can be integrated into other devices and/or processes and/or systems via a reasonable amount of experimentation. Those having skill in the art will recognize that examples of such other devices and/or processes and/or systems might include—as appropriate to context and application—all or part of devices and/or processes and/or systems of (a) an air conveyance (e.g., an airplane, rocket, hovercraft, helicopter, etc.), (b) a ground conveyance (e.g., a car, truck, locomotive, tank, armored personnel carrier, etc.), (c) a building (e.g., a home, warehouse, office, etc.), (d) an appliance (e.g., a refrigerator, a washing machine, a dryer, etc.), (e) a communications system (e.g., a networked system, a telephone system, a Voice over IP system, etc.), (f) a business entity (e.g., an Internet Service Provider (ISP) entity such as Comcast Cable, Quest, Southwestern Bell, etc), or (g) a wired/wireless services entity such as Sprint, Cingular, Nextel, etc.), etc.
One skilled in the art will recognize that the herein described components (e.g., steps), devices, and objects and the discussion accompanying them are used as examples for the sake of conceptual clarity and that various configuration modifications are within the skill of those in the art. Consequently, as used herein, the specific exemplars set forth and the accompanying discussion are intended to be representative of their more general classes. In general, use of any specific exemplar herein is also intended to be representative of its class, and the non-inclusion of such specific components (e.g., steps), devices, and objects herein should not be taken as indicating that limitation is desired.
With respect to the use of substantially any plural and/or singular terms herein, those having skill in the art can translate from the plural to the singular and/or from the singular to the plural as is appropriate to the context and/or application. The various singular/plural permutations are not expressly set forth herein for sake of clarity.
The herein described subject matter sometimes illustrates different components contained within, or connected with, different other components. It is to be understood that such depicted architectures are merely exemplary, and that in fact many other architectures can be implemented which achieve the same functionality. In a conceptual sense, any arrangement of components to achieve the same functionality is effectively “associated” such that the desired functionality is achieved. Hence, any two components herein combined to achieve a particular functionality can be seen as “associated with” each other such that the desired functionality is achieved, irrespective of architectures or intermedial components. Likewise, any two components so associated can also be viewed as being “operably connected”, or “operably coupled”, to each other to achieve the desired functionality, and any two components capable of being so associated can also be viewed as being “operably couplable”, to each other to achieve the desired functionality. Specific examples of operably couplable include but are not limited to physically mateable and/or physically interacting components and/or wirelessly interactable and/or wirelessly interacting components and/or logically interacting and/or logically interactable components.
While particular aspects of the present subject matter described herein have been shown and described, it will be apparent to those skilled in the art that, based upon the teachings herein, changes and modifications may be made without departing from the subject matter described herein and its broader aspects and, therefore, the appended claims are to encompass within their scope all such changes and modifications as are within the true spirit and scope of the subject matter described herein. Furthermore, it is to be understood that the invention is defined by the appended claims. It will be understood by those within the art that, in general, terms used herein, and especially in the appended claims (e.g., bodies of the appended claims) are generally intended as “open” terms (e.g., the term “including” should be interpreted as “including but not limited to,” the term “having” should be interpreted as “having at least,” the term “includes” should be interpreted as “includes but is not limited to,” etc.). It will be further understood by those within the art that if a specific number of an introduced claim recitation is intended, such an intent will be explicitly recited in the claim, and in the absence of such recitation no such intent is present. For example, as an aid to understanding, the following appended claims may contain usage of the introductory phrases “at least one” and “one or more” to introduce claim recitations. However, the use of such phrases should not be construed to imply that the introduction of a claim recitation by the indefinite articles “a” or “an” limits any particular claim containing such introduced claim recitation to inventions containing only one such recitation, even when the same claim includes the introductory phrases “one or more” or “at least one” and indefinite articles such as “a” or “an” (e.g., “a” and/or “an” should typically be interpreted to mean “at least one” or “one or more”); the same holds true for the use of definite articles used to introduce claim recitations. In addition, even if a specific number of an introduced claim recitation is explicitly recited, those skilled in the art will recognize that such recitation should typically be interpreted to mean at least the recited number (e.g., the bare recitation of “two recitations,” without other modifiers, typically means at least two recitations, or two or more recitations). Furthermore, in those instances where a convention analogous to “at least one of A, B, and C, etc.” is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., “a system having at least one of A, B, and C” would include but not be limited to systems that have A alone, B alone, C alone, A and B together, A and C together, B and C together, and/or A, B, and C together, etc.). In those instances where a convention analogous to “at least one of A, B, or C, etc.” is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., “a system having at least one of A, B, or C” would include but not be limited to systems that have A alone, B alone, C alone, A and B together, A and C together, B and C together, and/or A, B, and C together, etc.). It will be further understood by those within the art that virtually any disjunctive word and/or phrase presenting two or more alternative terms, whether in the description, claims, or drawings, should be understood to contemplate the possibilities of including one of the terms, either of the terms, or both terms. For example, the phrase “A or B” will be understood to include the possibilities of “A” or “B” or “A and B.”
While various aspects and embodiments have been disclosed herein, other aspects and embodiments will be apparent to those skilled in the art. The various aspects and embodiments disclosed herein are for purposes of illustration and are not intended to be limiting, with the true scope and spirit being indicated by the following claims.
Claims
- A system for gaming, the system comprising: a game device;an output device in communication with the game device;a vestibular stimulation device in communication with the game device;a sensor device configured to detect motions associated with a user;a game program running on the game device, the game program configured to provide output to the output device, and selectively provide control signals to the vestibular stimulation device to influence motions of the user during a first phase and provide the output to the output device and receive input from the sensor device during a second phase.
- The system of claim 1 , further comprising: an input device in communication with the game device.
- The system of claim 1 , wherein the second phase tracks how closely the user performs the motions provided in the first phase.
- The system of claim 1 , wherein the second phase tracks how closely the user performs the motions opposite those provided in the first phase.
- The system of claim 1 , wherein the output device includes a visual output device.
- The system of claim 1 , wherein the output device includes an audio output device.
- The system of claim 1 , wherein the output device includes a tactile output device.
- The system of claim 1 , wherein the game program computes a score based on a user's performance during the second phase.
- The system of claim 1 , wherein the output device includes audio prompts for the user.
- The system of claim 1 , wherein the output device includes video prompts for the user.
- The system of claim 1 , wherein the output is responsive to the detected motions.
- The system of claim 1 , wherein the control signals are responsive to the detected motions.
- The system of claim 1 , wherein the one or more operations of the game program are responsive to the detected motions.
- A system for gaming, comprising: a game device configured to allow a user to play a game;a vestibular stimulation device in communication with the game device;a feedback sensor device configured to detect motions associated with the user;and wherein the game device is configured to: receive information about motions associated with the user from the sensor device while the user is playing the game;and selectively provide control signals to the vestibular stimulation device to induce sensations in the user in response to the received information about motions associated with the user.
- The system of claim 14 , further comprising an input device in communication with the game device, the input device configured to receive input from the user.
- The system of claim 15 , wherein the input device is a game controller.
- The system of claim 14 , further comprising an output device in communication with the game device.
- The system of claim 17 , wherein the output device provides an output selected from the group consisting of visual output, audio output, and tactile output.
- The system of claim 17 , wherein the output device provides an audio or visual prompt for the user.
- The system of claim 14 , wherein the induced sensations are selected to counteract the detected motions associated with the user.
- The system of claim 14 , wherein the induced sensations are selected to reinforce the detected motions associated with the user.
- The system of claim 14 , wherein the motions associated with the user are physical motions made by the user.
- The system of claim 14 , wherein the motions associated with the user are virtual motions made by the user.
- The system of claim 14 , wherein the motions associated with the user are motions made by a game player in response to at least one of an output or an input.
- A system for gaming, comprising: a game device configured to allow a user to play a game;a vestibular stimulation device in communication with the game device;wherein the game device is configured to: determine information about motions associated with the user while the user is playing the game;and selectively provide control signals to the vestibular stimulation device to induce sensations in the user in response to the determined information about motions associated with the user.
- The system of claim 25 , further comprising an input device in communication with the game device, the input device configured to receive input from the user.
- The system of claim 26 , wherein the input device is a game controller.
- The system of claim 25 , further comprising an output device in communication with the game device.
- The system of claim 28 , wherein the output device provides an output selected from the group consisting of visual output, audio output, and tactile output.
- The system of claim 28 , wherein the output device provides an audio or visual prompt for the user.
- The system of claim 25 , wherein the induced sensations are selected to counteract the detected motions associated with the user.
- The system of claim 25 , wherein the induced sensations are selected to reinforce the detected motions associated with the user.
- The system of claim 25 , wherein the motions associated with the user are physical motions made by the user.
- The system of claim 25 , wherein the motions associated with the user are virtual motions made by the user.
- The system of claim 25 , wherein the motions associated with the user are motions made by a game player in response to at least one of an output or an input.
Disclaimer: Data collected from the USPTO and may be malformed, incomplete, and/or otherwise inaccurate.