U.S. Pat. No. 8,339,366

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

The present invention relates generally to game consoles and specifically to providing additional system directives to game consoles. The following description is presented to enable one of ordinary skill in the art to make and use the invention and is provided in the context of a patent application and its requirements. Various modifications to the preferred embodiment and the generic principles and features described herein will be readily apparent to those skilled in the art. Thus, the present invention is not intended to be limited to the embodiment shown but is to be accorded the widest scope consistent with the principles and features described herein.

Recent enhancements to various input methodologies are utilized in accordance with the present invention to create new ways of issuing directives to game consoles. For example, text input devices now allow a text-based console directive system, which uses DOS or IRC-like commands, to quickly and easily perform various system functions. Other input devices, such as eye-tracking systems, allow for motion-based directives to perform system functions. Still other input devices, such as those utilizing motion-sensing input devices, now also allow for gesture-based directives to perform system functions. It is envisioned by the present invention that a diversity of input devices are included as a part of the present invention, independent of their system functions, where each input device is capable of performing one or more system functions in relation to the specific input device As used herein, the term “input device” includes any input device capable of performing one or more system functions in relation to the input device. An “input device” as used herein includes at least a parsing and execution engine, and may include any one or more of the input devices above, gaming controllers, and, without limitation, singly or in combination, any of the following types of input devices: touch-sensitive; motion-sensitive; multi-degrees-of-freedom (MDOF); inertia-sensing; depression-activated; force-input; mass-based providing kinesthetic feedback; mass-reduced providing virtual feedback; gesture-based; neural-impulse-based; muscular-activity-based; pointing-based; stylus-derived; voice-activated; light-activated; and the like.

A system that utilizes an issuing directive process in accordance with the present invention can take the form of an implementation of entirely hardware, entirely software, or may be an implementation containing both hardware-based and software-based elements. In one implementation, this disclosure is implemented in software, which includes, but is not limited to, application software, firmware, resident software, program application code, microcode, etc.

Furthermore, the issuing directive process of the present invention can take the form of a computer program product accessible from a computer-usable or computer-readable medium providing program code for use by or in connection with a computer or any instruction execution system. For the purposes of this description, a computer-usable or computer-readable medium can be any apparatus that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. Further a computer-readable medium includes the program instructions for performing the steps of the present invention. In one implementation, a computer-readable medium preferably carries a data processing or computer program product used in a processing apparatus which causes a computer to execute in accordance with the present invention. A software driver comprising instructions for execution of the present invention by one or more processing devices and stored on a computer-readable medium is also envisioned.

The medium can be an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system (or apparatus or device) or a propagation medium, or a signal tangibly embodied in a propagation medium at least temporarily stored in memory. Examples of a computer-readable medium include a semiconductor or solid state memory, magnetic tape, a removable computer diskette, a random access memory (RAM), a read-only memory (ROM), a rigid magnetic disk, and an optical disk. Current examples of optical disks include DVD, compact disk-read-only memory (CD-ROM), and compact disk-read/write (CD-R/W).

FIG. 1is an illustration of a Nintendo® game console102having a base105, and a remote104, hereinafter referred to as the Wii® system100. A distinguishing feature of the console102is its associated wireless controller (i.e., remote)104, also known as the Wii® remote, which can be used as a handheld pointing device and can detect acceleration in three dimensions (i.e., motion-sensing technology).

Although the present invention is described in the context of a Wii system100which includes a wireless controller104with motion sensing technology, one of ordinary skill in the art readily recognizes that a variety of systems which include motion sensing technology and other input devices could be used without limitation and that the use of such systems is envisioned herein and would be within the spirit and scope of the present invention.

The Wii system100includes the console102, a stand105to allow the console102to be placed vertically oriented in one scenario, at least one Wii remote104, and a sensor bar (not shown) for sensing the position of the remote104by exchanging information signals with the remote. For a complete description of the elements of a Wii system100, refer for example to the Wii operation manual system set-up at www.nintendo.com.

The Wii remote104is the primary controller for the console102. The remote104uses a combination of built-in accelerometers and infrared detection to sense its position in 3D space when pointed at the LEDs within a sensor bar. This design allows users to control the game using physical movements and gestures (hereinafter collectively referred to as “gestures”) as well as traditional input depression techniques such as button presses.

The Wii wireless remote104connects to the console102using Bluetooth® and the remote also features an internal speaker. The Wii remote104can connect to other devices through, for example, a proprietary port at the base of the remote104.

A system and method in accordance with the present invention allow for system functions to be performed on a gaming console. To describe the features of the invention in more detail, refer now to the following description in conjunction with the following description. In one aspect, an input device of the present invention may be utilized to provide system directives to the game controller in various implementations. As defined earlier, there are envisioned a diversity of types of input devices that can be utilized for the present invention.

FIG. 2is a flow chart for providing system directives using a game console in accordance with the present invention. The process includes mapping commands to system directives of the game console, via step202. Next, at least one button of an input controller is utilized to engage the system directives, via step204. Finally, the input controller is utilized to perform systems functions after the system directives are engaged, via step206.

A key aspect of the present invention includes the use of text-based as well as gesture-based directives to perform those system functions in accordance with select implementations. Accordingly, an input controller could be utilized to provide system directives to the game controller. These system directives are then utilized to perform different tasks such as chatting, booting system functions and controller options and managing peripheral and other external devices.

In a further implementation, the input controller could part of the gaming system such as the Wii remote104to provide gesture based directives or the input controller could be a text input device to provide text based directives. Providing gesture-based directives and text-based directives are described in more detail hereinbelow.

Gesture-Based and Other Non-Text Directives

In one implementation, a controller such as the Wii remote104(FIG. 1) that includes motion sensing technology to provide gesture-based direction can be utilized to provide gesture-based directives. This has the advantage of using the existing controller for providing the system directives rather than requiring any additional device to provide the system directives. In another implementation, the user could initiate a reserved sequence of controls on the remote104(e.g. keys=press pause and/or gestures=swing-swing-down) to enter a state that is reserved for issuing system directives. Once this reserved state has been accessed, gestures can be used to initiate the system functions.

In addition, preferably, the remote could be utilized with an optical system to provide gesture-based directions. For example, the remote could include an XBOX Vision Camera to allow the gestures to be recognized visually. In so doing, the gestures can be visually determined and that information can be utilized to provide the gesture based directives via the remote as described above, in relation to one or more predetermined characteristics of the input device, for example.

Further, a neural impulse actuator based system could be utilized to provide muscle-based direction, whereby one or more sensors are placed on a user to interpret signals received from brain, eye and facial muscle activity, for instance. A neural impulse actuator based system could be further utilized to provide gesture-based direction in certain implementations. The system could be further utilized with a controller that includes muscle-based detection technology. In the preferred embodiment, the user could initiate a reserved sequence of controls to enter one or more states that are reserved for issuing system directives in relation to one or more muscle-based movements or gesture-based movements. Once this reserved state has been accessed, muscle or gesture-based movements can be used to initiate any of the system functions mentioned above in the text-based directive or other descriptions, in relation to one or more predetermined characteristics of the input device, for example.

Additionally, a system utilizing a personal computer and camera situated to detect eye gaze while compensating for measurement errors caused by head movements could be utilized to provide eye-based-motion directions.

It is envisioned by the present invention that other gesture-based devices may also be used. For example, a text input method based on hand gestures for wearable computers where a character is written by a fingertip and then recognized through a character recognition method, such that the writing procedure is controlled by hand gestures including hand tracking, gesture recognition and fingertip positioning. By further example, a gesture keyboard input device for entering phonetic scripts is envisioned in which a pen-based device is used to input text in multiple languages.

In various implementations the present invention may also include generating an input signal having predefined characteristics corresponding to the input device being utilized to engage the system directives.

Text-Based Directives

In a further implementation a text input device providing text-based direction, such as a Microsoft Chatpad device, is utilized to provide text-based directives. To describe the features of such a device refer now to the following description in conjunction with the accompanyingFIGS. 3 and 4.

FIG. 3is an illustration of a Microsoft Chatpad device304(which may also be associated using the XBox® 360 gaming console). This device304allows for text input to video games and chatting through Xbox LIVE and Windows-based PCs. This device304allows for connection to a game controller. The device304preferably includes a keypad306. The device304can be utilized, for example, to provide a system directive to a game controller (not shown) based on signals generated in response to triggered input actions. For instance, the depression of a key sequence such as “AB” of the keyboard306causes a signal to be generated by the input device304in relation to the key sequence “AB”. As a part of that signal, a system directive in relation to the “AB” key sequence is provided as output from the input device304. Although the Microsoft Chatpad device is utilized in conjunction with the present invention, one of ordinary skill in the art readily recognizes that a variety of other text input devices could be used and their use is envisioned by the present invention and would be within the spirit and scope of the present invention.

In an embodiment, the game console102(FIG. 1) would display a system prompt to the user when a special button combination (i.e., key sequence) is pressed, or other triggering event is activated. Ideally, in one implementation, for example, in the Microsoft Chatpad device304a button, or button combination is reserved to display this system prompt. The reserved button or reserved button combination in one embodiment could further be used to disengage any other text entry and initiate a system directive. Finally in a further implementation a user could further initiate a system prompt and system directive by preceding their text entry with a special “system directive character” such as a slash, for example. To describe the operation of the device304refer now to the following description in conjunction withFIG. 4.

FIG. 4is a block diagram of a text input device304ofFIG. 3in one implementation including a parsing and execution engine402and a text entry engine404. Typically, the device304includes a parsing and execution engine402and a text entry engine404as illustrated in the simple block diagram ofFIG. 4, but not necessarily Once the system directive parsing and execution engine402is engaged in relation to one or more predetermined characteristics of the input device, the user would use the text entry engine404to perform system function tasks

System Functions

Accordingly, an input controller could be utilized to provide system directives to the game controller. These system directives are then utilized to perform different tasks such as chatting, booting system functions and controller options and managing peripheral and external devices.

Examples of such tasks that could be performed utilizing either gesture-based or text-based directives, in one or more implementations, are listed below, but are not limited to such:

Add friend n00b123 to friends list using the system directive:f n00b123

Mute user n00b123 using the system directive:m n00b123

Chat with user n00b123 using the system directive:c n00b123

Boot CD using the system directive:b

Reboot using the system directive:r

Turn off controller3using the system directive:off 3

Turn on camera using the system directive:on cam

Next song in media player playlist using the system directive:mp next

View achievements using the system directive:a

Compare achievements with user n00b123 using the system directive:a n00b123

As a further embodiment, an auto-compete function could be leveraged to suggest appropriate parameters for commands such as mute, chat, etc.

CONCLUSION

A system and method in accordance with the present invention applies directly to the mechanism a user would need to execute a system-level command. A key aspect of the present invention includes the use of input-based directives having predefined characteristics corresponding to the input device being utilized to engage the system directives, such as text-based and gesture-based directives, for instance, to perform system functions.

Although the present invention has been described in accordance with the embodiments shown, one of ordinary skill in the art will readily recognize that there could be variations to the embodiments and those variations would be within the spirit and scope of the present invention. Accordingly, many modifications may be made by one of ordinary skill in the art without departing from the spirit and scope of the appended claims.