U.S. Pat. No. 8,153,881

DETAILED DESCRIPTION

FIG. 1is an example of a video game system in accordance with aspects of the invention. The video game system includes a video game console101, a display103, and a controller105. The video game console includes internal circuitry which allows the console to run a video game by executing various program instructions related to proper execution of the video game. The video game console typically includes one or more processors, memory, and various interface circuitry. The program instructions for the video game are generally found on a removable memory source such as a video game DVD-ROM, inserted into a removable memory interface of the video game console. In some embodiments of the invention, the video game console may alternatively be a handheld gaming device, including similar internal circuitry as herein described, as well as, for example, a built in display or displays and various different game player input devices, or in some embodiments the video game console may be a computer, for example a personal computer.

The video game console is coupled to the controller by a wireless connection127, although it should be recognized that in many embodiments the controller and video game console may be coupled by a wired connection. The controller includes a rotatable platter on a housing. The rotatable platter in most embodiments has a generally flat upper surface. However, concave surfaces may be provided for example to provide tactile feedback to a game player to allow the game player to more easily locate inputs without looking at the controller. Input device or devices are carried by the platter. For example, in some embodiments, the input devices extend through the upper surface of the platter, with bases of the inputs within the platter. In some embodiments the input devices are on the upper surface of the platter, or in some embodiments within the platter. As illustrated inFIG. 1, the input devices are buttons. In other embodiments, the input devices may be touch sensitive regions, which in some embodiments may be considered buttons. In many embodiments, and also as illustrated inFIG. 1, the controller includes a further housing, with further inputs, although in some embodiments no further housing is provided and the further inputs are provided with the housing of the rotatable platter. The further inputs are generally utilized to cause or simulate cross fading, sound effects and other mixer-like inputs for a disc jockey, and the further inputs may therefore be considered mixer inputs. Similarly, the further housing maybe considered a mixer module, or if the mixer inputs are provided as part of the housing for the rotatable platter, a mixer portion of the video game controller.

In some embodiments, the mixer is coupled to a portion of the housing of a rotatable platter by way of connectors. In some embodiments the mixer has connectors on opposing sides, allowing a housing with a rotatable platter to be coupled to the connectors on either side of the mixer module. Alternatively, a housing with a rotatable platter can be coupled to the connectors on each opposing side of the mixer module. In various other embodiments other controllers may instead or additionally be used, for example generic controllers, microphones, other simulated or actual disc jockey turntable controllers, or other disc jockey controllers in the general form of other musical instruments. Circuitry within the housing or alternatively the further housing, determines status of the rotatable platter, of the input devices carried by the platter, and of the further inputs, and communicates an indication of the status to the video game console.

The video game console is also in communication with a display unit103, generally through an audio-video cable or similar wired connection, although a wireless connection may be used in some embodiments. The display unit is typically a television, although in some embodiments a monitor may be used, with a display screen131and at least one audio output device, such as a speaker133. In the embodiment ofFIG. 1, the display screen shows a screen shot141of video game play in a music-based video game. In addition, in some embodiments, a display screen and processor could instead or in addition, be located in the controller allowing the controller to be utilized independently of a video game console system.

As illustrated inFIG. 1, the display shows a screenshot of an example music-based video game. In the particular screenshot ofFIG. 1, the display includes a plurality of instructive cues. The instructive cues generally scroll across portions of the screen towards and into a predefined area of the screen, for example a screen area143, which may be referred to as a NOW zone. The display also shows a player score151, a hidden gem153, and a visual indicator representing a power meter155.

During video game play, a game player is to depress or have depressed various buttons115or manipulate or have manipulated various other input devices117such as the position of the cross fader on the mixer module of the controller responsive to the instructive cues, generally when the instructive cues reach a predefined area of the display such as the NOW zone143. Additionally, in most embodiments, a game player is to depress or have depressed at least one of the plurality of buttons119or manipulate or have manipulated at least one touch-sensitive area on the rotatable platter and/or rotate the rotatable platter of the controller clockwise or counterclockwise responsive to the instructive cues, again generally when the instructive cues reach a predefined area of the display such as the NOW zone143. In most embodiments the video game console evaluates the game player based on extent of compliance with operations commanded by the instructive cues, for example by providing a score, a simulated crowd response, and or some other feedback to the game player. In addition, the video game console generally commands presentation of audio consisting of a premixed and recorded DJ created song during video game play. In most embodiments audio of a musical selection is provided in various streams, with for example in some embodiments audio of a particular stream or streams provided, as the game player complies with the instructive cues, and silence, volume reduction or user generated sample representing a error or mistake, possibly depending on whether the game player operates incorrect input devices or does not operate any input devices, may be provided if the game player does not comply with the instructive cues.

In many embodiments, the buttons119(or alternatively touch-sensitive areas) of the rotatable platter113of the controller105correspond to a heads up display (HUT)) highway on the display. The HUD highway comprises a plurality of visual indicators which correspond to a plurality of audio streams. The audio streams may include music track streams and audio sample streams, for example, created and previously recorded by an actual Disc Jockey. In some embodiments, the audio may be created on the fly as a game player is playing. For example, as illustrated inFIG. 1, rotatable platter113is shown with 3 buttons119and the HUD highway comprises 3 visual indicators representing 3 audio streams with 2 of the visual indicators representing music track streams and 1 of the visual indicators representing an audio sample stream. As shown inFIG. 1, the visual indicators are in the form of a generally continuous strip or stream, with the strips following a somewhat curved pathway, representative for example of a portion of a circular curve or a record. In some embodiments, the music track streams are of at least 2 different music sources or songs. Alternatively, in some embodiments, for example with two players playing, 6 audio streams may be used, with 3 streams associated with a first player and 3 streams associated with a second player. In another embodiment, rotatable platter113may have 4 or more buttons corresponding to 4 or more visual indicators representing 4 or more audio streams in the game. Depressing one of the buttons119on the controller allows a player to perform an action related to an audio stream. In one embodiment, the rotatable platter113can be rotated clockwise or counterclockwise while buttons on the rotatable platter are depressed to produce predetermined sound modifications or to add additional sounds to the corresponding audio streams. For example, rotating the rotatable platter113clockwise then counterclockwise while depressing a button corresponding to a first audio stream may produce sound modifications or add additional sounds to the audio output and modifications to the visual indicator representing the first audio stream. In some embodiments, the modification may resemble a scratching sound effect, similar to that of a vinyl audio record being scratched by a turntable needle by moving the record forward and backward on a turntable. A highlighted stream section may indicate that a user may activate sound effects on a specific track by pressing the corresponding track buttons and manipulating a sound effects dial or other type of control.

In some embodiments, a rewind may be indicated as available by visual indicators and may be triggered, for example at a certain point in time in game play or after a game player has attained some achievement or goal during game play, when the rotatable platter113is rotated independent of any buttons119pressed, although in some embodiments rewind may be triggered through other manipulations of the controller. Rewind sets the audio streams and the visual indicators representing the audio streams to an earlier point in time in game play, with game play continuing from that point in time. This allows a player to replay a portion or portions of the audio streams, for example in a similar manner as performed by actual DJ's, and score additional points. In some embodiments, if rewind is triggered during predetermined portions of the audio streams or during portions determined during game play based on game criteria, the audio streams are set to earlier or later points in time, allowing a player to replay a longer portion or a shorter portion of the audio stream and score further points. Alternatively, the rewind section could introduce a completely new song or section, which may be complimentary to the current song.

In some embodiments, a player may continuously play through a plurality of audio tracks. For example, a player may select a plurality of audio tracks before beginning play and play through the plurality of audio tracks with a very minimal gap between the audio tracks. In some embodiments, the gap between audio tracks may be filled by simulated crowd noise, such as cheering, or other sound effects.

FIG. 2is an example of a block diagram of a video game console in accordance with aspects of the invention. In the embodiment ofFIG. 2, the video game console includes at least one processor211interconnected with other components via a system bus. The other components may include, for example, a main memory213of the video game console, a removable memory interface215, a user input/output port217, a wireless transceiver219, an audio driver221, a video driver223, an Internet input/output port227, and other circuitry229, which may include for example an infrared sensor. In other embodiments of the invention, there may be different combinations of components that make up a video game console, depending on the individual needs of each application.

The processor executes program instructions to provide music-based video game play, for example the music based video game described with respect toFIG. 1, as well as program instructions to provide for a user physical performance aspect to game play, for example as described with respect toFIG. 1or3. The processor may obtain program instructions from a removable memory source, for example, a video game DVD-ROM, inserted into the removable memory interface of the video game console. The processor also receives game player input signals from a video game controller, either through the user input/output port or the wireless transceiver. The processor processes the program instructions and received input signals to generate audio and video output signals representative of video game play.

The processor may also be in data communication with a display unit, generally combined with one or more speakers, which presents video game action to a game player of the system. The processor may send audio generation information to the audio driver, and video generation information to the video driver, each of which generates audio and video output signals, respectively, from the received generation information. The audio and video drivers forward the audio and video output signals through a combined display input/output port225, or alternatively, separate audio and video input/output ports, to the display unit.

In some embodiments, the processor is also connected to the Internet via either the Internet input/output port, or via the wireless transceiver. In a multiplayer option, a connection to the Internet may be used to facilitate multiplayer game play with other game players in remote locations. In some embodiments, an Internet connection may also be used by video game publishers to offer, for free or for sale, downloadable content associated with a particular game. In a music-based video game, downloadable content may include, for example, new songs, background audio tracks or other content.

FIG. 3is a flow chart of video game operations in accordance with aspects of the invention. The process may be performed by the video game console ofFIG. 1, or a processor of the video game console, for example as discussed with respect toFIG. 2.

In block309, the process commands display of instructive cues. In many embodiments, the instructive cues may comprise visual indicators instructing a player to enter an input or a plurality of inputs on a video game controller. The instructive cues generally scroll across portions of the screen towards and into a predefined area of the screen, such as the NOW area as discussed inFIG. 1. In some embodiments and for example in the embodiment illustrated inFIG. 1, a visual indicator of an audio stream is shown with a lateral shift. In some embodiments, this visual cue indicates that a cross fader input is to be used in the direction of the shift. For example and as illustrated inFIG. 1, the center audio stream is shown with a shift, to the right as illustrated, which indicates that the cross fader input is to be moved to the right. Additionally and also illustrated inFIG. 1, a visual indicator of a hidden gem is indicated on one of the audio streams. In some embodiments, this is an indication, for example, to depress a button on the rotatable platter corresponding to the audio stream as the hidden gem scrolls across the NOW area.

In simulated disc jockey game play using the disc jockey turntable deck video game controller, the buttons on the rotatable platter correspond to aspects of a heads up display (HUD) highway on the display. The HUD highway comprises a plurality of visual indicators which correspond to a plurality audio streams. The audio streams may include music track streams and audio sample streams. Depressing the buttons on the rotatable platter allows a player to perform actions related to the HUD highway and corresponding audio streams. In some embodiments, the rotatable platter can be rotated clockwise or counterclockwise while buttons on the rotatable platter are depressed to produce signals commanding the video game console to produce predetermined sound modifications or add additional sounds to the corresponding audio streams.

In block311, the process determines controller inputs. In many embodiments, the controller includes a rotatable platter on a housing. Input devices extend through the surface of the platter, although in some embodiments the input devices are on the surface of the platter. In many embodiments, the controller includes a mixer, comprising a further housing, with further inputs, although in some embodiments no further housing is provided and the further inputs are provided with the housing material with respect to the rotatable platter. The mixer may include other sound effects inputs such as a dial and/or touch sensitive pad, which could have their own visual feedback elements. The video game controller produces input signals detectable by the video game console. Player operation of various video game controller inputs produces various input signals detectable by the game console. For example, rotation of the rotatable platter produces a signal detectable by the video game console indicating rotation of the platter with the signal generally indicating position of the platter, updated over time. In some embodiments, upon rotation of the platter, a mechanical sensor produces a signal detectable by the video game console indicating velocity In some embodiments, the velocity may be an angular velocity. Similarly, usage of the cross fader input and depressing the buttons on the rotatable platter produces further signals, distinct and detectable by the video game console. In some embodiments, alternate, directional or continuous rotation of the rotatable platter produces signal patterns detectable by the video game console indicating that the platter has been rotated in a particular pattern, force, length and speed. Similarly, usage of the cross fader input and depressing the buttons on the rotatable platter produces further signals, distinct and detectable by the video game console.

In block313, the process determines if the controller input complies with the instructive cues. In many embodiments, the process evaluates game player compliance with the instructive cues, for example based on input signals provided by the controller operated by the game player. If the process determines that controller input complies with the instructive cues, the process proceeds to block315and provides positive user feedback. Otherwise, if the process determines that controller input does not comply with the instructive cues, process proceeds to block317and provides negative use feedback.

In block315, the process provides positive user feedback. In many embodiments, positive feedback may be comprised of additional points, positive visual indicators, a positive simulated crowd response, such as cheering, and/or some other positive feedback to the game player. In addition, the video game console generally commands presentation of audio during video game play. In most embodiments audio of a musical selection is provided as the game player complies with the instructive cues and the musical selection is provided without any interruption or reduction in volume.

In block317, the process provides negative user feedback. In many embodiments, negative user feedback may be comprised of muting, altering or reducing the volume audio tracks associated with the failed simulation action, no points being added to a player's score, negative visual indicators, a negative simulated crowd response, such as boos, and/or some other negative feedback to the game player. In some embodiments, negative user feedback may be comprised of a plurality of audio effects produced by modifying portions of the audio track. In some embodiments, portions of the audio track are modified by applying digital signal processing to portions of the audio track. In addition, the audio of a musical selection may result in a period of silence or a sound of a missed note, muting, altering or reducing the volume of the audio tracks associated with a failure to comply with an instructive cue possibly depending on whether the game player operates incorrect input devices or does not operate any input devices.

The process thereafter proceeds to block319and determines whether the process should exit, although it should be recognized that exit processing may occur through other methods, such as provision of an interrupt signal or otherwise. If the process is not to exit, the process goes to block309, otherwise the process returns.

FIG. 4is an embodiment of a video game controller in accordance with aspects of the invention. The video game controller can be considered to simulate a disc jockey turntable deck. The video game controller comprises a rotatable platter411on a housing413. Input devices415a-cextend through the surface of the platter, although in some embodiments the input devices are protruding or subsurface/recessed on the surface of the platter. For example, and as illustrated inFIG. 4, the input devices comprise three buttons on the surface of the rotatable platter. In many embodiments, and as shown inFIG. 4, the video game controller includes an additional housing417. As illustrated inFIG. 4, the additional housing includes mixer and effects inputs on or extending through the surface of the additional housing, although in some embodiments no further housing is provided and the mixer inputs are provided with the housing material with respect to the rotatable platter. In one embodiment, and as illustrated inFIG. 4, the input devices on or extending through the surface of the mixer housing comprise a pad421, a plurality of deck buttons423, a rotatable knob425, a cross fader or potentiometer, or slidable switch427, a button429, and a touch pad431or hand proximity or gesture sensor. In many embodiments the pad421and plurality of deck buttons423may be used to navigate a music-based video game menu system. In some embodiments, the pad and plurality of deck buttons may be further used during music-based video game play.

In some embodiments, the video game controller is the video game controller illustrated in the video game system ofFIG. 1, and may be used in accordance with a music based video game featuring playing of a simulated instrument, for example, a disc jockey turntable deck with multiple music source changes and scratching. In these embodiments, the video game controller ofFIG. 4may be operated by a user to generate input signals which are transmitted to a video game console. The video game console processes the input signals and generates audio and video outputs based on the operation of the video game controller. The audio and video outputs may be directed towards playing of the simulated disc jockey deck.

In many embodiments, a video game console include a rotatable knob425, where position changes of the knob may cause variation of the audio outputs and/or modifications to the visual indicators representing the audio streams. For example, the video game console may increase the output frequency of an audio stream upon determining that the rotatable knob is rotating clockwise. In many embodiments, a portion of the audio output is modified by applying digital signal processing to the portion of an audio track. In some embodiments, the rotatable knob425may be used at predetermined portions of the audio streams, although in other embodiments the rotatable knob may be used at any portion of the audio streams. In some embodiments, the rotatable knob may be considered as representative of an effects dial.

In many embodiments, the slidable switch or cross fader potentiometer427comprises a knob or button which slides along a track on a single axis. However, in some embodiments, the cross fader may comprise a touch sensitive strip. The slidable switch427may be considered as a cross fader input. In some embodiments, the cross fader may provide a blending capability and may sense gradual movement of the knob or button of varying degrees along the track. In many embodiments, the knob or button is at a neutral position when it is positioned at the center of the track. In some embodiments, the fader knob, or button automatically returns to the neutral position when released. The knob or button may be moved left or right along the track relative to the neutral position or the fader may determine that it was moved left or right from a more “general” center position. The fader may contain a center tactile “pocket” felt when sliding it.

In some embodiments, the songs that are played by the user are created and recorded by a professional DJ who mixed two or more songs together and added DJ scratching, sound effects and generated samples. In some embodiments, the music source is a prerecorded mix of standard songs separated into independent stems corresponding to each of the main control systems on the simulated DJ controller.

The cross fader may be used in conjunction with the platter buttons to simulate switching between a plurality of audio streams such as two DJ turntables which is typically 2 music streams. In many embodiments, the video game controller simulates a two platter system using only a single platter. For example, in a two platter system, each rotatable platter corresponds to an audio stream and a user may switch between audio streams by operating the appropriate platter; however in this embodiment, each button on the platter corresponds to an audio stream and therefore a user may switch between audio streams by depressing the appropriate buttons on the single platter. In some embodiments, and as discussed inFIG. 3, the music-based video game may provide instructive cues commanding a video game player to use the cross fader, although in other embodiments, a player may use the cross fader at any point during video game play. Compliance with the instructive cues may result in positive user feedback, while non-compliance with the instructive cues may result in negative user feedback. In some embodiments, for example in the embodiment illustrated inFIG. 1, the cross fader may be used to switch between a first music stream and second music stream. In one embodiment, a third audio stream comprised of audio samples, may always be active and unaffected by cross fader usage. When the knob or button is in a neutral position, all three audio streams are active and the audio output of all three audio streams may be heard. When the knob or button is in the furthest left position, only the first audio stream and the audio sample track may be heard. In many embodiments, the first audio stream corresponds to first music stream represented by a visual indicator generally positioned on the left on the HUD highway and represents usage of a left turntable. When the knob or button is in the furthest right position, only the second audio stream and the audio sample track may be heard. In many embodiments, the second audio stream corresponds to second music stream represented by a visual indicator generally positioned on the right of the HUD highway.

In many embodiments, a button429may be considered as an attack button. In some embodiments, the button429may be of a transparent material and may be illuminated during portions of music-based game play. The attack button may be used to trigger a plurality of effects during music-based video game play.

In many embodiments, the attack button may become available to be used after the game has reached a predetermined state; for example, once a player has completed portions of an audio stream without errors or has reached a predetermined score. In some embodiments, the attack button may become available to be used during predetermined portions of the audio streams or during portions determined during game play based on game criteria, although in other embodiments the attack button may be used at any portion of the audio streams. Additionally, the music-based video game may provide instructive cues to alert the player that the game is in a state where the attack button may be used. For example, in some embodiments, the attack button may be illuminated when it is valid for a player to use it. In some embodiments, the game display may provide a prompt or signal during music-based video game play, for example an indicator on the game display, or other visual, auditory, or other prompt.

In many embodiments, during single player music-based video game play, the attack button may trigger a game state which allows a player to possibly score further points. In some embodiments, the attack button may trigger a game state which increases the playing difficulty of a competing player in numerous ways. For example, in some embodiments, triggering the attack button may increase or decrease the overall speed of an audio track, making it more difficult for a player to comply with instructive cues at the proper moment. In some embodiments, using the attack button during single player game play activate a multiplier factor which increases player score. In many embodiments, during multi-player game play, the attack button may be used to modify another player's performance.

In many embodiments, the touch pad431may be considered as an effects pad. The effects pad may be used to produce sound modifications to the audio outputs and/or modifications to the visual indicators representing the audio streams. For example, moving a finger from left to right along the touch sensitive pad may increase the output frequency of an audio stream, while moving a finger from top to bottom along the touch sensitive pad may decrease output volume of an audio stream. In some embodiments, a visual indicator may be provided in the form of a line which displays patterns that may be replicated utilizing user input on the touch pad. In some embodiments, the touch pad may additionally contain a light source or further visual indicators that react to user inputs. In some embodiments, the effects pad may be used at predetermined portions of the audio streams, although in other embodiments the effects pad may be used at any portion of the audio streams and may provide sound effects that may be activated by the user.

FIG. 5shows a further embodiment of a video game controller in accordance with aspects of the invention. The video game controller ofFIG. 5includes a first housing511, with a rotatable platter513on top of and mounted to the first housing. In some embodiments, the platter may be rotatable a continuous 360 degrees, although in some embodiments, the platter may only be rotatable a predetermined number of degrees. In some embodiments, the platter may be freely rotatable, although in some embodiments, the platter may automatically return to a neutral or default position after it is rotated and released. As illustrated inFIG. 5, the rotatable platter is mounted on a mesa of the top of the first housing, with the mesa in substantially cylindrical form. The rotatable platter and the first housing therefore have an appearance similar to a vinyl record on a record turntable. The rotatable platter is coupled to the first housing by way of a shaft or other rotary connector. In general, electromechanical or optoelectrical components within the first housing measure relative position of the shaft, allowing for determination of relative rotational position of the rotatable platter. In some embodiments, the rotatable platter may be covered with decorative record covers and similarly, the housing may be covered with decorative housing covers.

The rotatable platter includes a plurality of touch sensitive regions51a-c. As shown inFIG. 5, three touch sensitive regions are provided, and the touch sensitive regions are arranged in concentric rings about the axis of the rotatable platter. The touch sensitive regions, which may for example comprise capacitive touch sensing elements or strips, provide user input devices on the rotatable platter. These user input devices are electrically coupled to circuitry within the first housing. Preferably these user input devices are electrically coupled to the circuitry within the first housing by a slip ring connector or other rotary electromechanical connector, preferably allowing unconstrained rotation of the rotatable platter about its axis. In some embodiments, the touch sensitive regions may comprise grooves or may be providing from the rotatable platter to provide improved tactile feedback to the game player.

In many embodiments, the circuitry within the first housing determines whether a touch sensitive region has been validly pressed. For example, in some embodiments, it may be useful to determine a time of occurrence of application of pressure to the touch sensitive region, as opposed to, for example maintenance of a finger of palm on the region. In one embodiment, the circuitry samples the state of each touch sensitive region a plurality of times, for example 256 times, and determines a super sample by taking the average of the 256 samples. The circuitry determines a first moving average using the super samples and a second moving average using the super samples. The first moving average and second moving average may be, for example, moving averages over a predetermined time window, with the first moving average a fast moving average and the second moving average a slow moving average. The moving averages in various embodiments may be weighted averages or exponentially weighted averages. A positive difference between the first moving average and the second moving average which is greater than a set threshold, indicates a button press.

A second housing517is coupled to the first housing, although in some embodiments the first housing and the second housing are combined in a single housing. In the embodiment ofFIG. 5the second housing is coupled to a side of the first housing. A plurality of user input devices are provided on a top of the second housing. As illustrated inFIG. 5the user input devices include a cross fader switch519, which may for example be used to provide a mixing related function in a video game, and accordingly the second housing and it user input devices may be considered a mixer module. In addition to the cross fader switch, the user input devices of the mixer module include a rotary switch, a plurality of buttons, and a touch sensitive pad.

FIG. 6is a perspective view of the mixer module ofFIG. 5, showing a side611of the mixer module intended to be mated with a side of a housing with a rotatable platter. The side of the mixer module includes a first connector613and a second connector615. The first connector and the second connector provide for electrical coupling of the mixer module with other units, for example a housing with a rotatable platter. The first connector and the second connector are configured for mating to corresponding connectors of a housing having a rotatable platter coupled thereto. In the embodiment ofFIG. 6the first connector and the second connector are female connectors, although male connectors may instead be used, or one male connector and one female connector.

An opposing side of the mixer module additionally includes similar connectors similarly positioned. The additional connectors allow for mating of the opposing side of the mixer module to a side of a housing with a rotatable platter, for example either a second housing with a rotatable platter or a housing with a rotatable platter, with relative position of input devices on the mixer module reversed with respect to a housing with a rotatable platter. Allowing for reversal of relative position of the input devices on the mixer module with respect to a housing with a rotatable platter may be convenient for positioning of input devices with respect to either hand of a game player, for example allowing for a “lefty flip” of a game controller comprising both a mixer module and a housing with a rotatable platter.

FIG. 7shows an example of an embodiment of a video game controller where a mixer module and a turntable module are physically separable in accordance with aspects of the invention. As illustrated inFIG. 7a, the mixer module and turntable module are shown as separate modules. A side of the turntable module is shown with a plurality of connectors. The connectors provide for electrical coupling of the turntable module with a mixer module, which also has a plurality of connectors. InFIG. 7b, the mixer module and turntable module are shown in the process of being coupled into a single video game controller unit. InFIG. 7c, the mixer module and turntable module are shown coupled together as a single video game controller unit.

FIG. 8is an example of a block diagram of a video game controller in accordance with aspects of the invention. In the embodiment ofFIG. 8, the video game controller includes a mixer portion and a turntable portion. The mixer portion of the video game controller includes at least one processor811interconnected with other components. The electrical connections may be, for example by way of a system bus or direction connections. The other components may include, for example, a source of power813, a transmitter815, a rotary input817, a cross fader input819, and for example button inputs implemented using a linear switch821. Additionally, the turntable component of the video game controller includes a rotary encoder823and further button inputs825. The rotary encoder823, for example, determines relative rotational position of a shaft, with the shaft coupled to a rotatable platter representative of a turntable. Signals indicative of the state of the other components are provided to the processor. The processor811provides input state information to the transmitter815, which in many embodiments is a wireless transmitter. The transmitter815is configured to transmit information, for example input state information, to a video game console or apparatus. As illustrated, the source of power813is present in the mixer portion, with power being provided to the turntable portion, for example a battery and additional power regulator circuitry, from the mixer portion. Alternatively, in some embodiments, a turntable portion may also include a source of power, a connector and flexible boom stand for a microphone for recording vocal samples or singing, a plug for headphones listening to and previewing and selecting samples, music sources or tracks for live mixing.

An optional beats per minute (BPM) or tempo dial, which can speed up or slow down any portion of or an entire song to make the song easier or more difficult to play or may be used as an effect.

In other embodiments of the invention, there may be different combinations of components that make up a video game controller, depending on the individual needs of each application. For example, a second turntable with a further rotary encoder and buttons may be coupled to the mixer. In the embodiment ofFIG. 8, further inputs827to the processor and an additional power supply829output are shown and may be used to couple a second turntable to the mixer and would require additional visual indicators to instruct the user which of the two turntable inputs are to be utilized.

The processor receives game player input signals from the video game controller inputs. Input signals are transmitted by the transmitter815to a video game console. The video game console processes the input signals received from the video game controller to generate audio and video output signals representative of a game player's inputs into the video game controller. In addition, in many embodiments, the mixer portion and the turntable portion are physically separable. In the embodiment shown, a power signal831is routed from the mixer portion, to the turntable portion, and back to the mixer portion. The return of the power signal831allows the mixer portion to determine presence of a turntable portion. Similarly, and in the embodiment shown, the mixer portion has a further power signal829, and further inputs to the processor827which allows a second turntable portion to be coupled to the mixer portion. The return of the power signal829from a second turntable allows the mixer portion to determine the presence of a second turntable portion.

FIG. 9shows an example of an embodiment of a video game controller where a mixer module913is coupled to two turntable modules. As illustrated inFIG. 9, the mixer module and turntable modules are shown coupled together as a single video game controller unit, with a turntable module911coupled to the left of the mixer module and a turntable module915coupled to the right of the mixer module. In some embodiments and as discussed inFIG. 7, the mixer module and turntable modules may be separable.

FIG. 10is a flow chart of video game operations in accordance with aspects of the invention. The process may be performed by the video game console ofFIG. 1, or a processor of the video game console, for example as discussed with respect toFIG. 2.

In block1009the process provides for music-based video game play. In many embodiments the process commands display of instructive cues and evaluates game player compliance with the instructive cues, for example based on input signals provided by a controller operated by the game player. In many embodiments the process also commands presentation of audio of a song or portions of a song, with extent of presentation of the song dependent on extent of compliance by the game player with the instructive cues. The process may also provide features of music-based video game play commonly found in music-based video games. In most embodiments the process provides for music-based video game play throughout or substantially throughout operation of the process.

Blocks1011-1017relate to cross fader usage during music-based video game play. In many embodiments, the cross fader comprises a touch strip, knob or button which slides along a track on a single axis. In many embodiments, the knob or button is at a neutral position when it is positioned at the center of the track. In some embodiments, the knob or button automatically returns to the neutral position when released. The knob or button may be moved left or right along the track relative to the neutral position.

In block1011, a visual indicator on a display representing an audio stream is laterally shifted, indicating that the cross fader is to be used. In many embodiments, the direction of the shift may indicate the direction that the cross fader is to be moved. For example, a visual indicator representing an audio stream may be shifted toward the left of the display, indicating that the cross fader knob or button is to be moved to the left along the track. Alternatively, a visual indicator representing an audio stream may be shifted to the right of the display, indicating that the cross fader knob or button is to be moved to the right along the track. In the preferred system, from a center position, the left line may only move/fade to the left and the right line may only move/fade to the right simulating left and right turntables.

In block1013, the process determines cross fader position. In many embodiments, a position of the knob or button along the track produces a signal from which the process may determine cross fader position. In some embodiments, movement of the knob or button along the track from a reference point produces a signal from which the process may further determine cross fader position.

In block1015, the process determines if cross fader position matches a predetermined position as indicated by the shifted visual indicator representing the audio stream. In some embodiments, the process determines if cross fader position movement matches a predetermined movement pattern as indicated by the shifted visual indicator representing the audio stream. In some embodiments, the process determines if cross fader position and an associated button press, button press duration or pattern and scratch platter rotating pattern matches a predetermined position as indicated by the shifted visual indicator representing the audio stream. If the cross fader position matches the predetermined position, the process proceeds to block1017. Otherwise, if the cross fader position does not match the predetermined position, the process proceeds to block1021. After performing the operations of block1017, the process proceeds to block1019.

In block1017, the process provides points. In some embodiments, the amount of points provided is correlated to how closely the cross fader matches a predetermined position as indicated by the shifted visual indicators representing the audio streams. In some embodiments, the amount of points provided is not affected by to how closely the cross fader matches the predetermined position.

In block1021, the process provides negative user feedback. In many embodiments, non-compliance with an instructed cross fade may result in negative user feedback such as silence or a muted audio track for a period of time. In some embodiments, the negative user feedback may be comprised of no points being added to a player's score, negative visual indicators, a negative simulated crowd response, such as boos, and/or some other negative feedback to the game player.

The process thereafter proceeds to block1019and determines whether the process should exit, although it should be recognized that exit processing may occur through other methods, such as provision of an interrupt signal or otherwise. If the process is not to exit, the process goes to block1009, otherwise the process returns.

FIG. 11is a flow chart of video game operations in accordance with aspects of the invention. The process may be performed by the video game console ofFIG. 1, or a processor of the video game console, for example as discussed with respect toFIG. 2.

In block1109the process provides for music-based video game play. In many embodiments the process commands display of instructive cues and evaluates game player compliance with the instructive cues, for example based on input signals provided by a controller operated by the game player. In many embodiments the process also commands presentation of audio of a song or portions of a song, with extent of presentation of the song dependent on extent of compliance by the game player with the instructive cues. The process may also provide features of music-based video game play commonly found in music-based video games. In most embodiments the process provides for music-based video game play throughout or substantially throughout operation of the process.

In block1111, the process determines if rewind has been triggered during music-based video game play. In many embodiments, rewind may be triggered by player input on a game controller; for example counter-clockwise rotation of a rotatable platter of the controller, although in some embodiments rewind may be triggered by clockwise rotation of the rotatable platter. In some embodiments, rewind may be triggered after the game has reached a predetermined state. For example, rewind may be triggered after a player has reached a predetermined score or met other performance criteria. In some embodiments, rewind may be available to be triggered during predetermined portions of the audio streams or during portions determined during game play based on game criteria, although in other embodiments rewind may be triggered at any portion of the audio streams. Additionally, the music-based video game may provide instructive cues to alert the player that the game is in a state where rewind may be triggered. For example, the game display may provide a prompt or signal during music-based video game play, for example an indicator on the game display, or other visual, auditory, or other prompt. In some embodiments, rewind mode may be triggered by a combination of player input on the game controller and game state. For example, rewind may be triggered by a counter-clockwise or clockwise rotation of a rotatable platter of the controller after the player has reached a predetermined score. If the process determines that rewind has been triggered, the process proceeds to block313and initiates rewind. Otherwise, or after performing the operations of block1113, the process proceeds to block1115.

In block1113, the process returns audio streams and visual indicators representing the audio streams to an earlier point in the audio streams. This allows a player to replay a portion of the audio streams and possibly score additional points. In some embodiments, an audio effect or an auditory cue is produced, signaling that rewind has been triggered. In many embodiments, an audio stream is divided into a plurality of predetermined portions. In some embodiments, if rewind is triggered during predetermined portions of the audio streams or during portions determined during game play based on game criteria, the audio streams are returned a further earlier point in the audio streams, allowing a player to replay an even greater portion of the audio stream and possibly score further points. In some embodiments, the number of portions that may be replayed during rewind may depend upon a plurality of factors, including timing of triggering rewind, a player score, or other criteria. In some embodiments, a player score may additionally be modified by a multiplier during replayed portions which further increases the score. In some embodiments the multiplier value is based on extent of compliance with operations commanded by the instructive cues during rewind. For example poor compliance may result in no multiplier modification and perfect compliance may result in a multiplier modification of doubling a player's score. In some embodiments, the multiplier value may decrease as compliance with the operations commanded by the instructive cues decreases or alternatively increase as compliance with the operations commanded by the instructive cues increases. The process thereafter proceeds to block1115and determines whether the process should exit, although it should be recognized that exit processing may occur through other methods, such as provision of an interrupt signal or otherwise. If the process is not to exit, the process goes to block1109, otherwise the process returns.

FIG. 12is an example of a video game system in accordance with aspects of the invention. The video game system includes a video game console1201, a display1203, and a controller1205. The video game console includes internal circuitry which allows the console to run a video game by executing various program instructions related to proper execution of the video game. The video game console is coupled to the controller by a wireless connection1227, although it should be recognized that in many embodiments the controller and video game console may be coupled by a wired connection. The controller includes a rotatable platter on a housing1213and a cross fader switch1215. The video game console is also in communication with a display unit1203, generally through an audio-video cable or similar wired connection, although a wireless connection may be used in some embodiments. The display unit is typically a television, although in some embodiments a monitor may be used, with a display screen and at least one audio output device, such as a speaker1233.

As illustrated inFIG. 12, the display shows a screenshot1231of an example music-based video game. In the particular screenshot ofFIG. 12, the display shows a heads up display (HUD) highway, comprising three lines, corresponding to a left music stream, a center audio sample stream, and a right music stream. As discussed inFIG. 3, the lines corresponding to the music streams may be shown with a lateral shift. The lateral shift indicates that a cross fader input is to be moved or positioned in the direction of the shift. For example, inFIG. 12, the line for the left music stream shows a lateral shift to the left is approaching a NOW area, indicating the cross fader switch should be moved to the left. An indicator of current cross fader position is shown approximately in a NOW area. The indicator of current cross fader position is graphically illustrated inFIG. 12as buttons in lateral slots. In the embodiment ofFIG. 12, presence of the buttons in portions of the lateral slots towards a center stream indicate the cross fader switch is in a middle or neutral position. The cross fader switch is indicated as being towards the left if both buttons are indicated as being towards a left side of their slot, and similarly the cross fader is indicated as being towards the right if both buttons are indicated as being towards a right side of their slot.

FIG. 13is an example of a video game system in accordance with aspects of the invention. The video game system includes a video game console1301, a display1303, and a controller1305. The video game console includes internal circuitry which allows the console to run a video game by executing various program instructions related to proper execution of the video game. The video game console is coupled to the controller by a wireless connection1327, although it should be recognized that in many embodiments the controller and video game console may be coupled by a wired connection. The controller includes a rotatable platter on a housing1313and a cross fader switch1315. The video game console is also in communication with a display unit1303, generally through an audio-video cable or similar wired connection, although a wireless connection may be used in some embodiments. The display unit is typically a television, although in some embodiments a monitor may be used, with a display screen and at least one audio output device, such as a speaker1333.

As illustrated inFIG. 13, the display shows a screenshot of an example music-based video game. In the particular screenshot ofFIG. 12, the display shows a heads up display (HUD)) highway, comprising three lines, corresponding to a left music stream, a center audio sample stream, and a right music stream. As discussed inFIG. 3, the lines corresponding to the music streams may be shown with a lateral shift. The lateral shift indicates that a cross fader input is to be moved or positioned in the direction of the shift. For example, inFIG. 13, the line for the left and right music streams show a lateral shift to the left approaching a NOW area, indicating the cross fader switch should be moved to the left. An indicator of current cross fader position is shown approximately in a NOW area. The indicator of current cross fader position is graphically illustrated inFIG. 13as buttons in lateral slots. In the embodiment ofFIG. 13, presence of the buttons in portions of the lateral slots towards the right indicate the cross fader switch as being towards the right.

Accordingly, the invention provides a disc jockey related music video game and a controller for a music video game. Although the invention has been discussed with respect to certain embodiments, it should be recognized that the invention comprises the novel and unobvious claims, and their insubstantial variations, supported by the disclosure.