U.S. Pat. No. 8,082,499

Embodiments of the disclosed invention will be understood more fully from the detailed description given below and from the accompanying drawings of embodiments of the invention, which, however, should not be taken to limit the invention to a specific embodiment but are for explanation of understanding only.

DETAILED DESCRIPTION OF THE INVENTION

Reducing selection time of text that varies widely from scene to scene in a simulated conversation program has been a significant challenge, particularly in the videogame industry. The typical approach has been to address the visual configuration of the interface. For example, pie menus, when used with an input device such as a mouse, can save time as compared to a drop-down list menu by reducing the distance the cursor must be moved to make a selection. Icons have been used to represent classes of character appearance for quick selection, and can conceivably be applied to dialog, however, this would limit the information provided to a user by not disclosing any portion of the text or a description of it beyond what an icon could disclose.

As is known in the art, consistent mapping of selectable options is the preferred format. For example, in a word processing program, the selections, “save,” “open,” “close,” “exit,” etc., are always presented in the same order, regardless of the document a user has accessed. Unfortunately, when dealing with phrases, sentences or other conversation segments, the same type of selectable mapping cannot be directly applied. The inventors, however, have devised a way by which the idea of consistent mapping can be applied to selecting phrases and sentences that vary from scene to scene.

A plurality of dialog classes is provided and a selectable conversation segment is provided for each class. The choice indicator presents each dialog class in the same position throughout at least a portion of the program. Preferably, this consistent mapping is used throughout the entire program so a user becomes familiar with positions of particular dialog classes. If not, it may, for example, be correlated to a specific character, so that each character will have its own unique positioning of classes on the choice indicator. This may be done, for example, if particular classes vary from character to character.

FIG. 1depicts a graphical interface10according to an illustrative embodiment of the invention. The graphical interface10is displayed on-screen during use of a computer program, enabling a user of the program to participate in a simulated conversation with the program, by means of which the user can select from among options presented by the program. Graphical interface10has a radial choice indicator12comprising a plurality of selectable slots14a-fproviding selectable options for responses18a-fpresented by the program.

The illustrative graphical interface embodiments shown inFIGS. 1-4show slots14a-farrayed in sequence around a band16. Optionally, a movable indicator13may be incorporated to indicate a selected slot14.FIGS. 1-4depict the band16as having circular geometry. It will be recognized that many different geometries are suitable and may be used, and that a different number of slots14may be used. Also, it will be recognized that alternative designs, such as a rectangle, pie design or a multi-pointed star design, may be substituted for the band16and are still considered to be in the spirit and scope of the disclosed invention.

Preferably, the position of each selectable slot14correlates with a particular type or class of selectable option for response18for input into the program, shown as different selections of responses labelled18athrough18finFIGS. 1,2and4. Through repeated use a user quickly becomes familiar with a position of a particular slot14corresponding to a class of response18.

This consistent mapping of classes of selectable options to choice indicator positions may provide significant time savings as compared to conventional systems. The reduction in time required to select an option provides a pace that more closely approaches that of real life conversations.

The graphical interface10is particularly advantageous for use when playing of a videogame. It is noted, however, that embodiments of the present invention can be applied to other programs, such as, for example, training or testing programs. The graphical interface10is displayed on-screen during the videogame, to enable a player to select from among pre-determined responses, thereby enabling the player to participate in a simulated conversation. The graphical interface10may be displayed at all times during a videogame, or only at selected times such as on those occasions when there is an opportunity or requirement for simulated conversation. The times at which the graphical interface appears may be determined by the program or by the user, or both.

When used in a videogame, as illustrated inFIG. 3, each of slots14represents a different selectable option for response18to a component in a simulated conversation.FIG. 4illustrates a set of possible responses18according to an illustrative embodiment of the invention.

Six slots14are illustrated inFIGS. 1 through 4. It can be seen that the number of slots14may be varied to address the requirements for different situations. However, for consistency and ease of use by a player in one or more videogames, it is preferable that the number of slots14remains the same throughout a videogame, and preferably throughout all videogame applications. It has been found through experience that use of six selectable slots14arrayed around the band16provides several advantages. When the number of slots14is consistently six and these are arrayed around an oval or circular band16, a videogame player rapidly becomes familiar with the design and use of graphic interface10, there is ease of use, and the six slots14provide capability to offer sufficient options among potential responses18in a simulated conversation.

A player of a videogame can select from among the responses18enabling the player to participate in a simulated conversation with characters within the videogame. Each of slots14provides a selectable response18for input into a simulated conversation with characters within the videogame. The input response18into the simulated conversation is preferably selected from a remark, as illustrated inFIGS. 3 and 4, an animate action, and/or a combination of remark and an animated action. The manner in which actions and dialog are indicated can differ to increase the speed by which a user can select an input. For example, dialog may be presented in quotes and action descriptions depicted without quotes. Additional differentiating features may be needed, if for example a combination of dialog and actions is also presented as a selection. Other illustrative differentiating features include, but are not limited to, colour and font.

To enable the player of a videogame to respond rapidly, the nature of the responses18at any one of slots14athrough14fis similar in nature for each element of each conversation, i.e. can be categorized into a particular class of responses. It has been found through testing that players readily become familiar with and comfortable using the following options for assignment of six slots14for dialog choices comprising different types of response18.

DIALOG CLASSPARAPHRASEFIG. 4 REFERENCE NUMBERAgree“I know you do”14 aDisagree“No you don't”14 bAsk a question“But why?”14 cHostile“That's enough!”14 dFriendly“You're the best!”14 eEnd Conversation“Goodbye14 f

The chart above provides illustrative examples. In general, the classes can be any definable conversation segment type. The paraphrases can be any description or portion of the conversation segment they identify. Full conversation segments can also be displayed on the choice indicator.

Through the consistency of this arrangement, the player will know that a positive response18will always require selection of one particular slot14(for example, “Agree” response18acorresponding to slot14ainFIG. 2), and that a negative response will always require selection of a different slot14(for example, “Disagree” response18bcorresponding to slot14binFIGS. 2-4).

To further enhance the consistency of location of selections, the graphical interface can correlate with the configuration of buttons or other selection mechanisms on a control device. For example, if a control device has four buttons disposed in a circular configuration, the graphical interface can be a radial indicator with four slots. A mechanism to select the desired graphical interface configuration can be included so a user can choose one that most resembles the layout of the control device being used, or is otherwise most desirable.

In a particular embodiment of the invention, paraphrases appear in the slots while the associated full text appears at another location of the graphical interface, for example at the center of a radial interface. The full text will appear when a slot is highlighted or otherwise identified. A threshold time period, during which a slot is highlighted or otherwise identified, can be used to trigger appearance of the full text, or it can occur relatively instantaneously. If the text is extensive, the ability to scroll through it can be provided. Scrolling through the text can also be initiated by merely highlighting or otherwise indicating a slot over a period of time.

In a further embodiment of the invention, colours are used to identify the dialog classes. The colours can be used either alone or in conjunction with the text. Colours can help a user more quickly locate the desired class of text. To enhance that capability, the colours can correlate with the dialog class, such as having red for an angry response, yellow for a pleasant response, etc.

A slot can also be consistently used during at least a portion of the program to represent input from a character other than the main character. In an illustrative example, a representation of the character appears in a slot. The character appearing may differ, but it will always appear in the same slot. In a further embodiment of the invention particular characters appear in particular slots.

Referring toFIGS. 2-4, optionally, when response18is a remark, selection of a selectable slot14activates a voice-over vocalization of the selected remark into the simulated conversation.

Optionally, paraphrases can be assigned to each selectable slot14.

It has been found from experience that graphic interface10is more easily used when selectable slot14is initially highlighted before selection, as illustrated inFIGS. 1 through 4. It has also been found that incorporation of movable indicator13enables a user to more readily identify which among slots14has been selected or can be selected.

Optionally, highlighting selectable slot14before it is selected during playing of a videogame initiates animated movements of the corresponding videogame character.

Optionally, selection of selectable slot14while another among the videogame's characters is speaking causes that videogame character's remarks to be cut-off, which provides an effect that more closely simulates a real life conversation as compared to conventional programs.

Referring to the illustrative embodiment ofFIG. 3, a scene20is being displayed on a screen22of a viewing device such as a monitor24. The characters26in scene20have information the player needs to continue to progress in the videogame. To access the information, the player needs to engage the characters in a simulated conversation.

The contributions by one or more videogame characters26to a simulated conversation can be effected through on-screen dialog, using bubbles, captions or menus, or through pre-recorded voice-over vocalizations, or both, all of which are familiar within the art. When, during a role playing game using pre-recorded voice-overs, the player selects a remark from among options presented by graphical interface10, that player's own character26will “speak” the remark, and an audible simulated conversation will be conducted.

Some advantages of embodiments of the present invention will now be demonstrated by comparison with typical examples of prior art interfaces used in videogames as depicted inFIGS. 5-7.

Referring toFIG. 5, a first type of prior art interface100is exemplified in the recent videogame “Pandora Directive.” A scene is reproduced as a line drawing. Players are given a vertical list of “themes”102that describe each available dialog line. When a player makes a choice, the player-controlled character126is shown speaking the chosen line through the use of voice-over. Since the actual text of each dialog lines is not listed in full, the player is able to make a faster decision and can enjoy listening to the player-controlled character126speaking the chosen line. A drawback to the use of this type of interface system100is that the choices and inputs are different each time, so the player cannot learn to instinctively respond—thus causing some delay in player response and preventing the feeling of intuitively responding as part of a natural conversation between player-controlled character126and other characters26.

Referring toFIG. 6, alternatively, a second type of prior art interface200used in some videogames simply lists the available dialog options that are available to the player at the current point in the conversation, as illustrated by a line drawing of a scene20from the videogame “Jade Empire.” In many such videogames, players are presented with interface200comprising a vertical list of dialog lines204, written out in their entirety. Other recent typical examples of such videogames include “Star Wars: Knights of the Old Republic”. The player reads through each of lines204, then chooses the one that they wish player-controlled character126to speak. Since the player must read through each entire line206, the decision takes a considerable amount of time, and once the player makes a choice, the chosen line206is already known in full—thus making it redundant to play an audible voice-over line.

FIG. 7depicts a third type of prior art interface300. In the third type of prior art interface300, players can use an analog input such as a thumbstick on an Xbox® controller to select options302placed around the outside of indicators304, shown inFIG. 7as an oval.FIG. 7shows a line drawing of a scene from one example of the videogame “The Indigo Prophecy” using the third type of prior art interface300. In this videogame, players are presented with several dialog options302, each represented by a very brief description306of its response type. In this example, indicator304is above each description306. A direction the player must push on the thumbstick to choose option302is shown as a bright spot on indicator304. This interface system300also has the drawback of inconsistent mapping of inputs to response types, resulting in a lack of clarity about what is meant by the short paraphrases306used to present options302.

The drawbacks of prior art interface systems100,200,300can be reduced by embodiments of the present invention, such as by graphical interface10shown inFIGS. 1-4. Because it provides a consistent mapping of inputs to response types, graphical interface10allows the player to make informed choices relatively quickly, thus enabling the system using interface10to simulate verbal conversation at a pace similar to that of real-life conversations.

The consistent mapping of interface10may also work to enhance the effect of using paraphrases instead of complete dialog lines. In a system without consistent mapping, as illustrated byFIG. 7for the third prior art interface300, short paraphrases of lines can be very difficult for the player to decipher. Consider an example where the player-controlled character126is asked to do a job for another in-game character26. In a game that uses an interface with inconsistent mapping, a dialog line with a paraphrase of, for example, “Someone else” may not provide enough information for the player to understand what the corresponding dialog line would entail. When using the graphical interface10of the present invention however, the player will see that each of selection of dialog responses18a-18fsits in one of the consistently-mapped dialog slots14a-14f. InFIG. 7, for example, the player may see that it is in the “Hostile” slot14d, thus implying that the line will involve a response14where the player aggressively demands that the other character find someone else to do the job.

An illustrative embodiment of the method of use of the graphical interface10will now be described. The graphical interface10can be used for many videogame applications. The graphical interface10is particularly useful for games in which the player-controlled character126engages in branching dialog conversations with in-game characters26. Selection of a particular response by selection of one of slots14determines the next part of the conversation or, in a different context, the next component within the videogame.

A menu, such as a radial menu can present selectable input in terms of two or more axis. For example, the choices presented horizontally can be agree and disagree, so that opposite classes appear opposite one another along an axis. The choices presented vertically can be, for example, continue conversation and exit conversation, so again opposite classes are opposite one another. This is only one example of an implementation of the system of interface10, which can be adapted to a variety of interfaces and numbers and positions of classes of response18.

The graphical interface and associated programming can be designed so a user can choose the position of each dialog class. The user may also choose the dialog classes to be presented on the graphical interface by being provided with a list of classes or groups of classes.

Control input is effected by selection from among responses18represented by slots14. By assigning specific control inputs to specific classes of response, always using the same slot14for the same type of response18, a player can learn to instinctively respond to an in-game character. Especially when dialog lines are implemented as playback of pre-recorded voice-over, this system enables the player to be in control of a real-time, branching conversation where game characters26,126speak to each other audibly and at the pace of a normal conversation.

The use of highlighting selected slot14, indicator13, or the combination of indictor13and highlighting slot14enables a videogame player to readily and rapidly identify which among slots14is selected for activation.

One preferred example of use of graphical interface10for use in a videogame will now be described. In addition, a series of optional elements may be included to enhance the utility and versatility of graphical interface10, and the enjoyment of a videogame by players.

The illustrative embodiments of graphical interface10for use with videogames are readily utilized by use of a videogame console's analog thumbstick and button. In one protocol for using these elements, the player can rotate the thumbstick to highlight a slot14, and/or to move indicator13to identify slot14, for a response selected from among dialog classes18a-18f, and press the button to engage the dialog response18.

It will be recognized that other types of human interface controller, including, but not limited to, a joystick, touchpad, or a keyboard can be used to enable a user to interact with graphic interface10. Embodiments of the graphical interface, however, are particularly suitable to be used with a directional input device, such as a joystick, as opposed to a non-directional device such as a mouse. The immediacy and definitiveness of a directional input device serves to facilitate the selection speed. A non-directional input device, such as a mouse, must be moved to a particular point or range of points. To be sure that range will not be overshot, the mouse must be moved at a slower rate compared to the rate at which a directional device can be moved. Accordingly, for most applications, embodiments of the invention are preferably used with a console device having a directional input. A non-directional input device, such as a mouse, however, can still be used with embodiments of the invention.

The embodiment illustrated inFIG. 4associates paraphrases of the dialog lines18that are available for selection with their respective dialog choice slots14. This allows the player to get a more specific idea about what the corresponding dialog line18will say, without requiring the player to read the entire text of dialog line18.

Optionally, in periods during the videogame when the player is not permitted to engage a dialog choice (for example, because another character is speaking), graphical interface10can be used by the player to make an input, which can be used to play appropriate animations on the player-controlled character126. For example, while another character26is saying something with which the player disagrees, if the game presently is not ready to accept a dialog choice from the player, the player can engage a “disagree” input causing the player-controlled character126to play a “disagree” animation. This enhances the player's sense of immersion in the game by permitting the player to act out their feelings even before they select a dialog line.

The radial menu shown as graphical interface10inFIGS. 1-4allows players to highlight and/or indicate a choice of response18before selecting it. Optionally, this two-stage selection method allows players to put their character126into an animation state corresponding to the highlighted slot14before the game is ready to receive the input of a dialog response18.

By allowing the player to engage a control input before the other game character26is finished speaking a dialog line, the player can “cut off” that game character26in mid-speech, thereby simulating a behaviour that is sometimes desirable in a real-life conversation.

FIG. 8depicts an interactive computer game system according to an illustrative embodiment of the system. A support structure2contains a display1and right and left speakers (audio projection device)3R,3L. Display1can be any display mechanism compatible with the system and having the ability to display graphical interface. A television can, for example, serve as a display device. Display1is functionally connected to a hardware platform (such as a computer or gaming console)8by an audio/visual cable6. The hardware platform8is functionally connected to controller5by cable9. The Hardware platform preferably has a power switch7and is connected to, or contains, a power supply (not shown). The player interacts with the software using the controller5, by moving the analog stick4or pressing buttons10

FIG. 9is a schematic of an interactive computer system according to an illustrative embodiment of the invention. The schematic represents a generalized system900commonly found in a computer or gaming console that would support a software program that operates embodiments of the innovation. A central processing unit (CPU)902works with other processing units904to conduct the basic mathematical and logical operations required by the software code. The CPU(s) work with one or more memory buses906that allow storage and retrieval of software data. The software that is running on the CPU(s) communicates with an audio/video interface908,910that allows output of visual display and sound that are generated by the software. The software can also receive control inputs through a control interface912which provide user inputs to the software. A system interface914receives power to operate the various components from a power supply. It is noted that other system configurations can be used to implement embodiments of the invention, including, but not limited to, handheld devices such as personal digital assistance (PDA) devices, pocket personal computers (PCs), telephones, and handheld videogame devices, such as Game Boys.

FIG. 10is a flow chart showing a method of creating conversation in a computer program according to an illustrative embodiment of the invention. A plurality of dialog classes is provided in block30. In block32, dialog is assigned to each of the classes. The order of these steps can be reversed. The dialog includes conversation segments, which can be one or more words, phrases and/or sentences. It is preferable for each class to contain dialog, however, it is not mandatory, and thus, one or more classes may appear blank. Leaving a blank space maintains the mapping consistency. At other points of the program dialog classes may be removed.

Block34indicates the display of the graphical interface, which provides a choice indicator so a user may select a dialog input. Each slot is associated with a dialog class and, when selected provides a dialog choice. In block36, via the graphical interface, the user chooses from the six selectable slots corresponding to inputs1-6. Although six slots have been shown to be an optimum number for many applications, other numbers of choices may also be used. The slot can be designated by one or more words to indicate the nature of the dialog without revealing the entire conversational segment. Alternatively, the entire dialog can be revealed. The graphical interface is consistent as to the position of dialog classes throughout at least a segment of the program so the user becomes familiar with the location of particular types of response, thereby minimizing selection time.

Once a dialog choice is made, the corresponding character voice-over line is played and associated animation is displayed (block38). In block40, it is determined whether the conversation has ended. This can be by user selection or software instructions. If the conversation is not over, then voice-over lines are played for a non-player character and any associated animation is displayed as shown in block42. The conversation is exited in block44whenever the conversation is over. This determination is made after each player character and non-player character speaks, displays animated movement or otherwise carries out an action or is cut-off from an action by a user input or software direction. So, for example, the determination of whether the conversation is over is made again in block46.

The invention further includes a computer readable medium for executing the method and displays described herein.

While the invention has been described by illustrative embodiments, additional advantages and modifications will occur to those skilled in the art. Therefore, the invention in its broader aspects is not limited to specific details shown and described herein. Modifications, for example, to the visual appearance of the graphical interface, the type of program in which the interface is utilized and the types of dialog classes may be made without departing from the spirit and scope of the invention. Accordingly, it is intended that the invention not be limited to the specific illustrative embodiments, but be interpreted within the full spirit and scope of the appended claims and their equivalents.