U.S. Pat. No. 9,415,315

DETAILED DESCRIPTION OF NON-LIMITING EXAMPLE EMBODIMENTS

FIG. 1illustrates an example block diagram of a configuration of a game system according to an embodiment. In the game system according to the present embodiment, a plurality of portable game apparatuses1having a wireless communication function transmit and receive information to and from each other through a network5. By virtue of this, the game system realizes a game participated by a plurality of players. The present embodiment is described for a configuration that the game apparatuses1are of portable type. However, the game apparatuses may have another configuration of floor-standing type and the like. Further, the game system may be constructed from the game apparatuses1having mutually different configurations.

Each game apparatus1includes a processing part10, a display part11, a recording medium attachment part12, a primary storage part13, a secondary storage part14, a wireless communication part15, an operation part16, and a microphone17. The processing part10of the game apparatus1is constructed from an arithmetic processing unit such as a CPU (Central Processing Unit). The processing part10reads onto the primary storage part13a game program9stored in the secondary storage part14or a game program9recorded in a recording medium7attached to the recording medium attachment part12, and then executes the program. By virtue of this, the processing part10performs various kinds of information processing concerning the game. For example, the processing part10performs the processing of generating information for communication on the basis of sound information acquired through the microphone17. For example, the processing part10performs the processing of generating an effect image on the basis of received information. For example, in response to a accepted input operation or an event in the game, the processing part10performs the processing of generating a game image to be displayed on the display part11.

For example, the display part11is constructed from a liquid crystal panel. The display part11displays the image provided from the processing part10. The recording medium attachment part12is constructed such that a recording medium7of disk type, card type, or the like is allowed to be attached thereto and detached therefrom. The processing part10is allowed to read the game program9or other data from the recording medium7attached to the recording medium attachment part12. The primary storage part13is constructed from a semiconductor memory device or the like. The primary storage part13temporarily stores various kinds of data generated in association with arithmetic processing of the processing part10. The secondary storage part14is constructed from a nonvolatile storage device having a larger capacity than the primary storage part13. The secondary storage part14stores the game program9, other data and the like.

The wireless communication part15transmits and receives data to and from other game apparatuses1, a server apparatus or the like through the network5such as a wireless LAN (Local Area Network) and a portable telephone network. For example, the game apparatus1performs communication with the server apparatus through the wireless communication part15so as to download the game program9. The game apparatus1is allowed to store the downloaded game program9into the secondary storage part14. The operation part16has cross keys, an analog stick, push buttons, a touch panel, or the like. The operation part16accepts an operation input from the player and then reports the operation input to the processing part10. The microphone17acquires sound in the surroundings of the game apparatus1and then provides a signal to the processing part10. The microphone17acquires, for example, uttered voice and the like of the player.

In the game apparatus1, the processing part10executes the game program9so that an sound information acquisition processing part21, a communication data generation processing part22, a communication processing part23, an effect image generation processing part24, a game processing part25, a display processing part26, and the like are realized as software-based functional blocks. Here, a configuration may be employed that all or a part of the sound information acquisition processing part21to the display processing part26are realized as hardware-based functional blocks.

The sound information acquisition processing part21of the processing part10performs the processing of acquiring sound information of the surroundings of the game apparatus1through the microphone17. The sound information acquisition processing part21performs sampling with a given period onto the sound provided from the microphone17and thereby acquires sound information. The sound information acquisition processing part21provides the acquired sound information to the communication data generation processing part22. For example, the sound information acquisition processing part21acquires the sound information as data in the form of PCM (Pulse Code Modulation), AAC (Advanced Audio Coding) or the like.

On the basis of the sound information acquired by the sound information acquisition processing part21, the communication data generation processing part22of the processing part10performs the processing of generating communication data to be transmitted to other game apparatuses1. The communication data generation processing part22generates information indicating a change in the amplitude in the frequency domain for the provided sound information. By virtue of this, the communication data generation processing part22generates communication data having a smaller data amount than the sound information. The communication data generation processing part22provides the generated communication data to the communication processing part23. The communication data generated by the communication data generation processing part22is provided as information concerning the own apparatus to the effect image generation processing part24also. In the present embodiment, the game apparatus1does not transmit to other game apparatuses1the sound information itself acquired by the sound information acquisition processing part21. In the present embodiment, the communication data generated by the communication data generation processing part22has a different data format from that of the sound information provided from the sound information acquisition processing part21.

The communication processing part23of the processing part10performs the processing of transmitting the communication data generated by the communication data generation processing part22, to other game apparatuses1participating in the game. Further, the communication processing part23performs the processing of receiving the communication data transmitted by other game apparatuses1. The communication processing part23adds information such as a header or footer to the communication data provided from the communication data generation processing part22, and thereby generates information in a form suitable for the protocols of the wireless communication. The communication processing part23provides the generated information to the wireless communication part15so as to transmit the information to other game apparatuses1. The communication processing part23receives through the wireless communication part15the information received from other game apparatuses1. The communication processing part23extracts required information from the received information. The required information is, for example, communication data generated by the communication data generation processing part22of each of other game apparatuses1. The communication processing part23provides to the effect image generation processing part24the information extracted from the received information. Here, the communication processing part23also performs the processing of transmitting and receiving other information necessary for the game.

The effect image generation processing part24of the processing part10performs the processing of generating an effect image to be displayed on the display part11. The effect image generation processing part24generates this effect image on the basis of the communication data received from other game apparatuses1and the communication data concerning the own apparatus generated by the communication data generation processing part22. In the present embodiment, the effect image generated by the effect image generation processing part24is an image varying in accordance with a change in the sound acquired through the microphone17in each game apparatus1. The effect image generation processing part24generates one effect image for each game apparatus1. The effect image generation processing part24provides the generated effect image to the display processing part26.

The game processing part25of the processing part10performs the processing of accepting an input operation of a player inputted through the operation part16. In accordance with the accepted input operation, the game processing part25performs various kinds of processing of object control, game judgment and the like related to the game. For example, in accordance with the input operation, the game processing part25generates movement, action or the like in a player object. For example, the game processing part25performs generation, arrangement, movement and the like of an object other than the player object. Objects other than the player object include an enemy object (an object which is not an operation target of the user), a background or obstacle object, and a field object in which these objects are arranged. For example, the game processing part25performs the processing of judging the success or failure of an action such as attack, evasion and the like of the player object performed in accordance with the input operation. For example, the game processing part25performs the processing of judging whether conditions of victory or defeat in the game have been satisfied. The game processing part25provides the result of such processing to the display processing part26.

The display processing part26of the processing part10performs the processing of generating and displaying a game screen onto the display part11. The display processing part26generates this game screen on the basis of the result of the game processing provided from the game processing part25, the effect image provided from the effect image generation processing part24and the like. The display processing part26generates as a game image the image in which a plurality of objects arranged by the game processing part25are drawn. At that time, the display processing part26arranges respectively the effect images generated by the effect image generation processing part24, in the vicinities of the plurality of player objects corresponding to each game apparatus1or each player participating in the game. The display processing part26provides the generated game image to the display part11. As a result, the game screen is displayed on the display part11.

Next, an example of a game performed by the game program9according to the present embodiment is described below.FIG. 2is a schematic diagram illustrating an example of a game screen displayed by the game program9according to the present embodiment. In the game screen of the present example, four tank objects101serving as player objects and a plurality of obstacle objects105are arranged within a substantially rectangular field surrounded by four walls. The four tank objects101are colored differently from each other. Thus, the four tank objects101are distinguishable from each other in the game screen displayed on the display part11. Here, inFIG. 2, different coloring is expressed by different shading.

Each of the four tank objects101is in one-to-one correspondence to each game apparatus1participating in the game. In the game of the present example, each of the plurality of players uses corresponding one of the game apparatuses1. Then, each player operates one tank object101assigned to each game apparatus1. After the game is started, each player operates one tank object101so as to attack the tank objects101operated by other players. The illustrated game screen expresses a state obtained after the game start. In this game screen, certain tank objects101perform attacking actions. For example, each player performs a moving operation for the tank object101by using the cross keys provided in the operation part16of the own game apparatus1. For example, each player performs an attack (bombardment) operation by the tank object101by using a push button.

When the player has performed a bombardment operation, an artillery shell102is discharged from the tank object101. The discharged artillery shell102travels in a particular direction. When the artillery shell102goes into contact with one of other tank objects101, this tank object101is destroyed and hence is defeated in the present game. When the artillery shell102goes into contact with an obstacle object105, the course of the artillery shell102is reflected at the point of contact with the obstacle object105. Then, the artillery shell102travels in the direction of reflection. After discharged from the tank object101, the artillery shell102continues traveling within the field until a given time such as 10 seconds elapses. The artillery shell102disappears after going into contact with one of other tank objects101or after the given time has passed. The players operate the individual tank objects101so as to attack each other. Then, a tank object101having remained to the end without being destroyed becomes the victory object in the game of the present example.

In the game of the present example, a speech balloon103is displayed in the vicinity of each tank object101. The speech balloon103is in one-to-one correspondence to each tank object101. That is, the speech balloon103is in one-to-one correspondence to each game apparatus1and each player operating the game apparatus1. The speech balloon103is an image generated as an effect image by the effect image generation processing part24of the processing part10. Each speech balloon103in the figure is a polygonal geometrical figure obtained by joining a plurality of vertices. Then, a waveform is illustrated inside. The speech balloon103is generated on the basis of sound information collected through the microphone17of each corresponding game apparatus1. In the speech balloon103, a change is made in the vertex positions of the polygon, the shape of the waveform inside and the like in accordance with a change in the sound information.

FIGS. 3 to 8are schematic diagrams used for describing details of a generation method for the speech balloon103. In the processing part10of each game apparatus1, the sound information acquisition processing part21repeats sampling of sound input through the microphone17with a given sampling period. The sound information acquisition processing part21provides sound information obtained by accumulating the sampling results for a given time, to the communication data generation processing part22. The upper part ofFIG. 3illustrates an example of the sound information. The sound information acquired by the sound information acquisition processing part21may be expressed as amplitude-to-time characteristics. The communication data generation processing part22performs Fourier transformation on the provided sound information. By virtue of this, the communication data generation processing part22transforms the sound information expressed as amplitude-to-time characteristics into frequency components in the amplitude-to-frequency characteristics. The lower part ofFIG. 3illustrates an example of frequency components generated by Fourier transformation processing by the communication data generation processing part22.

The communication data generation processing part22divides into a plurality of frequency intervals the information of frequency components generated by Fourier transformation processing.FIG. 4illustrates an example where the amplitude-to-frequency characteristics illustrated in the lower part ofFIG. 3are divided into eight frequency intervals 1 to 8. In the example in the figure, the intervals 1 to 8 have mutually equal widths. However, the intervals 1 to 8 may have different widths. The communication data generation processing part22calculates the average of the amplitude for each of the eight intervals 1 to 8. InFIG. 4, the average of the amplitude in each interval 1 to 8 is illustrated as a horizontal solid line. The communication data generation processing part22calculates a follow value that follows the average for each of the eight intervals 1 to 8. InFIG. 4, the follow value in each of the intervals 1 to 8 is illustrated as a horizontal dashed line, and the follow direction of each follow value is indicated by an arrow.

The sound information acquisition processing part21repeats the acquisition of sound information with a given period. Similarly, the communication data generation processing part22repeats the calculation of the average and the follow value of each of the intervals 1 to 8. In the first turn of this repeat, the communication data generation processing part22sets the follow value to be equal to the average at that time point. In the next and subsequent turns, the communication data generation processing part22calculates the average at that time point of each of the intervals 1 to 8 and then increases or decreases the preceding follow value by a given amount in a direction of causing the follow value to approach the average. For example, in a case that the preceding follow value is 100 and the present average is 150 and that a given increase or decrease value is 10, the communication data generation processing part22calculates the present follow value as 100+10=110. For example, in a case that the preceding follow value is 100 and the present average is 60 and that a given increase or decrease value is 10, the communication data generation processing part22calculates the present follow value as 100−10=90. Here, the amount of increase or decrease may be not fixed. For example, the amount of increase or decrease may be set to be 10% or the like of the difference between the average and the follow value. Alternatively, the amount of increase or decrease may be set to be 10% or the like of the average.

The communication data generation processing part22calculates the difference between the average and the follow value for each of the intervals 1 to 8, and then adopts the obtained value of difference as communication data. That is, the communication data of each of the intervals 1 to 8 is equal to the average minus the follow value. Here, in the present embodiment, when the calculated difference has a negative value, the communication data generation processing part22sets the communication data to be 0. That is, the communication data has a non-negative value. In such a configuration that no negative value is used as the communication data, the amount of data transmitted and received between the game apparatuses1is reduced and hence the load of processing in the downstream stages using the communication data is reduced.

In the game apparatus1, the communication data generation processing part22generates eight pieces of communication data from the sound information acquired by the sound information acquisition processing part21. Here, in the present embodiment, the game apparatus1transmits to other game apparatuses1only one of the eight pieces of communication data generated by the communication data generation processing part22, and does not transmit the other seven pieces. The communication data generation processing part22selects one from the eight pieces of communication data and then provides it to the communication processing part23so as to perform transmission to other game apparatuses1. At that time, the communication data generation processing part22selects and transmits the communication data in a given order like interval 1→interval 2→ . . . →interval 8→interval 1. Thus, for the sound information of one turn acquired by the sound information acquisition processing part21, the communication data of one interval alone is transmitted to other game apparatuses1. Thus, when the communication data generation processing part22has processed the sound information of eight turns, the communication data of all intervals is transmitted to other game apparatuses1. Here, the communication data generation processing part22need not generate the communication data of all eight intervals in response to the sound information of one turn. A configuration may be employed that the communication data generation processing part22generates the communication data of necessary one interval alone. Another configuration may be employed that the communication data generation processing part22collects the differences of a plurality of intervals (two intervals to eight intervals) into one piece of communication data and then transmits the communication data to other game apparatuses1.

The communication processing part23transmits the communication data of one interval generated by the communication data generation processing part22, to other game apparatuses1participating in the game. Further, the communication processing part23receives the communication data of one interval transmitted by other game apparatuses1, and then provides the data to the effect image generation processing part24. Further, the communication data generation processing part22transmits to the effect image generation processing part24the same communication data of one interval as that transmitted to other game apparatuses1. Thus, the effect image generation processing part24acquires the communication data of all game apparatuses1participating in the game. On the basis of the provided communication data, the effect image generation processing part24generates an image of speech balloon103as an effect image for each game apparatus1.

As illustrated inFIG. 5, the speech balloon103generated by the effect image generation processing part24has a shape constructed from a base part of substantially triangle shape and from a part having a substantially decagon shape in which a waveform is drawn inside. The speech balloon103is displayed in the vicinity of the rear side of the corresponding tank object101relative to the direction of movement with the base part directed to the tank object101. The illustrated speech balloon103is a polygon having eleven vertices. In the speech balloon103, the positions of eight vertices other than the three vertices constituting the base part of substantially triangle shape vary in accordance with the difference values between the averages and the follow values in the intervals 1 to 8 generated as the communication data by the communication data generation processing part22. The waveform inside of the speech balloon103similarly varies in accordance with the difference values. In the speech balloon103illustrated inFIG. 5, the part of substantially decagon shape is in a regular decagon shape. This shape is obtained when the eight difference values are all 0.

At each time that communication data from one of other game apparatuses1is provided from the communication processing part23, the effect image generation processing part24updates the speech balloon103. At each time that communication data concerning the own apparatus is provided from the communication data generation processing part22, the effect image generation processing part24updates the speech balloon103. Update of the speech balloon103is performed at each time that the difference value of one interval is provided as communication data. The effect image generation processing part24distinguishes which game apparatus1is related to the provided communication data. The effect image generation processing part24performs generation, update and the like of the speech balloon103for each game apparatus1. The following description is given for a method of generation and update of the speech balloon103for one game apparatus1.

On the basis of the received difference value of one interval, the effect image generation processing part24performs position change for one of the eight vertices of the speech balloon103. As described above, the difference value in the communication data is transmitted in a given order like interval 1→interval 2→ . . . →interval 8→interval 1. In place of an approach that the positions of adjacent ones of the eight vertices of the speech balloon103are changed sequentially in, for example, a clockwise order or a counterclockwise order, the effect image generation processing part24changes the vertex positions without causing unevenness.

InFIG. 6, numbers 1 to 8 are assigned respectively to eight vertices of the speech balloon103whose positions vary. At each time that the difference value of one interval is provided, the effect image generation processing part24changes a vertex position in accordance with the difference value in the order of numbering illustrated in the figure. For example, the correspondence relation between the intervals 1 to 8 and the vertices 1 to 8 may be one to one. That is, the position of the vertex 1 may be determined in accordance with the difference value of the interval 1, the position of the vertex 2 may be determined in accordance with the difference value of the interval 2, . . . , and the position of the vertex 8 may be determined in accordance with the difference value of the interval 8. In this case, the communication data transmitted and received between the game apparatuses1may contain, together with the difference value of each interval, header information indicating which interval this difference value is related to. Alternatively, for example, regardless of which interval the provided difference value is related to, the effect image generation processing part24may change the position in the order of vertices 1 and 2, . . . , and 8 at each time that a difference value is provided.

FIGS. 7A and 7Billustrate examples of changing the position of a vertex of the speech balloon103. For example, in accordance with the difference value concerning the communication data provided first, the effect image generation processing part24changes the position of the vertex 1 of the speech balloon103. In the example illustrated inFIG. 7A, the effect image generation processing part24moves the vertex 1 by a distance in accordance with the difference value from the original position toward the outer side of the regular decagon. The original position of the vertex 1 indicates the position of the vertex 1 where the part of substantially decagon shape of the speech balloon103forms a regular decagon. Here, in a configuration that the communication data is allowed to contain a negative value, in accordance with the negative difference value, the effect image generation processing part24may move the vertex 1 toward the inner side of the regular decagon. Alternatively, in accordance with the negative difference value, the effect image generation processing part24may move the vertex 1 to the original position.

When a vertex is moved in accordance with the difference value, in some cases, in linkage with the moving of this vertex, the effect image generation processing part24moves the two adjacent vertices. In the example illustrated inFIG. 7B, together with the vertex 1 of the speech balloon103, the effect image generation processing part24moves the two adjacent vertex 4 and vertex 6. When the vertex 1 is moved in accordance with the difference value concerning the interval 1, the effect image generation processing part24judges whether the difference between the distance of the moved position of the vertex 1 measured from the original position and the distance of the moved position of the adjacent vertex 4 measured from the original position exceeds a threshold value. When the distance difference exceeds the threshold value, the effect image generation processing part24moves the position of the vertex 4 such that the distance difference should be at or below the threshold value. Similar processing is performed also on the vertex 6.

When a vertex position of the speech balloon103is to be moved, the effect image generation processing part24also moves the positions of the two adjacent vertices such that the differences from the two adjacent vertices should be at or below the threshold value. This suppresses occurrence of a situation that the speech balloon103has an excessively distorted shape. Here, in the case of the vertex 5 or the vertex 8 of the speech balloon103, the effect image generation processing part24moves the vertex 2 or the vertex 3 alone serving as an adjacent vertex on one side, and does not move the vertices constituting the base part of the speech balloon103.

The effect image generation processing part24generates a waveform image to be displayed in the speech balloon103.FIG. 8illustrates outlines of waveform generation. In the secondary storage part14or the recording medium7of the game apparatus1, eight pieces of waveform pattern data for waveform image generation are stored together with the game program9. The waveform pattern data for waveform image generation is illustrated as a waveform for interval 1 to a waveform for interval 8 in the upper part ofFIG. 8. For example, the waveform pattern data for waveform image generation may be provided as image data. Alternatively, the waveform pattern data for waveform image generation may be provided as a set of discrete amplitude values. The waveform pattern data for waveform image generation may be provided as a mathematical expression using a trigonometric function and the like. The waveform pattern data for waveform image generation may be of other configurations.

On the basis of the difference values concerning the intervals 1 to 8 and the waveform for interval 1 to the waveform for interval 8 described above, the effect image generation processing part24generates a waveform image to be displayed in the speech balloon103. For the interval 1, the effect image generation processing part24generates a waveform obtained by multiplying by the difference value the amplitude of the waveform of the interval 1. Similarly, for each of the intervals 2 to 8, the effect image generation processing part24generates a waveform obtained by multiplying the corresponding waveform amplitude by the difference value. The effect image generation processing part24is allowed to generate eight waveforms, and combines the generated eight waveforms. The effect image generation processing part24provides a speech balloon103containing this composite waveform inside, as an effect image to the display processing part26.

The effect image generation processing part24generates the speech balloon103for each game apparatus1. At each time that communication data is provided from each game apparatus1, the effect image generation processing part24changes the vertex positions and combines the waveforms so as to update the speech balloon103. The display processing part26displays each speech balloon103generated by the effect image generation processing part24, in the vicinity of the corresponding tank object101.

FIG. 9is a flow chart illustrating a procedure of communication data generation processing performed by the game apparatus1. In the processing part10of the game apparatus1, the sound information acquisition processing part21performs sampling on the sound input from the microphone17so that sound information is acquired (step S1). The communication data generation processing part22of the processing part10performs Fourier transformation on the sound information acquired by the sound information acquisition processing part21(step S2). The communication data generation processing part22transforms the sound information provided as amplitude-to-time characteristics, into frequency components expressed as amplitude-to-frequency characteristics.FIG. 9describes a procedure that the processing of sound information acquisition by the sound information acquisition processing part21and the processing of Fourier transformation and the like by the communication data generation processing part22are performed sequentially. However, these pieces of processing may be performed in parallel to each other.

The communication data generation processing part22of the processing part10divides the frequency components obtained by Fourier transformation into a plurality of intervals of given frequency bands (step S3). The communication data generation processing part22calculates the average of the amplitude in each interval (step S4). The communication data generation processing part22calculates a follow value in each interval (step S5). At that time, the communication data generation processing part22increases or decreases the preceding follow value by a given amount in a direction of causing the follow value to approach the present average, and thereby calculates the present follow value. For the next and subsequent processing, the communication data generation processing part22stores the calculated follow value into the primary storage part13or the secondary storage part14(step S6). The communication data generation processing part22calculates for each interval the difference between the calculated average and the calculated follow value (step S7).

Among the plurality of difference values calculated for each interval, the communication data generation processing part22of the processing part10selects the difference value of one interval serving as an object of transmission to other game apparatuses1(step S8). The processing part10provides the difference value of one interval selected by the communication data generation processing part22as communication data to the communication processing part23. The communication processing part23transmits the communication data to other game apparatuses1participating in the game (step S9). Here, during the time that the present game is ongoing, the processing part10repeats the processing of steps S1to S9.

FIG. 10is a flow chart illustrating a procedure of display processing for the speech balloon103performed by the game apparatus1. The processing part10of the game apparatus1performs the processing illustrated inFIG. 10individually for each tank object101. That is, the processing part10performs the illustrated processing for each game apparatus1or each player participating in the game. In the processing part10, when communication data from one of other game apparatuses1is received by the communication processing part23, the difference value concerning the communication data is provided to the effect image generation processing part24. In the processing part10, when the communication data generation processing part22has generated communication data concerning the own apparatus, the difference value concerning the communication data is provided to the effect image generation processing part24. The effect image generation processing part24of the processing part10judges whether the difference value has been provided from the communication processing part23or the communication data generation processing part22(step S21). When the difference value is not yet provided (S21: NO), the effect image generation processing part24waits until the difference value is provided thereto.

When the difference value has been provided (S21: YES), the effect image generation processing part24of the processing part10stores the provided difference value into the primary storage part13or the secondary storage part14(step S22). The effect image generation processing part24selects a vertex of the speech balloon103whose position is to be changed in accordance with the provided difference value (step S23). Selection of the vertex may be performed in accordance with, for example, an interval the provided difference value is related to, or the order of the difference values being provided. The effect image generation processing part24determines the position of the selected vertex in accordance with the difference value (step S24).

The effect image generation processing part24of the processing part10determines the positions of the two vertices adjacent to the vertex selected at step S23(step S25). At that time, depending on a situation whether the difference between the distance of the selected vertex measured from the original position and the distance of each adjacent vertex measured from the original position exceeds a threshold value, the effect image generation processing part24judges whether the adjacent vertex needs to be moved. When the adjacent vertex needs to be moved, the effect image generation processing part24determines the position of each adjacent vertex such that the difference between the distance of the selected vertex measured from the original position and the distance of the adjacent vertex measured from the original position should be at or below the threshold value.

The effect image generation processing part24of the processing part10reads out the waveform pattern data for waveform image generation corresponding to each interval (step S26). The effect image generation processing part24multiplies the amplitude of the waveform pattern data for waveform image generation for each interval, by the difference value corresponding to the interval. The effect image generation processing part24combines the waveforms of the waveform pattern data for waveform image generation obtained by multiplication by the difference values (step S27). The effect image generation processing part24provides to the display processing part26the speech balloon103containing inside the composite waveform obtained at step S27. In the processing part10, the display processing part26performs update of the display of the game screen corresponding to the speech balloon103provided from the effect image generation processing part24(step S28). Then, the processing is finished. Here, during the time that the present game is ongoing, the processing part10repeats the processing of steps S21to S28.

In the game system according to the present embodiment described above, the plurality of game apparatuses1perform communication with each other through the network5so as to perform processing concerning a game participated by a plurality of players. Each game apparatus1acquires sound information of the surroundings through the microphone17. On the basis of the acquired sound information, each game apparatus1generates communication data having a small data amount, and then transmits the obtained data to other game apparatuses1. The game apparatus1having received the communication data generates an image on the basis of the communication data. The game apparatus1displays the generated image in a manner of being related to a player participating in the game. Each game apparatus1does not transmit the acquired sound information itself. Thus, in comparison with a configuration that the sound information acquired through the microphone17is transmitted and received between the game apparatuses1, in the game system according to the present embodiment, the amount of communication data may be reduced. In the game system according to the present embodiment, the amount of information processing in each game apparatus1may also be reduced. Each game apparatus1generates and displays an image on the basis of the received communication data. Thus, even players who do not understand the same language are allowed to enjoy the game while feeling the presence of other players through the network.

The communication data generated by the game apparatus1has a numerical value corresponding to a change in the sound information. The communication data has a large numerical value when a change in the sound information is large. Thus, the game apparatus1having received this communication data is allowed to generate and display an image corresponding to a change in the sound information of the surroundings of other game apparatuses1.

In the game apparatus1, the operation part16accepts an operation of a player. The game apparatus1displays the tank object101serving as an operation target onto the game screen. At that time, the game apparatus1displays an image generated on the basis of the communication data from each game apparatus1, in a manner of being related to each tank object101. The game apparatus1displays the image based on the communication data, in the vicinity of the tank object101. The game apparatus1displays the image, for example, in the vicinity of the rear side of the tank object101relative to the direction of movement. Thus, the image based on the communication data is allowed to be displayed in a manner of being related to each player participating in the game. Further, the sound in the surroundings of each player may be expressed as an image.

The game apparatus1transforms the sound information acquired through the microphone17into information of frequency components by Fourier transformation. The game apparatus1divides the transformed frequency components into a plurality of frequency bands. Then, the game apparatus1generates communication data for each frequency band interval. For example, the communication data may be the difference value between the average of the amplitude of each interval and a follow value that varies following the present average. By virtue of this, the communication data has a large value when a change in the sound information is large. When an image for display is generated on the basis of this communication data, a larger image may be displayed when a change in the sound information is large. When the follow value is employed, a change in the speech balloon103displayed by the game apparatus1becomes smooth.

The game apparatus1does not transmit to other game apparatuses1all of the plural pieces of communication data generated for each interval, and selects one from the plural pieces of communication data and then transmits the selected one to other game apparatuses1. This reduces the amount of data transmitted and received between the plurality of game apparatuses1. The game apparatus1selects an interval in a given order and then transmits the communication data. Thus, on the basis of the order of receiving, the game apparatus1having received the communication data is allowed to judge which interval the communication data is related to.

The game apparatus1receives plural pieces of communication data generated for a plurality of intervals. On the basis of the plural pieces of received communication data, the game apparatus1generates and displays an image expressing the change in the amplitude of the frequency component in each interval. For example, the game apparatus1is allowed to generate and display a polygonal image of the speech balloon103having a plurality of vertices each assigned to one interval. In accordance with the difference value provided as the communication data of each interval, the game apparatus1changes the position of each vertex of the speech balloon103. This permits displaying of an image that varies in accordance with a change in the sound information acquired by each game apparatus1.

The game apparatus1stores plural pieces of waveform pattern data for waveform image generation each assigned to each frequency band interval. In accordance with the communication data of each provided interval, the game apparatus1combines the plural pieces of waveform pattern data for waveform image generation and then displays the composite waveform inside the speech balloon103. By virtue of this, the change in the sound information acquired by each game apparatus1may clearly be reported to the player.

The speech balloon103generated and displayed on the basis of sound information by each game apparatus1is an image unrelated to the progress of the game in which a plurality of tank objects101perform a battle against each other. That is, the presence or absence of display of the speech balloon103, the displayed contents, and the like do not affect the victory or defeat in the game, the success or failure of the attack or the like.

Here, in the present embodiment, the game played by the game apparatuses1according to the execution of the game program9has been such a game that a plurality of tank objects101attack each other. However, employable games are not limited to this. For example, a game may be employed that objects such as airplanes, ships, robots, persons and animals attack each other. Alternatively, in place of a game that a plurality of objects attack each other, a game may be employed that a plurality of objects cooperate with each other.

A configuration has been employed that when the processing part10of the game apparatus1executes the game program9, the processing part10operates as software-based functional blocks having the functions of the sound information acquisition processing part21to the display processing part26. However, employable configurations are not limited to this. For example, a part of the functions of the sound information acquisition processing part21to the display processing part26may be provided as a function of the OS (Operating System). A configuration has been employed that the game apparatus1includes the microphone17. However, employable configurations are not limited to this. For example, a configuration may be employed that the microphone17is attachable to and detachable from the game apparatus1. The game apparatus1has been of portable type. However, employable configurations are not limited to this. For example, a game apparatus of floor-standing type may be employed. Further, the game apparatus1need not be a dedicated apparatus for games, and may be a communication terminal device of diverse kind such as a PC (Personal Computer) or a smart phone capable of executing the game program9.

A configuration has been employed that a plurality of game apparatuses1perform communication directly with each other through the network5. However, employable configurations are not limited to this. For example, a configuration may be employed that each game apparatus1transmits information to a server apparatus and then the server apparatus distributes the information to each game apparatus1. In this configuration, a part or the entirety of the processing performed by the sound information acquisition processing part21to the display processing part26may be performed by the server apparatus.

All of the plurality of game apparatuses1participating in the game through the network5need not be of the same-type game apparatuses1. For example, various kinds of game apparatuses may be employed in a mixed manner like game apparatuses of floor-standing type, portable game apparatuses, PCs in which the game program is installed, and smart phones in which the game application is installed.

In the game system according to the present embodiment, a configuration has been employed that each game apparatus1acquires sound information as environmental information through the microphone17. However, the sound information is not limited to environmental information. For example, a camera may be mounted on the game apparatus1. Then, on the basis of the image information obtained by image pick-up through the camera, the game apparatus may generate communication data, for example, by extracting an edge in the image and thereby quantifying the position change of the edge or alternatively by performing facial recognition in the image and thereby quantifying the position change of the face. In this case, for example, the game apparatus1having received the communication data may, on the basis of the communication data, perform image processing of changing the orientation of the face of a human-shaped object operated by the player or alternatively of changing the facial expression. For example, the game apparatus1may include an acceleration sensor. Then, the game apparatus1may quantify a change in the acceleration applied on the game apparatus1and then adopt the data as communication data. In this case, for example, the game apparatus1having received the communication data may perform image processing of, on the basis of the communication data, vibrating a part or the entirety of the object operated by the player. Alternatively, the magnitude of the acceleration applied on the game apparatus1may be interpreted as indicating the degree of excitement of the player. Thus, for example, on the basis of the communication data, the game apparatus1is allowed to perform image processing of changing the facial expression of the human-shaped object operated by the player. For example, a configuration may be employed that the game apparatus1acquires, as environmental information, temperature information of the surroundings obtained through a temperature sensor, illuminance information of the surroundings obtained through an illuminance sensor, or position information obtained through a GPS (Global Positioning System).

A configuration has been employed that the game apparatus1transmits and receives as the communication data the difference value between the average and the follow value. However, employable configurations are not limited to this. For example, the game apparatus1may adopt as communication data the difference value between the preceding average and the present average. For example, the game apparatus1may adopt as communication data the present average. In place of the average of each interval, the game apparatus1may use another value such as the maximum or the minimum of the amplitude of each interval. The follow value may be regarded as following such a value.

A configuration has been employed that the game apparatus1transforms the acquired sound information into frequency components by Fourier transformation, and then generates communication data corresponding to the frequency components. However, employable configurations are not limited to this. For example, the game apparatus1may calculate any characteristic quantity from the environmental information by a method other than Fourier transformation, and then generate communication data in accordance with the calculated characteristic quantity.

The game apparatus1need not always display the speech balloon103in correspondence to each tank object101. In the game apparatus1, the speech balloon103may be not displayed when necessary. For example, a configuration may be employed that when a change in the sound information is large, the game apparatus1displays the speech balloon103and that when the change is small, the game apparatus1does not display the speech balloon103. In this case, when the total value of the difference values of each interval concerning the received communication data exceeds a given value, the game apparatus1displays the speech balloon103. Then, when the total value of the difference values does not exceed the given value, the game apparatus1does not display the speech balloon103.

A configuration has been employed that in accordance with the provided communication data, the game apparatus1displays the speech balloon103of polygon shape in the vicinity of the tank object101. However, employable configurations are not limited to this. For example, the game apparatus1may display the speech balloon constructed from a curved line. The game apparatus1may display an image other than a speech balloon. For example, in place of displaying the speech balloon103, the game apparatus1may display a composite waveform obtained by combining the waveform pattern data for waveform image generation of the individual intervals. For example, in place of displaying the image in the vicinity of the object operated by the player, the game apparatus1may change the shape, the color or the like of the object in accordance with the communication data.

(Modification 1)

In the game apparatus1according to Modification 1, the communication data generation processing part22generates communication data allowed to have a positive or a negative value, and then transmits the communication data to other game apparatuses1. The communication data generation processing part22adopts as the communication data the difference value between the average and the follow value in each interval regardless of whether the difference value is positive or negative. When the communication data is of a positive value, as illustrated inFIGS. 7A and 7B, the game apparatus1having received the communication data moves the vertex position of the speech balloon103toward the outer side of the regular decagon. In contrast, when the communication data is of a negative value, the game apparatus1moves the vertex position of the speech balloon103toward the inner side of the regular decagon. By virtue of this, the game apparatus1is allowed to display the speech balloon103having a concave shape.

(Modification 2)

In the game apparatus1according to Modification 2, in place of displaying the speech balloon103in accordance with the difference value of the received communication data, image processing of changing the color of the tank object101is performed. For example, in the case of the tank object101colored in red, the effect image generation processing part24of the game apparatus1according to Modification 2 generates the tank object101in deep red when the difference value of the communication data is large. When the difference value is small, the effect image generation processing part24generates the tank object101in light red. The display processing part26displays the game screen by using the tank object101generated by the effect image generation processing part24. Here, the game apparatus1may change the shape of the tank object101in accordance with the difference value of the communication data.

In the present specification, it is to be understood that description of an element expressed in a singular form provided with an article “a” or “an” does not exclude a configuration employing a plurality of elements each corresponding to the mentioned single element.

The game apparatus1according to the present embodiment generates communication data on the basis of the acquired environmental information, and then transmits and receives the communication data. This reduces the amount of data transmitted and received between the plurality of apparatuses. Further, the amount of information processing in each apparatus is reduced. The game apparatus1generates and displays a image on the basis of the received communication data. Thus, even players who do not understand the same language are allowed to enjoy the game while feeling the presence of other players through the network.