U.S. Pat. No. 10,918,956

DETAILED DESCRIPTION OF THE INVENTION

Reference is made herein to the attached drawings. Like reference numerals are used throughout the drawings to depict like or similar elements of the system for monitoring online gaming activities. For the purposes of presenting a brief and clear description of the present invention, the preferred embodiment will be discussed as used for a system for monitoring online gaming activities. The figures are intended for representative purposes only and should not be considered to be limiting in any respect.

Referring now toFIGS. 1A, 1B, and 1C, there is shown a logical view of how the component parts of a system for monitoring online gaming activity interact with one another, a logical view of a controller extension unit and how the electrical components interact with one another in one embodiment of a system for monitoring online gaming activity, and a logical view of a listening device and how the electrical components interact with one another in an embodiment of a system for monitoring online gaming activity, respectively. The system for monitoring online gaming activities1000, comprises a controller extension unit100operably connected to a game controller910, which is in turn operably connected to a gaming console900. “Gaming console” here is used to refer to any electronic device on which video games can be played. In the illustrated embodiment the controller extension unit100is configured to wirelessly communicate with a web-based data server400and a listening device200. Additionally, a downloadable software application300that can be installed on any electronic device600, like a phone or tablet, is also configured to wirelessly communicate with the web-based data server400and a listening device200.

The controller extension unit100comprises a first power supply120configured to provide electrical energy to a first transceiver130, a first microphone140, and a first microcontroller150. Furthermore, the first power supply120of the controller extension unit100is configured to be both wireless and rechargeable. The first microcontroller150is configured to record audio data captured via the first microphone140, and to wirelessly transmit the captured audio data to the web-based data server400. The controller extension unit100further includes a plurality of buttons160configured to transmit control commands wirelessly, via the first microcontroller150and the first transceiver130, to the second microphone240and speaker260disposed on the listening device200.

In the illustrated embodiment the listening device200comprises a portable housing210with a second power supply220configured to provide electrics energy to a second transceiver230, a second microphone240, a second microcontroller250, and a speaker260disposed therein. Furthermore, the second power supply220of the listening device is configured to be both wireless and rechargeable. In other embodiments the second power supply220of the listening device200is configured to be wired. The second microcontroller250is configured to control the volume level speaker260, to control whether, or not the second microphone240is actively receiving audio input, and to receive command signals from either the downloadable software application300or from the controller extension unit100via the second transceiver230. Furthermore, the listening device200is configured to allow parents or guardians to remotely monitor in-game oral communication between children in their care and other players in the game.

Referring now toFIGS. 2A and 2B, there is shown a flow chart of how audio data and control commands are processed between a gaming console, a controller extension unit, a web-based data server, and a listening device, and a flow chart of how audio data and control commands are processed between a software, a controller extension unit, a web-based data server, and a listening device in one embodiment of a system for monitoring online gamin activity, respectively.

In the illustrated embodiment, when an in-game oral communication500occurs through the gaming console900, the first microphone140is configured to capture audio data510from in-game oral communication500between players on both ends of the conversation. Next the first microcontroller150is configured to process and record the audio data510of in-game oral communication500between players captured by the microphone and transmit the processed audio data512to the web based data server400through the first transceiver130, which is configured to transmit the processed audio data512recorded on the first microcontroller150to a web-based data server400. The processed audio data512comprises the originally captured audio data510combined with audio input from the second microphone240. In some embodiments the processed audio data512can also filter out sound effects540from game play leaving only the voices from the in-game oral communication500.

Once received, the web-based data server400employs a speech recognition software program410to convert the audio data512into a searchable text-based transcript530. Additionally, the web-based data server400is configured to store the captured audio data512as an audio file520, and to store the searchable text-based transcript530generated by the speech recognition software program410. In this embodiment the speech recognition software410is configured to only recognize words spoken in English. However, in other embodiments the speech recognition software410can be configured to recognize words and phrases from other languages, for example Spanish or French, to expand the utility of the system to non-English speakers. In still other embodiments the first microcontroller150is configured to continuously record captured audio data510and the first transceiver130is configured to continuously transmit processed audio data512to the web-based data server400, such that all communication during gameplay is captured and recorded for later review.

In the illustrated embodiment, the first microcontroller150is also configured to transmit command control signals270from the plurality of buttons160on the controller extension unit100, such that the command control signals270are sent from the first transceiver130to the second transceiver230, which is configured to receive the command control signals270, and to send the command control signals270on to the second microcontroller250. From there the second microcontroller250on the listening device200is configured to implement control commands270, such that the second microphone240can be turned on or off, and the volume level of the speaker260can be raised or lowered. The second transceiver230is also configured to receive audio data512and to provide a livestream of the in-game oral communication500through the speaker260to a parent or guardian using the listening device200to remotely monitor the in-game activity of the child under their care. When the second microphone240is turned on, the second microphone240is configured to capture and retransmit the audio input from the monitoring parent or guardian, such that an additional piece of audio data511is sent back to the first microcontroller150via the second transceiver230which is also configured to transmit audio data511to the first transceiver130. Wherein the first transceiver130is further configured to receive audio data511from the second transceiver230, and to transmit the second piece of audio data511to the first microcontroller150where the additional piece of audio data511can be combined with the captured audio data510to create the processed audio data512.

InFIG. 2B, a downloadable software application300is installed on an electrons device600, like a phone or tablet, and is configured to allow parents or guardians to receive notifications from and to interact with the web-based data server400housing audio files520and searchable text-based transcripts530of the in-game oral communication500between players through a wireless interface360. In one embodiment the downloadable software application300is further configured to transmit control commands to the listening device200such that the command control signals270are sent from the electronic device600to the second transceiver230, which is configured to receive the command control signals270, and to send the command control signals270on to the second microcontroller250. From there the second microcontroller250on the listening device200is configured to implement control commands270, such that the second microphone240can be turned on or off, and the volume level of the speaker260can be raised or lowered.

Referring now toFIGS. 3A and 3B, there is shown a flow chart of how a downloadable software application interfaces with a web-based data server, a logical view of how a downloadable software application interfaces with a web-based data server in one embodiment of a system for monitoring online gaming activity, respectively. In the illustrated embodiment the downloadable software application300is further configured to detect the usage of special keywords310or phrases, via a keyword search420of the searchable text-based transcripts530of in-game oral communication between players stored on the web-based data server400. In use, the downloadable software application300first creates a wireless interface360with the web-based data server400. Once the interface360is established the parent or guardian can use the downloadable software application300to input special keywords310or phrases that they have personally defined. Next, the parent or guardian can use the downloadable software application300to classify the keywords310into a variety of categories in step311. Examples of some possible categories are personal phone numbers, email addresses, drugs, sex, violence, curse words, etc. Once categorized the parent or guardian can then use the downloadable software application300to rank or weight the severity of the custom keyword310or phrase based on their personal preferences in step312.

In this embodiment, after the special keywords310have been input, categorized311, and ranked312, the web-based data server then performs a keyword search420on searchable text-based transcripts530. Then based on the results of that keyword search420the web-based data server400is further configured to send a notification320to the parent or guardian through the downloadable software application300when these keywords310or phrases are detected. Additionally, in step312the parent or guardian can define how they wish to be notified in step320upon detection of the keywords in step420. For example, detection of low ranking keywords will only show up as an alert within the application300, while detection of middle ranked keywords can trigger transmission of an automated text or email to the parent or guardian, and detection of the highest ranked keywords can trigger a phone call to the parent or guardian.

The downloadable software application300is further configured to facilitate review of both the recorded audio file520and the searchable text-based transcript530of the in-game oral communication500between players after the communication500has occurred.

Referring now toFIGS. 4A and 4B, there is shown a flow chart of how a downloadable software application interfaces with a web-based gaming server, and a logical view of how a downloadable software application interfaces with a web-based gaming server in one embodiment of a system for monitoring online gaming activity, respectively.

In one embodiment the downloadable software application300is further configured to synch with in-game user accounts930, such that a parent or guardian can perform in-game social activities710. In use, the downloadable software application300first wireless interface760with web-based gaming server700. Then once the interface760is established the parent or guardian can use the downloadable software application300to perform in-game social activities710like: viewing a friend711, adding712or deleting713friends, or viewing text messages714, sending715or deleting716text messages.

Referring now toFIG. 5A, there is shown a perspective views of a controller extension unit being inserted into a controller for a gaming console. In the illustrated embodiment the electronic connector110is disposed on the controller extension unit100is configured to be removably attached to an electronic port920on a controller910for a gaming console. Here the electronic port920that the electronic connector110is being inserted into, is an audio output port, such that audio data510from the other player participating in the in-game oral communication can be captured by the first microphone. In other embodiments the electronic port920is a first 3.5 mm audio jack disposed on controller910for a gaming console900. In such embodiments the controller extension unit100can further include a second audio output port configured to facilitate wired connection of an additional audio output device through the controller extension unit100and thereby expand the utility of the device.

Referring now toFIG. 5B, there is shown a listening device in one embodiment of a system for monitoring online gaming activity. In the illustrated embodiment the listening device200is configured to remotely monitor in-game oral communication up to the 30 feet away from the controller extension unit, to stream audio data of in-game oral communication between players, via the second transceiver, in real-time, and to allow a parent or guardian to actively participate the in game oral communication between players G while remotely monitoring from another room in the house.

It is therefore submitted that the instant invention has been shown and described in what is considered to be the most practical and preferred embodiments. It is recognized, however, that departures may be made within the scope of the invention and that obvious modifications will occur to a person skilled in the art. With respect to the above description then, it is to be realized that the optimum dimensional relationships for the parts of the invention, to include variations in size, materials, shape, form, function and manner of operation, assembly and use, are deemed readily apparent and obvious to one skilled in the art, and all equivalent relationships to those illustrated in the drawings and described in the specification are intended to be encompassed by the present invention.

Therefore, the foregoing is considered as illustrative only of the principles of the invention. Further, since numerous modifications and changes will readily occur to those skilled in the art, it is not desired to limit the invention to the exact construction and operation shown and described and accordingingly, all suitable modifications and equivalents may be resorted to, falling within the scope of the invention.