U.S. Pat. No. 11,213,743

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

The embodiments of the present disclosure will be described below through exemplary embodiments. Those skilled in the art can easily understand other advantages and effects of the present disclosure according to contents disclosed by the specification. The present disclosure can also be implemented or applied through other different exemplary embodiments. Various modifications or changes can also be made to all details in the specification based on different points of view and applications without departing from the spirit of the present disclosure. It needs to be stated that the following embodiments and the features in the embodiments can be combined with one another under the situation of no conflict.

It needs to be stated that the drawings provided in the following embodiments are just used for schematically describing the basic concept of the present disclosure, thus only illustrating components only related to the present disclosure and are not drawn according to the numbers, shapes and sizes of components during actual implementation, the configuration, number and scale of each component during actual implementation thereof may be freely changed, and the component layout configuration thereof may be more complex.

Referring toFIG. 1, this embodiment provides a system for remote control of computer game by a gamepad. The system includes: a mobile terminal (such as a smartphone, tablet computer, smart wearable device, etc.), a virtual cloud desktop server (such as a physical server, cloud server, server group, etc. that provide virtual cloud desktop services), and at least one gamepad (such as wireless gamepad, wired gamepad, etc.). The mobile terminal is installed with a client-side software for remote connection, the virtual cloud desktop server is installed with a virtual cloud desktop server-side software, and the client-side software and the server-side software are remotely connected through the network, and transmit data based on the wide area network (WAN).

Referring toFIG. 2, an exemplary system for remote control of computer game by a gamepad is shown. When the user connects the gamepad to the mobile terminal through a wired or wireless (such as bluetooth, WIFI, etc.) protocol, the remote connection client-side transmits the operation instruction data sent by the gamepad to the virtual cloud desktop server-side via WIFI or mobile data traffic. In detail, if the user chooses to connect to the network via WIFI, the gamepad data accesses the WAN after passing through the router, modem, and internet service provider (ISP). If the user chooses to connect to the network via mobile data traffic, the gamepad data accesses the WAN after passing through the base station and then the internet service provider (ISP). Finally, the gamepad data transmitted through the WAN passes through the firewall and enters the virtual cloud desktop server-side.

In view of the fact that remotely accessing a computer game through a mobile terminal needs to use a peripheral physical keyboard and mouse for controlling. For those who are accustomed to playing computer games with a gamepad, they cannot get the same excellent experience on a mobile terminal as playing a computer game with a gamepad. Therefore, the present embodiment designs the following method to make up for this shortage.

Referring toFIG. 3, the method for remote control of computer game by a gamepad in this embodiment includes the following steps:

S301: The remote connection client-side is connected with the virtual cloud desktop server-side, so as to remotely access the virtual cloud desktop provided by the virtual cloud desktop server-side. The virtual cloud desktop includes a display window of a computer game.

S302: The remote connection client-side detects whether a gamepad connected with a mobile terminal. If yes, performing step S303.

S303: The remote connection client-side sends a message to the virtual cloud desktop server-side. The message includes the number of connected gamepad.

S304: When receiving a message, the virtual cloud desktop server-side creates or enables a corresponding number of virtual game devices. The virtual game device stores a one-to-one corresponding relationship between the button operation instructions of the physical gamepads and the KeyCode value of the operating system of the virtual cloud desktop server, and a one-to-one corresponding relationship between the joystick operation instructions of the physical gamepads and the KeyCode value of the operating system of the virtual cloud desktop server.

Steps S302to S304are specifically described hereinafter.

After the gamepad is connected to the mobile terminal, the client-side for remote connection of the mobile terminal detects whether there are gamepads being connected, and the detection includes the number N of gamepads connected, N>=1; then, the client-side for remote connection sends a message containing N to the virtual cloud desktop server-side.

After receiving the message, the virtual cloud desktop server-side creates and enables N virtual game devices in the operating system (virtual OS) of the virtual cloud desktop server. Alternatively, the virtual desktop infrastructure (VDI) layer creates multiple virtual game devices in advance and set them to be disabled, the virtual cloud desktop server-side enables N virtual game devices after receiving the message.

It is worth noting that each of the N virtual game devices is in a one-to-one corresponding relationship with the N connected gamepads. If the remote end is a physical PC instead of the virtual cloud desktop server used in this embodiment, the system would not have the feature of the VDI layer. Therefore, physical hardware devices cannot be simulated, the virtual game devices cannot be created at the VDI layer in advance.

S305: The client-side for remote connection captures the operation instruction data of each gamepad, and send them to the virtual cloud desktop server-side. The operation instruction data includes: the identity of the gamepad that the user is currently operating, the operation instruction data generated when the user operates the button and the operation instruction data generated when the user operates the joystick (including the relative movement value of the joystick).

S306: The virtual cloud desktop server-side receives each operation instruction data, and causes each virtual game device to output a KeyCode value corresponding to each button operation instruction and each joystick operation instruction according to the corresponding relationship, such that the virtual cloud desktop server executes the computer game according to each KeyCode value and the relative movement value of the joystick.

Herein, steps S305to S306are specifically described:

First, the client-side for remote connection processes the captured data into the data in the format required by the virtual cloud desktop server-side. Second, the client-side for remote connection packages the processed gamepad operation data and sends them to the virtual cloud desktop server-side. Third, the virtual cloud desktop server-side parses the data packet sent by the client-side for remote connection when receiving it, and sends the parse result to the virtual game devices created or enabled by the virtual cloud desktop server-side; each virtual game device searches in the corresponding relationship according to the parse content of the gamepad corresponding to itself in the parse result, and outputs the corresponding KeyCode. Finally, the virtual cloud desktop server runs the computer game based on these KeyCode values and the received relative movement value of the joystick, such that the operation of the gamepad is converted into the operation of remote computer games.

S307: The virtual cloud desktop server-side sends data of the running results of the computer game on the virtual cloud desktop to the client-side for remote connection.

Following the above, the virtual cloud desktop server displays the running result on the game display window of the virtual cloud desktop after executing the gamepad operation instructions, that is, the running result of the user controlling computer game by the gamepads is displayed on the virtual cloud desktop. After capturing the running results of the computer game of the virtual cloud desktop server, the virtual cloud desktop server-side encodes the data of all the displayed contents on the virtual cloud desktop (including the audio and video parts on the virtual cloud desktop) and sends them to the client-side for remote connection for displaying after being decoded and rendered. Of course, in order to save resources, if there are no changes on the virtual cloud desktop other than the game display window, only the display content data of the game display window is sent to the client-side for remote connection, such that the client-side for remote connection updates the display content of the game display window while continuing to display the desktop other than the original game display window.

S308: The client-side for remote connection receives the data and displays them on the mobile terminal.

Following the above, after the client-side receives the data, the display content of the virtual cloud desktop is displayed on the mobile terminal. Specifically, the client-side for remote connection displays the received data on the mobile terminal after rendering and decoding for feedback to the user.

All or part of the operations to implement the various method embodiments described above may be accomplished by hardware associated with a computer program. Based on this understanding, the present disclosure further provides a computer program product including one or more computer instructions. The computer command may be stored in a computer readable storage medium. The computer readable storage medium may be any available medium that can be stored by a computer, or may be a data storage device such as a server, a data center, and the like that integrates one or more available medium. The available medium may be a magnetic medium (such as a floppy disk, a hard disk, a magnetic tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid state disk (SSD)).

Referring toFIG. 4, this embodiment provides an electronic device, which may be a desktop computer, a portable computer, a smart phone, a physical server, a cloud server, or the like. In detail, the electronic device at least includes a storage42and a processor43connected through the bus41. The storage42stores a computer program, and the processor43executes the computer program stored in the storage42, so as to execute all or part of the steps performed by the virtual cloud desktop server-side in the aforementioned method embodiment.

The system bus mentioned above may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The system bus can be divided into address bus, data bus, and control bus and so on. For convenience of representation, only a thick line is used in the figure, but it does not mean that there is only one bus or one type of bus. The communication interface is used to implement communication between the database access device and other devices (such as a client-side, a read-write library, and a read-only library). The storage may include non-volatile memory, such as at least one disk memory.

The above processor may be a general processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processing (DSP), application specific integrated circuit (ASIC), field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

In summary, the present disclosure provides a method, system and electronic device for remote control of computer game by a gamepad, which enables a mobile terminal user to use a gamepad to remotely control a computer game on the mobile terminal, and obtain the excellent playing experience same as using a gamepad to directly control computer games. Therefore, the present disclosure effectively overcomes various shortcomings in the existing technology and has high industrial utilization value.

The above-described embodiments are merely illustrative of the principles of the disclosure and its effects, and are not intended to limit the disclosure. Modifications or variations of the above-described embodiments may be made by those skilled in the art without departing from the spirit and scope of the disclosure. Therefore, all equivalent modifications or changes made by those skilled in the art without departing from the spirit and scope of the disclosure will be covered by the appended claims.