U.S. Pat. No. 11,890,548

CROWD-SOURCED ESPORTS STREAM PRODUCTION

AssigneeSONY INTERACTIVE ENTERTAINMENT LLC; SONY INTERACTIVE ENTERTAINMENT INC.

Issue DateJuly 21, 2022

Illustrative Figure

Abstract

The present technology provides solutions for crowd-sourcing stream productions for a virtual esports environment. A method can include generating a virtual environment associated with an interactive session that includes a plurality of spectator devices, wherein each of the spectator devices is presented with a different display based on a corresponding vantage point located within the virtual environment; receiving a plurality of media captures from the spectator devices, wherein each of the media captures is captured from the corresponding vantage point of the spectator device within the virtual environment; selecting one of the media captures based on a comparison of visibility of an asset in the virtual environment; and streaming the selected media capture to a primary display on a requesting device.

Description

DETAILED DESCRIPTION In the same way that many sports fans enjoy watching sports games involving professional or amateur sports players both to learn sports techniques and to share a sense of community, many video game fans enjoy watching professional or amateur video game players both to learn video game techniques and to share a similar sense of community. Competitive gaming, sometimes referred to as electronic sports or “esports,” involves the play of video games in a competitive environment comparable to traditional sports. During competitive gaming involving single-player games, players sometimes compete to achieve a high score, or to achieve a particular goal within the video game in a record time, sometimes referred to as a “speed run.” During competitive gaming involving multi-player games, players sometimes likewise compete for best scores or times, but are also sometimes ranked against each other based on numbers of wins and/or losses against one another, or other statistics, often based on multiple game “matches” spread out over time, sometimes in a tournament style. Competitive gaming includes localized video game competitions that take place in a particular physical location, in which case spectators may be in the physical vicinity of the players. Competitive gaming also includes virtual video game competitions with a more virtual organization structure conducted online, where gameplay footage may be distributed to spectators via a network connection via video stream. Due to increasing popularity of the competitive gaming community, competition providers such as Major League Gaming (MLG) have more recently endeavored to provide an increased level of organization and structure to video game competitions for a number of video games, especially at the professional level. The subject technology described herein enhances and expands the functionality of server(s) that provide gameplay information to video game spectators and of user devices corresponding to spectators. The ...

DETAILED DESCRIPTION

In the same way that many sports fans enjoy watching sports games involving professional or amateur sports players both to learn sports techniques and to share a sense of community, many video game fans enjoy watching professional or amateur video game players both to learn video game techniques and to share a similar sense of community. Competitive gaming, sometimes referred to as electronic sports or “esports,” involves the play of video games in a competitive environment comparable to traditional sports.

During competitive gaming involving single-player games, players sometimes compete to achieve a high score, or to achieve a particular goal within the video game in a record time, sometimes referred to as a “speed run.” During competitive gaming involving multi-player games, players sometimes likewise compete for best scores or times, but are also sometimes ranked against each other based on numbers of wins and/or losses against one another, or other statistics, often based on multiple game “matches” spread out over time, sometimes in a tournament style.

Competitive gaming includes localized video game competitions that take place in a particular physical location, in which case spectators may be in the physical vicinity of the players. Competitive gaming also includes virtual video game competitions with a more virtual organization structure conducted online, where gameplay footage may be distributed to spectators via a network connection via video stream. Due to increasing popularity of the competitive gaming community, competition providers such as Major League Gaming (MLG) have more recently endeavored to provide an increased level of organization and structure to video game competitions for a number of video games, especially at the professional level.

The subject technology described herein enhances and expands the functionality of server(s) that provide gameplay information to video game spectators and of user devices corresponding to spectators. The servers may be associated with a video game, a video game platform/console, a video game league, or a combination thereof. The server(s) monitor timers and/or in-game events to identify that a trigger event has occurred, and in response, the server(s) may provide production tools for crowd-sourced esports streams. For example, the server(s) can determine perspectives that user devices are spectating the trigger event from and stream one or more of the perspectives to one or more user devices.

FIG.1illustrates an example of network environment in which some aspects of the technology can be implemented. Network environment100includes public network102, which can include one or more private networks, such as a local area network (LAN), a wireless local area network (WLAN), a wide area network (WAN), or a network of public/private networks, such as the Internet. Public network102is communicatively coupled to gaming network server104, which may for example represent multiple servers, associated routers, and other network hardware220supporting online gameplay for a particular type of client computing device, such as a particular brand of video game console. The gaming network server104may be inclusive of a variety of servers and other network hardware/resources configured for implementing an esports management system112. The esports management system112may also optionally operate on other gaming network servers104for interoperability of gaming leagues between different gaming network servers104and therefore different types of client computing devices210. The esports management system112may include a number of servers and/or routers associated with operation and maintenance of network-based gameplay for particular video games, a particular video game platform/console, a video game league, or a combination thereof. For example, the esports management system112can generate a virtual esports environment for a particular video game, a particular video game platform/console, a video game league, or a combination thereof. The servers, routers, and other hardware used in esports management system112, gaming network server104, and public network102may be computer systems400as illustrated in and discussed with respect toFIG.4, or may include components of the computer systems400. The esports management system112can record the game state information to allow spectators to rewind and watch a replay of game play action. Such a replay can be from existing viewing angles, or the spectator can adjust the viewing angle to get a better view of action that happened. In some cases, the system can automatically generate replay renderings of exciting action and make that easily accessible to spectators, which may be in the form of one or more streams that show renderings of the most exciting action that happened.

Public network102, and gaming network server104provide client and developer access to esports management system112. As illustrated, clients108,109, and110are permitted access to esports management system112using respective client devices (e.g.,108A,109A, and110A). Clients, and their respective devices, may take on a player role or a spectator role at any given time in a given video game match. Although client devices108A,109A, and110A, are depicted as personal computing devices, it is understood that the client devices can include various types of processor-based systems, including but not limited to: game consoles, smart phones, tablet computer systems, and the like. Example of hardware systems that can be used to implement the client device are illustrated in and discussed in further detail below with respect toFIG.2andFIG.4. Similarly, developers (e.g.,105,106and107), are permitted access to league management system via respective their computing systems (e.g.,105A,106A, and107A). Developer computing systems may likewise be computer systems400as illustrated in and discussed with respect toFIG.4, or may include components of the computer systems400.

It is further contemplated that a client device (e.g.,108A,109A, and110A) can include one or more displays. For example, a client device associated with a spectator device (e.g., a spectator device) can include a primary display that is operable to display selected media captures as discussed further below. It is also considered that these devices can include secondary displays that can be used to augment or otherwise provide additional media captures, information, and/or entertainment to spectators.

It is understood that a greater or smaller number of clients and/or developers can be engaged with environment100than are illustrated inFIG.1and described herein, without departing from the scope of the technology.

Some video games, especially those with online multiplayer capabilities, allow spectators to watch gameplay without actually playing or influencing the outcome of the game in any way. The spectator functionality is typically developed by developers (e.g.,105,106and107) with an integrated “spectator” functionality. The integrated “spectator” functionality may be integrated into code of the particular video game that runs during gameplay and/or into online servers that help operate the particular video game's online multiplayer functionality. A spectator client using such an integrated spectator function generally has a copy of the video game whose gameplay he/she is spectating on his/her corresponding client device, allowing the spectator client device to render the gameplay in the same way or in a similar way that client computing devices of player clients render the gameplay, only without giving the spectator any opportunity to control the gameplay via the spectator's client computing device.

This type of game-integrated spectating technology has the benefit of being more efficient in terms of network bandwidth usage than spectating via streaming of video content, as online games are typically optimized to use as little bandwidth as possible to maintain an acceptable gameplay speed for all players and spectators. The online games accomplish this by transmitting instructions as to how to render a shared virtual space, and then how to render modifications/updates to that shared virtual space over the course of gameplay over a time period between a beginning and an end of a game match. While the initial rendering of the shared virtual space may be complex—for instance, the game and/or game's servers may instruct player and spectator client devices to render numerous character avatars, pieces of scenery, landscapes, buildings, and so forth—later updates/modifications to the shared virtual space are generally less complex. For instance, for an update/modification during gameplay in the example of the preceding sentence, the game and/or game's servers may instruct player and spectator client devices to render that one of the character avatars has moved forward slightly while everything else previously rendered has remained static.

Spectating can occur via online video streaming, which allows spectators (via their spectator devices) to stream video content of recorded or live gameplay, either in real-time or with a slight delay. In reference toFIG.1, the gameplay video may be captured or recorded at player client devices (108A/109A/110A) and sent to spectator client devices (108A/109A/110A), optionally via networks102/104/112or similar video-streaming-focused networks not illustrated inFIG.1. Video streaming allows, for example, video games that do not have integrated spectator functionality to be spectated, for instance allowing spectators to watch a player play an older or legacy game title, an emulated game, or a game that otherwise has no online connectivity, as well as allowing a wide variety of computing devices to be used to spectate, regardless of processing capability or compatibility with the game title. That is, a spectator can spectate a player playing a graphically intensive game from their phone or another device that would not otherwise have the processing capabilities to render the gameplay of the graphically intensive game, and/or that is running an operating system that is not compatible with the graphically intensive game.

Integrated spectating technology may be provided by the game title itself, as well as associated platforms, service providers, and/or devices, including client device (such as a particular brand of video game console/platform), the gaming network server104, and/or an esports management system112. That is, client computing devices108A/109A/110A of a particular type—such as video game consoles of a particular brand—may include this integrated spectating technology, as well as the gaming network server104associated with client computing devices210of that particular type. Alternately or additionally, client computing devices210that are optionally of different types may all be compatible with an esports management system112that includes servers112and/or software running on the client computing devices210.

The particular type of client device (such as a particular brand of video game console/platform), the gaming network server104, and/or an esports management system112may include application programming interfaces (APIs) associated with spectating video games. InFIG.1, for instance, the esports management system112is illustrated as having an API114, though the APIs discussed herein may alternately or additionally be implemented in the gaming network server104and/or the client computing devices210. An individual video game and/or servers associated with the individual video game can then call spectator functions coded into such an API during gameplay to invoke spectator functionality. The spectator function may be standardized across that type of client device210, that gaming network server104, and/or that esports management system112. In this way, a spectator client device having access to the gaming network server104may further access the esports management system112, or a combination thereof, to access esports-related streams and related content and services.

Because the video game data may be in a standardized format using the API114or a gaming network server104API (or other type of data file), as long as the spectator client device can operate with the esports management system112or gaming network server104, spectator client device can spectate the game. For example, a client computing device running an operating system that is incompatible with a particular video game but that is compatible with the esports management system112or gaming network server104may still be able to spectate a game match of that otherwise incompatible video game. Game-integrated, console/platform-integrated, network-integrated, and/or league-integrated spectating technologies may provide extended levels of control for spectators because information about the entire shared virtual space is sent to the spectator, not just what a particular player sees, before the game content is rendered at the spectator's computing device. The spectator can be given an increased control over their view of the gameplay, allowing the spectator to pan, zoom, or rotate their perspective. A spectator may also emulate different viewing perspectives of different players currently playing the game, in series or in parallel. In this way, in a game with multiple players in the same shared virtual environment, a spectator may be able to view more than any individual player can, for example by repeatedly changing their view of the shared virtual space. As such, each spectator may generate unique perspectives and/or vantage points of various virtual assets (e.g., a goal, a player avatar, a virtual building structure, etc.). In some embodiments, the vantage points are rendered by the esports management system112and streamed to the spectator. In other embodiments, the vantage points are rendered by a spectator device (e.g., a client computing device108A/109A/110A) and provided as data to esports management system112(e.g., via public network102and/or gaming network server104).

Game-integrated, console/platform-integrated, network-integrated, and/or league-integrated spectating technologies also allow additional ways for players and spectators to interact with the shared virtual environment and with each other. For example, integrated spectating technologies allow two client devices to interact as illustrated in and discussed with respect toFIG.3. In some games, spectators may be able to provide their own media capture, perspective, and/or vantage point of the game to other devices (e.g., spectator devices, client devices, player devices, broadcasting devices, etc.), as illustrated in and discussed with respect toFIG.3.

To utilize these various vantage points or perspectives, esports management system112is configured to receive captured media from each spectator device (e.g., across public network102and/or in communication with one or more gaming network servers104). For example, esports management system112can receive images or views of a certain player, scene, or in-game event that one or more spectator devices may be viewing. Additionally, esports management system112is configured to provide streams of the virtual environment from one or more different perspectives to requesting devices. For example, one spectator may want to access a stream where the perspective is controlled by another spectator, who may be selecting from among different virtual locations within the virtual environment (where different characters or objects may be located), vantage points (at different distances, heights, and angles), zoom levels, specialized visual settings, overlays, etc. Accordingly, esports management system112can stream or otherwise provide the perspective of one spectator to one or more other spectators. As a result, a plurality of spectators are able to share the same perspective, thereby allowing the spectators to view the same in-game events in the same way. For example, if one spectator is dynamically controlling a streamed view of a player such that their perspective is circling around the player, the other spectators can access the same stream to view the player in the same circling fashion as the controlling spectator. It is further contemplated that esports management system112can be configured to associate different badge levels with one or more spectators. The badge levels can distinguish or otherwise assist in identifying a particular spectator. The badge levels can be based on quantity of views shared, quantity of streams viewed by other spectators, specialization in a certain perspective view, etc.

In other words, esports management system112can monitor or otherwise access streams captured from a variety of different vantage points associated with different players or spectators. Additionally, esports management system112can select from among the different media captures in each stream, as well switch from stream to stream or combine multiple streams into a single display. Selection of the media captures, perspectives, and/or vantage points can be based on a wide variety of different factors including, but not limited to, visibility of an asset in the virtual environment, proximity to or clustering of other spectator perspectives, an identity or title of the spectator (e.g., if the spectator is a prominent player, a professional broadcaster, etc.).

In some embodiments, automated selection of the media captures can also be based on a preference set by individual requesting spectators. The esports management system112may also use express or indicated preferences of a spectator in curating from multiple source streams and generating a combination stream specifically for that spectator. Where the spectator may express certain default preferences, for example, esports management system112can provide a stream of media captures selected in accordance with such preferences to the spectator device as a primary or default stream. For example, a requesting spectator may desire to view a favorite player rather than a specific goal. Accordingly, esports management system112can select media captures from the favorite player's point-of-view, from one of the other players within viewing distance, or from one of the spectators whose virtual camera is directed to the favorite player. As another example, a requesting spectator may desire to view a specific in-game structure from a ground level rather than from an upper perspective (e.g., bird's eye view). Accordingly, esports management system112can allow for automated filtering of different stream views, as well as selection of a media capture from one of the filtered views that captures the specific player and structure from the desired perspective. The media captures can also include views other than renderings of the game environment such as score boards or maps. Media captures can also include information that is not available to one or more players. For example, a scoreboard may display the health and inventory level of multiple players when players in the game may only be able to see some of the details about themselves or teammates, but not for other players. As another example, a map shown to a spectator may include information, such as location of enemies or traps, that is not visible to a player when viewing the map. A game rendering for a spectator may include features that are not used in game renderings seen by players, such as having accessibility features turned on (e.g., high contrast or object highlighting).

It is further contemplated that esports management system112can record statistics for each respective stream(s) and associated curators or producers. For example, esports management system112can record viewership statistics (e.g., how many other spectators subscribe, follow, or otherwise request access to a specific stream), viewer interaction with each other and the curator, team or player affiliation, similarity (e.g., in distance and/or angle) of vantage point, etc. In some embodiments, esports management system112can generate a notification to spectator devices based on a match between respective statistics for each spectator device, such that the notification includes a selectable option to initiate a chat communication function between the matched spectator devices. In some embodiments, esports management system112can, in response to affirmations by the spectator devices, enable microphones and/or other sensors to enable text, audio, or video chat communication between the matched spectator devices. For example, spectators using a similar vantage point (e.g., a perspective within a threshold distance from another perspective, perspectives within a threshold distance from an object, perspectives having similar angles to an object, etc.) can be identified as matches and enable communication therebetween. By matching spectators with similar vantage points together and enabling communication between the matched spectators, a sense of community, camaraderie, and/or mutual enjoyment of similar interests can replicate some of the same feelings as those in a physical arena when fans interact with each other. In some embodiments, audio from spectator microphones is introduced into the game environment as crowd noise originating from the points in which the corresponding game renderings being viewed by the spectators originate from. These crowd noise audio sources may also be directional based on the direction that the view for the game rendering is facing. This may provide a rendering of sounds from other spectators, much like in the real world where the closer a spectator moves to another spectator the better the other spectators can be heard; and the further away the spectator moves the less the spectator can hear the other spectators. There can also be controls for the level of crowd noise that is included in the audio that is heard, both for players and for spectators. The inclusion of such crowd noise can give a more energetic live feel to game play that is being spectated.

It is further contemplated that these spectator views can be utilized on a secondary display of spectating devices. For example, a first spectator may be utilizing their own perspective or vantage point on a primary display and simultaneously request another view (e.g., a perspective from a second spectator) to display on a secondary display. Thus, the first spectator would be able to simultaneously view the game from more than one perspective (i.e., his/her own view and a perspective of another spectator). It is also considered that the secondary display can be used to display available media captures, views for selection (e.g., to display on the secondary display, switch views to the primary display, etc.), concurrent displays of opponents, etc. In some embodiments, for example, a grid can be generated to provide a menu of different view options available for a given scene, whereby a spectator can switch a display on a primary screen to switch out or add one or more selected views. A grid display may also be used to present multiple display areas that can be customized to provide various session information and/or entertainment (e.g., player profiles, scores, game or tournament records, different views or perspectives, replays, highlights, etc.) based on a context in the primary display. For example, when a player performs a difficult or otherwise significant maneuver, the grid can display the player profile, a replay of the player performing the difficult maneuver, highlights of one or more players performing the difficult maneuver, explanations about why the maneuver is difficult or impressive, narrative context for the maneuver being performed within a storyline of the interactive title, etc. It is further contemplated that the grid can be configured with preference rules for automatic view switching. For example, a spectator may be new to the game and have a preference for learning more about the game. Thus, the grid may provide additional information about why maneuvers are difficult, why players perform certain actions at specific locations or times, instructions for performing a maneuver recently displayed, additional clips of other players performing similar actions, etc. As another example, the automatic view switching can also assist in providing content that is important to the game to spectators that are new to the game. For example, spectators that are new to the game may not understand what or where to look. Thus, the preference rule for automatic view switching can have a new player preference that automatically switches to perspectives that captures aspects of the game that is important to the objectives of the game. For example, in many multiplayer online battle arena games, the goal is typically to destroy the enemy base. However, there are various goals that must be completed before it is possible to destroy the enemy base (e.g., destroying enemy towers outside of the base). Accordingly, esports management system112can receive the new player preference for automatic view switching to automatically provide perspectives to the device associated with the spectator, such that the provided perspectives show the current goal of interest (e.g., a tower being destroyed, a portion of the base being destroyed, etc.). It is further contemplated that a spectator may be able to view one or more game renderings that are generated locally while also viewing one or more game renderings that are being streamed over a network. Additionally, the local system may display annotations over a game rendering, whether generated locally or streamed, that are customized to provide information of interest to the spectator, such as game rules or player statistics.

FIG.2illustrates a network-based video game environment involving different types of client computing devices. The network environment100ofFIG.1may be implemented using different types of client computing devices210, each of which represent computer systems400or at least include components as being part of the computer system400ofFIG.4.

For instance,FIG.2illustrates a first client computing device210A that is a laptop portable computer, a second client computing device210B that is a home video game console connected to a television, a third client computing device210C that is a desktop home computer, and a fourth client computing device210D that is a smartphone/tablet portable computing device and/or a portable video game console. Any of the client computing devices210ofFIG.2may be assigned player roles or spectator roles for a particular game. In the context of the environment100ofFIG.1, each of the client computing devices108A,109A, and110A ofFIG.1are client computing devices210.

All four of the client computing devices210ofFIG.2are communicatively coupled together via network hardware220, which in the context of the environment100ofFIG.1, may include various servers, routers, and other network hardware within one or more esports management system(s)112, one or more gaming network(s)104, the public network102, or a combination thereof.

FIG.3illustrates a flow diagram illustrating server network operations for crowd-sourcing esports stream productions. The method300ofFIG.3may be embodied as executable instructions in a non-transitory computer readable storage medium including but not limited to a CD, DVD, or non-volatile memory such as a hard drive. The instructions of the storage medium may be executed by a processor (or processors) to cause various hardware components of a computing device hosting or otherwise accessing the storage medium to effectuate the method. The steps identified inFIG.3(and the order thereof) are exemplary and may include various alternatives, equivalents, or derivations thereof including but not limited to the order of execution of the same.

At step310, a game server (e.g., esports management system112) can generate a virtual environment associated with an interactive session. The interactive session can include a plurality of spectator devices. Each spectator device can be presented with a different display based on a corresponding vantage point located within the virtual environment. As discussed above, each spectator device can control the corresponding vantage point to move around and observe virtual objects within the virtual environment.

At step320, a game server (e.g., esports management system112) receives a plurality of media captures (e.g., images, videos, clips, livestreams, audio content, audiovisual content, etc.) from the spectator devices. Each of the media captures can be captured from the respective vantage point of the spectator device within the virtual environment.

At step330, a game server (e.g., esports management system112) can receive a preference rule for automatic view switching. The preference rule can define when a display (e.g., a secondary display, a display grid, etc.) associated with a requesting device switches between the plurality of media captures (e.g., other perspectives or different views, replays, highlights, etc.), information (e.g., player profiles, virtual asset information, strategy, etc.), and/or other entertainment. In some embodiments, the requesting device can be configured with one or more displays (e.g., a primary display, a secondary display, etc.) that are configured to display one or more media captures on any of the one or more displays.

At step340, a game server (e.g., esports management system112) selects one of the media captures. In some embodiments, the game server can select media captures based on a wide variety of factors including, but not limited to, visibility of an asset in the virtual environment, an angle of the perspective to the asset, a distance to the asset, clustering of spectator perspectives (e.g., a large number of spectators are spectating from a similar or the same vantage point), etc. In some embodiments, a plurality (e.g., two or more) of the media captures are selected. In some embodiments, the game server selects media capture(s) based on the preference rule.

At step350, a game server (e.g., esports management system112) streams the selected media capture to a primary display on a requesting device. In some embodiments, the game server can stream two or more media captures, such that the two or more media captures are displayed on one or more of the primary display and a secondary display associated with the requesting device.

At step352, a game server (e.g., esports management system112) can identify that a first spectator device and a second spectator device are within a threshold distance. It is also contemplated that the game server can identify, additionally or alternatively, that the first spectator device and the second spectator device are viewing a virtual asset from an angle within a threshold tolerance, such that the first spectator device and the second spectator device are viewing the virtual asset from a substantially similar direction.

Additionally or alternatively, at step354, a game server (e.g., esports management system112) gathers a first set of statistics from a first spectator device. For example, esports management system112can gather, for and/or from the first spectator device, viewership statistics (e.g., how many other spectators tune-into a specific spectator view), team or player affiliation, similarity (e.g., in distance and/or angle) of vantage point, etc.

At step356, a game server (e.g., esports management system112) gathers a second set of statistics from a second spectator device. For example, esports management system112can gather, for and/or from the second spectator device, viewership statistics (e.g., how many other spectators tune-into a specific spectator view), team or player affiliation, similarity (e.g., in distance and/or angle) of vantage point, etc.

At step358, a game server (e.g., esports management system112) generates a notification to the first spectator device and the second spectator device. In some embodiments, the notification can be generated based on the identification that the first spectator device and the second spectator device are within a threshold distance, as described in step352. In some embodiments, the notification can be generated based on a match between the first set of statistics and the second set of statistics. In some embodiments, the notification includes a selectable option to initiate a chat communication function between the first spectator device and the second spectator device.

Additionally or alternatively, at step360, a game server (e.g., esports management system112) identifies a profile of a player in the selected media capture. For example, a player may be shown to be performing a specific action in the selected perspective. Accordingly, esports management system112can identify a profile (e.g., in a database of player profiles) associated with the player performing the specific action.

At step362, a game server (e.g., esports management system112) streams the profile to the requesting device. In some embodiments, the profile is displayed on a secondary display. In some embodiments, the profile is displayed in at least one portion of a grid on a display of the requesting device.

FIG.4is a block diagram of an exemplary electronic entertainment system400. The entertainment system400ofFIG.4includes a main memory405, a central processing unit (CPU)410, vector unit415, a graphics processing unit420, an input/output (I/O) processor425, an I/O processor memory430, a controller interface435, a memory card440, a Universal Serial Bus (USB) interface445, and an IEEE interface450. The entertainment system400further includes an operating system read-only memory (OS ROM)455, a sound processing unit460, an optical disc control unit470, and a hard disc drive465, which are connected via a bus475to the I/O processor425.

Entertainment system400may be an electronic game console. Alternatively, the entertainment system400may be implemented as a general-purpose computer, a set-top box, a hand-held game device, a tablet computing device, or a mobile computing device or phone. Entertainment systems may contain more or less operating components depending on a particular form factor, purpose, or design.

The CPU410, the vector unit415, the graphics processing unit420, and the I/O processor425ofFIG.4communicate via a system bus485. Further, the CPU410ofFIG.4communicates with the main memory405via a dedicated bus480, while the vector unit415and the graphics processing unit420may communicate through a dedicated bus490. The CPU410ofFIG.4executes programs stored in the OS ROM455and the main memory405. The main memory405ofFIG.4may contain pre-stored programs and programs transferred through the I/O Processor425from a CD-ROM, DVD-ROM, or other optical disc (not shown) using the optical disc control unit470. I/O Processor425ofFIG.4may also allow for the introduction of content transferred over a wireless or other communications network (e.g., 4$, LTE, 3G, and so forth). The I/O processor425ofFIG.4primarily controls data exchanges between the various devices of the entertainment system400including the CPU410, the vector unit415, the graphics processing unit420, and the controller interface435.

The graphics processing unit420ofFIG.4executes graphics instructions received from the CPU410and the vector unit415to produce images for display on a display device (not shown). For example, the vector unit415ofFIG.4may transform objects from three-dimensional coordinates to two-dimensional coordinates, and send the two-dimensional coordinates to the graphics processing unit420. Furthermore, the sound processing unit460executes instructions to produce sound signals that are outputted to an audio device such as speakers (not shown). Other devices may be connected to the entertainment system400via the USB interface445, and the IEEE 1394 interface450such as wireless transceivers, which may also be embedded in the system400or as a part of some other component such as a processor.

A user of the entertainment system400ofFIG.4provides instructions via the controller interface435to the CPU410. For example, the user may instruct the CPU410to store certain game information on the memory card440or other non-transitory computer-readable storage media or instruct a character in a game to perform some specified action.

The present invention may be implemented in an application that may be operable by a variety of end user devices. For example, an end user device may be a personal computer, a home entertainment system (e.g., Sony PlayStation2® or Sony PlayStation3® or Sony PlayStation4®), a portable gaming device (e.g., Sony PSP® or Sony Vita®), or a home entertainment system of a different albeit inferior manufacturer. The present methodologies described herein are fully intended to be operable on a variety of devices. The present invention may also be implemented with cross-title neutrality wherein an embodiment of the present system may be utilized across a variety of titles from various publishers.

The present invention may be implemented in an application that may be operable using a variety of devices. Non-transitory computer-readable storage media refer to any medium or media that participate in providing instructions to a central processing unit (CPU) for execution. Such media can take many forms, including, but not limited to, non-volatile and volatile media such as optical or magnetic disks and dynamic memory, respectively. Common forms of non-transitory computer-readable media include, for example, a floppy disk, a flexible disk, a hard disk, magnetic tape, any other magnetic medium, a CD-ROM disk, digital video disk (DVD), any other optical medium, RAM, PROM, EPROM, a FLASHEPROM, and any other memory chip or cartridge.

Various forms of transmission media may be involved in carrying one or more sequences of one or more instructions to a CPU for execution. A bus carries the data to system RAM, from which a CPU retrieves and executes the instructions. The instructions received by system RAM can optionally be stored on a fixed disk either before or after execution by a CPU. Various forms of storage may likewise be implemented as well as the necessary network interfaces and network topologies to implement the same.

The foregoing detailed description of the technology has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the technology to the precise form disclosed. Many modifications and variations are possible in light of the above teaching. The described embodiments were chosen in order to best explain the principles of the technology, its practical application, and to enable others skilled in the art to utilize the technology in various embodiments and with various modifications as are suited to the particular use contemplated. It is intended that the scope of the technology be defined by the claim.

Claims

  1. A computer-implemented method for crowd-sourcing content for esports stream production, the method comprising: generating a virtual environment associated with an interactive session that includes a plurality of spectator devices, wherein each of the spectator devices is presented with a different display based on a corresponding vantage point located within the virtual environment;receiving a plurality of media captures from the spectator devices, wherein each of the media captures is captured from the corresponding vantage point associated with the spectator device within the virtual environment;selecting one of the media captures based on a comparison of visibility of an asset in the virtual environment;and streaming the selected media capture to a requesting device, wherein the streamed media capture is displayed on a primary display of the requesting device.
  1. The computer-implemented method of claim 1, wherein the requesting device is configured to display a set of the media captures on a secondary display.
  2. The computer-implemented method of claim 1, further comprising: identifying that a first spectator device and a second spectator device are within a threshold distance;and generating a notification to the first spectator device and the second spectator device based on the identification, wherein the notification includes a selectable option to initiate a chat communication function between the first spectator device and the second spectator device.
  3. The computer-implemented method of claim 1, further comprising: gathering a first set of statistics associated with a first spectator device;gathering a second set of statistics associated with a second spectator device;and generating a notification to the first spectator device and the second spectator device based on a match between the first set of statistics and the second set of statistics, wherein the notification includes a selectable option to initiate a chat communication function between the first spectator device and the second spectator device.
  4. The computer-implemented method of claim of claim 1, further comprising: identifying a profile of a player in the selected media capture;and providing the profile to the requesting device.
  5. The computer-implemented method of claim of claim 1, wherein two or more of the media captures are selected and streamed to the requesting device, and wherein each of the two or more media captures is displayed on one or more of the primary display and a secondary display associated with the requesting device.
  6. The computer-implemented method of claim 1, further comprising: receiving a preference rule for automatic view switching for the requesting device;and storing the preference rule in memory, wherein selecting the media capture is further based on the preference rule.
  7. The computer-implemented method of claim 7, wherein the preference rule defines one or more conditions for switching among the plurality of media captures displayed on a secondary display associated with the requesting device.
  8. The computer-implemented method of claim 1, further comprising customizing a display of the plurality of media captures for presentation on a secondary display based on the asset in the selected media capture.
  9. A system for crowd-sourcing content for esports stream production, the system comprising: a processor that executes instructions stored in memory, wherein the processor executes the instructions to generate a virtual environment associated with an interactive session that includes a plurality of spectator devices, wherein each of the spectator devices is presented with a different display based on a corresponding vantage point located within the virtual environment;a communication interface that communicates over a communication network, wherein the communication interface receives a plurality of media captures from the spectator devices, wherein each of the media captures is captured from the corresponding vantage point associated with the spectator device within the virtual environment;wherein the processor executes further instructions to select one of the media captures based on a comparison of visibility of an asset in the virtual environment;and wherein the communication interface streams the selected media capture to a requesting device, and wherein the streamed media capture is displayed on a primary display of the requesting device.
  10. The system of claim 10, wherein the requesting device is configured to display a set of the media captures on a secondary display.
  11. The system of claim 10, wherein the processor executes further instructions to: identify that a first spectator device and a second spectator device are within a threshold distance;and generate a notification to the first spectator device and the second spectator device based on the identification, wherein the notification includes a selectable option to initiate a chat communication function between the first spectator device and the second spectator device.
  12. The system of claim 10, wherein the processor executes further instructions to: gather a first set of statistics associated with a first spectator device;gather a second set of statistics associated with a second spectator device;and generate a notification to the first spectator device and the second spectator device based on a match between the first set of statistics and the second set of statistics, wherein the notification includes a selectable option to initiate a chat communication function between the first spectator device and the second spectator device.
  13. The system of claim 10, wherein the processor executes further instructions to identify a profile of a player in the selected media capture;and wherein the communication interface provides the profile to the requesting device.
  14. The system of claim 10, wherein two or more of the media captures are selected and streamed to the requesting device, and wherein each of the two or more media captures is displayed on one or more of the primary display and a secondary display associated with the requesting device.
  15. The system of claim 10, wherein the communication interface further receives a preference rule for automatic view switching for the requesting device;and further comprising memory that stores the preference rule, wherein selecting the media capture is further based on the preference rule.
  16. The system of claim 16, wherein the preference rule defines one or more conditions for switching among the plurality of media captures displayed on a secondary display associated with the requesting device.
  17. The system of claim 10, wherein the processor executes further instructions to customize a display of the plurality of media captures for presentation on a secondary display based on the asset in the selected media capture.
  18. A non-transitory, computer-readable storage medium, having embodied thereon a program executable by a processor to perform a method for crowd-sourcing content for esports stream production, the method comprising: generating a virtual environment associated with an interactive session that includes a plurality of spectator devices, wherein each of the spectator devices is presented with a different display based on a corresponding vantage point located within the virtual environment;receiving a plurality of media captures from the spectator devices, wherein each of the media captures is captured from the corresponding vantage point associated with the spectator device within the virtual environment;selecting one of the media captures based on a comparison of visibility of an asset in the virtual environment;and streaming the selected media capture to a requesting device, wherein the streamed media capture is displayed on a primary display of the requesting device.

Disclaimer: Data collected from the USPTO and may be malformed, incomplete, and/or otherwise inaccurate.