U.S. Pat. No. 11,052,321

While embodiments are described herein by way of example for several embodiments and illustrative drawings, those skilled in the art will recognize that embodiments are not limited to the embodiments or drawings described. It should be understood, that the drawings and detailed description thereto are not intended to limit embodiments to the particular form disclosed, but on the contrary, the intention is to cover all modifications, equivalents and alternatives falling within the spirit and scope as defined by the appended claims. The headings used herein are for organizational purposes only and are not meant to be used to limit the scope of the description or the claims. As used throughout this application, the word “may” is used in a permissive sense (i.e., meaning having the potential to), rather than the mandatory sense (i.e., meaning must). Similarly, the words “include”, “including”, and “includes” mean including, but not limited to.

DETAILED DESCRIPTION

Various embodiments of methods and apparatus for collecting, analyzing, and applying participant metrics in game environments are described. The game environments may include, but are not limited to, console games, online games, and game spectating systems. The participants may include game players and game spectators. Embodiments of participant metrics collection, analysis, and application methods and systems are described that may be used in game environments to collect, analyze, and apply participant metrics collected from participants (e.g., players and/or spectators) and apply the analysis information to affect game play and/or game spectating in various ways. Embodiments of a participant metrics module or service are described that may, for example, be used with game systems in game environments to process and apply participant metrics collected from players and/or spectators of the games to affect game play, in-game characters, teams, or objects, game environmental factors or conditions, the game spectating environment, and/or the game participants. Embodiments may also generate game-related information from participant metrics collected from players and/or spectators of the games, and may store the game-related information and/or provide the game-related information to one or more entities including but not limited to game broadcasters and game developers.

Devices, referred to herein as metrics devices or participant metrics devices, are described that may, for example, be worn or held by the participants, during game play when the participants are playing or spectating a game, when the participants are not actively participating in game play or game spectating, or by spectators when viewing recordings of previously played games (e.g., video on demand). Participant metrics (also referred to herein simply as “metrics”) may be collected from the participant metrics devices, for example by a participant metrics module as described herein. The participant metrics may include any data or information about respective participants and/or their current environment that can be captured by or obtained from participant metrics devices. For example, the participant metrics devices may include one or more sensors or other components that measure or otherwise obtain one or more participant metrics including but not limited to physical metrics or biometrics, of the participants during game play or when the participants are not actively participating in game play. The metrics that are obtained by the participant metrics devices may include one or more of pulse, heart rate, breath rate, temperature, electrodermal activity, motion, position, or in general any physical or biological metric that can be measured by sensors of a device worn or held by a human. The metrics that are obtained by the participant metrics devices may also include or be used to determine other data or information including but not limited to the physical location of the participants, affinity or association of the participants with particular teams, players or games (e.g., an indication of a particular player or team that a spectator is a fan of), and so on. The metrics may, for example, indicate participants' (spectators and/or players) reactions to game play. As another example, the metrics may indicate or be used to determine whether the participants associated with the participant metrics devices are currently participating as spectators or players in a game session. The metrics collected from spectators and/or players in a game environment by the participant metrics devices may be collected, aggregated, and analyzed by a component of the game environment referred to herein as a participant metrics module. For example, the collected metrics for an individual participant or collection of participants may be analyzed to generate game inputs based on analysis of the participants' reactions to game play. The game inputs may be provided by the participant metrics module to a game system or game engine that executes the game in the game environment as controlled by the game players via respective devices that support game play. The game system may apply the game inputs generated from the participant metrics to affect the game environment, game play, and/or game players in various ways. As another example, the metrics for individual participants or collection of participants may be stored, for example in a participant metrics database, as participant metrics data, and the participant metrics data may be provided to or accessed by one or more entities such as game developers for meta-analysis of games, game play, game spectating, and game environments. As another example, the metrics for individual participants or collections of participants may be analyzed to generate game-related information that may be provided to game systems, game broadcasters, or other entities in real-time or near-real-time, for example to broadcasters in game tournament environments.

In some embodiments, the participant metrics devices may also include one or more indicators (e.g., display screens, lights, speakers, active surface materials, motion or thermal devices, etc.) that may, for example be used to signal participants (spectators and/or players), for example during game play, for example to provide feedback or alerts to the spectators and/or players. The feedback to the participants may include, but is not limited to, visual, audio, and/or haptic signals. Visual signals may, for example, include one or more of lights, surface color changes, and on-screen displays. Audio signals may, for example, include one or more of beeps, rings, tones, music, and voice. Haptic signals may, for example, include one or more of pressure, vibration, and thermal signals, or in general any signal that can be sensed through contact with or proximity to the skin or by the sense of touch.

In some embodiments, the participant metrics devices may also include one or more control modules or components that collect sensor data from the sensor(s) and communicate metrics data to the participant metrics module, for example via wired and/or wireless network connections and network protocols. The control modules may also receive feedback signals from the participant metrics module or from other sources, for example via wired and/or wireless network connections and network protocols, and provide the signals to one or more indicators of the participant metrics devices.

In some embodiments, participant metrics devices may include network-connectable wearable devices or items of clothing including but not limited to wristbands, bracelets, watches, shirts, jackets, rings, helmets, goggles, glasses, and hats or caps. In some embodiments, participant metrics devices may instead or also include network-connectable handheld devices, including but not limited to game controllers that implement at least part of the participant metrics device sensing and/or signaling functionality as described herein. In some embodiments, participant metrics device sensing and/or signaling functionality may be integrated with or included in other devices such as smartphones, keyboards, cursor control devices, and remote controls, and thus these devices may be used as or with participant metrics devices in game environments as described herein. Non-limiting examples of participant metrics devices are described in reference toFIGS. 7A through 7D.

In some embodiments, participant metrics devices may be associated or affiliated with particular games, teams, or players. For example, fans of team A may obtain participant metrics devices that are associated with team A, and fans of team B may obtain participant metrics devices that are associated with team B. As another example, fans of a particular player may obtain and wear participant metrics devices associated with that particular player. As another example, participant metrics devices may be associated with particular games or game titles. In some embodiments, one or more mechanisms may be provided that may be used by a participant to change the player, team, or game that their participant metrics device is associated with. In some embodiments, the player, team, or game that a participant metrics device is associated with may be automatically changed in response to a respective participant's actions, for example in response to a spectator announcing that he or she is switching player or team affiliations in a chat window of a game system or spectating system interface. The metrics collected from the participant metrics devices may thus indicate the affiliations of particular participants with, or the support of particular participants for, particular teams, players, or games. In some embodiments, meta-information such as the number of participants that have purchased or are wearing participant metrics devices associated with a team or player may be used to affect teams, players, and/or the game environment. For example, powers, strength, health, or other attributes of a character associated with a player may be affected based on the number of spectators that have purchased or are wearing participant metrics devices associated with that player.

While participant metrics devices are generally described herein as including wearable or handheld devices, in some embodiments participant metrics devices may include other types of network-connected devices that are not necessarily worn or held by the participants, but that may capture and provide (via wired or wireless network connections) participant metrics in the participants' environment. For example, in some embodiments, a room or facility (e.g., a participant's living room or house) may include sensors or other devices (e.g., motion detection sensors, infrared sensors, cameras, microphones, etc.) from which participant metrics data may be obtained via wired or wireless Internet connections. As another example, a participant's keyboard may be configured as a participant metrics device that captures typing metrics such as typing speed, key depression force or pressure, time between keystrokes, and so on; the typing metrics may be collected and analyzed to determine baseline typing signatures for participants and information about particular participants or groups of participants based on their typing signatures. As another example, a punching bag or other device or object in a participant's environment may include sensors that capture and provide, via a wired or wireless network connection, metrics input based on the participant's interactions with the device, for example how often and how hard a participant strikes an object such as a punching bag.

In some embodiments, participant metrics for multiple players (e.g., players in groups or teams) may be collected from player metrics devices and analyzed by the participant metrics module to determine, for example, the current states (e.g., emotions, moods, excitement level, stress level, anger, sadness, happiness, frustration, fear, shock, surprise, amusement, motion, position, affiliations with particular players or teams, whether currently participating or not participating in a game, etc.) of the players/groups, and game play may be affected based on the analysis. In some embodiments, participant metrics for multiple spectators may be collected from spectator metrics devices and analyzed to determine, for example, the states (e.g., emotions, moods, excitement level, stress level, anger, sadness, happiness, frustration, fear, shock, surprise, amusement, motion, position, affiliations, whether currently participating or not participating in a game, etc.) of the spectators or crowd, and game play or game players or teams may be affected based on the analysis. In some embodiments, player and/or spectator metrics may be collected and analyzed to determine events or states within a game or within one or more broadcast channels in a game spectating system, and the analysis results may be used to affect the game and/or game spectating environment, for example by indicating or highlighting broadcasts, games, or events of interest within broadcasts or games to the spectators via the spectator metrics devices.

Game environments may include, but are not limited to, console games, online games, and game spectating systems. For simplicity, game implementations in general may be referred to as game systems. In a game system, players actively participate in game play as executed by a game engine, while spectators watch the game play of the players, possibly but not necessarily from remote locations. A game spectating system includes one or more game systems and a spectating service that broadcasts game play to spectators, with at least some players in the games executed by the game systems also acting as broadcasters. In some embodiments, a participant metrics module may be implemented as a component of a game system in a game environment, for example as illustrated inFIG. 1, or of game system(s) in a game spectating environment, for example as illustrated inFIG. 2. In some embodiments, a participant metrics module may be implemented by a spectating service in a game spectating environment, for example as illustrated inFIG. 3. In some embodiments, a participant metrics module may be implemented as or by an application or service external to the game system(s) and spectating service, for example as illustrated inFIG. 10.

Online games are network-based games that may allow one, two, or more players, in some cases even thousands of players, to simultaneously participate in a game from consumer devices coupled to a network. At least some online games may provide a “spectator” or “observer” mode that allows spectators to watch game play from consumer devices coupled to the network without directly participating in the game. At least some online games may also allow game sessions to be recorded and played back for viewing by the players and/or spectators.

Games that may be implemented in gaming environments as described herein may vary from tightly scripted games to games that introduce varying amounts of randomness to the game play. A game may, for example, be a game in which the players attempt to achieve some goal or overcome some obstacle, and may include multiple levels that the players have to overcome. A game may, for example, be a game in which the players cooperate to achieve goals or overcome obstacles, or a game in which one or more of the players compete against one or more other players, either as teams or as individuals. Alternatively, a game may be a game in which the players may more passively explore and make discoveries within a complex game universe without any particular goals in mind, or a “world-building” game in which the players may actively modify their environments within the game universe. Games may include everything from relatively simple, two-dimensional (2D) casual games to more complex 2D or three-dimensional (3D) action, sports, or strategy games, to multiplayer online battle arena (MOBA) games, to complex 3D massively multiplayer online games (MMOGs) such as massively multiplayer online role-playing games (MMORPGs) that may simultaneously support hundreds or thousands of players in a persistent online “world”.

Game spectating systems may include network-based video streaming systems or services that may allow players to broadcast live streams of their online game play to tens, hundreds, thousands or more spectators, while allowing the spectators to select the broadcasts of particular players (also referred to as channels) for viewing. A game spectating system may support live streaming of broadcasts from tens, hundreds, or thousands of players simultaneously. A game spectating system may record at least some live broadcasts and allow the recorded broadcasts to be played back for viewing by spectators. A game spectating system may support live and recorded broadcasts for one, two, or more different online games.

In this document, the term “player” is generally used to refer to an actual human that actively participates in a game, the term “spectator” is generally used to refer to an actual human that watches live or recorded game play without directly participating in the game as a player, the term “participant” is generally used to collectively refer to players (active participants) and spectators (passive participants), the term “client” (as in “client device”, “game client”, “broadcasting client”, and “spectating client”) is generally used to refer to a hardware and/or software interface to a game system or streaming system via which a participant interacts with the game system and/or spectating system, and the term “character” or “game character” is generally used to refer to a player's in-game presence or “avatar” that the player may control via a game client on a client device to interact with other game characters, other game entities, and other objects within the game environment during a game session. Note, however, that the term “participants” as used herein may also encompass persons, referred to as “supporters,” that are not currently playing, spectating, or otherwise involved in live or recorded game play but that may be wearing or carrying participant metrics devices as described herein. In addition, the term “broadcaster” as used herein is generally used to refer to an actual human that watches live or recorded game play and that generates video, text, and/or audio commentary on and/or description of the game play; a broadcaster may be, but is not necessarily, a player. In addition, the term “spectator” as used herein may also encompass persons who are listening to audio of game play, broadcaster commentary or description, and so on. This information may be used, for example, by the participant metrics module and/or game systems to map the metrics input from the participant metrics devices to particular players, teams, or games affiliated with the devices.

While embodiments are primarily described herein in the context of collecting, analyzing, and applying participant metrics in multiplayer online gaming environments in which two or more players participate in online game sessions, it is to be noted that embodiments may also be applied in single-player online games, as well as in single-player and multiplayer games that are not necessarily online, such as single-player and multiplayer console games that may be played locally/offline. In addition, in some embodiments, a spectating system may support broadcasts of live and/or recorded digital media content from sources other than game systems, for example from sports games, competitions, concerts, and other events including but not limited to live streams from electronic spectator sports (eSports) competitions, and embodiments may also be applied to collect, analyze, and apply participant metrics for these broadcasts.

While embodiments are primarily described herein in the context of collecting, analyzing, and applying participant metrics such as pulse, heart rate, breath, temperature, electrodermal activity, motion, and position in game environments, it is to be noted that embodiments may also analyze content of other participant inputs to the game environment, for example audio input and text input to an online chat user interface element of an online game or spectating system broadcast, and may use that analysis alone or in combination with the analysis of the metrics collected by the participant metrics devices to, for example, detect states of participants and affect the game accordingly. As another example, some embodiments may obtain images of participants' faces (broadcasters, players, commentators and/or spectators) captured during game play or broadcast, for example images captured by cameras attached to or integrated with the participants' respective devices. The images may be analyzed, for example using facial recognition techniques and techniques that detect emotions via analysis of facial expressions, and that analysis may be used alone or in combination with analysis of the metrics collected by the participant metrics devices to determine states of participants and affect a game accordingly. As another example, some embodiments may obtain images of participants' eyes (broadcasters, players, commentators and/or spectators) captured during game play or broadcast, for example images captured by cameras attached to or integrated with wearable computing devices such as smart glasses, goggles, optical head-mounted displays, virtual reality (VR) headsets, and the like. The images may be analyzed, for example using techniques that detect emotions or other states via tracking and analysis of eye movements, blinking, dilation, and so on, and that analysis may be used alone or in combination with analysis of the metrics collected by the participant metrics devices to determine states of participants and affect a game accordingly.

While embodiments are primarily described herein in the context of collecting, analyzing, and applying metrics collected from spectators viewing live games or live or prerecorded video or broadcasts of games, in some embodiments participant metrics may be collected from spectators (or listeners) of audio-only broadcasts or playbacks of games or game broadcasts to generate game information according to the spectators' metrics as collected while the spectators are listening to the game play, game commentary, and/or game play-by-play description.

FIG. 1illustrates a game environment in which metrics are collected from participants via metrics devices to affect a game, and in which feedback is provided to the participants from the game through the metrics devices, according to some embodiments. In some embodiments, a game environment may include a game system100and multiple client devices; the client devices may include player device(s)120and spectator device(s)150. The game system100stores game data and information, implements game logic, and serves as an execution environment for the game. Each player device120may include, but is not limited to, input and output components and client software for the game via which respective players130can participate in a game being executed by the game system100. Each spectator device150may include, but is not limited to, input and output components and client software via which one or more spectators160may watch current games or recorded game sessions.

In some embodiments, a game system100stores game data and information in a data store, implements game logic (game engine102), and serves as an execution environment for the game. The game system100may also implement one or more user interfaces (UIs) and one or more application programming interfaces (APIs) (shown as UI/API104) to the game system functionality. In some embodiments, a game system100may include one or more computing devices, for example one or more server devices, that implement the game logic, and may also include other devices including but not limited to storage devices that store game data including but not limited to recordings of game sessions and participant information. However, in some embodiments, functionality and components of a game system100may be implemented at least in part on one or more of the client devices. An example computing device that may be used in a game system100is illustrated inFIG. 11.

A client device120or150may be any of a variety of consumer devices including but not limited to desktop computer systems, laptop/notebook computer systems, pad/tablet devices, smartphone devices, game consoles, handheld gaming devices, and wearable devices. Wearable devices may include, but are not limited to, gaming glasses or goggles and gaming “watches” or the like that are wearable on the wrist, arm, or elsewhere. Thus, client devices may range from powerful desktop computers configured as gaming systems down to “thin” mobile devices such as smartphones, pad/tablet devices, and wearable devices. Each client device may implement an operating system (OS) platform that is compatible with the device. A client device may include, but is not limited to, input and output components and client software for the game via which respective players can participate in a game session currently being executed by the game system100, and via which one or more spectators may watch current game sessions or recorded game sessions. The game client on a particular client device may be tailored to support the configuration and capabilities of the particular device type and the OS platform of the device. An example computing device that may be used as a client device120or150is illustrated inFIG. 11.

In some embodiments, client devices120and/or150may include audiovisual (A/V) components such as video cameras and microphones that may receive audio (e.g., voice or speech) and video input from game players130and/or spectators150during game play and/or spectating. In some embodiments, the game system100may receive the A/V input via UI/API104. Video input may be received in any of a variety of video formats. Audio input may, for example, be received by game system100as audio tracks in video input, as Voice over IP (VoIP), or according to other network formats or protocols that support digital audio transmission. In some embodiments, game system100may receive player audio and/or video input from player devices120, and may also receive spectator audio and/or video input from spectator devices150.

In some embodiments, the game system100may implement an online multiplayer game, and the game system100may be or may include one or more devices on a network of a game provider that implement the game engine102and UI/API104and that serve as or provide an execution environment for the online multiplayer game. In these online multiplayer game environments, client devices120and150are typically remotely located from the game system100and access the game system100via wired and/or wireless connections over an intermediate network or networks such as the Internet. Further, the client devices may typically have both input and output capabilities for playing and/or spectating the online multiplayer game.

In some embodiments, instead of a game system100implemented according to a client-server model or variation thereof in which one or more devices such as servers host most or all of the functionality of the online game, a game system100may at least in part be implemented as or on local devices that implement at least a portion of the game logic, for example gaming consoles that serve as local execution environments for console-based online multiplayer games installed on the console or executed from media inserted into the console. One or more client devices120and150may be local to the game system100, and may access the game system100via local wired or wireless connections for game play or spectating.

In some embodiments, instead of a game system100implemented according to a client-server model or variation thereof in which one or more devices such as servers host most or all of the functionality of the game system100, a game system100may be implemented according to a distributed or peer-to-peer architecture in which at least some of the game functionality and components of the game system100are distributed among one, two, or more client devices120and/or150that collectively participate in a peer-to-peer relationship to execute, play in, and/or spectate game sessions.

The following is a broad description of an example method for game execution in a game environment, and is not intended to be limiting. In some embodiments, for a particular game session, the game engine102of the game system100may generate a game universe that includes the game session's context, characters, and environment. The players130manipulate their characters within this universe via the player devices120and/or controllers122. The game system100may generate and display a view of the game universe from the perspective of each player's character to the player130on the player's respective device120, and may receive player input to and interactions with the game universe via the player's respective device120and/or controller122. The game system100may also generate and display a view of the game universe from the current perspective or viewpoint of each spectator170on the spectator's respective device150. Note that the spectators170typically do not have characters or avatars that appear within the game universe.

Typically, game logic/execution of the game system100is implemented in game engine102according to event-driven architecture in which a game event loop monitors for and reacts to players' inputs to and interactions with the game universe via their respective devices120and/or controllers122. Based upon the players' inputs and interactions with the universe and on other game factors (e.g., scripted events and/or a randomness component) at iterations of the game event loop, the game session progresses along a game session timeline, with the game universe being modified and updated accordingly.

In some embodiments, concurrent with the game event loop execution, game system100renders a 2D or 3D representation of the game universe based on the current state of the universe, generates video and sound according to a video frame rate based upon the rendering, and sends or streams the video and sound output to the client devices120and/or150for display. In some embodiments, the video and sound may be generated for and sent or streamed to each client device120and/or150according to a corresponding participant's current perspective or view of the universe. The game clients on these client devices120and/or150may be referred to as “thin” game clients as the game clients may not implement a 2D or 3D rendering component. However, in some embodiments, at least a portion of the actual rendering may be performed by “thick” game clients on the client devices120and/or150that do implement a 2D or 3D rendering component. In these implementations, instead of the game system100performing the full rendering of the game universe into video and sound and sending the video and sound to “thin” game clients on client devices120and/or150for display, the game system100may instead send game universe data to the client devices120and/or150from which thick game clients can render and display video and sound.

InFIG. 1, a participant metrics module106is implemented as a component of the game system100in the game environment. The game system100also includes a game engine102that executes the game as controlled by one or more players130via player device(s)120and/or controllers122, and game user interface/application programming interface (UI/API)104components that interface with player device(s)120and spectator device(s)150to provide input to and output from the game engine102. WhileFIG. 1shows participant metrics module106as separate from game engine102, in some embodiments participant metrics module106may be a component of game engine102.

In some embodiments, participant metrics module106may include one or more computing devices, for example one or more server devices, that implement a metrics processing engine that provides metrics analysis functionality and one or more application programming interfaces (APIs) to the metrics analysis functionality. Participant metrics module106may also include or access other devices including but not limited to storage devices for storing metrics analysis information for individual participants (players and/or spectators), groups, crowds, and/or games including but not limited to participant metrics patterns that can be matched or mapped to individual participants' states, group or crowd states, particular game events, and so on. In some embodiments, participant metrics module106may be implemented as a separate system from game system100, for example as a network-based service that is accessible by one or more entities including but not limited to game system100. In some embodiments, as shown inFIG. 1, participant metrics module106may be implemented as a component, module, or subsystem of a game system100.FIG. 6illustrates components and operations of an example participant metrics module106, according to some embodiments. An example computing device that may be used in a participant metrics module106is illustrated inFIG. 11.

Devices, referred to herein as participant metrics devices or simply metrics devices, may, for example, be worn or held by the participants during game play when the participants are playing or spectating a game, when the participants are not actively participating in game play or game spectating, or by spectators when viewing recordings of previously played games (e.g., video on demand). The participant metrics devices may include player metrics device(s)140and spectator metrics device(s)170. Note that the metrics devices may all be the same type of device or may include different types of devices. Each participant metrics device may include one or more sensors or other components that measure or otherwise obtain one or more participant metrics, including but not limited to physical metrics or biometrics, of the participants during game play or when the participants are not actively participating in game play. The metrics that are obtained by the participant metrics devices may include pulse, heart rate, breath, temperature, electrodermal activity, motion, position, or in general any physical or biological metric that can be measured or otherwise obtained by sensors or other components of a device worn or held by a human. The metrics that are obtained by the participant metrics devices may also include or be used to determine other data or information including but not limited to the physical location of the participants, affinity or association of the participants with particular teams, players or games (e.g., an indication of a particular player or team that a spectator is a fan of), and so on. The metrics may, for example, indicate participants' (spectators160and/or players130) reactions to game play. As another example, the metrics may indicate or be used to determine whether the participants associated with the participant metrics devices are currently participating as spectators or players in a game session. The metrics collected from spectators160and/or players130in the game environment by the participant metrics devices may be collected, aggregated, and analyzed by the participant metrics module106. For example, the collected metrics for an individual participant or collection of participants may be analyzed to generate game inputs based at least in part on the participants' reactions to the game play. The game inputs may be provided by the participant metrics module106to the game engine102. The game engine102may apply the game inputs generated from the participant metrics to affect the game environment, game play, and/or game players130in various ways. As another example, the metrics for individual participants or collection of participants may be stored, for example in a participant metrics database, as participant metrics data, and the participant metrics data may be provided to or accessed by one or more entities such as game developers for meta-analysis of games, game play, game spectating, and game environments. As another example, the collected metrics for an individual participant or collections of participants may be analyzed to generate game-related information that may be provided to game systems, game broadcasters, or other entities in real-time or near-real-time, for example to broadcasters in game tournament environments.

In some embodiments, the participant metrics devices may also include one or more indicators (e.g., display screens, lights, speakers, active surface materials, motion or thermal devices, etc.) that may, for example, be used to signal the spectators160and/or players130during game play, for example to provide feedback or alerts to the spectators160and/or players130. The signals may include, but are not limited to, visual, audio, and/or haptic signals. Visual signals may, for example, include one or more of lights, surface color changes, and on-screen displays. Audio signals may, for example, include one or more of beeps, rings, tones, music, and voice. Haptic signals may, for example, include one or more of pressure, vibration, and thermal signals, or in general any signal that can be sensed through contact with or proximity to the skin or by the sense of touch. For example, the participant metrics module may analyze metrics collected from the participant metrics devices to determine supporters of a player or team that are not currently participating as spectators watching the game, and may provide a signal the participant metrics devices associated with the determined supporters to alert the respective supporters of an event in the game involving their player or team. The participant metrics devices associated with the determined supporters may provide a visual, audio, and/or haptic indication of the alert to the respective participants in response to the signal.

In some embodiments, the participant metrics devices may include wearable devices or items of clothing including but not limited to wristbands, bracelets, watches, shirts, jackets, rings, helmets, goggles, glasses, and hats or caps. In some embodiments, the participant metrics devices may instead or also include handheld devices, including but not limited to game controllers122that implement at least part of the participant metrics device sensing and/or signaling functionality as described herein. In some embodiments, participant metrics device sensing and/or signaling functionality may be integrated with or included in other devices such as smartphones, keyboards, cursor control devices, and remote controls, and thus these devices may be used as participant metrics devices in game environments. Non-limiting examples of participant metrics devices are described in reference toFIGS. 7A through 7D.

In some embodiments, participant metrics analysis functionality may be implemented in part on the participant metrics devices. For example, in some embodiments, at least some participant metrics devices may include a participant metrics control module that may locally perform at least some analysis of the metrics collected for respective participants (players or spectators) associated with the participant metrics devices, and that may stream or upload the analysis information to the participant metrics module106, for example for aggregation with other analysis information and possibly further analysis to generate inputs to the game engine102.

In some embodiments, player metrics for individual players130or multiple players130(e.g., players in groups or teams) may be collected from player metrics devices140and analyzed to determine, for example, the current states (e.g., emotions, moods, excitement level, stress level, anger, sadness, happiness, frustration, fear, shock, surprise, amusement, movements, gestures, position, affiliations, whether currently participating or not participating in a game, etc.) of the players/groups, and game play may be affected based on the analysis. In some embodiments, spectator metrics for individual spectators160or multiple spectators160may be collected from spectator metrics devices170and analyzed to determine, for example, the states (e.g., emotions, moods, excitement level, stress level, anger, sadness, happiness, frustration, fear, shock, surprise, amusement, affiliations, whether currently participating or not participating in a game, etc.) of the spectators, crowds, or groups of fans affiliated with particular players or teams, and game play for game players or teams may be affected based on the analysis. In some embodiments, the player and/or spectator metrics may be collected and analyzed by the participant metrics module106to determine events or states within a game based on the participants' states, and the analysis results may be used to affect the game being executed by game engine102, for example by providing game inputs to the game engine102that change one or more parameters of the game.

In some embodiments, the participant metrics module106may signal information including but not limited to events or states within the game to the spectators160via the spectator metrics devices170. Spectator160reactions to the signals may be measured by the spectator metrics devices170and provided to the participant metrics module106. The participant metrics module106may analyze the spectator160reactions to generate game inputs to the game engine102that affect the game based on the spectator160reactions. In some embodiments, the participant metrics module106may signal information including but not limited to spectator states or reactions to the game or to signals sent to the spectator metrics devices170to the players130via the player metrics devices140.

In some embodiments, the game system100or players130may generate alerts that may be signaled to the spectators160via the spectator metrics devices170. For example, in some embodiments, the game engine102may detect a significant game event or situation involving one or more players130or teams of players130, and may send an alert signal to the participant metrics module106, which may in turn signal the alert to one or more spectators160via respective spectator metrics devices170. As another example, in some embodiments, a player130may send an alert signal to the participant metrics module106via the game client on their player device120, which may in turn signal the alert to one or more spectators160via respective spectator metrics devices170. As another example, in some embodiments, a player130may send an alert signal to the participant metrics module106via their player metrics device140, which may in turn signal the alert to one or more spectators160via respective spectator metrics devices170.

FIG. 2is a block diagram that illustrates a game system collecting metrics from participant metrics devices and providing feedback to participant metrics devices in a spectating environment, according to some embodiments. A game spectating environment as shown inFIG. 2may include a spectating system or service290and one or more game systems200. For example, one or more game systems100as illustrated inFIG. 1may be implemented in the spectating environment as illustrated inFIG. 2. A game system200may store game data and information in a data store and implement game logic (game engine202), and serves as an execution environment for a respective game. A game system200may implement one or more user interfaces (UIs) and one or more application programming interfaces (APIs) (shown as UI/API204) to the game system functionality. As shown inFIG. 2, at least one game system200in the spectating environment may also implement a participant metrics module206as described herein.

The spectating environment may also include multiple client devices; the client devices may include player/broadcaster devices220and spectator devices250. Each player/broadcaster device220may include, but is not limited to, input and output components and game client software for at least one online game200via which respective players can participate in game sessions currently being executed by the game system(s)200. Each player/broadcaster device220may also include input and output components (e.g., video cameras and microphones) and broadcasting client software for the spectating service290via which respective players acting as broadcasters may generate live A/V streams of their online game play and commentary for broadcasting to spectators via the game spectating service290. In some embodiments, the broadcasters may also receive spectator feedback (e.g., audio and/or textual commentary or chat) from the spectating service290, for example via the broadcasting client software. Each spectator device250may include, but is not limited to, input and output components and spectating client software via which respective spectators may interact with the spectating service290to select, receive, and view live broadcasts from the broadcasters or playbacks of previously recorded broadcasts, and via which the spectators may provide spectator feedback (e.g. audio or textual commentary) for broadcasts.

In some embodiments, spectating service290may be a network-based video streaming system that may allow players to broadcast live streams of their online game play to tens, hundreds, thousands or more spectators, while allowing the spectators to select the broadcasts of particular players (also referred to as channels) for viewing. A spectating service290may support live broadcasts for one, two, or more different game systems200, and may support live streaming of broadcasts from tens, hundreds, or thousands of player/broadcaster devices220to the spectator devices250. In some embodiments, a spectating service290may record at least some live broadcasts and allow the recorded broadcasts to be played back for viewing by spectators.

WhileFIG. 2shows game systems200as separate from spectating service290, in some embodiments, at least one game system200may be implemented at least in part by spectating service290. In some embodiments, one or more player/broadcaster devices220may be implemented within spectating service290. In some embodiments, at least some components of a spectating environment as shown inFIG. 2may be implemented in the context of a service provider that provides virtualized resources on a provider network to clients of the service provider, for example as illustrated inFIG. 10. For example, the spectating service290may be implemented as a service on a provider network as illustrated inFIG. 10, and one or more game systems200may be implemented by game providers on the provider network.

In some embodiments, a spectating service290may support broadcasts of live and/or recorded digital media content via player/broadcaster devices220from sources other than game systems200. For example, in some embodiments, the spectating service290may support live or recorded broadcasts of streams from sports games, competitions, concerts, and other events including but not limited to live streams from electronic spectator sports (eSports) competitions. eSports (also referred to as competitive gaming) generally refers to organized multiplayer video game competitions. For example, video cameras and audio equipment may be installed in an arena or other venue in which an event such as a sports game or an eSports competition is being held. Video and/or audio feeds from the equipment may be input to one or more broadcaster devices220that may composite and stream the audio/video (A/V) inputs to the spectating service290. For eSports events, game A/V may be added to the stream along with the feeds from the cameras and audio equipment. Commentators and/or broadcasters may input their audio, text, and/or video content into the stream as well. The live stream may be broadcast to spectator devices250by the spectating service290, and/or may be recorded for rebroadcast. Spectators may view the broadcast on spectator devices250, and may also input A/V and/or text input via the spectating service290clients on their devices250.

As shown inFIG. 2, at least one game system200in the spectating environment may also implement a participant metrics module206as described herein. In some embodiments, participant metrics module206may include one or more computing devices, for example one or more server devices, that implement a metrics processing engine that provides metrics analysis functionality and one or more application programming interfaces (APIs) to the metrics analysis functionality. Participant metrics module206may also include or access other devices including but not limited to storage devices for storing metrics analysis information for individual participants (players and/or spectators), groups, crowds, and/or games including but not limited to participant metrics patterns that can be matched or mapped to individual participants' states, group or crowd states, particular game events, and so on. In some embodiments, participant metrics module206may be implemented as a separate system from game system200, for example as a network-based service that is accessible by one or more entities including but not limited to the game system200. In some embodiments, as shown inFIG. 2, participant metrics module206may be implemented as a component, module, or subsystem of a game system200in the spectating environment.FIG. 6illustrates components and operations of an example participant metrics module206, according to some embodiments. An example computing device that may be used in a participant metrics module206is illustrated inFIG. 11.

Devices, referred to herein as participant metrics devices or simply metrics devices, may, for example, be worn or held by the participants during game play when the participants are playing or spectating a game, when the participants are not actively participating in game play or game spectating, or by spectators when viewing recordings of previously played games (e.g., video on demand). The participant metrics devices may include player metrics device(s)240and spectator metrics device(s)270. Note that the participant metrics devices may all be the same type of device or may include different types of devices. Each participant metrics device may include one or more sensors or other components that measure or otherwise obtain one or more participant metrics, including but not limited to physical metrics or biometrics, of the participants during game play or when the participants are not actively participating in game play. The metrics that are obtained by the participant metrics devices may include pulse, heart rate, breath, temperature, electrodermal activity, motion, position, or in general any physical or biological metric that can be measured or otherwise obtained by sensors or other components of a device worn or held by a human. The metrics that are obtained by the participant metrics devices may also include or be used to determine other data or information including but not limited to the physical location of the participants, affinity or association of the participants with particular teams, players or games (e.g., an indication of a particular player or team that a spectator is a fan of), and so on. The metrics may, for example, indicate participants' (spectators, players also acting as broadcasters, and/or players that are not also broadcasters) reactions to game play and/or game broadcasts. As another example, the metrics may indicate or be used to determine whether the participants associated with the participant metrics devices are currently participating as spectators or players in a game session or broadcast. The metrics collected from the spectators and/or players by the participant metrics devices during a game executed by the game system200and broadcast by the spectating service290may be collected, aggregated, and analyzed by the participant metrics module206. For example, the collected metrics for an individual participant or collection of participants may be analyzed to generate game inputs based at least in part on the participants' reactions to the game play and/or broadcasts. The game inputs may be provided by the participant metrics module206to the game engine202. The game engine202may apply the game inputs generated from the participant metrics to affect the game universe, game play, and/or game players in various ways. As another example, the metrics for individual participants or collection of participants may be stored, for example in a participant metrics database, as participant metrics data, and the participant metrics data may be provided to or accessed by one or more entities such as game developers for meta-analysis of games, game play, game spectating, and game environments. As another example, the collected metrics for an individual participant or collections of participants may be analyzed to generate game-related information that may be provided to game systems, game broadcasters, or other entities in real-time or near-real-time, for example to broadcasters in game tournament environments.

In some embodiments, the participant metrics devices240and/or270may also include one or more indicators (e.g., display screens, lights, speakers, active surface materials, motion or thermal devices, etc.) that may, for example, be used to signal the spectators and/or players during game play, for example to provide feedback or alerts to the spectators and/or players. The feedback or alerts may include, but are not limited to, visual, audio, and/or haptic signals. Visual signals may, for example, include one or more of lights, surface color changes, and on-screen displays. Audio signals may, for example, include one or more of beeps, rings, tones, music, and voice. Haptic signals may, for example, include one or more of pressure, vibration, and thermal signals, or in general any signal that can be sensed through contact with or proximity to the skin or by the sense of touch.

In some embodiments, the participant metrics devices240and270may include wearable devices or items of clothing including but not limited to wristbands, bracelets, watches, shirts, jackets, rings, helmets, goggles, glasses, and hats or caps. In some embodiments, the participant metrics devices may instead or also include handheld devices, including but not limited to game controllers that implement at least part of the participant metrics device sensing and/or signaling functionality as described herein. In some embodiments, participant metrics device sensing and/or signaling functionality may be integrated with or included in other devices such as smartphones, keyboards, cursor control devices, and remote controls, and thus these devices may be used as participant metrics devices in game environments. Non-limiting examples of participant metrics devices are described in reference toFIGS. 7A through 7D.

In some embodiments, participant metrics analysis functionality may be implemented in part on the participant metrics devices240and270. For example, in some embodiments, at least some participant metrics devices240and270may include a participant metrics control module that may locally perform at least some analysis of the metrics collected for respective participants (players or spectators) associated with the participant metrics devices, and that may stream or upload the analysis information to the participant metrics module206, for example for aggregation with other analysis information and possibly further analysis to generate inputs to the game engine202.

In some embodiments, player metrics for individual players or multiple players (e.g., players in groups or teams) may be collected from player metrics devices240and analyzed to determine, for example, the current states (e.g., emotions, moods, excitement level, stress level, anger, sadness, happiness, frustration, fear, shock, surprise, amusement, affiliations, whether currently participating or not participating in a game, etc.) of the players/groups, and game play may be affected based on the analysis. In some embodiments, spectator metrics for individual spectators or multiple spectators may be collected from spectator metrics devices270and analyzed to determine, for example, the states (e.g., emotions, moods, excitement level, stress level, anger, sadness, happiness, frustration, fear, shock, surprise, amusement, affiliations, whether currently participating or not participating in a game, etc.) of the spectators, crowds, or groups of fans affiliated with particular players or teams, and game play for game players or teams may be affected based on the analysis. In some embodiments, the player and/or spectator metrics may be collected and analyzed by the participant metrics module206to determine events or states within a game executing on a game system200in the spectating environment based on the participants' states, and the analysis results may be used to affect the game being executed by the game system200, for example by providing game inputs to the game engine202that change one or more parameters of the game.

In some embodiments, the participant metrics module206may signal information including but not limited to events or states within the game to the spectators via the spectator metrics devices270. Spectator reactions to the signals may be measured by the spectator metrics devices270and provided to the participant metrics module206. The participant metrics module206may analyze the spectator reactions to generate game inputs to the game engine202that affect the game based on the spectator reactions. In some embodiments, the participant metrics module206may signal information including but not limited to spectator states or reactions to the game or broadcasts to the players via the player metrics devices240.

In some embodiments, the game system200or players may generate alerts that may be signaled to the spectators via the spectator metrics devices270. For example, in some embodiments, the game engine202may detect a significant game event or situation involving one or more players or teams of players, and may send an alert signal to the participant metrics module206, which may in turn signal the alert to one or more spectators via respective spectator metrics devices270. As another example, in some embodiments, a player may send an alert signal to the participant metrics module206via the game client on their player/broadcaster device220, which may in turn signal the alert to one or more spectators via respective spectator metrics devices270. As another example, in some embodiments, a player may send an alert signal to the participant metrics module206via their player metrics device240, which may in turn signal the alert to one or more spectators via respective spectator metrics devices270.

WhileFIG. 2shows spectator metrics being provided to the participant metrics module206from spectator metrics devices270and feedback being provided to the spectator metrics devices270from the participant metrics module206through the spectating service290, in some embodiments at least some of the spectator metrics devices270may communicate with the participant metrics module206through wired or wireless communications that do not pass through the spectating service290.

FIG. 3is a block diagram that illustrates a spectating service collecting metrics for games from participant metrics devices and providing feedback from the games to participant metrics devices in a spectating environment, according to some embodiments. In some embodiments, instead of or in addition to game system(s)200that implement participant metrics module(s)206in a game spectating environment as illustrated inFIG. 2, a participant metrics module306may be implemented by the spectating service390in the game spectating environment, for example as illustrated inFIG. 3. A game spectating environment as shown inFIG. 3may include a spectating system or service390and one or more game systems300. Each game system300may implement game logic (game engine302) and serves as an execution environment for a respective game. A game system300may provide a UI/API304to the game system functionality to player/broadcaster devices320in the game spectating environment. As was described in reference toFIG. 2, the spectating environment ofFIG. 3may include multiple client devices that include player/broadcaster devices320for broadcasting game play to spectators via the game spectating service390, and spectator devices350for viewing the broadcasts via the game spectating service390.

WhileFIG. 3shows game systems300as separate from spectating service390, in some embodiments, at least one game system300may be implemented at least in part by spectating service390. In some embodiments, one or more player/broadcaster devices320may be implemented within spectating service390. In some embodiments, at least some components of a spectating environment as shown inFIG. 3may be implemented in the context of a service provider that provides virtualized resources on a provider network to clients of the service provider, for example as illustrated inFIG. 10. For example, the spectating service390and/or participant metrics module306may be implemented as services on a provider network as illustrated inFIG. 10, and one or more game systems300may be implemented by game providers on the provider network.

As shown inFIG. 3, the spectating service390may implement a participant metrics module306as described herein that may provide participant metrics functionality for one or more of the game systems300in the spectating environment. Participant metrics devices may, for example, be worn or held by the participants (spectators, players also acting as broadcasters, and/or players that are not also broadcasters) during game play. Non-limiting examples of participant metrics devices are described in reference toFIGS. 7A through 7D. The participant metrics devices may include player metrics device(s)340and spectator metrics device(s)370. Each participant metrics device may include one or more sensors or other components that measure or otherwise obtain one or more participant metrics, including but not limited to physical metrics or biometrics of the participants during game play or when the participants are not actively participating in game play. The metrics that are obtained by the participant metrics devices may include any physical or biological metric that can be measured by sensors of a device worn or held by a human. The metrics that are obtained by the participant metrics devices may also include or be used to determine other data or information including but not limited to the physical location of the participants, affinity or association of the participants with particular teams, players or games (e.g., an indication of a particular player or team that a spectator is a fan of), and so on. The metrics may, for example, indicate participants' (spectators and/or players) reactions to game play and/or game broadcasts. As another example, the metrics may indicate or be used to determine whether the participants associated with the participant metrics devices are currently participating as spectators or players in a game session or broadcast. The metrics collected from spectators and/or players by the participant metrics devices during a game executed by a game system300and broadcast by the spectating service390may be collected, aggregated, and analyzed by the participant metrics module306. For example, the collected metrics for an individual participant or collection of participants may be analyzed to generate game inputs based at least in part on the participants' reactions to the game play and/or broadcasts. The game inputs may be provided by the participant metrics module306to the game engine302, for example via an API provided by the spectating system390or participant metrics module306. The game engine302may apply the game inputs generated from the participant metrics to affect the game universe, game play, and/or game players in various ways. As another example, the metrics for individual participants or collection of participants may be stored, for example in a participant metrics database, as participant metrics data, and the participant metrics data may be provided to or accessed by one or more entities such as game developers for meta-analysis of games, game play, game spectating, and game environments. As another example, the metrics for individual participants or collections of participants may be analyzed to generate game-related information that may be provided to game systems, game broadcasters, or other entities in real-time or near-real-time, for example to broadcasters in game tournament environments.

In some embodiments, the participant metrics devices340and/or370may also include one or more indicators (e.g., display screens, lights, speakers, active surface materials, motion or thermal devices, etc.) that may be used, for example, to signal the spectators and/or players during game play, for example to provide feedback or alerts to the spectators and/or players. The signals may include, but are not limited to, visual, audio, and/or haptic signals.

In some embodiments, participant metrics analysis functionality may be implemented in part on the participant metrics devices340and370. For example, in some embodiments, at least some participant metrics devices340and370may include a participant metrics control module that may locally perform at least some analysis of the metrics collected for respective participants (players or spectators) associated with the participant metrics devices, and that may stream or upload the analysis information to the participant metrics module306, for example for aggregation with other analysis information and possibly further analysis to generate inputs to the game engine302of a game system300.

In some embodiments, player metrics for individual players or multiple players (e.g., players in groups or teams) may be collected from player metrics devices340and analyzed to determine, for example, current states of the players/groups, and game play may be affected based on the analysis. In some embodiments, spectator metrics for individual spectators or multiple spectators may be collected from spectator metrics devices370and analyzed to determine, for example, states of the spectators, crowds, or groups of fans affiliated with particular players or teams, and game play for game players or teams may be affected based on the analysis. In some embodiments, the player and/or spectator metrics may be collected and analyzed by the participant metrics module306to determine events or states within a game executing on a game system300in the spectating environment based on the participants' states, and the analysis results may be used to affect the game being executed by the game system300, for example by providing game inputs to the game engine302that change one or more parameters of the game.

In some embodiments, the participant metrics module306may signal information including but not limited to events or states within a game being executed by a game system300in the spectating environment to the game's spectators via respective spectator metrics devices370. Spectator reactions to the signals may be measured by the spectator metrics devices370and provided to the participant metrics module306. The participant metrics module306may analyze the spectator reactions to generate game inputs to the game engine302that affect the game based on the spectator reactions. In some embodiments, the participant metrics module306may signal information including but not limited to spectator states or reactions to the game or broadcasts to the players via the player metrics devices340.

In some embodiments, a game system300or a game's players may generate alerts that may be signaled to the spectators via the spectator metrics devices370. For example, in some embodiments, a game system300may detect a significant game event or situation involving one or more players or teams of players, and may send an alert signal to the participant metrics module306, which may in turn signal the alert to one or more spectators via respective spectator metrics devices370. As another example, in some embodiments, a player may send an alert signal to the participant metrics module306via their player/broadcaster device320, which may in turn signal the alert to one or more spectators via respective spectator metrics devices370. As another example, in some embodiments, a player may send an alert signal to the participant metrics module306via their player metrics device340, which may in turn signal the alert to one or more spectators via respective spectator metrics devices370.

FIGS. 4A and 4Bare high-level flowcharts of a method for collecting, analyzing, and applying participant metrics in a game environment, according to some embodiments. The methods ofFIGS. 4A and 4Bmay, for example, be applied in game environments as illustrated inFIGS. 1 through 3.

FIG. 4Aillustrates a method for collecting and analyzing participant metrics in a game environment, according to some embodiments. The method ofFIG. 4Amay, for example, be implemented by a participant metrics module as illustrated inFIGS. 1 through 3andFIG. 6. As indicated at400ofFIG. 4A, a participant metrics module may receive metrics for participants in a game from participant metrics devices. In some embodiments, a participant metrics module may be implemented as a component of a game system in a game environment, for example as illustrated inFIG. 1, or of game system(s) in a game spectating environment, for example as illustrated inFIG. 2. In some embodiments, a participant metrics module may be implemented by a spectating service in a game spectating environment, for example as illustrated inFIG. 3. In some embodiments, a participant metrics module may be implemented as or by an application or service external to the game system(s) and spectating service, for example as illustrated inFIG. 10. The participant metrics devices may, for example, include devices that are worn or held by participants (spectators and/or players) in a game session executing on a game system in a game environment. The participant metrics devices may, for example, be worn or held by the participants during game play when the participants are playing or spectating a game or broadcast, when the participants are not actively participating in game play or game spectating, or by spectators when viewing recordings of previously played games (e.g., video on demand). Each participant metrics device may include one or more sensors or other components that measure or otherwise obtain one or more participant metrics, including but not limited to physical metrics or biometrics of a respective participant wearing or holding the device. The metrics that are measured by the participant metrics device may include pulse, heart rate, breath, temperature, electrodermal activity, motion, position, or in general any physical or biological metric that can be measured by sensors of a device worn or held by a human. The metrics that are obtained by the participant metrics devices may also include or be used to determine other data or information including but not limited to the physical location of the participants, affinity or association of the participants with particular teams, players or games (e.g., an indication of a particular player or team that a spectator is a fan of), and so on. A participant metrics device may include a control component that communicates the sensor data collected on the device to the participant metrics module, for example via a wired or wireless connection. In some embodiments, the control component may perform some processing of the sensor data before communicating the sensor data to the participant metrics module. In some embodiments, the participant metrics device may provide the sensor data to the participant metrics module according to an API provided by the participant metrics module.

As indicated at410ofFIG. 4A, the participant metrics module may analyze the metrics to determine current information about the game participants (players and/or spectators) or game. In some embodiments, metrics for individual players or spectators may be collected from participant metrics devices and analyzed to determine, for example, the current state (e.g., emotion, mood, excitement level, stress level, anger, sadness, happiness, frustration, fear, shock, surprise, amusement, affiliations, whether currently participating or not participating in a game, etc.) of the individual participants. In some embodiments, participant metrics for multiple players (e.g., players in groups or teams) may be collected from player metrics devices, aggregated, and analyzed by the participant metrics module to determine, for example, the current states (e.g., emotions, moods, excitement level, stress level, anger, sadness, happiness, frustration, fear, shock, surprise, amusement, affiliations, whether currently participating or not participating in a game, etc.) of the players/groups. In some embodiments, participant metrics for multiple spectators may be collected from spectator metrics devices and analyzed to determine, for example, the states (e.g., emotions, moods, excitement level, stress level, anger, sadness, happiness, frustration, fear, shock, surprise, amusement, affiliations, whether currently participating or not participating in a game, etc.) of the spectators or crowd. In some embodiments, participant metrics for multiple participants may be collected and analyzed to determine events or states within a game or within one or more broadcast channels in a game spectating system.FIG. 6illustrates an example participant metrics module that analyzes sensor data collected from participant metrics devices in a game environment, according to some embodiments.

As indicated at420ofFIG. 4A, the participant metrics module may apply the analysis information to the game to affect game play. In some embodiments, the participant metrics module may determine one or more game inputs based on the analysis of the metrics performed at element410ofFIG. 4A. The game inputs may be provided by the participant metrics module to the game engine that executes the game in the game environment as controlled by the game players via respective devices that support game play. The game engine may apply the game inputs generated from the participant metrics to affect the game environment, game play, and/or game players in various ways. In some embodiments, instead of or in addition to applying the analysis information to generate game inputs, the participant metrics may be analyzed to determine whether participants associated with the participant metrics devices are currently participating as spectators or players in a game session or broadcast, and alerts or feedback may be provided to participants that are not currently participating in game play or game spectating (referred to as supporters), for example to alert supporters that are fans of particular teams or players that are currently active in a game session. In some embodiments, the metrics for individual participants or collection of participants may be stored, for example in a participant metrics database, as participant metrics data, and the participant metrics data may be provided to or accessed by one or more entities such as game developers for meta-analysis of games, game play, game spectating, and game environments. In some embodiments, the metrics for individual participants or collections of participants may be analyzed to generate game-related information that may be provided to game systems, game broadcasters, or other entities in real-time or near-real-time, for example to broadcasters in game tournament environments.FIG. 6illustrates an example participant metrics module that applies analysis information generated from sensor data collected from participant metrics devices in a game environment, according to some embodiments.FIG. 4Billustrates a method for applying analysis information to a game in a game environment that may be used at element420ofFIG. 4Ain some embodiments.

As shown by the arrow returning from element420to element400, the method ofFIG. 4Amay be a continuous process during execution of the game.

FIG. 4Billustrates a method for applying participant metrics in a game environment, according to some embodiments. The method ofFIG. 4Bmay, for example, be implemented at element420ofFIG. 4Aor element550ofFIG. 5by a participant metrics module and game engine as illustrated inFIGS. 1 through 3andFIG. 6. As indicated at422ofFIG. 4B, the participant metrics module may generate game inputs based at least in part on the information that was determined about the participants or game from the analysis of the sensor data received from the participant metrics devices. As indicated at424ofFIG. 4B, the participant metrics module may provide the game inputs to the game engine. In some embodiments, the participant metrics module may provide the game inputs to the game engine according to an API provided by the participant metrics module. As indicated at426ofFIG. 4B, the game engine may apply the game inputs to the game to affect the game environment, game play, players, or teams of players.

FIG. 5is a high-level flowchart of a method for providing feedback to spectators and applying reactions of the spectators to the feedback in a game environment, according to some embodiments. The method ofFIG. 5may, for example, be applied in game environments as illustrated inFIGS. 1 through 3.

As indicated at500ofFIG. 5, the participant metrics module may generate feedback for at least some of the spectators of a game. The feedback may, for example, be generated in response to analysis of participant metrics received from the participant metrics devices, in response to inputs to the participant metrics module from the game engine, or in response to alerts received from the player devices or player metrics devices of the game players.

As indicated at510ofFIG. 5, the participant metrics module may send feedback signals to at least some of the spectator metrics devices. In some embodiments, the participant metrics device may receive the feedback signals from the participant metrics module according to an API provided by the participant metrics module.

As indicated at520ofFIG. 5, the spectator metrics devices react to the feedback signals to provide the feedback or alerts to the respective spectators. In some embodiments, the spectator metrics devices may include one or more indicators (e.g., display screens, lights, speakers, active surface materials, motion or thermal devices, etc.) that may be used to provide feedback or alerts to the spectators in response to the feedback signals received from the participant metrics module. The feedback or alerts provided by the indicators may include, but are not limited to, visual, audio, and/or haptic signals. Visual signals may, for example, include one or more of lights, surface color changes, and on-screen displays. Audio signals may, for example, include one or more of beeps, rings, tones, music, and voice. Haptic signals may, for example, include one or more of pressure, vibration, and thermal signals, or in general any signal that can be sensed through contact with or proximity to the skin or by the sense of touch.

As indicated at530ofFIG. 5, the participant metrics module may receive spectator metrics from the spectator metrics devices based on the spectator's reactions to the feedback. Each spectator metrics device may include one or more sensors or other components that measure or otherwise obtain one or more metrics of a respective spectator wearing or holding the device. The metrics that are obtained by the spectator metrics device may include pulse, heart rate, breath, temperature, electrodermal activity, motion, position, or in general any physical or biological metric that can be measured by sensors of a device worn or held by a human. The metrics that are obtained by the participant metrics devices may also include or be used to determine other data or information including but not limited to the physical location of the participants, affinity or association of the participants with particular teams, players or games (e.g., an indication of a particular player or team that a spectator is a fan of), and so on. A spectator metrics device may include a control component that communicates the sensor data collected on the device to the participant metrics module, for example via a wired or wireless connection. In some embodiments, the control component may perform some processing of the sensor data before communicating the sensor data to the participant metrics module. In some embodiments, the spectator metrics device may provide the sensor data to the participant metrics module according to an API provided by the participant metrics module.

As indicated at540ofFIG. 5, the participant metrics module may analyze the received spectator metrics to determine the reactions of the spectators to the feedback, and may apply the analysis information within the game environment to affect game play. In some embodiments, metrics for individual spectators may be collected from spectator metrics devices and analyzed to determine, for example, the reactions or states (e.g., emotion, mood, excitement level, stress level, anger, sadness, happiness, frustration, fear, shock, surprise, amusement, affiliations, whether currently participating or not participating in a game, etc.) of the individual spectators. In some embodiments, participant metrics for multiple spectators may be collected from spectator metrics devices and analyzed to determine, for example, the reactions or states (e.g., emotions, moods, excitement level, stress level, anger, sadness, happiness, frustration, fear, shock, surprise, amusement, affiliations, whether currently participating or not participating in a game, etc.) of the spectators or crowd.

As indicated at550ofFIG. 5, the participant metrics module may apply the analysis information generated from the spectators' reactions to the feedback to the game to affect game play. In some embodiments, a method similar to the method ofFIG. 4Bmay be used to apply the analysis information to the game. For example, the participant metrics module may generate game inputs based at least in part on the analysis information generated from the spectators' reactions and provide the game inputs to the game engine via an API. The game engine may then apply the game inputs generated from the spectator metrics to affect the game environment, game play, and/or game players in various ways. In some embodiments, instead of or in addition to applying the analysis information to generate game inputs, the spectator metrics may be analyzed to determine whether the people associated with the spectator metrics devices are currently participating as spectators in a game session or broadcast, and may alert or provide feedback to one or more persons that are not currently participating as players or spectators, for example to alert supporters that are fans of particular teams or players that are currently active in a game session. In some embodiments, the metrics for individual spectators or collection of spectators may be stored, for example in a participant metrics database, as spectator metrics data, and the spectator metrics data may be provided to or accessed by one or more entities such as game developers for meta-analysis of games, game play, game spectating, and game environments. In some embodiments, the metrics for individual spectators or collections of spectators may be analyzed to generate game-related information (e.g., levels of support, enthusiasm, excitement, etc. among spectators for particular teams or players) that may be provided to game systems, game broadcasters, or other entities in real-time or near-real-time, for example to broadcasters in game tournament environments.

FIG. 6is a block diagram illustrating an example participant metrics module, service, or system that collects, analyzes, and applies participant metrics in a game environment, according to some embodiments. The participant metrics module600ofFIG. 6may, for example, be used in game environments as illustrated inFIGS. 1 through 3. The participant metrics module600may, for example, be implemented in a game system as illustrated inFIGS. 1 and 2or in a game spectating system or service as illustrated inFIG. 3. In some embodiments, the participant metrics module600may be implemented externally to the game system(s) or spectating system, for example as a participant metrics service in a network environment as illustrated inFIG. 10.

In some embodiments, a participant metrics module600may include one or more computing devices, for example one or more server devices, that implement one or more components of the participant metrics module600. An example computing device that may be used in a participant metrics module600is illustrated inFIG. 11. In some embodiments, a participant metrics module600may include, but is not limited to, a metrics processing602component or module and a feedback processing608component or module. The participant metrics module600may also include or have access to a metrics data store606that, for example, stores data and information related to the game systems630, models used in processing input metrics data, information related to the participant metrics devices670, etc. In some embodiments, a participant metrics module600may provide a metrics device interface610, for example an API, that exposes functionality of the participant metrics module600to the participant metrics devices670, and that collects inputs from and provides outputs to the participant metrics devices670. In some embodiments, a participant metrics module600may provide a game interface604, for example an API, that exposes functionality of the participant metrics module600to one or more game systems630, and that collects inputs from and provides outputs to the game systems(s)630.

The participant metrics module600may obtain or receive input metrics data from participant metrics devices670. In some embodiments, the participant metrics module600may also receive alerts from participant metrics devices670, for example alerts from players of a game. Participant metrics devices670may, for example, include wearable or handheld devices associated with spectators, players and/or broadcaster/players as illustrated inFIGS. 1 through 3.FIGS. 7A through 7Dillustrate example participant metrics devices, according to some embodiments.

The participant metrics module600may also receive information from game system(s)630. In some embodiments, the game information may include alerts from a game system630, for example alerts indicating significant events in a currently executing game. Participant metrics devices670may, for example, include wearable or handheld devices associated with spectators, players and/or broadcaster/players as illustrated inFIGS. 1 through 3.FIGS. 7A through 7Dillustrate example participant metrics devices, according to some embodiments.

In some embodiments, metrics processing602component may receive input metrics data from the participant metrics devices670and game information from the game system(s)630(e.g., indications of events within the game(s)), and may generate game inputs and metrics information from the obtained data and information at least in part according to data stored in metrics data store606. In some embodiments, metrics processing602component may perform analysis of the input metrics data to determine and extract information from the metrics data, and may map the information to game inputs for the game system630. In some embodiments, metrics processing602component may perform the analysis at least in part according to one or more models maintained in metrics data store606. The metrics that are measured by the participant metrics devices670may include one or more of pulse, heart rate, breath, temperature, electrodermal activity, motion, position, or in general any physical or biological metric that can be measured by sensors of a device worn or held by a human. The metrics that are obtained by the participant metrics devices670may also include or be used to determine other data or information including but not limited to the physical location of the participants, affinity or association of the participants with particular teams, players or games (e.g., an indication of a particular player or team that a spectator is a fan of), and so on.

The information extracted from the input metrics data may, for example, include information indicating current states (e.g., emotions, moods, excitement level, stress level, anger, sadness, happiness, frustration, fear, shock, surprise, amusement, movements, gestures, position, affiliations, whether currently participating or not participating in a game, etc.) for individual participants (players and/or spectators) and/or for groups of participants, and in general any relevant information that can be extracted from the metrics measured or otherwise obtained by the participant metrics devices670. The information may, for example, be analyzed to determine participant metrics patterns for individual participants or groups of participants that can be matched or mapped to individual participants' states, group or crowd states, particular game events, and so on, for example according to the model(s) maintained in metrics data store606and/or the game information received from the game system(s)630. Game inputs may be determined at least in part from the analysis of the information, for example by mapping determined participant metrics patterns or states to game input templates maintained in metrics data store606and/or to game events provided by the game system(s)630. Metrics processing602component may output the game inputs to respective game system(s)630. The game system(s)630may apply the game inputs generated from the participant metrics data to affect the game environment, game play, and/or game players in various ways. In some embodiments, metrics processing602component may also provide metrics information based on the analysis to feedback processing608component, which may for example use the provided metrics information to generate and provide feedback signals for the participant metrics devices670.

In some embodiments, the participant metrics may be analyzed to determine whether participants associated with the participant metrics devices670are currently participating as spectators or players in a game session or broadcast, and alerts or feedback may be provided to participants that are not currently participating as players or spectators, for example to alert supporters that are fans of particular teams or players that are currently active in a game session. In some embodiments, the metrics for individual participants or collection of participants may be stored, for example in a participant metrics database, as participant metrics data, and the participant metrics data may be provided to or accessed by one or more entities such as game developers for meta-analysis of games, game play, game spectating, and game environments. In some embodiments, the metrics for individual participants or collections of participants may be analyzed to generate game-related information that may be provided to game systems, game broadcasters, or other entities in real-time or near-real-time, for example to broadcasters in game tournament environments.

In some embodiments, metrics processing602component may apply an emotion recognition technique to one or more physical metrics in analyzing and determining emotion or mood for individuals or groups of participants. In some embodiments, the emotion recognition technique may be a statistical pattern recognition technique that compares the physical metrics to known or learned patterns for individual participants or groups of participants according to one or more models maintained in metrics data store606to determine states, emotions, or emotional states (e.g., excitement, stress, fear, shock, surprise, amusement, anger, sadness, happiness, frustration, affiliations, whether currently participating or not participating in a game, etc.) for participants or groups of participants from the participants' physical metrics patterns. In various embodiments, for example, a Maximum Likelihood Bayes classifier (MLB), Kernel Regression (KR), or K-nearest neighbors (KNN) statistical pattern recognition technique may be used. Note, however, that other types of emotion recognition techniques may be used.

In some embodiments, the models and patterns may map the detected emotions or moods to known or learned patterns maintained in metrics data store606to determine information about participants, games, and/or broadcasts from the input participant metrics data. The patterns may include, but are not limited to, emotion patterns corresponding to particular emotions or emotional states for individuals, groups, and crowds in game environments. The determined information may include one or more of, but is not limited to: information identifying current emotions or emotional states for particular participants or groups of participants (players, teams of players, broadcasters, and/or spectators); information identifying particular players or teams of players of interest (e.g., “hot” teams or “hot” players) in games; information identifying active or popular players/teams, broadcasters, games, and/or broadcasts; information identifying events in games and/or broadcasts; and in general any information that can be determined for participants, games, and/or broadcasts from the metrics data collected from participants as described herein.

In some embodiments, at least some of the patterns may be generic to spectators, players, games and/or broadcasts, and the metrics data may, for example, be mapped to general events or general types of events in games and/or broadcasts according to the patterns. In some embodiments, at least some of the metrics data may be specific to particular games, and the metrics data may, for example, be mapped to particular events or types of events within the games according to the game-specific patterns. In some embodiments, metrics processing602component may maintain models and patterns as metrics data store606, and may access the models and patterns from the metrics data store606when processing the metrics data. Some embodiments may use participant-independent techniques that are designed to generally recognize anyone's emotions or moods based on analysis of the metrics data according to the models and patterns. However, some embodiments may use participant-dependent techniques. In either case, the data sets and models may be initialized or trained, and the patterns for individuals or groups may be learned or improved over time.

In some embodiments, the participant metrics module600may use feedback and machine learning techniques to train and improve the data sets used in extracting information from the input metrics data, recognizing emotions or mood from the extracted information, and mapping the emotions or moods to the patterns. For example, in embodiments that use participant-independent techniques, the data sets may be initialized by collecting a corpus of physical or biological metrics examples from the participant metrics devices670of many individuals and developing statistical models from the corpus of examples. The data sets may be improved over time, for example by adding new samples obtained during usage of participant metrics devices670in game environments to the statistical model, or by receiving feedback from the participants to indications of participants' emotions as recognized by the participant metrics module600.

In embodiments that use participant-dependent techniques, the participant metrics module600may create and maintain data sets for individual participants that may be used in recognizing emotions and moods for the individuals. In some embodiments, a participant's data set may be initially trained by the participant, for example by exhibiting different emotions in response to stimuli while wearing or holding a participant metrics device670so that the participant metrics module600can analyze how the participant reacts to stimuli and establish a baseline for the participant. As the participant uses the participant metrics device670over time, additional samples of the participant's physical metrics data may be used to improve or refine the participant's data set. Further, the participant may provide additional feedback to improve the quality of the emotion recognition. For example, the participant metrics device670may visually indicate a participant's emotions as recognized by the participant metrics module600, and the participant may be asked if its interpretations of the participant's physical metrics are correct. The participant may respond, and the response may be used to improve the participant's data set.

In some embodiments, feedback processing608component may receive metrics information from the metrics processing602component, game information from the game system(s)630(e.g., indications of events within the game(s), alerts generated by the game engines or player devices, etc.), and alerts from player metrics devices670, and may generate output signals for the participant metrics devices670from the obtained data and information at least in part according to data stored in metrics data store606. For example, in some embodiments, feedback processing608component may receive metrics information from the metrics processing602component indicating individual or group reactions to particular game events, and may generate feedback signals for one or more participant metrics devices670that cause the participant metrics devices670to provide indications of the reactions to respective participants. As another example, in some embodiments, feedback processing608component may receive an alert from a player metrics device670, and may generate a feedback signal to spectator metrics devices670of a group of spectators (e.g., fans) associated with the respective player. As another example, in some embodiments, feedback processing608component may receive an alert from a game system630, and may generate a feedback signal to one or more participant metrics devices670associated with players and/or spectators of the respective game.

In some embodiments, metrics data of two or more different types collected from one or more participants may be analyzed by the metrics processing602component in combination to generate game inputs and metrics information. For example, metrics data indicating participants' pulse or heartrate may be used in combination with metrics data indicating breath rate, temperature, and/or electrodermal activity to estimate a current mood or emotion of participant(s).

In some embodiments, sensor data indicating motion and/or position of the participants may be collected by the participant metrics devices670, and may be analyzed by the metrics processing602component to generate game inputs and metrics information. For example, the metrics processing602component may receive metrics data indicating motions detected by motion detection sensors of a bracelet or wristband as illustrated inFIG. 7B, and may determine from the metrics data that the participants have raised their arms, or made some other gesture, and game inputs and/or metrics information may be generated in response to the detected gestures.

FIGS. 7A through 7Dillustrate example participant metrics devices, according to some embodiments. The participant metrics devices ofFIGS. 7A through 7Dmay, for example, be used in game and spectating environments as illustrated inFIGS. 1 through 3andFIG. 6.

FIG. 7Ais a block diagram illustrating components of an example participant metrics device770, according to some embodiments. A participant metrics device770may, for example, be worn or held by a participant790(a spectator or player) in a game during game play. A participant metrics device770may include one or more sensors772or other components that measure or otherwise obtain one or more participant metrics including but not limited to physical metrics of the participant790during game play. The participant metrics that are measured by the sensor(s)772may include one or more of pulse, heart rate, breath rate, temperature, electrodermal activity, motion, position, or in general any physical or biological metric that can be measured by sensors772of a device770worn or held by a human. The metrics that are obtained by the participant metrics devices may also include or be used to determine other data or information including but not limited to the physical location of the participants, affinity or association of the participants with particular teams, players or games (e.g., an indication of a particular player or team that a spectator is a fan of), and so on. The metrics may, for example, indicate the participant790's reactions to game play. As another example, the metrics may indicate or be used to determine whether the participant is or is not currently participating as a spectator or player in a game session.

In some embodiments, a participant metrics device770may also include one or more indicators775(e.g., display screens, lights, speakers, active surface materials, motion or thermal devices, etc.) that may be used to signal the participant790during game play, for example to provide feedback or alerts to the participant790. The feedback to the participant790may include, but are not limited to, visual, audio, and/or haptic signals. Visual signals may, for example, include one or more of lights, surface color changes, and on-screen displays. Audio signals may, for example, include one or more of beeps, rings, tones, music, and voice. Haptic signals may, for example, include one or more of pressure, vibration, and thermal signals, or in general any signal that can be sensed through contact with or proximity to the skin or by the sense of touch.

In some embodiments, the participant metrics device770may also include a control module776that collects sensor data from the sensor(s)772and communicates metrics data to a participant metrics module700, for example via wired and/or wireless network connections and network protocols. The control module776may, for example, include one or more processors. In some embodiments, the control module776may include a sensor data processing773component that receives sensor data from the sensor(s)772, processes the sensor data to generate metrics data, and outputs the metrics data to the participant metrics module700. For example, the sensor data processing773component may collect sensor data from a sensor772over time, and may aggregate, normalize, average, or otherwise process the sensor data to generate a metrics data reading for the sensor772that is output to the participant metrics module700. In some embodiments, patterns for the participant790's sensor data may be maintained and locally stored by the participant metrics device770that map the sensor data to emotions or moods, and the sensor data may be analyzed according to the participant790's patterns to generate metrics data that, for example, indicates an emotion or mood of the respective participant790.

In some embodiments, sensor data from two or more sensors772may be analyzed by the sensor data processing773component in combination to generate metrics data. For example, pulse or heartrate may be used in combination with breath rate, temperature, and/or electrodermal activity to estimate a current mood or emotion of the participant790.

In some embodiments, sensor data indicating motion and/or position of the participant790may be collected from one or more sensors772, and may be analyzed by the sensor data processing773component to generate metrics data indicating a gesture or position of the participant790. For example, the sensor data processing773component may receive sensor data from a motion detection sensor of a bracelet or wristband as illustrated inFIG. 7B, and may determine from the sensor data that the participant has raised their arm, or made some other gesture, and an indication of the detected gesture may be provided to the participant metrics module700as metrics data.

In some embodiments, the control module776may also receive input signals from the participant metrics module700or from other sources, for example via wired and/or wireless network connections and network protocols, and may provide the signals to one or more indicators775of the participant metrics device770. In some embodiments, the control module776may include an input signal processing774component that receives the input signals, processes the input signals to determine appropriate feedback or alerts for the participant790, and activates, modifies, or deactivates one or more indicators775to provide the feedback or alerts to the participant790.

In some embodiments, a participant metrics device770may be associated or affiliated with particular games, teams, or players. For example, fans of team A may obtain participant metrics devices770that are associated with team A, and fans of team B may obtain participant metrics devices770that are associated with team B. As another example, fans of a particular player may obtain and wear participant metrics devices770associated with that particular player. As another example, participant metrics devices770may be associated with particular games or game titles. In some embodiments, one or more mechanisms may be provided that may be used by a participant to change the player, team, or game that their participant metrics device770is associated with. In some embodiments, the player, team, or game that a participant metrics device770is associated with may be automatically changed in response to a respective participant's actions, for example in response to a spectator or player announcing that he or she is switching team affiliations in a chat window of a game system or spectating system interface. The metrics collected from the participant metrics devices770may thus indicate the affiliations of particular participants with, or the support of particular participants for, particular teams, players, or games.

FIGS. 7B through 7Dillustrate some non-limiting examples of wearable or handheld participant metrics devices, according to some embodiments. In some embodiments, participant metrics devices770may include wearable devices or items of clothing including but not limited to wristbands, bracelets, watches, shirts, jackets, rings, helmets, goggles, glasses, and hats or caps. In some embodiments, participant metrics devices770may instead or also include handheld devices, including but not limited to game controllers that implement at least part of the participant metrics device sensing and/or signaling functionality as described herein. In some embodiments, participant metrics device sensing and/or signaling functionality may be integrated with or included in other devices such as smartphones, keyboards, cursor control devices, and remote controls, and thus these devices may be used as participant metrics devices in game environments as described herein.

FIG. 7Billustrates an example wristband, bracelet, watch, or the like770A that implements participant metrics device sensing and/or signaling functionality as described herein, and that includes one or more sensors772A, one or more indicators774A, and a control module776A, for example as illustrated inFIG. 7A.FIG. 7Cillustrates an example shirt, jacket, or the like770B that implements participant metrics device sensing and/or signaling functionality as described herein, and that includes one or more sensors772B, one or more indicators774B, and a control module776B, for example as illustrated inFIG. 7A.FIG. 7Dillustrates an example game controller that includes game controls776and other components for controlling a game and that acts as a participant metrics device770C when held by a player. The game controller776C and implements participant metrics device sensing and/or signaling functionality as described herein, and includes one or more sensors772C1and772C2, one or more indicators774C, and a control module776C, for example as illustrated inFIG. 7A.

FIGS. 8A and 8Billustrate methods of operation for participant metrics devices in a game environment, according to some embodiments. The methods ofFIGS. 8A and 8Bmay, for example, be implemented by participant metrics devices as illustrated inFIGS. 1 through 3,FIG. 6, andFIGS. 7A through 7D.

FIG. 8Aillustrates a method for providing participant metrics to a participant metrics module, according to some embodiments of a participant metrics device. The method ofFIG. 8Amay, for example, be implemented by a participant metrics device770as illustrated inFIGS. 7A through 7D. As indicated at800ofFIG. 8A, the participant metrics device770may collect sensor data from a participant via one or more sensors, for example sensors as illustrated inFIGS. 7A through 7D. As indicated at810ofFIG. 8A, the participant metrics device770may process the collected sensor data to generate metrics data, for example as described in reference toFIG. 7A. As indicated at820ofFIG. 8A, the participant metrics device770may send the metrics data to a participant metrics module700, for example via a wired or wireless network connection as described in reference toFIG. 7A. As shown by the arrow returning from element820to element800, the method ofFIG. 8Amay be a continuous process during execution of the game.

FIG. 8Billustrates a method for processing signals from a participant metrics module, according to some embodiments of a participant metrics device. The method ofFIG. 8Bmay, for example, be implemented by a participant metrics device770as illustrated inFIGS. 7A through 7D. As indicated at850ofFIG. 8B, the participant metrics device770may receive a signal from the participant metrics module700. As indicated at860ofFIG. 8B, the participant metrics device770may interpret the signal to determine an appropriate indication or feedback for the respective participant790, for example as described in reference toFIG. 7A. As indicated at860ofFIG. 8B, the participant metrics device770may cause one or more indicators to react to the signal to provide the indication or feedback to the participant790, for example as described in reference toFIG. 7A.

FIG. 9illustrates an example use case in which spectators may affect game play in a game environment via spectator metrics devices, according to some embodiments. In this example, a game being executed by a game engine902is being played by two or more teams of players via respective player devices920A and920B, shown as team A players910A and team B players910B. Each team910A and910B may have a group of spectators that are fans of the teams, shown as team A fans920A and team B fans920B. Participant metrics module906may collect spectator metrics data from spectator metrics devices970, and may categorize the metrics data according to spectator metrics devices970A and970B to generate fan-based game inputs according to team A's fans920A and team B's fans920B. Game engine902may then affect team A players910A and/or team B players910B according to the fan-based game inputs. For example a high level of emotion or excitement detected for team A's fans920A may result in the game engine902positively affecting team A players910A and/or negatively affecting team B players910B, for example by providing an energy boost or special weapon or power to team A, or by reducing team B's powers or removing weapons from team B.

As another example, team A players910A and team B players910B may generate alerts for their respective fans920A and920B, for example via respective player devices920A or via player metrics devices930A and930B. As shown inFIG. 9, the alerts may be provided to the game engine902, which may send fan alerts to the participant metrics module906, which in turn may send appropriate alert signals to the spectator metrics devices970A and/or970B. Alternatively, alerts may be sent from player devices920or player metrics devices930directly to the participant metrics module906, or directly to spectator metrics devices970. In some embodiments, game engine902may also generate alerts based on game play. The spectator metrics devices970A and/or970B may then provide indications of the alerts to the fans920A and/or920B. The fans920A and/or920B may react to the indications, their reactions may be sensed by the spectator metrics devices970A and/or970B, and metrics indicating the reactions may be provided to the participant metrics module906. The participant metrics module906may generate fan-based game inputs based on the reactions, and provide the game inputs to the game engine902. The game engine902may then affect the team(s) according to the fans' reactions to the alerts.

As an example, an alert may be sent to spectators requesting that the spectators raise their arms if they support team A910A or team B910B. Spectator metrics devices970may sense motion of the spectators, and convey that information as metrics data to the participant metrics module906. The participant metrics module906may analyze the metrics data to determine which team has the most support, for example by determining how many fans reacted for each team. The participant metrics module906may then provide a game input to the game engine902that indicates, for example, that the majority of fans currently support team A. The game engine902may then positively affect team A players910and/or negatively affect team B players910in response to the game input.

Example Online Gaming Network Environments

FIG. 10illustrates example network-based game and game spectating environments, according to some embodiments. Embodiments of game systems, spectating systems or services, and/or participant metrics modules, services, or systems that implement the methods and apparatus for collecting, analyzing, and applying participant metrics in game environments as described herein in reference toFIGS. 1 through 9may be implemented in the context of a service provider that provides virtualized resources (e.g., virtualized computing resources, virtualized storage resources, virtualized database (DB) resources, etc.) on a provider network1990to clients of the service provider, for example as illustrated inFIG. 10. Virtualized resource instances may be provisioned via one or more provider network services1992, and may be rented or leased to the clients of the service provider, for example to developer1970clients that develop and provide game systems1900or other systems or services via the provider network1990and services1992.

In some embodiments, one or more developers1970may access one or more of services1992of the provider network1990via application programming interfaces (APIs) to the services1992to configure a game system1900, participant metrics service1910, and/or game spectating service1930on the provider network1990. A game system1900, participant metrics service1910, or game spectating service1930may include multiple virtualized resource instances (e.g., computing resources, storage resources, DB resources, etc.) that implement the components of the respective services on the provider network1990.

At least some of the resource instances on the provider network1990(e.g., computing resources) may be implemented according to hardware virtualization technology that enables multiple operating systems to run concurrently on a host computer, for example as virtual machines (VMs) on the host. In some embodiments, the provider network1990, via the services1992, may enable the provisioning of logically isolated sections of the provider network1990to particular clients as client private networks on the provider network1990. At least some of a client's resources instances on the provider network1990may be provisioned in the client's private network. For example, inFIG. 10, one or more game systems1900may be implemented as or in private networks of respective developers1970that are provisioned on provider network1990via one or more of the services1992. As another example, a participant metrics service1910and a game spectating service1930may be provisioned in private networks on provider network1990via one or more of the services1992.

The provider network1990, via the services1992, may provide flexible provisioning of resource instances to clients in which virtualized resource instances can be automatically added to or removed from a configuration on the provider network1990in response to changes in demand or usage, thus enabling an implementation on the provider network1990to automatically scale to handle computation and/or storage needs. For example, one or more additional computing and/or storage resources may be automatically added to a game system1900, to participant metrics service1910, and/or to game spectating service1930in response to an increase in game playing, broadcasting, and/or game spectating from player/broadcaster devices1920and/or spectator devices1980. Conversely, if and when usage drops below a threshold, resources can be removed from a game system1900, participant metrics service1910, and/or game spectating service1930.

In some embodiments, players and player/broadcasters may access game system(s)1900on provider network1990via an intermediate network1950such as the Internet using broadcaster/player devices1920to play games executed on the game system(s)1900. In some embodiments, player/broadcasters may stream broadcasts of their game play via game spectating service1930for viewing by spectators on respective spectator devices1980. Alternatively, spectators may access the game system(s)1900via game clients on their devices1980to view game play on the game system(s)1900through the intermediate network1950. At least some of the players, player/broadcasters, and/or spectators may wear or hold participant metrics devices1960when playing or viewing a game executing on a game system1900. The participant metrics devices1960may collect sensor data from the participants during game play, and may provide metrics data generated from the sensor data to the participant metrics service1910. The participant metrics service1910may receive the metrics data from the participant metrics devices1960via the intermediate network1950, generate game inputs according to the collected metrics data, and provide the game inputs to respective games executing on the game systems1900. The game systems1900may apply the game input to affect the games and/or players in the game in various ways as described herein.

Game Development Environments

In some embodiments, game developers may be provided with a set of development tools, for example a toolkit, integrated development environment (IDE), and/or software development kit (SDK), that provide libraries and APIs to enable the developers to develop game code that integrates the participant metrics devices and the physical metrics of participants collected from the participant metrics devices into their game systems under development. The tool set may, for example, be provided as a component of a game development framework that provides development tools for other game functionality. For example, a service provider that provides a provider network1990as illustrated inFIG. 10may provide a tool set as part of a game development framework to developers1970for integrating participant metrics as described herein in game systems1900developed for deployment on the provider network1990. The tool set may provide mechanisms (e.g., libraries, APIs, etc.) whereby a developer can obtain, process, and map particular participant metrics collected by a participant metrics module from the participant metrics devices to particular game content and/or game effects.

For example, a tool set may be provided via which developers can map participant metrics described by the tool set such as pulse, heart rate, breath, temperature, electrodermal activity, motion, and position to particular game characters (either player controlled or AI controlled), teams of characters, objects, environmental conditions, and so on, and to particular effects on the content. As an example, the developer may map biometric inputs from players to their corresponding characters within the game, and define the effects that the inputs have on the characters. As another example, the developer may map biometric inputs from game spectators to particular game characters that the spectators are currently supporting, and define the effects that the inputs have on the game characters or their opponents.

Illustrative System

In some embodiments, a computing device that implements a portion or all of the methods and apparatus for collecting, analyzing, and applying participant metrics in game environments as described herein may include a general-purpose computer system that includes or is configured to access one or more computer-accessible media, such as computer system2000illustrated inFIG. 11. In the illustrated embodiment, computer system2000includes one or more processors2010coupled to a system memory2020via an input/output (I/O) interface2030. Computer system2000further includes a network interface2040coupled to I/O interface2030.

In various embodiments, computer system2000may be a uniprocessor system including one processor2010, or a multiprocessor system including several processors2010(e.g., two, four, eight, or another suitable number). Processors2010may be any suitable processors capable of executing instructions. For example, in various embodiments, processors2010may be general-purpose or embedded processors implementing any of a variety of instruction set architectures (ISAs), such as the x86, PowerPC, SPARC, or MIPS ISAs, or any other suitable ISA. In multiprocessor systems, each of processors2010may commonly, but not necessarily, implement the same ISA.

System memory2020may be configured to store instructions and data accessible by processor(s)2010. In various embodiments, system memory2020may be implemented using any suitable memory technology, such as static random access memory (SRAM), synchronous dynamic RAM (SDRAM), nonvolatile/Flash-type memory, or any other type of memory. In the illustrated embodiment, program instructions and data implementing one or more desired functions, such as those methods, techniques, and data described above for collecting, analyzing, and applying participant metrics in game environments, are shown stored within system memory2020as code2025and data2026.

In some embodiments, I/O interface2030may be configured to coordinate I/O traffic between processor2010, system memory2020, and any peripheral devices in the device2000, including network interface2040, input/output (I/O) devices, or other peripheral interfaces. In some embodiments, I/O interface2030may perform any necessary protocol, timing or other data transformations to convert data signals from one component (e.g., system memory2020) into a format suitable for use by another component (e.g., processor2010). In some embodiments, I/O interface2030may include support for devices attached through various types of peripheral buses, such as a variant of the Peripheral Component Interconnect (PCI) bus standard or the Universal Serial Bus (USB) standard, for example. In some embodiments, I/O interface2030may support one or more input/output peripheral devices or components2070of system2000, such as cursor control, keyboard, display, video, and/or audio I/O devices2070or components. In some embodiments, the function of I/O interface2030may be split into two or more separate components, such as a north bridge and a south bridge, for example. Also, in some embodiments some or all of the functionality of I/O interface2030, such as an interface to system memory2020, may be incorporated directly into at least one processor2010.

Network interface2040may be configured to allow data to be exchanged between computer system2000and other devices2060attached to a network or networks2050, such as other computer systems or devices as illustrated inFIGS. 1 through 10, for example. In various embodiments, network interface2040may support communication via any suitable wired or wireless general data networks, such as types of Ethernet network, for example. Additionally, network interface2040may support communication via telecommunications/telephony networks such as analog voice networks or digital fiber communications networks, via storage area networks such as Fibre Channel SANs, or via any other suitable type of network and/or protocol.

In some embodiments, system memory2020may be one embodiment of a computer-accessible medium configured to store program instructions and data as described above forFIGS. 1 through 10for implementing embodiments of methods and apparatus for collecting, analyzing, and applying participant metrics in game environments. However, in other embodiments, program instructions and/or data may be received, sent or stored upon different types of computer-accessible media. Generally speaking, a computer-accessible medium may include non-transitory storage media or memory media such as magnetic or optical media, e.g., disk or DVD/CD coupled to computer system2000via I/O interface2030. A non-transitory computer-accessible storage medium may also include any volatile or non-volatile media such as RAM (e.g. SDRAM, DDR SDRAM, RDRAM, SRAM, etc.), ROM, etc., that may be included in some embodiments of computer system2000as system memory2020or another type of memory. Further, a computer-accessible medium may include transmission media or signals such as electrical, electromagnetic, or digital signals, conveyed via a communication medium such as a network and/or a wireless link, such as may be implemented via network interface2040.

Conclusion

Various embodiments may further include receiving, sending or storing instructions and/or data implemented in accordance with the foregoing description upon a computer-accessible medium. Generally speaking, a computer-accessible medium may include storage media or memory media such as magnetic or optical media, e.g., disk or DVD/CD-ROM, volatile or non-volatile media such as RAM (e.g. SDRAM, DDR, RDRAM, SRAM, etc.), ROM, etc., as well as transmission media or signals such as electrical, electromagnetic, or digital signals, conveyed via a communication medium such as network and/or a wireless link.

The various methods as illustrated in the Figures and described herein represent exemplary embodiments of methods. The methods may be implemented in software, hardware, or a combination thereof. The order of method may be changed, and various elements may be added, reordered, combined, omitted, modified, etc.

Various modifications and changes may be made as would be obvious to a person skilled in the art having the benefit of this disclosure. It is intended to embrace all such modifications and changes and, accordingly, the above description to be regarded in an illustrative rather than a restrictive sense.