U.S. Pat. No. 9,833,703

DETAILED DESCRIPTION

This disclosure relates generally to computer ecosystems including aspects of consumer electronics (CE) device networks. A system herein may include server and client components, connected over a network such that data may be exchanged between the client and server components. The client components may include one or more computing devices including portable televisions (e.g. smart TVs, Internet-enabled TVs), portable computers such as laptops and tablet computers, and other mobile devices including smart phones and additional examples discussed below. These client devices may operate with a variety of operating environments. For example, some of the client computers may employ, as examples, operating systems from Microsoft, or a Unix operating system, or operating systems produced by Apple Computer or Google. These operating environments may be used to execute one or more browsing programs, such as a browser made by Microsoft or Google or Mozilla or other browser program that can access web applications hosted by the Internet servers discussed below.

Servers and/or gateways may include one or more processors executing instructions that configure the servers to receive and transmit data over a network such as the Internet. Or, a client and server can be connected over a local intranet or a virtual private network. A server or controller may be instantiated by a game console such as a Sony Playstation (trademarked), a personal computer, etc.

Information may be exchanged over a network between the clients and servers. To this end and for security, servers and/or clients can include firewalls, load balancers, temporary storages, and proxies, and other network infrastructure for reliability and security. One or more servers may form an apparatus that implement methods of providing a secure community such as an online social website to network members.

As used herein, instructions refer to computer-implemented steps for processing information in the system. Instructions can be implemented in software, firmware or hardware and include any type of programmed step undertaken by components of the system.

A processor may be any conventional general purpose single- or multi-chip processor that can execute logic by means of various lines such as address lines, data lines, and control lines and registers and shift registers.

Software modules described by way of the flow charts and user interfaces herein can include various sub-routines, procedures, etc. Without limiting the disclosure, logic stated to be executed by a particular module can be redistributed to other software modules and/or combined together in a single module and/or made available in a shareable library.

Present principles described herein can be implemented as hardware, software, firmware, or combinations thereof; hence, illustrative components, blocks, modules, circuits, and steps are set forth in terms of their functionality.

Further to what has been alluded to above, logical blocks, modules, and circuits described below can be implemented or performed with a general purpose processor, a digital signal processor (DSP), a field programmable gate array (FPGA) or other programmable logic device such as an application specific integrated circuit (ASIC), discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A processor can be implemented by a controller or state machine or a combination of computing devices.

The functions and methods described below, when implemented in software, can be written in an appropriate language such as but not limited to C# or C++, and can be stored on or transmitted through a computer-readable storage medium such as a random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), compact disk read-only memory (CD-ROM) or other optical disk storage such as digital versatile disc (DVD), magnetic disk storage or other magnetic storage devices including removable thumb drives, etc. A connection may establish a computer-readable medium. Such connections can include, as examples, hard-wired cables including fiber optics and coaxial wires and digital subscriber line (DSL) and twisted pair wires. Such connections may include wireless communication connections including infrared and radio.

Components included in one embodiment can be used in other embodiments in any appropriate combination. For example, any of the various components described herein and/or depicted in the Figures may be combined, interchanged or excluded from other embodiments.

“A system having at least one of A, B, and C” (likewise “a system having at least one of A, B, or C” and “a system having at least one of A, B, C”) includes systems that have A alone, B alone, C alone, A and B together, A and C together, B and C together, and/or A, B, and C together, etc.

Now specifically referring toFIG. 1, an example ecosystem10is shown, which may include one or more of the example devices mentioned above and described further below in accordance with present principles. The first of the example devices included in the system10is a consumer electronics (CE) device configured as an example primary display device, and in the embodiment shown is an audio video display device (AVDD)12such as but not limited to an Internet-enabled TV with a TV tuner (equivalently, set top box controlling a TV). However, the AVDD12alternatively may be an appliance or household item, e.g. computerized Internet enabled refrigerator, washer, or dryer. The AVDD12alternatively may also be a computerized Internet enabled (“smart”) telephone, a tablet computer, a notebook computer, a wearable computerized device such as e.g. computerized Internet-enabled watch, a computerized Internet-enabled bracelet, other computerized Internet-enabled devices, a computerized Internet-enabled music player, computerized Internet-enabled head phones, a computerized Internet-enabled implantable device such as an implantable skin device, etc. Regardless, it is to be understood that the AVDD12is configured to undertake present principles (e.g. communicate with other CE devices to undertake present principles, execute the logic described herein, and perform any other functions and/or operations described herein).

Accordingly, to undertake such principles the AVDD12can be established by some or all of the components shown inFIG. 1. For example, the AVDD12can include one or more displays14that may be implemented by a high definition or ultra-high definition “4K” or higher flat screen and that may be touch-enabled for receiving user input signals via touches on the display. The AVDD12may include one or more speakers16for outputting audio in accordance with present principles, and at least one additional input device18such as e.g. an audio receiver/microphone for e.g. entering audible commands to the AVDD12to control the AVDD12. The example AVDD12may also include one or more network interfaces20for communication over at least one network22such as the Internet, an WAN, an LAN, etc. under control of one or more processors24. Thus, the interface20may be, without limitation, a Wi-Fi transceiver, which is an example of a wireless computer network interface, such as but not limited to a mesh network transceiver. It is to be understood that the processor24controls the AVDD12to undertake present principles, including the other elements of the AVDD12described herein such as e.g. controlling the display14to present images thereon and receiving input therefrom. Furthermore, note the network interface20may be, e.g., a wired or wireless modem or router, or other appropriate interface such as, e.g., a wireless telephony transceiver, or Wi-Fi transceiver as mentioned above, etc.

In addition to the foregoing, the AVDD12may also include one or more input ports26such as, e.g., a high definition multimedia interface (HDMI) port or a USB port to physically connect (e.g. using a wired connection) to another CE device and/or a headphone port to connect headphones to the AVDD12for presentation of audio from the AVDD12to a user through the headphones. For example, the input port26may be connected via wire or wirelessly to a cable or satellite source26aof audio video content. Thus, the source26amay be, e.g., a separate or integrated set top box, or a satellite receiver. Or, the source26amay be a game console or disk player containing content that might be regarded by a user as a favorite for channel assignation purposes described further below.

The AVDD12may further include one or more computer memories28such as disk-based or solid state storage that are not transitory signals, in some cases embodied in the chassis of the AVDD as standalone devices or as a personal video recording device (PVR) or video disk player either internal or external to the chassis of the AVDD for playing back AV programs or as removable memory media. Also in some embodiments, the AVDD12can include a position or location receiver such as but not limited to a cellphone receiver, GPS receiver and/or altimeter30that is configured to e.g. receive geographic position information from at least one satellite or cellphone tower and provide the information to the processor24and/or determine an altitude at which the AVDD12is disposed in conjunction with the processor24. However, it is to be understood that that another suitable position receiver other than a cellphone receiver, GPS receiver and/or altimeter may be used in accordance with present principles to e.g. determine the location of the AVDD12in e.g. all three dimensions.

Continuing the description of the AVDD12, in some embodiments the AVDD12may include one or more cameras32that may be, e.g., a thermal imaging camera, a digital camera such as a webcam, and/or a camera integrated into the AVDD12and controllable by the processor24to gather pictures/images and/or video in accordance with present principles. Also included on the AVDD12may be a Bluetooth transceiver34and other Near Field Communication (NFC) element36for communication with other devices using Bluetooth and/or NFC technology, respectively. An example NFC element can be a radio frequency identification (RFID) element.

Further still, the AVDD12may include one or more auxiliary sensors37(e.g., a motion sensor such as an accelerometer, gyroscope, cyclometer, or a magnetic sensor, an infrared (IR) sensor, an optical sensor, a speed and/or cadence sensor, a gesture sensor (e.g. for sensing gesture command), etc.) providing input to the processor24. The AVDD12may include an over-the-air TV broadcast port38for receiving OTH TV broadcasts providing input to the processor24. In addition to the foregoing, it is noted that the AVDD12may also include an infrared (IR) transmitter and/or IR receiver and/or IR transceiver42such as an IR data association (IRDA) device. A battery (not shown) may be provided for powering the AVDD12.

Still referring toFIG. 1, in addition to the AVDD12, the system10may include one or more other CE device types. In one example, a first CE device44may be used to control the display via commands sent through the below-described server while a second CE device46may include similar components as the first CE device44and hence will not be discussed in detail. In the example shown, only two CE devices44,46are shown, it being understood that fewer or greater devices may be used.

In the example shown, to illustrate present principles all three devices12,44,46are assumed to be members of an entertainment network in, e.g., a home, or at least to be present in proximity to each other in a location such as a house. However, for present principles are not limited to a particular location, illustrated by dashed lines48, unless explicitly claimed otherwise.

The example non-limiting first CE device44may be established by any one of the above-mentioned devices, for example, a portable wireless laptop computer or notebook computer or game controller, and accordingly may have one or more of the components described below. The second CE device46without limitation may be established by a video disk player such as a Blu-ray player, a game console, and the like. The first CE device44may be a remote control (RC) for, e.g., issuing AV play and pause commands to the AVDD12, or it may be a more sophisticated device such as a tablet computer, a game controller communicating via wired or wireless link with a game console implemented by the second CE device46and controlling video game presentation on the AVDD12, a personal computer, a wireless telephone, etc.

Accordingly, the first CE device44may include one or more displays50that may be touch-enabled for receiving user input signals via touches on the display. The first CE device44may include one or more speakers52for outputting audio in accordance with present principles, and at least one additional input device54such as e.g. an audio receiver/microphone for e.g. entering audible commands to the first CE device44to control the device44. The example first CE device44may also include one or more network interfaces56for communication over the network22under control of one or more CE device processors58. Thus, the interface56may be, without limitation, a Wi-Fi transceiver, which is an example of a wireless computer network interface, including mesh network interfaces. It is to be understood that the processor58controls the first CE device44to undertake present principles, including the other elements of the first CE device44described herein such as e.g. controlling the display50to present images thereon and receiving input therefrom. Furthermore, note the network interface56may be, e.g., a wired or wireless modem or router, or other appropriate interface such as, e.g., a wireless telephony transceiver, or Wi-Fi transceiver as mentioned above, etc.

In addition to the foregoing, the first CE device44may also include one or more input ports60such as, e.g., a HDMI port or a USB port to physically connect (e.g. using a wired connection) to another CE device and/or a headphone port to connect headphones to the first CE device44for presentation of audio from the first CE device44to a user through the headphones. The first CE device44may further include one or more tangible computer readable storage medium62such as disk-based or solid state storage. Also in some embodiments, the first CE device44can include a position or location receiver such as but not limited to a cellphone and/or GPS receiver and/or altimeter64that is configured to e.g. receive geographic position information from at least one satellite and/or cell tower, using triangulation, and provide the information to the CE device processor58and/or determine an altitude at which the first CE device44is disposed in conjunction with the CE device processor58. However, it is to be understood that that another suitable position receiver other than a cellphone and/or GPS receiver and/or altimeter may be used in accordance with present principles to e.g. determine the location of the first CE device44in e.g. all three dimensions.

Continuing the description of the first CE device44, in some embodiments the first CE device44may include one or more cameras66that may be, e.g., a thermal imaging camera, a digital camera such as a webcam, and/or a camera integrated into the first CE device44and controllable by the CE device processor58to gather pictures/images and/or video in accordance with present principles. Also included on the first CE device44may be a Bluetooth transceiver68and other Near Field Communication (NFC) element70for communication with other devices using Bluetooth and/or NFC technology, respectively. An example NFC element can be a radio frequency identification (RFID) element.

Further still, the first CE device44may include one or more auxiliary sensors72(e.g., a motion sensor such as an accelerometer, gyroscope, cyclometer, or a magnetic sensor, an infrared (IR) sensor, an optical sensor, a speed and/or cadence sensor, a gesture sensor (e.g. for sensing gesture command), etc.) providing input to the CE device processor58. The first CE device44may include still other sensors such as e.g. one or more climate sensors74(e.g. barometers, humidity sensors, wind sensors, light sensors, temperature sensors, etc.) and/or one or more biometric sensors76providing input to the CE device processor58. In addition to the foregoing, it is noted that in some embodiments the first CE device44may also include an infrared (IR) transmitter and/or IR receiver and/or IR transceiver42such as an IR data association (IRDA) device. A battery (not shown) may be provided for powering the first CE device44. The CE device44may communicate with the AVDD12through any of the above-described communication modes and related components.

The second CE device46may include some or all of the components shown for the CE device44. Either one or both CE devices may be powered by one or more batteries.

Now in reference to the afore-mentioned at least one server80, it includes at least one server processor82, at least one tangible computer readable storage medium84such as disk-based or solid state storage, and at least one network interface86that, under control of the server processor82, allows for communication with the other devices ofFIG. 1over the network22, and indeed may facilitate communication between servers and client devices in accordance with present principles. Note that the network interface86may be, e.g., a wired or wireless modem or router, Wi-Fi transceiver, or other appropriate interface such as, e.g., a wireless telephony transceiver.

Accordingly, in some embodiments the server80may be an Internet server, and may include and perform “cloud” functions such that the devices of the system10may access a “cloud” environment via the server80in example embodiments. Or, the server80may be implemented by a game console or other computer in the same room as the other devices shown inFIG. 1or nearby.

Now referring toFIG. 2, an AVDD200that may incorporate some or all of the components of the AVDD12inFIG. 1is connected to at least one gateway for receiving content, e.g., UHD content such as 4K or 8K content, from the gateway. In the example shown, the AVDD200is connected to first and second satellite gateways202,204, each of which may be configured as a satellite TV set top box for receiving satellite TV signals from respective satellite systems206,208of respective satellite TV providers.

In addition or in lieu of satellite gateways, the AVDD200may receive content from one or more cable TV set top box-type gateways210,212, each of which receives content front a respective cable head end214,216.

Yet again, instead of set-top box like gateways, the AVDD200may receive content from a cloud-based gateway220. The cloud-based gateway220may reside in a network interface device that is local to the AVDD200(e.g., a modem of the AVDD200) or it may reside in a remote Internet server that sends Internet-sourced content to the AVDD200. In any case, the AVDD200may receive multimedia content such as UHD content from the Internet through the cloud-based gateway220. The gateways are computerized and thus may include appropriate components of any of the CE devices shown inFIG. 1.

In some embodiments, only a single set top box-type gateway may be provided using. e.g., the present assignee's remote viewing user interface (RVU) technology.

Tertiary devices may be connected, e.g., via Ethernet or universal serial bus (USB) or WiFi or other wired or wireless protocol to the AVDD200in a home network (that may be a mesh-type network) to receive content from the AVDD200according to principles herein. In the non-limiting example shown, a second TV222is connected to the AVDD200to receive content therefrom, as is a video game console224. Additional devices may be connected to one or more tertiary devices to expand the network. The tertiary devices may include appropriate components of any of the CE devices shown inFIG. 1.

FIG. 3shows a gaming system300including a display device302that may be implemented by, e.g., the AVDD12inFIG. 1AVDD200inFIG. 2. The display device300communicates via a wired and/or wireless link304with a game console306, which may be implemented, as non-limiting examples, by the source26ainFIG. 1, the first CE device44, the game console224inFIG. 2, or the below-described game controller itself. The game console306may be integrated into the display device302if desired. In any case, the game console306typically includes one or more processors308accessing one or more computer memories310and communicating via one or more communication interfaces312with other components. The interface312may be any appropriate communication interface such as any of the interfaces, where appropriate, discussed above.

A game controller314communicates with the game console306via an aired and/or wireless link316. The game controller may be body-borne including a hand-holdable device. Accordingly, the game controller includes a lightweight hollow housing318that can be hand-held. The game controller314may physically take on any desired external configuration, such as but not limited to a rectilinear block (FIG. 7) or a toy rifle (FIG. 8) or a head-worn system which uses motion sensor signals as input to the game console to control the video game graphics.

The game controller314may incorporate one or more of the components of, e.g., the CE device46discussed above, and thus may include one or more processors320accessing one or more computer memories322and communicating via one or more communication interfaces324with other components in the system300. The interface324may be any appropriate communication interface such as any of the interfaces, where appropriate, discussed above.

Also, the game controller may include gaming input elements326such as keys, including directional keys and “shoot” keys and the like. The game controller314may be powered by one or more batteries328which preferably can be recharged.

As shown inFIG. 3, one or more thermoelectric devices (TED)330are mounted on the housing318of the game controller314. The TED330may be, for example, a Seebeck-Peltier thermoelectric device. The TED330is preferably mounted on or close enough to the surface of the housing318that any heat or cold it generates can be tactilely detected by a person bearing the housing. By supplying control electricity using a first polarity to the TED, the TED can be made to generate heat. By reversing the polarity, the TED is made to generate cold, i.e., to cool. By tapping electricity generated by the TED when a player's hands heat the TED when no control electricity is being supplied to the TED, electricity generated by the TED from the heat of the person's body can be used to recharge the battery328.

FIG. 4illustrates giving a user the option of using the TED300for tactile signal generation or battery charging. A user interface (UI)400may be presented on a display402such as the display of the AVDD under control of the game console to select, at402, to charge the battery328. A selector404may be selected by a user to select to use the TED330to generate tactile gaming signals that are temperature-based.

FIG. 5illustrates logic that may be executed by the processor of the game controller according to a first example. At block500the game controller receives from the game console a command to actuate the TED of the game controller. In this embodiment, in other words, the game console knows of TED capability in the controller and the game software executed by the game console has been programmed accordingly to issue commands to actuate the TED to heat or cool the game controller surface in coordination with presentation of the video game. The command(s) are executed at block502.

On the other hand, the game console may be agnostic regarding whether the game controller has TED capability, in which case the logic ofFIG. 6may be employed. At block600, a game event signal is received, either from the console or from manipulation of game control elements on the game controller. Moving to decision diamond602, it is determined whether the game event signal correlates to an event in a list of events available to the processor of the game controller for which a temperature signal is indicated as being generated. If a correlation is found, the logic proceeds to block604to actuate the TED according to the temperature signal (e.g., heat up or cool down) corresponding to the event in the list of events matching the game event signal.

For example, a game event signal may be a signal from the game console indicating that the player has been shot, and the list of events may correlate such a signal to a command to input control current to the TED using a polarity that will cause the TED to cool, thereby generating a temperature-based tactile signal. Or, a game event signal may be a signal from the game console indicating that the player's weapon has been hit, and the list of events may correlate such a signal to a command to input control current to the TED using a polarity that will cause the TED to heat up, thereby generating a temperature-based tactile signal.

Yet again, a game event signal may be generated by the game controller itself in response to, e.g., a player simulating firing a rifle round using the game controller. In such an example, the list of events may correlate such a signal to a command to input control current to the TED using a polarity that will cause the TED to heat up, thereby generating a temperature-based tactile signal.

Other game events that may be used as triggers to actuate the TED include, without limitation, predetermined key manipulation sequences, predetermined button holds (pressing a controller key or button for at least a threshold period), motion sensing, or lack of any user input via the controller for at least a predetermined period (in which case the TED can be actuated to lower temperature).

FIG. 7shows an example game controller700configured as a hand-held block-type controller with control buttons or keys702and a directional rocker704. Thermoelectric device tiles706may be mounted on each end of the game controller700on the surface or just under the surface of the housing of the game controller.

FIG. 8shows an example game controller800configured as a rifle with a barrel hand grip802onto which a TED804is mounted, and a handle806onto which a TED808is mounted. One or both TEDs804,808may be energized to heat its respective area of the game controller800when the user pulls the trigger of the controller.

The above methods may be implemented as software instructions executed by a processor, suitably configured application specific integrated circuits (ASIC) or field programmable gate array (FPGA) modules, or any other convenient manner as would be appreciated by those skilled in those art. Where employed, the software instructions may be embodied in a non-transitory device such as a CD Rom or Flash drive. The software code instructions may alternatively be embodied in a transitory arrangement such as a radio or optical signal, or via a download over the internet.

It will be appreciated that whilst present principals have been described with reference to some example embodiments, these are not intended to be limiting, and that various alternative arrangements may be used to implement the subject matter claimed herein.