Ambient light effects based on video via home automation

- Sony Corporation

A system for controlling ambient light effects comprises a receiving device including at least one processor programmed to parse incoming video content to detect at least one portion of the incoming video content and determine at least one ambient light effect to be associated with the portion of the video content. The system further comprises a home automation controller in communication with the processor and at least one lighting device in communication with the receiving device and the home automation controller. The processor of the receiving device is programmed to send a command to the home automation controller specifying the ambient light effect determined by the processor to be associated with the portion of the video content. The lighting device generates the ambient light effect specified in the command when the portion of the video content is displayed to a user.

Skip to: Description  ·  Claims  ·  References Cited  · Patent History  ·  Patent History
Description
CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of the priority date and is a continuation of Ser. No. 13/654,255, filed on Oct. 17, 2012, which is hereby incorporated it is entirety by reference.

FIELD

This invention relates to ambient light effects, and more specifically, to ambient light effects generated via home automation systems based on information included in a video file.

BACKGROUND

Television programs, movies, and video games most commonly provide visual stimulation from a television screen display and audio stimulation from the speakers connected to the television. There are some known systems that attempt to enhance a viewer's/user's experience by providing a more interactive/responsive environment. For example, some video gaming systems cause lighting devices such as lamps to generate an ambient light effect (“ALE”) during game play.

To provide an enjoyable interactive experience, the lighting devices need to generate the ambient light effects at appropriate times when the associated scene is displayed to a user. Thus, an ambient light effect-capable system needs to be able to identify one or more scenes during the display of which an ambient light effect is to be generated. One such system focuses on detecting and analyzing various parameters of the video file or video game application and generating ambient light effects based on the detected parameters. One problem with such an approach is that many video files and video games include various access restrictions imposed by the content providers, and such restrictions may make it difficult or impossible to analyze the parameters of a video file and/or video game.

Home automation systems provide networks for controlling various electrical devices such as lighting fixtures, garage door openers, home alarm systems, and the like. Home automation systems are not known to be integrated with electronic devices such as televisions, DVD players, or video game consoles to provide ambient light effects based on scenes or action sequences included in television programs, movies, and video games.

What is needed are systems and methods of producing ambient light effects in association with one or more portions of a video file that overcomes the aforementioned shortcomings.

SUMMARY

The present invention satisfies this need. In one embodiment, a system for controlling ambient light effects comprises a receiving device including at least one processor programmed to parse incoming video content to detect at least one portion of the incoming video content and determine at least one ambient light effect to be associated with the at least one portion of the video content. The system further includes at least one home automation controller in communication with the at least one processor. The system further includes at least one lighting device in communication with at least one of the receiving device and the home automation controller. The processor of the receiving device is programmed to send a command from the receiving device to the home automation controller, the command specifying the at least one ambient light effect determined by the at least one processor to be associated with the at least one portion of the video content. The at least one lighting device includes at least one hardware controller adapted to, after receiving the command from the home automation controller, to generate the at least one ambient light effect specified in the command.

The receiving device can be selected from one of a television, set-top box, disc player, personal computer, laptop, tablet computer, and mobile phone.

In one approach, the home automation controller is integrated into the receiving device. The receiving device and the home automation controller can be in communication with a common graphical interface. The graphical interface can include one or more options adapted to be configured by a user to control the at least one ambient light effect.

In another approach, the home automation controller is spaced apart from the receiving device.

The home automation controller can include a translator adapted to translate the command received by the home automation controller from the receiving device. The home automation controller can be in communication with the receiving device via one of a wired connection and wireless connection. The home automation component can be in communication with the at least one lighting device via one of a wired connection and wireless connection.

In one approach, the command by the processor identifies the at least one lighting device for generating the at least one ambient light effect specified in the command. In another approach, the command by the processor includes chrominance control data specifying at least one color of the ambient light effect to be generated by the at least one lighting device, the color being selected from red, green, blue, or combinations thereof. In yet another approach, the command includes data specifying brightness level of the at least one ambient light effect to be generated by the at least one lighting device. In still another approach, the command includes data specifying a predetermined time for generating the at least one ambient light effect by the at least one lighting device after receiving the command.

In an approach, the at least one lighting device is adapted to both interpret the command including chrominance control data and to generate the at least one color specified in the command.

The at least one home automation controller can be in communication with at least one electrical device not in communication with the receiving device or the at least one lighting device.

The systems and methods described herein provide an engaging experience to a user when watching television programming, movies, or playing video games. One advantage of the systems and methods described therein is that television programming, movies, and video games can be made more interactive for a user by including ambient light effects conveniently generated via the home automation system which can be in communication with practically any household lighting device. These and other advantages will be apparent upon consideration of the present specification.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram of several exemplary devices of a system according to one embodiment; and

FIG. 2 is a schematic diagram of several exemplary devices of a system according to another embodiment.

 DETAILED DESCRIPTION

Reference will now be made in detail to the present preferred embodiments of the invention, examples of which are illustrated in the accompanying drawings.

Generally, systems and methods are described herein for providing ambient light effects for a user when watching television programming, movies, or playing video games. The ambient light effects can be generated by one or more lighting devices based on information included in the video file representing the television program, movie, or video game. The ambient light effects can be generated by a device receiving the video content and sending, via a home automation system controller, a command to one or more lighting fixtures determined for generating the ambient light effects. The home automation system controller can be integrated into the receiving device and can be located separately from the receiving device. The ambient light effects can be associated with various events or action sequences in the television program, movie, or video game, and can be customized by the user through an interactive graphical user interface.

One embodiment of a system according to the present invention is shown in FIG. 1, where a receiving device 10 is connected to two lighting devices 16 and 18 via a home automation controller 20.

The receiving device 10 receives television programming, movies, and video game content in the form of video files from a video source 12. The receiving device 10 shown in FIG. 1 can be a television, set-top box, optical disc player such as a DVD-player or Blu-Ray player, portable media player, personal computer, laptop, tablet computer, gaming console, mobile phone, and the like. The video source 12 can be any source capable of providing digital video files via a connection 11 to the receiving device 10. The video source 12 can be a cable head-end, a DVD or Blu-Ray disc, a video game disc, hard drive, or a digital media server capable of streaming to the receiving device. Although the connection 11 between the receiving device 10 and the video source 12 is preferably a wired connection, it is to be appreciated that the connection 11 between the receiving device 10 and the video source 12 can also be wireless.

The receiving device 10 may include a processor 13 that is programmed to parse an incoming digital video signal or digital video file incoming from the video source 12 to detect at least one portion of the incoming video content and determine at least one ambient light effect to be associated with the at least one portion of the video content. For purposes of this application, the term “processor” will be understood to mean any hardware component capable of parsing a digital video signal or digital video file incoming into the receiving device 10 from the video source 12. For example, the processor 13 may be a graphics card, a decoder, or the like.

The processor 13 of the receiving device 10 is also programmed to generate and send one or more commands to one or more lighting devices (16, 18, or both) to generate the one or more of the ambient light effects determined by the processor 13 to be associated with various portions of the video content from the video source 12. For example only, the processor 13 can cause the receiving device 10 to send a first command to the lighting device 16 to generate a first ambient light effect associated with a first portion of the incoming video content, and a second command to the lighting device 18 to generate a second ambient light effect associated with a second portion of the video content. The first and second ambient light effects may be the same or different.

In one approach shown in FIG. 1, the home automation system controller 20 is a physical device located separate from the receiving device 10 and connected to the receiving device 10 via a connection 15. The home automation controller 20 is in turn connected to the lighting devices 16 and 18 via connections 17 and 19, respectively. The connections 15, 17 and 19 can be wired or wireless connections.

As shown in FIG. 1, the home automation controller 20 includes a hardware component such as a decoder or translator 22 programmed to translate the commands sent to the home automation controller 20 by the processor 13 of the receiving device 10. Optionally, each of the lighting devices 16 and 18 may include a decoder or translator similar to the translator 22 to permit the lighting devices 16 and 18 to translate the commands sent to the lighting devices 16 and 18 by the home automation controller 20.

The receipt of the commands by the lighting devices 16 and 18 causes the lighting devices 16 and 18 to generate the ambient light effects specified in the commands generated by the processor 13. As such, the ambient light effects specified in the commands are generated by the lighting devices 16 and 18, preferably when the one or more portions of the video content associated with the one or more ambient light effects specified in the commands are displayed to the user. The generation of the ambient light effects by the lighting devices 16 and 18 in association with scenes, action sequences, or events specified in the commands generated by the processor 13 creates an enhanced and visually pleasing experience for a user watching a television program, a movie, or playing a video game.

In one exemplary approach shown in FIG. 1, the home automation controller 20 is in communication via lines 28 and 38 with devices such as garage door opener 30 and home alarm system 40, respectively. The communication lines 28 and 38 are indicated in dashed lines to indicate that the processor 13 of the receiving device 10 cannot communicate with either the garage door opener 30 or the home alarm system 40 via the communications lines 28 and 38.

In another approach shown in FIG. 2, the home automation controller 120 can be integrated into the receiving device 10. In one approach, the system includes a graphical user interface 130 such that the processor 13 and the home automation controller 120 can communicate via the common user interface 130. The graphical user interface includes one or more options adapted to be configured by a user to control and customize various aspects of the at least one ambient light effect specified in a command ultimately received by the lighting devices 16 and 18 from the processor 13

Referring to FIG. 2, the home automation controller 120, similar to the home automation controller 20, can include a hardware component such as a decoder or translator 122 programmed to translate the commands sent to the home automation controller 120 by the processor 13. Optionally, each of the lighting devices 16 and 18 may include a decoder or translator similar to the translator 122 to permit the lighting devices 16 and 18 to translate the commands sent to the lighting devices 16 and 18 by the home automation controller 120.

With further reference to FIG. 2, similarly to the home automation controller of 20, the home automation controller 120, in addition to being in communication with the lighting devices 16 and 18 ultimately controlled by the processor 13, is in communication via lines 28 and 38 with devices such as garage door opener 30 and home alarm system 40, respectively. The communication lines 28 and 38 are indicated in dashed lines to indicate that the processor 13 of the receiving device 10 cannot communicate with either the garage door opener 30 or the home alarm system 40 via the communications lines 28 and 38.

The lighting devices 16 and 18 can be any type of household or commercial devices capable of producing visible light. For example only, the lighting devices may be stand-alone lamps, track lights, recessed lights, wall-mounted lights or the like. The lighting devices 16 and 18 are preferably adapted to be dimmed. The lighting devices 16 and 18 have been shown in FIG. 1 as being identical for example only, and it is to be appreciated that the receiving device 10 can be simultaneously connected to two, three, four, or more types of different lighting devices.

Further, it is to be appreciated that the receiving device 10 has been shown in FIG. 1 as being connected to two lighting devices 16 and 18 by way of example only, and that the receiving device 10 can be connected to any number of lighting devices suitable for a given room where the receiving device 10 is located. In one exemplary approach, the receiving device 10 may be connected to only one lighting device. In another approach, the receiving device 10 may be connected to four lighting devices each located in a corner of a room. In another approach, the receiving device 10 may be connected to at least two lighting devices located in front of a user, at least two lighting devices located on right and left sides of the user, and at least two lighting devices located behind the user so as to create a surround ambient light effect for the user.

With reference to both FIGS. 1 and 2, the commands sent by the processor 13 of the receiving device 10 to the home automation controllers 20 and 120 can identify a specific lighting device (16, 18, or both) for generating the at least one ambient light effect specified in the command.

In one aspect, the commands sent by the processor 13 of the receiving device 10 to the home automation controllers 20 and 120 can include chrominance control data specifying at least one color of the ambient light effect to be generated by the lighting devices 16 and 18. For example, the color can be selected from red, green, blue, or combinations thereof. In one approach, the lighting devices 16 and 18 can be adapted, for example by including a hardware component, a software component, or both, to interpret the command including chrominance control data and to generate the at least one color specified in the command received from the processor 13.

In one aspect, the command generated by the processor 13 can include data specifying brightness level of the at least one ambient light effect to be generated by the lighting devices 16 and 18. In another aspect, the command includes data specifying a predetermined time for generating the at least one ambient light effect by one or both of the lighting devices 16 and 18 after receiving the command.

The generation of the ambient light effects by the lighting devices 16 and 18 in association with scenes, action sequences, or events specified in the commands generated by the processor 13 and delivered via the home automation controllers 20 and 120 creates an enhanced and visually pleasing experience for a user watching a television program, a movie, or playing a video game.

Those skilled in the art will recognize that a wide variety of modifications, alterations, and combinations can be made with respect to the above described embodiments without departing from the spirit and scope of the invention, and that such modifications, alterations, and combinations are to be viewed as being within the ambit of the inventive concept.

Claims

1. A receiving device for controlling ambient light effects, the device comprising:

at least one processor configured to communicate with a home automation controller configured to communicate with at least one lighting device, the at least one processor programmed to: parse incoming video content to detect at least one portion of the incoming video content and determine at least one ambient light effect to be associated with the at least one portion of the incoming video content; and send a command to the home automation controller, the command specifying the at least one ambient light effect determined by the at least one processor to be associated with the at least one portion of the incoming video content.

2. The receiving device of claim 1, wherein the receiving device is at least one of a television, set-top box, disc player, video game console, personal computer, laptop, tablet computer, and mobile phone.

3. The receiving device of claim 1, wherein the home automation controller is integrated into a physical structure of the receiving device.

4. The receiving device of claim 3, wherein the receiving device includes a translator adapted to translate the command received by the home automation controller from the at least one processor.

5. The receiving device of claim 3, further comprising a graphical interface in communication with the at least one processor and the home automation controller, the graphical interface including one or more options adapted to be configured by a user to control the at least one ambient light effect.

6. The receiving device of claim 1, wherein the command identifies the at least one lighting device for generating the at least one ambient light effect specified in the command.

7. The receiving device of claim 1, wherein the receiving device is a television separate from the home automation controller and the at least one processor is internal to the television and programmed to parse incoming video content selected from at least one of a television program, a movie, and a video game.

8. A home automation controller for controlling ambient light effects, the home automation controller being adapted to:

receive a command from a receiving device in communication with the home automation controller, the command specifying at least one ambient light effect to be associated with at least one portion of video content received by the receiving device; and
send the command to the at least one lighting device in communication with the home automation controller to generate the at least one ambient light effect specified in the command when the at least one portion of the video content is displayed to a user.

9. The home automation controller of claim 8, wherein the home automation controller includes a translator adapted to translate the command received by the home automation controller from the receiving device.

10. The home automation controller of claim 8, wherein the home automation controller is in communication with the receiving device via one of a wired connection and a wireless connection.

11. The home automation controller of claim 8, wherein the home automation controller is in communication with the at least one lighting device via one of a wired connection and a wireless connection.

12. The home automation controller of claim 8, wherein the at least one home automation controller is in communication with at least one electrical device that is not in communication with the receiving device or the at least one lighting device.

13. A method of controlling ambient light effects, the method comprising:

parsing, by at least one processor of a receiving device, incoming video content to detect at least one portion of the incoming video content;
determining, by the at least one processor of the receiving device, at least one ambient light effect to be associated with the at least one portion of the incoming video content;
sending a command from the at least one processor of the receiving device to a home automation controller, the command specifying the at least one ambient light effect determined by the at least one processor to be associated with the at least one portion of the incoming video content; and
in response to receiving the command from the home automation controller, generating, via at least one lighting device, the at least one ambient light effect specified in the command when the at least one portion of the incoming video content is displayed to a user.

14. The method of claim 13, wherein the sending the command includes sending the command identifying the at least one lighting device for generating the at least one ambient light effect specified in the command.

15. The method of claim 13, wherein the sending the command includes sending the command including chrominance control data specifying at least one color of the ambient light effect to be generated by the at least one lighting device, the color being selected from red, green, blue, or combinations thereof.

16. The method of claim 13, wherein the sending the command includes sending the command including data specifying brightness level of the at least one ambient light effect to be generated by the at least one lighting device.

17. The method of claim 13, wherein the sending the command includes sending the command including a predetermined time for generating the at least one ambient light effect by the at least one lighting device after receiving the command.

18. The method of claim 13, further comprising communicating, via the home automation controller, with at least one electrical device not in communication with the receiving device or the at least one lighting device.

19. The method of claim 13, wherein the sending the command from the at least one processor of the receiving device to the home automation controller further comprises translating the command received by the home automation controller from the receiving device.

20. The method of claim 13, wherein the generating, via at least one lighting device, the at least one ambient light effect specified in the command when the at least one portion of the video content is displayed to a user, further comprises both interpreting a command including chrominance control data specifying at least one color and generating the at least one color specified in the command.

Referenced Cited
U.S. Patent Documents
5061997 October 29, 1991 Rea
6140987 October 31, 2000 Stein
6577080 June 10, 2003 Lys
6611297 August 26, 2003 Akashi
7180529 February 20, 2007 Covannon
7262813 August 28, 2007 Sato
7369903 May 6, 2008 Diederiks
7616262 November 10, 2009 Eves
7859595 December 28, 2010 Gutta
7894000 February 22, 2011 Gutta
7932953 April 26, 2011 Gutta et al.
8063992 November 22, 2011 Gutta
8143813 March 27, 2012 Aarts
8576340 November 5, 2013 Li
20030057884 March 27, 2003 Dowling
20050206788 September 22, 2005 Eves
20060058925 March 16, 2006 Diederiks
20060161270 July 20, 2006 Luskin
20070055390 March 8, 2007 Simon
20070091111 April 26, 2007 Gutta
20070157281 July 5, 2007 Ellis
20070174773 July 26, 2007 Abernethy
20070242162 October 18, 2007 Gutta
20070288849 December 13, 2007 Moorer
20070288975 December 13, 2007 Cashman
20080129821 June 5, 2008 Howarter
20080174254 July 24, 2008 Abernethy
20090109340 April 30, 2009 Iwanami
20090123086 May 14, 2009 Iwanami
20090175536 July 9, 2009 Gutta et al.
20090212939 August 27, 2009 Richmond
20090219305 September 3, 2009 Diederiks
20090249428 October 1, 2009 White
20100005062 January 7, 2010 Van Den Dungen
20100052843 March 4, 2010 Cannistraro
20100177247 July 15, 2010 Sekulovski
20100213873 August 26, 2010 Picard
20100231140 September 16, 2010 Aarts
20100238664 September 23, 2010 Steenbergen
20100244745 September 30, 2010 Wendt
20100262336 October 14, 2010 Rivas
20100265414 October 21, 2010 Nieuwlands
20100289661 November 18, 2010 Styers et al.
20110075036 March 31, 2011 Galeazzi
20110190911 August 4, 2011 Iwanami
20110245941 October 6, 2011 De Waele
20120013257 January 19, 2012 Sibert
20120068832 March 22, 2012 Feldstein et al.
Foreign Patent Documents
2012027643 March 2012 WO
Other references
  • Non-Final Office Action from U.S. Appl. No. 13/654,255 dated Jun. 19, 2013.
  • Notice of Allowance from U.S. Appl. No. 13/654,213 dated Jun. 18, 2013.
  • Non-Final Office Action from U.S. Appl. No. 13/654,190 dated Jul. 17, 2013.
  • Non-Final Office Action from U.S. Appl. No. 13/654,190 mailed Jan. 22, 2014 (11 pgs.).
  • Notice of Allowance from U.S. Appl. No. 13/654,213 mailed Sep. 3, 2013 (7 pgs.).
  • Notice of Allowance from U.S. Appl. No. 13/654,255 mailed Nov. 20, 2013 (14 pgs.).
  • Notice of Allowance from U.S. Appl. No. 13/654,255 mailed Mar. 27, 2014 (12 pgs.).
  • Non-final Office Action from U.S. Appl. No. 13/654,279 mailed May 7, 2014 (20 pgs).
  • Notice of Allowance from U.S. Appl. No. 13/654,255 mailed Jul. 22, 2014(11 pgs.).
  • Final office action from U.S. Appl. No. 13/654,190 mailed Jul. 17, 2014 (29 pgs.).
  • Non-Final Office Action from U.S. Appl. No. 13/654,233 mailed Jul. 16, 2014 (14 pgs.).
Patent History
Patent number: 8970786
Type: Grant
Filed: Jan 15, 2014
Date of Patent: Mar 3, 2015
Patent Publication Number: 20140142762
Assignee: Sony Corporation (Tokyo)
Inventors: Adam Li (Solana Beach, CA), Megan Farrell (San Diego, CA), Aixin Liu (San Diego, CA), Djung Nguyen (San Diego, CA)
Primary Examiner: Jefferey Harold
Assistant Examiner: Mustafizur Rahman
Application Number: 14/156,344
Classifications
Current U.S. Class: Display Controlled By Ambient Light (348/602); Remote Control (348/734); Receiver Circuitry (348/725); Including Processor Interface (e.g., Cpu) (348/719); For Controlling Video Processing (e.g., Digitally Assisted Video) (348/474); Specified Chrominance Processing (348/453); Specified Chrominance Processing (e.g., Y/c Separation) (348/450); Arrangements For Multiplexing One Video Signal, One Or More Audio Signals, And A Synchronizing Signal (348/423.1); Based On Ambient Light (348/366); Wireless (348/211.2); Over Wireless Communication (348/14.02); Operator Interface (e.g., Graphical User Interface) (715/700); On Screen Video Or Audio System Interface (715/716); Video Interface (715/719); Audio User Interface (715/727); User Interface Development (e.g., Gui Builder) (715/762); Wireless Return Path (725/123); Connection To External Network At Receiver (e.g., Set-top Box) (725/110); Video Distribution System With Upstream Communication (725/105); User-requested Video Program System (725/86); Using Wireless Link (725/81); User Customization Of Display Content (725/47); Content Arrangement (725/44); To Facilitate Tuning Or Selection Of Video Signal (725/38); By Data Encoded In Video Signal (e.g., Vbi Data) (725/20); By Passive Determination And Measurement (e.g., By Detecting Motion Or Ambient Temperature, Or By Use Of Video Camera) (725/12); Position Responsive (340/686.1); Door Or Window Movement (340/545.1); Remote Control (340/12.22); Specific Application, Apparatus Or Process (700/90)
International Classification: H04N 5/57 (20060101); H04N 5/56 (20060101); G05B 15/02 (20060101); H04N 21/422 (20110101); H04N 21/43 (20110101); H04N 21/431 (20110101); H04N 21/81 (20110101); H05B 37/02 (20060101); H04N 9/73 (20060101);