SYSTEMS AND METHODS FOR SHARED MULTIMEDIA EXPERIENCES

Abstract

An embodiment of the invention provides systems and methods for a shared multimedia experience. An embodiment of the invention identifies media content, automatically obtains related media content and provides a wide variety of options for users of the system to interact with the system and each other via other electronic devices of choice. An embodiment of the invention provides users with previews of related content, the ability to select related content from the previews for combined display with input media content, and the ability to augment the related content with content obtained and/or transmitted via the other electronic devices.

Description

CLAIM FOR PRIORITY

This application claims priority from U.S. Provisional Patent Application No. 61/116,972, filed Nov. 21, 2008, which is fully incorporated by reference herein.

FIELD OF THE INVENTION

The invention is directed to systems and methods for multimedia management. Specifically, the invention is directed to a media management system for providing users of multiple electronic devices with a shared multimedia experience.

BACKGROUND OF THE INVENTION

An increasing number of households now have high definition televisions (HDTVs) and broadband Internet connections. Consumers watch a significant amount of television on these HDTVs. Consumers are also increasingly accessing media content via the Internet, primarily on traditional desktop and laptop computers, as well as mobile computing devices and the like. These trends are very likely to continue as more HD programming becomes available, more consumers buy HDTVs, and more consumers switch to or obtain wired or wireless broadband Internet connections.

Consumers commonly use computing and mobile devices to augment their television watching experiences (such as when using a laptop to track election results or sports scores while watching related content on the television). This trend is also likely to continue, as consumers are constantly seeking out additional information related to a television program, even while watching the programming. Advances in television services and Internet media content related to television services have facilitated this behavior. Ever increasing and accessible ways of manipulating television programs are becoming available (e.g. picture in picture displays, pausing live programs via digital video recorders (DVRs) and the like, etc.). Likewise, increasing amounts of Internet media content related to television programs is becoming available.

However, there is currently no conventional way for allowing a user to have a truly integrated television and Internet media experience. Even when watching television programs on an Internet-connected device (e.g. laptop, desktop or mobile computing devices), a truly integrated experience is lacking, as consumers must choose between watching the program or browsing the Internet. Consequently, consumers resort to switching between media devices (e.g. between television and laptop) or applications manually, in a time consuming and disjointed fashion.

Accordingly, the inventors have recognized a need for an integrated system that seamlessly combines the various capabilities of conventional devices to provide a shared multimedia experience.

SUMMARY OF THE INVENTION

At least one presently preferred embodiment of the invention provides systems and methods for a shared multimedia experience. The invention identifies media content, automatically obtains related media content and provides a wide variety of options for users of the system to interact with the system and each other via other electronic devices of choice. The invention provides users with previews of related content, the ability to select related content from the previews for combined display with input media content, and the ability to augment the related content with content obtained and/or transmitted via the other electronic devices.

In summary, one aspect of the invention provides an apparatus comprising: one or more processors; and a program storage device tangibly embodying a program of instructions that when executed by the one or more processors enable the apparatus to: identify media input to the apparatus; automatically obtain content related to the media; provide the content related to the media to one or more electronic devices having a display.

Another aspect of the invention provides A method comprising: identify media input to an apparatus; automatically obtain content related to the media; provide the content related to the media to one or more electronic devices having a display.

A further aspect of the invention provides a tangible program storage device, readable by machine, embodying a program of instructions that when executed by a processor of the machine enable the machine to: identify media input to an apparatus; automatically obtain content related to the media; provide the content related to the media to one or more electronic devices having a display.

For a better understanding of the present invention, together with other and further features and advantages thereof, reference is made to the following description, taken in conjunction with the accompanying drawings, and the scope of the invention will be pointed out in the appended claims.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a block diagram of a computer system.

FIG. 2 illustrates a media management system.

FIG. 3 illustrates a method for transmitting related content to a connected device.

FIG. 4 illustrates a method of single click transfer of related content.

DETAILED DESCRIPTION OF THE INVENTION

It will be readily understood that the components of the present invention, as generally described and illustrated in the figures herein, may be arranged and designed in a wide variety of different configurations in addition to the described presently preferred embodiments. Thus, the following more detailed description of the embodiments of the present invention, as represented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected presently preferred embodiments of the invention.

Reference throughout this specification to “one embodiment” or “an embodiment” (or the like) means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, appearances of the phrases “in one embodiment” or “in an embodiment” or the like in various places throughout this specification are not necessarily all referring to the same embodiment.

Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the invention. One skilled in the relevant art will recognize, however, that the invention can be practiced without one or more of the specific details, or with other methods, components, materials, etc. In other instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring aspects of the invention.

The illustrated embodiments of the invention will be best understood by reference to the drawings. The following description is intended only by way of example, and simply illustrates certain selected presently preferred embodiments of the invention as claimed herein.

As noted above, conventional arrangements for media management do not provide an integrated experience for the user. In contrast, systems, devices and methods for providing an integrated media experience are described in co-pending and commonly owned U.S. patent application Ser. No. 12/415,638, filed on Mar. 31, 2009, and Ser. No. 12/463,020, filed on May 8, 2009, and the application entitled “System and Method for Distributed Local Content Identification” (Docket No. RPS920090016-US-NP), filed concurrently herewith, all of which are incorporated by reference herein. These applications provide some useful information on media management systems that can identify a variety of media content, obtain related content based on the identification, and integrate/overlay media content from a plurality of sources for selective, combined display.

According to one embodiment of the invention, a computer of a media management system is configured to utilize a communications connection and communicate with other Internet-connected and/or networked devices (hereinafter referred to as “connected devices”). These connected devices can include but are not limited to laptop and desktop computers, mobile/smart phones and other devices (e.g. web enabled mobile media/music players). The computer of the media management system is also configured to communicate with a remote electronic device, such as a data center as described below, to facilitate identification and retrieval of content related to media input to the computer from a component media source (e.g. a cable TV box).

According to one embodiment of the invention, software running on the connected devices enables an operative connection with the computer of the media management system. The connected devices are configured to run a dedicated application and/or a browser plug-in. The connection can be structured through navigation to a specific address provided by the browser application. In each instance, the connection can be maintained through the computer of the media management system when the computer is operative, as discussed herein.

Once a connection between the connected devices and the computer of the media management system is established, the computer is configured to share content with the connected devices, and between them, including but not limited to related content (e.g. customized Internet content) to provide a customized multimedia experience. Software running on the computer of the media management system permits recognition of the presence of other connected devices (e.g. on the Internet or home network) that have been registered and paired with the computer of the media management system. This registration can be accomplished in a variety of ways, including but not limited to running dedicated software applications and/or plug-ins on the connected devices, or by navigating the connected devices to a specific web site.

When a connected device is recognized by the computer of the media management system, the devices of the system are configured to allow an operable connection for content sharing. The media management system utilizes uniquely relevant information (e.g. what is currently being watched on a television connected to the computer of the media management system) to select related content (e.g. Internet web sites, etc.).

It should be noted that because the computer of the media management system can access real-time and over-time source-independent media consumption information (e.g. stored historical data relating to one or more users' media consumption habits), the computer of the media management system is positioned to provide related content to the connected devices in an intelligent way. For, example, the media management system is configured such that the computer of the media management system and/or the connected devices can retrieve web sites relevant to what is (or has been) watched on the television and/or other stored historical (e.g. profiling) data. In addition, the computer of the media management system and/or the connected devices can display streaming media content (e.g. a video clip) related to some relevant parameter know to the media management system (e.g. what is currently being watched on the television) and can display the same at the connected devices and/or a display of the media management system.

By way of a non-limiting example, if the computer of the media management system is playing an episode of a television program, a user of a connected device would be enabled to automatically obtain at that connected device a list and/or a display of related content (e.g. web sites) identified and provided automatically by the media management system. The user of the connected device would therefore be enabled to navigate to the web sites. For example, if the computer of the media management system is playing a football game, the connected device could obtain web sites containing related content (e.g. scores of other football games, statistics regarding players involved in the game, etc.).

According to at least one embodiment of the invention, the connected devices are enabled to provide a “single-click” transfer of related content. For example, the connected devices can transfer a web site to the computer of the media management system for display on the main display (e.g. a high definition television set, HDTV). Thus, the computer of the media management system allows users of connected devices to display, using the connection between the computer of the media management system and the connected devices, the related content. For example, a user watching an Internet video clip on a web site can single-click transfer (“flick”) this content to the computer of the media management system for display on the main screen (e.g. HDTV) for all to see. This content transfer can include but is not limited to a link for the content (e.g. hyperlink to the web site having the content) or the actual content itself (e.g. display of the web site and video therein).

According to an embodiment of the invention, a browser plug-in is offered which puts control in a connected device to allow, when clicked, any Internet media content or URL (uniform resource locator) to be instantly sent to the computer of the media management system and displayed (or queued for display) on the main display. This allows a number of users of separate connected devices to actively send content (e.g. web sites or links thereto) for all to see on the main display. Once the connection is made and the necessary application programs are installed on the various devices, content can be sent to the main display upon a single-click.

In addition, the computer of the media management system itself may be controlled via suitable commands issued by one or more of the connected devices, thus allowing the one or more connected devices to act as a remote control. The computer of the media management system also is configured to allow for collaboration amongst the users of the connected devices. In this context, collaboration includes but is not limited to multi-player gaming, voting, and direct control media management system (via the computer) user interface and display, in addition to the related content sharing discussed above.

Referring now to FIG. 1, there is depicted a block diagram of an illustrative embodiment of a computer system 100. The illustrative embodiment depicted in FIG. 1 may be a notebook computer system, such as one of the ThinkPad® series of personal computers sold by Lenovo (US) Inc. of Morrisville, N.C. or a workstation computer, such as the Thinkstation®, which is also sold by Lenovo (US) Inc. of Morrisville, N.C. As will become apparent from the following description, however, the present invention is applicable to operation by any appropriately configured data processing system or other electronic device.

As shown in FIG. 1, computer system 100 includes at least one system processor 42, which is coupled to a Read-Only Memory (ROM) 40 and a system memory 46 by a processor bus 44. System processor 42, which may comprise one of the AMD™ line of processors produced by AMD Corporation or a processor produced by Intel Corporation, is a general-purpose processor that executes boot code 41 stored within ROM 40 at power-on and thereafter processes data under the control of operating system and application software stored in system memory 46. System processor 42 is coupled via processor bus 44 and host bridge 48 to Peripheral Component Interconnect (PCI) local bus 50.

PCI local bus 50 supports the attachment of a number of devices, including adapters and bridges. Among these devices is network adapter 66, which interfaces computer system 100 to LAN, and graphics adapter 68, which interfaces computer system 100 to display 69. Communication on PCI local bus 50 is governed by local PCI controller 52, which is in turn coupled to non-volatile random access memory (NVRAM) 56 via memory bus 54. Local PCI controller 52 can be coupled to additional buses and devices via a second host bridge 60.

Computer system 100 further includes Industry Standard Architecture (ISA) bus 62, which is coupled to PCI local bus 50 by ISA bridge 64. Coupled to ISA bus 62 is an input/output (I/O) controller 70, which controls communication between computer system 100 and attached peripheral devices such as a keyboard, mouse, and a disk drive. In addition, I/O controller 70 supports external communication by computer system 100 via serial and parallel ports. The USB Bus and USB Controller (not shown) are part of the Local PCI controller (52).

FIG. 2 depicts a non-limiting example of a media management system 200 configured according to one embodiment of the invention. The computer system 100 described above is for example a computer 202 of media management system 200. As shown, a component media source 203 (e.g. cable TV box, satellite receiver, etc.) is connected to the computer 202, which is in turn connected to at least one main display 204 (e.g. HDTV set, computer monitor, etc.). A user first plugs his or her existing component media source 203 into the computer 202. The component media source 203 may provide uncompressed digital data via a high definition multimedia interface (HDMI) or other digital or analog connection types. Then, the user plugs the computer 202 into the display device 204. The computer is appropriately connected (e.g. via network connection) to a remote data center (210).

It is assumed in this example that an overlay passthrough device (OPD) (not shown) is provided within or external to the computer 202, though more than one OPD could be provided as external components operatively connected to the computer 202, e.g. in a home network environment. The OPD enables information capturing, identification, retrieval of related content and selective combined display of media from the component source 203 and related media content, for example derived from a remote source such as data center (210). Exemplary OPD arrangements are described co-pending and commonly owned U.S. patent application Ser. No. 12/463,020, filed on May 8, 2009, and which is incorporated by reference herein.

The information necessary for identification of the input media (e.g. a TV program) from the component media source 203 is captured by the computer (e.g. OPD) 202. The input media can be identified locally or remotely utilizing any of a wide variety of identification techniques (e.g. digital fingerprinting). The information necessary for identification of the input media (which can include the identification result itself if the input media is identified locally) is sent to the data center 410. The data center 410 can then identify the input media and obtain related content in an automated way. The related content may also be obtained directly by the computer 202, e.g. by conducting an Internet query. Thus, the related content (e.g. web sites relevant to the identified input media) can be gained in a wide variety of ways, locally or remotely, including but not limited to conducting Internet queries and/or consulting a database having pre-selected content therein.

Once obtained, the related content (if derived via the data center 210) is sent from the data center 210 to the computer 202. The computer 202 is now in possession of the related content. This related content could selectively be combined (e.g. overlaid by the OPD) for display at the main display device 202 immediately, if desired. The media management system 200 can however make the related content available in a wide variety of other ways, as discussed below.

As shown, one or more connected devices 212a, 212b, . . . 212n are in operable connection with the computer 202. The connected devices are also configurable to be in operable connection with one another. The operable connection can be any suitable connection; however, it is presently preferred that the computer and the connected devices be operably connected wirelessly within a local (home) network environment. The computer 202 can transmit the related content to one or more of the connected devices 212a, 212b . . . 212n. The selection of which device(s) to pass the related content to is configurable as desired and may be dependent upon user selection (e.g. to receive the related content at the device). Thus, the media management system 200 is capable of displaying the input media from the component media source 203 alone on the display 204, or combining the related content and the input media for combined display. Additionally, the media management system can provide the related content to one or more of the connected devices in addition to or in lieu of the combined display at the main display 204.

As a non-limiting example, the input media from the component media source 203 could be a popular television news program. The computer 202 in combination with the data center 210 can identify that the news program is being watched and obtain the news programs web site as related content. This news program web site can then selectively be displayed on the display 204 along with or in lieu of the input media (television news program). The news program web site can also be transmitted directly to one or more of the connected devices for display at those devices. Accordingly, a user with a connected device (e.g. 212a) could optionally view the news program web site, automatically provided by the media management system 200, in addition to watching the news program on the display 204. In contrast, another user 212b could opt not to view the news program web site and simply watch the program on the main display 204. Additionally, if both users are interested in the news program web site, they could selectively display it (e.g. via suitable remote control) on the main display 204 for all to see. Thus, the media management system 200 allows for one or more users to view related content selectively, as desired.

FIG. 3 illustrates a non-limiting example of communication between connected devices and the computer of the media management system. Utilizing a web browser (e.g. Internet Explorer®) of the connected device, the connected device points to a web server contained within the computer of the media management system at 301. To point to the web server the connected devices utilizes the address (e.g. IP address) of the web server to locate the web server in the (home) network utilizing known techniques, e.g. an application program (e.g. UpNP (Universal Plug and Play) or DNLA (Digital Living Network Alliance)) running on the connected device. The application program can automatically locate/identify and point to the web server). As above, the computer of the media management system is configured to obtain related content based upon the identification of input media from a component media source. As a non-limiting example, a series of relevant web sites may be obtained as related content by the computer of the media management system. The computer is configured to display previews of these web pages (e.g. in a cue of links, as thumbnail pictures, etc.) on the main display and/or transmit the same to the connected devices.

The computer transfers the preview of related content to the one or more connected devices at 302, preferably as a web page. The connected device displays the previews on a local display (i.e. a display of the connected device) using the connected device's Internet browser. At 303 the user of the connected device may review the previews (e.g. scroll through a list of thumbnail web site previews utilizing a touch screen) and select a particular preview as being of interest, e.g. clicking on it. Upon selection, the connected device obtains the selected preview at 304 (e.g. the connected device's browser obtains the selected web page for display) and displays it on the device's local screen/display. The web page containing the previews of related content by the web server is updated/refreshed at desired rate. Similarly, the retrieval by the connected device of the web page having the previews from the web server is repeated as desired.

FIG. 4 illustrates a non-limiting example of a method for single-click transfer of related content from the one or more connected devices to the media management system (for combined display on the main display device). Steps 401, 402 and 403 correspond to the steps 301, 302 and 303 as described in connection with FIG. 3. As discussed, the user can display the related content locally at 404. Additionally, at 403, the user of a connected device can select a previewed page (or other page) for single click transfer. The single-click transfer can be implemented by way of appropriate user interface on the connected device (e.g. button or area of a touch screen).

At 405, upon single-click transfer selection by the user, the connected device can http post to the web server to a packet giving the URL of the web page selected by the user. At 406 the web server receives the post and then passes this information off to the computer proper, which obtains the page and outputs it for (e.g. combined) display at the main display device. It should be noted that, as the connected devices are configured with browsers capable of browsing the Internet at the user's discretion, web pages, etc., can be derived by users independently and can also be posted for combined display using a similar post.

The computer of the media management system is configured to manage multiple posts from one or more connected devices and employ logic for handling these requests, as is desirable. For example, the computer of the media management system could place multiple post requests in a side panel of the main (combined) display and force the post requests to wait a predetermined amount of time prior to being displayed as web pages in the combined display, etc.

According to one embodiment, a peer-to-peer relationship is enabled between the computer of the media management systems and/or the one or more connected devices utilizing appropriate application software implemented on the respective devices. This will enable instant messaging capabilities, etc., between the component devices of the system and allow for increased usability and user interaction with one another and the media management system.

In brief recapitulation, at least one embodiment of the invention enables automatic identification of input media content, automatic retrieval of related content, transmission of related content to and from connected devices, and combined display of a plurality of media.

It should be understood that many of the functional characteristics of the inventive system described in this specification may be implemented as modules. Modules may include hardware circuits such as one or more processors with memory, programmable logic, and/or discrete components. The hardware circuits may perform hardwired logic functions, execute computer readable programs stored on tangible storage devices, and/or execute programmed functions. The computer readable programs may in combination with a computer system and the other described elements perform the functions of the invention.

It will be readily understood by those having ordinary skill in the art that embodiments of the present invention may take the form of an entirely hardware embodiment or an embodiment containing both hardware and software elements. An embodiment that is implemented in software may include, but is not limited to, firmware, resident software, microcode, etc.

The computer readable programs may be stored in tangible computer/machine-readable (apparatus readable) medium. Examples of a computer/machine-readable medium include a semiconductor or solid state memory, magnetic tape, a removable computer diskette, a random access memory (RAM), a read-only memory (ROM), a rigid magnetic disk and an optical disk. Current examples of optical disks include compact disk-read only memory (CD-ROM), compact disk-read/write (CD-R/W) and DVD.

Accordingly, elements of the present invention may be implemented on at least one computer running suitable software programs. These may also be implemented on at least one Integrated Circuit or part of at least one Integrated Circuit. Thus, it is to be understood that the invention may be implemented in a combination of both hardware and software. Again, computer/machine-readable programs may in combination with a computer system perform the functions of the invention.

This disclosure has been presented for purposes of illustration and description but is not intended to be exhaustive or limiting. Many modifications and variations will be apparent to those of ordinary skill in the art. The embodiments were chosen and described in order to explain principles and practical application, and to enable others of ordinary skill in the art to understand the disclosure for various embodiments with various modifications as are suited to the particular use contemplated.

In the drawings and specification there has been set forth a preferred embodiment of the invention and, although specific terms are used, the description thus given uses terminology in a generic and descriptive sense only and not for purposes of limitation.

If not otherwise stated herein, it is to be assumed that all patents, patent applications, patent publications and other publications (including web-based publications) mentioned and cited herein are hereby fully incorporated by reference herein as if set forth in their entirety.

Claims

1. An apparatus comprising:

one or more processors; and

a program storage device tangibly embodying a program of instructions that when executed by the one or more processors enable the apparatus to:

identify media input to the apparatus;

automatically obtain content related to the media;

provide the content related to the media to one or more electronic devices having a display.

2. The apparatus according to claim 1, wherein the media input to the apparatus is sourced from the one or more electronic devices.

3. The apparatus according to claim 1, wherein the media input to the apparatus is not sourced from the one or more electronic devices.

4. The apparatus according to claim 1, wherein to identify further comprises:

transmitting to a data center identification information related to the media, the data center being configured to conduct an identification analysis; and

receiving an identification result.

5. The apparatus according to claim 1, wherein the one or more electronic devices comprise one or more of a laptop computer, a desktop computer, a mobile phone and a mobile media player.

6. The apparatus according to claim 3, wherein the program of instructions, when executed by the one or more processors, further enables the apparatus to:

transmit a preview of the related content to the one or more electronic devices; and

receive from the one or more electronic devices one or more selections from the preview.

7. The apparatus according to claim 6, wherein the preview comprises one or more web pages relevant to the media.

8. The apparatus according to claim 6, wherein the one or more selections comprise one or more post requests from the one or more electronic devices.

9. The apparatus according to claim 5, wherein the program of instructions, when executed by the one or more processors, further enables the apparatus to receive additional content from the one or more electronic devices, the additional content comprising user derived additional content.

10. The apparatus according to claim 1, wherein the program of instructions, when executed by the one or more processors, further enables the apparatus to receive commands from the one or more electronic devices, the commands modifying the combined display of the media and the content related to the media on a main display device.

11. A method comprising:

identify media input to an apparatus;

automatically obtain content related to the media;

provide the content related to the media to one or more electronic devices having a display.

12. The method according to claim 11, wherein the media input to the apparatus is sourced from the one or more electronic devices.

13. The method according to claim 11, wherein the media input to the apparatus is not sourced from the one or more electronic devices.

14. The method according to claim 11, wherein to identify further comprises transmitting to a data center identification information related to the media, the data center being configured to conduct an identification analysis, and receiving an identification result.

15. The method according to claim 11, wherein the one or more other electronic devices comprise one or more of a laptop computer, a desktop computer, a mobile phone and a mobile media player.

16. The method according to claim 14, further comprising:

transmitting a preview of the related content to the one or more electronic devices; and

receiving from the one or more electronic devices one or more selections from the preview.

17. The method according to claim 16, wherein the preview comprises one or more web pages relevant to the media.

18. The method according to claim 16, wherein the one or more selections comprise one or more post requests from the one or more other electronic devices.

19. The method according to claim 15, further comprising receiving additional content from the one or more other electronic devices, the additional content comprising user derived additional content.

20. A tangible program storage device, readable by machine, embodying a program of instructions that when executed by a processor of the machine enable the machine to:

identify media input to an apparatus;

automatically obtain content related to the media;

provide the content related to the media to one or more electronic devices having a display.