INTERACTIVE MOBILE VIDEO AUTHORING EXPERIENCE
Devices and methods for creating social media videos based on media assets are disclosed. A computing device displays a graphical user interface (“GUI”) for creating the social media video. The GUI includes a first region for selecting a media asset and a second region for displaying selected media assets. The device receives a user selection of the first media asset for use in a social media video. The device obtains a first metadata information associated with the first media asset, obtains a second media asset based at least in part on the first metadata information, and displays, in the first region, a thumbnail image of the second media asset. The second media asset is obtained based on first metadata information. In this way, related media assets are retrieved and display to optimize the creation of social media videos.
1. Field
The present disclosure relates generally to the social media, and more specifically, to user interfaces for authoring social media videos.
2. Description of Related Art
Social media technologies described in U.S. provisional application 61/649,916, filed on May 21, 2012, provide for the authoring of social media content using media assets, and are hereby incorporated by reference for all purposes. Media assets are visual and/or aural digital objects, such as computer images, video clips, audio clips, text verbiages, or the like. Media assets may be stored at a variety of sources, e.g., social networking web sites, cloud-based image repositories, local repositories of portable computing devices, and the like.
Given the limited display screen sizes of computing devices that are often used to author social media (e.g., smartphones), and the large pool of media assets that are often available via social media for use in social media content authoring, it would be advantageous to present relevant media assets in organized manners to facilitate social media content authoring.
SUMMARYIn some embodiments, a computer-implemented method for creating a social media video includes causing to be displayed, on one or more display screens, a user interface for creating the social media video, where the user interface includes a first region for selecting a media asset and a second region for displaying selected media assets, and the first region includes a first icon representing a first media asset. The method includes receiving a user selection of the first media asset from a user input device. The user selection is a swipe of the first icon from the first region towards the second region. The method includes obtaining a first metadata information associated with the first media asset, obtaining a second icon representing a second icon representing a second media asset based at least in part on the first metadata information, and causing to be displayed, in the first region, the second icon representing the second media asset. The second media asset is obtained based on the first metadata information.
In some embodiments, the method includes obtaining, from a global positioning system (GPS) sensor, a GPS location of a computing device, and causes to be displayed the first icon representing the first media asset if the first metadata information indicates a first location within a predetermined distance of the GPS location of the computing device.
In some embodiments, the first metadata information includes a first location information that indicates the location at which the first media asset was created, and the second media asset was created at a location within a predetermined distance of the first location. In some embodiments, the first metadata information includes a first timestamp indicating a date and/or time at which the first media asset was created, and the second media asset was created within a timespan before or after the first timestamp.
In some embodiments, the first metadata information comprises a social graph information, the social graph information identifies a first node of a social graph, the second media asset is associated with a second node of the social graph, and the first node and the second node are connected on the social graph. In some embodiments, the social graph is a social graph of a social networking web site.
In some embodiments, when metadata of the first media asset indicates that the first media asset was created within a predetermined distance of a business, the second media asset represents the business. In some embodiments, the second media asset is an advertisement for the business or includes a picture of the business.
In some embodiments, the first metadata information includes image recognition information generated by an image recognition algorithm based on the first media asset, and the second icon representing the second media asset is displayed based on the image recognition information. The recognition information may be generated using facial recognition, object recognition, and/or color matching technologies.
In some embodiments, the first media asset includes audio, the audio is analyzed, and the second icon representing the second media asset is displayed based on the analysis of the audio.
In some embodiments, a non-transitory computer-readable storage medium having computer-executable instructions for creating a social media video includes instructions for causing to be displayed, on one or more display screens, a user interface for creating the social media video, where the user interface includes a first region for selecting a media asset and a second region for displaying selected media assets, and the first region includes a first icon representing a first media asset. The instructions include receiving a user selection of the first media asset from a user input device. The user selection is a swipe of the first icon from the first region towards the second region. The instructions include obtaining a first metadata information associated with the first media asset, obtaining a second icon representing a second icon representing a second media asset based at least in part on the first metadata information, and causing to be displayed, in the first region, the second icon representing the second media asset. The second media asset is obtained based on the first metadata information.
In some embodiments, a computing device for creating a social media video based on media assets includes one or more processors operatively coupled to one or more display screens, a user input device, and a network interface, where the network interface is configured to connect with a network. The one or more processors are configured to cause to be displayed, on the one or more display screens, a user interface for creating the social media video, where the user interface includes a first region for selecting a media asset and a second region for displaying selected media assets, and the first region includes a first icon representing a first media asset. The one or more processors are configured to receive, from the user input device, a user selection of the first media asset. The user selection is a swipe of the first icon from the first region towards the second region. The one or more processors are configured to obtain a first metadata information associated with the first media asset, obtain a second icon representing a second media asset based at least in part on the first metadata information, and cause to be displayed, in the first region, the second icon representing the second media asset. The second media asset is obtained based on first metadata information.
The following description is presented to enable a person of ordinary skill in the art to make and use the various embodiments. Descriptions of specific devices, techniques, and applications are provided only as examples. Various modifications to the examples described herein will be readily apparent to those of ordinary skill in the art, and the general principles defined herein may be applied to other examples and applications without departing from the spirit and scope of the various embodiments. Thus, the various embodiments are not intended to be limited to the examples described herein and shown, but are to be accorded the scope consistent with the claims.
The embodiments described herein include technologies directed to the blogging of interactive videos in the social media (“Social Media Video”). In some embodiments, a native application that operates on a computing device includes computer-executable instructions for authoring and viewing Social Media Videos. For example, the native application may be an APPLE iOS “app” or a GOOGLE ANDROID “application” or “widget”.
1. Social Media VideosA user authors a Social Media Video using media assets. Media assets are visual and/or aural digital objects, such as computer images, video clips, audio clips, text verbiages, or the like. For instance, a computer media object in the form of a PNG file constitutes a media asset. Media assets may be obtained from various sources, e.g., the memory of a computing device, a social media website, a Social Media Video service provider, a cloud-based repository of media assets, and so forth. A source of media assets may be referred to as a media asset feed.
A view may have multiple regions. Editing view 210 includes two regions. A first region, called “media carousel” 211, displays icons that each represents a media asset feed and/or a media asset. As shown in
Editing view 210 (
Note, although
Also, although not shown, the user interface that is provided by editing view 210 may be implemented using multiple views. For example, the first region media carousel 211 and timeline 212 may each be displayed in its respective view. The two corresponding views may be displayed on the same or across different physical display screens. That is, the above-described user interface may be adapted to take advantage of additional display hardware offered by a multi-display screen computing device.
2. Media CarouselMedia carousel 211 (
During game play, user 301 uses computing device 305, e.g., a smartphone, to obtain photographs and video clips of volleyball game 300 in order to author a Social Media Video based on the game play. As illustrated by
When user 301 uses editing view 310 shown in
As another example, as shown in
Thus, media carousel 311 dynamically controls its display of media assets using metadata information associated with media assets and/or information associated with the local computing device. In this way, media carousel 311 provides a user with an improved user experience that also reduces the amount time of necessary to author a Social Media Video.
The techniques by which media carousel 311 selects and displays media assets are described in further detail, below. A media carousel displays media assets based on logic conditions. Conditions may be based on location information, date/time information, user information, social graph information, media asset metadata information, or the like, as described below.
A media carousel may display media assets based on location information. For example, a computing device may contain a GPS sensor that provides the location of the computing device, which is deemed a reliable proxy for user location. Location information may also be obtained by other means such as cell tower triangulation, an IP address, user input, or the like. If media assets have metadata that identifies an origin of the media asset, then GPS sensor information may be used to determine which media assets should be displayed in the media carousel. For example, a digital image file may have metadata in the form of a field that identifies the GPS location where the image was captured. The user's location may be compared to the metadata of the digital image file to determine whether the contents of the digital image file should be displayed as a relevant media asset. If the origin of a media asset is near the user's location, the media asset may be prioritized for display, meaning that the media asset may be displayed to the left of other media assets in a media carousel.
A media carousel may display media assets based on temporal (e.g., date/time) information. For example, a computing device may provide current date/time information, while media assets may include metadata indicating when the media asset was created. A media asset may be displayed on the condition that the media asset was created within a specified time before the current date/time. For example, the media carousel may display only media assets that were created within 24 hours of the current date/time. Additionally, media assets may be displayed based on the order in which they were created. For example, media assets created more recently are potentially more relevant to a user, and thus may be displayed ahead of media assets created longer ago.
A media carousel may display media assets based on social graphs. Consistent with the ordinary meaning of the term in the art, a “social graph” is a mapping of the connections or relationships between people, places, events, pets, and other entities. Various social networking web sites maintain social graphs of their users. A media asset may be displayed in the media carousel on the condition that it is accessible, as determined by a relevant social graph, to the author of a Social Media Video. Media assets may be accessible when two nodes (e.g., user accounts) in a social graph are connected. For instance, the media carousel may display images uploaded by FACEBOOK friends, by TWITTER followers, by PTCH tribe members, or by GOOGLE+ circle members of a Social Media Video author.
A media carousel may display media assets based on image recognition information. Image recognition information may be generated by applying an image recognition algorithm to a media asset. The metadata of the media asset may include the image recognition information generated by the image recognition algorithm. Image recognition algorithms may perform facial recognition, object recognition, color recognition, or the like. Image recognition information may include facial information, object information, color matching information, or the like. A media carousel may use image recognition information of media assets to identify and/or display other media asset(s) with matching or overlapping metadata information.
A media carousel may display media assets based on an audio signature. An audio clip, a video clip containing audio, or any other media asset that has an audio component may be analyzed to generate an audio signature. The audio signature may be included in the metadata of the analyzed media asset. The audio signature of a media asset may be used to identify and/or display another media asset with similar or related metadata information. The audio signature metadata information of two media assets may be considered similar if the metadata information, in terms of data values, are within a threshold of each other.
A media carousel may display media assets based on contents that have already been added into a Social Media Video. For example, the Social Media Video of
Note, the various conditions described above can be used in conjunction to identify media assets for display in a media carousel. For example, the media carousel may be populated with media assets that are produced by friends of the user at about the same place at about the same time.
At block 410, a user interface for creating the Social Media Video is displayed. The user interface includes a media carousel for displaying icons representing media assets and for selecting media assets. The user interface also includes a timeline for displaying selected media assets. At block 420, a user selection of a first media asset is received. The user selection may be a swipe of an icon representing a first media asset displayed in the media carousel from the media carousel towards the timeline. Also, the user selection may be a tap on the icon representing the first media asset. At block 430, metadata associated with the selected media asset is obtained. Metadata may include, for example, date/time, author, title, description, location, recognized faces, recognized objects, recognized colors, audio signatures, or the like. At block 440, an icon of a second media asset is obtained based on the metadata associated with the selected media asset. At block 450, the icon of the second media asset is displayed in the media carousel.
Process 400 may be repeated as media assets are added to the Social Media Video in order to continually update the media carousel with relevant content. As an example, a condition may be set such that media assets are displayed based on the existing contents of the Social Media Video. For example, when a user adds a media asset to a Social Media Video, the metadata from the added content may be used in process 400 to update the media carousel with content related or similar to the media asset that was just added. By repeating process 400, the media carousel can provide more relevant results as the user adds content because additional content provides a greater amount of information about the subject of the Social Media Video being authored.
One or more of Social Media Video service provider 510 (e.g., server 511), mobile computing device 501, and/or desktop computer 502 may have computer-executable instructions for authoring, viewing, and/or revising Social Media Videos and their related data. One or more of third-party content provider 505, Social Media Video service provider 510 (e.g., server 511), mobile computing device 501, and/or desktop computer 502 may provide media assets for use in Social Media Videos, i.e., may be a media asset feed. Third-party content provider 505 may be a social networking web site, such as FACEBOOK.
3. Display of Commercial/Advertising ContentAlthough the foregoing techniques are described in the context of user-generated content, it should be noted that a media carousel may also be populated with commercial content in some embodiments. As used here, the term “user-generated content” is used consistent with its ordinary meaning in the art to refer to content created by technology consumers. In contrast, the term “commercial content” refers to content generated by a commercial provider of goods or services, such as a business organization. Exemplary commercial content includes product advertisements.
For example, using the above-described techniques, when the media carousel recognizes that a Social Media Video directed to volleyball is being authored, among the media assets displayed by the media carousel may be advertisements for a volleyball equipment manufacturer or a sporting goods store. As another example, when the media carousel recognizes that a Social Media Video contains many media assets taken near a particular landmark, the media carousel may display a curated image of the landmark, such as a corporate logo or a “hero shot” of the landmark.
A Social Media Video service provider may store and provide commercial content to Social Media Video users for a fee. For example, a volleyball manufacturer may pay Social Media Video service provider 510 (
The above-described processes and techniques may be implemented in exemplary computing system 600. As shown in
At least some data in the above-described process can be saved into memory such as memory 606 for subsequent use. Memory 606 may include a non-transitory computer-readable medium that stores (e.g., tangibly embodies) one or more computer programs for performing any one of the above-described processes by means of a computer. The computer program may be written, for example, in a general-purpose programming language (e.g., C including Objective C, Java, JavaScript including JSON, and/or HTML) or some specialized, application-specific language.
Although only certain exemplary embodiments have been described in detail above, those skilled in the art will readily appreciate that many modifications are possible in the exemplary embodiments without materially departing from the novel teachings and advantages of this disclosure. For example, aspects of embodiments disclosed above can be combined in other combinations to form additional embodiments. Accordingly, all such modifications are intended to be included within the scope of this technology.
Claims
1. A computer-implemented method for creating a social media video, the method comprising:
- causing to be displayed, on one or more display screens, a user interface for creating the social media video, wherein the user interface comprises a first region for selecting a media asset and a second region for displaying selected media assets, and wherein the first region includes a first icon representing a first media asset;
- receiving, from a user input device, a user selection of the first media asset, wherein the user selection is a swipe of the first icon from the first region towards the second region;
- obtaining a first metadata information associated with the first media asset;
- obtaining a second icon representing a second media asset based at least in part on the first metadata information; and
- causing to be displayed, in the first region, the second icon representing the second media asset.
2. The method of claim 1, further comprising:
- obtaining, from a global positioning system (GPS), a GPS location of a computing device; and
- causing to be displayed, the first icon representing the first media asset if the first metadata information indicates a first location within a predetermined distance of the GPS location of the computing device.
3. The method of claim 1,
- wherein the first metadata information comprises a first location information,
- wherein the first location information indicates the location at which the first media asset was created, and
- wherein the second media asset was created at a location within a predetermined distance of the first location.
4. The method of claim 1,
- wherein the first metadata information comprises a first timestamp indicating a date and/or time at which the first media asset was created, and wherein the second media asset was created within a timespan before or after the first timestamp.
5. The method of claim 1,
- wherein the first metadata information comprises a first social graph information,
- wherein the social graph information identifies a first node of a social graph, and
- wherein the second media asset is associated with a second node of the social graph, and the first node and the second node are connected on the social graph.
6. The method of claim 5, wherein the social graph is a social graph of a social networking website.
7. The method of claim 1, wherein when metadata of the first media asset indicates that the first media asset was created within a predetermined distance of a business, the second media asset represents the business.
8. The method of claim 7, wherein the second media asset is an advertisement for the business.
9. The method of claim 7, wherein the second media asset includes a picture of the business.
10. The method of claim 1,
- wherein the first metadata information comprises an image recognition information generated by an image recognition algorithm based on the first media asset, and
- wherein the second media asset is obtained based on the image recognition information.
11. The method of claim 10,
- wherein the generated recognition information is selected from the group consisting of facial information, object information, and color matching information.
12. The method of claim 1,
- wherein the first media asset includes audio, and the method further comprises:
- analyzing the audio, and
- obtaining the second media asset based on the audio analysis.
13. The method of claim 1, wherein the user interface is caused to be displayed on a cellular phone.
14. The method of claim 1, wherein the user interface is caused to be displayed on a tablet computer.
15. A non-transitory computer-readable storage medium having computer-executable instructions for creating a social media video, the computer-executable instructions comprising instructions for:
- causing to be displayed, on one or more display screens, a user interface for creating the social media video, wherein the user interface comprises a first region for selecting a media asset and a second region for displaying selected media assets, and wherein the first region includes a first icon representing a first media asset;
- receiving, from a user input device, a user selection of the first media asset, wherein the user selection is a swipe of the first icon from the first region towards the second region;
- obtaining a first metadata information associated with the first media asset;
- obtaining a second icon representing a second media asset based at least in part on the first metadata information; and
- causing to be displayed, in the first region, the second icon representing the second media asset.
16. The non-transitory computer-readable storage medium of claim 15, further comprising instructions for:
- obtaining, from a global positioning system (GPS), a GPS location of a computing device; and
- causing to be displayed, the first icon representing the first media asset if the first metadata information indicates a first location within a predetermined distance of the GPS location of the computing device.
17. The non-transitory computer-readable storage medium of claim 15,
- wherein the first metadata information comprises a first location information,
- wherein the first location information indicates the location at which the first media asset was created, and
- wherein the second media asset was created at a location within a predetermined distance of the first location.
18. The non-transitory computer-readable storage medium of claim 15,
- wherein the first metadata information comprises a first timestamp indicating a date and/or time at which the first media asset was created, and
- wherein the second media asset was created within a timespan before or after the first timestamp.
19. The non-transitory computer-readable storage medium of claim 15,
- wherein the first metadata information comprises a first social graph information,
- wherein the social graph information identifies a first node of a social graph, and
- wherein the second media asset is associated with a second node of the social graph, and the first node and the second node are connected on the social graph.
20. The non-transitory computer-readable storage medium of claim 19, wherein the social graph is a social graph of a social networking website.
21. The non-transitory computer-readable storage medium of claim 15, wherein when metadata of the first media asset indicates that the first media asset was created within a predetermined distance of a business, the second media asset represents the business.
22. The non-transitory computer-readable storage medium of claim 21, wherein the second media asset is an advertisement for the business.
23. The non-transitory computer-readable storage medium of claim 21, wherein the second media asset includes a picture of the business.
24. The non-transitory computer-readable storage medium of claim 15,
- wherein the first metadata information comprises an image recognition information generated by an image recognition algorithm based on the first media asset, and
- wherein the second media asset is obtained based on the image recognition information.
25. The non-transitory computer-readable storage medium of claim 24,
- wherein the generated recognition information is selected from the group consisting of facial information, object information, and color matching information.
26. The non-transitory computer-readable storage medium of claim 15,
- wherein the first media asset includes audio, and the computer-executable instructions further comprise instructions for:
- analyzing the audio, and
- obtaining the second media asset based on the audio analysis.
27. The non-transitory computer-readable storage medium of claim 15, wherein the user interface is caused to be displayed on a cellular phone.
28. The non-transitory computer-readable storage medium of claim 15, wherein the user interface is caused to be displayed on a tablet computer.
29. A computing device for creating a social media video based on media assets, the computing device comprising:
- one or more processors operatively coupled to one or more display screens, a user input device, and a network interface, wherein the network interface is configured to connect with a network, and wherein the one or more processors are configured to: cause to be displayed, on the one or more display screens, a user interface for creating the social media video, wherein the user interface comprises a first region for selecting a media asset and a second region for displaying selected media assets, and wherein the first region includes a first icon representing a first media asset; receive, from the user input device, a user selection of the first media asset, wherein the user selection is a swipe of the first icon from the first region towards the second region; obtain a first metadata information associated with the first media asset; obtain a second icon representing a second media asset based at least in part on the first metadata information; and cause to be displayed, in the first region, the second icon representing the second media asset.
30. The computing device of claim 29, further comprising:
- a global positioning system (GPS) sensor operatively coupled to the one or more processors, wherein the GPS sensor is configured to obtain a GPS location of the computing device, and
- wherein the one or more processors is further configured to cause to be displayed the first icon representing the first media asset if the first metadata information indicates a first location within a predetermined distance of the GPS location of the computing device.
31. The computing device of claim 29,
- wherein the first metadata information comprises a first location information,
- wherein the first location information indicates the location at which the first media asset was created, and
- wherein the second media asset was created at a location within a predetermined distance of the first location.
32. The computing device of claim 29,
- wherein the first metadata information comprises a first timestamp indicating a date and/or time at which the first media asset was created, and
- wherein the second media asset was created within a timespan before or after the first timestamp.
33. The computing device of claim 29,
- wherein the first metadata information comprises a first social graph information,
- wherein the social graph information identifies a first node of a social graph, and
- wherein the second media asset is associated with a second node of the social graph, and the first node and the second node are connected on the social graph.
34. The computing device of claim 33, wherein the social graph is a social graph of a social networking web site.
35. The computing device of claim 29, wherein when metadata of the first media asset indicates that the first media asset was created within a predetermined distance of a business, the second media asset represents the business.
36. The computing device of claim 35, wherein the second media asset is an advertisement for the business.
37. The computing device of claim 35, wherein the second media asset includes a picture of the business.
38. The computing device of claim 29,
- wherein the first metadata information comprises an image recognition information generated by an image recognition algorithm based on the first media asset, and
- wherein the second media asset is obtained based on the image recognition information.
39. The computing device of claim 38,
- wherein the generated recognition information is selected from the group consisting of facial information, object information, and color matching information.
40. The computing device of claim 29,
- wherein the first media asset includes audio, and the one or more processors are further configured to:
- analyze the audio, and
- obtain the second media asset based on the audio analysis.
41. The computing device of claim 29, wherein the computing device is a cellular phone.
42. The computing device of claim 29, wherein the computing device is a tablet computer.
Type: Application
Filed: Apr 22, 2013
Publication Date: Jun 23, 2016
Patent Grant number: 10191624
Inventors: Hans T. KU (La Canada Flintridge, CA), David M. KOENIG (Los Angeles, CA), Edwin R. LEONARD (Glendora, CA), David MOORE (Pasadena, CA)
Application Number: 13/867,990