LOCATION AND ACTIVITY AWARE CONTENT DELIVERY SYSTEM
A location and activity aware content delivery system stores a plurality of instances of media content relating to known locations, and each of the instances of media content that are not generated by a mobile device user at the time the user is engaged in an activity proximate to the known locations. The system detects a current mobile device user location and activity, selects an appropriate stored instance of media content and delivers the selected media content to a friendly user.
This application claims the benefit under 35 U.S.C. §119(e) of U.S. Provisional Patent Application Ser. No. 62/206,413 entitled “LOCATION AND ACTIVITY AWARE CONTENT DELIVERY SYSTEM”, filed Aug. 18, 2015, the entire contents of which is incorporated by reference.
FIELD OF THE INVENTIONThe present disclosure relates generally to the delivery of media content based upon a location and activity of a mobile communication device user.
BACKGROUNDWith the proliferation of wireless connectivity to networks that permit access to information stored in association with computational devices (i.e., servers) connected to these networks, a very large number of applications (mobile applications) are being developed that are compatible to run on mobile communication devices. During the time that a mobile device is connected to a wireless network, a user of the device is able to search for and down-load information that they are interested in, and which is germane to their current geographic location. At some point, network developers and mobile communication device developers realized that implementing geographic positioning system (GPS) functionality in a mobile communication device allowed the current location of a mobile device to be easily tracked, and this current geographic position information could be used as the basis for identifying information to be delivered to the mobile device. Such location based information delivery applications (Location Aware Content Delivery) can be configured to request or pull location dependent content from a network, or these applications can be configured to automatically accept certain type of content that is of interest to the device user. Regardless of the method, the delivery of information to a mobile device based upon the current location of that device was a step forward in the development of mobile application functionality.
Social networking applications are available that permit groups of people to befriend one another and to share their activities and experiences with other friendly members of the group. In this regard, and among other things, friends can easily communicate what they are doing, where they are doing it, and whether they like what they are doing or not. Social networking services have designed their applications to operate with geographic positioning service functionality so that all members of a friendly group can know, in real-time, where other members of the group are located. More recently, functionality associated with social networking services has been combined with services that deliver content based on awareness of a mobile user's location, so that content can be delivered to friends in a social networking group based upon each friend's current location. Information delivered in this manner can be related to comments a member of the group makes about a restaurant, a store, an art gallery, museum, or any other location based activity, and this information can be delivered when any member of the group is located proximate to the restaurant, store, art gallery or museum.
The present invention can be best understood by reading the specification with reference to the following figures, in which:
As described earlier, location aware systems have been designed to deliver content that relates to a location that a friendly mobile device user is proximate to. This content is not typically associated with a real time activity of another friend, and the variety or type of content that can be delivered is generally limited to information entered into the system by a friendly user. For example, a first friendly mobile device user who is proximate to a particular location can comment on their experience at that location at some earlier time. The first friendly user's comments can be stored in the location aware system, and these comments can be associated with information germane to the particular location, such as the name and/or description of that location. The first user's comments and/or location description can then be delivered to a second friendly user at a later time when the second user moves proximate to the location that the first user was previously proximate to. Operating in this manner, the location aware system can push/deliver content to the second friendly user or the second friendly user can pull/request content from the system, and the content delivered by the system to the second friendly user can relate to the current location of the second friendly user. While this type of location aware content delivery system operates nicely for some types of social networking applications, it is limited to only delivering content to one or more friendly users that relates to a past activity engaged in by another friendly user that corresponds to a particular location, and it is limited to delivering content based upon a past as opposed to a current activity of another friendly user. Accordingly, it would be advantageous if a location aware content delivery system operated to deliver media content to one (or more) friendly user that relates to a current activity that another friendly user is engaged in at a location to which they are currently proximate.
In this regard, we discovered that a location aware media content delivery system can be configured to deliver rich and varied content to one or more friendly users that is associated with a current activity that another friendly user is engaged in proximate to a known object. The known object can be identified as being at a particular geographic location, it can be identified as being proximate to a particular beacon, or it can be identified as matching a captured environmental image. The media content that is delivered may not be content that is generated by one friendly user, but can be content that is created prior to the user engaging in their current activity and which can be stored in a network device for delivery in real-time to another friendly user. According to this description, current friendly user activity can be any interaction a mobile device user has with their environment, whether the environment is an interior or exterior type environment, and any interaction the mobile device user has with a mobile communication device. This activity can be characterized by, but not limited to, a mobile device user rate of movement (i.e., standing, sitting or moving around the interior of a venue, such as a museum or some other indoor venue), and activity can be characterized by a friendly user observing, viewing, reading or studying objects comprising the interior or exterior space, such as object of art or any type of object (i.e., walking around a store and viewing merchandise for sale), it can include attending a sporting event, it can include standing, sitting or walking around in an outdoor environment, such as walking down a street in a city or town, or walking through a park for instance, and it can include any interaction the user has with a mobile communication device proximate to a particular location. Information associated with mobile device user activity can be generated by a motion sensor or other sensors operating in conjunction with the mobile device, or the activity information can be generated by user interaction with an application running on the mobile device. The activity information can be characterized, but are not limited to, the current, recent, or recent history of a rate of speed with which the friendly mobile device user (mobile user) is moving, preferences or other settings the user enters into one or more applications running on a mobile communication device, and whether or not mobile communication device accessories are being used.
As described earlier, a first friendly user can be engaged in an activity at a location (venue) that is in an enclosed area (inside), or engaged in an activity that is in a venue located in the open air (outside), and the media content delivered to another, second friendly user can be content that is created previously and stored in a network device for delivery to the second, friendly user when the first friendly user moves to be proximate to a an object at a particular location corresponding to the previously created content. Optionally, the type of media content delivered to a friendly user can depend upon one or more characteristics of the activity the friendly mobile device user is engaged in. In one embodiment, the friendly user(s) to which media content is delivered depends upon information comprising each of the friendly user profiles. In this regard, one or more of the friendly users can receive the same or different media content depending upon information in their profiles. In another embodiment, media content is delivered or not delivered to one or more of the friendly users depending upon information in each of the friendly user's profile.
Such a location aware media content delivery system is able to provide one or more friendly users with a real-time indication of another friendly user's activity, and the content that is delivered to a friendly user is not limited to content that can be captured or generated in real-time by a mobile device under the control of another friendly user. Further, the system is configured such that it may only deliver media content that is of interest to each friendly user. Still further, the system can deliver media content that relates to a future location and activity that the mobile user is planning to engage in. In this regard, media content can be delivered based on a friendly user's calendar information or an indication of their intention to travel to a particular location to engage in a particular activity at a particular time, and the system can deliver content to a friendly user in anticipation/advance of the mobile user arriving at that location and engaging in the activity at the particular time. From one perspective, the location aware content delivery system operates to deliver media content to one or more friendly users that is an indication of the current activity or future planned activity to be engaged in by another friendly mobile user.
These and other aspects of the location aware content delivery system are described below with reference to the figures, in which
In certain instances, a GPS signal may not be available (indoors for example), or beacons may not be deployed. In these cases, and according to another embodiment, a mobile device, such as the mobile device 103, can be configured with image capture hardware and software that permits the device to capture and record image information from its environment. Environmental image information can be periodically captured, sent to network device where it can be used to determine a current location of the mobile device that captures the information. Systems that use image information to determine a current location are known and commercially available, and these systems can employ different methodologies to process the image information to determine a distance between the image capture device and a location that is recognizable by the system. As will be described later, the captured and recorded image information (either still image information or video information) can be transmitted to a server with functionality that operates to identify a current location of a mobile image capture device, and that operates to assist in determining a current activity in which a mobile device user is engaged. In this regard,
Generally, the content delivery system 100 in
As described earlier, any one or combination of the plurality of media content types can be delivered to one or more friendly users 107 and 108 based upon a current detected location and activity of a mobile device user 101 and/or 102. The current or recent (historical) location of a mobile user can be determined by either an indoor location position application running on a mobile device or by a similar application running on the server 130, or it can be determined by comparing an image captured by a mobile device with an image at a known location. Based upon the identity of a beacon of known location and the proximity of the mobile user to that beacon, as determined by a signal strength, the position of a mobile device user relative to the beacon can be easily determined. The beacon ID and signal strength information can be sent to the server 130 for processing to determine a mobile device position, or this processing determination can be performed by the positioning application running on the mobile device, and the position information sent to the server 130. A mobile user activity can be determined using the combination of a current or recent location and a rate at which the user is moving and their interaction with a mobile communication device. The movement rate of the user can be determined by an accelerometer operating on a mobile device or by the time it takes to move from one beacon to another beacon (beacons B.1 to B.2 for instance), or it can be determined using the captured image information to determine a current rate of movement of the device at the time a message is sent by the device, and the rate of movement can be determined based upon, among other things, a change in size of an object in a series of images captured at known points in time.. Content selection logic operating in conjunction with the mobile device 103 or on the server 130 can employ the current position, rate of movement and user interaction information received from the mobile device 103 to determine what type of activity the user is currently engaged in. For example, if the user is not moving and is proximate to the beacon B.3 in Gallery B, then the logic can determine that the user 102 is current engaged in an activity of standing still while observing an object labeled 109 that is on display in Gallery B. In this case, the content selection logic can control the server 130 to deliver to one or both friendly users 107 and 108 a still image of the object 109 and textual or audio information describing the object in some manner. On the other hand, if the system 100 detects that the user 101 is moving rapidly through Gallery B without stopping, then the logic can determine that the user 101 is not necessarily interested in the objects on display in this gallery and it can control the server 130 to deliver video type content that comprises a previously recorded walk through Gallery B. Or, if the system 100 detects that the user 101 is moving at a slow rate through Gallery B without stopping, then the logic can determine that the user may be observing some or all of the objects located in this Gallery, but not interested enough to study each object closely. In this case, the logic can control the server 130 to deliver to one or both friendly users a sequence of still images with audio content that quickly describes each object in the Gallery.
A detailed description of the functionality that can be employed to determine a current mobile user activity, and that can process activity information to determine what type or types of media content to deliver is described later. As described previously, the delivery of media content is not limited to content that corresponds to an indoor space, but can include media content that corresponds to outdoor space as well.
The server 260 in
The indoor object location map 132A (described in more detail later with reference to
Continuing to refer to
The device movement function 134 in
Continuing to refer to
Turning now to a description of the indoor object location map 132A shown with reference to
Continuing to refer to
As described earlier, the content delivery module 300 running on the server 130 operates to store a plurality of media content instances, and each instance of content can comprise one or more types of content. In order to identify an appropriate content instance and type of content comprising the instance of content to send to one or more friendly users, the server 130 receives location (beacon, GPS or image information) and activity information from a mobile device being operated by another friendly user. This activity can be characterized by, but not limited to, standing, sitting or moving around the interior of a venue, such as a museum or some other indoor venue, and observing, viewing, reading or studying objects comprising the interior or exterior space, such as object of art or any type of object (i.e., walking around a store and viewing merchandise for sale), it can include attending a sporting event, it can include standing, sitting or walking around in an outdoor environment, such as walking down a street in a city or town, or walking through a park for instance. Information associated with mobile device user activity can be generated by motion or other sensors (camera function) operating in conjunction with the mobile device or the activity information can be generated by user interaction with an application running on the mobile device. The activity information can be characterized, by but is not limited to, the current or recent rate of speed with which the friendly mobile device user (mobile user) is moving. Logic instructions comprising the content selection module 136 operates on the location and the activity information, and on information comprising a friendly user profile, to determine the appropriate media content to deliver to each friendly user.
The operation of the selection logic is now described with reference to
Continuing to refer to
The forgoing description, for purposes of explanation, used specific nomenclature to provide a thorough understanding of the invention. However, it will be apparent to one skilled in the art that specific details are not required in order to practice the invention. Thus, the forgoing descriptions of specific embodiments of the invention are presented for purposes of illustration and description. They are not intended to be exhaustive or to limit the invention to the precise forms disclosed; obviously, many modifications and variations are possible in view of the above teachings. The embodiments were chosen and described in order to best explain the principles of the invention and its practical applications, they thereby enable others skilled in the art to best utilize the invention and various embodiments with various modifications as are suited to the particular use contemplated. It is intended that the following claims and their equivalents define the scope of the invention.
Claims
1. A method of delivering media content, comprising:
- maintaining by a content delivery process, running on a computational device connected to a network, a plurality of media content instances each instance of which is associated with an object at a particular location and with a particular mobile communication device user activity;
- detecting, by a mobile communication device associated with a first mobile communication device user, information that is indicative of a current location and activity a first user is currently engaged in, and sending this information to the content delivery process running on the computational device;
- receiving, by the content delivery process, the information that is indicative of the current location and current activity of the first user and determining that the first user is proximate to an object that corresponds to a known location and identifying at least one instance of media content among the plurality of instances of media content that is associated with the object and that relates to the current activity information; and
- delivering, by the content delivery process, the identified at least one instance of media content to a second mobile communication device user.
2. The method of claim 1, further comprising identifying the at least one instance of media content based upon one or more preferences selected by the second mobile communication device user.
3. The method of claim 2, wherein the one or more preferences selected by the second mobile device user comprise any one or more of a listing of friendly users from which a user will accept content, a listing of the content types the second user will accept, a listing of the times that the second user will accept content, and an listing of the locations at which the second user will accept content.
4. The method of claim 1, wherein the information indicative of a location is received from an outdoor positioning system, an indoor positioning system or is environmental image information captured by the mobile communication device.
5. The method of claim 4, wherein the environmental image information is comprised of one or a sequence of still images or video image information.
6. The method of claim 5, wherein the still image information can be three dimensional still image information.
7. The method of claim 6, wherein the three dimensional still image information is used to calculate a distance to an identified object of interest comprising the image.
8. The method of claim 1, wherein the activity information is comprised of a rate of movement of the first mobile device user, the first mobile device user observing, viewing, reading or studying objects comprising an interior or exterior space proximate to them, attending a sporting event, standing, sitting or walking around in an outdoor environment, and any interaction the first mobile device user has with the mobile communication device.
9. The method of claim 1, wherein the media content delivered by the content delivery process to the second mobile communication device user is any one or a combination of textual information, still image information, audio information, and video information relating to the object the second mobile communication device user is proximate to.
10. A media content delivery system, comprising:
- a media content delivery process running on a computational device that is connected to a network, the content delivery process maintaining a plurality of media content instances each instance of which is associated with an object at a known location and associated with a mobile communication device user activity; and
- a plurality of mobile communication devices all of which are connected to the network, and a first one of the plurality of the mobile communication devices operating to receive information that is indicative of a current location and activity associated with a first mobile communication device user, and sending this information over the network to the content delivery process running on the computational device;
- wherein the content delivery process operates on the current location information and the current first mobile device user activity information received from the first mobile communication device to determine that the first mobile communication device user is proximate to an object that corresponds to a known location and that the first mobile communication device user is engaged in a particular activity, and identifying at least one instance of media content among the plurality of the instances of media content that is associated with the object at the current location and that relates to the activity the first mobile communication device user is currently engaged in, and delivering the identified at least one instance of media content to a second one of the plurality of the mobile communication devices.
11. The system of claim 10, further comprising the media content delivery process identifying the at least one instance of media content based upon one or more preferences selected by a user of the second one of the plurality of the mobile communication devices.
12. The method of claim 11, wherein the one or more preferences selected by a user of the mobile communication device comprises any one or more of a listing of friendly users from which a user will accept content, a listing of the content types the user will accept, a listing of the times that the user will accept content, and an listing of the locations at which the user will accept content.
13. The method of claim 10, wherein the information indicative of a current location is received from an outdoor positioning system, an indoor positioning system or is environmental image information captured by the mobile communication device.
14. The method of claim 13, wherein the environmental image information is comprised of one or a sequence of still images or video image information.
15. A media content delivery process running on a computational device connected to a network, comprising:
- a plurality of stored media content instances each instance being associated with a particular object at a known location and associated with a mobile communication device user activity; and
- logical instructions that operate on information received from a first mobile communication device over the network that is indicative of a current location and current activity of a first mobile communication device user to determine that the first mobile communication device user is proximate to an object that corresponds to a known location, and to identify at least one instance of media content among the plurality of instances of media content that is associated with the object and that relates to the current activity information, and delivering the identified at least one instance of media content to a second one of the plurality of the mobile communication devices.
16. The media content delivery process of claim 15, further comprising identifying the at least one instance of media content among the plurality of instances of media content based upon one or more preferences selected by a user of the second one of the plurality of the mobile communication devices.
17. The method of claim 15, wherein the information indicative of a current location is received from an outdoor positioning system, an indoor positioning system or is environmental image information captured by the mobile communication device.
18. The method of claim 15, wherein the mobile communication device user activity information is comprised of a rate of movement of the first mobile communication device, the first mobile communication device user observing, viewing, reading or studying objects comprising an interior or exterior space proximate to them, attending a sporting event, standing, sitting or walking around in an outdoor environment, and any interaction the first mobile device user has with the mobile communication device.
19. The method of claim 15, wherein the at least one instance of media content delivered to the second mobile communication device is any one or a combination of textual information, still image information, audio information, and video information relating to the object the second mobile communication device user is proximate to.
Type: Application
Filed: Jun 29, 2016
Publication Date: Feb 23, 2017
Inventor: BRENDAN CIECKO (BOSTON, MA)
Application Number: 15/196,928