Abstract: Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for gesture recognition for a wearable multimedia device using real-time data streams. In an embodiment, a method comprises: detecting a trigger event from one or more real-time data streams running on a wearable multimedia device; taking one or more data snapshots of the one or more real-time data streams; inferring user intent from the one or more data snapshots; and selecting a service or preparing content for the user based on the inferred user intent. In an embodiment, a hand and finger pointing direction is determined from a depth image, a 2D bounding box for the hand/finger is projected into a 2D image space and compared to bounding boxes for identified/labeled objects in the 2D image space to identify an object that the hand is holding or the finger is pointing toward.

Abstract: Techniques are disclosed for creating scaled images with super resolution using neighborhood patches of pixels to provide higher resolution than traditional interpolation techniques. Also disclosed are techniques for creating super field-of-view (FOV) images of a scene created from previously captured and stored images of the scene that are stitched together with a current image of the scene, to generate an image of the scene that extends beyond the fixed FOV of the camera.

Abstract: Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a body-worn apparatus comprises: a camera; a depth sensor; a laser projection system; one or more processors; memory storing instructions that when executed by the one or more processors, cause the one or more processors to perform operations comprising: capturing, using the camera, a set of digital images; identifying an object in the set of digital images; capturing, using the depth sensor, depth data; identifying a gesture of a user wearing the apparatus in the depth data; associating the object with the gesture; obtaining data associated with the object; and projecting, using the laser projection system, a laser projection of the data on a surface.

Abstract: In one embodiment, a method includes connecting to a virtual session for co-experiencing digital media content with one or more other users in a virtual reality environment, where the virtual reality environment comprises a screen for displaying the digital media content, receiving relative-position information indicating relative positions between the first user and the one or more other users in the virtual reality environment, rendering the screen based on a first position of the first user in the virtual reality environment, wherein the screen and the first position of the first user have a predefined spatial relationship in the virtual reality environment, and rendering, based on the received relative-position information and the first position of the first user, a second avatar representing a second user in the virtual reality environment, wherein the second user is one of the one or more other users.