Abstract: A portable battery pack is disclosed for wirelessly powering a portable electronic device through a user's clothing. The portable battery pack includes a housing with a mating surface that includes one or more permanent magnets to facilitate mating with a portable electronic device, such as a body-worn camera.

Abstract: Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a method comprises: receiving, by one or more processors of a cloud computing platform, context data from a wearable multimedia device, the wearable multimedia device including at least one data capture device for capturing the context data; creating a data processing pipeline with one or more applications based on one or more characteristics of the context data and a user request; processing the context data through the data processing pipeline; and sending output of the data processing pipeline to the wearable multimedia device or other device for presentation of the output.

Abstract: Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a body-worn apparatus comprises: a camera; a depth sensor; a laser projection system; one or more processors; memory storing instructions that when executed by the one or more processors, cause the one or more processors to perform operations comprising: capturing, using the camera, a set of digital images; identifying an object in the set of digital images; capturing, using the depth sensor, depth data; identifying a gesture of a user wearing the apparatus in the depth data; associating the object with the gesture; obtaining data associated with the object; and projecting, using the laser projection system, a laser projection of the data on a surface.

Abstract: Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a method comprises: receiving, by one or more processors of a cloud computing platform, context data from a wearable multimedia device, the wearable multimedia device including at least one data capture device for capturing the context data; creating a data processing pipeline with one or more applications based on one or more characteristics of the context data and a user request; processing the context data through the data processing pipeline; and sending output of the data processing pipeline to the wearable multimedia device or other device for presentation of the output.

Abstract: In an embodiment, a wearable multimedia device, comprises: a housing configured to attach to clothing of a user; a wide field-of-view camera embedded in the housing; one or more processors; memory storing instructions that when executed by the one or more processors, causes the one or more processors to perform operations comprising: capturing, using the camera, an image of a scene that includes a bar code displayed by a terminal device; determining an intent of the user to read the bar code; in accordance with the user's intent to read the barcode: cropping the barcode from the image of the scene; establishing, using the bar code, a communication channel with the terminal device; receiving, using the communication channel, transaction data from the terminal device; and responsive to the transaction data, sending, using the communication channel, authentication credentials to the terminal device.

Abstract: Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a method for using a machine learning model to provide data corresponding to a query comprises receiving a query for data stored in one or more databases. A prompt file is determined for the query. The prompt file and the query are provided as input for a machine learning model configured to generate a prediction for the query. Training the machine learning model can include updating network parameters in the machine learning model based on the prompt file. The prediction generated for the query is received. The prediction comprises a predicted database query corresponding to the query, and a level of accuracy is determined for the predicted database query.

Abstract: Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a wearable multimedia device projects a virtual interface (VI) on a surface using a laser projector. The VI includes a first user interface element and a second user interface element partially overlapping the first user interface element. The device detects, based on sensor data from at least one of a camera or a depth sensor of the wearable multimedia device, that a user has positioned a finger in proximity with the first user interface element. In response, the device modifies a visual characteristic of at least one of the first user interface element or the second user interface element.

Abstract: Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a wearable multimedia device receives a first speech input from a user, including a first command to generate a message, and first content for inclusion in the message. The device determines second content for inclusion in the message based on the first content, and generates the message such that the messages includes the first and second content. The device receives a second speech input from the user, including a second command to modify the message. In response, the device determines third content for inclusion in the message based on the first content and/or the second content, and modifies the message using the third content. The device transmits the modified message to a recipient.

Abstract: Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and, in some implementations, a cloud computing platform. In some implementations, in a method for presentation of a home screen. In response to determining that a waking condition of a mobile device is satisfied, an environment of the mobile device is sensed using one or more sensors of the mobile device. Based at least on the sensing, a current context of the mobile device is determined. In response to determining the current context of the mobile device, a particular content is selected from among a plurality of content, the particular content being relevant to a user of the mobile device based on the current context of the mobile device. The particular content is presented as a home screen of the mobile device upon waking the mobile device.

Abstract: Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a wearable multimedia device determines a plurality of points of interest and, for each of the points of interest, a heading of that point of interest relative to the device, and a distance between that point of interest and the device. The device presents a user interface including a plurality of user interface elements arranged according to one or more curved layers. Each of the user interface elements corresponds to a different one of the points of interest. A position of each of the user interface elements relative to each of the other user interface elements in the user interface is determined based on the first data and the second data.

Abstract: Systems, methods, devices and non-transitory, computer-readable storage media are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In some implementations, a first event data structure is obtained, the first event data structure including first content and a first label including a first plurality of nested categories. A second event data structure is obtained, the second event data structure including second content, and a second label including a second plurality of nested categories. The second label is different from the first label. A context of a mobile device is determined. At least one of the first content or the second content to present using the mobile device is determined. Using the mobile device, the at least one of the first content or the second content is presented.

Abstract: Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing data captured by the wearable multimedia device. In an embodiment, operations performed by the wearable multimedia device or cloud computing platform include accessing information from one or more data streams, where the one or more data streams include at least one of image data or preset image parameters; determining, using the information from the one or more data streams, exposure parameters for capturing one or more images; applying the determined exposure parameters to a camera; and controlling the camera to capture one or more images with an exposure set according to the applied exposure parameters.

Abstract: Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing data captured by the wearable multimedia device. In an embodiment, operations performed by the wearable multimedia device or cloud computing platform include obtaining an image captured using a camera coupled to a wearable multimedia device; comparing the image to one or more known images; identifying one or more target features in the image; generating a new image comprising a portion of the image that includes the one or more target features; and providing the new image to the wearable multimedia device for presentation.

Abstract: Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a wearable multimedia device presents a user interface for composing a message. The device receives a first user input indicating a recipient of the message and first data for inclusion in the message. In response, the device presents at least the recipient and the first data in a first user interface element of the user interface. Further, subsequent to receiving the first user input, the device receives a second user input indicating a selection of a first application or service from a plurality of applications or services presented in a second user interface element of the user interface. Subsequently, the device transmits the message to the recipient using the first application or service.

Abstract: Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a wearable multimedia device obtains sensor data from one or more first sensors of the wearable multimedia device, and generates a first content item based on the sensor data. Further, the device obtains biometric data regarding a user of the device. The biometric data is obtained from one or more second sensors of the wearable multimedia device. The device determines a metric for the first content item based on the biometric data, and stores the first content item and the metric. The metric is stored as metadata of the first content item.

Abstract: Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a wearable multimedia device obtains first configuration data specifying first operations associated with a first hand of a user of the wearable multimedia device, and second configuration data specifying second operations associated with a second hand of the user. Further, the device captures sensor data from a camera and/or a depth sensor of the wearable multimedia device, and determines a presence of the first hand and/or the second hand based on the sensor data. Further, the device performs at least one of (i) the first operations responsive to determining the presence of the first hand, or (ii) the second operations responsive to determining the presence of the second hand.

Abstract: Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for a wearable multimedia device and cloud computing platform with an application ecosystem for processing multimedia data captured by the wearable multimedia device. In an embodiment, a wearable multimedia device determines a projection area of a laser projector, the projection area having an inner region and a border region at least partially enclosing the inner region. Further, the device projects, using the laser projector, a virtual interface (VI) on a surface. In particular, the device determines, based on sensor data from a camera and/or a depth sensor, a position of the surface relative to the projection area. Further, the device projects the VI on the surface based on the position of the surface. Further, the device determines that a portion of the VI coincides with the border region, and in response, modifies a visual appearance of that portion.

Abstract: Systems, methods, devices and non-transitory, computer-readable storage mediums are disclosed for gesture recognition for a wearable multimedia device using real-time data streams. In an embodiment, a method comprises: detecting a trigger event from one or more real-time data streams running on a wearable multimedia device; taking one or more data snapshots of the one or more real-time data streams; inferring user intent from the one or more data snapshots; and selecting a service or preparing content for the user based on the inferred user intent. In an embodiment, a hand and finger pointing direction is determined from a depth image, a 2D bounding box for the hand/finger is projected into a 2D image space and compared to bounding boxes for identified/labeled objects in the 2D image space to identify an object that the hand is holding or the finger is pointing toward.

Abstract: A portable battery pack and portable electronic device communicate by pulsing (turning on/off) their respective battery chargers causing variations in a magnetic field between the battery pack and portable electronic device that can be used to transmit and receive short messages through their respective coils using a magnetic communication protocol. Data or messages can be transferred between portable battery pack and portable electronic device when the portable battery pack and portable electronic device are in a mated configuration. The magnetic communication protocol allows for bi-directional communication of various battery status indicators and other data from the portable battery pack to the portable electronic device and vice-versa.

Abstract: Techniques are disclosed for creating scaled images with super resolution using neighborhood patches of pixels to provide higher resolution than traditional interpolation techniques. Also disclosed are techniques for creating super field-of-view (FOV) images of a scene created from previously captured and stored images of the scene that are stitched together with a current image of the scene, to generate an image of the scene that extends beyond the fixed FOV of the camera.