Abstract: Systems and methods for device handshaking are described. Embodiments for client device and associated wearable device initiated handshaking are described. In certain embodiments, a device such as wearable camera eyeglasses having both high-speed wireless circuitry and low-power wireless circuitry communicates with a client device. The low-power wireless circuitry is used for signaling and to manage power on handshaking for the high-speed circuitry in order to reduce power consumption. An analysis of a high-speed connection status may be performed by a client device, and used to conserve power at the glasses with signaling from the client device to indicate when the high-speed circuitry of the glasses should be powered on.

Abstract: Method of generating customized graphics based on location information includes processor receiving location information including location of first client device. Processor causes a status interface to be displayed on the first client device that includes locations that are within a predetermined distance from the first client device. Processor receives a selection from the first client device of the first location via the status interface and stores the first location in a location database associated with the first user. Location database includes: locations previously selected by the first client device via the status interface, locations associated with media content items received from the first client device, or locations associated with the location information received from the first client device. Processor generates a country selectable item, a city selectable item, and timeline selectable items and causes passport interface to be displayed on the first client device.

Abstract: Systems and methods for operating a messaging system are provided. An example method includes receiving a first authorization from a user to use a self-image of the user in a personalized video, receiving a second authorization from the user to use a further self-image of a further user in the personalized video, sending, after the first and second authorizations have been received, the personalized video including at least part of the self-image of the user, at least part of the further self-image of the further user, and at least part of a stock video to the further user, and receiving an indication of whether the further user has authorized using the further self-image in the personalized video.

Abstract: Systems, devices, media, and methods are presented for an immersive augmented reality (AR) experience using an eyewear device with spatial audio. The eyewear device has a processor, a memory, an image sensor, and speakers. The eyewear device captures image information for an environment surrounding the device, identifies a match between objects in the image information and predetermined objects in previously obtained information for the same environment. The eyewear device then identifies a target location within the environment, which may be associated with a physical or a virtual object. The eyewear device monitors its orientation with respect to the target location and presents audio signals to guide the user toward the target location.

Abstract: A method of plane tracking comprising: capturing by a camera a reference frame of a given plane from a first angle; capturing by the camera a destination frame of the given plane from a second angle different than the first angle; defining coordinates of matching points in the reference frame and the destination frame; calculating, using the first and second angles, first and second respective rotation transformations to a simulated plane parallel to the given plane; applying an affine transformation between the reference frame coordinate on the simulated plane and the destination frame coordinate on the simulated plane; and applying a projective transformation on the simulated plane destination frame coordinate to calculate the destination frame coordinate.

Abstract: Disclosed are systems, methods, and computer-readable storage media to perform an interactive image recolorization process. The method includes receiving user input including a stroke drawn on an image presented on a client device. The stroke comprises a user-specified color. The method further includes determining a region of interest in the image. The method further includes recolorizing the region of interest on the image based on the user-specified color and causing presentation of a result of the recolorization on the client device.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for prioritizing display of an icon representing a user with available content. The program and method provide for determining a display order for multiple icons, each icon corresponding to a user of a messaging application having a content collection available for display; receiving, from a device, an indication to prioritize display of a selected icon of the multiple icons relative to other icons of the multiple icons; updating, in response to receiving the indication, the display order to prioritize display of the selected icon relative to the other icons; and providing, to the device, an indication of the updated display order to cause the multiple icons to be displayed according to the updated display order.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for configuring participant video feeds within a virtual conferencing system. The program and method provide, in association with designing a room for virtual conferencing, an interface for configuring plural participant video elements which are assignable to respective participant video feeds; receive, via the interface, an indication of user input for setting properties for the plural participant video elements; provide, in association with virtual conferencing between plural participants, display of the room based on the properties for the plural participant video elements; and assign, for each of the plural participants, a participant video feed corresponding to the participant with a respective participant video element of the plural participant video elements.

Abstract: An occlusion detection system to perform operations that include: capturing image data that depicts an environment at a client device, the environment including a target object at a position within the environment; causing display of a presentation of the environment at the client device, the presentation of the environment including a display of the target object at the position within the environment; detecting a first attribute of the display of the target object at the client device; performing a comparison of the first attribute of the display of the target object and a second attribute associated with the target object; and detecting an occlusion based on the comparison.

Abstract: System, method, and non-transitory computer readable medium for presenting images on a mobile device. Images are presented by monitoring one or more physical characteristics surrounding the mobile device using at least one sensor, determining a contextual state of the mobile device based on the monitored one or more physical characteristics, selecting an image from a plurality of related images associated with the determined contextual state, generating at least one overlay image from the selected image, and presenting the at least one overlay image with an optical assembly of the mobile device.

Abstract: Embodiments described herein include an expressive icon system to present an animated graphical icon, wherein the animated graphical icon is generated by capture facial tracking data at a client device. In some embodiments, the system may track and capture facial tracking data of a user via a camera associated with a client device (e.g., a front facing camera, or a paired camera), and process the facial tracking data to animate a graphical icon.

Abstract: A method for adjusting camera intrinsic parameters of a multi-camera visual tracking device is described. In one aspect, a method for calibrating the multi-camera visual tracking system includes disabling a first camera of the multi-camera visual tracking system while a second camera of the multi-camera visual tracking system is enabled, detecting a first set of features in a first image generated by the first camera after detecting that the temperature of the first camera is within the threshold of the factory calibration temperature of the first camera, and accessing and correcting intrinsic parameters of the second camera based on the projection of the first set of features in the second image and a second set of features in the second image.

Abstract: A caption of a multimodal message (e.g., social media post) can be identified as a named entity using an entity recognition system. The entity recognition system can use a visual attention based mechanism to generate a visual context representation from an image and caption. The system can use the visual context representation to identify one or more terms of the caption as a named entity.

Abstract: Systems and methods for reconstructing 3D models of human bodies from 2D images that counts for perspective and/or distortion effects are provided. The systems and methods include reconstructing a three-dimensional model of an object in a three-dimensional scene from a two-dimensional image comprising an image of the object. The systems and methods include determining an absolute depth of a key point of the object in the image; determining, using the absolute depth of the key point, a three-dimensional position of the key point in the three-dimensional scene; generating, using a neural network, a three-dimensional representation of the object, the three-dimensional representation comprising mesh nodes defined in a coordinate system relative to the key point; and positioning the three-dimensional representation of the object in the scene based on the position of the key point by applying a position dependent rotation to the three-dimensional object.

Abstract: A mobile device can implement a neural network-based style transfer scheme to modify an image in a first style to a second style. The style transfer scheme can be configured to detect an object in the image, apply an effect to the image, and blend the image using color space adjustments and blending schemes to generate a realistic result image. The style transfer scheme can further be configured to efficiently execute on the constrained device by removing operational layers based on resources available on the mobile device.

Abstract: A conversation interface in a messaging application is displayed, the conversation interface being presented to participants in a conversation that is being conducted on the messaging application. The conversation interface is constructed by determining statuses of at least two external resources that have been launched, within the context of the messaging application, by one or more of the conversation participants. An external resource notification interface (or “dock”) is displayed in the conversation interface, the external resource notification interface including icons corresponding to the at least two external resources. Upon user selection of the external resource notification interface, a list interface (or “drawer”) including user-selectable cells corresponding to the at least two external resources is displayed.

Abstract: Systems, devices, media, and methods are presented for categorizing unknown devices using benchmark applications. Benchmark applications are distributed to client devices to produce performance metrics for the client devices. Performance metrics of the client devices are used to categorize unknown devices by comparing the performance metrics of these devices to performance metrics of known devices.

Abstract: A method for mitigating motion blur in a visual-inertial tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, accessing a second image generated by the optical sensor of the visual tracking system, the second image following the first image, determining a first motion blur level of the first image, determining a second motion blur level of the second image, identifying a scale change between the first image and the second image, determining a first optimal scale level for the first image based on the first motion blur level and the scale change, and determining a second optimal scale level for the second image based on the second motion blur level and the scale change.

Abstract: The present invention relates to a system to facilitate the identification of geo-cells, and the distribution of media content. A visitation tracking system is configured to retrieve location data from a client device, identify a geo-cell from among a set of geo-cells based on the location data, access a database that comprises media content associated with one or more physical location within the geo-cell, ranking a first media content among the media content, and loading the first media content at the client device based on the ranking, according to certain example embodiments.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality content corresponding to a translation in association with travel. The program and method provide for receiving, by a messaging application running on a device of a user, a request to scan an image captured by a device camera; obtaining, in response to receiving the request, a travel parameter associated with the request, and an attribute of an object depicted in the image; determining, based on the travel parameter and the attribute, to perform a translation with respect to the object; performing, in response to the determining, the translation with respect to the object; and displaying an augmented reality content item, which includes the translation, with the image.