Abstract: The technical problem of enhancing the quality of an image captured in low light conditions by a front facing camera is addressed by providing an adaptive front flash system. An adaptive front flash system automatically adjusts configuration parameters of an overlaid view that operates in lieu of a front flash, termed a front flash view. The configuration parameters are adjusted based on characteristics of the output of the digital image sensor of the front facing camera. Examples of configuration parameters of the front flash view include one or more of brightness of the display, color temperature of the front flash view, and transparency of the front flash view.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for updating element properties based on distances between elements in a virtual conference. The program and method provide, in association with designing a room, an interface for specifying how a first element in the room affects at least one property value of a second element, based on distance between the two elements; receive user selection of parameter values specifying how the first element affects the at least one property value of the second element based on the distance; provide a virtual conference between plural participants within the room including the first and second elements; update the at least one property value of the second element based on a change in distance between the first and second elements, and on the parameter values; and provide for updated display of the second element.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality content corresponding to a translation in association with travel. The program and method provide for receiving, by a messaging application running on a device of a user, a request to scan an image captured by a device camera; obtaining, in response to receiving the request, a travel parameter associated with the request, and an attribute of an object depicted in the image; determining, based on the travel parameter and the attribute, to perform a translation with respect to the object; performing, in response to the determining, the translation with respect to the object; and displaying an augmented reality content item, which includes the translation, with the image.

Abstract: A mobile device can implement a neural network-based style transfer scheme to modify an image in a first style to a second style. The style transfer scheme can be configured to detect an object in the image, apply an effect to the image, and blend the image using color space adjustments and blending schemes to generate a realistic result image. The style transfer scheme can further be configured to efficiently execute on the constrained device by removing operational layers based on resources available on the mobile device.

Abstract: A method for mitigating motion blur in a visual-inertial tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, accessing a second image generated by the optical sensor of the visual tracking system, the second image following the first image, determining a first motion blur level of the first image, determining a second motion blur level of the second image, identifying a scale change between the first image and the second image, determining a first optimal scale level for the first image based on the first motion blur level and the scale change, and determining a second optimal scale level for the second image based on the second motion blur level and the scale change.

Abstract: Embodiments of the present disclosure relate generally to systems for enhancing a first media item through the addition of a supplemental second media item. A user may provide a request to enhance a selected media item, and in response, an enhancement system retrieves and presents a curated collection of supplemental content to be added to the media, to the user. The user may review the curated collection of supplemental content, for example by providing a tactile input to scroll through the curated collection of content.

Abstract: Methods and systems provide information products relating to past, present and future advertising transactions (i.e., contracts to place advertisements in various media) to enable a marketplace in advertising products. Information regarding a plurality of advertising transactions are gathered. Data is analyzed to determine its attributes. Some attribute values are transformed and the attribute values are stored in a database. Attributes are organized or indexed according to a taxonomy of attributes to provide indexes to advertising transaction records. Indexes and benchmarks for various selected types of advertising transactions can be generated by selecting certain records from the database and aggregating the data or otherwise synthesizing information products, such as benchmarks and market entities for the selected types of advertising transactions. Information products may be published and syndicated as market indexes and benchmarks.

Abstract: Systems, devices, media, and methods are presented for graphical icon identification within an image or video stream. The systems and methods receive an image including a graphical icon. The systems and methods identify a set of proposed regions of the image, at least one proposed region of the set of proposed regions containing the graphical icon and extract a set of semantic features for each proposed region of the set of proposed regions. Based on the set of semantic features of the set of proposed regions, the systems and methods identify a set of proposed icons corresponding to the graphical icon included in the image and determine a match between the graphical icon and at least one proposed icon of the set of proposed icons.

Abstract: Systems and methods for custom functional patterns for optical barcodes are provided. In example embodiments, image data of an image is received from a user device. A candidate shape feature of the image is extracted from the image data. A determination is made that the shape feature satisfies a shape feature rule. In response to the candidate shape feature satisfying the shape feature rule, a custom graphic in the image is identified by comparing the candidate shape feature with a reference shape feature of the custom graphic. In response to identifying the custom graphic, data encoded in a portion of the image is decoded.

Abstract: A computer system receives user selection of an avatar story template. User-specific parameters relating to the user are determined and real-time data, based at least in part on the user-specific parameters, is retrieved. Specific media or digital assets are obtained based on at least one of the real-time data and the user-specific parameters. An avatar story is then generated by combining the avatar story template and the specific media or digital assets. The avatar story is then displayed on a display of a computing device.

Abstract: Systems, methods, and computer readable media for augmented reality beauty product tutorials. Methods disclose determining from live images of an augmented reality (AR) tutorial effects, the effects indicating changes to the live images of a presenter of the AR tutorial from a beauty product being applied to a body part of the presenter. The methods further comprising determining from the live images motion, the motion indicating motion of the beauty product from the beauty product being applied to the body part of the presenter and storing the effects and the motion.

Abstract: The subject technology generates depth data using a machine learning model based at least in part on captured image data from at least one camera of a client device. The subject technology applies, to the captured image data and the generated depth data, a 3D effect based at least in part on an augmented reality content generator. The subject technology generates a depth map using at least the depth data. The subject technology generates a packed depth map based at least in part on the depth map, the generating the packed depth map. The subject technology converts a single channel floating point texture to a raw depth map. The subject technology generates multiple channels based at least in part on the raw depth map. The subject technology generates a segmentation mask based at least on the captured image data. The subject technology performs background inpainting and blurring of the captured image data using at least the segmentation mask to generate background inpainted image data.

Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the image; generating one or more game-based augmented reality elements; and applying the one or more game-based augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.

Abstract: Systems and methods are provided for sending serialized data for an interactive message comprising a first session data item to a second computing device to render the interactive message using the first session data item and display the rendered interactive message comprising a first media content item associated with a first interactive object and receiving, from the second computing device, a second media content item associated with a second interactive object of the interactive message. The systems and methods further provided for generating a second session data item for the second interactive object of the interactive message, adding the second session data item to the serialized data, and sending the serialized data to a third computing device to render the interactive message using the serialized data and display the rendered interactive message comprising the first media content item and the second media content item.

Abstract: A tracking system is provided that tracks user browsing activity while maintaining user privacy. It is determined whether a cookie is stored in local storage of a client device. If the cookie is not stored: a tracking identification (ID) is generated; the tracking ID, a cookie rotation timestamp, and a failed request counter in a generated cookie is stored; and the generated cookie is copied and attached to a transmitted event. If the cookie is stored: it is determined whether a time indicated by a stored cookie rotation timestamp is in the past; if the time is in the past, a flag requesting a new cookie value is set for a transmitted event; and if the time is not in the past, the stored cookie is copied and attached to a transmitted event.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing augmented reality content with a captured image in association with traveling, in accordance with some example embodiments. The program and method provide for receiving, by a messaging application running on a device of a user, a request to scan an image captured by a device camera; determining, in response to the receiving, a travel parameter associated with the request and an attribute of an object depicted in the image; obtaining supplemental content based on the travel parameter and on the attribute; and displaying an augmented reality content item, which includes the supplemental content, with the captured image.

Abstract: Eyewear providing an interactive augmented reality experience by displaying virtual 3D content in a 3D frame on a display forming a field of view (FOV). The user can manipulate the displayed 3D frame using control components, such as touchpad of the eyewear device and the mobile device including control components. The 3D frame is displayed around the 3D content to avoid FOV clipping of the 3D content by the display which distracts from the virtual experience and draws attention to the device's limitations. The 3D frame is illustrated as a window positioned in a central portion of a virtual scene displayed on display. The 3D frame can be manipulated with reference to the virtual scene by the user using the control inputs, such as by rotating the 3D frame about a non-visual vertical axis within the virtual scene to create a seamless transition. Upon advancing the 3D frame to the next/previous frame having different 3D content, an event, such as playing animation, can be triggered.

Abstract: Methods and devices are presented for managing communications in an ephemeral communication system. In some embodiments, messages in the system are analyzed to determine a complexity value for the message. This may be based on various algorithms, models, or system associations. The complexity information may then be used to recommend an availability value for the message, and to set a deletion trigger for the message based on the recommended availability value. When criteria of the automatically set deletion trigger are met at a device receiving the message, the message is automatically deleted from the device. In some embodiments, this deletion trigger at the device may also be used to initiate deletion of the message from other parts of the system.

Abstract: A messaging server system receives audio data packages from a plurality of client devices. Each audio data package includes audio content captured by a respective client device from the plurality of client devices, and location data describing a location of the respective client device when the audio content was captured. The messaging server system identifies, based on the location data included in the audio data packages, a subset of the audio data packages that include audio content captured within a predetermined geographic area. The messaging server system generates, based on the subset of the audio data packages, a playlist of audio content items for the predetermined geographic area, and provides the playlist of audio content items to at least a first client device.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for providing an in-game status bar. A gaming application is launched from a messaging application. A state in the messaging application from which the gaming application was launched is determined. A communication interface that is associated with the messaging application is generated for display, concurrently with a display of the gaming application. Functionality of the communication interface is modified based on the state in the messaging application from which the gaming application was launched.