Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for presenting shortcuts based on a scan operation. The program and method provide for receiving a user request to identify at least one object depicted in an image captured by a device camera; determining, in response to receiving the user request, an attribute of an object depicted in the image; selecting, from a plurality of shortcuts for performing with respect to the image, a shortcut that is associated with the attribute of the object, each shortcut of the plurality of shortcuts corresponding to a combination of individual functions to apply to the image; and causing display of an interface with a user-selectable element for performing the selected shortcut with respect to the image.

Abstract: Various embodiments provide for systems, methods, and computer-readable storage media that improve media content search functionality and curation of media content. For instance, various embodiments described in this document provide features that can present media content items in the form of dynamic collection of media content items upon a user typing into a search bar. In another instance, various embodiments described herein improve media content search functionality by ranking user facing search features using input signals.

Abstract: The present invention teaches a real-time hybrid ray tracing system for non-planar specular reflections. The high complexity of a non-planar surface is reduced to low complexity of multiple small planar surfaces. Advantage is taken of the planar nature of triangles that comprise building blocks of a non-planar surface. All secondary rays bouncing from a given surface triangle toward object triangles keep a close direction to each other. A collective control of secondary rays is enabled by this closeness and by decoupling secondary rays from primary rays. The result is a high coherence of secondary rays.

Abstract: Described are virtual AR interfaces for generating a virtual rotational interface for the purpose of controlling connected IoT devices using the inertial measurement unit (IMU) of a portable electronic device. The IMU control application enables a user of a portable electronic device to activate a virtual rotational interface overlay on a display and adjust a feature of a connected IoT product by rotating a portable electronic device. The device IMU moves a slider on the virtual rotational interface. The IMU control application sends a control signal to the IoT product which executes an action in accordance with the slider position. The virtual rotational interface is presented on the display as a virtual object in an AR environment. The IMU control application detects the device orientation (in the physical environment) and in response presents a corresponding slider element on the virtual rotational interface (in the AR environment).

Abstract: A method includes determining participation in an interaction function by a first user of an interaction system with a second user of the interaction system. The method also includes accessing profile data of the first user, and determining, based on the profile data, whether the first user has captured or designated a first-user self-image for use in the interaction function. In response to determining that the first user has not captured or designated the first-user self-image, the method includes accessing a media content item that includes a character, identifying a head portion of the character in the media content item, replacing the head portion with a placeholder space, and displaying the media content item with the placeholder space in a user interface corresponding to the interaction function.

Abstract: Systems and methods are provided for presenting subtitles in association with a composite video. The systems and methods include a facility for uploading a subtitle file having the full subtitles information for the entire composite video. The uploaded subtitle file is then split to generate video content item subtitles files that correspond to video content items in the composite video.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing Musical Instrument Digital Interface (MIDI) controls within a virtual conferencing system. The program and method provide, in association with designing a room for virtual conferencing, an interface for updating a property of an element within a room based on a received MIDI message; receiving, based on the interface, an indication of user input specifying to update the property of the element when the received MIDI message includes a predefined value; providing a virtual conference between plural participants within the room, the room including the element; receiving a MIDI message that includes the predefined value; and updating, in response to receiving the MIDI message, the property of the element.

Abstract: Systems, methods, and computer-readable media for adding beauty products to tutorials are presented. Methods include accessing video data comprising images of a presenter creating a tutorial, the tutorial depicting the presenter applying a beauty product to a body part of the presenter. Methods further include processing the video data to identify changes to the body part of the presenter from an application of the beauty product, and responding to identifying changes to the body part of the presenter from the application of the beauty product by processing the video data to identify the beauty product. Methods further include retrieving information regarding the beauty product and causing presentation of information regarding the beauty product on a display device.

Abstract: Aspects of the present disclosure involve systems and methods for performing operations comprising: retrieving, from a content management system (CMS), website generation data that references a data model type stored on the CMS; importing, by a migration agent from the CMS, definition of the data model type referenced by the website generation data as a local version of the data model type; detecting, by the migration agent, a change to a property of the local version of the data model type; and generating, by the migration agent, a migration script to migrate the change to the property of the local version of data model type to the data model type stored on the CMS.

Abstract: Content controller system comprising rendering server system comprising a plurality of servers. The servers receiving a plurality of segment render requests that correspond respectively to segments included in a set of media content item segments. The servers render the segments corresponding to the segment render requests using a media content identification and a main user identification. Rendering the segments comprises retrieving metadata from a metadata database associated with the media content identification, rendering the segments using the metadata, generating a main user avatar based on the main user identification, and incorporating the main user avatar into the segments. The servers can upload the segments to a segment database and update segment states in a segment state database to indicate that the segments are available. Other embodiments are disclosed herein.

Abstract: Systems, methods, and non-transitory computer readable mediums including processes to correct for distortion in images introduced by eyewear (i.e., where the facial region surrounding the eye has a boundary that doesn't match the boundary of an uncovered facial region). The correction includes segmenting images to detect eyewear covered facial regions and facial regions not covered by the eyewear and altering the covered facial regions to match the covered facial boundary to the uncovered facial boundary. Alterations include processing using a machine learning model, applying anti-refraction algorithms, scaling the covered facial region to match boundaries of the uncovered facial region, or a combination thereof.

Abstract: A messaging server system receives a message creation input from a first client device that is associated with a first user registered with the messaging server system. The messaging server system determines, based on an entity graph representing connections between a plurality of users registered with the messaging server system, that the first user is within a threshold degree of connection with a second that initiated a group story in relation to a specified event. The messaging server system determines, based on location data received from the first client device, that the first client device was located within a geo-fence surrounding a geographic location of the specified event during a predetermined event window, the geo-fence and event window having been designated by the second user, and causes the first client device to present a user interface element, that enables the first user to submit content to the group story.

Abstract: Methods and systems are disclosed for performing operations for monitoring user activity on a messaging platform. The operations include receiving, from a first client device, a request to access a group portal associated with a group of users; in response to receiving the request, generating, for display in a first section of the group portal, a first identifier of a first user of the group of users; accessing activity information associated with the first user being descriptive of one or more messages sent by a second client device of the first user to a set of recipients; and generating, for display in a second section of the group portal, the activity information associated with the first user excluding contents of the one or more messages sent by the second client device.

Abstract: The subject technology selects a plurality of augmented reality (AR) content items based at least in part on a set of attributes. The subject technology analyzes each of the selected plurality of AR content items to determine an inclusion of textual information, identify an area of interest, or detect panning motion. The subject technology modifies each of the selected plurality of AR content items based at least in part on the analyzing. The subject technology generates, using at least the modified plurality of AR content items, a composite AR content item, the composite AR content item comprising a sequence of different AR content items, each of the different AR content items corresponding to a modified AR content item from the modified plurality of AR content items. The subject technology causes display, at a client device, the generated composite AR content item.

Abstract: A semantic texture map system to generate a semantic texture map based on a 3D model that comprises a plurality of vertices that include coordinate that indicate positions of the plurality of vertices, a UV map, and a semantic segmentation image that comprises a set of semantic labels.

Abstract: A server machine modifies an augmented reality (AR) object in response to fulfillment of a condition. The machine provides, to a user device, object data that defines the AR object. The object data specifies a physical geolocation of the AR object, a presentation attribute of the AR object, a conditional modification program, and a trigger condition for execution of the conditional modification program. The object data causes the user device to present the AR object with a first appearance, located at the physical geolocation. The machine detects fulfillment of the trigger condition, and in response, the machine executes the conditional modification program. This modifies the object data by modifying the presentation attribute. The machine provides, to the user device, the modified object data, which causes the user device to present the AR object with a second appearance based on the modified presentation attribute.

Abstract: Systems, methods, and computer readable media for augmented reality beauty product tutorials. Methods disclose determining from live images of an augmented reality (AR) tutorial effects, the effects indicating changes to the live images of a presenter of the AR tutorial from a beauty product being applied to a body part of the presenter. The methods further comprising determining from the live images motion, the motion indicating motion of the beauty product from the beauty product being applied to the body part of the presenter and storing the effects and the motion.

Abstract: In an example, the eyewear includes an optical element, electronic components, and a support structure configured to support the optical element and the electronic components. The support structure defines a region for receiving at least a portion of a head of a user. The eyewear also includes a biometric sensor coupled to the electronic components and supported by the support structure. The biometric sensor is attached to the support structure and positioned to detect, in the region, a biometric signal representative of a biometric of the user for processing by the electronic components.

Abstract: The subject technology causes display, at the client device, a set of augmented reality content items generated by the first augmented reality content generator. The subject technology receives, at the client device, a second selection of the particular augmented reality content item corresponding to the destination geolocation. The subject technology causes display, at the client device, a second set of augmented reality content items generated by the first augmented reality content generator. The subject technology receives, at the client device, a second selection of the second set of augmented reality content items. The subject technology causes display, at the client device, a third set of augmented reality content items generated by the first augmented reality content generator, the third set of augmented reality content items comprising at least one activity or location associated with the destination geolocation and a selected period of time.