Abstract: Eyewear presenting text corresponding to spoken words (e.g., in speech bubbles) and optionally translating from one language to another. In one example, an interactive augmented reality experience is provided between two users of eyewear devices to allow one user of an eyewear device to share a personal attribute of the user with a second user. The personal attribute can be speech spoken by a remote second user of eyewear converted to text. The converted text can be displayed on a display of eyewear of the first user proximate the viewed second user. The personal attribute may be displayed in a speech bubble proximate the second user, such as proximate the head or mouth of the second user. The language of the spoken speech can be recognized by the second user eyewear, and translated to a language that is understood by the first user.

Abstract: Among other things, embodiments of the present disclosure improve the functionality of electronic messaging software and systems by generating customized images with avatars of different users within electronic messages. For example, users of different mobile computing devices can exchange electronic communications with images generated to include avatars representing themselves as well as their friends, colleagues, and other acquaintances.

Abstract: Methods, systems, and devices for generating contact suggestions for a user of a social network. A first score is computed for each one of the plurality of users, the first score being computed using an edge-weighted ranking algorithm based on the user graph. A second score is computed, using a machine learning model, for each user of the plurality of users, the second score of each user being, at least partially, based on the first score of said user, with the second score of each user being representative of a probability of a first user sending a connection request to said user. A ranked contact suggestion list of one or more users of the plurality of users is generated, the one or more users being ranked based on their respective second score.

Abstract: Example systems, devices, media, and methods are described for presenting an interactive game in augmented reality on the display of a smart eyewear device. A hand tracking utility detects and tracks the location of hand gestures in real time, based on high-definition video data. The detected hand gestures are compared to library of hand gestures and landmarks. Examples include synchronized, multi-player games in which each device detects and shares hand gestures with other devices for evaluation and scoring. A single-player example includes gesture-shaped icons presented on a virtual scroll that appears to move toward an apparent collision with corresponding key images, awarding points if the player's hand is located near the apparent collision and the detected hand shape matches the moving icon.

Abstract: The technical problem of creating an augmented reality (AR) experience that, on one hand, is accessible from a camera view user interface provided with a messaging client and that, also, can perform a modification based on a previously captured image of a user, is addressed by providing an AR component. When a user, while accessing the messaging client, engages a user selectable element representing the AR component in the camera view user interface, the messaging system loads the AR component in the messaging client. The AR component comprises a target media content object, which can be animation or live action video. The loaded AR component accesses a portrait image associated with a user and modifies the target media content using the portrait image. The resulting target media content object is displayed in the camera view user interface.

Abstract: Devices, media, and methods are presented for an immersive augmented reality (AR) experience using an eyewear device with spatial audio. The eyewear device has a processor, a memory, and image sensor, and a speaker system. The eyewear device captures image information for an environment surrounding the device and identifies an object location within the same environment. The eyewear device then associates a virtual object with the identified object location. The eyewear device monitors the position of the device with respect to the virtual object and presents audio signals to alert the user that the identified object is in the environment.

Abstract: An optical display system has an optical waveguide combiner and one or more cameras. The one or more camera(s) is optically coupled to the optical waveguide combiner and have a field of view of at least one real object and at least one virtual object displayable by the optical display system. The one or more camera(s), which may be for example wafer level waveguide camera(s), may be disposed outside the usable field of view of an output coupler. The one or more camera(s) may be self-calibrated electronically using images captured by the cameras of one or more virtual object(s) displayable by the optical display system. AR/VR/MR registration of devices and/or displayed virtual objects with real objects may be implemented using the images captured by the one or more camera(s) of the displayed virtual objects and real world objects. Real object distance and/or spatial location relative to the optical waveguide combiners may be determined or estimated from the captured images.

Abstract: Systems and methods are provided for performing operations including: retrieving, by one or more processors, a plurality of content items; identifying a first content item from the plurality of content items to which a user has previously reacted; determining a category of the first content item; selecting a second content item in the plurality of content items that is associated with the determined category of the first content item to which the user has previously reacted; and presenting the second content item to the user in a presentation arrangement of a graphical user interface.

Abstract: Apparatuses and systems for electronic wearable devices such as smart glasses are described. The wearable device can comprise a housing, an image capture component, a locking component, and a control component. The housing defines an imaging aperture. The image capture component is coupled to the housing and aligned with the imaging aperture. The image capture component is configured to capture image data of a field of view aligned with the imaging aperture. The locking component is coupled to the image capture component. The locking component modifies a capture state of the image capture component to selectively enable image capture in response to a selection releasing the locking component. The control component is coupled to the locking component. Interaction with the control component comprises the selection releasing the locking component and triggering modification of the capture state of the image capture component.

Abstract: Systems, methods, and computer readable media for enhanced augmented reality (AR) reading are provided, where the methods include entering a reading mode, capturing an image of a section of reading materials such as a page of a book, identifying a code within the image, and identifying a code module corresponding to the code. The methods further include executing the code module, the code module providing an augmented reality object or virtual reality object related to an object depicted on the section or page, entering a sleep mode for a sleep duration based on an estimated reading time duration of a section or page, awaking after the sleep duration, and capturing a next image. The sleep duration is adjusted based on times when identifiers of the sections of the reading materials such as numbers are captured. The user may manually wake the AR reading device using an external user interface.

Abstract: Systems and methods for ranking a feed in a social network. The systems and methods include operations for displaying a feed includes identifying a group of users associated with a first user, identifying a plurality of content generated by one or more of the group of users, determining one or more actions that may result when each of the plurality of content is presented to the first user, ranking the content based on the one or more determined actions, and displaying the content to the first user according to the ranking.

Abstract: Systems, methods, and instructions on non-transitory computer readable media for automatically sending images to designated recipients based on context selection criteria (e.g., one or more of location, content, or quality). The system includes a camera and a user interface to trigger the camera to capture an image. The method includes identifying context selection criteria, identifying designated recipients, receiving the image captured by the camera, determining image data for the captured image, comparing the determined image data to the identified context selection criteria to identify a match, and sending the captured image to the set of designated recipients responsive to the identified match.

Abstract: Systems and methods provide for advanced video editing techniques using sampling patterns. In one example, a computing device can receive a selection of a clip of a video and a sampling pattern. The computing device can determine a respective number of frames to sample from the clip for each interval of time over a length of time for a new clip. For example, the computing device can determine a function corresponding the pattern that relates time and the number of frames to sample, a histogram corresponding to the pattern, or a definite integral corresponding to the pattern, among other approaches. The computing device can extract these numbers of frames from the clip and generate the new clip from the extracted frames. The computing device can present the new clip as a preview and send the new clip to other computing devices.

Abstract: Dense feature scale detection can be implemented using multiple convolutional neural networks trained on scale data to more accurately and efficiently match pixels between images. An input image can be used to generate multiple scaled images. The multiple scaled images are input into a feature net, which outputs feature data for the multiple scaled images. An attention net is used to generate an attention map from the input image. The attention map assigns emphasis as a soft distribution to different scales based on texture analysis. The feature data and the attention data can be combined through a multiplication process and then summed to generate dense features for comparison.

Abstract: Systems and methods herein access a visual identifier, perform a visual search of the visual identifier, in response to performing the visual search of the visual identifier, cause presentation of an application menu within a graphical user interface of a computing device, receive a selection of a first user interface element within the application menu, and in response to receiving the selection, run the computer application.

Abstract: Example systems, devices, media, and methods are described for controlling one or more virtual elements on a display in response to hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. An image processing system detects a hand and presents a menu icon on the display in accordance with a detected current hand location. The image processing system detects a series of hand shapes in the captured frames of video data and determines whether the detected hand shapes match any of a plurality of predefined hand gestures stored in a hand gesture library. In response to a match, the method includes executing an action in accordance with the matching hand gesture. In response to an opening gesture, an element animation system presents one or more graphical elements incrementally moving along a path extending away from the menu icon. A closing hand gesture causes the elements to retreat along the path toward the menu icon.

Abstract: A method and a system include receiving a request from a client device to view a media content item, determining at least one comment associated with a respective user profile from a set of connected profiles, generating a summary comments selectable item based at least in part on the respective user profile, causing a display of playback of the media content item and the summary comments selectable item in response to the request to view the media content item, and during the playback of the media content item at the particular time, causing a display of at least one comment.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for presenting available augmented reality (AR) content items. The program and method provide for displaying a capture interface in accordance with a camera mode configured to capture multiple video clips; displaying a carousel interface for presenting a first set of AR content items, each being selectable to apply respective AR content to captured video; receiving first user input selecting an explore tab included which is selectable to switch to an explorer interface for presenting a second set of AR content items; switching from the capture interface to the explorer interface; receiving, via the explorer interface, second user input selecting an AR content item from among the second set; and updating, in response to receiving the second user input, the first set of AR content items to include the selected AR content item.

Abstract: Systems and methods for radial gesture navigation are provided. In example embodiments, user input data is received from a user device. The user input data indicates a continuous physical user interaction associated with a display screen of the user device. An initial point and a current point are detected from the user input data. A radius distance for a circle that includes the current point and is centered about the initial point is determined. An action is selected from among multiple actions based on the radius distance being within a particular range among successive ranges along a straight line that starts at the initial point and extends through the circle. Each range among the successive ranges corresponds to a particular action among the multiple actions. The selected action is performed in response to detecting a completion of the continuous physical user interaction.

Abstract: Systems, devices, media, and methods are presented for determining a level of abusive network behavior suspicion for groups of entities and for identifying suspicious entity groups. A suspiciousness metric is developed and used to evaluate a multi-view graph across multiple views where entities are associated with nodes of the graph and attributes of the entities are associated with levels of the graph.