Abstract: Method for generating haptic feedback responses starts with processor causing communication interface for communication session to be displayed on first user interface and on a second user interface. Processor detects first touch input on first user interface and second touch input on second user interface. Processor monitors location of the first touch input on the first user interface and location of the second touch input on the second user interface. Processor determines distance between location of first touch input on first user interface and location on first user interface corresponding to location of second touch input on second user interface. Processor causes the first user interface and the second user interface to generate a haptic feedback response based on the distance. The haptic feedback response increases in intensity or speed as the distance decreases and decreases in intensity or speed as the distance increases. Other embodiments are described herein.

Abstract: Methods and systems are disclosed for generating voice notes. In one embodiment, a messaging application implemented on a first participant computing device, receives a request to send a voice message to a second participant computing device in a communication session. In response to receiving the request, the messaging application selects a voice modification effect. The messaging application receives input to begin recording the voice message. While the voice message is being recorded, the messaging application receives speech input, modifies the speech input based on the voice modification effect in real time, and continuously updates an audio file with the modified speech input. In response to receiving input to terminate recording the voice message, the messaging application provides a first option to playback the audio file and a second option to send the audio file as the voice message to the second participant computing device.

Abstract: A messaging system performs neural network hair rendering for images provided by users of the messaging system. A method of neural network hair rendering includes processing a three-dimensional (3D) model of fake hair and a first real hair image depicting a first person to generate a fake hair structure, and encoding, using a fake hair encoder neural subnetwork, the fake hair structure to generate a coded fake hair structure. The method further includes processing, using a cross-domain structure embedding neural subnetwork, the coded fake hair structure to generate a fake and real hair structure, and encoding, using an appearance encoder neural subnetwork, a second real hair image depicting a second person having a second head to generate an appearance map. The method further includes processing, using a real appearance renderer neural subnetwork, the appearance map and the fake and real hair structure to generate a synthesized real image.

Abstract: The subject technology receives a set of frames. The subject technology detect a first gesture correspond to an open trigger finger gesture. The subject technology receives a second set of frames. The subject technology detects from the second set of frames, a second gesture correspond to a closed trigger finger gesture. The subject technology detects a location and a position of a representation of a finger from the closed trigger finger gesture. The subject technology generates a first virtual object based at least in part on the location and the position of the representation of the finger. The subject technology renders a movement of the first virtual object along a vector away from the location and the position of the representation of the finger within a first scene. The subject technology provides for display the rendered movement of the first virtual object along the vector within the first scene.

Abstract: Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate a first color camera, a second color camera, a first display, and a second display. The first SoC and a second SoC are configured to selectively operate a first and second computer vision (CV) camera algorithms. The first SoC is configured to perform visual odometry (VIO), track hand gestures of the user, and provide depth from stereo images. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.

Abstract: The amount of user activity performed in relation to a promotion may be tracked based on user content captured via the client application. At least a portion of user content captured via the client application may be scanned and analyzed to identify user activity related to the user content. Augmented reality content items may be executable to generate content that is displayed in relation to the user content and that indicates an amount of user activity related to the promotion. In addition, the augmented reality content items may be executable to generate content in relation to the user content that indicates one or more redemption options for the promotion based on an amount of user activity performed by a user of the client application that captured the user content.

Abstract: Provided are systems and methods for portrait animation. An example method includes receiving, by a computing device, a scenario video, where the scenario video includes information concerning a first face, receiving, by the computing device, a target image, where the target image includes a second face, determining, by the computing device and based on the target image and the information concerning the first face, two-dimensional (2D) deformations of the second face in the target image, and applying, by the computing device, the 2D deformations to the target image to obtain at least one output frame of an output video.

Abstract: Eyewear including a frame having a first side and a second side, a first temple extending from the first side of the frame, a second temple extending from the second side of the frame, electronic components, a first system on a chip (SoC) adjacent the first side of the frame coupled to a first set of the electronic components, and a second system on a chip adjacent the second side, the second SoC coupled to the first SoC and to a second set of the plurality of electronic components. Processing workloads are balanced between the first SoC and the second SoC by performing a first set of operations with the first SoC and performing a second set of operations with the second SoC.

Abstract: A system and method relating to a brain-computer interface in which a visual stimulus overlaying one or more objects is provided, the visual stimulus having a characteristic modulation. The brain computer interface measures neural response to objects viewed by a user. The neural response to the visual stimulus is correlated to the modulation. The method allows the interface to discriminate between merely viewing of a display object and deliberate selection of that display object (for example, as a trigger to a further action).

Abstract: Augmented reality experiences with an eyewear device including a position detection system and a display system are provided. The eyewear device acquires text from a user input, a data input, or a speech recognition system. The eyewear device presents a visual text graphic at a predefined location with respect to the eyewear on the display by the display system. The eyewear device allows the user to manipulate the visual text graphics in a number of ways.

Abstract: Disclosed are systems, methods, and computer-readable storage media to present content on an electronic display. In one aspect, a method includes identifying a first candidate content and a second candidate content for presentation on an electronic display, determining a first probability and a second probability that the first candidate content and the second candidate content respectively will elicit a particular type of input response, determining a first weight and a second weight based on the first probability and the second probability respectively, selecting either the first content or the second content based on the first weight and the second weight; and presenting the selected content on the electronic display.

Abstract: A human interface system comprising a physical controller configured to receive input from a user and a brain-computer interface in which visual stimuli are presented such that the intention of the user can be validated. The input data from the physical controller is combined with input data from the brain-computer interface to provide hybrid input which may be used to control one or more external real or computer-generated objects. Method of operating said human interface device.

Abstract: A social media platform provides a map-based graphical user interface (GUI) for accessing social media content submitted for public accessibility via the social media platform supported by the map-based GUI. The GUI includes a map providing interactive location-based searching functionality in that selection of a target location by the user in the GUI, such as by tapping or clicking at the target location, triggers a search for social media content having geo-tag data indicating geographic locations within a geographical search area centered on the target location.

Abstract: Method starts with processor causing virtual reality (VR) interface for communication session to be displayed on first user interface of a first head-wearable apparatus and on second user interface of second head-wearable apparatus. Processor detects first touch input from first VR input device and second touch input from second VR input device. Processor monitors location of the first touch input within the first user interface and location of the second touch input within second user interface. Processor determines distance between location of the first touch input within first user interface and location on first user interface corresponding to location of second touch input within second user interface. Processor causes first and second VR input devices to generate haptic feedback response based on the distance. Haptic feedback response increases in intensity or speed as distance decreases and decreases in intensity or speed as distance increases. Other embodiments are described herein.

Abstract: Methods and systems are disclosed for generating a custom sticker. In one embodiment, a messaging application implemented on a first device receives a video and input that draws a selection of a region of the video. The messaging application generates a graphical element comprising the region of the video drawn by the input and applies one or more visual effects to the graphical element to create a custom graphic. The custom graphic with the one or more visual effects is sent from the first device to a second device.

Abstract: In a method for performing adaptive content classification of a video content item, frames of a video content item are analyzed at a sampling rate for a type of content, wherein the sampling rate dictates a frequency at which frames of the video content item are analyzed. Responsive to identifying content within at least one frame indicative of the type of content, the sampling rate of the frames is increased. Responsive to not identifying content within at least one frame indicative of the type of content, the sampling rate of the frames is decreased. It is determined whether the video content item includes the type of content based on the analyzing the frames.

Abstract: A system for deformation or bending correction in an Augmented Reality (AR) system. Sensors are positioned in a frame of a head-worn AR system to sense forces or pressure acting on the frame by temple pieces attached to the frame. The sensed forces or pressure are used in conjunction with a model of the frame to determine a corrected model of the frame. The corrected model is used to correct video data captured by the AR system and to correct a video virtual overlay that is provided to a user wearing the head-worn AR system.

Abstract: Systems, methods, and computer readable media for voice input for augmented reality (AR) wearable devices are disclosed. Embodiments are disclosed that enable a user to interact with the AR wearable device without using physical user interface devices. A keyword is used to indicate that the user is about to speak an action or command. The AR wearable device divides the processing of the audio data into a keyword module that is trained to recognize the keyword and a module to process the audio data after the keyword. In some embodiments, the AR wearable device transmits the audio data after the keyword to a host device to process. The AR wearable device maintains an application registry that associates actions with applications. Applications can be downloaded, and the application registry updated where the applications indicate actions to associate with the application.

Abstract: Method for generating haptic feedback responses starts with processor causing communication interface for communication session to be displayed on first user interface and on a second user interface. Processor detects first touch input on first user interface and second touch input on second user interface. Processor monitors location of the first touch input on the first user interface and location of the second touch input on the second user interface. Processor determines distance between location of first touch input on first user interface and location on first user interface corresponding to location of second touch input on second user interface. Processor causes the first user interface and the second user interface to generate a haptic feedback response based on the distance. The haptic feedback response increases in intensity or speed as the distance decreases and decreases in intensity or speed as the distance increases. Other embodiments are described herein.