Abstract: Content is displayed to a user of augmented reality device. In response to receiving an indication of an increased level of risk, the degree of content being displayed to the user is reduced. The indication of increased level of risk may be generated by or received from an associated transportation device. The adjustment of the display of the degree of content may include moving one or more content elements out of a central field of view of the augmented reality device, reducing the size or visual characteristics of a content element, or eliminating a content element from the display.

Abstract: A support arm assembly for a head-worn device includes a metal support arm configured to form a rear face, a bottom face, and a top face of an enclosure for a projector, thermally coupled to the projector to act as a heatsink, configured to structurally attach to a rear structural element of the head-worn device, and configured to structurally attach to an optical element holder of the head-worn device, such that the metal support arm forms a structural support joining the optical element holder to the rear structural element without placing mechanical load on the projector.

Abstract: The subject technology determines at least one primitive shape based on at least one graphical element in an augmented reality (AR) facial pattern. The subject technology generates a JavaScript Object Notation (JSON) file using at least one primitive shape. The subject technology generates internal facial makeup format (IFM) data using the JSON file.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by one or more processors that implement a messaging application, a video feed from a camera of a user device; detecting, by the messaging application, a face in the video feed; in response to detecting the face in the video feed, retrieving a three-dimensional (3D) caption; modifying the video feed to include the 3D caption at a position in 3D space of the video feed proximate to the face; and displaying a modified video feed that includes the face and the 3D caption.

Abstract: A gesture-based wake process for an AR system is described herein. The AR system places a hand-tracking input pipeline of the AR system in a suspended mode. A camera component of the hand-tracking input pipeline detects a possible visual wake command being made by a user of the AR system. On the basis of detecting the possible visual wake command, the AR system wakes the hand-tracking input pipeline and places the camera component in a fully operational mode. If the AR system, using the hand-tracking input pipeline, verifies the possible visual wake command as an actual wake command, the AR system initiates execution of an AR application.

Abstract: Methods and devices are presented for managing communications in an ephemeral communication system. In some embodiments, messages in the system are analyzed to determine a complexity value for the message. This may be based on various algorithms, models, or system associations. The complexity information may then be used to recommend an availability value for the message, and to set a deletion trigger for the message based on the recommended availability value. When criteria of the automatically set deletion trigger are met at a device receiving the message, the message is automatically deleted from the device. In some embodiments, this deletion trigger at the device may also be used to initiate deletion of the message from other parts of the system.

Abstract: Systems and methods for providing personalized videos are provided. An example method includes receiving preprocessed videos including a target face and facial expression parameters of the target face, modifying the preprocessed videos to generate one or more personalized videos by replacing the target face with a source face, where the source face is modified to adopt the facial expression parameters of the target face, providing a user interface enabling a user to share at least one personalized video of the one or more personalized videos with a further user of a further computing device, determining that an application to be used to share the personalized video does not allow auto-play of the personalized video in a video format, in response the determination, exporting the personalized video of the one or more personalized videos into an image file, and sharing the image file via the application.

Abstract: Systems and methods for simplified message grouping and display are provided. In example embodiments, a plurality of messages are received within a conversation which is accessible by a plurality of client devices. Messages are grouped into different cards based on criteria associated with the cards. During a transition between displaying a first of the cards to a second of the cards, an animation may be displayed.

Abstract: Aspects of the present disclosure involve a system for providing virtual experiences. The system accesses an image depicting a person and one or more camera parameters representing a viewpoint associated with a camera used to capture the image. The system extracts a portion of the image comprising the depiction of the person. The system processes, by a neural radiance field (NeRF) machine learning model, the one or more camera parameters to render an estimated depiction of a scene from the viewpoint associated with the camera used to capture the image. The system combines the portion of the image comprising the depiction of the person with the estimated depiction of the scene to generate an output image and causes the output image to be presented on a client device.

Abstract: Systems and methods for determining a location of a wearable electronic device are disclosed. In some aspects, the device includes a position acquisition device and an accelerometer. A hardware processor included in the device may be configured to generally maintain the position acquisition device in a low power state to save power. When a video or image is captured, it may tag the video or image with first location information. Given the inoperative position acquisition device, a current location may not be known. In some aspects, in response to a need for location information, measurements from an accelerometer may be stored. The position acquisition device may also be transitioned to an operative state, and after some time delay, a second location determined. In some aspects, the location of the capture may then be obtained based on the acceleration measurements and the second location.

Abstract: An audio response system can generate multimodal messages that can be dynamically updated on viewer's client device based on a type of audio response detected. The audio responses can include keywords or continuum-based signal (e.g., levels of wind noise). A machine learning scheme can be trained to output classification data from the audio response data for content selection and dynamic display updates.

Abstract: Systems and methods provide for advanced video editing techniques using sampling patterns. In one example, a computing device can receive a selection of a clip of a video and a sampling pattern. The computing device can determine a respective number of frames to sample from the clip for each interval of time over a length of time for a new clip. For example, the computing device can determine a function corresponding the pattern that relates time and the number of frames to sample, a histogram corresponding to the pattern, or a definite integral corresponding to the pattern, among other approaches. The computing device can extract these numbers of frames from the clip and generate the new clip from the extracted frames. The computing device can present the new clip as a preview and send the new clip to other computing devices.

Abstract: An interaction system that provides users in mutual affinity relationships to send messages. Interaction applications of two or more users receives notifications of a mutual affinity relationship between the first user and the second user. The interaction applications configure respective mutual affinity widgets by associating the mutual affinity widget with the respective other user. Icons of the mutual affinity widgets are provided on respective home screens of the users. Upon detecting a selection of the mutual affinity widget by a first user, a message creation interface is provided to the first user and a message is generated based on an image captured by the first user using the message creation user interface. The message is then sent to a second user. The second user uses their own mutual affinity widget to access the message.

Abstract: Systems, methods, and computer readable media for customizable avatar generation system, where the methods include accessing text data, processing, using at least one processor, the text data to determine first characteristics of the text data, selecting a personalized avatar of a plurality of personalized avatars for the text data based on matching the first characteristics with second characteristics of the plurality of personalized avatars, generating a customized avatar based on the text data and the selected personalized avatar, and causing the customized avatar to be displayed on a display of a computing device.

Abstract: Systems, devices, media, and methods are presented for determining a level of abusive network behavior suspicion for groups of entities and for identifying suspicious entity groups. A suspiciousness metric is developed and used to evaluate a multi-view graph across multiple views where entities are associated with nodes of the graph and attributes of the entities are associated with levels of the graph.

Abstract: A hydrofoil board having a hydrofoil and individually controllable flaps configured to be controlled to stabilize the board in a level position even when incurring waves. The flaps are spaced from the hydrofoil to generate a gap, and direct fluid flowing under the hydrofoil through the gap, and over the flaps. The flaps control the pitch and direction of the hydrofoil board when propelled in motion. A processor uses an internal measurement unit (IMU) to obtain orientation and acceleration information of the hydrofoil board. A global positioning system (GPS) unit is also used as an additional speed and location sensor. The processor combines IMU data with a user/rider's input, such as selected speed and direction via handheld wireless controller, and individually controls the flap motors to position the flaps, and the propulsion motor to set speed. In one example, the controller is configured to bring the hydrofoil board to a complete and stabile stop.

Abstract: AR-enabled wearable electronic devices such as smart glasses are adapted for use as an (Internet of Things) IoT remote control device where the user can control a pointer on a television screen, computer screen, or other IoT enabled device to select items by looking at them and making selections using gestures. Built-in six-degrees-of-freedom (6DoF) tracking capabilities are used to move the pointer on the screen to facilitate navigation. The display screen is tracked in real-world coordinates to determine the point of intersection of the user's view with the screen using raycasting techniques. Hand and head gesture detection are used to allow the user to execute a variety of control actions by performing different gestures. The techniques are particularly useful for smart displays that offer AR-enhanced content that can be viewed in the displays of the AR-enabled wearable electronic devices.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing an indication of video recording. The program and method provide for displaying a user interface within an application running on a device, the user interface presenting real-time image data captured by a camera of the device, the user interface including a shutter button which is selectable to initiate video recording in response to a first user gesture; and upon detecting the first user gesture selecting the shutter button, initiating video recording with respect to the real-time image data, replacing a first set of interface elements within the user interface with a second set of interface elements within the user interface, and updating an appearance of the shutter button.

Abstract: A method and a system include providing for a group conversation between plural users including a first user and a second user; determining that the second user is active within one of the main conversation view or the experience page; upon determining that the second user is active in the main conversation view, providing a first graphical element for display on a first device associated with the first user, the first graphical element including an avatar and name of the second user; and upon determining that the second user is active in the experience page, providing a second graphical element for display on the first device associated with the first user, the second graphical element including the avatar and name of the second user together with an icon representing the experience page.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: capturing a video that depicts a person; identifying a set of skeletal joints of the person depicted in the video; storing a movement vector representing previously captured three-dimensional (3D) movement of the set of skeletal joints of the person depicted in the video; receiving input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the previously captured 3D movement of the set of skeletal joints of the person depicted in the video.