Abstract: Various embodiments provide for a registry for augmented reality (AR) objects, which can provide AR objects to a client device to support various software or hardware applications. For instance, some embodiments provide for an AR object registry that facilitates or enables registration of one or more AR objects in association with one or more locations across a planet.

Abstract: Method of dynamically assigning storage locations starts with the processor updating first user's home location data. Processor selects communication session between first user and second user and determines second user's home location data. Processor determines a session location data that indicates current storage location that stores data of communication session received from first and second client devices. Processor identifies available data storage locations based on first user and second user's home location data and determines whether to update the session location data based on an average of a distance over network fiber using the first user and second user's home locations, current storage location, and available storage locations. In response to determining to update the session location data, processor updates session location data to indicate one of the available storage locations, and causes transfer of data of communication session to one of the available storage locations.

Abstract: An augmented reality component detects anchor points assigned to respective segments of a person image in output of a digital image sensor of a camera, and displays a user selectable element that can be activated through engagement of an object from the output of the digital image sensor with the user selectable element. The augmented reality component detects engagement of the user selectable element with an object from the person image and, in response, triggers a predetermined action, such as, for example, starting or stopping recording of the output of the digital image sensor or capturing a still image of the output of the digital image sensor.

Abstract: The technical problem of matching records in different datasets, for example a host dataset and a partner dataset storing records representing respective users, while maintaining the privacy of each dataset, is addressed by providing a privacy safe joint identification protocol. The privacy safe joint identification protocol computes respective anonymous joint identifiers for records in the two datasets. An anonymous joint identifier is generated such that the host-assigned and the partner-assigned identifies that have been determined to represent the same user are mapped to the same anonymous joint identifier.

Abstract: The technical problem of reducing the amount of processing involved when searching for customizable media content items that are suitable for incorporating input text is addressed by providing a hybrid search system. In some examples, the hybrid search system executes a rough search first, to determine whether a line of text can be incorporated into a media content item, based on character count conditions associated with the media content item. A more thorough evaluation of the input text with respect to the media content item is executed subsequent to the rough search if the rough search produces a result indicating uncertainty with respect to whether the combination of specific characters included in the input text can or cannot be incorporated into the media content item.

Abstract: In one or more implementations, information about a number of products may be obtained. Visual effects corresponding to each product may be applied to objects included in user content to change the appearance of the objects included in the user content. Augmented reality content may be implemented to cause changes to the appearance of one or more objects included in the user content. In various examples, a number of visual effects related to different products may be applied to objects included in the user content. A user interface including information about each of the products applied to objects included in the user content may be produced.

Abstract: A method for dynamically initializing a 3 degrees of freedom (3DOF) tracking device is described. In one aspect, the method includes accessing a gyroscope signal from a gyroscope of the 3DOF tracking device, accessing an accelerometer signal from an accelerometer of the 3DOF tracking device, determining an initial state includes a combination of an initial orientation, an initial position, and an initial velocity of the 3DOF tracking device, the initial state indicating a starting condition of the 3DOF tracking device, integrating the gyroscope signal and the accelerometer signal to obtain orientation and position signals using the initial state, and refining an inclination signal of the orientation signal using the position signal.

Abstract: The online co-location connection service is provided by a messaging system configured to selectively pair user profiles associated with respective client devices equipped with sensors that communicate with each other within the predetermined physical proximity range. The pairing is effectuated without requiring that the two client devices, at the time of pairing, are within a communication range permitted by their respective short range communication sensors and without requiring a communication between the first client device and the second client device via a short-range wireless communication technology. Subsequent to the pairing, the messaging system monitors physical proximity of the client devices based on the sensor data obtained by the co-location connection service from the respective messaging clients executing at the respective client devices.

Abstract: Among other things, embodiments of the present disclosure improve the functionality of electronic messaging software and systems by allowing senders to transmit messages and content using a messaging system, and recipients to access such messages and content, even if the recipients do not have access to the messaging system.

Abstract: Systems and methods are provided for receiving a background image for a media overlay to be applied to a message comprising an image or video, and at least one smart widget selection, and storing the media overlay comprising the background image and the at least one smart widget selection. The systems and methods further provide for receiving a request for the media overlay to be applied to a message comprising an image or video, analyzing context data associated with a computing device to determine that the media overlay is relevant to at least one aspect of the context data, determining data associated with the at least one smart widget based on the context data, and transmitting to the computing device, the media overlay and data associated with the at least one smart widget.

Abstract: A system for generating a voltage at a pixel array includes a plurality of display pixels forming the pixel array, each display pixel comprising a pixel circuit for driving the pixel. The system further comprises a row formatter configured to store a plurality of bits representing image data for a row of display pixels of the LCOS array; a row controller configured to write a subset of the plurality of bits representing image data for a pixel of the row into a plurality of data latches of said pixel circuit; and a waveform generator for generating reference pulses represented by a set of reference bits. The pixel circuit is configured to compare each reference bit to corresponding bits stored in the latches of each pixel circuit, and generate voltage at an electrode of each pixel based on this comparison.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving a request from a client device of a first user to engage in a shared augmented reality (AR) shopping experience with a second user; generating, for display on respective client devices of the first and second users, the shared AR shopping experience comprising a plurality of AR items that represent real-world products overlaid on a shared real-world environment of the first and second users; determining that the second user is interacting with a first AR item of the plurality of AR items; and in response to detecting that the second user is depicted in an image captured by the client device of the first user, overlaying the first AR item on the second user in the image.

Abstract: Systems and methods for interfacing augmented reality (AR) camera devices to Internet of Things (IoT) devices include pairing an AR camera device to an IoT device to establish which actions recognized by the AR camera device may control the IoT device, receiving an action identifier representing a gesture or position of a body part that has been recognized by the AR camera device, and sending a command to the IoT device paired with the AR camera device to perform a requested action in response to the action identifier received from the AR camera device. Context information relating to the action identifier from the AR camera may be used to modify the command sent to the IoT device. The AR camera device may be paired with an IoT device pointed at by the AR camera device, selected through a user interface of the AR camera device, or determined from context information.

Abstract: The subject technology determines a gaze direction in a field of view of a user using an eyewear device. The subject technology generates an anchor point in the field of view based at least in part on the determined gaze direction. The subject technology identifies a surface corresponding to a ground plane in the field of view. The subject technology determines a distance from the identified surface to the anchor point. The subject technology generates AR content based at least in part on the determined distance. The subject technology renders the generated AR content in the field of view for display by the eyewear device.

Abstract: Interactive augmented reality experiences with an eyewear device including a position detection system and a display system. The eyewear device registers a first marker position for a user-controlled virtual game piece and a second marker for an interaction virtual game piece. The eyewear device monitors its position (e.g., location and orientation) and updates the position of the user-controlled virtual game piece accordingly. The eyewear device additionally monitors the position of the user-controlled virtual game piece with respect to the interaction virtual game piece for use in generating a score. Augmented reality examples include a “spheroidal balancing” augmented reality experience and a “spheroidal balancing” augmented reality experience.

Abstract: Disclosed are systems, methods, and computer-readable storage media to provide voice driven dynamic menus. One aspect disclosed is a method including receiving, by an electronic device, video data and audio data, displaying, by the electronic device, a video window, determining, by the electronic device, whether the audio data includes a voice signal, displaying, by the electronic device, a first menu in the video window in response to the audio data including a voice signal, displaying, by the electronic device, a second menu in the video window in response to a voice signal being absent from the audio data, receiving, by the electronic device, input from the displayed menu, and writing, by the electronic device, to an output device based on the received input.

Abstract: A virtual mailbox is established for a first user based on a virtual mailbox definition specified by the first user. A message directed to the first user is received from a first device associated with a second user. A location within a real-world environment of the first user corresponding to the virtual mailbox is identified. A marker associated with the virtual mailbox is detected within the real-world environment of the first user. Based on detecting the marker, the second device presents the message overlaid on the real-world environment at the location corresponding to the virtual mailbox.

Abstract: In order to guide the user to a target object that is located outside of the field of view of the wearer of the AR computing device, a rotational navigation system displays on a display device an arrow or a pointer, referred to as a direction indicator. The direction indicator is generated based on the angle between the direction of the user's head and the direction of the target object, and a correction coefficient. The correction coefficient is defined such that the greater the angle between the direction of the user's head and the direction of the target object, the greater is the horizontal component of the direction indicator.

Abstract: Eyewear having an optical waveguide communicating infrared light from a remote infrared emitter in the eyewear to an optical output coupler that uniformly illuminates an eye for tracking eye movement of a user. An optical input coupler couples a light beam emitted by the remote infrared emitter into the waveguide. The remote infrared emitter simplifies industrial design and is a single light source. The remote infrared emitter is not in a peripheral vision of a user's eye and improves a cosmetic impact.

Abstract: A messaging system for audio character type swapping. Methods of audio character type swapping include receiving input audio data having a first characteristic and transforming the input audio data to an input image where the input image represents the frequencies and intensities of the audio. The methods further include processing the input image using a convolutional neural network (CNN) to generate an output image and transforming the output image to output audio data, the output audio data having a second characteristic. The input audio and output audio may include vocals. The first characteristics may indicate a male voice and the second characteristics may indicate a female voice. The CNN is trained together with another CNN that changes input audio having the second characteristic to audio having the first characteristic. The CNNs are trained using discriminator CNNs that determine whether audio has a first characteristic or a second characteristic.