Patents Assigned to Facebook Technologies, LLC
  • Patent number: 11269777
    Abstract: In one embodiment, a system may include a memory unit, a first processing unit configured to write data into a memory region of the memory unit, a second processing unit configured to read data from the memory region, a first control unit configured to control the first processing unit's access to the memory unit and, and a second control unit configured to control the second processing unit's access to the memory unit. The second control unit may be configured to obtain, from the first control unit, a first memory address associated with a data writing process of the first processing unit, receive a read request from the second processing unit, the read request having an associated second memory address, and delay execution of the read request based on a comparison of the first memory address and the second memory address.
    Type: Grant
    Filed: September 25, 2019
    Date of Patent: March 8, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Vlad Fruchter, Richard Lawrence Greene, Hideo Tamama
  • Patent number: 11269406
    Abstract: A method for calibrating eye tracking data for a head wearable optical device includes receiving eye tracking data from an imaging device oriented towards a combiner. The method includes determining a gaze direction of an eye of a user based on the eye tracking data. The method includes receiving calibration data from the imaging device that includes an indication of positions of one or more calibration indicators. The method includes determining the gaze direction based at least in part on the calibration data received from the imaging device (or factors adjusted by the calibration data).
    Type: Grant
    Filed: October 24, 2019
    Date of Patent: March 8, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Sebastian Sztuk, Karol Constantine Hatzilias, Kirk Erik Burgess, Javier San Agustin Lopez
  • Patent number: 11272137
    Abstract: This disclosure describes techniques that include modifying text associated with a sequence of images or a video sequence to thereby generate new text and overlaying the new text as captions in the video sequence. In one example, this disclosure describes a method that includes receiving a sequence of images associated with a scene occurring over a time period; receiving audio data of speech uttered during the time period; transcribing into text the audio data of the speech, wherein the text includes a sequence of original words; associating a timestamp with each of the original words during the time period; generating, responsive to input, a sequence of new words; and generating a new sequence of images by overlaying each of the new words on one or more of the images.
    Type: Grant
    Filed: February 8, 2021
    Date of Patent: March 8, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Vincent Charles Cheung, Marc Layne Hemeon, Nipun Mathur
  • Patent number: 11262650
    Abstract: Embodiments relate to a method of fabricating a nano-sized structure in a resin element by nanoimprint lithography (NIL). The method reduces adhesive failure during NIL demolding by inhibiting polymerization at the interface between the resin element and the template. The method includes depositing a layer of polymerization inhibiting compound onto a surface of the template. The layer of polymerization inhibiting compound has a thickness no more than 10 nanometers. A surface of the template has a nano-sized pattern that mirrors that nano-sized structure. The method further includes pressing the template onto the resin element (or the resin element onto the template) to form the nano-sized structure in the resin element. The process also includes curing the resin element after forming the nano-sized structure and removing the template from the resin element after curing the resin element. The polymerization inhibiting compound prevents adhesive failure during the removing.
    Type: Grant
    Filed: December 11, 2018
    Date of Patent: March 1, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Austin Lane, Tingling Rao
  • Patent number: 11265721
    Abstract: The disclosure describes artificial reality (AR) systems and techniques that enable secure, privacy-preserving device attestation and mutual authentication of multiple devices used concurrently within a multi-device AR system. For example, an AR system comprises a security server configured to generate a pairing certificate that includes information identifying a plurality of devices to be operationally paired with each other. The AR system comprises a peripheral device configured to receive one or more inputs from a user of the AR system, wherein the peripheral device is configured to store the pairing certificate in a non-volatile memory (NVM) of the peripheral device for authenticating the peripheral device and a head-mounted display (HMD) for pairing. The AR system comprises the HMD configured to output artificial reality content, wherein the HMD is configured to store the pairing certificate in a NVM of the HMD for authenticating the HMD device and the peripheral device for pairing.
    Type: Grant
    Filed: August 20, 2019
    Date of Patent: March 1, 2022
    Assignee: Facebook Technologies, LLC
    Inventor: Sudhir Satpathy
  • Patent number: 11262495
    Abstract: A manufacturing system for creating waveguides that include optical gratings having high coupling efficiencies is described herein. The waveguides are used to guide image light from a source assembly to an eye of a user. The optical gratings are used to couple light into an optical waveguide element and/or decouple light from the optical waveguide element. The manufacturing system creates optical gratings by patterning and adjusts refractive indexes of the optical gratings by infusion and post-processing. A refractive index of an optical grating can be uniform or non-uniform. In-coupling efficiencies of light into a waveguide via the optical gratings and/or out-coupling efficiencies of light out of a waveguide via the optical gratings can be increased. The manufacturing system includes a patterning system, an infusion system, and a post-processing system.
    Type: Grant
    Filed: October 4, 2018
    Date of Patent: March 1, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Matthew E. Colburn, Giuseppe Calafiore, Matthieu Charles Raoul Leibovici, Maxwell Parsons
  • Patent number: 11262644
    Abstract: The disclosed structured light projector may include (1) a light source having a light-emitting side that emits light, (2) a solid optical spacer element having a first side securely coupled to the light-emitting side of the light source, and (3) a diffractive optical element (DOE) stack including one or more DOEs, where the DOE stack includes (a) a light-receiving side securely coupled to a second side of the solid optical spacer element opposite the first side, and (b) a light-emitting side opposite the light-receiving side that emits structured light in response to the light received from the light-emitting side of the light source via the solid optical spacer element. Various other devices and methods are also disclosed.
    Type: Grant
    Filed: May 10, 2019
    Date of Patent: March 1, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Mark Sullivan, Jonatan Ginzburg
  • Patent number: 11263353
    Abstract: This disclosure describes systems on a chip (SOCs) that prevent side channel attacks (SCAs). An example SoC of this disclosure includes an engine configured to encrypt transmission (Tx) channel data using an encryption operation set configured with a first polynomial, and to decrypt encrypted received (Rx) channel data using a decryption operation set configured with a second polynomial different from the first polynomial. The SoC further includes a security processor configured to multiplex the encryption operation set against the decryption operation set with a varied sequence of selection inputs on a round-by-round basis to generate a mixed sequence of encryption rounds and decryption rounds, and to control the engine to encrypt the Tx channel data and decrypt the encrypted Rx channel data in a combined datapath according to the mixed sequence of encryption rounds and decryption rounds.
    Type: Grant
    Filed: March 30, 2020
    Date of Patent: March 1, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Sudhir Satpathy, Wojciech Stefan Powiertowski, Neeraj Upasani
  • Patent number: 11262584
    Abstract: A display device includes a display panel having a first emission region and one or more second emission regions disposed adjacent to the first emission region. The display device includes a plurality of light emitters, arranged in the first emission region, corresponding to a first color gamut and a plurality of light emitters, arranged in the one or more second emission regions, corresponding to a second color gamut that is distinct from the first color gamut. A method for making a display device with a plurality of light emitters corresponding to a first color gamut in a first emission region and a plurality of light emitters corresponding to a second color gamut in a second emission region is also described.
    Type: Grant
    Filed: October 25, 2018
    Date of Patent: March 1, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Andrew John Ouderkirk, James Hillis, Marina Zannoli, Jasmine Soria Sears, James Ronald Bonar, Gareth Valentine, Barry David Silverstein, Warren Andrew Hunt
  • Patent number: 11265532
    Abstract: A depth camera assembly (DCA) for depth sensing of a local area. The DCA includes a transmitter, a receiver, and a controller. The transmitter illuminates a local area with outgoing light in accordance with emission instructions. The transmitter includes a fine steering element and a coarse steering element. The fine steering element deflects one or more optical beams at a first deflection angle to generate one or more first order deflected scanning beams. The coarse steering element deflects the one or more first order deflected scanning beams at a second deflection angle to generate the outgoing light projected into the local area. The receiver captures one or more images of the local area including portions of the outgoing light reflected from the local area. The controller determines depth information for one or more objects in the local area based in part on the captured one or more images.
    Type: Grant
    Filed: January 9, 2020
    Date of Patent: March 1, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Michael Hall, Qing Chao, Byron Taylor, Xinqiao Liu
  • Patent number: 11262487
    Abstract: The disclosed liquid lens array may include a plurality of independently operable array sections, each of which may include (1) a transparent base layer, (2) an aperture plate overlapping the transparent base layer, the aperture plate defining a plurality of apertures extending through the aperture plate between an inner surface of the aperture plate facing the transparent base layer and an outer surface of the aperture plate, and (3) a liquid reservoir disposed between the base layer and the aperture plate. The liquid lens array may also include driving circuit for operating at least one array section of the plurality of array sections to change liquid volumes extending from the liquid reservoir at least partially through the apertures defined in the aperture plate of the at least one array section. Various other methods, systems, and devices are also disclosed.
    Type: Grant
    Filed: February 12, 2020
    Date of Patent: March 1, 2022
    Assignee: Facebook Technologies, LLC
    Inventor: Kirk Erik Burgess
  • Publication number: 20220061047
    Abstract: Disclosed herein are systems and methods related to describing slot information. In one aspect, a first wireless communication device determines a bitmap having a value for each of a plurality of slots for wireless traffic. The bitmap may indicate a status or type of a corresponding slot. The first wireless communication device may send, using a wireless local area network (WLAN) based protocol, to a second wireless communication device, a message comprising the bitmap. The message may further comprise a duration of each of the plurality of slots, a period of the plurality of slots, and a persistency of the plurality of slots.
    Type: Application
    Filed: August 9, 2021
    Publication date: February 24, 2022
    Applicant: Facebook Technologies, LLC
    Inventor: Chunyu Hu
  • Patent number: 11256336
    Abstract: Aspects of the present disclosure are for an interaction mode system that provides multiple interaction modes in an artificial reality environment with automatic, context-specific transitions between interaction modes. An interaction mode can specify how the interaction mode system determines direction indications and movement within an artificial reality environment and interactions for making selections or performing other actions. In some implementations, the interaction mode system can control at least four interaction modes including a no-hands, 3DoF mode, a no-hands, 6DoF mode, a gaze and gesture mode, and a ray casting mode. The interaction mode system can employ a mapping of interaction mode context factors (e.g., which components are enabled, mode settings, lighting or other environment conditions, current body positions, etc.) to interaction modes to control transitioning between particular interaction modes.
    Type: Grant
    Filed: June 29, 2020
    Date of Patent: February 22, 2022
    Assignee: Facebook Technologies, LLC
    Inventor: Hayden Schoen
  • Patent number: 11256086
    Abstract: An optical system includes an optical waveguide, and a first optical element configured to direct a first ray, having a first circular polarization and impinging on the first optical element at a first incidence angle, in a first direction so that the first ray propagates through the optical waveguide via total internal reflection toward a second optical element. The first optical element is configured to also direct a second ray, having a second circular polarization that is distinct from the first circular polarization and impinging on the first optical element at the first incidence angle, in a second direction that is distinct from the first direction so that the second ray propagates away from the second optical element. The second optical element is configured to direct the first ray propagating through the optical waveguide toward a detector.
    Type: Grant
    Filed: March 20, 2019
    Date of Patent: February 22, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Babak Amirsolaimani, Pasi Saarikko, Ying Geng, Yusufu Njoni Bamaxam Sulai, Scott Charles McEldowney
  • Patent number: 11256331
    Abstract: Embodiments of the present disclosure are generally directed to apparatuses, systems, and methods that utilize electroactive devices in connection with haptic devices (e.g., haptic touch sensors or haptic feedback elements). In some examples, a haptic feedback system may include an array of electroactive devices, each electroactive device including 1) a first electrode, 2) a second electrode, and 3) an electroactive polymer element disposed between the first electrode and the second electrode. The electroactive polymer element may include a nanovoided polymer material that is mechanically deformable in response to an electric field generated by a potential difference between the first electrode and the second electrode. The system may also include control circuitry electronically coupled to the array and configured to apply a voltage to at least one of the first electrode or the second electrode. Various other apparatuses, systems, and methods are also disclosed.
    Type: Grant
    Filed: June 4, 2019
    Date of Patent: February 22, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Kenneth Diest, Andrew John Ouderkirk, Renate Eva Klementine Landig, Katherine Marie Smyth, Christopher Yuan Ting Liao, Jack Lindsay
  • Patent number: 11259138
    Abstract: In one embodiment, a method for determining a dynamic head-related transfer function for a subject includes receiving audio recordings of a sound captured by audio sensors. The sound is emitted by an in-ear speaker worn by the subject. Additionally, a reference signal captured by a microphone coupled to the in-ear speaker and one or more images captured by image sensors are received. The one or more images depict a body pose of the subject while the sound is emitted by the in-ear speaker and may be used to generate a pose representation of the body pose of the subject. A head-related transfer function for each audio sensor is determined based on the pose representation, the audio recordings of the sound, and the reference signal. The dynamic head-related transfer function is determined based on the head-related transfer function for each audio sensor.
    Type: Grant
    Filed: August 14, 2020
    Date of Patent: February 22, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Nicholas Pourazima, Israel Dejene Gebru, Dejan Markovic, James White, Steven Krenn, Matthew Stewart
  • Patent number: 11257280
    Abstract: Elements in an artificial reality environment (e.g., objects or volumes) can be assigned different ray casting rules. In response to detecting a corresponding trigger, such as the user entering the volume or interacting with the object, the ray casting rules associated with that element can be implemented. Implementing the ray casting rules can control aspects of the ray such as the ray's shape, size, effects of the ray, where a ray originates, whether the ray is directed along a particular plane, or how rays are controlled. In some cases, an artificial reality system can cast multiple rays at the same time, which are controlled by the same feature of a user. Using priority rules (e.g., weighting factors, hierarchies, filters, etc.), the artificial reality system can determine which ray is primary, allowing the user to use the primary ray to interact with elements.
    Type: Grant
    Filed: May 28, 2020
    Date of Patent: February 22, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Owen Pedrotti, Gayan Ediriweera, Brandon Furtwangler
  • Patent number: 11257407
    Abstract: In one example, an apparatus comprises a backplane to attach an array of light emitting diodes (LED), the backplane comprising an array of display driver circuits, each display driver circuit of the array of display driver circuits corresponding to an LED of the array of LEDs and comprising: a current driver circuit configured to supply to a current to the corresponding LED; a control signal generator circuit configured to supply a driver control signal to the current driver circuit to control the current; and one or more monitor circuits controllable to provide access to at least one of: the current, or an internal voltage of at least one of the current driver circuit or the control signal generator circuit.
    Type: Grant
    Filed: May 29, 2020
    Date of Patent: February 22, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Ilias Pappas, Michael Yee, Ramakrishna Chilukuri, William Thomas Blank
  • Patent number: 11257275
    Abstract: In one embodiment, a system may determine a sampling location within a texture with each texel encoding first and second distance fields and first and second color indices. The system may select, based on the sampling location, a set of texels to use to determine a color for the sampling location. The system may compute first and second interpolated distance fields based on, respectively, the first and second distance fields of the set of texels. The system may select, based on the first interpolated distance field, a subset of the set of texels, and select a texel from the subset of texels based on a distance between the texel and the sampling location. The system may select, based on the second interpolated distance filed, a color index from the first and second color indices of the selected texel and use it to determine the color for the sampling location.
    Type: Grant
    Filed: September 26, 2019
    Date of Patent: February 22, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Larry Seiler, Alexander Nankervis, John Adrian Arthur Johnston
  • Patent number: D945458
    Type: Grant
    Filed: September 24, 2019
    Date of Patent: March 8, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Tomas Brennessl, Benjamin John Parfitt, Robert William Hanley