Patents Assigned to Facebook Technologies, LLC
  • Patent number: 11415880
    Abstract: A method is described for utilizing NIL materials with switchable mechanical properties. The method comprises applying an imprint mask to a nano-imprint lithography (NIL) material layer. The NIL material layer is comprised of a NIL material with a modulus level below a flexibility threshold. The NIL material layer has an internal property, that when changed, causes a change in the modulus level of the NIL material. The method further comprises detaching the imprinted NIL material layer from the imprint mask, with the low modulus level of the NIL material causing a shape of the imprinted NIL material layer to remain unchanged after detachment. A modulus level of the NIL material is increased by changing an internal property of the NIL material, with the modulus level increased beyond a strength threshold to create a first imprint layer that has a structure that remains unaffected by a subsequent process.
    Type: Grant
    Filed: January 18, 2019
    Date of Patent: August 16, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Austin Lane, Matthew E. Colburn, Giuseppe Calafiore, Nihar Ranjan Mohanty
  • Patent number: 11417054
    Abstract: In one embodiment, a method includes displaying, for one or more displays of a virtual VR device, a first output image comprising a passthrough view of a real-world environment. The method includes identifying, using one or more images captured by one or more cameras of the VR display device, a real-world object in the real-world environment. The method includes receiving a user input indicating a first dimension corresponding to the real-world object. The method includes automatically determining, based on the first dimension, a second and third dimension corresponding to the real-world object. The method includes rendering, for the one or more displays of the VR display device, a second output image of a VR environment. The VR environment includes a MR object that corresponds to the real-world object. The MR object is defined by the determined first, second, and third dimensions.
    Type: Grant
    Filed: March 17, 2021
    Date of Patent: August 16, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Christopher Richard Tanner, Amir Mesguich Havilio, Michelle Pujals, Gioacchino Noris, Alessia Marra, Nicholas Wallen
  • Patent number: 11416239
    Abstract: In one embodiment, one or more computing systems executes a computer program defining (1) a bound value that references a bound variable and (2) a terminating bound value that references computation instructions for deriving a runtime value from at least the bound value of the bound variable. A computation orchestration layer of a programming framework initializes, according to the computer program, a subscription tracker that tracks subscription relationships between the bound variable and the terminating bound value. The computation orchestration layer uses, in response to receiving an indication of an update to the bound value of the bound variable, the subscription tracker to determine that the terminating bound value subscribes to updates to the bound value of the bound variable. The computation orchestration layer sends an update stream associated with the update to a callback function associated with the terminating bound value.
    Type: Grant
    Filed: December 30, 2020
    Date of Patent: August 16, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Arthur Zwiegincew, Gwen Erick Eng Mittertreiner, Andrew William Keep
  • Patent number: 11416075
    Abstract: A wearable device equipped with sensors or transducers capable of detecting a vibration propagating through two different mediums. In some embodiments, the two mediums are air and a surface contacted by a user. In such an embodiment, the sensors or transducers include a microphone and an accelerometer. In some embodiments, the device may perform some or all of the signal processing and/or logic used to determine that a contact occurred and the location of the contact using a processor programmed with a set of computer-executable instructions. In some embodiments, the device may transmit data or signals to a processor located in a different device, such as a mobile phone or artificial reality headset, for signal processing and/or the execution of logic.
    Type: Grant
    Filed: March 25, 2020
    Date of Patent: August 16, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Jun Gong, Aakar Gupta, Hrvoje Benko
  • Patent number: 11415808
    Abstract: An example device may include a light source, an optical element, and an encapsulant layer. A light beam generated by the light source may be received by the optical element, and redirected into the encapsulant layer. The optical element may include a high-index material, for example, with a refractive index of at least approximately 1.5 at the wavelength of the light beam. The light source may be a semiconductor light source, such as a light emitting diode or a laser. The optical element may be embedded in the encapsulant layer, and the optical element may have a curved exit surface. Refraction at the exit surface of the optical element may redirect the light beam towards a target.
    Type: Grant
    Filed: December 19, 2019
    Date of Patent: August 16, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Robin Sharma, Andrew John Ouderkirk, Christopher Yuan Ting Liao, Qi Zhang, Tanya Malhotra, Karol Constantine Hatzillias, Maik Scheller, Sheng Ye, Gregory Olegovic Andreev
  • Patent number: 11416067
    Abstract: In general, this disclosure describes a suspend mode feature for artificial reality systems and, more specifically, system configurations and techniques for generating a suspend mode environment during execution of an artificial reality application, and presenting and controlling user interface (UI) elements within the suspend mode environment. The suspend mode feature enables a user interacting with one or more other users (or one or more avatars corresponding to the one or more other users) within an artificial reality (AR) environment to suspend the AR environment from the user's perspective. While in the suspend mode environment, the user is able to view and select the other users from the AR environment. For example, the user may select another user to friend, message, mute, block, or report that user from the suspend mode environment.
    Type: Grant
    Filed: September 13, 2021
    Date of Patent: August 16, 2022
    Assignee: FACEBOOK TECHNOLOGIES, LLC
    Inventors: Arthur Bodolec, Jing Shu, Lindsay Young, Melissa Erin Summers, Andrea Zeller, Seohyun Lee, Ayfer Gokalp
  • Patent number: 11410272
    Abstract: In one embodiment, a computing system may determine, for a current frame to be displayed and using an eye tracking system, a current eye position of a viewer. The system may determine a first array of scaling factors based on the determined current eye position of the viewer. The system may retrieve one or more second arrays of scaling factors used for correcting one or more proceeding frames of the current frame. The system may determine a third array of scaling factors based on the first array of scaling factors determined based on the current eye position and the one or more second arrays of scaling factors used for correcting the proceeding frames. The system may adjust pixel values of the current frame based at least on the third array of scaling factors. The system may output the current frame with the adjusted pixel values to a display.
    Type: Grant
    Filed: July 1, 2020
    Date of Patent: August 9, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Thomas Scott Murdison, Romain Bachy, Edward Buckley, Bo Zhang
  • Patent number: 11409671
    Abstract: This disclosure describes various examples of a system which uses a multi-bank, multi-port shared memory system that may be implemented as part of a system on a chip. The shared memory system may have particular applicability in the context of an artificial reality system, and may be designed to have distributed or varied latency for one or more memory banks and/or one or more components or subsystems within the system on a chip. The described shared memory system may be logically a single entity, but physically may have multiple memory banks, each accessible by any of a number of components or subsystems. In some examples, the memory system may enable concurrent, common, and/or shared access to memory without requiring, in some situations, full locking or arbitration.
    Type: Grant
    Filed: December 19, 2019
    Date of Patent: August 9, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Alok Kumar Mathur, Ennio Salemi, Drew Eric Wingard, Valerio Catalano
  • Patent number: 11407211
    Abstract: In some examples, a method includes forming a material layer on a substrate, partially polymerizing a component of the material layer, to form fluid-filled droplets within a partially polymerized matrix, deforming the material layer to form anisotropic fluid-filled droplets, and further polymerizing the partially polymerized matrix to form an anisotropic voided polymer, including anisotropic voids in a polymer matrix. The anisotropic voids may include anisotropic nanovoids. Example methods may further include depositing electrodes on the anisotropic voided polymer so that at least a portion of the anisotropic voided polymer is located between the electrodes. Examples may include forming electroactive elements including an anisotropic nanovoided polymer, and devices (such as sensors and/or actuators) including electroactive elements.
    Type: Grant
    Filed: October 31, 2019
    Date of Patent: August 9, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Renate Eva Klementine Landig, Kenneth Diest, Sheng Ye, Andrew John Ouderkirk
  • Patent number: 11409143
    Abstract: In some examples, a device includes a multilayer structure, a first electrode, and a second electrode, where the multilayer structure is located at least in part between the first electrode and the second electrode, and the multilayer structure includes a nanovoided polymer layer, and a solid layer. The solid layer may include a non-nanovoided layer. The nanovoided polymer layer may be an electroactive layer. The device may further include a control circuit configured to apply an electrical potential between the first electrode and the second electrode, which may induce a mechanical deformation of the multilayer.
    Type: Grant
    Filed: April 16, 2019
    Date of Patent: August 9, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Renate Eva Klementine Landig, Kenneth Diest, Andrew John Ouderkirk
  • Patent number: 11412511
    Abstract: Disclosed herein are a system, a method and a device for switching between different communications protocols. A head wearable display can transmit, to a console during a first session interval, a first request to switch from a first link using a first communication protocol to a second link using a second communication protocol. The first request can include at least one characteristic of the first link. The head wearable display can receive, from the console, a first response to the first request, to perform a switch from the first link to the second link. The first response can indicate a wake up time and a second session interval to perform the switch. The head wearable display can switch from the first link to the second link in the second session interval and after the wake up time.
    Type: Grant
    Filed: May 5, 2020
    Date of Patent: August 9, 2022
    Assignee: FACEBOOK TECHNOLOGIES, LLC
    Inventors: Gang Lu, Nihar Doshi, Jiwon Steve Han, Xiaoguang Wang, Dong Zheng, Chunyu Hu, Qi Qu
  • Patent number: 11412050
    Abstract: In general, the disclosure describes techniques for wireless communications between multiple devices of an artificial reality system using virtual channels. In one example, a first computing device of a multi-device system, comprising: one or more first processors coupled to one or more memory devices; and a supervisory processor configured to establish a plurality of virtual channels over a physical wireless channel between the first computing device and a second computing device, wherein each of the virtual channels is associated with a different pair of processors comprising a source processor selected from one of the first processors or second processors of the second computing device and a destination processor selected from one of the first processors or the second processors, wherein, for each virtual channel and associated pair of processors, the source processor is configured to communicate application data with the destination processor using the virtual channel.
    Type: Grant
    Filed: February 13, 2020
    Date of Patent: August 9, 2022
    Assignee: FACEBOOK TECHNOLOGIES, LLC
    Inventors: Alok Kumar Mathur, Gang Lu
  • Patent number: 11409364
    Abstract: Disclosed herein are related to a system and a method for controlling a virtual reality based on a physical object. In one aspect, a shape of a hand of a user corresponding to a surface or a structure of a physical object is detected. In one aspect, according to the detected shape of the hand, an interactive feature for the surface or the structure of the physical object is generated in a virtual reality or augmented reality application. In one aspect, a user interaction with the interactive feature is detected. In one aspect, an action of the virtual reality or augmented reality application is initiated, in response to detecting the user interaction with the interactive feature.
    Type: Grant
    Filed: June 4, 2020
    Date of Patent: August 9, 2022
    Assignee: FACEBOOK TECHNOLOGIES, LLC
    Inventors: Qian Zhou, Kenrick Cheng-Kuo Kin
  • Patent number: 11410331
    Abstract: A method for using a virtual camera location to display image data to one device from another device associated with a plurality of cameras. The method includes receiving image data from a plurality of cameras associated with a second user device associated with a second user. The method further includes establishing a virtual camera location different from positions of the plurality of cameras. The method further includes providing an image using the image data on a first user display of a first user device based at least on a viewpoint of the virtual camera location.
    Type: Grant
    Filed: December 3, 2019
    Date of Patent: August 9, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Ronit Kassis, Brian Keith Cabral, Michael F. Cohen
  • Patent number: 11409405
    Abstract: Aspects of the present disclosure are directed to an artificial reality system orchestrating interactions between virtual object “augments.” The orchestration can include linking, which can be forming two or more augments into a combination, embedding an augment within an existing combination, or triggering an action mapped to the linking of those augments. Another type of orchestration can include extracting, which can refer to taking an augment out of an existing combination, either by removing it from the combination or copying the augment to leave a version in the combination and having another version outside the combination.
    Type: Grant
    Filed: December 22, 2020
    Date of Patent: August 9, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Michal Hlavac, Benjamin Taylor Koga-Winn, Wai Leong Chak, Jasper Stevens, Alexander Michael Louie
  • Patent number: 11410580
    Abstract: In one embodiment, a computing system may access a first mask associated with a first color component and a first pixel in an image, and a second mask associated with a second color component and a second pixel in the image. The system may access first component values of the first color component in a first pixel region containing the first pixel, and second component values of the second color component in a second pixel region containing the second pixel. The system may modify the first component values using the first mask, and the second component values using the second mask. The system may cause the modified first and second component values to be displayed by light-emitting elements of the first and second color components. The first and second masks may be generated based on relative positions of the first light-emitting elements and the second light-emitting elements.
    Type: Grant
    Filed: August 20, 2020
    Date of Patent: August 9, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Edward Buckley, Michael Yee
  • Patent number: 11410387
    Abstract: In one embodiment for generating passthrough, a computing system may access images of an environment captured by cameras of a device worn by a user. The system may generate, based on the images, depth measurements of objects in the environment. The system may generate a mesh covering a field of view of the user and then update the mesh based on the depth measurements to represent a contour of the objects in the environment. The system may determine a first viewpoint of a first eye of the user and render a first output image based on the first viewpoint and the updated mesh. The system may then display the first output image on a first display of the device, the first display being configured to be viewed by the first eye of the user.
    Type: Grant
    Filed: January 17, 2020
    Date of Patent: August 9, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Matthew James Alderman, Gaurav Chaurasia, Paul Timothy Furgale, Lingwen Gan, Alexander Sorkine Hornung, Alexandru-Eugen Ichim, Arthur Nieuwoudt, Jan Oberländer, Gian Diego Tipaldi
  • Patent number: 11402964
    Abstract: Methods and systems for integrating functionality of XR devices and non-XR devices are disclosed herein. An XR device can identify and obtain one or more content items being displayed on non-XR devices and create virtual objects associated with the content item in an artificial reality environment of the XR device. A user of the XR device can interact with the virtual objects, such as by moving the virtual objects to new locations within the artificial reality environment or interact with the virtual objects to view the content items. The user of the XR device can also provide one or more gestures or commands to send content items or identifiers of content items associated with the virtual objects to non-XR devices for display at the non-XR devices.
    Type: Grant
    Filed: February 8, 2021
    Date of Patent: August 2, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Jasper Stevens, Alexander Michael Louie, Michal Hlavac, Benjamin Taylor Koga-Winn, Wai Leong Chak
  • Patent number: 11403810
    Abstract: In one embodiment, a method includes accessing one or more surfaces of an artificial reality scene. The one or more surfaces are generated based on one or more images of the artificial reality scene rendered at a first rate and based on a first viewing position. The method includes generating subframes at a second rate higher than the first rate. Each of the subframes is generated by determining a second viewing position, determining a visibility of the one or more surfaces of the artificial reality scene from the second viewing position, generating, based on the determined visibility of the one or more surfaces, color values of the subframe corresponding to output positions of a display, and providing the color values of the subframe for display.
    Type: Grant
    Filed: September 27, 2019
    Date of Patent: August 2, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Larry Seiler, Alexander Nankervis, Warren Andrew Hunt
  • Patent number: D960160
    Type: Grant
    Filed: December 7, 2021
    Date of Patent: August 9, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Peter Wesley Bristol, Yi-yaun Chen, Mauricio Romano, Peter Allan Chase Newbury