Abstract: Exemplary embodiments relate to uses of face detection in video, and especially in video calls. In some embodiments, face detection may be used to center a camera shot by maintaining a face in the center of a screen. The centering may be applied selectively, such as by overriding centering if the user is looking off-screen. The video may also be cropped to better fit a face in a screen, or to allow multiple faces to appear on screen. In some embodiments, emphasizing the face over the background (or parts of the face over the whole face) allows for improvement in video call performance. Moreover, these techniques can be used to bring certain areas of a camera shot into focus while de-emphasizing the background (or vice versa).
Type:
Grant
Filed:
April 15, 2019
Date of Patent:
December 15, 2020
Assignee:
FACEBOOK, INC.
Inventors:
Stephane Taine, Brendan Benjamin Aronoff, Jason Clark
Abstract: Techniques to response to respond to user requests using natural-language machine learning based on branching example conversations are described.
Type:
Grant
Filed:
December 27, 2016
Date of Patent:
December 15, 2020
Assignee:
FACEBOOK, INC.
Inventors:
Martin Jean Raison, Willy Blandin, Andreea-Loredana Crisan, Stepan Parunashvili, Kemal El Moujahid, Laurent Nicolas Landowski
Abstract: An example device may include an electronic display configured to generate an augmented reality image element and an optical combiner configured to receive the augmented reality image element along with ambient light from outside the device. The optical combiner may be configured to provide an augmented reality image having the augmented reality image element located within a portion of an ambient image formed from the ambient light. The device may also include a dimmer element configured to selectively dim the portion of the ambient image in which the augmented reality image element is located.
Type:
Grant
Filed:
July 3, 2019
Date of Patent:
December 15, 2020
Assignee:
Facebook Technologies, LLC
Inventors:
Jasmine Soria Sears, Alireza Moheghi, Oleg Yaroshchuk, Douglas Robert Lanman, Andrew Maimone, Kavitha Ratnam, Nathan Matsuda
Abstract: In some embodiments, an electroactive device includes a first electrode, a second electrode, and an electroactive element disposed between the first electrode and the second electrode. The electroactive element may include a plurality of voids distributed within the electroactive element. The electroactive device may have a non-uniform electroactive response based at least in part on a non-uniform distribution of voids within the electroactive element. The non-uniform electroactive response may include a non-uniform sensor response or a non-uniform actuation response. Various other methods, systems, apparatuses, and materials are also disclosed.
Type:
Grant
Filed:
November 21, 2018
Date of Patent:
December 8, 2020
Assignee:
Facebook Technologies, LLC
Inventors:
Yigit Menguc, Andrew John Ouderkirk, Christopher Yuan Ting Liao, Katherine Marie Smyth, Thomas Wallin, Jack Lindsay, Austin Lane, Tanya Malhotra, Ken Diest
Abstract: In one embodiment, a computing system may configure a first memory to store image data to be adjusted based on a user viewpoint. The system may configure a first processing module to generate adjusted image data based on a resampling process using a surface associated with the image data, the image data, and the user viewpoint. The system may configure a second processing module to generate adjusted image data by applying a transformation to the image data. The system may configure a controller to cause a number of second images to be generated at a second frame rate based on a first image stored in the first memory and generated at a first frame rate lower than the second frame rate. One or more of the second images may be selectively generated using (1) the first processing module or (2) the second processing module based on one or more criteria.
Abstract: An online system receives information describing actions performed by online system users, in which the information describes an actual physical location at which each action was performed. The online system retrieves user attributes associated with each user and trains a machine-learning model to predict a physical location of a user based on the information received at the online system and the user attributes. The online system receives information describing a geographic location (e.g., GPS coordinates) from a client device associated with a viewing user of the online system and identifies candidate physical locations within a threshold distance of the geographic location. The online system then uses the trained model to predict a physical location of the viewing user from the candidate physical locations based on user attributes associated with the viewing user and presents content to the viewing user based on the predicted physical location.
Abstract: Systems described herein use outside-in positional tracking. A base station emits one or more rotational light beams to illuminate a local area. The rotational light beams rotate around a rotation axis and are used for positional tracking one or more objects in the local area. The one or more rotational light beams retroreflect from the one or more objects in the local area. The one or more objects include retroreflectors that retroreflect light beams incident on them. The base station detects the retroreflected light beams. The base station generates illumination data in response to the detected light beams. A system analyzes the illumination to determine an orientation and/or a location of an object.
Type:
Grant
Filed:
December 22, 2017
Date of Patent:
December 8, 2020
Assignee:
Facebook Technologies, LLC
Inventors:
David Maurice Moore, Evan Paul Gander, Jason Victor Tsai, Zhaoming Zhu, Richard Andrew Newcombe, Renzo De Nardi, Nicholas Daniel Trail
Abstract: A backplate for a head-mounted display (HMD) is disclosed. The backplate provides structural support as well as thermal cooling for components coupled to the backplate. The backplate includes a plurality of mounting regions that are used to couple components to the backplate. The mounting regions may include camera mounting regions (e.g., for inside-out tracking), an inertial measurement unit (IMU) mounting region, circuit board mounting regions, heat pipe mounting region, and a fan mounting region. The mounting regions may be specific to the component. In various embodiments, the backplate is a single diecast metal plate that includes the mounting regions designed to provide certain levels of thermal management, stiffness, and conductivity (e.g., ground) for the HMD.
Abstract: Methods and apparatus for use in the manufacture of a display element. Some embodiments include a method for selective pick up of a subset of a plurality of electronic devices adhered to a handle layer. The method comprises modifying a level of adhesion between one or more electronic devices of the plurality of electronic devices adhered to the handle layer, such that the subset of the plurality of electronic devices has a level of adhesion to the handle layer that is less than a force applied by a pick up tool, PUT. This enables selective pick up of the subset of the plurality of electronic devices from the handle layer by the PUT.
Type:
Grant
Filed:
July 3, 2018
Date of Patent:
December 8, 2020
Assignee:
Facebook Technologies, LLC
Inventors:
Allan Pourchet, William Padraic Henry, Patrick Joseph Hughes, Joseph O'Keeffe
Abstract: A laser light is used to modify the surface of the gallium semiconductor layer of an LED. The parameters of the laser are selected so that the laser interacts with the gallium semiconductor layer in a desired manner to yield the desired surface properties. For example, if a particular surface roughness is desired, the power of the laser light is selected so that the laser light penetrates the gallium semiconductor layer to a depth matching the desired surface roughness. The same principles can also be applied in a process that creates features such as trenches, pits, lenses, and mirrors on the gallium semiconductor layer of an LED. The laser projector is operated to irradiate a region of the gallium semiconductor layer to create a region of metallic gallium. The desired surface roughness and the different features can advantageously improve the beam collimation, light extraction, and other properties of the LED.
Abstract: An online system provides a virtual world including a plurality of locations spatially distributed throughout the virtual world. The online system receives sponsorship requests for generating locations in the virtual world associated with one or more advertisers. A sponsorship request identifies a position in the virtual world for presenting the location and a bid amount specifying an amount of compensation to the online system for presenting the location at the position in the virtual world. When an opportunity to present a location at a position in the virtual world to a user is identified, the online system selects a location from the received sponsorship request for presentation at the position based at least in part on the bid amounts of the sponsorship requests.
Abstract: A first instance of a messenger application having a plug-in communicates with a second instance of the messenger application lacking the plug-in. The plug-in provides enhanced functionality to the first instance of the messenger application, while also providing corresponding functionality to the second instance, which lacks the plug-in. For example, the plug-in may provide rich, non-thread-native content to the first instance, while also providing corresponding thread-native content to the second instance. As another example, the plug-in may obtain data from the second instance and provide tailored advertisements to the second instance based upon that data. An another example, the plug-in may obtain location data from one or more of the instances and provide access to location-specific services that take the location data into account.
Type:
Grant
Filed:
April 4, 2019
Date of Patent:
December 8, 2020
Assignee:
Facebook, Inc.
Inventors:
Jason Duane Clark, Benjamin Kyle Padget, Christopher Jon Lang
Abstract: A virtual-reality device includes a data generator, one or more processors, two or more gamma bands, and a display. The virtual-reality device generates initial color values for each of the plurality of pixels, and determines a respective gray-level value for each of the pixels according to the generated color values. The device selects, for each of the pixels, a respective gamma band corresponding to the determined respective gray-level value and one or more respective contextual markers, where each gamma band has a distinct luminance target. The virtual-reality device then adjusts the luminance level of each pixel according to the respective selected gamma band and displays the pixels according to the adjusted luminance levels.
Abstract: There is herein described a low power consumption high brightness display. More particularly, there is described an integrated LED micro-display and a method of manufacturing the integrated LED micro-display.
Type:
Grant
Filed:
June 14, 2019
Date of Patent:
December 8, 2020
Assignee:
Facebook Technologies, LLC
Inventors:
James Ronald Bonar, Gareth John Valentine, Stephen Warren Gorton
Abstract: A head-mounted display (HMD) includes an optics block and an electronic display. A varifocal actuation block included in the HMD adjusts a location of an image plane by adjusting a position of the optics block or the electronic display. Responsive to the varifocal actuation block being powered down or a determination that the HMD is not being worn, the varifocal actuation block changes focus of light directed towards the electronic display by the optics block so the light is not focused on the electronic display. For example, the varifocal actuation block maximizes defocusing of light on the electronic display by the optics block. Additionally, when the HMD is powered on, the varifocal actuation block may also reposition the optics block and the electronic display relative to other so light directed towards the electronic display by the optics block illuminates different areas of the electronic display at different times.
Type:
Grant
Filed:
May 29, 2018
Date of Patent:
December 8, 2020
Assignee:
Facebook Technologies, LLC
Inventors:
Douglas Robert Lanman, Brian Wheelwright
Abstract: Disclosed herein are display systems and techniques for operating a display in a display system. An output image is formed by scanning a column of light emitters such that emitters in different rows of the column contribute to a same location in the output image. The emitters are driven using pulse-width modulation (PWM). PWM pulses are applied in synchronization with the scanning to cause emitters to emit light at an intensity corresponding to an illumination parameter. The driving includes generating, based on an illumination parameter, a PWM pulse by applying an analog signal in combination with applying a digital signal. The analog signal controls an amplitude of the PWM pulse. The digital signal controls a duration of the PWM pulse.
Type:
Grant
Filed:
May 13, 2019
Date of Patent:
December 8, 2020
Assignee:
FACEBOOK TECHNOLOGIES, LLC
Inventors:
Mark Alan Horowitz, Ilias Pappas, Edward Buckley, William Thomas Blank
Abstract: A head-mounted display (HMD) includes a dichroic element, an eye tracking system, a controller, and an external focus camera. The dichroic element is transmissive to the light in a first optical band (e.g., visible light) but reflective to light in a second optical band (e.g., IR light). The eye tracking system includes a source assembly and a tracking camera. The source assembly projects light in the second optical band into an eyebox of the HMD. The tracking camera captures images of at least a portion of a user's eye in the eyebox. The controller of the HMD determines a gaze direction of the user based on the captured images. An orientation of the external focus camera corresponds to the gaze direction. The external focus camera captures image data of a portion of a local area surrounding the HMD at the orientation.
Abstract: Systems, methods, and non-transitory computer-readable media can identify a set of video segments that represents a video. A subset of video segments can be selected out of the set of video segments. A list that indicates a playback sequence for the subset of video segments can be generated. Playback of the subset of video segments can be provided based on the playback sequence indicated via the list.