Patents Examined by Antonio Caschera
  • Patent number: 11216988
    Abstract: A system and method implement deep learning on a mobile device to provide a convolutional neural network (CNN) for real time processing of video, for example, to color hair. Images are processed using the CNN to define a respective hair matte of hair pixels. The respective object mattes may be used to determine which pixels to adjust when adjusting pixel values such as to change color, lighting, texture, etc. The CNN may comprise a (pre-trained) network for image classification adapted to produce the segmentation mask. The CNN may be trained for image segmentation (e.g. using coarse segmentation data) to minimize a mask-image gradient consistency loss. The CNN may further use skip connections between corresponding layers of an encoder stage and a decoder stage where shallower layers in the encoder, which contain high-res but weak features are combined with low resolution but powerful features from deeper decoder layers.
    Type: Grant
    Filed: October 24, 2018
    Date of Patent: January 4, 2022
    Assignee: L'OREAL
    Inventors: Alex Levinshtein, Cheng Chang, Edmund Phung, Irina Kezele, Wenzhangzhi Guo, Eric Elmoznino, Ruowei Jiang, Parham Aarabi
  • Patent number: 11216943
    Abstract: The invention relates to a method for producing a two-dimensional whole image of a recording region captured by means of a plurality of individual images, each having its own viewing direction and its own distance, wherein a spatial orientation of a main image plane of each individual image relative to a main image plane of the respective further individual image is determined on the basis of an overlap of the respectively captured subregions, and at least a plurality of the individual images are combined in accordance with the spatial orientations to form the whole image. The whole image area is the surface of a torus.
    Type: Grant
    Filed: June 20, 2018
    Date of Patent: January 4, 2022
    Assignee: DENTSPLY SIRONA INC.
    Inventors: Anders Adamson, Markus Erbacher, Steffen Hauth, Björn Voss
  • Patent number: 11211030
    Abstract: An electronic device may include a display that displays virtual reality content. Control circuitry may estimate a brightness adaptation state of a user that is wearing the electronic device. The control circuitry may select a tone mapping curve and brightness level for the virtual reality content based on the user's adaptation state. To estimate the user's adaptation state, the control circuitry may gather ambient light information from an ambient light sensor, may gather physiological attributes of the user such as blink rate, pupil size, and eye openness from a camera, and may gather gaze position information from gaze detection circuitry. The control circuitry may optimize the brightness of the display based on the user's current adaptation state, or the control circuitry may shift the brightness of the display away from the user's adaptation level to help guide the adaptation state to the desired level.
    Type: Grant
    Filed: August 27, 2018
    Date of Patent: December 28, 2021
    Assignee: Apple Inc.
    Inventors: Nicolas P. Bonnier, Teun R. Baar, Christina G. Gambacorta, Jiaying Wu
  • Patent number: 11205398
    Abstract: A system includes a full-color electronic display, an eye-tracking module arranged to track an eye of a viewer of the display during operation of the system, at least one programmable processor, and a machine-readable medium storing instructions that, when executed by the at least one programmable processor to perform operations, including: (i) assessing uncorrected image data with one or more image frames, including determining an initial color of pixels in an image frame; (ii) assessing, based on data from the eye-tracking module, a location on the display where the viewer's eye is looking; (iii) modifying a color of red pixels from its initial color to a modified red color based on the location of the pixel relative to the location on the display where the viewer's eye is looking and the initial color of the pixel; and (iv) displaying, on the display, the image frames in which the one or more pixels have the modified color and other pixels have their initial color.
    Type: Grant
    Filed: February 24, 2020
    Date of Patent: December 21, 2021
    Assignee: WaveShift LLC
    Inventors: Michael Benjamin Selkowe Fertik, Thomas W. Chalberg, Jr.
  • Patent number: 11205404
    Abstract: An electronic device including a display, a memory, and a processor operatively connected to the display and the memory. The processor may be configured to: display a partial image, corresponding to a view area to be watched, in an omnidirectional image stored in the memory, on the display; select a display attribute on the basis of the distance between the view area and an area of interest in the omnidirectional image; and display additional information associated with the area of interest, on the display on the basis of the selected display attribute. Various other embodiments found through the specification are also possible.
    Type: Grant
    Filed: February 14, 2019
    Date of Patent: December 21, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Gounyoung Kim, Heejung Jung, Soonyeon Choi, Youngkyoo Kim
  • Patent number: 11200870
    Abstract: A calibration set is stored on a storage device, including a plurality of temperatures and a plurality of homography transformation matrices, each respective homography transformation matrix being for a respective temperature. A temperature is detected. A respective one of the homography transformation matrices is selected for a temperature matching the temperature. A geometric change is calculated based on the selected homography relationship. Data representing local content is received. A rendering of the local content is generated based on the geometric change and displayed to a user.
    Type: Grant
    Filed: September 28, 2020
    Date of Patent: December 14, 2021
    Assignee: Magic Leap, Inc.
    Inventor: Lei Zhang
  • Patent number: 11199452
    Abstract: A process for determining a tooth color of a filling or another restoration is provided which in particular is produced using composite materials, wherein at least one tooth is scanned or is visually detected. The process is characterized in that natural teeth are spectrally measured in advance, that the color values measured within a color space are classified into several, in particular four, categories which each form a color cloud extending in a three-dimensional fashion within the color space, which is done with the help of a structuring algorithm, in particular a Nearest Neighbour Algorithm, or a symmetry recognition algorithm, and that the tooth color of the filling is determined by means of evaluating to which category the tooth scanned has the smallest color distance, or to which color cloud the tooth scanned belongs.
    Type: Grant
    Filed: October 7, 2019
    Date of Patent: December 14, 2021
    Assignee: Ivoclar Vivadent AG
    Inventors: Stefan Lerch, José Antonio Pulido Estepa
  • Patent number: 11176722
    Abstract: This disclosure is directed to a method of composing an animation scene in a computer-generated animation. The method includes receiving a user input requesting to perform an operation on at least one computer-generated asset in the animation scene. The method also includes determining, based on the user input, a type of operation and at least one attribute associated with the at least one computer-generated asset in the animation scene. The method further includes, in accordance with the determination of the type of operation and the at least one attribute, processing representations of one or more instances of the at least one computer-generated asset; and projecting the processed representations of the one or more instances of the at least one computer-generated asset onto the animation scene to perform the operation. The method further includes generating metadata associated with the manipulated representations of the one or more instances of the at least one computer-generated asset.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: November 16, 2021
    Assignee: DreamWorks Animation L.L.C.
    Inventor: Brian R. Walters
  • Patent number: 11170559
    Abstract: A computer device includes a processor configured to simulate a virtual environment based on a set of virtual environment parameters, and perform ray tracing to render a view of the simulated virtual environment. The ray tracing includes generating a plurality of rays for one or more pixels of the rendered view of the simulated virtual environment. The processor is further configured to determine sub-pixel data for each of the plurality of rays based on intersections between the plurality of rays and the simulated virtual environment, and store the determined sub-pixel data for each of the plurality of rays in an image file.
    Type: Grant
    Filed: August 2, 2019
    Date of Patent: November 9, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Pedro Urbina Escos, Dimitrios Lymberopoulos, Di Wang, Emanuel Shalev
  • Patent number: 11158129
    Abstract: An augmented reality display system can include a partially transparent eyepiece, an ambient light sensor, and an image input device. The image input device can include a light source and a spatial light modulator. The system can also include a controller that determines that no virtual content is being displayed to the user and compares the ambient light to display light to determine if a light source shutoff criterion is satisfied. The light source shutoff criterion can be indicative of whether shutting off the light source that illuminates the spatial light modulator will result in a change in the display light that will be user-perceptible. If the light source shutoff criterion is satisfied, the controller can turn off the light source.
    Type: Grant
    Filed: July 23, 2019
    Date of Patent: October 26, 2021
    Assignee: Magic Leap, Inc.
    Inventors: Arno Leon Konings, Mihailo Slobodan Zivkovic, Jose Felix Rodriguez, Ricardo Martinez Perez
  • Patent number: 11137851
    Abstract: A luminescence shock avoidance algorithm selectively limits the brightness level of a display device when the display device is activated in a dark environment to prevent the temporary vision impairment that can occur when a display device is activated in a dark environment. The algorithm receives the state of the display (e.g. on or in standby mode), and can optionally receive an ambient lighting value from an ambient light sensor and a user-selectable manual brightness adjustment setting to determine whether luminescence shock avoidance should even be triggered, and if it is triggered, how much should the brightness level of the display be limited.
    Type: Grant
    Filed: May 18, 2020
    Date of Patent: October 5, 2021
    Assignee: Apple Inc.
    Inventor: Kai Achim Pantfoerder
  • Patent number: 11138690
    Abstract: A multi-image brick mosaic depicting a plurality of images each from a different viewing angle and systems and methods for building it. The multi-image brick mosaic includes a plurality of interlocking bricks assembled on baseplate(s) where the interlocking bricks are divided to multiple brick sets each associated with a respective one of multiple images. The top facet of the interlocking bricks of each group are aligned to a respective one of multiple angles. Instructions are computed for selecting the color of the top facet of each interlocking brick based on color analysis of a respective pixel group of a respective image mapped by the respective interlocking brick. Further instructions are computed for assembly of the interlocking bricks on the baseplates(s) to form the multi-image brick mosaic depicting multiple pixelated versions of the images, each pixelated image is clearly viewable from a respective one of the angles.
    Type: Grant
    Filed: December 8, 2020
    Date of Patent: October 5, 2021
    Assignee: Photobrick Pty. Ltd.
    Inventors: Amir Malka, Eyal Israel
  • Patent number: 11132053
    Abstract: In one implementation, a method includes: displaying simulated reality (SR) content; determining whether an object in a physical environment satisfies one or more interaction criteria; and changing display of the SR content from a first view to a second view, in response to determining that the object in the physical environment satisfies the one or more interaction criteria, wherein, in the first view, the object in the physical environment is occluded by the SR content, and wherein the second view reduces occlusion of the object in the physical environment by the SR content.
    Type: Grant
    Filed: September 27, 2018
    Date of Patent: September 28, 2021
    Assignee: APPLE INC.
    Inventor: Yohan Rajan
  • Patent number: 11106240
    Abstract: A dual display housing information handling system and method comprising a first display screen side having a first portion of a display screen, a second display screen side, hinged to the first display screen side, having a second portion, and a second display screen side RGB detector to activate and the first display to test flash and a first display screen side RGB detector to activate and the second display to test flash. A controller to determine operating color temperature shift for comparison to detect burn-in differences from color temperature readings by the first display screen side RGB detector and the second display screen side RGB detector, and if a threshold difference detected, the controller implementing display color shift management to provide adjusted color mapping data to adjust at least one color component of the first or second display screen side to balance the operating color temperatures.
    Type: Grant
    Filed: August 17, 2020
    Date of Patent: August 31, 2021
    Assignee: Dell Products, LP
    Inventors: Deeder M. Aurongzeb, Lawrence E. Knepper
  • Patent number: 11100887
    Abstract: A relay apparatus for coupling a head-mounted display apparatus to a first external device includes a substrate, a first cable including a plurality of first thin wires, the first cable extending in a first direction and a second cable extending in a direction opposite the first direction. In the relay apparatus, the substrate includes a first surface, a second surface on a backside of the first surface, a first coupling portion to which the plurality of first thin wires are coupled, and a second coupling portion to which the second cable is coupled, the first coupling portion includes a first connector that is located on the first surface and to which a subset of the plurality of first thin wires is coupled, and a second connector that is located on the second surface and to which another subset of the plurality of first thin wires is coupled.
    Type: Grant
    Filed: September 26, 2019
    Date of Patent: August 24, 2021
    Assignee: SEIKO EPSON CORPORATION
    Inventors: Yoshihiro Yoshimura, Takeshi Fujishiro
  • Patent number: 11094286
    Abstract: An image processing apparatus for generating data of an image and outputting the generated data to a display device, includes a meta data acquiring unit configured to acquire meta data used for a correcting process for correcting the image in the display device, a corrector configured to perform at least part of the correcting process on the image, using the meta data, and an image output unit configured to acquire data of the corrected image from the corrector and output the acquired data to the display device.
    Type: Grant
    Filed: November 9, 2018
    Date of Patent: August 17, 2021
    Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
    Inventors: Kenichiro Yokota, Hiroshi Mikami
  • Patent number: 11087600
    Abstract: A display control method including selecting an indicator image corresponding to a display attribute which is set for a display area, and performing display control for displaying each alarm corresponding to the display attribute among alarms generated in a plant and also displaying the selected indicator image collectively in the display area.
    Type: Grant
    Filed: May 13, 2020
    Date of Patent: August 10, 2021
    Assignee: Yokogawa Electric Corporation
    Inventors: Ayako Kono, Yuya Iketsuki, Naotaka Nogawa, Motoichi Kuwatani
  • Patent number: 11086580
    Abstract: A method for checking a validity of image data, in which the image data is assigned to a display device. The image data are classified into at least two groups as a function of a color value of the image data and/or of a brightness value of the image data, a test value being ascertained from the image data of the at least one group for the respective group. The ascertained test value of a group is compared with a predefined test value of the respective group. A validity of the image data is established when the ascertained test value of the respective group and the predefined test value of the respective group coincide. An invalidity of the image data is established when the ascertained test value of the respective group and the predefined test value of the respective group do not coincide.
    Type: Grant
    Filed: November 8, 2017
    Date of Patent: August 10, 2021
    Assignee: Robert Bosch GmbH
    Inventor: Siegfried Hodri
  • Patent number: 11069122
    Abstract: Images of various views of objects can be captured. An object mesh structure can be created based at least in part on the object images. The object mesh structure represents the three-dimensional shape of the object and includes a mesh with mesh elements. The mesh elements are assigned views first from a subset of views to texture large contiguous portions of the object from relatively few views. Portions that are not textured from the subset views are textured using the full set of views, such that all mesh elements are assigned views. The views first assigned from the subset of views and the views then assigned from the full plurality of views can be packaged into a texture atlas. These texture atlas views can be packaged with mapping data to map the texture atlas views to their corresponding mesh elements. The texture atlas and the object mesh structure can be sent to a client device to render a representation of the object.
    Type: Grant
    Filed: November 27, 2019
    Date of Patent: July 20, 2021
    Assignee: A9.com, Inc.
    Inventors: Tomas Francisco Yago Vicente, Radek Grzeszcsuk, Arnab Sanat Kumar Dhua
  • Patent number: 11069095
    Abstract: A sample mask is used to control which samples are used in a filtering operation such as bilinear filtering. A conventional filtering operation reads a set of samples based on a single coordinate and combines the samples to produce a filtered sample value. Such filtering operations are performed conventionally using fixed function units designed specifically to perform such filtering operations. However, for some applications, excluding one or more of the samples in producing a filtered sample value is desirable. In other applications, combining the samples using different weighting factors is also desirable. Techniques are disclosed herein for extending the capabilities of existing filtering units, for example, to exclude one or more samples in the filtering operation and for specifying different weighting rules for combining the samples.
    Type: Grant
    Filed: June 2, 2020
    Date of Patent: July 20, 2021
    Assignee: NVIDIA Corporation
    Inventor: Evgenii Makarov