Patents Examined by Chong Wu
  • Patent number: 11514553
    Abstract: There is provided an image processing device for observing an inside of an eye in a wider range. The image processing device includes an integration processing unit that integrates ophthalmologic images acquired by a plurality of types of ophthalmologic image capturing devices by correlating intraocular positions and generates one integrated image indicating intraocular information in a range wider than a range indicated by each of the ophthalmologic images.
    Type: Grant
    Filed: March 28, 2019
    Date of Patent: November 29, 2022
    Assignee: SONY CORPORATION
    Inventor: Tomoyuki Ootsuki
  • Patent number: 11512956
    Abstract: An augmented-reality system is combined with a surveying system to make measurement and/or layout at a construction site more efficient. A reflector can be mounted to a wearable device having an augmented-reality system. A total station can be used to track a reflector, and truth can be transferred to the wearable device while an obstruction is between the total station and the reflector. Further, a target can be used to orient a local map of a wearable device to an environment based on a distance between the target and the wearable device.
    Type: Grant
    Filed: July 9, 2020
    Date of Patent: November 29, 2022
    Assignee: Trimble Inc.
    Inventors: Kent Kahle, David Hyland, Benedict J G Atkins, Eliot Jones, Marc Howell, Steven Ostrowski
  • Patent number: 11507184
    Abstract: A head-mountable display (HMD) system includes at least one detector to detect movement of an eye of a user wearing the HMD, control circuitry to detect saccadic movement of the eye in dependence upon the detected movement of the eye, a display unit and a processor to generate images for display to the user by the display unit, in which the control circuitry is configured to control the processor in response to the detected saccadic movement, in which the control circuitry is configured to control the processor to adjust one or more image quality parameters for one or more of the images to be displayed by the display unit during the detected saccadic movement.
    Type: Grant
    Filed: May 18, 2021
    Date of Patent: November 22, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Patrick John Connor, Matthew William Sanders, Mark Jacobus Breugelmans, Maria Chiara Monti
  • Patent number: 11508129
    Abstract: An image processing method and an image processing apparatus are disclosed. An image processing method according to an embodiment includes the steps of: obtaining a position of a user's hand; and controlling a virtual window on the basis of the position of the hand.
    Type: Grant
    Filed: October 18, 2018
    Date of Patent: November 22, 2022
    Assignee: Korea Advanced Institute of Science and Technology
    Inventors: Seok Hyung Bae, Joon Hyub Lee
  • Patent number: 11501040
    Abstract: An example computing system is configured to (i) generate a cross-sectional view of a three-dimensional drawing file; (ii) receive a first user input indicating a selection of a first mesh, wherein the selection comprises a selection point that establishes a first end point; (iii) generate a first representation indicating an alignment of the first end point with at least one corresponding geometric feature of the first mesh and a second representation indicating a set of one or more directions; (iv) receive a second user input indicating a given direction; (v) based on receiving the second user input, generate a dynamic representation of the dimensioning information along the given direction; (vi) receive a third user input indicating that the second user input is complete; (vii) based on receiving the third user input, add the dimensioning information to the cross-sectional view between the first end point and the second end point.
    Type: Grant
    Filed: June 14, 2021
    Date of Patent: November 15, 2022
    Assignee: Procore Technologies, Inc.
    Inventors: Ritu Parekh, David McCool, Christopher Myers, Christopher Bindloss
  • Patent number: 11495003
    Abstract: Techniques for placing and manipulating multiple three-dimensional (3D) models using mobile augmented reality (AR) are described. One technique includes receiving a first request to initialize an AR simulation of a first product for sale within a physical environment. In response to the first request, a first 3D model of the first product for sale is rendered onto the screen. After rendering the first 3D model, a second request to visualize a second product for sale within the physical environment is received during the AR simulation of the first product for sale. In response to the second request, a second 3D model of the second product for sale is rendered onto the screen with the first 3D model.
    Type: Grant
    Filed: November 30, 2020
    Date of Patent: November 8, 2022
    Assignee: A9.com, Inc.
    Inventors: Mukul Agarwal, Jonathan Bernadel-Huey, Kevin May, Xing Zhang, Karl Hillesland, Jack Mousseau, Simon Fox
  • Patent number: 11481179
    Abstract: Provided is an information processing apparatus that includes a movement history acquiring section that acquires a movement history, based on an absolute coordinate, of a gazing point of a first user that gazes at a display region, in which the absolute coordinate is in a three-dimensional space displayed in the display region. The information processing apparatus further includes a display controller that controls a display unit that displays the display region to visualize, to a second user, the movement history of the gazing point. This allows the gazing point of the first user to be shared with the second user without hiding a target object.
    Type: Grant
    Filed: June 26, 2019
    Date of Patent: October 25, 2022
    Assignee: SONY CORPORATION
    Inventor: Takuro Noda
  • Patent number: 11468619
    Abstract: This disclosure covers methods, computer-readable media, and systems that animate a digital graphic associated with a video or other visual media item based on a detected dynamic attribute. In particular, the disclosed methods, computer-readable media, and systems detect sensor data from a client device or a motion of an object within a video or other visual media item. Based on the detected sensor data or motion of an object within a visual media item, the methods, computer-readable media, and systems overlay and animate an emoji or other digital graphic selected by a user on a video or other visual media item.
    Type: Grant
    Filed: May 25, 2021
    Date of Patent: October 11, 2022
    Assignee: WhatsApp LLC
    Inventor: Dmitri Stukalov
  • Patent number: 11461981
    Abstract: An example augmented reality system includes: obtaining information about an instance of a device; recognizing the instance of the device based on the information; selecting a digital twin for the instance of the device, with the digital twin being unique to the instance of the device; and generating augmented reality content based on the digital twin and an actual graphic of the instance of the device.
    Type: Grant
    Filed: January 12, 2021
    Date of Patent: October 4, 2022
    Assignee: PTC INC.
    Inventors: Vladimir Parfenov, Kevin Elliott Jordan, Steven Thomas Dertien, Moshe Jacob Baum, Andre Gosselin, Stephen Prideaux-Ghee, James E. Heppelman
  • Patent number: 11450075
    Abstract: A method for generating a body model of a person wearing a cloth includes receiving an user input related to a person, wherein the user input comprises at least one image or photograph of the person, wherein at least one image of the person has face of the person, using a human body information to identify requirement of the other body part/s, receiving at least one image or photograph of other human body part/s based on identified requirement, processing the image/s of the person with the image/s or photograph/s of other human body part/s using the human body information to generate a body model of the person, wherein the body model represent the person whose image/photograph is received as user input, and the body model comprises face of the person, receiving an image of a cloth according to shape and size of the body model of the person, and combining the body model of the person and the image of the cloth to show the body model of the human wearing the cloth.
    Type: Grant
    Filed: January 27, 2017
    Date of Patent: September 20, 2022
    Inventor: Nitin Vats
  • Patent number: 11449134
    Abstract: An electronic device according to various embodiments comprises a display, a camera module, and a processor, wherein the processor can be configured to: acquire a first image including a specific region through the camera module; store, on the basis of the first image, information related to at least one object included in the first image; acquire, on the basis of the second image, information related to at least one object included in a second image when the camera module acquires the second image including at least a partial region of the specific region; display, through the display, together with the second image, information that matches information corresponding to the at least one object included in the second image from among the pieces of information related to the at least one object included in the first image; and store, in correspondence to the at least partial region of the specific region, information which does not match the information corresponding to the at least one object included in the
    Type: Grant
    Filed: June 26, 2019
    Date of Patent: September 20, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Sujung Bae, Soyoung Kim, Heebum Ahn
  • Patent number: 11436805
    Abstract: A computer implemented method for augmenting a first image with image data from a second image, the method comprising: receiving (S02) the first image depicting a first scene; capturing (S04) the second image depicting a second scene using an image capturing device; identifying (S06) an object in the second image; receiving (S08) a 3D model from a database, the database comprising a plurality of 3D models, the 3D model corresponding to the identified object of the second image; aligning (S10) the 3D model with the identified object in the second image; extracting (S12) pixel data from the second image using a contour of the 3D model's projection onto the second image; inserting (S14) the extracted pixel data of the second image data into the first image, thereby rendering an augmented image.
    Type: Grant
    Filed: December 16, 2020
    Date of Patent: September 6, 2022
    Assignee: Inter IKEA Systems B.V.
    Inventors: Jonas Gustavsson, Camila Dorin
  • Patent number: 11430198
    Abstract: In some implementations, a method includes: obtaining a request to display a virtual object at a location within a computer-generated environment; and, in response to detecting the request to display the virtual object the location within the computer-generated environment: determining a real-world pose for the electronic device relative to a first coordinate space associated with a physical environment; determining a viewing vector by transforming the real-world pose from the first coordinate space to a second coordinate space associated with the computer-generated environment; in accordance with a determination that the viewing vector satisfies viewing criteria, displaying the virtual object at the location within the computer-generated environment according to a first view mode; and in accordance with a determination that the viewing vector satisfies second viewing criteria, displaying the virtual object at the location within the computer-generated environment according to a second view mode.
    Type: Grant
    Filed: January 8, 2021
    Date of Patent: August 30, 2022
    Assignee: Apple Inc.
    Inventors: Cameron J. Dunn, Etienne H. Guerard
  • Patent number: 11423619
    Abstract: Systems and methods for virtual showroom are described. The virtual showroom may allow a consumer to virtually visit a showroom and receive detailed vehicle information in a variety of manners. A consumer may use augmented reality to highlight a vehicle and receive information regarding it. A consumer may walk through a guided showroom tour or walk through an interactive showroom tour. Another user may be conferenced into the tour as well.
    Type: Grant
    Filed: March 25, 2020
    Date of Patent: August 23, 2022
    Assignee: Volvo Car Corporation
    Inventors: Qinzi Tan, Lukasz Pasek
  • Patent number: 11417065
    Abstract: Methods and systems are provided for a reprojection engine for augmented-reality devices. The augmented-reality device projects virtual content within a real-world environment. The augmented-reality device tracks a six degrees of freedom headpose of the augmented-reality device, depth information of the virtual content, motion vectors that correspond to movement of the virtual content, and a color buffer for a reprojection engine. The reprojection engine generates a reprojection of the virtual content defined by an extrapolation of a first frame using the headpose, the depth information, motion vectors, and the color surface data structure. The reprojected virtual content continues to appear as if positioned with the real-world environment regardless of changes in the headpose of the augmented-reality device or motion of the virtual content.
    Type: Grant
    Filed: October 28, 2020
    Date of Patent: August 16, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Robert Blake Taylor, Gilles Cadet
  • Patent number: 11410404
    Abstract: A computer-implantable method includes accessing a model file containing a digital 3-D object, calculating at least one dimensional measurement of the object, uniformly scaling the object in the X, Y and Z axes by a predetermined percentage, mirroring the object across the X, Y and Z axes, slicing the mirrored object at a predetermined interval by an infinite plane in both a rotated and animated state of the infinite plane, generating from the slices points at the edge of a plane object collision, and assigning to the points positive and negative values relating to all possible X, Y and Z quadrant locations.
    Type: Grant
    Filed: March 23, 2021
    Date of Patent: August 9, 2022
    Inventor: Karl A. Roesch
  • Patent number: 11409929
    Abstract: An example computing system is configured to (i) receive a request to generate a cross-sectional view of a three-dimensional drawing file, where the cross-sectional view is based on a location of a cross-section line within the three-dimensional drawing file and includes an intersection of two meshes within the three-dimensional drawing file; (ii) generate the cross-sectional view of the three-dimensional drawing file; (iii) add, to the generated cross-sectional view, dimensioning information involving at least one of the two meshes; (iv) generate one or more controls for adjusting a location of the cross-section line within the three-dimensional drawing file; and (v) based on an input indicating a selection of the one or more controls, adjust the location of the cross-section line within the three-dimensional drawing file, update the cross-sectional view based on the adjusted location of the cross-section line, and update the dimensioning information to correspond to the updated cross-sectional view.
    Type: Grant
    Filed: December 30, 2020
    Date of Patent: August 9, 2022
    Assignee: Procore Technologies, Inc.
    Inventors: David McCool, Christopher Myers, Christopher Bindloss
  • Patent number: 11393177
    Abstract: An information processing apparatus includes a controller (100) that performs: control of displaying information in augmented reality in a preparation mode in which a real object is disposed, the information that supports disposition of the real object on the basis of prerecorded information about the real object with which a virtual object has an interaction; and control of recording disposition result information of the real object in a disposition result information database referred to in a normal mode in which the virtual object that has the interaction with the disposed real object is displayed.
    Type: Grant
    Filed: June 25, 2019
    Date of Patent: July 19, 2022
    Assignee: SONY CORPORATION
    Inventors: Yasuko Ishihara, Hidenori Aoki, Shintaro Tsutsui, Fujio Arai, Naoyuki Sato
  • Patent number: 11392198
    Abstract: Systems and methods are described for extended reality environment interaction. An extended reality environment including an object is generated for display, and an eye motion is detected. Based on the detecting, it is determined whether the object is in a field of view for at least a predetermined period of time, and in response to determining that the object is in the field of view for at least the predetermined period of time, one or more items related to the object are generated for display in the extended virtual reality environment.
    Type: Grant
    Filed: October 20, 2020
    Date of Patent: July 19, 2022
    Assignee: ROVl GUIDES, INC.
    Inventor: Sakura Saito
  • Patent number: 11393179
    Abstract: A system aligns a 3D model of an environment with image frames of the environment and generates a visualization interface that displays a portion of the 3D model and a corresponding image frame. The system receives LIDAR data collected in the environment and generates a 3D model based on the LIDAR data. For each image frame, the system aligns the image frame with the 3D model. After aligning the image frames with the 3D model, when the system presents a portion of the 3D model in an interface, it also presents an image frame that corresponds to the portion of the 3D model.
    Type: Grant
    Filed: July 2, 2021
    Date of Patent: July 19, 2022
    Assignee: OPEN SPACE LABS, INC.
    Inventors: Michael Ben Fleischman, Jeevan James Kalanithi, Gabriel Hein, Elliott St. George Wilson Kember