Patents Examined by Grace Q Li
  • Patent number: 11816887
    Abstract: An augmented reality (AR) node location and activation technique for use in an AR system in a process plant or other field environment quickly and easily detects an AR node in a real-world environment and is then able to activate an AR scene within the AR system, which improves the usability and user experience of the AR system. The AR node location and activation system generally enables users to connect to and view an AR scene within an AR system or platform even when the user is not directly at an existing AR node, when the user is experiencing poor lighting conditions in the real-world environment and in situations in which the user is unfamiliar with the AR nodes that are in the AR system database.
    Type: Grant
    Filed: August 4, 2020
    Date of Patent: November 14, 2023
    Assignee: FISHER-ROSEMOUNT SYSTEMS, INC.
    Inventors: Yicheng Peter Pan, Anna Velena, David R. Denison, Manikandan Nambiar, Kuo-Lung Chin, Guido Maria Re
  • Patent number: 11810473
    Abstract: A system and method of training how to use a medical device using an instrument such as a mock ultrasound probe or syringe to be tracked in 3D space with six degrees of freedom using an internal optical camera, a light source (e.g. infrared LEDs), and a display of markers arranged on a surface. By extracting corner information for each marker, a 3D transformation can be established, allowing the system to know the instrument's position and orientation in 3D space relative to that marker. Each marker also encodes a numerical value corresponding to its predetermined position and orientation on the surface, allowing the instrument to determine its own position and orientation relative to the surface. Thus, as long as the instrument is able to see at least one marker on an optical surface, the system will know its full 3D position and orientation relative to the whole optical surface.
    Type: Grant
    Filed: January 29, 2020
    Date of Patent: November 7, 2023
    Assignee: THE REGENTS OF THE UNIVERSITY OF CALIFORNIA
    Inventors: Matthew Wang, Kresimir Petrinec, Gabriele Nataneli, Eric Savitsky
  • Patent number: 11790498
    Abstract: Systems and methods are provided for displaying augmented reality image content perceived as being overlaid on background image content viewed through a light-transmissive viewing surface. Image processing circuitry may receive input augmented reality image data corresponding with a pixel position on the display panel, determine a perceived background brightness metric indicative of background brightness level at the pixel position based at least in part on captured background image data and an ambient lighting metric, determine a target tone mapping based at least in part on the perceived background brightness metric, and determine display augmented reality image data to be used by a display panel to display the augmented reality image content least in part by applying the target tone mapping to the input augmented reality image data.
    Type: Grant
    Filed: August 26, 2020
    Date of Patent: October 17, 2023
    Assignee: Apple Inc.
    Inventors: Sheng Zhang, Mahnaz Mohammadi, Shuang Wang, José Antonio Dominguez-Caballero, Chaohao Wang, Tobias Jung, Jun Miao
  • Patent number: 11789260
    Abstract: A head-up display of the present disclosure projects a display image on a transparent reflecting member. The head-up display includes: a display device that displays the display image; and a projection optical system that projects the display image displayed on the display device. On an assumption that light reaching a center of a viewpoint region of the observer and corresponding to a center of the virtual image is reference light, the projection optical system includes a prism element that has an incident surface, a reflection surface, and an emitting surface different from the incident surface sequentially in an optical path from the display device. The emitting surface is inclined to the reference light. An inclination amount ?2 of the reference light emitted from the emitting surface with respect to the emitting surface lies in a range of 15°<|?2|<45° in the optical path from the display device.
    Type: Grant
    Filed: June 29, 2022
    Date of Patent: October 17, 2023
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Satoshi Kuzuhara, Hiroaki Okayama
  • Patent number: 11790814
    Abstract: A system includes a first multilayer surface that includes a plurality of layers. The system further includes a plurality of sensors and circuitry. The circuitry receives a plurality of signals from the plurality of sensors and projection data associated with a media content projectable by a projection device. The projection data includes contrast control information associated with the media content. The circuitry determines ambient condition of an enclosed space based on the received plurality of signals. The circuitry selects one or more portions of the plurality of layers of the first multilayer surface based on the determined ambient condition or the projection data. The circuitry controls an opacity level of the selected one or more portions of the first multilayer surface to provide dynamic shade control in the enclosed space or improve contrast of the projected media content based on the determined ambient condition or the projection data.
    Type: Grant
    Filed: April 1, 2021
    Date of Patent: October 17, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Ted Yamazaki, Tonni Larsen, Leigh Anderson, Tatsushi Nashida, Naomasa Takahashi
  • Patent number: 11786206
    Abstract: Systems, devices and methods for augmented reality guidance of surgical procedures using multiple head mounted displays or other augmented reality display devices are described. In addition, systems, devices and methods using head mounted displays or other augmented reality display systems for operating surgical robots and/or imaging systems are described.
    Type: Grant
    Filed: March 10, 2022
    Date of Patent: October 17, 2023
    Assignee: OnPoint Medical, Inc.
    Inventors: Daniel Steines, Philipp K. Lang
  • Patent number: 11771499
    Abstract: A surgical implant planning computer is connectable to a fluoroscopy imager, a marker tracking camera, and a robot having a robot base coupled to a robot arm that is movable by motors relative to the robot base. Operations include performing a registration setup mode that determines occurrence of a first condition indicating the marker tracking camera can observe to track reflective markers that are on a fluoroscopy registration fixture of the fluoroscopy imager, and determines occurrence of a second condition indicating the marker tracking camera can observe to track dynamic reference base markers attached to the robot arm and/or an end-effector connected to the robot arm. While both of the first and second conditions occur, operations are allowed to be performed to obtain a first intra-operative fluoroscopic image of a patient along a first plane and to obtain a second intra-operative fluoroscopic image of the patient along a second plane that is orthogonal to the first plane.
    Type: Grant
    Filed: January 18, 2022
    Date of Patent: October 3, 2023
    Assignee: Globus Medical Inc.
    Inventors: Neil R. Crawford, Norbert Johnson
  • Patent number: 11766937
    Abstract: In a display control method, a first information image is displayed on a head-up display. The first information image includes a first vehicle icon which is a figure indicating a vehicle, and a first character string arranged above the first vehicle icon. A second information image is displayed on a meter display. The second information image includes a second vehicle icon which is a figure indicating a vehicle, and a second character string which is arranged below the second vehicle icon, and includes the first character string.
    Type: Grant
    Filed: May 15, 2019
    Date of Patent: September 26, 2023
    Assignee: Nissan Motor Co., Ltd.
    Inventors: Hikaru Nakao, Akira Morimoto, Kosuke Sato, Shohei Nakamura, Shuko Ishimaru
  • Patent number: 11762696
    Abstract: In an example, an apparatus comprises a plurality of execution units comprising at least a first type of execution unit and a second type of execution unit and logic, at least partially including hardware logic, to analyze a workload and assign the workload to one of the first type of execution unit or the second type of execution unit. Other embodiments are also disclosed and claimed.
    Type: Grant
    Filed: November 5, 2021
    Date of Patent: September 19, 2023
    Assignee: INTEL CORPORATION
    Inventors: Abhishek R Appu, Altug Koker, Balaji Vembu, Joydeep Ray, Kamal Sinha, Prasoonkumar Surti, Kiran C. Veernapu, Subramaniam Maiyuran, Sanjeev S. Jahagirdar, Eric J. Asperheim, Guei-Yuan Lueh, David Puffer, Wenyin Fu, Nikos Kaburlasos, Bhushan M. Borole, Josh B. Mastronarde, Linda L. Hurd, Travis T. Schluessler, Tomasz Janczak, Abhishek Venkatesh, Kai Xiao, Slawomir Grajewski
  • Patent number: 11744465
    Abstract: Disclosed is a method for generating a three-dimensional brain map, comprising the steps of: acquiring a brain magnetic resonance imaging (MRI) image of an object; segmenting the brain MRI image into a plurality of regions; generating a three-dimensional brain image of the object including the plurality of regions by using the segmented brain MRI image; and generating a three-dimensional brain map of the object capable of simulating a process of transferring electrical stimulation to the brain of the object based on properties of each of the plurality of regions included in the three-dimensional brain image, wherein the step of segmenting includes the step of acquiring a segmented brain MRI image of the object by inputting a brain MRI image of the object into a model learned by using a plurality of processed brain MRI images.
    Type: Grant
    Filed: March 10, 2020
    Date of Patent: September 5, 2023
    Assignee: NEUROPHET INC.
    Inventor: Dong Hyeon Kim
  • Patent number: 11731512
    Abstract: A display panel for displaying at least one graphical display object and a control device are part of a display apparatus in a motor vehicle. The display panel is freestanding in a space and has a multiplicity of predetermined sections, each having a settable degree of light transmittance. As a result, an environment of the display panel may be visible in the display panel, depending on the degree of light transmittance. The control device is configured to individually set a respective light transmittance to a predetermined degree for each of the multiplicity of predetermined sections of the display panel.
    Type: Grant
    Filed: March 20, 2019
    Date of Patent: August 22, 2023
    Assignee: AUDI AG
    Inventors: Jacques Helot, Ulrich Mueller, Immo Redeker, Joris Mertens, Anna Hufnagel
  • Patent number: 11734895
    Abstract: The present disclosure provides systems and methods for displaying a real-world vehicle in an augmented reality environment. The system employs a user device camera to obtain image data of an environment that includes a real-world vehicle. The system analyzes the image data to identify the vehicle within the environment. A wireframe model of the vehicle is then generated and registered to the vehicle. The image data is displayed on the user device. In response to user input, the system may then attach a virtual vehicle accessory to the wireframe model. The accessory is then displayed on the user device display in an augmented reality environment such that the vehicle appears to seamlessly incorporate the accessory.
    Type: Grant
    Filed: May 7, 2021
    Date of Patent: August 22, 2023
    Assignee: TOYOTA MOTOR NORTH AMERICA, INC.
    Inventors: Anthony D. Sanor, David Kleiner, Jazmieka Smith, Gary Banks
  • Patent number: 11715268
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering a three-dimensional virtual object in a video clip. The method and system include capturing, using a camera-enabled device, video content of a real-world scene and movement information collected by the camera-enabled device during capture of the video content. The captured video and movement information are stored. The stored captured video content is processed to identify a real-world object in the scene. An interactive augmented reality display is generated that: adds a virtual object to the stored video content to create augmented video content comprising the real-world scene and the virtual object and adjusts, during playback of the augmented video content, an on-screen position of the virtual object within the augmented video content based at least in part on the stored movement information.
    Type: Grant
    Filed: May 4, 2021
    Date of Patent: August 1, 2023
    Assignee: Snap Inc.
    Inventors: Samuel Edward Hare, Andrew James McPhee, Tony Mathew
  • Patent number: 11709526
    Abstract: Disclosed are an electronic apparatus and a method of controlling the same. The electronic apparatus includes: a display; and a processor configured to: control the display to display an image on the display, identify a screen mode of the display displaying an image among a plurality of screen modes having different aspect ratios, and provide information on content corresponding to the identified screen mode among a plurality of pieces of content.
    Type: Grant
    Filed: November 24, 2020
    Date of Patent: July 25, 2023
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Kangchun Lee, Sungsik Park, Yongman Son
  • Patent number: 11703684
    Abstract: The present invention relates to an apparatus and method for providing cluster information using a three-dimensional (3D) image. The apparatus for providing the cluster information using the 3D image according to the present invention includes an input unit configured to receive display mode setting information and driving information, a memory configured to store a cluster information providing program that uses a 3D image, and a processor configured to execute the cluster information providing program, wherein the processor controls a light source disposed in a cluster according to the display mode setting information to display the driving information.
    Type: Grant
    Filed: July 7, 2021
    Date of Patent: July 18, 2023
    Assignee: HYUNDAI MOBIS Co., Ltd.
    Inventors: Sung Joon Ahn, Myung Bin Choi, Seung Hwan Lee, Tae Hun Kim, Kyung Hoon Kim
  • Patent number: 11694435
    Abstract: Systems and methods of disabling user control interfaces during attachment of a wearable electronic device to a portion of a user's clothing or accessory are disclosed. The wearable electronic device can include inertial measurement units (IMUs), optical sources, optical sensors or electromagnetic sensors. Based on the information provided by the IMUs, optical sources, optical sensors or electromagnetic sensors, an electrical processing and control system can make a determination that the electronic device is being grasped and picked up for attaching to a portion of a user's clothing or accessory or that the electronic device is in the process of being attached to a portion of a user's clothing or accessory and temporarily disable one or more user control interfaces disposed on the outside of the wearable electronic device.
    Type: Grant
    Filed: June 18, 2019
    Date of Patent: July 4, 2023
    Assignee: MAGIC LEAP, INC.
    Inventors: Carlos Julio Suate Pedroza, Todd Daniel Hendry, Guillermo Padin Rohena, Paul M. Greco, Vinosh Christopher Diptee, Evan Francis Rynk
  • Patent number: 11653900
    Abstract: Various embodiments relate to a method for managing healthcare resources including receiving information selecting a first outcome perspective, calculating first impactibility scores for the first outcome perspective, determining a first subarea based on the first impactibility scores, and designating an allocation of healthcare resources and cost for the first subarea based on the first outcome perspective. The first impactibility scores are calculated for respective subareas including the first subarea, and the first outcome perspective corresponds to a first ratio of healthcare resources and cost.
    Type: Grant
    Filed: April 3, 2020
    Date of Patent: May 23, 2023
    Assignee: KONINKLIJKE PHILIPS N.V.
    Inventors: Grzegorz Andrzej Toporek, Jun Seob Shin
  • Patent number: 11644928
    Abstract: A display apparatus and a control method thereof are provided. The display apparatus includes a display configured to be rotatable; a plurality of cameras; and a processor configured to: based on the display being oriented in a vertical direction, control one camera of the plurality of cameras to perform photographing; and based on a user command being received while the one camera is performing photographing, rotate the display to be oriented in a horizontal direction and control the one camera to stop photographing.
    Type: Grant
    Filed: September 11, 2020
    Date of Patent: May 9, 2023
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Kunsok Kang, Byungseok Soh, Seungil Yoon, Eungsik Yoon, Suhwan Jin, Taedon Hwang
  • Patent number: 11631380
    Abstract: The present technology relates to an information processing apparatus and an information processing method enabling a user to visually recognize a surrounding environment promptly based on a sudden change in brightness. An information processing apparatus of the present technology includes an acquisition section that acquires environmental information which is information associated with an environment including an object present in a real space, and a display control section that exercises display control based on the environmental information with respect to form information representing a form of the object over a display section that displays predetermined information in a visually recognizable state while superimposing the predetermined information on the real space based on occurrence of a change in brightness of the real space higher than a threshold. The present technology is applicable to an HMD that displays information while superimposing the information on a scene in front of a user.
    Type: Grant
    Filed: March 1, 2019
    Date of Patent: April 18, 2023
    Assignee: SONY CORPORATION
    Inventors: Hiroshi Yuasa, Kazuma Aiki
  • Patent number: 11620855
    Abstract: A method, computer system, and a computer program product for memory mapping is provided. The present invention may include identifying an augmented reality device and at least one Internet of Things (IoT) device which observes at least one biometric parameter. The present invention may include defining at least one user attention pattern based on the at least one biometric parameter. The present invention may include predicting an attentiveness of a user based on the at least one attention pattern. The present invention may include recording data from the augmented reality device, based on the attentiveness of the user dropping below a certain point. The present invention may include storing the recorded data.
    Type: Grant
    Filed: September 3, 2020
    Date of Patent: April 4, 2023
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Shikhar Kwatra, Jeremy R. Fox, Sarbajit K. Rakshit, John D. Wilson