Patents Examined by Jwalant Amin
  • Patent number: 11335303
    Abstract: Certain examples of the present invention relate to an apparatus, method, computer program and system for use in gaze dependent foveated rendering. Certain examples provide an apparatus including at least one processor; and at least one memory including computer program code; the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to perform adapting a gaze dependent foveated rendering process in response to a determination of a sub-optimal operational condition of the gaze dependent foveated rendering process.
    Type: Grant
    Filed: December 19, 2017
    Date of Patent: May 17, 2022
    Assignee: Nokia Technologies Oy
    Inventors: Toni Jarvenpaa, Peter Eskolin, Tero Jokela, Marja Salmimaa
  • Patent number: 11335304
    Abstract: A driving circuit for head-worn display device, and a virtual reality display device, and the driving circuit includes: a display panel driving circuit, the display panel driving circuit comprises a sensor circuit, and a data processing circuit; the sensor circuit is configured to generate a posture information signal corresponding to a rotation direction of the display panel; and the data processing circuit is configured to receive the posture information signal and a display data signal for a display panel, and to control the display panel according to the posture information signal and the display data signal to display an image corresponding to a rotation direction.
    Type: Grant
    Filed: December 2, 2019
    Date of Patent: May 17, 2022
    Assignees: Beijing BOE Optoelectronics Technology Co., Ltd., BOE Technology Group Co., Ltd.
    Inventors: Yu Lei, Hao Zhang, Lili Chen, Peng Han, Yuanjie Lu, Huidong He, Yukun Sun
  • Patent number: 11327323
    Abstract: Aspects of the present invention relate to methods and devices for receiving and presenting content. In an example method, content is received, the content to be delivered to a plurality of recipients. Each recipient of the plurality of recipients has a preference for a respective first physical location at which the content is to be presented on a display of a wearable head device associated with the recipient. A sender of the content has a preference for a second physical location at which the content is to be presented to the respective recipient of the plurality of recipients. A respective final physical location for the presentation of the content for the respective recipient of the plurality of recipients is identified. The respective final physical location is based on the respective recipient's preference and the sender's preference. It is determined whether the respective recipient is proximate to a zone associated with the respective final physical location.
    Type: Grant
    Filed: March 10, 2021
    Date of Patent: May 10, 2022
    Assignee: Mentor Acquisition One, LLC
    Inventors: Ralph F. Osterhout, John D. Haddick, Robert Michael Lohse, John N. Border, Nima L. Shams
  • Patent number: 11301969
    Abstract: Some implementations provide improved user experiences on head mounted devices (HMDs) that provide near eye viewing, e.g., HMDs that display distorted images and provide lenses that undistort the images for the user. The images are produced using distortion that is corrected dynamically based on context to conserve device resources. To do so, a context associated with a state of the user, the HMD, or content being viewed on the HMD is tracked during the user experience. For example, the device may predict pupil position, eye state, eye gaze direction, or eye fixation, content type, connection mode, and other context. The device uses the tracked context to determine how to correct distortion for the images at different points during the user experience. For example, new distortion corrections may be computed and used while the user's gaze is moving and previously-determined distortion corrections may be used while the user's gaze is fixed.
    Type: Grant
    Filed: September 19, 2019
    Date of Patent: April 12, 2022
    Assignee: Apple Inc.
    Inventors: Moinul Khan, Simon Fortin-Deschenes, Yanli Zhang, Bennett S. Wilburn, Sterling G. Orsten, Nan Zhu, James Zhou
  • Patent number: 11302086
    Abstract: The present disclosure relates to providing a software feature of an electronic product in an augmented reality (AR) environment. In some embodiments, images are obtained using one or more image sensors, a determination is made whether the obtained images include printed media depicting the electronic product, when the obtained images include the printed media depicting the electronic product, a virtual object corresponding to the electronic product is displayed in the AR environment, and the software feature of the electronic product is provided with the virtual object.
    Type: Grant
    Filed: January 5, 2021
    Date of Patent: April 12, 2022
    Assignee: Apple Inc.
    Inventors: Justin D. Stoyles, Michael Kuhn
  • Patent number: 11301195
    Abstract: A display device includes a display configured to display a deterioration degree of a secondary battery and a controller. The controller is configured to control the display such that the display does not display the deterioration degree when the deterioration degree is lower than a first level, or configured to control the display such that the display does not display the deterioration degree when the deterioration degree is higher than a second level that is higher than the first level.
    Type: Grant
    Filed: January 28, 2021
    Date of Patent: April 12, 2022
    Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
    Inventors: Kimihiro Nakayama, Kosuke Yoshida, Kohki Nakamura
  • Patent number: 11301272
    Abstract: Aspects of the disclosure relate to providing augmented reality user interfaces and controlling automated systems based on user activity information and pre-staging information. A computing platform may receive, from a client user device, a trip start notification indicating that a user of the client user device is initiating a trip to an enterprise center. In response to receiving the trip start notification, the computing platform may generate a pre-staging augmented reality user interface for a client augmented reality device linked to the client user device. Thereafter, the computing platform may receive pre-staging information identifying one or more events to be performed at the enterprise center when the user of the client user device arrives at the enterprise center. The computing platform may generate one or more pre-staging commands based on the pre-staging information and may send these commands to one or more systems associated with the enterprise center.
    Type: Grant
    Filed: March 17, 2021
    Date of Patent: April 12, 2022
    Assignee: Bank of America Corporation
    Inventor: Matthew E. Carroll
  • Patent number: 11281417
    Abstract: A display device includes a display configured to display a deterioration degree of a secondary battery and a controller. The controller is configured to control the display such that the display does not display the deterioration degree when the deterioration degree is lower than a first level, or configured to control the display such that the display does not display the deterioration degree when the deterioration degree is higher than a second level that is higher than the first level.
    Type: Grant
    Filed: August 15, 2019
    Date of Patent: March 22, 2022
    Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
    Inventors: Kimihiro Nakayama, Kosuke Yoshida, Kohki Nakamura
  • Patent number: 11276234
    Abstract: A method of controlling augmented reality (AR) mobility according to embodiments may include generating, by a camera, image data by photographing one or more users, extracting information about the one or more users from the image data, calculating a reference point for projection of an AR object based on the location information about the users, and displaying the AR object on a display based on the calculated reference point. An apparatus for controlling AR mobility according to embodiments may include a camera configured to generate image data by photographing one or more users, a controller configured to extract information about the one or more users from the image data, a calibrator configured to calculate a reference point for projection of an AR object based on the location information about the users, and a display configured to display the AR object on a display based on the calculated reference point.
    Type: Grant
    Filed: December 9, 2019
    Date of Patent: March 15, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Sunghwan Choi, Byeongjun Choi, Yeonsoo Kim, Dukyung Jung
  • Patent number: 11270409
    Abstract: A method includes obtaining an image via an image sensor. The method includes determining a first perceptual quality value that is associated with a first portion of the image. The method includes determining a first image perceptual quality warping function that is based on the first perceptual quality value and an image warping map. The first image perceptual quality warping function is characterized by a first warping granularity level that is a function of the first perceptual quality value. The method includes warping the first portion of the image according to the first image perceptual quality warping function.
    Type: Grant
    Filed: September 23, 2020
    Date of Patent: March 8, 2022
    Assignee: APPLE INC.
    Inventors: Raffi A. Bedikian, Mohamed Selim Ben Himane, Pedro Manuel Da Silva Quelhas, Moinul Khan, Katharina Buckl, Jim C. Chou, Julien Monat Rodier
  • Patent number: 11249549
    Abstract: The present invention relates to a brain connectivity-based visual perception training device, method and program. The brain connectivity-based visual perception training method, according to one embodiment of the present invention, comprises: a step (S200; a spatial movement image providing step) of allowing a computer to provide a spatial movement image to a head-mounted display device; a step (S400; a visual perception training image providing step) of allowing the computer to provide a visual perception training image simultaneously with the spatial movement image or subsequently to the spatial movement image; and a step (S1000) of allowing the computer to receive, from a user, a performance result of a first task of the visual perception training image. Hereinafter, each step is described in detail.
    Type: Grant
    Filed: July 16, 2020
    Date of Patent: February 15, 2022
    Assignee: NUNAPS INC.
    Inventors: Dong Wha Kang, Dong Ho Kim
  • Patent number: 11244660
    Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display is disclosed herein. The electronic device includes processing circuitry that is operatively coupled to the display and configured to foveate one or more areas of the display according to the eye tracking data. If the eye tracking data input is lost, the processing circuitry is configured to recover from the loss of eye tracking data by changing one or more aspects of the foveated areas (e.g., size, resolution, etc.) until a threshold is satisfied. As time elapses since loss of eye tracking, the foveated areas move toward a center or a salient region of the display.
    Type: Grant
    Filed: February 11, 2021
    Date of Patent: February 8, 2022
    Assignee: Apple Inc.
    Inventors: Yashas Rai Kurlethimar, Can Jin, Nicolas Pierre Marie Frederic Bonnier, Jiaying Wu, Andrew B. Watson
  • Patent number: 11244186
    Abstract: The information processing apparatus in one embodiment of the present invention is an information processing apparatus for selecting an image from among a plurality of images in response to instructions of a user and having: a reception unit configured to receive specification of an object on one image of the plurality of images; a detection unit configured to detect the object from each of the plurality of images; a display unit configured to display an area corresponding to the detected object of each of the plurality of images so that the area is emphasized more than the other areas in each of the plurality of images; and a selection unit configured to select one of the plurality of images in response to the instructions by a user after the display by the display unit.
    Type: Grant
    Filed: March 16, 2020
    Date of Patent: February 8, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventors: Norikazu Horiike, Ruriko Kawano
  • Patent number: 11238664
    Abstract: Techniques and systems are provided for providing recommendations for extended reality systems. In some examples, a system determines one or more environmental features associated with a real-world environment of an extended reality system. The system determines one or more user features associated with a user of the extended reality system. The system also outputs, based on the one or more environmental features and the one or more user features, a notification associated with at least one application supported by the extended reality system.
    Type: Grant
    Filed: November 5, 2020
    Date of Patent: February 1, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Mehrad Tavakoli, Robert Tartz, Scott Beith, Gerhard Reitmayr
  • Patent number: 11238621
    Abstract: A vehicle display device includes: a display unit that is disposed in a host vehicle and that displays an image; an imaging unit that captures an image of circumstances surrounding the host vehicle; and a controller configured to perform processing through which, by controlling the display unit, a virtual vehicle image representing a virtual vehicle imitating the host vehicle is displayed, and the image of the circumstances surrounding the host vehicle captured by the imaging unit is pasted for display as a reflected image representing reflection in the host vehicle onto an outer panel of the virtual vehicle represented by the virtual vehicle image.
    Type: Grant
    Filed: August 9, 2019
    Date of Patent: February 1, 2022
    Assignee: YAZAKI CORPORATION
    Inventor: Harutoshi Nakajima
  • Patent number: 11237629
    Abstract: A gaze initiated interaction technique for facilitating social networking in augmented reality. Methods are shown which allow users to interact with each other following an event of interlocking gaze. Methods are also shown which allows tagging using augmented reality filters following a gaze interlock. Methods are also introduced to allow an augmented reality target to determine themselves how they would like to be enhanced in augmented reality following gaze interlocks. This disclosure also introduces a device for social networking in augmented reality which comprises a gaze-interlock event detection circuit and a gaze-interlock event processing unit.
    Type: Grant
    Filed: October 20, 2020
    Date of Patent: February 1, 2022
    Inventor: Maximilian Ralph Peter von und zu Liechtenstein
  • Patent number: 11232769
    Abstract: An image display system according to an embodiment of the present technology includes an image display unit, an acquisition unit, and a display control unit. The image display unit is capable of displaying an image and moves in association with a movement of a user. The acquisition unit acquires movement information regarding a movement of the image display unit. The display control unit causes the image display unit to execute suppression image display for suppressing an influence of the movement of the image display unit with respect to an external space on the basis of the acquired movement information.
    Type: Grant
    Filed: February 1, 2019
    Date of Patent: January 25, 2022
    Assignee: SONY CORPORATION
    Inventors: Koji Nagata, Takashi Saitoh, Yoshinori Nasada, Tomoya Takei, Jun Nishikawa
  • Patent number: 11232306
    Abstract: A display apparatus includes a communication interface, a camera, a display and a processor configured to receive information on a plurality of images including a first object image corresponding to an identical type of an object selected by a user and a second object image included in each of the plurality of images. The processor is configured to identify one from a plurality of images based on information on a third object image identified from an image photographed through the camera and the received second object image, and control the display to display an obtained image based on the identified image, a fourth object image corresponding to an object selected by the user, and the third object image is displayed.
    Type: Grant
    Filed: November 18, 2019
    Date of Patent: January 25, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Hyeseon Heo, Kyoungjae Park, Youngchun Ahn
  • Patent number: 11226678
    Abstract: A wearable computing system that includes a head-mounted display implements a gaze timer feature for enabling the user to temporarily extend the functionality of a handheld controller or other user input device. In one embodiment, when the user gazes at, or in the vicinity of, a handheld controller for a predetermined period of time, the functionality of one or more input elements (e.g., buttons) of the handheld controller is temporarily modified. For example, the function associated with a particular controller button may be modified to enable the user to open a particular menu using the button. The gaze timer feature may, for example, be used to augment the functionality of a handheld controller or other user input device during mixed reality and/or augmented reality sessions.
    Type: Grant
    Filed: December 28, 2020
    Date of Patent: January 18, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Karen Stolzenberg, Marc Alan McCall, Frank Alexander Hamilton, IV, Cole Parker Heiner, John Austin Day
  • Patent number: 11222728
    Abstract: A medical image display apparatus includes an image acquisition unit that receives an input of a three-dimensional brain image of a subject, a brain area division unit that divides the three-dimensional brain image of the subject into a plurality of brain areas, an image analysis unit that calculates an analysis value for each brain area from the three-dimensional brain image of the subject, a data acquisition unit that acquires information indicating a correspondence between the brain area and a function of the brain, a display unit, and a display controller that displays an image showing the brain image of the subject divided into the brain areas, a function of the brain corresponding to each of the brain areas, and the analysis value on the display unit in association with each other.
    Type: Grant
    Filed: January 30, 2020
    Date of Patent: January 11, 2022
    Assignee: FUJIFILM Corporation
    Inventors: Caihua Wang, Keigo Nakamura, Noriaki Ida