Viewer Attached Patents (Class 348/53)
  • Patent number: 11216095
    Abstract: A head-mounted display system may include a display device and a head-mounted device. The display device includes a touch screen surface exposed to an outside and including an active region which displays an image and senses a user input. The head-mounted device includes a frame, in which a reception space allowing the display device to be mounted therein is defined, and an optical system disposed in the frame. The active region of the display device includes a first active region, which is exposed to the outside and receives the user input for controlling the head-mounted device, when the display device is coupled with the head-mounted device.
    Type: Grant
    Filed: June 15, 2018
    Date of Patent: January 4, 2022
    Assignee: SAMSUNG DISPLAY CO., LTD.
    Inventor: Minsoo Kim
  • Patent number: 11202059
    Abstract: The image processing apparatus acquires image data to be displayed and generates an initial image to output the image to a head-mounted display. Further, the apparatus generates a reference image including an image for a left eye and an image for a right eye and representing an image of an object viewed from two viewpoints spaced apart horizontally. In the case where the inclination angle of the head of the user is other than 0 degrees, the apparatus rotates the image for the left eye and the image for the right eye in reverse to the head inclination, using one point defined on a view screen, as a common axis. The apparatus outputs the image data to the head-mounted display regardless of the presence or absence of rotation. The apparatus repeats the processes until the display ends.
    Type: Grant
    Filed: February 21, 2018
    Date of Patent: December 14, 2021
    Assignee: Sony Interactive Entertainment Inc.
    Inventor: Daisuke Kurata
  • Patent number: 11187895
    Abstract: A content generation system including an image generation unit operable to generate one or more images of a virtual environment for display at a first display device, and an image transmission unit operable to transmit generated images of the virtual environment to each of the first display device and the second display device, where the or each image displayed at one of the first display device and the second display device is a subset of the or each image displayed at the other of the first display device and the second display device, and where the viewpoint of the display device displaying a subset of the or each image is operable to modify the displayed field of view independently of the field of view displayed at the other display device.
    Type: Grant
    Filed: November 2, 2018
    Date of Patent: November 30, 2021
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Jesus Lucas Barcias, Claire Rogers, Douglas Ealey
  • Patent number: 11182958
    Abstract: In various embodiments, computerized methods and systems for rendering near-field objects as perceivable far-field objects within a virtual environment are provided. A determination is made that a near-field object to be rendered is configured for far-field perception within the virtual environment. The virtual environment is operable to include one or more virtualized near-field objects that are stereoscopically rendered utilizing one or more stereoscopic projection transforms generated based at least in part on a position and orientation of a head-mounted display. A harmonize transform is generated for the configured near-field object based at least in part on one of the stereoscopic projection transforms. Based on the determination that the near-field object is configured for far-field perception, the generated harmonize transform is employed to stereoscopically render the configured near-field object as a perceivable far-field object within the virtual environment.
    Type: Grant
    Filed: July 29, 2019
    Date of Patent: November 23, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventor: Patrick W. J. Evans
  • Patent number: 11175490
    Abstract: A shutter-type adaptive three-dimensional (3D) display system based on medical microscopic imaging is provided. In the system, a binocular camera is connected to an operating microscope optical system through a beam splitter, and is configured to acquire binocular image data. A control module is configured to input control instructions, where the control instructions include a first type of control instructions and a second type of control instructions. An image processing module calculates image parallaxes based on the binocular image data under the first type of control instructions, and transmits the image parallaxes to the binocular camera to adjust offsets. A display module is configured to generate display data based on the binocular image data and display the display data through a display device for viewing with 3D glasses. The operating microscope optical system is configured to perform an adjustment based on the control instructions.
    Type: Grant
    Filed: May 18, 2021
    Date of Patent: November 16, 2021
    Assignee: INSTITUTE OF AUTOMATION, CHINESE ACADEMY OF SCIENCES
    Inventors: Guibin Bian, Jinlian Song, Wenhao He, Zhen Li, Haitao Song
  • Patent number: 11166706
    Abstract: A surgical device includes a plurality of cameras integrated therein. The view of each of the plurality of cameras can be integrated together. A surgical tool that includes an integrated camera may be used in conjunction with the surgical device. The image produced by the camera integrated with the surgical tool may be associated with the images generated by the plurality of cameras integrated in the surgical device. The position and orientation of the cameras and/or the surgical tool can be tracked, and the surgical tool can be rendered as at least partially transparent. A surgical device may be powered by a hydraulic system, thereby reducing electromagnetic interference with tracking devices.
    Type: Grant
    Filed: March 18, 2019
    Date of Patent: November 9, 2021
    Assignee: CamPlex, Inc.
    Inventors: Steven T. Charles, John Tesar
  • Patent number: 11143904
    Abstract: A display device includes: a display module including elemental pixel groups, each of the elemental pixel groups being configured to display an elemental image for displaying a reproduced image; an elemental lens array including elemental lenses, the elemental lenses being provided in front of the elemental pixel groups in one-to-one correspondence; a diopter adjustment element array including diopter adjustment elements, the diopter adjustment elements being provided in front of the plurality of elemental lenses in one-to-one correspondence; and a controller. The controller is configured to: control a part of the diopter adjustment elements in accordance with visual acuity of one eye of a user; and control the other part of the diopter adjustment elements in accordance with visual acuity of the other eye of the user.
    Type: Grant
    Filed: September 20, 2018
    Date of Patent: October 12, 2021
    Assignee: TIANMA MICROELECTRONICS CO., LTD.
    Inventors: Masanori Shirokawa, Ken Sumiyoshi
  • Patent number: 11137967
    Abstract: In an exemplary process for interacting with user interface objects using an eye gaze, an affordance associated with a first object is displayed. A gaze direction or a gaze depth is determined. While the gaze direction or the gaze depth is determined to correspond to a gaze at the affordance, a first input representing user instruction to take action on the affordance is received, and the affordance is selected responsive to receiving the first input.
    Type: Grant
    Filed: March 24, 2020
    Date of Patent: October 5, 2021
    Assignee: Apple Inc.
    Inventors: Avi Bar-Zeev, Ryan S. Burgoyne, Devin W. Chalmers, Luis R. Deliz Centeno, Rahul Nair
  • Patent number: 11132827
    Abstract: The disclosure describes a distributed, pluggable architecture for an artificial reality (AR) system that enables concurrent execution and collaborative scene rendering for multiple artificial reality applications. For example, an AR system includes an image capture device configured to capture image data representative of a physical environment. The AR system also includes a head-mounted display (HMD) configured to output artificial reality content. The AR system further includes a plurality of concurrently executing artificial reality client applications. The AR system also includes a concurrent application engine configured to control rendering the artificial reality content as a common scene that include one or more objects from each of the plurality of artificial reality applications.
    Type: Grant
    Filed: September 19, 2019
    Date of Patent: September 28, 2021
    Assignee: Facebook Technologies, LLC
    Inventors: Denis Gladkov, Daniel Lehmann, Paul B. Menage, Clifford Merritt Boyd, Anton Vaneev, Luiz Alfonso Coimbra Barbosa Silva, Mandeep S Baines, Aaron David Lieberman, Rodney Huff, Cyril Daniel Saint Girons
  • Patent number: 11127219
    Abstract: Systems and methods are provided for displaying supplemental content for print media using augmented reality. A user profile for a user of an augmented reality device is determined. Content of the print media is searched to identify a first portion of the print media that matches the user profile and a second portion of the print media that does not match the user profile. Supplemental content is obtained based on content of the first portion of the print media. A display of the supplemental content is positioned over the second portion of the print media.
    Type: Grant
    Filed: January 22, 2020
    Date of Patent: September 21, 2021
    Assignee: Rovi Guides, Inc.
    Inventors: Lucas Waye, Theresa Tokesky, Michael A. Montalto, Kanagasabai Sivanadian
  • Patent number: 11113799
    Abstract: A display method and a display device are provided. The display method may be applied to a display device having a lens unit and a display unit for normal display, and may include steps of: detecting a first distance between the lens unit and the display unit; calculating correction information according to the first distance and transmitting the correction information to the display unit; and displaying a corrected image by the display unit according to the correction information, so that the corrected image is converged into eyes of a user via the lens unit, wherein the corrected image is obtained by correcting an original image according to the first distance.
    Type: Grant
    Filed: January 2, 2019
    Date of Patent: September 7, 2021
    Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD., BOE TECHNOLOGY GROUP CO., LTD.
    Inventors: Yukun Sun, Xuefeng Wang, Jinghua Miao, Wenyu Li, Jinbao Peng, Bin Zhao, Lixin Wang, Xi Li, Qingwen Fan, Jianwen Suo, Yali Liu, Yu Lei, Yakun Wang, Hao Zhang, Lili Chen
  • Patent number: 11113897
    Abstract: Systems and methods are provided herein for providing supplemental Augmented Reality (AR) content. Media content is provided to a user device located within a viewing area. A determination is made that a supplemental three dimensional (3D) AR content related to the media content is available. 3D characteristics of the supplemental AR content are determined. Such characteristics include a viewing angle and body position of an actor from the supplemental AR content. 3D characteristics of the viewing area are determined. Such characteristics include shape and position of the furniture within the viewing area and a position of a user within the viewing area. A position is determined within the viewing area by comparing the 3D characteristics of the supplemental AR content and the 3D characteristics of the viewing area. The supplemental AR content is then provided for display at the determined position.
    Type: Grant
    Filed: November 5, 2019
    Date of Patent: September 7, 2021
    Assignee: ROVI GUIDES, INC.
    Inventors: Vikram Makam Gupta, Harsha Neerakani, Nimit Dineshbhai Kalaria
  • Patent number: 11086197
    Abstract: The present invention relates to a photographing system. The photographing system may include a photographing device having a lens for capturing image data of a human; a display panel having a screen configured to display the image data of the human; and a semi-transparent mirror disposed between the human and the photographing device and at an angle to the screen of the display panel. The photographing device may capture the image data of the human through the semi-transparent mirror. The semi-transparent mirror may be disposed to reflect the image data of the human on the screen of the display panel so that a reflection of the image data of the human appears on the semi-transparent mirror.
    Type: Grant
    Filed: August 28, 2020
    Date of Patent: August 10, 2021
    Inventors: Yongtong Hu, David Hu
  • Patent number: 11080943
    Abstract: Embodiments of the present invention relate to the field of communications technologies, and disclose a method and an apparatus for displaying with a 3D parallax effect, to generate a relatively good 3D parallax effect. A specific solution is: displaying a graphical user interface, where the graphical user interface includes first content, and the first content includes at least two elements; obtaining a first operation instruction which is used for moving, in an area for displaying the first content, at least one first element of the at least two elements; and moving each of the at least one first element by a different distance along a direction of a first straight line, so that the first content has a 3D parallax effect, where the direction of the first straight line is a direction having a preset included angle with a plane in which the graphical user interface is located.
    Type: Grant
    Filed: April 17, 2020
    Date of Patent: August 3, 2021
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Xin Xin, Yu Gao, Jun Chen
  • Patent number: 10950058
    Abstract: A method for providing XR content includes obtaining a first 2D image representing a user's face, determining whether an object which is not the user's face is included in the first 2D image, in response to determining that the object is included in the acquired first 2D image, generating a second 2D image representing the user's face without the object based on the first 2D image, generating a first 3D image corresponding to the generated second 2D image, generating a mask image representing a difference between the first 2D image and the second 2D image, determining a type of object based on the generated mask image, obtaining a 3D preset including one or more 3D images corresponding to the determined type of object, generating a second 3D by combining at least one of one or more 3D images with the first 3D image and providing XR content including the generated second 3D image.
    Type: Grant
    Filed: August 28, 2019
    Date of Patent: March 16, 2021
    Assignee: LG ELECTRONICS INC.
    Inventors: Dahye Yoon, Seunghoon Lee
  • Patent number: 10901224
    Abstract: A wearable computing device having a main computing element having a center portion and at least two arms and a display element operably connected to arms to enclose a region within which a body part may be inserted. Each arm may include a docking element connectable to the display element and may be configured to slide within the arm to move the display element relative to the center portion of the main computing element. A pivot arm may pivotably connect the display element to the slider arm to permit pivoting of the display element relative to the plane of the main computing element.
    Type: Grant
    Filed: April 28, 2017
    Date of Patent: January 26, 2021
    Assignee: Intel Corporation
    Inventors: Jeff Ku, Gavin Sung, Simon S. Yuan, Lance Lin, Jason Y Jiang
  • Patent number: 10866632
    Abstract: The technology disclosed relates to a method of realistic simulation of real world interactions as virtual interactions between a control object sensed acting in a three-dimensional (3D) sensory space and the virtual object in a virtual space that the control object interacts with. In particular, it relates to detecting free-form gestures of a control object in a three-dimensional (3D) sensory space and generating for display a 3D solid control object model for the control object during the free-form gestures, including sub-components of the control object and in response to detecting a free-form gesture of the control object in the 3D sensory space in virtual contact with the virtual object, depicting, in the generated display, the virtual contact and resulting motions of the virtual object by the 3D solid control object model.
    Type: Grant
    Filed: September 30, 2019
    Date of Patent: December 15, 2020
    Assignee: Ultrahaptics IP Two Limited
    Inventors: John Adrian Arthur Johnston, Johnathon Scott Selstad, Alex Marcolina
  • Patent number: 10869013
    Abstract: Provided is a method for creating a virtual reality content, storing the virtual reality content in a transmission buffer, and after that, managing the transmission buffer. A server creates the virtual reality content based on user's motion information, stores the virtual reality content in the transmission buffer and is allowed to modify the virtual reality content stored in the transmission buffer based on subsequently received user's motion information, so that the most recent user's motion information can be appropriately reflected in the virtual reality content. It is possible to provide a more immersive virtual reality service.
    Type: Grant
    Filed: July 18, 2019
    Date of Patent: December 15, 2020
    Assignee: FOUNDATION FOR RESEARCH AND BUSINESS, SEOUL NATIONAL UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventor: Ji Hoon Yun
  • Patent number: 10838210
    Abstract: A display system can include a head-mounted display configured to project light to an eye of a user to display augmented reality image content to the user. The display system can include one or more user sensors configured to sense the user and can include one or more environmental sensors configured to sense surroundings of the user. The display system can also include processing electronics in communication with the display, the one or more user sensors, and the one or more environmental sensors. The processing electronics can be configured to sense a situation involving user focus, determine user intent for the situation, and alter user perception of a real or virtual object within the vision field of the user based at least in part on the user intent and/or sensed situation involving user focus. The processing electronics can be configured to at least one of enhance or de-emphasize the user perception of the real or virtual object within the vision field of the user.
    Type: Grant
    Filed: July 24, 2017
    Date of Patent: November 17, 2020
    Assignee: Magic Leap, Inc.
    Inventors: Nastasja U. Robaina, Nicole Elizabeth Samec, Christopher M. Harrises, Rony Abovitz, Mark Baerenrodt, Brian Lloyd Schmidt
  • Patent number: 10802278
    Abstract: Technology is described for (3D) space carving of a user environment based on movement through the user environment of one or more users wearing a near-eye display (NED) system. One or more sensors of the NED system provide sensor data from which a distance and direction of movement can be determined. Spatial dimensions for a navigable path can be represented based on user height data and user width data of the one or more users who have traversed the path. Space carving data identifying carved out space can be stored in a 3D space carving model of the user environment. The navigable paths can also be related to position data in another kind of 3D mapping like a 3D surface reconstruction mesh model of the user environment generated from depth images.
    Type: Grant
    Filed: January 9, 2019
    Date of Patent: October 13, 2020
    Assignee: Microsoft Technology Licensing LLC
    Inventors: Anthony J. Ambrus, Jea Gon Park, Adam G. Poulos, Justin Avram Clark, Michael Jason Gourlay, Brian J. Mount, Daniel J. McCulloch, Arthur C. Tomlin
  • Patent number: 10803832
    Abstract: A method of coordinating a mixed-reality (MR) configured head-mounted display (HMD) with a separate media device to enable a synchronized user experience. The method includes establishing a communication channel between the HMD and the media device. At least one of the following is performed via the communication channel: accessing content on the media device or executing control commands on the media device based on an interface displayed by the HMD, or detecting media content presented by the media device and synchronizing display of MR content on the HMD and the detected media content.
    Type: Grant
    Filed: June 12, 2018
    Date of Patent: October 13, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: David H. Chung, Nils Harrison, Brian Nhu Dang, Christopher F. Lee
  • Patent number: 10762691
    Abstract: Examples described herein generally relate to displaying an image on a display device where a motion during a latency between a first time associated with activating a first portion of the display device and a second time associated with activating a second portion of the display device is predicted. At least a second portion of an image, to be displayed at the second time, is distorted based at least in part on a function of the motion and the latency to compensate for the latency. A first portion of the image is displayed at the first time by activating the first portion of the display device. The second portion of the image, as distorted, is displayed at the second time by activating the second portion of the display device.
    Type: Grant
    Filed: February 14, 2018
    Date of Patent: September 1, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Andrew Zicheng Yeung, Brent Michael Wilson, Jack Andrew Elliott, Matthew David Sandy, Michael George Boulton, Yang You
  • Patent number: 10757325
    Abstract: A video server comprises a video encoder to encode video data representing panoramic video content in which the panoramic video content has a greater field of view than a displayable region at a client device, the video encoder being configured to encode spatial regions within the video content at different respective encoding qualities in dependence upon track data indicating, for temporal positions with respect to the panoramic video content, a preferred viewing region within the panoramic video content at those temporal positions, so that the preferred viewing region is encoded at a higher encoding quality than another region of the panoramic video content.
    Type: Grant
    Filed: October 14, 2016
    Date of Patent: August 25, 2020
    Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
    Inventors: Phillip Rogers, Quoc Dat Nguyen, Rohan Pankaj Bangdiwala, David Peter Woodhouse, Anthony Godar
  • Patent number: 10748338
    Abstract: An index extraction unit detects indices from a sensed image sensed by a sensing unit which senses an image of a physical space on which a plurality of indices is laid out. A convergence arithmetic unit calculates position and orientation information of the sensing unit based on the detected indices. A CG rendering unit generates a virtual space image based on the position and orientation information. A sensed image clipping unit extracts, as a display image, an image in a display target region from the sensed image. An image composition unit generates a composite image by compositing the extracted display image and the generated virtual space image. A display unit displays the composite image.
    Type: Grant
    Filed: December 14, 2016
    Date of Patent: August 18, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventors: Makoto Oikawa, Takuya Tsujimoto
  • Patent number: 10740969
    Abstract: A method for the production of immersive virtual reality experiences designed for viewing in virtual reality head-mounted displays (HMD). This unique layered panorama process is a cubic or spherical mapped content method for presentation of pre-rendered images viewed from a fixed point of view in a head mounted display for virtual reality (VR) applications, a method that by mapping/layering all visual elements onto a mono or stereoscopic spherical or cubic panorama surface creates a seamless visual integration.
    Type: Grant
    Filed: June 4, 2019
    Date of Patent: August 11, 2020
    Assignee: EVOX Productions, LLC
    Inventors: David Falstrup, Ryan Murray, Alex McClain, Pat Hadnagy, Thom Denick, Claudia Nefately Ambriz
  • Patent number: 10728532
    Abstract: An approach for projecting light may be implemented using a acousto-optical depth switch that uses surface acoustic waves produced along a substrate to guide image light to different areas. The surface acoustic waves may be generated on a substrate using a transducer. Surface acoustic waves of different frequencies can guide image light onto different optical elements at different physical positions. The optical elements may be configured to show objects in an image at different distances from a viewer.
    Type: Grant
    Filed: January 30, 2019
    Date of Patent: July 28, 2020
    Assignee: Magic Leap, Inc.
    Inventors: Hudson Welch, Jeremy A. Grata, Marwan Hussein
  • Patent number: 10685211
    Abstract: A head-mounted display, a display control method, and a program that facilitate a user to understand proximity between the user and an object around the user are provided. A display block (36) is arranged in front of the eyes of the user wearing a HMD (12). In accordance with proximity between the user and an object around the user, the HMD (12) controls the display block (36) so as to have the user visually recognize a forward direction of the display block (36).
    Type: Grant
    Filed: August 2, 2016
    Date of Patent: June 16, 2020
    Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
    Inventors: Yuichiro Nakamura, Yasushi Okumura
  • Patent number: 10666932
    Abstract: The general field of the invention is that of monochromatic stereoscopic image projectors including two light sources that illuminate two imagers, the radiation of the two light sources having a spectral distribution centred on a central wavelength, the first imager and the second imager being connected to a generator of stereoscopic image pairs. The image projector includes a dichroic separating filter that transmits the portion of the spectrum below the central wavelength and that reflects the portion of the spectrum above this central wavelength. The first light source and the second light source are arranged symmetrically on either side of the dichroic separating filter. The image projector operates cyclically, each cycle including two alternations. Each alternation consists in changing the emission source and in switching to the two displays the left and right images emitted by the generator of image pairs.
    Type: Grant
    Filed: March 30, 2017
    Date of Patent: May 26, 2020
    Assignee: THALES
    Inventors: Philippe Coni, Aude Gueguen, Matthieu Grossetete
  • Patent number: 10665027
    Abstract: An apparatus comprising: at least one processor; and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following: based on a virtual reality space provided for viewing by a first user and a physical location of the first user, provide for display of an augmented reality graphic for viewing by a second, different user, in an augmented reality view, said augmented reality graphic comprising an image of at least part of the virtual reality space provided to the first user which is displayed at a position corresponding to the physical location of the first user to at least partially surround the first user in the augmented reality view, such that the second user can see the at least part of the virtual reality space experienced by the first user.
    Type: Grant
    Filed: February 6, 2017
    Date of Patent: May 26, 2020
    Assignee: Nokia Technologies Oy.
    Inventors: Jussi Leppänen, Antti Eronen, Arto Lehtiniemi
  • Patent number: 10652525
    Abstract: Embodiments allow different viewers of a shared display to see different images. Images may have different combinations of polarization and time slices that correspond to filters in glasses worn by the viewers. The images viewed by each of the glasses may be based on the tracked position and orientation of the glasses, so that the images correspond to the user's viewpoint. Different images may be presented to left and right eyes for 3D stereoscopic viewing. The lenses of the glasses may have a filter that selects light of a specific polarization combined with a shutter that passes images during a specific time slice. The polarization filter may select circularly polarized images of a desired orientation and emit linearly polarized images. The shutter may use liquid crystals to twist the linearly polarized images during the desired time slice so that a final linear polarizer passes the image to the viewer.
    Type: Grant
    Filed: May 29, 2018
    Date of Patent: May 12, 2020
    Assignee: 3DI LLC
    Inventor: David Paul Woods
  • Patent number: 10572010
    Abstract: The present disclosure relates to a virtual reality display device and an adaptive parallax adjustment method for the virtual reality display device, which belong to the display technical field. The adaptive parallax adjustment method includes: obtaining pupil distance information of a user; and adjusting a position of a to-be-displayed image on a display screen according to the pupil distance information.
    Type: Grant
    Filed: July 6, 2018
    Date of Patent: February 25, 2020
    Assignees: BOE TECHNOLOGY GROUP CO., LTD., BEIJING OPTOELECTRONICS TECHNOLOGY CO., LTD.
    Inventors: Yinwei Chen, Minglei Chu, Chenru Wang
  • Patent number: 10521013
    Abstract: A method, an electronic device and a non-transitory computer readable medium for are provided. The method includes capturing a first eye and a second eye. The method also includes identifying a first position of the first eye and a second position the second eye. Additionally, the method includes staggering the capture of the first eye and the second eye, wherein the first eye is captured prior to capturing the second eye. The method also includes identifying the first gaze direction with respect to a display. The method further includes mapping the second gaze direction of the second eye based on the identified first gaze direction, prior to capturing the second eye.
    Type: Grant
    Filed: March 1, 2018
    Date of Patent: December 31, 2019
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Injoon Hong, Sourabh Ravindran
  • Patent number: 10515482
    Abstract: Disclosed herein are systems and methods for configuring a multi-device digital experience. In an embodiment, the method includes presenting a first content portion of a digital experience via a wearable display device in an environment; presenting a second content portion of the digital experience via a first device in a set of one or more devices in the environment; capturing test-signal-output data presented by the first device, the test-signal-output data being captured by the wearable display device in the environment, the test-signal-output data being based on a test signal sent to the first device; estimating spatial-characteristic data of the first device based on the captured test-signal-output data; and modifying the presentation of the second content portion of the digital experience via the first device based on the estimated spatial-characteristic data of the first device.
    Type: Grant
    Filed: August 17, 2016
    Date of Patent: December 24, 2019
    Assignee: PCMS Holdings, Inc.
    Inventor: Tatu V. J. Harviainen
  • Patent number: 10503247
    Abstract: One disclosed example provides a head-mounted device including a stereo camera arrangement, a logic device configured to execute instructions, and a storage device storing instructions executable by the logic device to, for each camera in the stereo camera arrangement, receive image data of a field of view of the camera, detect light sources of a handheld object in the image data, and based upon the light sources detected, determine a pose of the handheld object. The instructions are executable to, based upon the pose of the handheld object determined for each camera in the stereo camera arrangement, calibrate the stereo camera arrangement.
    Type: Grant
    Filed: November 29, 2017
    Date of Patent: December 10, 2019
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Michael Edward Samples, Alexandru Octavian Balan, Salim Sirtkaya, Vuk Jovanovic, Filip Panjevic, Taras Khapko, Ruven Jaime Rivera, III
  • Patent number: 10474233
    Abstract: Methods and apparatus relating to enabling augmented reality applications using eye gaze tracking are disclosed. An exemplary method according to the disclosure includes displaying an image to a user of a scene viewable by the user, receiving information indicative of an eye gaze of the user, determining an area of interest within the image based on the eye gaze information, determining an image segment based on the area of interest, initiating an object recognition process on the image segment, and displaying results of the object recognition process.
    Type: Grant
    Filed: May 2, 2018
    Date of Patent: November 12, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: Ashwin Swaminathan, Mahesh Ramachandran
  • Patent number: 10477198
    Abstract: A display control method with which a captioned image can be displayed in the visual field of a user irrespective of a change in the line-of-sight direction of the user. The display control method includes a step of generating visual-field image data, which represents a visual-field image, based on the line-of-sight direction of a user and 360-degree space image data. The method further includes a step of receiving captioned image data, which represents a captioned image. The method further includes a step of displaying on an HMD a composite image of the visual-field image and from the captioned image, based on the visual-field image data and the captioned image data. The composite image is displayed is displayed at a given place in the visual-field image irrespective of a change in the line-of-sight direction of the user.
    Type: Grant
    Filed: April 7, 2017
    Date of Patent: November 12, 2019
    Assignee: COLOPL, INC.
    Inventor: Eita Kikuchi
  • Patent number: 10473941
    Abstract: A virtual reality goggle includes a goggle shaped body having multiple cameras mounted thereon. A display is supported by the goggle shaped body. A support extends between sides of the goggle shaped body and includes multiple cameras. Circuitry is coupled to receive video from the multiple cameras, the video comprising a composite field of view of approximately 360 degrees about the goggle, the circuitry to couple to a wireless communication device to transmit the received video to networked processing services, and to receive stitched stereoscopic three dimensional virtual reality video from the networked processing services, the circuitry further coupled to provide the received stitched stereoscopic three dimensional virtual reality video for display.
    Type: Grant
    Filed: October 31, 2017
    Date of Patent: November 12, 2019
    Assignee: Futurewei Technologies, Inc.
    Inventor: Tian Shen
  • Patent number: 10466107
    Abstract: A method for determining an optical performance parameter of a head mounted display device adapted for a wearer includes a head mounted display device providing step, during which a head mounted display device adapted for a wearer is provided, an optical measurement device providing step, during which an optical measurement device is provided that includes an entrance pupil and a sensor receiving light through the entrance pupil, a positioning step, during which the optical measurement device and the head mounted display device are positioned so that the position of the entrance pupil of the optical measurement device corresponds to the position of the pupil of the wearer when wearing the head mounted display device, an optical performance parameter determining step during which at least one optical performance parameter of the head mounted see-through display device is determined based on the data measured by the optical measurement device.
    Type: Grant
    Filed: October 30, 2017
    Date of Patent: November 5, 2019
    Assignee: Essilor International
    Inventors: Marius Peloux, Loic Baillon, Ludovic Jouard
  • Patent number: 10440334
    Abstract: An MRI-compatible video projector system with improved safety features, comprising a projector module, a liquid cooling system, comprising a coolant block of non-magnetic material disposed in or adjacent the housing of the projector and heat generating components, a coolant pump situated remotely from the projector, and coupled to the coolant block by coolant lines carrying liquid to and from the coolant block, and a projector power system situated remotely from the projector.
    Type: Grant
    Filed: April 18, 2018
    Date of Patent: October 8, 2019
    Assignee: Resonance Technology, Inc.
    Inventor: Mokhtar Ziarati
  • Patent number: 10432906
    Abstract: A recording medium according an aspect of the present disclosure has recorded therein a main video stream where a main video has been encoded, and a sub-video stream where a sub-video, that is to be superimposed on the main video and displayed, has been encoded. The sub-video stream includes bitmap data indicating a design of the sub-video and palette data specifying the display color of the design. The palette data includes first palette data for a first luminance dynamic range (SDR), and second palette data for a second luminance dynamic range (HDR) that is broader than the first dynamic range.
    Type: Grant
    Filed: August 30, 2017
    Date of Patent: October 1, 2019
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Hiroshi Yahata, Tadamasa Toma
  • Patent number: 10379362
    Abstract: The present invention relates to a head mounted display (HMD) capable of receiving an image through a camera. An HMD according to an embodiment of the present invention comprises: a main body configured to be worn on a user's head; a camera equipped in the main body; a sensing unit configured to measure the distance between the main body and a subject corresponding to the image received through the camera; and a control unit which determines a plurality of feature points satisfying preset conditions in the image, measured, by means of the sensing unit, the distance between the main body and the subject corresponding to at least one of the plurality of feature points, and determines the movement of the main body on the basis of at least one of the plurality of feature points and the measured distance.
    Type: Grant
    Filed: August 5, 2015
    Date of Patent: August 13, 2019
    Assignee: LG ELECTRONICS INC.
    Inventors: Sungmin Baek, Soungmin Im
  • Patent number: 10366536
    Abstract: In various embodiments, computerized methods and systems for rendering near-field objects as perceivable far-field objects within a virtual environment are provided. A determination is made that a near-field object to be rendered is configured for far-field perception within the virtual environment. The virtual environment is operable to include one or more virtualized near-field objects that are stereoscopically rendered utilizing one or more stereoscopic projection transforms generated based at least in part on a position and orientation of a head-mounted display. A harmonize transform is generated for the configured near-field object based at least in part on one of the stereoscopic projection transforms. Based on the determination that the near-field object is configured for far-field perception, the generated harmonize transform is employed to stereoscopically render the configured near-field object as a perceivable far-field object within the virtual environment.
    Type: Grant
    Filed: June 28, 2016
    Date of Patent: July 30, 2019
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventor: Patrick W. J. Evans
  • Patent number: 10311636
    Abstract: A method for the production of immersive virtual reality experiences designed for viewing in virtual reality head-mounted displays (HMD). This unique layered panorama process is a cubic or spherical mapped content method for presentation of pre-rendered images viewed from a fixed point of view in a head mounted display for virtual reality (VR) applications, a method that by mapping/layering all visual elements onto a mono or stereoscopic spherical or cubic panorama surface creates a seamless visual integration.
    Type: Grant
    Filed: July 29, 2016
    Date of Patent: June 4, 2019
    Assignee: Evox Productions, LLC
    Inventors: David Falstrup, Ryan Murray, Alex McClain, Pat Hadnagy, Thom Denick, Claudia Nefately Ambriz
  • Patent number: 10284751
    Abstract: An optical scanning head-mounted display includes an optical scanning controller that emits, as image light, a laser beam in accordance with an image signal; a transmission cable that transmits the image light emitted from the optical scanning controller; and a head mount unit provided with an optical scanner including a mirror for scanning the image light transmitted by the transmission cable, wherein the head mount unit includes an amplifier that amplifies a motion signal corresponding to a tilt of the mirror, the motion signal being output from the optical scanner, and wherein the optical scanning controller includes a difference generator that generates a difference signal from the motion signal output from the amplifier through the transmission cable and a filter that removes noise from the difference signal generated by the difference generator.
    Type: Grant
    Filed: August 30, 2017
    Date of Patent: May 7, 2019
    Assignee: MITSUMI ELECTRIC CO., LTD.
    Inventor: Kimiyuki Oba
  • Patent number: 10237540
    Abstract: An approach for projecting light may be implemented using a acousto-optical depth switch that uses surface acoustic waves produced along a substrate to guide image light to different areas. The surface acoustic waves may be generated on a substrate using a transducer. Surface acoustic waves of different frequencies can guide image light onto different optical elements at different physical positions. The optical elements may be configured to show objects in an image at different distances from a viewer.
    Type: Grant
    Filed: May 21, 2018
    Date of Patent: March 19, 2019
    Assignee: MAGIC LEAP, INC.
    Inventors: Hudson Welch, Jeremy A. Grata, Marwan Hussein
  • Patent number: 10203505
    Abstract: A head-mounted display includes a camera that obtains an image of an object within a field of view. The head-mounted display further includes a processor configured to determine a plurality of feature points from the image and calculate a feature strength for each of the plurality of feature points. The processor is further configured to divide the image into a plurality of cells and select feature points having the highest feature strength from each cell and which have not yet been selected. The processor being further configured to detect and track the object within the field of view using the selected feature points.
    Type: Grant
    Filed: November 16, 2017
    Date of Patent: February 12, 2019
    Assignee: SEIKO EPSON CORPORATION
    Inventors: Alex Levinshtein, Mikhail Brusnitsyn, Andrei Mark Rotenstein
  • Patent number: 10178150
    Abstract: A method, computer program product and system for eye contact-based information transfer. Communication is established by a computer device between a first head mounted device worn by a first user and a second head mounted device worn by a second user. Gaze tracking establishes through gaze tracking of the first head mounted device and the second head mounted device that the first head mounted device and the second head mounted device have made eye contact. Responsive to an input to at least one of the first head mounted device and the second head mounted device made while the first head mounted device and the second head mounted device have established eye contact, a computer device transfers a file between the first head mounted device and the second head mounted device.
    Type: Grant
    Filed: August 7, 2015
    Date of Patent: January 8, 2019
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventor: Sarbajit K. Rakshit
  • Patent number: 10152851
    Abstract: A head-mounted display device may display a notification artifact for another display device. Using image data of a physical environment, a three dimensional model of the environment may be generated. Locations of the head-mounted display device and the other display device within the model may be determined. Notification data for the other display device may be received. Based on the location of the other display device relative to the head-mounted display device, the notification artifact for the other display device may be displayed within the physical environment.
    Type: Grant
    Filed: November 29, 2016
    Date of Patent: December 11, 2018
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Srinivas Raghu Gatta, Richard Fang
  • Patent number: 10122985
    Abstract: The disclosure provides methods and systems for warning a user of a head mounted display that the user approaches an edge of field of view of a camera or one or more tangible obstacles. The warning includes presenting audio and/or displayable messages to the user, or moving the display(s) of the head mounted displays away of the user's eyes. The determination that the user approaches the edge of scene or a tangible obstacle is made by dynamically tracking motions of the users through analysis of images and/or depth data obtained from image sensor(s) and/or depth sensor(s) secured to either the head mounted display, arranged outside of the scene and not secured to the head mounted display, or a combination of both.
    Type: Grant
    Filed: August 7, 2017
    Date of Patent: November 6, 2018
    Assignee: Sony Interactive Entertainment Inc.
    Inventor: Jeffrey Roger Stafford
  • Patent number: 10055887
    Abstract: A system and method of operating an audio visual device generating a virtual immersive experience is provided. The system may include an optical system and a display system received in a housing, and an audio output device operably coupled to the display system, the housing being coupled to a frame to be worn by a user. A sensing device may sense at least one of an ambient brightness level or an ambient noise level, and a control system and processor operably coupled to the optical system, the display system, the audio output device and the sensing device may, in response to an external command to transition between the virtual environment and the ambient environment, adjust at least one of a brightness level or a noise level of the virtual environment based on the sensed ambient brightness level and/or the sensed ambient noise level before executing the received external command.
    Type: Grant
    Filed: February 19, 2015
    Date of Patent: August 21, 2018
    Assignee: GOOGLE LLC
    Inventors: Leandro Gracia Gil, Christian Plagemann, Alexander James Faaborg, Joshua Weaver, Michael Simonian, Glen Murphy, Jon Wiley