Operator Body-mounted Heads-up Display (e.g., Helmet Mounted Display) Patents (Class 345/8)
  • Patent number: 11967021
    Abstract: Various techniques pertaining to methods, systems, and computer program products a spatial persistence process that places a virtual object relative to a physical object for an extended-reality display device based at least in part upon a persistent coordinate frame (PCF). A determination is made to decide whether a drift is detected for the virtual object relative to the physical object. upon or after detection of the drift or deviation, the drift or deviation is corrected at least by updating a tracking map into an updated tracking map and further at least by updating the persistent coordinate frame (PCF) based at least in part upon the updated tracking map, wherein the persistent coordinate frame (PCF) comprises six degrees of freedom relative to the map coordinate system.
    Type: Grant
    Filed: May 16, 2023
    Date of Patent: April 23, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Yilun Cao, Mohan Babu Kandra, David Geoffrey Molyneaux, Daniel Olshansky, David Paul Pena, Frank Thomas Steinbrücker, Rafael Domingos Torres
  • Patent number: 11967148
    Abstract: In a display device 100, a photographing unit 12 is configured to photograph the surroundings of the display device 100, and the recognizing unit 16 is configured to recognize a clock 300 (a real object regarding a time or date) from a result of the photographing. When the recognizing unit 16 recognizes the clock 300, the schedule obtaining unit 11 is configured to obtain schedule information, and the display controller 17 is configured to display and output the schedule information in accordance with a position of the clock 300. In this case, since the display device 100 displays the schedule information in accordance with the position of the clock 300, the schedule information can be displayed in association with actual environment, and the schedule information can be outputted in a format that is easier to recognize the schedule information.
    Type: Grant
    Filed: November 15, 2019
    Date of Patent: April 23, 2024
    Assignee: MAXELL, LTD.
    Inventor: Naohisa Takamizawa
  • Patent number: 11953696
    Abstract: The present disclosed subject matter relates to a display device for displaying an image to an eye, comprising a support mounting a light source and a mirror assembly. The light source is configured to emit a visible light beam carrying the image towards the mirror assembly, and the mirror assembly is configured to angularly oscillate and deflect the emitted visible light beam towards the eye. A light sensor is mounted on the support and configured to record return light received via said mirror assembly from the eye. The display device further comprises a processor connected to the light sensor and configured to detect a state of the eye from the recorded return light.
    Type: Grant
    Filed: March 9, 2023
    Date of Patent: April 9, 2024
    Assignee: TriLite Technologies GmbH
    Inventors: Louahab Noui, Joerg Reitterer
  • Patent number: 11953694
    Abstract: A right temple member and a left temple member are provided, close to a display unit, at inner side faces of a right case member and a left case member that store at least a part of the display unit. A right support member and a left support member are provided at the right temple member and the left temple member. Accordingly, the provision of the right support member and the left support member enables to adjust a degree of opening and an inward repulsive force of the right temple member and the left temple member.
    Type: Grant
    Filed: March 25, 2021
    Date of Patent: April 9, 2024
    Assignee: SEIKO EPSON CORPORATION
    Inventor: Kazuya Kamakura
  • Patent number: 11947731
    Abstract: Aspects of the subject technology provide for intention-based user interface control for electronic devices. For example, an electronic device may utilize multiple indirect engagement indicators performed by a user of the electronic device, to confirm which of several displayed user interfaces with which the user intends to engage. Once the electronic device determines which of the multiple user interfaces the user intends to engage with, the electronic device may provide a user input to the application or other process underlying that user interface. The user input may be based, in whole or in part, one or more of the multiple indirect engagement indicators.
    Type: Grant
    Filed: March 22, 2023
    Date of Patent: April 2, 2024
    Assignee: Apple Inc.
    Inventors: James T. Turner, Peter L. Hajas
  • Patent number: 11947116
    Abstract: A method and an apparatus are defined for displaying images on a flexible display in a head-mountable device (HMD). One or more flexible display devices may be inserted in the HMD. The one or more flexible display devices may be constrained by the HMD to take a particular curved form and wrap the field of view (FOV) of images displayed on the one or more flexible display devices for an improved user experience. The display surface of the one or more flexible displays may be divided in display areas, the display areas corresponding to a focus area and a peripheral FOV. Image processing may be differentiated according to display area.
    Type: Grant
    Filed: March 18, 2020
    Date of Patent: April 2, 2024
    Assignee: INTERDIGITAL VC HOLDINGS, INC.
    Inventors: Pierre Andrivon, Franck Galpin, Fabrice Urban
  • Patent number: 11947122
    Abstract: A tracking system for use in head-mounted device (HMD) includes light sources arranged spatially around user-interaction controller(s); controller-pose-tracking means arranged in user-interaction controller(s); HMD-pose-tracking means; camera(s) arranged on portion of HMD that faces real-world environment in which HMD is in use; and processor(s) configured to estimate relative pose, based on controller-pose-tracking data and HMD-pose-tracking data; determine sub-set of light sources, based on estimated relative pose and arrangement of light sources; selectively control light sources such that light sources of sub-set are activated, whereas remaining light sources are deactivated; process at least one image, captured by camera(s), to identify operational state of light source(s) of sub-set that is visible in image(s), wherein image(s) is indicative of actual relative pose; and correct estimated relative pose to determine actual relative pose, based on operational state.
    Type: Grant
    Filed: December 8, 2022
    Date of Patent: April 2, 2024
    Assignee: Varjo Technologies Oy
    Inventors: Roman Golovanov, Oleksandr Dovzhenko, Juha Ala-Luhtala
  • Patent number: 11941172
    Abstract: A method for training an eye tracking model is disclosed, as well as a corresponding system and storage medium. The eye tracking model is adapted to predict eye tracking data based on sensor data from a first eye tracking sensor. The method comprises receiving sensor data obtained by the first eye tracking sensor at a time instance and receiving reference eye tracking data for the time instance generated by an eye tracking system comprising a second eye tracking sensor. The reference eye tracking data is generated by the eye tracking system based on sensor data obtained by the second eye tracking sensor at the time instance. The method comprises training the eye tracking model based on the sensor data obtained by the first eye tracking sensor at the time instance and the generated reference eye tracking data.
    Type: Grant
    Filed: July 6, 2022
    Date of Patent: March 26, 2024
    Assignee: Tobii AB
    Inventors: Carl Asplund, Patrik Barkman, Anders Dahl, Oscar Danielsson, Tommaso Martini, Mårten Nilsson
  • Patent number: 11941167
    Abstract: A head-mounted VR all-in-one machine comprises a front cover plate. Four first tracking cameras are arranged on an outer side frame of the front cover plate, two second tracking cameras are respectively arranged at positions on an inner side of the front cover plate that are close to the left eye and the right eye of a user, and a third tracking camera is arranged at a position on the lower bottom of the front cover plate that is close to the mouth of the user, wherein the four first tracking cameras and an IMU sensor form a 6DoF user head tracking module, the two second tracking cameras form a user eyeball tracking module, the two second tracking cameras and the one third tracking camera form a user facial expression recognition module, and the four first tracking cameras form a user bare hand recognition tracking module in a multiplexed manner.
    Type: Grant
    Filed: November 4, 2021
    Date of Patent: March 26, 2024
    Assignee: QINGDAO PICO TECHNOLOGY CO., LTD
    Inventor: Tao Wu
  • Patent number: 11942989
    Abstract: There is provided a method including receiving an incoming ID at a first wearable heads-up display (WHUD), which incoming ID is associated with a communicant device. The method also includes sending match data from the first WHUD to a match engine. The match data includes a first WHUD ID and the incoming ID. Moreover, the method includes receiving a match indicator at the first WHUD from the match engine. The match indicator is to indicate a match event between the first WHUD and the communicant device based on the match data. Furthermore, the method includes effecting communication between the first WHUD and the communicant device comprising at least one of sending a message from the first WHUD to the communicant device and receiving at the first WHUD a corresponding message from the communicant device. The first WHUD, and a method of operating the match engine are also described.
    Type: Grant
    Filed: March 31, 2021
    Date of Patent: March 26, 2024
    Assignee: GOOGLE LLC
    Inventors: Ido Raveh, Stuart James Myron Nicholson
  • Patent number: 11934735
    Abstract: A method and a device capable of supporting various display methods using an electronic device and/or glasses-type wearable electronic device (e.g., AR glasses) in an augmented reality (AR) are provided. An AR providing device for AR services includes a display and a processor. The processor is configured to provide content through an AR screen, detect a specified external object through the AR screen while providing the content, determine a display mode for providing the content, based on detection of the specified external object, control to display the content through a display of the specified external object, based on the determined display mode, and perform control to display the content through a virtual display area associated with the specified external object on the AR screen, based on the determined display mode.
    Type: Grant
    Filed: November 22, 2022
    Date of Patent: March 19, 2024
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Youngchan Woo, Donghee Kang, Choonkyoung Moon, Christian Park, Joayoung Lee, Jiwon Jeon, Hoon Han
  • Patent number: 11933982
    Abstract: Methods and systems are provided for using a user's line of sight (LOS) and/or gaze direction to enhance displayed data and control various displays and instruments. The user's LOS is tracked, corresponding element(s) in a scene at which the user gazes are identified, e.g., in a database, and respective displayed data are enhanced or otherwise manipulated with respect to the identified element(s). The database may be multilayered and may comprise data layers which are conformal to a scene representation. Users may also select, using their LOS, among multiple layers of information and among multiple displayed parts to enhance or attenuate respective layers or parts. Designated elements may be real-world elements, displayed elements or instruments in the operational surroundings of the user. Identification of elements at which LOSs of multiple users are aimed at may be used for exchange of information among the users.
    Type: Grant
    Filed: December 28, 2016
    Date of Patent: March 19, 2024
    Assignee: Elbit Systems Ltd.
    Inventors: Itamar Nocham, Avner Shahal
  • Patent number: 11935201
    Abstract: An information handling system operating an HMD device may include a video display device to display application images or a fiducial image when the HMD device is worn by a user; the HMD device including: a display device in the HMD device to present to a user an XR (XR) image of a surrounding XR environment; a pass-through camera to detect the fiducial image displayed by the video display device; and an HMD processor to receive data from an HMD wearing sensor indicating that the user is wearing the HMD device and execute computer readable program code to display an XR environment to the user including an XR image version of the application images presented to the user via the video display device; wherein detection of the fiducial image triggers an API with the XR image version of the video display application images via the video display device.
    Type: Grant
    Filed: April 28, 2022
    Date of Patent: March 19, 2024
    Assignee: Dell Products LP
    Inventors: Loo Shing Tan, Michiel Knoppert, Gerald Rene Pelissier, Martin Douglas Sawtell
  • Patent number: 11928384
    Abstract: A computer implemented method of facilitating communication between first and second users includes displaying, by a first head-worn device, a first virtual object to the first user first user wearing the first head-worn device. The method also includes displaying, by a second head-worn device, a second virtual object to the second user wearing the second head-worn device. The method further includes facilitating, by the first and second head-worn devices, communications between the first and second users using the first and second virtual objects to simulate the first and second users being present in a common environment.
    Type: Grant
    Filed: November 7, 2022
    Date of Patent: March 12, 2024
    Assignee: Magic Leap, Inc.
    Inventors: Rodolpho C. Cardenuto, David Charles Lundmark
  • Patent number: 11927761
    Abstract: A head-mounted device may have a head-mounted housing. The head-mounted housing may have rear-facing display that displays a three-dimensional image to rear eye boxes. The head-mounted device may also have a front-facing display that faces away from the rear eye boxes. The front-facing display may cover a front face of the head-mounted housing. To share content such as content being displayed by the rear-facing displays with external viewers, the head-mounted device may use the front-facing display or a separate display to display images. An accessory that is coupled to the front face of the housing may reflect an image on the front-facing display towards a viewer for viewing. Sensors in the device may detect presence of the accessory. Display projectors and waveguides or optical layers on the front face that overlap the front-facing display may be used to display three-dimensional images to front eye boxes.
    Type: Grant
    Filed: June 11, 2021
    Date of Patent: March 12, 2024
    Assignee: Apple Inc.
    Inventors: Muhammad F. Hossain, Syed F. Mohiuddin
  • Patent number: 11927754
    Abstract: A virtual image display device includes: an image light generating device; a projection optical system configured to project image light emitted from the image light generating device; a folding mirror configured to reflect, in an intersecting direction, the image light from the projection optical system; a semi-transmissive mirror configured to reflect a portion of the image light from the folding mirror; and a concave surface mirror configured to reflect, toward the semi-transmissive mirror, the image light reflected at the semi-transmissive mirror to form an exit pupil, in which an optical axis of the image light extending from the image light generating device to the folding mirror is disposed between a first virtual extension plane obtained by imaginarily extending the semi-transmissive mirror and a second virtual extension plane obtained by imaginarily extending the concave surface mirror.
    Type: Grant
    Filed: March 31, 2021
    Date of Patent: March 12, 2024
    Assignee: SEIKO EPSON CORPORATION
    Inventors: Daiki Matsumoto, Masatoshi Yonekubo, Takashi Takeda
  • Patent number: 11927751
    Abstract: The present application discloses a system and device for displaying content. The system includes two optical units. The two optical units are part of the system that is wearable. Each of the two optical units comprises a front lit display. The system includes an adjustable mounting. The adjustable mounting enables a user to adjust a mounting position of the two optical units.
    Type: Grant
    Filed: August 15, 2022
    Date of Patent: March 12, 2024
    Assignee: Sindarin, Inc.
    Inventors: Benjamin Eli Nelson Chelf, John Aaron Boiles, Nicholas Cory Johnson, Kevin Robert McKinney, Steven David Oliver, Tun Yuen Yeung, Keith Alsberg, Jeremiah O'Leary
  • Patent number: 11927764
    Abstract: Disclosed is a head mounted display device. The head mounted display device includes a head mount unit wearable on a head of a user, a display unit supported on the head mount unit and sending an image to eyes of the user, and a position adjustment unit coupled to the head mount unit, connected to the display unit, and moving the display unit relative to the head mount unit such that a position of the display unit varies with respect to the eyes of the user.
    Type: Grant
    Filed: August 24, 2021
    Date of Patent: March 12, 2024
    Assignee: MEGAGEN IMPLANT CO., LTD.
    Inventors: Kwang Bum Park, Hyun Wook An, Keun Oh Park, Tae Gyoun Lee
  • Patent number: 11921966
    Abstract: Systems and methods related to intelligent typing and responses using eye-gaze technology are disclosed herein. In some example aspects, a dwell-free typing system is provided to a user typing with eye-gaze. A prediction processor may intelligently determine the desired word or action of the user. In some aspects, the prediction processor may contain elements of a natural language processor. In other aspects, the systems and methods may allow quicker response times from applications due to application of intelligent response algorithms. For example, a user may fixate on a certain button within a web-browser, and the prediction processor may present a response to the user by selecting the button in the web-browser, thereby initiating an action. In other example aspects, each gaze location may be associated with a UI element. The gaze data and associated UI elements may be processed for intelligent predictions and suggestions.
    Type: Grant
    Filed: January 31, 2022
    Date of Patent: March 5, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Dmytro Rudchenko, Eric N. Badger, Akhilesh Kaza, Jacob Daniel Cohen, Harish S. Kulkarni
  • Patent number: 11921288
    Abstract: A display device includes a light source array including a plurality of light sources where at least one of the plurality of light sources is selectively driven, a spatial light modulator for modulating light from the light source array to form image light, a focusing optical system for focusing the image light formed by the spatial light modulator at a position in a predetermined eye box, a micro mirror array arranged in an optical path formed in the focusing optical system and including a plurality of mirror cells. The plurality of mirror cells are controlled to be in an ON state in that light is reflected in a direction toward an inside of the eye box or to be in an OFF state in that light is reflected in a direction toward an outside of the eye box.
    Type: Grant
    Filed: May 21, 2021
    Date of Patent: March 5, 2024
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Wontaek Seo, Hongseok Lee, Sunil Kim, Seokil Moon, Bongsu Shin, Daeho Yang, Changkun Lee
  • Patent number: 11924401
    Abstract: A system and method for displaying a 3D image with depths, which utilize at least one light signal generator to sequentially generate multiple light signals(S100) and at least one optical assembly to receive the multiple light signals from the at least one light signal generator, and project and scan the multiple light signals within a predetermined time period to display the 3D image in space(S200). Each pixel of the 3D image is displayed at a position by at least two of the multiple light signals to a viewer's eye, paths or extensions of the paths of the at least two light signals intersects at the position and at an angle associated with a depth of the pixel, and the predetermined time period is one eighteenth of a second. Accordingly, the advantages of simplified structure, a miniatured size, and a less costly building cost can be ensured.
    Type: Grant
    Filed: October 29, 2019
    Date of Patent: March 5, 2024
    Assignee: HES IP HOLDINGS, LLC
    Inventor: Tai Kuo Chen
  • Patent number: 11914765
    Abstract: Systems and methods for overlaying virtual objects in a virtual environment based on user interest and user interactions are disclosed. The methods analyze a live view of a surface viewed through camera or a transparent lens and determine if the policies of the surface allow overlaying of virtual objects. The method fetches a virtual object and calculates a score based on user interest, user gaze, and user engagement. Virtual objects that meet the policies of the surface and a scoring criterion are overlayed on the surface in the virtual environment and enhanced based on a plurality of enhancement factors. Virtual objects are also overlayed in frames of a live broadcast based on their scores. Virtual objects displayed on a conference call interface, which may be meeting tools or icons associated with other conferencing functionality, are enhanced, or removed from the user interface based on their utilization.
    Type: Grant
    Filed: February 17, 2022
    Date of Patent: February 27, 2024
    Assignee: Rovi Guides, Inc.
    Inventor: Serhad Doken
  • Patent number: 11915348
    Abstract: Systems, methods and non-transitory computer readable media for optimizing visual contents are provided. A particular mathematical object corresponding to a particular visual content in a mathematical space including a plurality of mathematical objects corresponding to visual contents may be determined. The mathematical space and the particular mathematical object may be used to obtain first and second mathematical objects of the plurality of mathematical objects. The visual content corresponding to the first mathematical object may be used in a communication with a first user and the visual content corresponding to the second mathematical object may be used in a communication with a second user. Indications of the reactions of the first and second users to the communications may be received. A third visual content may be obtained based on the reactions. The third visual content may be used in a communication with a third user.
    Type: Grant
    Filed: November 4, 2021
    Date of Patent: February 27, 2024
    Assignee: BRIA ARTIFICIAL INTELLIGENCE LTD.
    Inventors: Yair Adato, Gal Jacobi, Ori Feldstein, Bar Fingerman
  • Patent number: 11914149
    Abstract: A system for generating a virtual image for a wearer includes: a lens providing vision of a real scene and having refractive power related to the prescription of the wearer, a directive light source that emits directive light beams to create the virtual image, a reflecting element positioned on or in the lens that receives and redirects the directive light beams emitted by the directive light source toward a convergence area of an eye of the wearer, a dynamical optical element for modifying the received light beams, and a memory storing prescription data relative to the prescription of the wearer, the dynamical optical element modifying the light beams at the convergence area so as to compensate at least partly the prescription of the wearer.
    Type: Grant
    Filed: May 10, 2019
    Date of Patent: February 27, 2024
    Assignee: Essilor International
    Inventor: Vincent Roptin
  • Patent number: 11914161
    Abstract: A light-transmitting substrate has parallel surfaces deployed with a first of the parallel surfaces in facing relation to an eye. An optical element is associated with the first surface and applies optical power to incident light of a first type so as to collimate the incident light, and applies substantially no optical power to incident light of a second type. An optical coupling configuration is associated with the substrate and is configured for coupling-in a proportion of collimated light of the first type incident on the first surface so as to propagate within the substrate, and for coupling-out a proportion of light of the second type propagating within the substrate. Optics associated with the substrate convert collimated light of the first type into converging beams of light, which are sensed by an optical sensor. A processor derives current gaze direction of the eye by processing signals from the optical sensor.
    Type: Grant
    Filed: June 25, 2020
    Date of Patent: February 27, 2024
    Assignee: LUMUS LTD.
    Inventor: Eitan Ronen
  • Patent number: 11906761
    Abstract: A multicolor static multiview display and method of multicolor static multiview display operation provide a color static multiview image using diffractive gratings to diffractively scatter light from guided light beams having a selectable color and different radial directions. The multicolor static multiview display includes a light guide configured to guide plurality of guided light beams and a multicolor light source configured to provide the guided light beam plurality having the selectable color and the different radial directions. The multicolor static multiview display further includes a plurality of diffraction gratings configured to provide from a portion of the guided light beams directional light beams having a color, intensities, and principal angular directions corresponding to color view pixels of the color static multiview image.
    Type: Grant
    Filed: April 2, 2023
    Date of Patent: February 20, 2024
    Assignee: LEIA INC.
    Inventor: David A. Fattal
  • Patent number: 11906740
    Abstract: There is provided a display system used for a head mounted display including a head mounted device having a lens for guiding image light to an eye of a user and configured to be mounted on a head of the user and a portable terminal having an imaging unit for photographing a front of a display surface and capable of being housed in the head mounted device. The display system includes a display control section configured to display a moving image on the display surface, an image information obtaining section configured to obtain image information photographed by the imaging unit, and a position information obtaining section configured to obtain position information of an optical axis of the lens on the display surface on the basis of position information of at least two reference positions whose relative positions with respect to the optical axis are determined in advance, the at least two reference positions being included in the image information.
    Type: Grant
    Filed: September 28, 2018
    Date of Patent: February 20, 2024
    Assignee: Sony Interactive Entertainment Inc.
    Inventor: Manabu Ishioka
  • Patent number: 11899213
    Abstract: An augmented reality device includes an illuminator, a camera, a memory, and a processor, wherein the processor is configured to execute one or more instructions stored in the memory to turn on a light source of the illuminator to obtain a first image from the camera, turn off the light source to obtain a second image from the camera, estimate depth information, based on the first image, and estimate posture information, based on the second image.
    Type: Grant
    Filed: September 6, 2021
    Date of Patent: February 13, 2024
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Jaeyun Jeong, Seokyeol Kim, Gipyo Kim, Songhyeon Kim, Seunghak Shin, Haekyung Jung
  • Patent number: 11902498
    Abstract: Described are various embodiments of a binocular light field display, adjusted pixel rendering method therefor, and vision correction system and method using same. In one embodiment, a system is described to produce a perception adjustment of an input image comprising a pupil tracking device, a digital light field display operable to define spatially periodically recurring view zones within which to produce a perceptively adjusted version of the input image, and a digital data processor operable on pixel data to produce the perceptively adjusted version of the input image within the zones while actively translating a boundary of these view zones so to reduce overlap of the boundary with each of respective pupil locations.
    Type: Grant
    Filed: August 22, 2020
    Date of Patent: February 13, 2024
    Assignee: Evolution Optiks Limited
    Inventors: Daniel Gotsch, Matej Goc
  • Patent number: 11899214
    Abstract: An electronic device such as a head-mounted device may have a user display for displaying an image to a user. The image may be displayed at an eye box after passing through a lens that is interposed between the display and the eye box. A forward-facing component such as a forward-facing camera and/or an externally viewable display may be supported in the housing. The forward-facing component may be overlapped by an optical system. The optical system may have a double-folded light path that virtually shifts the position of the forward-facing component. The optical system may have a reflective polarizer and a partially reflective mirror that are separated by a given distance. The optical system may virtually shift the forward-facing component toward the eye box by twice the given distance.
    Type: Grant
    Filed: December 1, 2021
    Date of Patent: February 13, 2024
    Assignee: Apple Inc.
    Inventor: Yury A. Petrov
  • Patent number: 11893807
    Abstract: A method for determining a state of vigilance of a driver in a vehicle using a predetermined image-analyzing algorithm. The method especially includes a step of executing the predetermined algorithm on the generated sequence of images in order to detect a series comprising at least one movement of the head of the driver, a step of determining the speed and/or the amplitude of each identified movement and of the dynamic and static periods of the head of the driver, a step of detecting dynamic and static periods of the head of the driver and of measuring the frequency and duration of each period, and a step of determining a state of vigilance of the driver from the speed and/or the amplitude determined for each identified movement and from the frequency and duration of each detected period.
    Type: Grant
    Filed: December 13, 2019
    Date of Patent: February 6, 2024
    Inventors: Martin Petrov, Alain Giralt
  • Patent number: 11885968
    Abstract: Compact occlusion-capable optical see-through head mounted displays (OCOST-HMDs) are described having a double-wrapped path and capable of rendering per-pixel mutual occlusion, and correct see-through viewing perspective or a pupil-matched viewing between the virtual and real views. An example device includes a polarizer, a polarizing beam splitter, an objective lens, a spatial light modulator (SLM), an eyepiece lens, a quarter wave plate, and a reflective optical element configured to reflect the light that is incident thereupon in a first direction, and to transit the light received from a microdisplay that is incident thereupon from a second direction. The components form a first double-pass configurations that allow the light that passes through the objective to reflect from the SLM and propagate again through the objective, and a second double-pass configuration that allows the light that passes through the eyepiece to reflect from the reflective optical element and propagate again through the eyepiece.
    Type: Grant
    Filed: September 14, 2020
    Date of Patent: January 30, 2024
    Assignee: Arizona Board of Regents on Behalf of the University of Arizona
    Inventors: Hong Hua, Austin Wilson
  • Patent number: 11887258
    Abstract: A computer implemented method and a virtual and physical environment integration system (VPEIS) for dynamically integrating a virtual environment with a physical environment are provided. The VPEIS receives dimensions and an orientation of the physical environment, and a user device's reference position in the physical environment.
    Type: Grant
    Filed: February 16, 2021
    Date of Patent: January 30, 2024
    Assignee: Virtex Apps, LLC
    Inventor: Jeffrey Michael Green
  • Patent number: 11887261
    Abstract: A simulation object identity recognition method includes displaying, by an electronic device, a simulation object, determining, by the electronic device, whether the simulation object is valid, and notifying by the electronic device, a user of a determining result to improve a user alertness and to avoid disclosing personal information by the user under inducement of an invalid simulation object.
    Type: Grant
    Filed: June 19, 2020
    Date of Patent: January 30, 2024
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventor: Linghan Pan
  • Patent number: 11887267
    Abstract: A method includes receiving an image of a real environment captured using a camera worn by a user, the image comprising a hand of the user and determining a pose of the hand based on the image. Based on a three-dimensional model of the hand having the determined pose, generating a two-dimensional surface representing the hand as viewed from a first viewpoint of the user and positioning the two-dimensional surface representing the hand and one or more virtual-object representations in a three-dimensional space. The method further includes determining that a portion of the two-dimensional surface representing the hand is visible from a second viewpoint in the three-dimensional space, and generating an output image, wherein a set of image pixels of the output image corresponding to the portion of the two-dimensional surface that is visible is configured to cause a display to tur off a set of corresponding display pixels.
    Type: Grant
    Filed: July 7, 2021
    Date of Patent: January 30, 2024
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Christopher James Goodman, Gregory Mayo Daly
  • Patent number: 11880941
    Abstract: In one embodiment, a method includes segmenting a layout of a physical space surrounding a user into physical segments; generating, based on the physical segments, virtual paths for a virtual environment through which the user can navigate by traveling the physical segments; identifying, based on a current location of the user with respect to the physical space, a portion of the physical segments for which to enable an intrusion detection feature; detecting a physical object in the portion of the physical segments that corresponds to a particular virtual path of the virtual paths; and in response to the detecting, displaying a representation of the physical object in the particular virtual path.
    Type: Grant
    Filed: November 8, 2021
    Date of Patent: January 23, 2024
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Gioacchino Noris, Matthew James Alderman, Alexandru-Eugen Ichim
  • Patent number: 11880499
    Abstract: Systems, methods, apparatuses, and computer-readable media for creating an observation video are described. The observation video may comprise a viewport that moves in coordination with motion of an HMD user's head and that shows portions of VR content being output to the HMD user at different times. For each of those times, motion data from the HMD may be used to determine a position, orientation, and/or shape of the viewport. The observation video may also include an element that represents the HMD user, which element may comprise a video element video isolated from video of the user captured by a camera, and/or which may comprise an animated avatar.
    Type: Grant
    Filed: May 12, 2022
    Date of Patent: January 23, 2024
    Assignee: Science Applications International Corporation
    Inventors: Andrew W. Wilson, Ari J. Hollander
  • Patent number: 11880041
    Abstract: Aspects of the present invention relate to speaker assemblies for head worn computers, including speaker assemblies in a temple portion of a head-worn computer.
    Type: Grant
    Filed: August 26, 2022
    Date of Patent: January 23, 2024
    Assignee: Mentor Acquisition One, LLC
    Inventors: John D. Haddick, Robert Michael Lohse, Nima L. Shams, Ralph F. Osterhout
  • Patent number: 11880113
    Abstract: A device includes a first-type liquid crystal (LC) lens configured to provide a first optical power that is variable in a first step resolution. The device also includes a second-type LC lens coupled with the first-type LC lens, and configured to provide a second optical power that is variable in a second step resolution. The first step resolution is smaller than the second step resolution. A total optical power of the device is a sum of the first optical power and the second optical power, and is variable in the first step resolution.
    Type: Grant
    Filed: May 3, 2022
    Date of Patent: January 23, 2024
    Assignee: META PLATFORMS TECHNOLOGIES, LLC
    Inventors: Lu Lu, Fenglin Peng, Douglas Robert Lanman
  • Patent number: 11874530
    Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have displays that produce images. Positioners may be used to move the displays relative to the eye positions of a user's eyes. An adjustable optical system may include tunable lenses such as tunable cylindrical liquid crystal lenses. The displays may be viewed through the lenses when the user's eyes are at the eye positions. A sensor may be incorporated into the head-mounted display to measure refractive errors in the user's eyes. The sensor may include waveguides and volume holograms, and a camera for gathering light that has reflected from the retinas of the user's eyes. Viewing comfort may be enhanced by adjusting display positions relative to the eye positions and/or by adjusting lens settings based on the content being presented on the display and/or measured refractive errors.
    Type: Grant
    Filed: May 3, 2018
    Date of Patent: January 16, 2024
    Assignee: Apple Inc.
    Inventors: Victoria C. Chan, Christina G. Gambacorta, Graham B. Myhre, Hyungryul Choi, Nan Zhu, Phil M. Hobson, William W. Sprague, Edward A. Valko, Qiong Huang, Branko Petljanski, Paul V. Johnson, Brandon E. Clarke, Elijah H. Kleeman
  • Patent number: 11874470
    Abstract: Provided a display apparatus including an image forming apparatus configured to form an image, a projection optical system configured to project the image formed by the image forming apparatus, and a combining optical system configured to provide the image projected from the projection optical system combined with light emitted from an external landscape, wherein the combining optical system is configured to divide the image projected from the projection optical system into same images and focus the same images on different positions.
    Type: Grant
    Filed: September 29, 2022
    Date of Patent: January 16, 2024
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Sunil Kim, Druzhin Vladislav, Malinina Polina, Bongsu Shin, Dubynin Sergey
  • Patent number: 11874485
    Abstract: An augmented reality providing device includes a lens including a reflective mirror, a display module on at least one side surface of the lens and configured to display an image, and an anti-reflective module between the display module and the lens.
    Type: Grant
    Filed: December 31, 2019
    Date of Patent: January 16, 2024
    Assignee: Samsung Display Co., Ltd.
    Inventors: Jaejoong Kwon, Juhwa Ha, JeongWoo Park, Subin Jung
  • Patent number: 11874958
    Abstract: A head-mounted device having a plurality of electrodes configured to detect optical events such as the movement of one or more eyes or coarse eye gestures is disclosed. In some examples, the one or more electrodes can be coupled to dielectric elastomer materials whose shape can be changed to vary contact between a user of the head-mounted device and the one or more electrodes to ensure sufficient contact and electrode signal quality. In some examples, the one or more electrodes can be coupled to pressure sensors and control circuitry to monitor and adjust the applied pressure. In some examples, the optical events can be used as triggers for operating the device, including transitioning between operational power modes. In some examples, the triggers can invoke higher resolution sensing capabilities of the head-mounted device. In some examples, the electrodes can be used as an on-head detector to wake-up and/or unlock the device.
    Type: Grant
    Filed: September 24, 2021
    Date of Patent: January 16, 2024
    Assignee: Apple Inc.
    Inventors: Erdrin Azemi, Ali Moin, Christoph H. Krah, Joseph Yitan Cheng, Kaan Emre Dogrusoz, Mohammad Yeke Yazdandoost
  • Patent number: 11857378
    Abstract: Aspects of the disclosure relate to a system comprising a head mounted display, an adjusting mechanism, and a connecting mechanism, wherein the head mounted display is configured to be worn on a head of a user under a cover of a surgical helmet so that the display of the head mounted display is adjacent to a transparent portion of the cover, wherein the adjusting mechanism is configured to adjust at least a position of the head mounted display in relationship to the user's eyes, and wherein the connecting mechanism is configured to couple the head mounted display to the surgical helmet. Aspects of the disclosure relate to a system for tracking a head mounted display when used in connection with a surgical helmet and a cover for the surgical helmet.
    Type: Grant
    Filed: February 14, 2020
    Date of Patent: January 2, 2024
    Assignee: OnPoint Medical, Inc.
    Inventors: Raymond Bojarski, Chuang-Jang Chiou, Philipp K. Lang, Daniel Steines
  • Patent number: 11863596
    Abstract: A head-worn device system includes one or more cameras, one or more display devices and one or more processors. The system also includes a memory storing instructions that, when executed by the one or more processors, configure the system to perform operations to initiate or join a joint visual computing session. The method may comprise receiving user input to initiate a joint session of a visual computing experience, monitoring for short-range data transmissions including data indicating the existence of a current session of the visual computing experience, and based on determining that a current session is in process, providing a user input option to join the current session of the visual computing experience.
    Type: Grant
    Filed: December 7, 2021
    Date of Patent: January 2, 2024
    Assignee: Snap Inc.
    Inventors: Kristian Bauer, Tiago Rafael Duarte, Terek Judi, Shin Hwun Kang, Karen Stolzenberg
  • Patent number: 11856815
    Abstract: A display panel including a first edge extending in a first direction, a second edge extending in a second direction intersecting with the first direction, and a corner edge extending in a curved shape from the first edge to the second edge includes: a substrate including a front area overlapping a center of the display panel and a corner area extending from the front area to the corner edge; and a pixel arranged over the substrate, wherein the display panel is curved in the corner area in a direction in which the corner edge approaches the center of the display panel.
    Type: Grant
    Filed: October 20, 2021
    Date of Patent: December 26, 2023
    Assignee: SAMSUNG DISPLAY CO., LTD.
    Inventors: Jiwon Lee, Sangho Kim, Soomin Baek, Cheonmyeong Lee, Juhwa Ha
  • Patent number: 11852815
    Abstract: The present invention relates to an optical glass having refractive index of 1.55 or more and having chromaticity b* that satisfies b*?4.8 under A light source in a CIELab representation. The present invention also relates to an optical glass having refractive index of 1.55 or more, having a ratio (b*/|a*|) of chromaticity b* to an absolute value of chromaticity a* that satisfies b*/|a*|?0.55 under A light source in a CIELab representation, and satisfying b*?0.1.
    Type: Grant
    Filed: May 18, 2020
    Date of Patent: December 26, 2023
    Assignee: AGC INC.
    Inventors: Shinichi Amma, Tatsuo Nagashima
  • Patent number: 11854227
    Abstract: A method for correcting a bending of a flexible device is described. In one aspect, the method includes accessing feature data of a first stereo frame that is generated by stereo optical sensors of the flexible device, the feature data generated based on a visual-inertial odometry (VIO) system of the flexible device, accessing depth map data of the first stereo frame, the depth map data generated based on a depth map system of the flexible device, estimating a pitch-roll bias and a yaw bias based on the features data and the depth map data of the first stereo frame, and generating a second stereo frame after the first stereo frame, the second stereo frame based on the pitch-roll bias and the yaw bias of the first stereo frame.
    Type: Grant
    Filed: September 21, 2021
    Date of Patent: December 26, 2023
    Assignee: SNAP INC.
    Inventors: Sagi Katz, Matthias Kalkgruber
  • Patent number: 11843764
    Abstract: A method of managing user experience with a virtual reality (VR) headset includes: with a server, receiving data from a number of sensors that are detecting parameters associated with a user during use of the VR headset; with the server, analyzing the data from the sensors to predict a negative effect on the user from the use of the VR headset; and with the server, taking action to minimize the negative effect on the user that is predicted.
    Type: Grant
    Filed: October 21, 2021
    Date of Patent: December 12, 2023
    Assignee: Hewlett-Packard Development Company, L.P.
    Inventors: Anuradha Kulkarni, Tulit Pal, Narendra Kumar Chincholikar
  • Patent number: 11833901
    Abstract: A method includes placing a physical target on a windshield of a vehicle, mounting a fixture inside the vehicle to position a camera array on the fixture within a line of sight of a passenger, capturing images of the physical target using the camera array, and determining a difference between actual and target locations of the physical target in each image. In addition, the method includes controlling the HUD to display a virtual target on the windshield, capturing images of the virtual target using the camera array, and determining a target location of the virtual target in each image based on the difference. Further, the method includes determining an offset between an actual location of the virtual target in each image and the target location of the virtual target in each image, and adjusting the location of an image projected onto the windshield by the HUD based on the offset.
    Type: Grant
    Filed: October 12, 2020
    Date of Patent: December 5, 2023
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Thomas A. Seder, Kai-Han Chang, Leslie G. Ferris, Guy N. Kennerly