Image Superposition By Optical Means (e.g., Heads-up Display) Patents (Class 345/7)
  • Patent number: 11927750
    Abstract: A head up display arrangement for a motor vehicle includes an image source emitting a light field. A first freeform mirror is positioned to provide a first reflection of the light field. A generally concave second freeform mirror is positioned to receive the first reflection and provide a second reflection of the light field. The second reflection is reflected off of a windshield of the vehicle so as to be visible to a driver of the vehicle as a virtual image. The generally concave second freeform mirror includes a reflective surface having a shape such that the virtual image appears to be curved to the driver of the vehicle.
    Type: Grant
    Filed: May 17, 2022
    Date of Patent: March 12, 2024
    Assignee: Panasonic Automotive Systems Company of America, Division of Panasonic Corporation of North America
    Inventors: Patrick O'Connell, Edo Omanovic
  • Patent number: 11915627
    Abstract: A viewing angle expansion plate, which is a multi-pinhole mask, includes a plurality of cell areas; and a plurality of pinholes formed in the plurality of cell areas, wherein each cell area from among the plurality of cell areas corresponds to a respective pixel from among a plurality of pixels in a flat panel display. The flat panel display includes a light source configured to emit parallel light; a flat panel, on which the parallel light is incident, configured to provide a three-dimensional image; and the viewing angle expansion plate.
    Type: Grant
    Filed: September 23, 2019
    Date of Patent: February 27, 2024
    Assignees: SAMSUNG ELECTRONICS CO., LTD., KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY
    Inventors: Wontaek Seo, Yongkeun Park, Hoon Song, Jungkwuen An, Jongchan Park
  • Patent number: 11900841
    Abstract: A display system of a vehicle, and a control method thereof includes: a user input device; a head-up display configured to project a virtual image including augmented reality contents and to adjust a projection position of the augmented reality contents according to predetermined driver viewpoint information and left and right direction offset; and a controller configured to correct the driver viewpoint information or the left and right direction offset according to a control input received through the user input device, wherein the left and right direction offset indicates a degree to which the augmented reality contents are shifted left or right.
    Type: Grant
    Filed: January 6, 2022
    Date of Patent: February 13, 2024
    Assignees: Hyundai Motor Company, Kia Corporation
    Inventors: Juhyuk Kim, Huiwon Shin
  • Patent number: 11899218
    Abstract: A head-up display and a movable body can display a virtual image viewable at a position nearer a user. The head-up display includes a display device that displays a first image and emits image light from the first image in a first direction, a first optical member located in the first direction from the display device, and a second optical member located between the display device and the first optical member in the first direction. The second optical member reflects the first image in a first plane direction and a second plane direction and displays a virtual image of the first image in a space between the first optical member and a user.
    Type: Grant
    Filed: November 12, 2020
    Date of Patent: February 13, 2024
    Assignee: KYOCERA CORPORATION
    Inventors: Kaoru Kusafuka, Mitsuhiro Murata, Sunao Hashimoto
  • Patent number: 11902503
    Abstract: Systems and methods for rendering a 3D image are provided. The system receives texture and depth data (depth map) for an image. The system generates, based on the image data, a plurality of folded focal planes matrices. For each respective pixel matrix, the system preprocesses pixel values in the respective focal pixel plane matrix to generate a respective preprocessed matrix, wherein the respective preprocessed matrix clusters together pixel values of the respective folded focal plane matrix based on the depth data for the image. The system generates phase functions based on a plurality of the preprocessed matrices. The system configures a spatial light modulator of the SLM device in accordance with the generated phase functions. The system then provides the plurality of the preprocessed matrices as input to the SLM device to generate for display a 3D representation of the received image data.
    Type: Grant
    Filed: November 18, 2022
    Date of Patent: February 13, 2024
    Assignee: ROVI GUIDES, INC.
    Inventors: Seppo Valli, Pekka Siltanen
  • Patent number: 11893482
    Abstract: Examples are disclosed that relate to the restoration of degraded images acquired via a behind-display camera. One example provides a method of training a machine learning model, the method comprising inputting training image pairs into the machine learning model, each training image pair comprising an undegraded image and a degraded image that represents an appearance of the undegraded image to a behind-display camera, and training the machine learning model using the training image pairs to generate frequency information that is missing from the degraded images.
    Type: Grant
    Filed: February 24, 2020
    Date of Patent: February 6, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Yuqian Zhou, Timothy Andrew Large, Se Hoon Lim, Neil Emerton, Yonghuan David Ren
  • Patent number: 11886089
    Abstract: A tintable window is described having a tintable coating, e.g., an electrochromic device coating, for regulating light transmitted through the window. In some embodiments, the window has a transparent display in the window's viewable region. Transparent displays may be substantially transparent when not in use, or when the window is viewed in a direction facing away from the transparent display. Windows may have sensors for receiving user commands and/or for monitoring environmental conditions. Transparent displays can display graphical user interfaces to, e.g., control window functions. Windows, as described herein, offer an alternative display to conventional projectors, TVs, and monitors. Windows may also be configured to receive, transmit, or block wireless communications from passing through the window. A window control system may share computational resources between controllers (e.g., at different windows).
    Type: Grant
    Filed: April 25, 2018
    Date of Patent: January 30, 2024
    Assignee: View, Inc.
    Inventors: Nitesh Trikha, Stephen Clark Brown, Dhairya Shrivastava, Robert T. Rozbicki
  • Patent number: 11873007
    Abstract: The present disclosure relates to an information processing apparatus, an information processing method, and a program for ensuring safety when a line-of-sight direction of a driver is inappropriate according to a driving situation. The line-of-sight direction of the driver of a vehicle is detected, whether or not the detected line-of-sight direction is a safe line-of-sight direction is determined, and in a case where the line-of-sight direction is determined not to be the safe line-of-sight direction, the vehicle is controlled to a safe state. The present disclosure can be applied to an in-vehicle system.
    Type: Grant
    Filed: October 30, 2019
    Date of Patent: January 16, 2024
    Assignee: SONY GROUP CORPORATION
    Inventor: Masahiro Tamori
  • Patent number: 11867907
    Abstract: An electronic device may include a display module that produces light having an image, a lens that directs the light to a waveguide, and a waveguide that directs the light to an eye box. The lens may produce a foveated image in the light by applying a non-uniform magnification to the image in the light. The non-uniform magnification may vary as a function of angle within a field of view of the lens. This may allow the foveated image to have higher resolution within the central region than in the peripheral region. Performing foveation using the lens maximizes the resolution of images at the eye box without increasing the size of the display module. Control circuitry on the device may apply a pre-distortion to the image that is an inverse of distortion introduced by the lens in producing the foveated image.
    Type: Grant
    Filed: September 14, 2021
    Date of Patent: January 9, 2024
    Inventors: Vikrant Bhakta, David A. Kalinowski, Hyungryul Choi, Nathanael D. Parkhill, Stanley K. Melax, Byron R. Cocilovo
  • Patent number: 11856178
    Abstract: Systems and methods for viewing stereoscopic video images are disclosed. The systems can include a first video camera configured to generate a first video feed of a subject, and a second video camera configured to generate a second video feed of the subject. The first video feed and the second video feed combined generate a near real-time stereoscopic video image. A tracking module can be associated with the first video camera and the second video camera, and can be configured to cause the first video camera and the second video camera to be directed to a desired convergent point relative to a selected tracking point to maintain stereopsis. The system may further include an array of video cameras, a gesture control module, an image adjustment module, a calibration module, or a 3-D modeling module, for example.
    Type: Grant
    Filed: July 3, 2018
    Date of Patent: December 26, 2023
    Assignee: Ultradent Products, Inc.
    Inventors: Neil T. Jessop, Matthew Michael Fisher
  • Patent number: 11848542
    Abstract: An optical system includes an illumination layer, an optical combiner, and an active optics block. The illumination layer includes an array of point light sources configured to emit calibration light. The optical combiner is configured to pass visible light to a front side of the optical system and to direct the calibration light to a camera that generates an image in response to the calibration light. The image includes an array of points corresponding to the array of point light sources. The active optics block includes an adjustable lens disposed between the illumination layer and the optical combiner and is configured to pass the calibration light to the optical combiner and to focus the visible light. The active optics block is further configured to adjust an optical power of the adjustable lens based on the image of the array of points.
    Type: Grant
    Filed: May 29, 2019
    Date of Patent: December 19, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Robin Sharma, Katherine Marie Smyth, Andrew John Ouderkirk, Karol Constantine Hatzilias, Christopher Yuan-Ting Liao
  • Patent number: 11841511
    Abstract: A wearable display system includes one or more nanowire LED micro-displays. The nanowire micro-LED displays may be monochrome or full-color. The nanowire LEDs forming the arrays may have an advantageously narrow angular emission profile and high light output. Where a plurality of nanowire LED micro-displays is utilized, the micro-displays may be positioned at different sides of an optical combiner, for example, an X-cube prism which receives light rays from different micro-displays and outputs the light rays from the same face of the cube. The optical combiner directs the light to projection optics, which outputs the light to an eyepiece that relays the light to a user's eye. The eyepiece may output the light to the user's eye with different amounts of wavefront divergence, to place virtual content on different depth planes.
    Type: Grant
    Filed: February 9, 2023
    Date of Patent: December 12, 2023
    Inventors: Jahja I. Trisnadi, Clinton Carlisle
  • Patent number: 11832401
    Abstract: A head-mounted display includes a main body having a housing defining at least a portion of an exterior of the head mounted display; a built-in display disposed in the housing; a wearing band extending from the main body to a rear side and having a shape enclosing a head of a user as a whole; a right-side extending section configured to make up a right-side part of the wearing band; a left-side extending section configured to make up a left-side part of the wearing band; and a frame which is separate from the housing and constitutes at least a portion of a rear part of the main body, where the frame has left and right openings for receiving left and right lenses, respectively, and a recessed section for accommodating a user's nose when the head-mounted display is worn.
    Type: Grant
    Filed: March 8, 2022
    Date of Patent: November 28, 2023
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Takamasa Araki, Fumihiko Sato, Takayuki Tateno
  • Patent number: 11828938
    Abstract: A small information display apparatus capable of displaying video information on a windshield as a virtual image is provided. An information display apparatus configured to display video information of a virtual image on a windshield of a conveyance includes: a liquid crystal panel arranged as a video display apparatus configured to form the video information; and a virtual image optical system provided with a windshield for displaying the virtual image at a front of the conveyance by reflecting video of the liquid crystal panel by means of the windshield. The virtual image optical system is configured by arranging a concave mirror and an optical element between the concave mirror and the video display apparatus.
    Type: Grant
    Filed: November 30, 2021
    Date of Patent: November 28, 2023
    Assignees: MAXELL, LTD., Hitachi Industry & Control Solutions, Ltd.
    Inventors: Koji Hirata, Masahiko Yatsu, Toshinori Sugiyama, Kazuomi Kaneko, Shigeki Hoshino
  • Patent number: 11816388
    Abstract: Systems, devices, and methods for visual displays are described. Such visual displays may be used in a retail environment to provide interactive presentations to customers. The visual displays may include a display panel, a visual source, and a controller. The display panel may present images and/or video to a user, in which the images and/or video are generated by the visual source. The controller may determine the types of images and/or video to be presented based upon communications received from a user via a communication device or a user kiosk. The display panel may be a variable height and may be offset from the floor or a shelf by a variable distance. A plurality of display panels may be arranged on a display floor to provide retail experiences to customers and/or may be received by one or more docks placed in the display floor.
    Type: Grant
    Filed: June 4, 2021
    Date of Patent: November 14, 2023
    Assignee: GOOGLE LLC
    Inventors: Kyle Glackin, Nairey Keshishian, Lisa Marie Zane, Walter J. S. Hermsen, Cheryl Eng, Bridget Cinquegrano
  • Patent number: 11815694
    Abstract: An apparatus may include a first emitter and a second emitter. The first emitter may be configured to emit visible light comprising first heads up display information to be displayed to a driver of a vehicle. The second emitter may be configured to emit infrared light comprising second heads up display information to be displayed to one or more rear seat passengers of the vehicle.
    Type: Grant
    Filed: July 14, 2021
    Date of Patent: November 14, 2023
    Assignee: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.
    Inventor: Mikio David
  • Patent number: 11815679
    Abstract: A method, a processing device, and a system for information display are proposed. The system may be disposed in a vehicle and includes a light transmissive display, at least one first information extraction device, at least one second information extraction device, and a processing device. The first information extraction device is configured to extract gaze information of a user in the vehicle. The second information extraction device is configured to extract scene information of a scene outside of the vehicle. The processing device is configured to compute a field of view of the user viewing the scene outside of the vehicle through the display according to the gaze information and the scene information, generate display information according to the field of view of the user, and display the display information on the display.
    Type: Grant
    Filed: December 15, 2021
    Date of Patent: November 14, 2023
    Assignee: Industrial Technology Research Institute
    Inventors: Hong-Ming Dai, Tzu-Yi Yu, Chien-Ju Lee, Yu-Hsiang Tsai
  • Patent number: 11809674
    Abstract: There is provided a method for monitoring interaction with 3D medical images, comprising: dividing the 3D image into a sequence of a 2D images, arranging the sequence into slabs each including at least one 2D image, computing, for each respective slab, a minimal amount of viewing time a user is predicted to spend viewing the respective slab, monitoring, while the 3D medical image is presented on a display, an amount of time a user actually spent viewing portions of the 3D medical image corresponding to each of the of slabs, in response to the amount of time spent viewing a certain portion of the 3D medical image being less than the computed minimal amount of viewing time of a certain slab corresponding to the certain portion, generating instructions for implementation by a user interface indicative of the amount of time spent being less than the computed minimal amount of time.
    Type: Grant
    Filed: July 30, 2020
    Date of Patent: November 7, 2023
    Assignee: International Business Machines Corporation
    Inventors: Flora Gilboa-Solomon, Aviad Zlotnick
  • Patent number: 11796808
    Abstract: A directional backlit display device includes a light source module, a reflective narrow-angle diffuser, a backlit display device panel, an eye tracking device, and a controller. The diffuser includes a shaft and is utilized to reflect and uniformly diffuse the light to provide a uniform directional light beam. The backlit display device panel is included on the projecting optical path of the uniform directional light beam. The uniform directional light beam illuminates an image displayed on the backlit display device panel and projects to a projection area. The controller receives an eye position information from the eye tracking device and determines a coordinate. The controller determines a corrective projection area when the coordinate deviates from the projection area, and the drive module rotates the reflective narrow-angle diffuser around an axis of the shaft according to the corrective projection area, so the image projection area moves with the eye.
    Type: Grant
    Filed: February 9, 2022
    Date of Patent: October 24, 2023
    Assignee: E-LEAD ELECTRONIC CO., LTD.
    Inventor: Stephen Chen
  • Patent number: 11776239
    Abstract: Disclosed is a liveness test method and liveness test apparatus. The liveness test method includes determining a presence of a subject using a radar sensor, performing a first liveness test on the subject based on radar data obtained by the radar sensor, in response to the subject being present, acquiring image data of the subject using an image sensor, in response to a result of the first liveness test satisfying a first condition, and performing a second liveness test on the subject based on the image data.
    Type: Grant
    Filed: July 9, 2020
    Date of Patent: October 3, 2023
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Seungju Han, Byung Kwan Kim, Jong-Sok Kim, Sungdo Choi
  • Patent number: 11754975
    Abstract: A holographic display and method for operating the holographic display can include: a holographic display operable in a plurality of modes, a computing system, and a sensor. The holographic display can option include a user interface device. Views displayed by the display can optionally be processed or modified based on a viewer pose relative to the display.
    Type: Grant
    Filed: July 29, 2022
    Date of Patent: September 12, 2023
    Assignee: Looking Glass Factory, Inc.
    Inventors: Alexis Hornstein, Kyle Appelgate, Lee Shiu Pong, Shi Yun Liu, Shawn Michael Frayne
  • Patent number: 11749132
    Abstract: A method includes detecting an eye movement of a reader during a reading of presented text; determining, based on whether an eye movement is detected, whether the reader is looking at the presented text; pausing a presentation of the presented text if it is determined that the reader is not looking at the presented text; and resuming, if the presentation of the text is paused, the presentation of the presented text.
    Type: Grant
    Filed: November 21, 2018
    Date of Patent: September 5, 2023
    Assignee: International Business Machines Corporation
    Inventors: Aldis Sipolins, Marco Cavallo, Ravi Tejwani, Jenna Reinen, Hui Wu
  • Patent number: 11740475
    Abstract: A head-mounted display includes a display unit and a facial interface. The display unit displays graphical content to the user. The facial interface is removably coupleable to the display unit and engages a facial engagement region of a face of the user whereby the display unit is supported on the face of the user. The facial interface includes a physiological sensor for sensing a physiological condition of the user in the facial engagement region.
    Type: Grant
    Filed: January 14, 2020
    Date of Patent: August 29, 2023
    Assignee: APPLE INC.
    Inventors: Daniel M. Strongwater, Kristi E. Bauerly, Dustin A. Hatfield
  • Patent number: 11738643
    Abstract: Disclosed embodiments include power machines having doors with a display that allows the display of information, such as gauges, user inputs, mapped obstacles, boundaries, etc., allowing the operator of the machine to see the displayed information closer to the line of sight with the work area.
    Type: Grant
    Filed: February 27, 2020
    Date of Patent: August 29, 2023
    Assignee: Clark Equipment Company
    Inventors: John Pfaff, Dennis Agnew, Matthew Sagaser, Joel Honeyman
  • Patent number: 11736674
    Abstract: Systems and methods are disclosed that dynamically and laterally shift each virtual object displayed by an augmented reality headset by a respective distance as the respective virtual object is displayed to change virtual depth from a first virtual depth to a second virtual depth. The respective distance may be determined based on a lateral distance between a first convergence vector of a user's eye with the respective virtual object at the first virtual depth and a second convergence vector of the user's eye with the respective virtual object at the second virtual depth along the display, and may be based on an interpupillary distance. In this manner, display of the virtual object may be adjusted such that the gazes of the user's eyes may converge where the virtual object appears to be.
    Type: Grant
    Filed: September 2, 2021
    Date of Patent: August 22, 2023
    Assignee: Universal City Studios LLC
    Inventors: Yu-Jen Lin, Patrick John Goergen, Martin Evan Graham
  • Patent number: 11730226
    Abstract: The disclosed embodiments illustrate methods and systems for training users in sports using mixed reality. The method includes retrieving data from athletes wearing helmets, wearable glasses, and/or motion-capture suits in real time. The helmets and the wearable glasses are integrated with mixed-reality technology. Further, physical performance data of the athletes is captured using a variety of time-synchronized measurement techniques. Thereafter, the athletes are trained using the captured data and audio, visual and haptic feedback.
    Type: Grant
    Filed: September 22, 2020
    Date of Patent: August 22, 2023
    Assignee: Robotarmy Corp.
    Inventors: Damien Phelan Stolarz, Alan Gary Brown
  • Patent number: 11720380
    Abstract: A system receives, from a first augmented reality device, a first image of a web application that shows a first element of the web application. The system receives eye tracking information that indicates eye movements of a user looking at different elements of web application. The system determines that the user is looking at the first element and that the first element is actuated. The system receives a second image of the web application that shows an error message. The system determines that the first element is faulty, records user events that led to the error message, and updates an augmented reality message for the first element by indicating that the first element is faulty. If it is determined that a second user wearing a second augmented reality device is looking at the first element, the system communicates the updated augmented reality message to the second augmented reality device.
    Type: Grant
    Filed: May 18, 2022
    Date of Patent: August 8, 2023
    Assignee: Bank of America Corporation
    Inventor: Shailendra Singh
  • Patent number: 11716456
    Abstract: A near-eye display device comprises right and left display projectors, expansion optics, and inertial measurement units (IMUs), in addition to a plurality of angle-sensitive pixel (ASP) elements and a computer. The right and left expansion optics are configured to receive respective display images from the right and left display projectors and to release expanded forms of the display images. The right IMU is fixedly coupled to the right display projector, and the left IMU is fixedly coupled to the left display projector. Each ASP element is responsive to an angle of light of one of the respective display images as received into the right or left expansion optic. The computer is configured to receive output from the right IMU, the left IMU and the plurality of ASP elements, and render display data for the right and left display projectors based in part on the output.
    Type: Grant
    Filed: May 21, 2021
    Date of Patent: August 1, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Michael Edward Samples, Dmitry Reshidko, Rayna Demaster-Smith
  • Patent number: 11707984
    Abstract: A circuit device 100 includes an error detection circuit 110 and a processing circuit 120. The error detection circuit 110 obtains a glare index value, which is an index value indicating glare of a head-up display, based on image data IMD for head-up display. The error detection circuit 110 determines whether or not a glare index value has exceeded a first threshold value, and when the glare index value exceeds the first threshold value, detects occurrence of a first glare error. When occurrence of a first glare error is detected, the processing circuit 120 performs processing corresponding to the first glare error.
    Type: Grant
    Filed: December 19, 2019
    Date of Patent: July 25, 2023
    Assignee: SEIKO EPSON CORPORATION
    Inventors: Kumar Anandabairavasamy Anand, Wittmeir Manfred, Jeffrey Eric, Tetsuo Kawamoto, Yasutoshi Akiba
  • Patent number: 11703683
    Abstract: A head-up display includes a display device and a projection optical system; the projection optical system includes first and second optical elements arranged in order of an optical path from the image; and when optical paths corresponding to an upper end and a lower end of the virtual image are defined as an upper ray and a lower ray, respectively, and a diverging effect and a converging effect are defined as being negative and positive, respectively, the first and the second optical elements satisfy conditional expressions P_u1?P_l1<0 and P_u2?P_l2>0 (where P_u1 denotes a local power of the first optical element acting on the upper ray, P_l1 denotes a local power of the first optical element acting on the lower ray, P_u2 denotes a local power of the second optical element acting on the upper ray, P_l2 denotes a local power of the second optical element acting on the lower ray).
    Type: Grant
    Filed: October 1, 2020
    Date of Patent: July 18, 2023
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Satoshi Kuzuhara, Hiroaki Okayama
  • Patent number: 11698680
    Abstract: In aspects, methods and apparatus are provided for generating a haptic effect for a three-dimensional (3D) environment that is experienced virtually by a user. The methods may be performed by a processor, and includes receiving media data that describes the 3D environment, wherein the media data includes haptic data which describes a haptic characteristic associated with at least one object, structure, or event in the 3D environment. The method further includes performing a haptic decoding operation and a haptic rendering operation. The decoding operation may include extracting the haptic data from the media data. The haptic rendering operation may include generating a drive signal and communicating the drive signal to a haptic output device to cause the haptic output device to generate a haptic effect at a user peripheral device. Numerous other aspects are provided.
    Type: Grant
    Filed: June 10, 2021
    Date of Patent: July 11, 2023
    Assignee: IMMERSION CORPORATION
    Inventors: David Birnbaum, Yeshwant Muthusamy, Jamal Saboune, Christopher Ullrich
  • Patent number: 11686939
    Abstract: An optical aperture multiplier includes a first optical waveguide (10) having a rectangular cross-section and including partially reflecting surfaces (40) at an oblique angle to a direction of elongation of the waveguide. A second optical waveguide (20), also including partially reflecting surfaces (45) at an oblique angle, is optically coupled with the first optical waveguide (10). An image coupled into the first optical waveguide with an initial direction of propagation at an oblique coupling angle advances by four-fold internal reflection along the first optical waveguide, with a proportion of intensity of the image reflected at the partially reflecting surfaces so as to be coupled into the second optical waveguide, and then propagates through two-fold reflection within the second optical waveguide, with a proportion of intensity of the image reflected at the partially reflecting surfaces so as to be directed outwards from one of the parallel faces as a visible image.
    Type: Grant
    Filed: July 4, 2022
    Date of Patent: June 27, 2023
    Assignee: LUMUS LTD.
    Inventor: Yochay Danziger
  • Patent number: 11682183
    Abstract: An augmented reality system and an anchor display method thereof are provided. An environmental image is captured by an image capturing device disposed on a head-mounted device. A reference image block in the environmental image that matches a display image on a display is detected by performing feature matching between the environmental image and the display image. Position information of the reference image block in the environmental image is obtained. Depth information of the display is obtained according to an actual screen size of the display and a block size of the reference image block in the environmental image. At least one virtual object is displayed by the head-mounted device according to the position information and the depth information. The at least one virtual object is displayed as being anchored to at least one screen bezel of the display.
    Type: Grant
    Filed: November 3, 2021
    Date of Patent: June 20, 2023
    Assignee: Acer Incorporated
    Inventor: Chao-Shih Huang
  • Patent number: 11676422
    Abstract: A system and method for generating data suitable for determining a parameter of a human eye. The method includes receiving a first image of the eye for a first time from a camera of known camera intrinsics defining an image plane, and determining a first ellipse in the first image. The method includes determining a first eye intersecting line expected to intersect a center of the eyeball at the first time as a line which is, in the direction of the orientation vector, parallel-shifted to the first center line by an expected distance between the center of the eyeball and a center of the pupil.
    Type: Grant
    Filed: June 5, 2019
    Date of Patent: June 13, 2023
    Assignee: PUPIL LABS GmbH
    Inventors: Kai Dierkes, Moritz Kassner
  • Patent number: 11659150
    Abstract: A processor system processes image data for rendering a virtual environment for a user present in a real environment. The system receives head tracking data indicative of the orientation of the head of the user. An image processor generates image data for rendering a viewport of the virtual environment on a display system based on the head tracking data. A real-view area is defined in the virtual environment, having at least one boundary. The boundary corresponds to predetermined coordinates in the virtual environment. Thereby a corresponding part of the real environment is made visible in the real-view area, the part showing the real environment as perceived from the user head pose. Effectively the virtual environment is augmented by integrating part of the real environment via the real-view area.
    Type: Grant
    Filed: December 10, 2020
    Date of Patent: May 23, 2023
    Assignee: KONINKLIJKE KPN N.V.
    Inventors: Hans Maarten Stokking, Milan Wijnmalen
  • Patent number: 11654771
    Abstract: A multi-view display device is provided for a collaborative co-pilot system (system) of a vehicle having a windshield. The system includes one or more input devices for generating an input signal associated with a road condition. The multi-view display device includes one or more single-user viewing devices, with each single-user viewing device including an Augmented Reality Head Up Display module (ARHUD) for generating a dedicated display associated with the road condition. The ARHUD projects the dedicated display onto an associated portion of the windshield that is visible to a corresponding single user and overlaying a road geometry associated with the road condition. The multi-view display device further includes an Extended View Display module (EV display module) for generating a common display that is visible to a plurality of users including each one of the single users.
    Type: Grant
    Filed: July 20, 2022
    Date of Patent: May 23, 2023
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Kai-Han Chang, Thomas A. Seder, Joseph F. Szczerba, John P. Weiss
  • Patent number: 11654358
    Abstract: Systems and methods for executing content to be rendered on a screen of a head mounted display (HMD) are provided. One method includes executing the content to render interactive scenes on the screen and tracking an orientation direction of the HMD when worn on a head of a user and the interactive scenes are being rendered on the screen. The method includes changing view directions into the interactive scenes based on changes in the orientation direction of the HMD, such that movements of the head of the user causes the changes in the view directions into the interactive scenes. The method further includes receiving images of a real world space using a camera of the HMD. The camera of the HMD is configured to capture a location of real world objects in the real world space relative to the user of the HMD.
    Type: Grant
    Filed: January 31, 2022
    Date of Patent: May 23, 2023
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Steven Osman, Xiaodong Mao
  • Patent number: 11656242
    Abstract: An angular velocity detection device includes an angular velocity sensor configured to detect angular velocity, an acquisition unit configured to acquire orientation information in a three-dimensional space on a moving object including the angular velocity sensor, a calculation unit configured to calculate estimated angular velocity based on the acquired orientation information, and a correction unit configured to correct an output of the angular velocity sensor based on the angular velocity detected by the angular velocity sensor and the estimated angular velocity calculated by the calculation unit.
    Type: Grant
    Filed: September 18, 2020
    Date of Patent: May 23, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Toshiaki Sato
  • Patent number: 11648878
    Abstract: A luminance determining unit 14 determines a luminance distribution of an exterior circumstantial image in a line-of-sight direction of a driver 300, and a luminance changing unit 15 determines a bright region 301 of this luminance distribution. Further, the luminance changing unit 15 determines a luminance after the change in a peripheral region 302 of this bright region 301. A virtual-image creating unit 16A creates a virtual image based on the determined luminance, and a display processing unit 17 displays this virtual image on a display unit 200. In this manner, since a display system 1A displays the virtual image for use in increasing the luminance in periphery of the bright region 301, the feeling of the brightness for the driver 300 can be moderated, and therefore, the visual recognition can be improved. That is, the display system 1A can output the virtual image depending on the circumstances.
    Type: Grant
    Filed: September 22, 2017
    Date of Patent: May 16, 2023
    Assignee: MAXELL, LTD.
    Inventors: Seiji Murata, Hiromitsu Mori, Kenichi Shimada, Kazuyoshi Yamazaki, Mayumi Nagayoshi
  • Patent number: 11640050
    Abstract: A head-up display (HUD) system is provided. The HUD system comprises a microdisplay-based projection system, a diffuser, a relay optical system, and a combiner. The microdisplay-based HUD system includes aberration correction capabilities and may easily and effectively replace a CRT-based HUD system in aircrafts while providing light-weight, multi-color, superior imaging capabilities with a large field-of-view.
    Type: Grant
    Filed: October 19, 2011
    Date of Patent: May 2, 2023
    Assignee: EPIC OPTIX INC.
    Inventors: Simon Magarill, Dongha Kim
  • Patent number: 11635867
    Abstract: Implementations described herein relate to methods, devices, and computer-readable media to display a user interface that includes a map portion and a grid portion. A method includes identifying a first set of images that match a first region of a digital map and causing a user interface to be displayed that includes a map portion that corresponds to the first region of the digital map and a grid portion that includes images of the first set. The method further includes receiving user input indicative of a second region of the digital map. The method further includes identifying a second set of images that match the second region of the digital map and updating the user interface such that the map portion of the updated user interface corresponds to the second region of the digital map and the grid portion of the updated user interface includes images of the second set.
    Type: Grant
    Filed: May 17, 2020
    Date of Patent: April 25, 2023
    Assignee: Google LLC
    Inventors: James Aspinall, Andre Santoso, Juan Carlos Miguel Anorga
  • Patent number: 11625095
    Abstract: Embodiments are related to a plurality of gaze sensors embedded into a frame of a headset for detection of a gaze vector of a user wearing the headset and user's control at the headset. The gaze vector for an eye of the user can be within a threshold distance from one of the gaze sensors. By monitoring signals detected by the gaze sensors, it can be determined that the gaze vector is within the threshold distance from the gaze sensor. Based on this determination, at least one action associated with the headset is initiated.
    Type: Grant
    Filed: January 20, 2022
    Date of Patent: April 11, 2023
    Assignee: Zinn Labs, Inc.
    Inventors: Robert Konrad, Kevin Boyle, Nitish Padmanaban, Gordon Wetzstein
  • Patent number: 11625624
    Abstract: Systems, methods, and computer-readable media are described for performing real-time vehicular incident risk prediction using real-time vehicle-to-everything (V2X) data. A vehicular incident risk prediction machine learning model is trained using historical V2X data such as historical incident data and historical vehicle operator driving pattern behavior data as well as third-party data such as environmental condition data and infrastructure condition data. The trained machine learning model is then used to predict the risk of an incident for a vehicle on a roadway segment based on real-time V2X data relating to the roadway segment and/or vehicle operators on the roadway segment. A notification of a high risk of incident can then be sent to a V2X communication device of the vehicle to inform an operator of the vehicle.
    Type: Grant
    Filed: September 24, 2019
    Date of Patent: April 11, 2023
    Assignee: Ford Global Technologies, LLC
    Inventors: Amin Ariannezhad, Hamed Asadi, Praveen Kumar Yalavarty
  • Patent number: 11619811
    Abstract: An image display system includes: an image projection unit that projects and displays an image on a display target for a moving body; a posture angle calculation unit that calculates a posture angle for the moving body on the basis of chronological data for acceleration detection values for the acceleration of the moving body in a prescribed time period; and a display control unit that controls the display position at which the image is projected and displayed on the display target, in accordance with the posture angle calculated by the posture angle calculation unit. The acceleration detection values include bi-directional components. The posture angle calculation unit excludes acceleration detection values from the chronological data used when calculating the posture angle, said acceleration detection values being included in an exclusion time period which has a ratio for the bidirectional components, in the prescribed time period, that is outside a prescribed range.
    Type: Grant
    Filed: September 24, 2021
    Date of Patent: April 4, 2023
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Fumihito Inukai, Toshiya Mori, Masanaga Tsuji, Ken′ichi Kasazumi, Yukihiro Chokyu
  • Patent number: 11614849
    Abstract: A system including a display output device, a computer including instructions that when executed by the computer, cause the computer to generate a virtual environment, instantiate one or more virtual devices into the virtual environment, instantiate a user representation into the virtual environment, and display the virtual environment, the one or more virtual devices, and the user representation on the display output device, an input device to receive a movement input associated with movement by the user representation in the virtual environment, and the computer further configured with instructions to move or rotate the one or more virtual devices relative to a point of reference in the virtual environment in response to the movement input, while maintaining the user representation stationary.
    Type: Grant
    Filed: May 13, 2019
    Date of Patent: March 28, 2023
    Assignee: Thermo Fisher Scientific, Inc.
    Inventors: Mark Field, Daniel Garden
  • Patent number: 11604360
    Abstract: The head-up display includes an imaging position changer configured to change a position of a virtual image between a far visual position far from an observer and a near visual position close to the observer. The imaging position changer inclines the virtual image at the far visual position by a second inclination angle with respect to a perpendicular plane to a reference light beam reaching a center of a viewpoint region in which a viewpoint of the observer is located, to move an upper end thereof in a forward direction of the moving object, and inclines the virtual image at the near visual position by a first inclination angle smaller than the second inclination angle with respect to the perpendicular plane to the reference light beam, to move the upper end in the forward direction of the moving object.
    Type: Grant
    Filed: December 18, 2020
    Date of Patent: March 14, 2023
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Hiroaki Okayama, Satoshi Kuzuhara, Yusuke Nihei, Koji Taniguchi, Makoto Funabiki
  • Patent number: 11602691
    Abstract: Described herein are techniques for providing an in-game virtual boundary. First data is received that is indicative of a user position while the user is playing a video game. It is determined whether the user position is within a warning zone, wherein the warning zone comprises an area between a soft boundary indicative of a safe area for the user and a safe boundary indicative of one or more real-world objects around the user. Based on a relationship between the user position and the safe boundary, a visual indication of a plurality of visual indications of the in-game virtual boundary is determined to provide to the user. Second data indicative of the visual indication is transmitted to a display being viewed by the user while playing the video game.
    Type: Grant
    Filed: March 11, 2021
    Date of Patent: March 14, 2023
    Assignee: Harmonix Music Systems, Inc.
    Inventor: Ryan William Challinor
  • Patent number: 11598967
    Abstract: A head-mounted display system includes a head-mounted display unit and a positioning and stabilising structure structured and arranged to hold the head-mounted display unit in an operational position over a user's face in use. The positioning and stabilising structure includes a rear support structure adapted to contact posterior regions of a user's head and a forehead support connector, which includes a forehead support strap, which extends generally along and in the direction of the sagittal plane and connects the rear support structure to a superior edge region of the head-mounted display unit. The forehead support connector further includes a forehead support rigidiser that provides rigidification to a portion of the forehead support connector.
    Type: Grant
    Filed: December 2, 2021
    Date of Patent: March 7, 2023
    Assignee: ResMed Pty Ltd
    Inventor: Ian Andrew Law
  • Patent number: 11586294
    Abstract: A video display apparatus according to an embodiment includes a video display unit configured to display a video image in a field of view of a user in a state in which the user is wearing the video display apparatus, an image pickup unit configured to take a video image of an outside state, a switching unit configured to selectively perform switching as to whether to display a video image of a certain content or a video image taken by the image pickup unit, and a switching control unit configured to control the switching unit. The switching control unit switches the video image displayed on the video display unit when an object with a predetermined identification pattern is included in the video image taken by the image pickup unit and the switching control unit has detected that a user's hand has made a predetermined gesture.
    Type: Grant
    Filed: November 19, 2021
    Date of Patent: February 21, 2023
    Assignee: JVCKENWOOD CORPORATION
    Inventor: Takeshi Ibaraki
  • Patent number: 11564657
    Abstract: Aspects of the technology described herein relate to techniques for guiding an operator to use an ultrasound device. Thereby, operators with little or no experience operating ultrasound devices may capture medically relevant ultrasound images and/or interpret the contents of the obtained ultrasound images. For example, some of the techniques disclosed herein may be used to identify a particular anatomical view of a subject to image with an ultrasound device, guide an operator of the ultrasound device to capture an ultrasound image of the subject that contains the particular anatomical view, and/or analyze the captured ultrasound image to identify medical information about the subject.
    Type: Grant
    Filed: May 25, 2021
    Date of Patent: January 31, 2023
    Assignee: BFLY OPERATIONS, INC.
    Inventors: Matthew de Jonge, Robert Schneider, David Elgena, Alex Rothberg, Jonathan M. Rothberg, Michal Sofka, Tomer Gafner, Karl Thiele, Abraham Neben