Image Superposition By Optical Means (e.g., Heads-up Display) Patents (Class 345/7)
-
Patent number: 11966044Abstract: This document relates to an optical device that uses adaptive optics as part of an optical system. The adaptive optics can be used to correct light rays that correspond to a portion of an eye box based on information received from an eye-tracking unit, and can also correct for aberrations in the optics in the optical device. The adaptive optics include corrective elements that can be modified using modifying elements to correct the angle of light rays, such that rays associated with a specific pupil position and gaze direction of a user's eye can be made parallel and ensure a high quality image is viewed by the user.Type: GrantFiled: October 17, 2022Date of Patent: April 23, 2024Assignee: Microsoft Technology Licensing, LLCInventors: Andreas Georgiou, Alfonsus D. Lunardhi, Joel Steven Kollin, Bernard C. Kress, Ishan Chatterjee, Mario Possiwan
-
Patent number: 11958360Abstract: A display control device includes a processor. The processor is configured to: determine content to be superimposed and displayed over an object on a first display unit fixed to a moving body or a second display unit worn on a human body, the object being a real image seen through the first display unit or the second display unit; select either the first display unit or the second display unit to display the content based on a predetermined condition; and superimpose and display the content over the object on the first display unit or the second display unit, the first display unit or the second display unit being selected to display the content.Type: GrantFiled: August 4, 2022Date of Patent: April 16, 2024Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHAInventors: Tomohiro Inada, Hitoshi Muraki
-
Patent number: 11960082Abstract: An object detection method is suitable for a virtual reality system. The object detection method includes a plurality of first cameras of a head-mounted display (HMD) to capture a plurality of first frames. A plurality of second frames are captured through a plurality of second cameras in a tracker, wherein, the object detector searches for the object position in the first frames and the second frames.Type: GrantFiled: July 13, 2022Date of Patent: April 16, 2024Assignee: HTC CORPORATIONInventors: Jyun-Jhong Lin, Chun-Kai Huang, Heng-Li Hsieh, Yun-Jung Chang
-
Patent number: 11954763Abstract: The disclosure relates to a motor vehicle that loads a motor vehicle movement dataset (KBD) indicative of accelerations of the motor vehicle, loads a passenger movement dataset (PBD) indicative of movements of a passenger of the motor vehicle, evaluate the motor vehicle movement dataset (KBD) and the passenger movement dataset (PBD) by means of a transfer function with a predetermined threshold value (SW) in order to generate an image dataset (BS) for an infotainment system of the motor vehicle, and outputs the image dataset (BS) by means of the infotainment system.Type: GrantFiled: July 1, 2022Date of Patent: April 9, 2024Assignee: Ford Global Technologies, LLCInventors: Nikica Hennes, Erik Chapman, Eike Schmidt
-
Patent number: 11947388Abstract: A wearable device includes a body having fasteners and a frame coupled between two fasteners. The frame includes first and second sections. A first portion of the body includes the first section of the frame and one fastener and a second portion of the body includes the second section of the frame and the other fastener. A speaker and a microphone are connected to the first portion and another speaker and another microphone are connected to the second portion. The body also includes a processor, memory accessible to the processor, and programming in the memory for configuring the processor to selectively activate the speakers and microphones such that a first speaker emits an output sound signal while a first microphone and a second speaker are deactivated and a second microphone captures an input sound signal during the emission of the output sound signal by the first speaker.Type: GrantFiled: March 7, 2023Date of Patent: April 2, 2024Assignee: SNAP INC.Inventors: Russell Douglas Patton, Jonathan M. Rodriguez, II, Julio Cesar Castañeda, Samuel Bryson Thompson
-
Patent number: 11944344Abstract: A guidance system, a method and a device for dynamically guiding a surgical needle catheter onto an organ to be surgically operated of a patient. In particular, the disclosure relates to a guidance system, a method and a device to aid in the percutaneous kidney puncture.Type: GrantFiled: September 25, 2020Date of Patent: April 2, 2024Assignee: KARL STORZ SE & Co. KGInventors: Pedro Rodrigues, João Luis Araújo Martins Vilaça, Jorge Correia Pinto, Jaime Francisco Cruz Fonseca, Estevão Lima
-
Patent number: 11941168Abstract: A gaze initiated interaction technique for facilitating interaction between wearers of head-mountable devices. Methods are shown which allow users to interact with each other following an event of interlocking gaze. Methods are also shown which allows the operator of a personal point-of-interest beacon to control and limit interaction from the public thus ensuring a greater degree of privacy. Methods are also introduced which allow a mode of interaction to be determined by a remote service after mutual authorization of each interacting user. This disclosure also introduces a system of a head-mountable device which comprises a directional beacon transceiver system using beams in the infrared light spectrum enabling the detection of a gaze interlock event.Type: GrantFiled: September 20, 2021Date of Patent: March 26, 2024Inventor: Maximilian Ralph Peter von und zu Liechtenstein
-
Patent number: 11935503Abstract: A method includes sensing a plurality of luminance values associated with ambient light from a physical environment. The plurality of luminance values quantifies the ambient light arriving at a see-through display. The method includes obtaining a plurality of semantic values respectively associated with a plurality of portions within image data. The plurality of portions includes a first portion of the image data and a second portion of the image data. The method includes identifying a first one of the plurality of semantic values that satisfies a criterion. The first one of the plurality of semantic values is associated with the first portion of the image data. The method includes mapping, based on a function of a portion of the plurality of luminance values, the image data to predetermined display characteristics of the first portion of the image data within a performance threshold.Type: GrantFiled: April 8, 2021Date of Patent: March 19, 2024Assignee: APPLE INC.Inventors: Sivalogeswaran Ratnasingam, Anselm Grundhoefer, Ralf Habel
-
Patent number: 11927750Abstract: A head up display arrangement for a motor vehicle includes an image source emitting a light field. A first freeform mirror is positioned to provide a first reflection of the light field. A generally concave second freeform mirror is positioned to receive the first reflection and provide a second reflection of the light field. The second reflection is reflected off of a windshield of the vehicle so as to be visible to a driver of the vehicle as a virtual image. The generally concave second freeform mirror includes a reflective surface having a shape such that the virtual image appears to be curved to the driver of the vehicle.Type: GrantFiled: May 17, 2022Date of Patent: March 12, 2024Assignee: Panasonic Automotive Systems Company of America, Division of Panasonic Corporation of North AmericaInventors: Patrick O'Connell, Edo Omanovic
-
Patent number: 11915627Abstract: A viewing angle expansion plate, which is a multi-pinhole mask, includes a plurality of cell areas; and a plurality of pinholes formed in the plurality of cell areas, wherein each cell area from among the plurality of cell areas corresponds to a respective pixel from among a plurality of pixels in a flat panel display. The flat panel display includes a light source configured to emit parallel light; a flat panel, on which the parallel light is incident, configured to provide a three-dimensional image; and the viewing angle expansion plate.Type: GrantFiled: September 23, 2019Date of Patent: February 27, 2024Assignees: SAMSUNG ELECTRONICS CO., LTD., KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGYInventors: Wontaek Seo, Yongkeun Park, Hoon Song, Jungkwuen An, Jongchan Park
-
Patent number: 11900841Abstract: A display system of a vehicle, and a control method thereof includes: a user input device; a head-up display configured to project a virtual image including augmented reality contents and to adjust a projection position of the augmented reality contents according to predetermined driver viewpoint information and left and right direction offset; and a controller configured to correct the driver viewpoint information or the left and right direction offset according to a control input received through the user input device, wherein the left and right direction offset indicates a degree to which the augmented reality contents are shifted left or right.Type: GrantFiled: January 6, 2022Date of Patent: February 13, 2024Assignees: Hyundai Motor Company, Kia CorporationInventors: Juhyuk Kim, Huiwon Shin
-
Patent number: 11899218Abstract: A head-up display and a movable body can display a virtual image viewable at a position nearer a user. The head-up display includes a display device that displays a first image and emits image light from the first image in a first direction, a first optical member located in the first direction from the display device, and a second optical member located between the display device and the first optical member in the first direction. The second optical member reflects the first image in a first plane direction and a second plane direction and displays a virtual image of the first image in a space between the first optical member and a user.Type: GrantFiled: November 12, 2020Date of Patent: February 13, 2024Assignee: KYOCERA CORPORATIONInventors: Kaoru Kusafuka, Mitsuhiro Murata, Sunao Hashimoto
-
Patent number: 11902503Abstract: Systems and methods for rendering a 3D image are provided. The system receives texture and depth data (depth map) for an image. The system generates, based on the image data, a plurality of folded focal planes matrices. For each respective pixel matrix, the system preprocesses pixel values in the respective focal pixel plane matrix to generate a respective preprocessed matrix, wherein the respective preprocessed matrix clusters together pixel values of the respective folded focal plane matrix based on the depth data for the image. The system generates phase functions based on a plurality of the preprocessed matrices. The system configures a spatial light modulator of the SLM device in accordance with the generated phase functions. The system then provides the plurality of the preprocessed matrices as input to the SLM device to generate for display a 3D representation of the received image data.Type: GrantFiled: November 18, 2022Date of Patent: February 13, 2024Assignee: ROVI GUIDES, INC.Inventors: Seppo Valli, Pekka Siltanen
-
Patent number: 11893482Abstract: Examples are disclosed that relate to the restoration of degraded images acquired via a behind-display camera. One example provides a method of training a machine learning model, the method comprising inputting training image pairs into the machine learning model, each training image pair comprising an undegraded image and a degraded image that represents an appearance of the undegraded image to a behind-display camera, and training the machine learning model using the training image pairs to generate frequency information that is missing from the degraded images.Type: GrantFiled: February 24, 2020Date of Patent: February 6, 2024Assignee: Microsoft Technology Licensing, LLCInventors: Yuqian Zhou, Timothy Andrew Large, Se Hoon Lim, Neil Emerton, Yonghuan David Ren
-
Patent number: 11886089Abstract: A tintable window is described having a tintable coating, e.g., an electrochromic device coating, for regulating light transmitted through the window. In some embodiments, the window has a transparent display in the window's viewable region. Transparent displays may be substantially transparent when not in use, or when the window is viewed in a direction facing away from the transparent display. Windows may have sensors for receiving user commands and/or for monitoring environmental conditions. Transparent displays can display graphical user interfaces to, e.g., control window functions. Windows, as described herein, offer an alternative display to conventional projectors, TVs, and monitors. Windows may also be configured to receive, transmit, or block wireless communications from passing through the window. A window control system may share computational resources between controllers (e.g., at different windows).Type: GrantFiled: April 25, 2018Date of Patent: January 30, 2024Assignee: View, Inc.Inventors: Nitesh Trikha, Stephen Clark Brown, Dhairya Shrivastava, Robert T. Rozbicki
-
Patent number: 11873007Abstract: The present disclosure relates to an information processing apparatus, an information processing method, and a program for ensuring safety when a line-of-sight direction of a driver is inappropriate according to a driving situation. The line-of-sight direction of the driver of a vehicle is detected, whether or not the detected line-of-sight direction is a safe line-of-sight direction is determined, and in a case where the line-of-sight direction is determined not to be the safe line-of-sight direction, the vehicle is controlled to a safe state. The present disclosure can be applied to an in-vehicle system.Type: GrantFiled: October 30, 2019Date of Patent: January 16, 2024Assignee: SONY GROUP CORPORATIONInventor: Masahiro Tamori
-
Patent number: 11867907Abstract: An electronic device may include a display module that produces light having an image, a lens that directs the light to a waveguide, and a waveguide that directs the light to an eye box. The lens may produce a foveated image in the light by applying a non-uniform magnification to the image in the light. The non-uniform magnification may vary as a function of angle within a field of view of the lens. This may allow the foveated image to have higher resolution within the central region than in the peripheral region. Performing foveation using the lens maximizes the resolution of images at the eye box without increasing the size of the display module. Control circuitry on the device may apply a pre-distortion to the image that is an inverse of distortion introduced by the lens in producing the foveated image.Type: GrantFiled: September 14, 2021Date of Patent: January 9, 2024Inventors: Vikrant Bhakta, David A. Kalinowski, Hyungryul Choi, Nathanael D. Parkhill, Stanley K. Melax, Byron R. Cocilovo
-
Patent number: 11856178Abstract: Systems and methods for viewing stereoscopic video images are disclosed. The systems can include a first video camera configured to generate a first video feed of a subject, and a second video camera configured to generate a second video feed of the subject. The first video feed and the second video feed combined generate a near real-time stereoscopic video image. A tracking module can be associated with the first video camera and the second video camera, and can be configured to cause the first video camera and the second video camera to be directed to a desired convergent point relative to a selected tracking point to maintain stereopsis. The system may further include an array of video cameras, a gesture control module, an image adjustment module, a calibration module, or a 3-D modeling module, for example.Type: GrantFiled: July 3, 2018Date of Patent: December 26, 2023Assignee: Ultradent Products, Inc.Inventors: Neil T. Jessop, Matthew Michael Fisher
-
Patent number: 11848542Abstract: An optical system includes an illumination layer, an optical combiner, and an active optics block. The illumination layer includes an array of point light sources configured to emit calibration light. The optical combiner is configured to pass visible light to a front side of the optical system and to direct the calibration light to a camera that generates an image in response to the calibration light. The image includes an array of points corresponding to the array of point light sources. The active optics block includes an adjustable lens disposed between the illumination layer and the optical combiner and is configured to pass the calibration light to the optical combiner and to focus the visible light. The active optics block is further configured to adjust an optical power of the adjustable lens based on the image of the array of points.Type: GrantFiled: May 29, 2019Date of Patent: December 19, 2023Assignee: Meta Platforms Technologies, LLCInventors: Robin Sharma, Katherine Marie Smyth, Andrew John Ouderkirk, Karol Constantine Hatzilias, Christopher Yuan-Ting Liao
-
Patent number: 11841511Abstract: A wearable display system includes one or more nanowire LED micro-displays. The nanowire micro-LED displays may be monochrome or full-color. The nanowire LEDs forming the arrays may have an advantageously narrow angular emission profile and high light output. Where a plurality of nanowire LED micro-displays is utilized, the micro-displays may be positioned at different sides of an optical combiner, for example, an X-cube prism which receives light rays from different micro-displays and outputs the light rays from the same face of the cube. The optical combiner directs the light to projection optics, which outputs the light to an eyepiece that relays the light to a user's eye. The eyepiece may output the light to the user's eye with different amounts of wavefront divergence, to place virtual content on different depth planes.Type: GrantFiled: February 9, 2023Date of Patent: December 12, 2023Inventors: Jahja I. Trisnadi, Clinton Carlisle
-
Patent number: 11832401Abstract: A head-mounted display includes a main body having a housing defining at least a portion of an exterior of the head mounted display; a built-in display disposed in the housing; a wearing band extending from the main body to a rear side and having a shape enclosing a head of a user as a whole; a right-side extending section configured to make up a right-side part of the wearing band; a left-side extending section configured to make up a left-side part of the wearing band; and a frame which is separate from the housing and constitutes at least a portion of a rear part of the main body, where the frame has left and right openings for receiving left and right lenses, respectively, and a recessed section for accommodating a user's nose when the head-mounted display is worn.Type: GrantFiled: March 8, 2022Date of Patent: November 28, 2023Assignee: Sony Interactive Entertainment Inc.Inventors: Takamasa Araki, Fumihiko Sato, Takayuki Tateno
-
Patent number: 11828938Abstract: A small information display apparatus capable of displaying video information on a windshield as a virtual image is provided. An information display apparatus configured to display video information of a virtual image on a windshield of a conveyance includes: a liquid crystal panel arranged as a video display apparatus configured to form the video information; and a virtual image optical system provided with a windshield for displaying the virtual image at a front of the conveyance by reflecting video of the liquid crystal panel by means of the windshield. The virtual image optical system is configured by arranging a concave mirror and an optical element between the concave mirror and the video display apparatus.Type: GrantFiled: November 30, 2021Date of Patent: November 28, 2023Assignees: MAXELL, LTD., Hitachi Industry & Control Solutions, Ltd.Inventors: Koji Hirata, Masahiko Yatsu, Toshinori Sugiyama, Kazuomi Kaneko, Shigeki Hoshino
-
Patent number: 11816388Abstract: Systems, devices, and methods for visual displays are described. Such visual displays may be used in a retail environment to provide interactive presentations to customers. The visual displays may include a display panel, a visual source, and a controller. The display panel may present images and/or video to a user, in which the images and/or video are generated by the visual source. The controller may determine the types of images and/or video to be presented based upon communications received from a user via a communication device or a user kiosk. The display panel may be a variable height and may be offset from the floor or a shelf by a variable distance. A plurality of display panels may be arranged on a display floor to provide retail experiences to customers and/or may be received by one or more docks placed in the display floor.Type: GrantFiled: June 4, 2021Date of Patent: November 14, 2023Assignee: GOOGLE LLCInventors: Kyle Glackin, Nairey Keshishian, Lisa Marie Zane, Walter J. S. Hermsen, Cheryl Eng, Bridget Cinquegrano
-
Patent number: 11815694Abstract: An apparatus may include a first emitter and a second emitter. The first emitter may be configured to emit visible light comprising first heads up display information to be displayed to a driver of a vehicle. The second emitter may be configured to emit infrared light comprising second heads up display information to be displayed to one or more rear seat passengers of the vehicle.Type: GrantFiled: July 14, 2021Date of Patent: November 14, 2023Assignee: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.Inventor: Mikio David
-
Patent number: 11815679Abstract: A method, a processing device, and a system for information display are proposed. The system may be disposed in a vehicle and includes a light transmissive display, at least one first information extraction device, at least one second information extraction device, and a processing device. The first information extraction device is configured to extract gaze information of a user in the vehicle. The second information extraction device is configured to extract scene information of a scene outside of the vehicle. The processing device is configured to compute a field of view of the user viewing the scene outside of the vehicle through the display according to the gaze information and the scene information, generate display information according to the field of view of the user, and display the display information on the display.Type: GrantFiled: December 15, 2021Date of Patent: November 14, 2023Assignee: Industrial Technology Research InstituteInventors: Hong-Ming Dai, Tzu-Yi Yu, Chien-Ju Lee, Yu-Hsiang Tsai
-
Patent number: 11809674Abstract: There is provided a method for monitoring interaction with 3D medical images, comprising: dividing the 3D image into a sequence of a 2D images, arranging the sequence into slabs each including at least one 2D image, computing, for each respective slab, a minimal amount of viewing time a user is predicted to spend viewing the respective slab, monitoring, while the 3D medical image is presented on a display, an amount of time a user actually spent viewing portions of the 3D medical image corresponding to each of the of slabs, in response to the amount of time spent viewing a certain portion of the 3D medical image being less than the computed minimal amount of viewing time of a certain slab corresponding to the certain portion, generating instructions for implementation by a user interface indicative of the amount of time spent being less than the computed minimal amount of time.Type: GrantFiled: July 30, 2020Date of Patent: November 7, 2023Assignee: International Business Machines CorporationInventors: Flora Gilboa-Solomon, Aviad Zlotnick
-
Patent number: 11796808Abstract: A directional backlit display device includes a light source module, a reflective narrow-angle diffuser, a backlit display device panel, an eye tracking device, and a controller. The diffuser includes a shaft and is utilized to reflect and uniformly diffuse the light to provide a uniform directional light beam. The backlit display device panel is included on the projecting optical path of the uniform directional light beam. The uniform directional light beam illuminates an image displayed on the backlit display device panel and projects to a projection area. The controller receives an eye position information from the eye tracking device and determines a coordinate. The controller determines a corrective projection area when the coordinate deviates from the projection area, and the drive module rotates the reflective narrow-angle diffuser around an axis of the shaft according to the corrective projection area, so the image projection area moves with the eye.Type: GrantFiled: February 9, 2022Date of Patent: October 24, 2023Assignee: E-LEAD ELECTRONIC CO., LTD.Inventor: Stephen Chen
-
Patent number: 11776239Abstract: Disclosed is a liveness test method and liveness test apparatus. The liveness test method includes determining a presence of a subject using a radar sensor, performing a first liveness test on the subject based on radar data obtained by the radar sensor, in response to the subject being present, acquiring image data of the subject using an image sensor, in response to a result of the first liveness test satisfying a first condition, and performing a second liveness test on the subject based on the image data.Type: GrantFiled: July 9, 2020Date of Patent: October 3, 2023Assignee: Samsung Electronics Co., Ltd.Inventors: Seungju Han, Byung Kwan Kim, Jong-Sok Kim, Sungdo Choi
-
Patent number: 11754975Abstract: A holographic display and method for operating the holographic display can include: a holographic display operable in a plurality of modes, a computing system, and a sensor. The holographic display can option include a user interface device. Views displayed by the display can optionally be processed or modified based on a viewer pose relative to the display.Type: GrantFiled: July 29, 2022Date of Patent: September 12, 2023Assignee: Looking Glass Factory, Inc.Inventors: Alexis Hornstein, Kyle Appelgate, Lee Shiu Pong, Shi Yun Liu, Shawn Michael Frayne
-
Patent number: 11749132Abstract: A method includes detecting an eye movement of a reader during a reading of presented text; determining, based on whether an eye movement is detected, whether the reader is looking at the presented text; pausing a presentation of the presented text if it is determined that the reader is not looking at the presented text; and resuming, if the presentation of the text is paused, the presentation of the presented text.Type: GrantFiled: November 21, 2018Date of Patent: September 5, 2023Assignee: International Business Machines CorporationInventors: Aldis Sipolins, Marco Cavallo, Ravi Tejwani, Jenna Reinen, Hui Wu
-
Patent number: 11740475Abstract: A head-mounted display includes a display unit and a facial interface. The display unit displays graphical content to the user. The facial interface is removably coupleable to the display unit and engages a facial engagement region of a face of the user whereby the display unit is supported on the face of the user. The facial interface includes a physiological sensor for sensing a physiological condition of the user in the facial engagement region.Type: GrantFiled: January 14, 2020Date of Patent: August 29, 2023Assignee: APPLE INC.Inventors: Daniel M. Strongwater, Kristi E. Bauerly, Dustin A. Hatfield
-
Patent number: 11738643Abstract: Disclosed embodiments include power machines having doors with a display that allows the display of information, such as gauges, user inputs, mapped obstacles, boundaries, etc., allowing the operator of the machine to see the displayed information closer to the line of sight with the work area.Type: GrantFiled: February 27, 2020Date of Patent: August 29, 2023Assignee: Clark Equipment CompanyInventors: John Pfaff, Dennis Agnew, Matthew Sagaser, Joel Honeyman
-
Patent number: 11736674Abstract: Systems and methods are disclosed that dynamically and laterally shift each virtual object displayed by an augmented reality headset by a respective distance as the respective virtual object is displayed to change virtual depth from a first virtual depth to a second virtual depth. The respective distance may be determined based on a lateral distance between a first convergence vector of a user's eye with the respective virtual object at the first virtual depth and a second convergence vector of the user's eye with the respective virtual object at the second virtual depth along the display, and may be based on an interpupillary distance. In this manner, display of the virtual object may be adjusted such that the gazes of the user's eyes may converge where the virtual object appears to be.Type: GrantFiled: September 2, 2021Date of Patent: August 22, 2023Assignee: Universal City Studios LLCInventors: Yu-Jen Lin, Patrick John Goergen, Martin Evan Graham
-
Patent number: 11730226Abstract: The disclosed embodiments illustrate methods and systems for training users in sports using mixed reality. The method includes retrieving data from athletes wearing helmets, wearable glasses, and/or motion-capture suits in real time. The helmets and the wearable glasses are integrated with mixed-reality technology. Further, physical performance data of the athletes is captured using a variety of time-synchronized measurement techniques. Thereafter, the athletes are trained using the captured data and audio, visual and haptic feedback.Type: GrantFiled: September 22, 2020Date of Patent: August 22, 2023Assignee: Robotarmy Corp.Inventors: Damien Phelan Stolarz, Alan Gary Brown
-
Patent number: 11720380Abstract: A system receives, from a first augmented reality device, a first image of a web application that shows a first element of the web application. The system receives eye tracking information that indicates eye movements of a user looking at different elements of web application. The system determines that the user is looking at the first element and that the first element is actuated. The system receives a second image of the web application that shows an error message. The system determines that the first element is faulty, records user events that led to the error message, and updates an augmented reality message for the first element by indicating that the first element is faulty. If it is determined that a second user wearing a second augmented reality device is looking at the first element, the system communicates the updated augmented reality message to the second augmented reality device.Type: GrantFiled: May 18, 2022Date of Patent: August 8, 2023Assignee: Bank of America CorporationInventor: Shailendra Singh
-
Patent number: 11716456Abstract: A near-eye display device comprises right and left display projectors, expansion optics, and inertial measurement units (IMUs), in addition to a plurality of angle-sensitive pixel (ASP) elements and a computer. The right and left expansion optics are configured to receive respective display images from the right and left display projectors and to release expanded forms of the display images. The right IMU is fixedly coupled to the right display projector, and the left IMU is fixedly coupled to the left display projector. Each ASP element is responsive to an angle of light of one of the respective display images as received into the right or left expansion optic. The computer is configured to receive output from the right IMU, the left IMU and the plurality of ASP elements, and render display data for the right and left display projectors based in part on the output.Type: GrantFiled: May 21, 2021Date of Patent: August 1, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Michael Edward Samples, Dmitry Reshidko, Rayna Demaster-Smith
-
Patent number: 11707984Abstract: A circuit device 100 includes an error detection circuit 110 and a processing circuit 120. The error detection circuit 110 obtains a glare index value, which is an index value indicating glare of a head-up display, based on image data IMD for head-up display. The error detection circuit 110 determines whether or not a glare index value has exceeded a first threshold value, and when the glare index value exceeds the first threshold value, detects occurrence of a first glare error. When occurrence of a first glare error is detected, the processing circuit 120 performs processing corresponding to the first glare error.Type: GrantFiled: December 19, 2019Date of Patent: July 25, 2023Assignee: SEIKO EPSON CORPORATIONInventors: Kumar Anandabairavasamy Anand, Wittmeir Manfred, Jeffrey Eric, Tetsuo Kawamoto, Yasutoshi Akiba
-
Patent number: 11703683Abstract: A head-up display includes a display device and a projection optical system; the projection optical system includes first and second optical elements arranged in order of an optical path from the image; and when optical paths corresponding to an upper end and a lower end of the virtual image are defined as an upper ray and a lower ray, respectively, and a diverging effect and a converging effect are defined as being negative and positive, respectively, the first and the second optical elements satisfy conditional expressions P_u1?P_l1<0 and P_u2?P_l2>0 (where P_u1 denotes a local power of the first optical element acting on the upper ray, P_l1 denotes a local power of the first optical element acting on the lower ray, P_u2 denotes a local power of the second optical element acting on the upper ray, P_l2 denotes a local power of the second optical element acting on the lower ray).Type: GrantFiled: October 1, 2020Date of Patent: July 18, 2023Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.Inventors: Satoshi Kuzuhara, Hiroaki Okayama
-
Patent number: 11698680Abstract: In aspects, methods and apparatus are provided for generating a haptic effect for a three-dimensional (3D) environment that is experienced virtually by a user. The methods may be performed by a processor, and includes receiving media data that describes the 3D environment, wherein the media data includes haptic data which describes a haptic characteristic associated with at least one object, structure, or event in the 3D environment. The method further includes performing a haptic decoding operation and a haptic rendering operation. The decoding operation may include extracting the haptic data from the media data. The haptic rendering operation may include generating a drive signal and communicating the drive signal to a haptic output device to cause the haptic output device to generate a haptic effect at a user peripheral device. Numerous other aspects are provided.Type: GrantFiled: June 10, 2021Date of Patent: July 11, 2023Assignee: IMMERSION CORPORATIONInventors: David Birnbaum, Yeshwant Muthusamy, Jamal Saboune, Christopher Ullrich
-
Patent number: 11686939Abstract: An optical aperture multiplier includes a first optical waveguide (10) having a rectangular cross-section and including partially reflecting surfaces (40) at an oblique angle to a direction of elongation of the waveguide. A second optical waveguide (20), also including partially reflecting surfaces (45) at an oblique angle, is optically coupled with the first optical waveguide (10). An image coupled into the first optical waveguide with an initial direction of propagation at an oblique coupling angle advances by four-fold internal reflection along the first optical waveguide, with a proportion of intensity of the image reflected at the partially reflecting surfaces so as to be coupled into the second optical waveguide, and then propagates through two-fold reflection within the second optical waveguide, with a proportion of intensity of the image reflected at the partially reflecting surfaces so as to be directed outwards from one of the parallel faces as a visible image.Type: GrantFiled: July 4, 2022Date of Patent: June 27, 2023Assignee: LUMUS LTD.Inventor: Yochay Danziger
-
Patent number: 11682183Abstract: An augmented reality system and an anchor display method thereof are provided. An environmental image is captured by an image capturing device disposed on a head-mounted device. A reference image block in the environmental image that matches a display image on a display is detected by performing feature matching between the environmental image and the display image. Position information of the reference image block in the environmental image is obtained. Depth information of the display is obtained according to an actual screen size of the display and a block size of the reference image block in the environmental image. At least one virtual object is displayed by the head-mounted device according to the position information and the depth information. The at least one virtual object is displayed as being anchored to at least one screen bezel of the display.Type: GrantFiled: November 3, 2021Date of Patent: June 20, 2023Assignee: Acer IncorporatedInventor: Chao-Shih Huang
-
Patent number: 11676422Abstract: A system and method for generating data suitable for determining a parameter of a human eye. The method includes receiving a first image of the eye for a first time from a camera of known camera intrinsics defining an image plane, and determining a first ellipse in the first image. The method includes determining a first eye intersecting line expected to intersect a center of the eyeball at the first time as a line which is, in the direction of the orientation vector, parallel-shifted to the first center line by an expected distance between the center of the eyeball and a center of the pupil.Type: GrantFiled: June 5, 2019Date of Patent: June 13, 2023Assignee: PUPIL LABS GmbHInventors: Kai Dierkes, Moritz Kassner
-
Patent number: 11659150Abstract: A processor system processes image data for rendering a virtual environment for a user present in a real environment. The system receives head tracking data indicative of the orientation of the head of the user. An image processor generates image data for rendering a viewport of the virtual environment on a display system based on the head tracking data. A real-view area is defined in the virtual environment, having at least one boundary. The boundary corresponds to predetermined coordinates in the virtual environment. Thereby a corresponding part of the real environment is made visible in the real-view area, the part showing the real environment as perceived from the user head pose. Effectively the virtual environment is augmented by integrating part of the real environment via the real-view area.Type: GrantFiled: December 10, 2020Date of Patent: May 23, 2023Assignee: KONINKLIJKE KPN N.V.Inventors: Hans Maarten Stokking, Milan Wijnmalen
-
Patent number: 11654771Abstract: A multi-view display device is provided for a collaborative co-pilot system (system) of a vehicle having a windshield. The system includes one or more input devices for generating an input signal associated with a road condition. The multi-view display device includes one or more single-user viewing devices, with each single-user viewing device including an Augmented Reality Head Up Display module (ARHUD) for generating a dedicated display associated with the road condition. The ARHUD projects the dedicated display onto an associated portion of the windshield that is visible to a corresponding single user and overlaying a road geometry associated with the road condition. The multi-view display device further includes an Extended View Display module (EV display module) for generating a common display that is visible to a plurality of users including each one of the single users.Type: GrantFiled: July 20, 2022Date of Patent: May 23, 2023Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLCInventors: Kai-Han Chang, Thomas A. Seder, Joseph F. Szczerba, John P. Weiss
-
Patent number: 11654358Abstract: Systems and methods for executing content to be rendered on a screen of a head mounted display (HMD) are provided. One method includes executing the content to render interactive scenes on the screen and tracking an orientation direction of the HMD when worn on a head of a user and the interactive scenes are being rendered on the screen. The method includes changing view directions into the interactive scenes based on changes in the orientation direction of the HMD, such that movements of the head of the user causes the changes in the view directions into the interactive scenes. The method further includes receiving images of a real world space using a camera of the HMD. The camera of the HMD is configured to capture a location of real world objects in the real world space relative to the user of the HMD.Type: GrantFiled: January 31, 2022Date of Patent: May 23, 2023Assignee: Sony Interactive Entertainment Inc.Inventors: Steven Osman, Xiaodong Mao
-
Patent number: 11656242Abstract: An angular velocity detection device includes an angular velocity sensor configured to detect angular velocity, an acquisition unit configured to acquire orientation information in a three-dimensional space on a moving object including the angular velocity sensor, a calculation unit configured to calculate estimated angular velocity based on the acquired orientation information, and a correction unit configured to correct an output of the angular velocity sensor based on the angular velocity detected by the angular velocity sensor and the estimated angular velocity calculated by the calculation unit.Type: GrantFiled: September 18, 2020Date of Patent: May 23, 2023Assignee: CANON KABUSHIKI KAISHAInventor: Toshiaki Sato
-
Patent number: 11648878Abstract: A luminance determining unit 14 determines a luminance distribution of an exterior circumstantial image in a line-of-sight direction of a driver 300, and a luminance changing unit 15 determines a bright region 301 of this luminance distribution. Further, the luminance changing unit 15 determines a luminance after the change in a peripheral region 302 of this bright region 301. A virtual-image creating unit 16A creates a virtual image based on the determined luminance, and a display processing unit 17 displays this virtual image on a display unit 200. In this manner, since a display system 1A displays the virtual image for use in increasing the luminance in periphery of the bright region 301, the feeling of the brightness for the driver 300 can be moderated, and therefore, the visual recognition can be improved. That is, the display system 1A can output the virtual image depending on the circumstances.Type: GrantFiled: September 22, 2017Date of Patent: May 16, 2023Assignee: MAXELL, LTD.Inventors: Seiji Murata, Hiromitsu Mori, Kenichi Shimada, Kazuyoshi Yamazaki, Mayumi Nagayoshi
-
Patent number: 11640050Abstract: A head-up display (HUD) system is provided. The HUD system comprises a microdisplay-based projection system, a diffuser, a relay optical system, and a combiner. The microdisplay-based HUD system includes aberration correction capabilities and may easily and effectively replace a CRT-based HUD system in aircrafts while providing light-weight, multi-color, superior imaging capabilities with a large field-of-view.Type: GrantFiled: October 19, 2011Date of Patent: May 2, 2023Assignee: EPIC OPTIX INC.Inventors: Simon Magarill, Dongha Kim
-
Patent number: 11635867Abstract: Implementations described herein relate to methods, devices, and computer-readable media to display a user interface that includes a map portion and a grid portion. A method includes identifying a first set of images that match a first region of a digital map and causing a user interface to be displayed that includes a map portion that corresponds to the first region of the digital map and a grid portion that includes images of the first set. The method further includes receiving user input indicative of a second region of the digital map. The method further includes identifying a second set of images that match the second region of the digital map and updating the user interface such that the map portion of the updated user interface corresponds to the second region of the digital map and the grid portion of the updated user interface includes images of the second set.Type: GrantFiled: May 17, 2020Date of Patent: April 25, 2023Assignee: Google LLCInventors: James Aspinall, Andre Santoso, Juan Carlos Miguel Anorga
-
Patent number: 11625095Abstract: Embodiments are related to a plurality of gaze sensors embedded into a frame of a headset for detection of a gaze vector of a user wearing the headset and user's control at the headset. The gaze vector for an eye of the user can be within a threshold distance from one of the gaze sensors. By monitoring signals detected by the gaze sensors, it can be determined that the gaze vector is within the threshold distance from the gaze sensor. Based on this determination, at least one action associated with the headset is initiated.Type: GrantFiled: January 20, 2022Date of Patent: April 11, 2023Assignee: Zinn Labs, Inc.Inventors: Robert Konrad, Kevin Boyle, Nitish Padmanaban, Gordon Wetzstein