Image Superposition By Optical Means (e.g., Heads-up Display) Patents (Class 345/7)
-
Patent number: 11927750Abstract: A head up display arrangement for a motor vehicle includes an image source emitting a light field. A first freeform mirror is positioned to provide a first reflection of the light field. A generally concave second freeform mirror is positioned to receive the first reflection and provide a second reflection of the light field. The second reflection is reflected off of a windshield of the vehicle so as to be visible to a driver of the vehicle as a virtual image. The generally concave second freeform mirror includes a reflective surface having a shape such that the virtual image appears to be curved to the driver of the vehicle.Type: GrantFiled: May 17, 2022Date of Patent: March 12, 2024Assignee: Panasonic Automotive Systems Company of America, Division of Panasonic Corporation of North AmericaInventors: Patrick O'Connell, Edo Omanovic
-
Patent number: 11915627Abstract: A viewing angle expansion plate, which is a multi-pinhole mask, includes a plurality of cell areas; and a plurality of pinholes formed in the plurality of cell areas, wherein each cell area from among the plurality of cell areas corresponds to a respective pixel from among a plurality of pixels in a flat panel display. The flat panel display includes a light source configured to emit parallel light; a flat panel, on which the parallel light is incident, configured to provide a three-dimensional image; and the viewing angle expansion plate.Type: GrantFiled: September 23, 2019Date of Patent: February 27, 2024Assignees: SAMSUNG ELECTRONICS CO., LTD., KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGYInventors: Wontaek Seo, Yongkeun Park, Hoon Song, Jungkwuen An, Jongchan Park
-
Patent number: 11900841Abstract: A display system of a vehicle, and a control method thereof includes: a user input device; a head-up display configured to project a virtual image including augmented reality contents and to adjust a projection position of the augmented reality contents according to predetermined driver viewpoint information and left and right direction offset; and a controller configured to correct the driver viewpoint information or the left and right direction offset according to a control input received through the user input device, wherein the left and right direction offset indicates a degree to which the augmented reality contents are shifted left or right.Type: GrantFiled: January 6, 2022Date of Patent: February 13, 2024Assignees: Hyundai Motor Company, Kia CorporationInventors: Juhyuk Kim, Huiwon Shin
-
Patent number: 11899218Abstract: A head-up display and a movable body can display a virtual image viewable at a position nearer a user. The head-up display includes a display device that displays a first image and emits image light from the first image in a first direction, a first optical member located in the first direction from the display device, and a second optical member located between the display device and the first optical member in the first direction. The second optical member reflects the first image in a first plane direction and a second plane direction and displays a virtual image of the first image in a space between the first optical member and a user.Type: GrantFiled: November 12, 2020Date of Patent: February 13, 2024Assignee: KYOCERA CORPORATIONInventors: Kaoru Kusafuka, Mitsuhiro Murata, Sunao Hashimoto
-
Patent number: 11902503Abstract: Systems and methods for rendering a 3D image are provided. The system receives texture and depth data (depth map) for an image. The system generates, based on the image data, a plurality of folded focal planes matrices. For each respective pixel matrix, the system preprocesses pixel values in the respective focal pixel plane matrix to generate a respective preprocessed matrix, wherein the respective preprocessed matrix clusters together pixel values of the respective folded focal plane matrix based on the depth data for the image. The system generates phase functions based on a plurality of the preprocessed matrices. The system configures a spatial light modulator of the SLM device in accordance with the generated phase functions. The system then provides the plurality of the preprocessed matrices as input to the SLM device to generate for display a 3D representation of the received image data.Type: GrantFiled: November 18, 2022Date of Patent: February 13, 2024Assignee: ROVI GUIDES, INC.Inventors: Seppo Valli, Pekka Siltanen
-
Patent number: 11893482Abstract: Examples are disclosed that relate to the restoration of degraded images acquired via a behind-display camera. One example provides a method of training a machine learning model, the method comprising inputting training image pairs into the machine learning model, each training image pair comprising an undegraded image and a degraded image that represents an appearance of the undegraded image to a behind-display camera, and training the machine learning model using the training image pairs to generate frequency information that is missing from the degraded images.Type: GrantFiled: February 24, 2020Date of Patent: February 6, 2024Assignee: Microsoft Technology Licensing, LLCInventors: Yuqian Zhou, Timothy Andrew Large, Se Hoon Lim, Neil Emerton, Yonghuan David Ren
-
Patent number: 11886089Abstract: A tintable window is described having a tintable coating, e.g., an electrochromic device coating, for regulating light transmitted through the window. In some embodiments, the window has a transparent display in the window's viewable region. Transparent displays may be substantially transparent when not in use, or when the window is viewed in a direction facing away from the transparent display. Windows may have sensors for receiving user commands and/or for monitoring environmental conditions. Transparent displays can display graphical user interfaces to, e.g., control window functions. Windows, as described herein, offer an alternative display to conventional projectors, TVs, and monitors. Windows may also be configured to receive, transmit, or block wireless communications from passing through the window. A window control system may share computational resources between controllers (e.g., at different windows).Type: GrantFiled: April 25, 2018Date of Patent: January 30, 2024Assignee: View, Inc.Inventors: Nitesh Trikha, Stephen Clark Brown, Dhairya Shrivastava, Robert T. Rozbicki
-
Patent number: 11873007Abstract: The present disclosure relates to an information processing apparatus, an information processing method, and a program for ensuring safety when a line-of-sight direction of a driver is inappropriate according to a driving situation. The line-of-sight direction of the driver of a vehicle is detected, whether or not the detected line-of-sight direction is a safe line-of-sight direction is determined, and in a case where the line-of-sight direction is determined not to be the safe line-of-sight direction, the vehicle is controlled to a safe state. The present disclosure can be applied to an in-vehicle system.Type: GrantFiled: October 30, 2019Date of Patent: January 16, 2024Assignee: SONY GROUP CORPORATIONInventor: Masahiro Tamori
-
Patent number: 11867907Abstract: An electronic device may include a display module that produces light having an image, a lens that directs the light to a waveguide, and a waveguide that directs the light to an eye box. The lens may produce a foveated image in the light by applying a non-uniform magnification to the image in the light. The non-uniform magnification may vary as a function of angle within a field of view of the lens. This may allow the foveated image to have higher resolution within the central region than in the peripheral region. Performing foveation using the lens maximizes the resolution of images at the eye box without increasing the size of the display module. Control circuitry on the device may apply a pre-distortion to the image that is an inverse of distortion introduced by the lens in producing the foveated image.Type: GrantFiled: September 14, 2021Date of Patent: January 9, 2024Inventors: Vikrant Bhakta, David A. Kalinowski, Hyungryul Choi, Nathanael D. Parkhill, Stanley K. Melax, Byron R. Cocilovo
-
Patent number: 11856178Abstract: Systems and methods for viewing stereoscopic video images are disclosed. The systems can include a first video camera configured to generate a first video feed of a subject, and a second video camera configured to generate a second video feed of the subject. The first video feed and the second video feed combined generate a near real-time stereoscopic video image. A tracking module can be associated with the first video camera and the second video camera, and can be configured to cause the first video camera and the second video camera to be directed to a desired convergent point relative to a selected tracking point to maintain stereopsis. The system may further include an array of video cameras, a gesture control module, an image adjustment module, a calibration module, or a 3-D modeling module, for example.Type: GrantFiled: July 3, 2018Date of Patent: December 26, 2023Assignee: Ultradent Products, Inc.Inventors: Neil T. Jessop, Matthew Michael Fisher
-
Patent number: 11848542Abstract: An optical system includes an illumination layer, an optical combiner, and an active optics block. The illumination layer includes an array of point light sources configured to emit calibration light. The optical combiner is configured to pass visible light to a front side of the optical system and to direct the calibration light to a camera that generates an image in response to the calibration light. The image includes an array of points corresponding to the array of point light sources. The active optics block includes an adjustable lens disposed between the illumination layer and the optical combiner and is configured to pass the calibration light to the optical combiner and to focus the visible light. The active optics block is further configured to adjust an optical power of the adjustable lens based on the image of the array of points.Type: GrantFiled: May 29, 2019Date of Patent: December 19, 2023Assignee: Meta Platforms Technologies, LLCInventors: Robin Sharma, Katherine Marie Smyth, Andrew John Ouderkirk, Karol Constantine Hatzilias, Christopher Yuan-Ting Liao
-
Patent number: 11841511Abstract: A wearable display system includes one or more nanowire LED micro-displays. The nanowire micro-LED displays may be monochrome or full-color. The nanowire LEDs forming the arrays may have an advantageously narrow angular emission profile and high light output. Where a plurality of nanowire LED micro-displays is utilized, the micro-displays may be positioned at different sides of an optical combiner, for example, an X-cube prism which receives light rays from different micro-displays and outputs the light rays from the same face of the cube. The optical combiner directs the light to projection optics, which outputs the light to an eyepiece that relays the light to a user's eye. The eyepiece may output the light to the user's eye with different amounts of wavefront divergence, to place virtual content on different depth planes.Type: GrantFiled: February 9, 2023Date of Patent: December 12, 2023Inventors: Jahja I. Trisnadi, Clinton Carlisle
-
Patent number: 11832401Abstract: A head-mounted display includes a main body having a housing defining at least a portion of an exterior of the head mounted display; a built-in display disposed in the housing; a wearing band extending from the main body to a rear side and having a shape enclosing a head of a user as a whole; a right-side extending section configured to make up a right-side part of the wearing band; a left-side extending section configured to make up a left-side part of the wearing band; and a frame which is separate from the housing and constitutes at least a portion of a rear part of the main body, where the frame has left and right openings for receiving left and right lenses, respectively, and a recessed section for accommodating a user's nose when the head-mounted display is worn.Type: GrantFiled: March 8, 2022Date of Patent: November 28, 2023Assignee: Sony Interactive Entertainment Inc.Inventors: Takamasa Araki, Fumihiko Sato, Takayuki Tateno
-
Patent number: 11828938Abstract: A small information display apparatus capable of displaying video information on a windshield as a virtual image is provided. An information display apparatus configured to display video information of a virtual image on a windshield of a conveyance includes: a liquid crystal panel arranged as a video display apparatus configured to form the video information; and a virtual image optical system provided with a windshield for displaying the virtual image at a front of the conveyance by reflecting video of the liquid crystal panel by means of the windshield. The virtual image optical system is configured by arranging a concave mirror and an optical element between the concave mirror and the video display apparatus.Type: GrantFiled: November 30, 2021Date of Patent: November 28, 2023Assignees: MAXELL, LTD., Hitachi Industry & Control Solutions, Ltd.Inventors: Koji Hirata, Masahiko Yatsu, Toshinori Sugiyama, Kazuomi Kaneko, Shigeki Hoshino
-
Patent number: 11816388Abstract: Systems, devices, and methods for visual displays are described. Such visual displays may be used in a retail environment to provide interactive presentations to customers. The visual displays may include a display panel, a visual source, and a controller. The display panel may present images and/or video to a user, in which the images and/or video are generated by the visual source. The controller may determine the types of images and/or video to be presented based upon communications received from a user via a communication device or a user kiosk. The display panel may be a variable height and may be offset from the floor or a shelf by a variable distance. A plurality of display panels may be arranged on a display floor to provide retail experiences to customers and/or may be received by one or more docks placed in the display floor.Type: GrantFiled: June 4, 2021Date of Patent: November 14, 2023Assignee: GOOGLE LLCInventors: Kyle Glackin, Nairey Keshishian, Lisa Marie Zane, Walter J. S. Hermsen, Cheryl Eng, Bridget Cinquegrano
-
Patent number: 11815694Abstract: An apparatus may include a first emitter and a second emitter. The first emitter may be configured to emit visible light comprising first heads up display information to be displayed to a driver of a vehicle. The second emitter may be configured to emit infrared light comprising second heads up display information to be displayed to one or more rear seat passengers of the vehicle.Type: GrantFiled: July 14, 2021Date of Patent: November 14, 2023Assignee: TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC.Inventor: Mikio David
-
Patent number: 11815679Abstract: A method, a processing device, and a system for information display are proposed. The system may be disposed in a vehicle and includes a light transmissive display, at least one first information extraction device, at least one second information extraction device, and a processing device. The first information extraction device is configured to extract gaze information of a user in the vehicle. The second information extraction device is configured to extract scene information of a scene outside of the vehicle. The processing device is configured to compute a field of view of the user viewing the scene outside of the vehicle through the display according to the gaze information and the scene information, generate display information according to the field of view of the user, and display the display information on the display.Type: GrantFiled: December 15, 2021Date of Patent: November 14, 2023Assignee: Industrial Technology Research InstituteInventors: Hong-Ming Dai, Tzu-Yi Yu, Chien-Ju Lee, Yu-Hsiang Tsai
-
Patent number: 11809674Abstract: There is provided a method for monitoring interaction with 3D medical images, comprising: dividing the 3D image into a sequence of a 2D images, arranging the sequence into slabs each including at least one 2D image, computing, for each respective slab, a minimal amount of viewing time a user is predicted to spend viewing the respective slab, monitoring, while the 3D medical image is presented on a display, an amount of time a user actually spent viewing portions of the 3D medical image corresponding to each of the of slabs, in response to the amount of time spent viewing a certain portion of the 3D medical image being less than the computed minimal amount of viewing time of a certain slab corresponding to the certain portion, generating instructions for implementation by a user interface indicative of the amount of time spent being less than the computed minimal amount of time.Type: GrantFiled: July 30, 2020Date of Patent: November 7, 2023Assignee: International Business Machines CorporationInventors: Flora Gilboa-Solomon, Aviad Zlotnick
-
Patent number: 11796808Abstract: A directional backlit display device includes a light source module, a reflective narrow-angle diffuser, a backlit display device panel, an eye tracking device, and a controller. The diffuser includes a shaft and is utilized to reflect and uniformly diffuse the light to provide a uniform directional light beam. The backlit display device panel is included on the projecting optical path of the uniform directional light beam. The uniform directional light beam illuminates an image displayed on the backlit display device panel and projects to a projection area. The controller receives an eye position information from the eye tracking device and determines a coordinate. The controller determines a corrective projection area when the coordinate deviates from the projection area, and the drive module rotates the reflective narrow-angle diffuser around an axis of the shaft according to the corrective projection area, so the image projection area moves with the eye.Type: GrantFiled: February 9, 2022Date of Patent: October 24, 2023Assignee: E-LEAD ELECTRONIC CO., LTD.Inventor: Stephen Chen
-
Patent number: 11776239Abstract: Disclosed is a liveness test method and liveness test apparatus. The liveness test method includes determining a presence of a subject using a radar sensor, performing a first liveness test on the subject based on radar data obtained by the radar sensor, in response to the subject being present, acquiring image data of the subject using an image sensor, in response to a result of the first liveness test satisfying a first condition, and performing a second liveness test on the subject based on the image data.Type: GrantFiled: July 9, 2020Date of Patent: October 3, 2023Assignee: Samsung Electronics Co., Ltd.Inventors: Seungju Han, Byung Kwan Kim, Jong-Sok Kim, Sungdo Choi
-
Patent number: 11754975Abstract: A holographic display and method for operating the holographic display can include: a holographic display operable in a plurality of modes, a computing system, and a sensor. The holographic display can option include a user interface device. Views displayed by the display can optionally be processed or modified based on a viewer pose relative to the display.Type: GrantFiled: July 29, 2022Date of Patent: September 12, 2023Assignee: Looking Glass Factory, Inc.Inventors: Alexis Hornstein, Kyle Appelgate, Lee Shiu Pong, Shi Yun Liu, Shawn Michael Frayne
-
Patent number: 11749132Abstract: A method includes detecting an eye movement of a reader during a reading of presented text; determining, based on whether an eye movement is detected, whether the reader is looking at the presented text; pausing a presentation of the presented text if it is determined that the reader is not looking at the presented text; and resuming, if the presentation of the text is paused, the presentation of the presented text.Type: GrantFiled: November 21, 2018Date of Patent: September 5, 2023Assignee: International Business Machines CorporationInventors: Aldis Sipolins, Marco Cavallo, Ravi Tejwani, Jenna Reinen, Hui Wu
-
Patent number: 11740475Abstract: A head-mounted display includes a display unit and a facial interface. The display unit displays graphical content to the user. The facial interface is removably coupleable to the display unit and engages a facial engagement region of a face of the user whereby the display unit is supported on the face of the user. The facial interface includes a physiological sensor for sensing a physiological condition of the user in the facial engagement region.Type: GrantFiled: January 14, 2020Date of Patent: August 29, 2023Assignee: APPLE INC.Inventors: Daniel M. Strongwater, Kristi E. Bauerly, Dustin A. Hatfield
-
Patent number: 11738643Abstract: Disclosed embodiments include power machines having doors with a display that allows the display of information, such as gauges, user inputs, mapped obstacles, boundaries, etc., allowing the operator of the machine to see the displayed information closer to the line of sight with the work area.Type: GrantFiled: February 27, 2020Date of Patent: August 29, 2023Assignee: Clark Equipment CompanyInventors: John Pfaff, Dennis Agnew, Matthew Sagaser, Joel Honeyman
-
Patent number: 11736674Abstract: Systems and methods are disclosed that dynamically and laterally shift each virtual object displayed by an augmented reality headset by a respective distance as the respective virtual object is displayed to change virtual depth from a first virtual depth to a second virtual depth. The respective distance may be determined based on a lateral distance between a first convergence vector of a user's eye with the respective virtual object at the first virtual depth and a second convergence vector of the user's eye with the respective virtual object at the second virtual depth along the display, and may be based on an interpupillary distance. In this manner, display of the virtual object may be adjusted such that the gazes of the user's eyes may converge where the virtual object appears to be.Type: GrantFiled: September 2, 2021Date of Patent: August 22, 2023Assignee: Universal City Studios LLCInventors: Yu-Jen Lin, Patrick John Goergen, Martin Evan Graham
-
Patent number: 11730226Abstract: The disclosed embodiments illustrate methods and systems for training users in sports using mixed reality. The method includes retrieving data from athletes wearing helmets, wearable glasses, and/or motion-capture suits in real time. The helmets and the wearable glasses are integrated with mixed-reality technology. Further, physical performance data of the athletes is captured using a variety of time-synchronized measurement techniques. Thereafter, the athletes are trained using the captured data and audio, visual and haptic feedback.Type: GrantFiled: September 22, 2020Date of Patent: August 22, 2023Assignee: Robotarmy Corp.Inventors: Damien Phelan Stolarz, Alan Gary Brown
-
Patent number: 11720380Abstract: A system receives, from a first augmented reality device, a first image of a web application that shows a first element of the web application. The system receives eye tracking information that indicates eye movements of a user looking at different elements of web application. The system determines that the user is looking at the first element and that the first element is actuated. The system receives a second image of the web application that shows an error message. The system determines that the first element is faulty, records user events that led to the error message, and updates an augmented reality message for the first element by indicating that the first element is faulty. If it is determined that a second user wearing a second augmented reality device is looking at the first element, the system communicates the updated augmented reality message to the second augmented reality device.Type: GrantFiled: May 18, 2022Date of Patent: August 8, 2023Assignee: Bank of America CorporationInventor: Shailendra Singh
-
Patent number: 11716456Abstract: A near-eye display device comprises right and left display projectors, expansion optics, and inertial measurement units (IMUs), in addition to a plurality of angle-sensitive pixel (ASP) elements and a computer. The right and left expansion optics are configured to receive respective display images from the right and left display projectors and to release expanded forms of the display images. The right IMU is fixedly coupled to the right display projector, and the left IMU is fixedly coupled to the left display projector. Each ASP element is responsive to an angle of light of one of the respective display images as received into the right or left expansion optic. The computer is configured to receive output from the right IMU, the left IMU and the plurality of ASP elements, and render display data for the right and left display projectors based in part on the output.Type: GrantFiled: May 21, 2021Date of Patent: August 1, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Michael Edward Samples, Dmitry Reshidko, Rayna Demaster-Smith
-
Patent number: 11707984Abstract: A circuit device 100 includes an error detection circuit 110 and a processing circuit 120. The error detection circuit 110 obtains a glare index value, which is an index value indicating glare of a head-up display, based on image data IMD for head-up display. The error detection circuit 110 determines whether or not a glare index value has exceeded a first threshold value, and when the glare index value exceeds the first threshold value, detects occurrence of a first glare error. When occurrence of a first glare error is detected, the processing circuit 120 performs processing corresponding to the first glare error.Type: GrantFiled: December 19, 2019Date of Patent: July 25, 2023Assignee: SEIKO EPSON CORPORATIONInventors: Kumar Anandabairavasamy Anand, Wittmeir Manfred, Jeffrey Eric, Tetsuo Kawamoto, Yasutoshi Akiba
-
Patent number: 11703683Abstract: A head-up display includes a display device and a projection optical system; the projection optical system includes first and second optical elements arranged in order of an optical path from the image; and when optical paths corresponding to an upper end and a lower end of the virtual image are defined as an upper ray and a lower ray, respectively, and a diverging effect and a converging effect are defined as being negative and positive, respectively, the first and the second optical elements satisfy conditional expressions P_u1?P_l1<0 and P_u2?P_l2>0 (where P_u1 denotes a local power of the first optical element acting on the upper ray, P_l1 denotes a local power of the first optical element acting on the lower ray, P_u2 denotes a local power of the second optical element acting on the upper ray, P_l2 denotes a local power of the second optical element acting on the lower ray).Type: GrantFiled: October 1, 2020Date of Patent: July 18, 2023Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.Inventors: Satoshi Kuzuhara, Hiroaki Okayama
-
Patent number: 11698680Abstract: In aspects, methods and apparatus are provided for generating a haptic effect for a three-dimensional (3D) environment that is experienced virtually by a user. The methods may be performed by a processor, and includes receiving media data that describes the 3D environment, wherein the media data includes haptic data which describes a haptic characteristic associated with at least one object, structure, or event in the 3D environment. The method further includes performing a haptic decoding operation and a haptic rendering operation. The decoding operation may include extracting the haptic data from the media data. The haptic rendering operation may include generating a drive signal and communicating the drive signal to a haptic output device to cause the haptic output device to generate a haptic effect at a user peripheral device. Numerous other aspects are provided.Type: GrantFiled: June 10, 2021Date of Patent: July 11, 2023Assignee: IMMERSION CORPORATIONInventors: David Birnbaum, Yeshwant Muthusamy, Jamal Saboune, Christopher Ullrich
-
Patent number: 11686939Abstract: An optical aperture multiplier includes a first optical waveguide (10) having a rectangular cross-section and including partially reflecting surfaces (40) at an oblique angle to a direction of elongation of the waveguide. A second optical waveguide (20), also including partially reflecting surfaces (45) at an oblique angle, is optically coupled with the first optical waveguide (10). An image coupled into the first optical waveguide with an initial direction of propagation at an oblique coupling angle advances by four-fold internal reflection along the first optical waveguide, with a proportion of intensity of the image reflected at the partially reflecting surfaces so as to be coupled into the second optical waveguide, and then propagates through two-fold reflection within the second optical waveguide, with a proportion of intensity of the image reflected at the partially reflecting surfaces so as to be directed outwards from one of the parallel faces as a visible image.Type: GrantFiled: July 4, 2022Date of Patent: June 27, 2023Assignee: LUMUS LTD.Inventor: Yochay Danziger
-
Patent number: 11682183Abstract: An augmented reality system and an anchor display method thereof are provided. An environmental image is captured by an image capturing device disposed on a head-mounted device. A reference image block in the environmental image that matches a display image on a display is detected by performing feature matching between the environmental image and the display image. Position information of the reference image block in the environmental image is obtained. Depth information of the display is obtained according to an actual screen size of the display and a block size of the reference image block in the environmental image. At least one virtual object is displayed by the head-mounted device according to the position information and the depth information. The at least one virtual object is displayed as being anchored to at least one screen bezel of the display.Type: GrantFiled: November 3, 2021Date of Patent: June 20, 2023Assignee: Acer IncorporatedInventor: Chao-Shih Huang
-
Patent number: 11676422Abstract: A system and method for generating data suitable for determining a parameter of a human eye. The method includes receiving a first image of the eye for a first time from a camera of known camera intrinsics defining an image plane, and determining a first ellipse in the first image. The method includes determining a first eye intersecting line expected to intersect a center of the eyeball at the first time as a line which is, in the direction of the orientation vector, parallel-shifted to the first center line by an expected distance between the center of the eyeball and a center of the pupil.Type: GrantFiled: June 5, 2019Date of Patent: June 13, 2023Assignee: PUPIL LABS GmbHInventors: Kai Dierkes, Moritz Kassner
-
Patent number: 11659150Abstract: A processor system processes image data for rendering a virtual environment for a user present in a real environment. The system receives head tracking data indicative of the orientation of the head of the user. An image processor generates image data for rendering a viewport of the virtual environment on a display system based on the head tracking data. A real-view area is defined in the virtual environment, having at least one boundary. The boundary corresponds to predetermined coordinates in the virtual environment. Thereby a corresponding part of the real environment is made visible in the real-view area, the part showing the real environment as perceived from the user head pose. Effectively the virtual environment is augmented by integrating part of the real environment via the real-view area.Type: GrantFiled: December 10, 2020Date of Patent: May 23, 2023Assignee: KONINKLIJKE KPN N.V.Inventors: Hans Maarten Stokking, Milan Wijnmalen
-
Patent number: 11654771Abstract: A multi-view display device is provided for a collaborative co-pilot system (system) of a vehicle having a windshield. The system includes one or more input devices for generating an input signal associated with a road condition. The multi-view display device includes one or more single-user viewing devices, with each single-user viewing device including an Augmented Reality Head Up Display module (ARHUD) for generating a dedicated display associated with the road condition. The ARHUD projects the dedicated display onto an associated portion of the windshield that is visible to a corresponding single user and overlaying a road geometry associated with the road condition. The multi-view display device further includes an Extended View Display module (EV display module) for generating a common display that is visible to a plurality of users including each one of the single users.Type: GrantFiled: July 20, 2022Date of Patent: May 23, 2023Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLCInventors: Kai-Han Chang, Thomas A. Seder, Joseph F. Szczerba, John P. Weiss
-
Patent number: 11654358Abstract: Systems and methods for executing content to be rendered on a screen of a head mounted display (HMD) are provided. One method includes executing the content to render interactive scenes on the screen and tracking an orientation direction of the HMD when worn on a head of a user and the interactive scenes are being rendered on the screen. The method includes changing view directions into the interactive scenes based on changes in the orientation direction of the HMD, such that movements of the head of the user causes the changes in the view directions into the interactive scenes. The method further includes receiving images of a real world space using a camera of the HMD. The camera of the HMD is configured to capture a location of real world objects in the real world space relative to the user of the HMD.Type: GrantFiled: January 31, 2022Date of Patent: May 23, 2023Assignee: Sony Interactive Entertainment Inc.Inventors: Steven Osman, Xiaodong Mao
-
Patent number: 11656242Abstract: An angular velocity detection device includes an angular velocity sensor configured to detect angular velocity, an acquisition unit configured to acquire orientation information in a three-dimensional space on a moving object including the angular velocity sensor, a calculation unit configured to calculate estimated angular velocity based on the acquired orientation information, and a correction unit configured to correct an output of the angular velocity sensor based on the angular velocity detected by the angular velocity sensor and the estimated angular velocity calculated by the calculation unit.Type: GrantFiled: September 18, 2020Date of Patent: May 23, 2023Assignee: CANON KABUSHIKI KAISHAInventor: Toshiaki Sato
-
Patent number: 11648878Abstract: A luminance determining unit 14 determines a luminance distribution of an exterior circumstantial image in a line-of-sight direction of a driver 300, and a luminance changing unit 15 determines a bright region 301 of this luminance distribution. Further, the luminance changing unit 15 determines a luminance after the change in a peripheral region 302 of this bright region 301. A virtual-image creating unit 16A creates a virtual image based on the determined luminance, and a display processing unit 17 displays this virtual image on a display unit 200. In this manner, since a display system 1A displays the virtual image for use in increasing the luminance in periphery of the bright region 301, the feeling of the brightness for the driver 300 can be moderated, and therefore, the visual recognition can be improved. That is, the display system 1A can output the virtual image depending on the circumstances.Type: GrantFiled: September 22, 2017Date of Patent: May 16, 2023Assignee: MAXELL, LTD.Inventors: Seiji Murata, Hiromitsu Mori, Kenichi Shimada, Kazuyoshi Yamazaki, Mayumi Nagayoshi
-
Patent number: 11640050Abstract: A head-up display (HUD) system is provided. The HUD system comprises a microdisplay-based projection system, a diffuser, a relay optical system, and a combiner. The microdisplay-based HUD system includes aberration correction capabilities and may easily and effectively replace a CRT-based HUD system in aircrafts while providing light-weight, multi-color, superior imaging capabilities with a large field-of-view.Type: GrantFiled: October 19, 2011Date of Patent: May 2, 2023Assignee: EPIC OPTIX INC.Inventors: Simon Magarill, Dongha Kim
-
Patent number: 11635867Abstract: Implementations described herein relate to methods, devices, and computer-readable media to display a user interface that includes a map portion and a grid portion. A method includes identifying a first set of images that match a first region of a digital map and causing a user interface to be displayed that includes a map portion that corresponds to the first region of the digital map and a grid portion that includes images of the first set. The method further includes receiving user input indicative of a second region of the digital map. The method further includes identifying a second set of images that match the second region of the digital map and updating the user interface such that the map portion of the updated user interface corresponds to the second region of the digital map and the grid portion of the updated user interface includes images of the second set.Type: GrantFiled: May 17, 2020Date of Patent: April 25, 2023Assignee: Google LLCInventors: James Aspinall, Andre Santoso, Juan Carlos Miguel Anorga
-
Patent number: 11625095Abstract: Embodiments are related to a plurality of gaze sensors embedded into a frame of a headset for detection of a gaze vector of a user wearing the headset and user's control at the headset. The gaze vector for an eye of the user can be within a threshold distance from one of the gaze sensors. By monitoring signals detected by the gaze sensors, it can be determined that the gaze vector is within the threshold distance from the gaze sensor. Based on this determination, at least one action associated with the headset is initiated.Type: GrantFiled: January 20, 2022Date of Patent: April 11, 2023Assignee: Zinn Labs, Inc.Inventors: Robert Konrad, Kevin Boyle, Nitish Padmanaban, Gordon Wetzstein
-
Patent number: 11625624Abstract: Systems, methods, and computer-readable media are described for performing real-time vehicular incident risk prediction using real-time vehicle-to-everything (V2X) data. A vehicular incident risk prediction machine learning model is trained using historical V2X data such as historical incident data and historical vehicle operator driving pattern behavior data as well as third-party data such as environmental condition data and infrastructure condition data. The trained machine learning model is then used to predict the risk of an incident for a vehicle on a roadway segment based on real-time V2X data relating to the roadway segment and/or vehicle operators on the roadway segment. A notification of a high risk of incident can then be sent to a V2X communication device of the vehicle to inform an operator of the vehicle.Type: GrantFiled: September 24, 2019Date of Patent: April 11, 2023Assignee: Ford Global Technologies, LLCInventors: Amin Ariannezhad, Hamed Asadi, Praveen Kumar Yalavarty
-
Patent number: 11619811Abstract: An image display system includes: an image projection unit that projects and displays an image on a display target for a moving body; a posture angle calculation unit that calculates a posture angle for the moving body on the basis of chronological data for acceleration detection values for the acceleration of the moving body in a prescribed time period; and a display control unit that controls the display position at which the image is projected and displayed on the display target, in accordance with the posture angle calculated by the posture angle calculation unit. The acceleration detection values include bi-directional components. The posture angle calculation unit excludes acceleration detection values from the chronological data used when calculating the posture angle, said acceleration detection values being included in an exclusion time period which has a ratio for the bidirectional components, in the prescribed time period, that is outside a prescribed range.Type: GrantFiled: September 24, 2021Date of Patent: April 4, 2023Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.Inventors: Fumihito Inukai, Toshiya Mori, Masanaga Tsuji, Ken′ichi Kasazumi, Yukihiro Chokyu
-
Patent number: 11614849Abstract: A system including a display output device, a computer including instructions that when executed by the computer, cause the computer to generate a virtual environment, instantiate one or more virtual devices into the virtual environment, instantiate a user representation into the virtual environment, and display the virtual environment, the one or more virtual devices, and the user representation on the display output device, an input device to receive a movement input associated with movement by the user representation in the virtual environment, and the computer further configured with instructions to move or rotate the one or more virtual devices relative to a point of reference in the virtual environment in response to the movement input, while maintaining the user representation stationary.Type: GrantFiled: May 13, 2019Date of Patent: March 28, 2023Assignee: Thermo Fisher Scientific, Inc.Inventors: Mark Field, Daniel Garden
-
Patent number: 11604360Abstract: The head-up display includes an imaging position changer configured to change a position of a virtual image between a far visual position far from an observer and a near visual position close to the observer. The imaging position changer inclines the virtual image at the far visual position by a second inclination angle with respect to a perpendicular plane to a reference light beam reaching a center of a viewpoint region in which a viewpoint of the observer is located, to move an upper end thereof in a forward direction of the moving object, and inclines the virtual image at the near visual position by a first inclination angle smaller than the second inclination angle with respect to the perpendicular plane to the reference light beam, to move the upper end in the forward direction of the moving object.Type: GrantFiled: December 18, 2020Date of Patent: March 14, 2023Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.Inventors: Hiroaki Okayama, Satoshi Kuzuhara, Yusuke Nihei, Koji Taniguchi, Makoto Funabiki
-
Patent number: 11602691Abstract: Described herein are techniques for providing an in-game virtual boundary. First data is received that is indicative of a user position while the user is playing a video game. It is determined whether the user position is within a warning zone, wherein the warning zone comprises an area between a soft boundary indicative of a safe area for the user and a safe boundary indicative of one or more real-world objects around the user. Based on a relationship between the user position and the safe boundary, a visual indication of a plurality of visual indications of the in-game virtual boundary is determined to provide to the user. Second data indicative of the visual indication is transmitted to a display being viewed by the user while playing the video game.Type: GrantFiled: March 11, 2021Date of Patent: March 14, 2023Assignee: Harmonix Music Systems, Inc.Inventor: Ryan William Challinor
-
Patent number: 11598967Abstract: A head-mounted display system includes a head-mounted display unit and a positioning and stabilising structure structured and arranged to hold the head-mounted display unit in an operational position over a user's face in use. The positioning and stabilising structure includes a rear support structure adapted to contact posterior regions of a user's head and a forehead support connector, which includes a forehead support strap, which extends generally along and in the direction of the sagittal plane and connects the rear support structure to a superior edge region of the head-mounted display unit. The forehead support connector further includes a forehead support rigidiser that provides rigidification to a portion of the forehead support connector.Type: GrantFiled: December 2, 2021Date of Patent: March 7, 2023Assignee: ResMed Pty LtdInventor: Ian Andrew Law
-
Patent number: 11586294Abstract: A video display apparatus according to an embodiment includes a video display unit configured to display a video image in a field of view of a user in a state in which the user is wearing the video display apparatus, an image pickup unit configured to take a video image of an outside state, a switching unit configured to selectively perform switching as to whether to display a video image of a certain content or a video image taken by the image pickup unit, and a switching control unit configured to control the switching unit. The switching control unit switches the video image displayed on the video display unit when an object with a predetermined identification pattern is included in the video image taken by the image pickup unit and the switching control unit has detected that a user's hand has made a predetermined gesture.Type: GrantFiled: November 19, 2021Date of Patent: February 21, 2023Assignee: JVCKENWOOD CORPORATIONInventor: Takeshi Ibaraki
-
Patent number: 11564657Abstract: Aspects of the technology described herein relate to techniques for guiding an operator to use an ultrasound device. Thereby, operators with little or no experience operating ultrasound devices may capture medically relevant ultrasound images and/or interpret the contents of the obtained ultrasound images. For example, some of the techniques disclosed herein may be used to identify a particular anatomical view of a subject to image with an ultrasound device, guide an operator of the ultrasound device to capture an ultrasound image of the subject that contains the particular anatomical view, and/or analyze the captured ultrasound image to identify medical information about the subject.Type: GrantFiled: May 25, 2021Date of Patent: January 31, 2023Assignee: BFLY OPERATIONS, INC.Inventors: Matthew de Jonge, Robert Schneider, David Elgena, Alex Rothberg, Jonathan M. Rothberg, Michal Sofka, Tomer Gafner, Karl Thiele, Abraham Neben