Image Superposition By Optical Means (e.g., Heads-up Display) Patents (Class 345/7)
  • Patent number: 11366315
    Abstract: This invention provides an image processing apparatus configured to communicate with a head mounted display, which comprises a display device and an optical system for imaging an image displayed on the display device in relation to a user's eyes, and to generate image data for displaying on the display device of the head mounted display, wherein the image processing apparatus comprises a generating unit configured to generate image data for displaying on the display device, and an image processing unit configured to, with regard to the image data generated by the generating unit, in relation to inside a visible area of the optical system, perform image processing for correcting a deterioration of image quality by the optical system.
    Type: Grant
    Filed: August 27, 2020
    Date of Patent: June 21, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Yoshiki Kajita
  • Patent number: 11363242
    Abstract: Light projection systems and methods may comprise combining light from two or more projectors, Each projector may be controlled so that the combined light output of the projectors matches a target for the projected light. In some embodiments optimization is performed to generate image data and control signals for each of the projectors. Embodiments may be applied in image projecting applications, lighting applications, and 3D stereoscopic imaging.
    Type: Grant
    Filed: December 20, 2018
    Date of Patent: June 14, 2022
    Assignee: MTT Innovation Incorporated
    Inventors: Eric Kozak, Gerwin Damberg, Anders Ballestad, Raveen Kumaran, James Gregson, Johannes Minor, Gil Rosenfeld
  • Patent number: 11360302
    Abstract: A head up display arrangement for a motor vehicle includes an image source emitting a light field. A first freeform mirror is positioned to provide a first reflection of the light field. A generally concave second freeform mirror is positioned to receive the first reflection and provide a second reflection of the light field. The second reflection is reflected off of a windshield of the vehicle so as to be visible to a driver of the vehicle as a virtual image. The generally concave second freeform mirror includes a reflective surface having a shape such that the virtual image appears to be curved to the driver of the vehicle.
    Type: Grant
    Filed: September 22, 2020
    Date of Patent: June 14, 2022
    Assignee: Panasonic Automotive Systems Company of America, Division of Panasonic Corporation of North America
    Inventors: Patrick O'Connell, Edo Omanovic
  • Patent number: 11360316
    Abstract: Augmented reality lenses configured to be light, fit in standard eyeglass frames, have a field of view of 90 degrees and visible light intensity of above 1000 NIT. The lenses receive an encoded light image from an image generator. Transfer optics and an image presenter are integrally formed within the lens. An image presenter curved in one direction having reflective diffraction gratings on a concave surface of the curve and configured to present the encoded light image as a virtual augmented reality image to the eye of the wearer. The transfer optics system also having reflectors and reflective gratings and is configured to propagate image of encoded light from the image generator to the image presenter. The transfer optics system and image presenter are integrally formed in at least one lens of the augmented reality eyeglasses.
    Type: Grant
    Filed: July 22, 2021
    Date of Patent: June 14, 2022
    Inventor: Michael Shlomo Ben Yacov
  • Patent number: 11350071
    Abstract: A display system renders a motion parallax view of object images based upon multiple observers. Also, a headset renders stereoscopic images that augment either physical objects viewed through the headset, or virtual objects projected by a stereoscopic display separate from the headset, or both. The headset includes a system for locating both physical objects and object images within a stereographic projection. Also, a proprioceptive user interface defines interface locations relative to body parts of an observer, the body parts include the head and the shoulders of the observer. The observer may enable a process associated with the interface location by indicating an intersection with the interface location with a physical object, such as a wand or a finger of the observer.
    Type: Grant
    Filed: July 8, 2019
    Date of Patent: May 31, 2022
    Inventor: Michael J. Deluca
  • Patent number: 11347308
    Abstract: A gaze tracking method and apparatus, and a gaze tracking neural network training method and apparatus are provided. The gaze tracking apparatus includes one or more processors and a memory, and the one or more processors obtain output position information from an input face image of a user using a neural network model, determines a position adjustment parameter for the user, and predicts gaze position information of the user by adjusting the output position information based on the position adjustment parameter.
    Type: Grant
    Filed: July 24, 2020
    Date of Patent: May 31, 2022
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Yongchao Liu, Hui Zhang, Xiabing Liu, Byung In Yoo, Chang Kyu Choi, Jaejoon Han, Youngjun Kwak, Tianchu Guo
  • Patent number: 11350080
    Abstract: Methods and apparatus for using a display in a manner which results in a user perceiving a higher resolution than would be perceived if a user viewed the display from a head on position are described. In some embodiments one or more displays are mounted at an angle, e.g., sometimes in range a range from an angle above 0 degrees to 45 relative to a user's face and thus eyes. The user sees more pixels, e.g., dots corresponding to light emitting elements, per square inch of eye area than the user would see if the user were viewing the display head on due to the angle at which the display or displays are mounted. The methods and display mounting arrangement are well suited for use in head mounted displays, e.g., Virtual Reality (VR) displays for stereoscopic viewing (e.g., 3D) and/or non-stereoscopic viewing of displayed images.
    Type: Grant
    Filed: June 30, 2020
    Date of Patent: May 31, 2022
    Assignee: Nevermind Capital LLC
    Inventors: David Cole, Alan McKay Moss
  • Patent number: 11340670
    Abstract: A display system, such as a wearable display device, includes a system housing including a cavity having a linear axis extending generally in parallel with first and second side walls enclosing the cavity and a display stack enclosed within the cavity and movable along the linear axis. The display stack includes a display panel and a support chassis configured to support a first side of the display panel and thermally couple the display panel to the first side wall to facilitate heat transfer from the display panel, across the support chassis, and to the system housing The display stack includes a heat sink configured for support by a second side of the display panel and to thermally couple the display panel to the second side wall to facilitate heat transfer from the display panel, across the heat sink, and to the system housing.
    Type: Grant
    Filed: August 24, 2020
    Date of Patent: May 24, 2022
    Assignee: Apple Inc.
    Inventors: Ivan S. Maric, Phil M. Hobson, Laura M. Campo, Sivesh Selvakumar, Jeffrey C. Olson
  • Patent number: 11340465
    Abstract: A head-mounted display that is modular and configured for securement to an item of headwear is provided. The head-mounted display may comprise a selection of components that are desired for a particular application, such as a display boom, camera, microphone, position-tracking component, etc., and may include an attachment mechanism for securing the selection of components to the item of headwear. The head-mounted display may include a display module having a corresponding display characteristic that provides a visual display and/or display functionality that is appropriate for a particular application. The display module may include a micro display that is non-transparent and/or a waveguide optic that is at least partially transparent, and may be configured to provide an augmented reality display for a user.
    Type: Grant
    Filed: September 26, 2019
    Date of Patent: May 24, 2022
    Assignee: RealWear, Inc.
    Inventors: Stephen A. Pombo, George Henry Hines, Christopher Iain Parkinson, Sanjay Subir Jhawar, Kenneth Lustig
  • Patent number: 11340698
    Abstract: Eye movements and/or physiological characteristics of a user viewing a subject are detected and quantified to produce data to determine one or more details that is or was observable in the scene or image of which the user may or may not be consciously aware. Eye movement data includes the number of times a user looks at each area of a subject (“fixation number”), the length or duration of the fixation (“fixation duration value”), the number of times a user returns to look at a particular area (“fixation repeats”), and additionally any changes to pupil size based on dilation/constriction (“pupil size”). Physiological characteristic data includes heart rate, pulse or skin conductance. Advantageously, the system and methods may be used for a variety of purposes including evaluation improvement and training.
    Type: Grant
    Filed: October 31, 2016
    Date of Patent: May 24, 2022
    Assignee: University of Massachusetts
    Inventors: Gregory J. Digirolamo, Max P. Rosen
  • Patent number: 11341726
    Abstract: An information processing apparatus including a processor configured to detect a connection to each of a first and second image display apparatus, generate a first image based on first medical apparatus information acquired from a first medical apparatus and a second image based on second medical apparatus information acquired from a second medical apparatus, detect an object from an outside scene that is captured by both the first and second image display apparatuses, and acquire a first distance from the first image display apparatus to the object and a second distance from the second image display apparatus to the object. When the first distance is smaller than the second distance, the processor causes the first image display apparatus to display the first image at a first size that is greater than a second size of the first image displayed at the second image display apparatus.
    Type: Grant
    Filed: April 17, 2020
    Date of Patent: May 24, 2022
    Assignee: SEIKO EPSON CORPORATION
    Inventors: Atsunari Tsuda, Toshikazu Uchiyama, Hitomi Wakamiya, Masahide Takano
  • Patent number: 11328643
    Abstract: A display unit of the present disclosure includes one or more display devices that perform image display by making a difference in resolution for each of a plurality of image regions in an original image, and an optical device that corrects optically for distortion of a display image that is caused by performing the image display at the different resolution for each of the plurality of image regions, a position of the image display between the plurality of image regions, or both.
    Type: Grant
    Filed: May 14, 2019
    Date of Patent: May 10, 2022
    Assignee: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
    Inventor: Osamu Akimoto
  • Patent number: 11327319
    Abstract: A left panel has a portion exceeding a size of a left lens, and a left-eye image displayed in an area of the left panel, which exceeds the size of the left lens, is not visually recognized by a user. A right panel has a portion exceeding a size of a right lens, and a right-eye image displayed in an area of the right panel, which exceeds the size of the right lens, is not visually recognized by the user. An HMD stores a display start position of the left-eye image and a display start position of the right-eye image. The HMD acquires a left-eye image having a size corresponding to the size of the left lens and a right-eye image having a size corresponding to the size of the right lens, which are generated by an external apparatus. The HMD causes the left-eye image to be displayed from the display start position of left-eye image stored in advance and causes the right-eye image to be displayed from the display start position of right-eye image stored in advance.
    Type: Grant
    Filed: May 15, 2018
    Date of Patent: May 10, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventor: Takehiro Tominaga
  • Patent number: 11330691
    Abstract: The invention relates to a display (1) comprising—a casing (10), —an image generation unit (20), and—a light sensor (30), disposed in the interior (INT) of said casing (10), suitable for delivering a signal representative of a light intensity received by same, the display (1) being adapted such that the luminosity of an image generated by the image generation unit (20) is controlled as a function of said signal. According to the invention, the display (1) further comprises a light guide (50) situated in the interior (INT) of the casing (10) of the display (1), having an inlet face (51) and being shaped to collect at the input face (51) of same a light ray coming from outside the casing (10) of the display, and for guiding said light ray to said sensor (30).
    Type: Grant
    Filed: April 25, 2017
    Date of Patent: May 10, 2022
    Assignee: VALEO COMFORT AND DRIVING ASSISTANCE
    Inventors: François Grandclerc, Pierre Mermillod
  • Patent number: 11322057
    Abstract: An image display device includes: a light source; a screen on which an image is formed when light from the light source is applied thereto; an optical system configured to generate a virtual image by light from the screen; an actuator configured to move the screen in an optical axis direction; a position detector configured to detect a movement position of the screen; a servo circuit configured to cause the movement of the screen by the actuator to follow a target waveform on the basis of a signal from the position detector; and a correction circuit configured to reduce a deviation between a timing to move the screen by the servo circuit and a timing to form the image on the screen.
    Type: Grant
    Filed: November 24, 2020
    Date of Patent: May 3, 2022
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Susumu Uragami, Yuta Yamamoto, Hiroyuki Furuya, Yoshiro Kashiwabara
  • Patent number: 11321939
    Abstract: Mapping common features between images that commonly represent an environment using different light spectrum data is performed. A first image having first light spectrum data is accessed, and a second image having second light spectrum data is accessed. These images are fed as input to a DNN, which then identifies feature points that are common between the two images. A generated mapping lists the feature points and lists coordinates of the feature points from both of the images. Differences between the coordinates of the feature points in the two images are determined. Based on these differences, the second image is warped to cause the coordinates of the feature points in the second image to correspond to the coordinates of the feature points in the first image.
    Type: Grant
    Filed: November 26, 2019
    Date of Patent: May 3, 2022
    Inventors: Raymond Kirk Price, Michael Bleyer, Christopher Douglas Edmonds
  • Patent number: 11312301
    Abstract: A display apparatus projects an image of an object located in an area outside a mobile body onto a target projection surface, the target projection surface being set in a cabin of the mobile body and having a first region and a second region. The display apparatus includes: an image data acquisition unit that acquires image data; an image processing unit that generates projection image data by performing image conversion processing including color conversion in which the first wavelength light is selected for a pixel corresponding to the first region and the second wavelength light is selected for a pixel corresponding to the second region based on region distribution information; a light source unit that emits light selected from either the first wavelength light or the second wavelength light; and a projection unit that projects the image formed by the emitted light onto the target projection surface.
    Type: Grant
    Filed: February 10, 2021
    Date of Patent: April 26, 2022
    Assignee: JVCKENWOOD CORPORATION
    Inventor: Minoru Ohyama
  • Patent number: 11314085
    Abstract: A viewing devices includes an optical assembly comprising a display, an optical system forming of this display an image at infinity and a light guide for expanding a pupil in two spatial directions. The guide comprises three planar mirrors and two semi-reflective plates, the optical axis of the optical assembly being inclined with respect to the surface of the first planar mirror by an angle different from zero and strictly smaller than 90 degrees, the light beams output from the optical assembly propagating inside the light guide via successive reflections from the planar mirrors and the semi-reflective plates, the transmission of the light beams output from the optical assembly to outside of the light guide occurring via successive transmissions by the second semi-reflective plate.
    Type: Grant
    Filed: February 5, 2020
    Date of Patent: April 26, 2022
    Assignee: THALES
    Inventors: Natacha Damamme, Jean-Luc Bardon, Jean-Louis Bourgain, Philippe Coni
  • Patent number: 11315326
    Abstract: A processing system of a mobile device may determine the device's predicted viewport, which defines a portion of a real world environment that is expected to be visible to the device's user at a future time. The processing system may determine a set of extended reality anchors that are present in the real world environment, where each anchor stores a digital object that, when rendered by the device and presented to the user simultaneously with the real world environment, creates extended reality media. The processing system may remove a first subset anchors from the set, where locations of anchors in the first subset fall outside a threshold distance from the predicted viewport. The removing results in a second subset of anchors remaining in the set. The processing system may download a digital object from a second device, where the digital object is stored by an anchor of the second subset.
    Type: Grant
    Filed: October 15, 2019
    Date of Patent: April 26, 2022
    Assignee: AT&T Intellectual Property I, L.P.
    Inventors: Tan Xu, David Crawford Gibbon, Bo Han, Eric Zavesky
  • Patent number: 11314281
    Abstract: A head-mounted display includes a display unit, a head support, a power storage device, and one or more receiving coils. The head support is coupled to the display unit and configured to engage a head of a user for supporting the display unit thereon. The power storage device is coupled to the display unit for storing power to be supplied to the display unit. The one or more receiving coils are coupled to the head support for inductively charging the power storage device.
    Type: Grant
    Filed: June 11, 2019
    Date of Patent: April 26, 2022
    Assignee: Apple Inc.
    Inventors: Fletcher R. Rothkopf, James W. VanDyke, Grant H. Mulliken
  • Patent number: 11307424
    Abstract: A system includes a head-mounted virtual reality/augmented reality (VR/AR) display system, comprising a processor, wherein the processor is configured to display an image on a graphical display of the head-mounted VR/AR display system. The system further includes a scaffolding system comprising a headpiece configured to be worn by a user; wherein the headpiece comprises at least one fastener configured to fasten and unfasten the head-mounted VR/AR display system to the headpiece, and configured to fasten and unfasten a headgear to the headpiece.
    Type: Grant
    Filed: October 5, 2020
    Date of Patent: April 19, 2022
    Assignee: Universal City Studios LLC
    Inventor: James Jeffrey Coatney
  • Patent number: 11304323
    Abstract: A head-mounted display configured to enhance the ease of wearing work and the stability of wearing is provided. A wearing band has an extending section and a movable section that is movable relative to the extending section in the length direction of the wearing band.
    Type: Grant
    Filed: July 10, 2020
    Date of Patent: April 12, 2022
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Takamasa Araki, Fumihiko Sato, Takayuki Tateno
  • Patent number: 11294203
    Abstract: Improved wearable optics is disclosed. The wearable optics comprises a frame member and a lens. The wearable optics also includes circuitry within the frame member for enhancing the use of the wearable optics. A system and method in accordance with the present invention is directed to a variety of ways to enhance the use of eyeglasses. They are: (1) media focals, that is, utilizing the wearable optics for its intended purpose and enhancing that use by using imaging techniques to improve the vision of the user; (2) telecommunications enhancements that allow the eyeglasses to be integrated with telecommunication devices such as cell phones or the like; and (3) entertainment enhancements that allow the wearable optics to be integrated with devices such as MP3 players, radios, or the like.
    Type: Grant
    Filed: March 17, 2015
    Date of Patent: April 5, 2022
    Assignee: Percept Technologies
    Inventor: Scott W. Lewis
  • Patent number: 11295702
    Abstract: A head-up display device includes: a reflection member disposed in front of a driver who drives a vehicle; a projection unit configured to project light toward the reflection member and display a virtual image in a region superimposed on a superimposing display target when viewed by the driver; and an imaging unit configured to take an image of a region in front of the vehicle to generate a front image that is an image of the region in front of the vehicle. The projection unit adjusts a luminance distribution of a virtual image in accordance with a luminance distribution of a region of the superimposing display target in the front image.
    Type: Grant
    Filed: January 23, 2018
    Date of Patent: April 5, 2022
    Assignee: YAZAKI CORPORATION
    Inventors: Atsushi Ishibashi, Kazuyoshi Ogasawara, Akihiro Yoshida
  • Patent number: 11284948
    Abstract: The present invention relates to a surgical microscope (1) with a field of view (9) and comprising an optical imaging system (3) which images an inspection area (11) which is at least partially located in the field of view (9), and to a method for a gesture control of a surgical microscope (1) having an optical imaging system (3). Surgical microscopes (1) of the art have the disadvantage that an adjustment of the microscope parameters, for instance the working distance, field of view (9) or illumination mode, requires the surgeon to put down his or her surgical tools, look up from the microscope's eyepiece (5) and perform the adjustment by operating the microscope handles. Also foot switches and mouth switches where proposed, whereas those are not intuitively operated, require training and are less accurate than hand control of the microscope handles. Thus, the surgeon may lose his or her focus, is confronted with inconveniences and delays and bears an increased risk of contamination.
    Type: Grant
    Filed: July 15, 2017
    Date of Patent: March 29, 2022
    Assignee: LEICA INSTRUMENTS (SINGAPORE) PTE. LTD.
    Inventor: George Themelis
  • Patent number: 11281290
    Abstract: A display system including eye-tracking means, first image renderer, second image renderer, optical combiner and processor is described. Eye-tracking data is processed to determine gaze directions of user's eyes. Gaze location and gaze velocity and/or acceleration of user is determined based on gaze directions of user's eyes. It is detected whether or not gaze has been fixated for predefined time period based on gaze location and gaze velocity and/or acceleration of user. If gaze has been fixated, input image is processed to generate and render first image and second image substantially simultaneously. Projection of rendered first image and projection of rendered second image are combined optically by optical combiner to create extended-reality scene. If gaze has not been fixated, input image is processed to generate and render first image via first image renderer, whilst switching off or dimming second image renderer.
    Type: Grant
    Filed: June 17, 2020
    Date of Patent: March 22, 2022
    Assignee: Varjo Technologies Oy
    Inventors: Niko Eiden, Klaus Melakari, Jarno Wuolijoki, Ville Kivistö, Antti Peuhkurinen
  • Patent number: 11280999
    Abstract: A head-up display comprises an image display device, a virtual image optical system, a housing with a housing opening, an antiglare plate covering the housing opening, a camera for capturing an image of a face area including an eye of a driver, a viewpoint detection device for detecting a viewpoint of the driver based on the image captured by the camera, and a main controller. The camera is installed on a position outside the housing and withdrawn from an optical path of the image light emitted through the housing opening, as well as in an orientation for capturing an image of an area where a face including the eye of the driver is reflected on the antiglare plate. The main controller controls to adjust an emission direction of the image light based on a viewpoint position of the driver detected by the viewpoint detection device.
    Type: Grant
    Filed: May 16, 2019
    Date of Patent: March 22, 2022
    Assignee: MAXELL, LTD.
    Inventors: Chohei Ono, Akio Misawa
  • Patent number: 11275240
    Abstract: Image light that travels between opposed parallel surfaces (100a, 100b) of the light guide (10) while being reflected by the opposed parallel surfaces is partially reflected by the outgoing-side reflection surfaces (102a, 102b) of a beam splitter. The image light took out from the light guide (10) is partially reflected by the two combiners (14, 15) and advances towards eyes of a user (E). The distance D of the combiners (14, 15) is set to be equal to or larger than A1/(2 cos ?·tan ?) and equal to or smaller than A2/(2 cos ?·tan ?), where ? is an incident angle ? of the image light to the combiner (14, 15), A1 is a light flux width of the image light reflected by one outgoing-side reflection surface, and A2 is a light flux width of the image light emitted from all of the outgoing-side reflection surfaces. This makes it possible to reduce the overlapping of images formed when viewed from the user, avoid the generation of partial image omission, and improve visibility.
    Type: Grant
    Filed: June 11, 2018
    Date of Patent: March 15, 2022
    Assignee: Shimadzu Corporation
    Inventor: Masato Tanaka
  • Patent number: 11269403
    Abstract: A window in a multi-window display configuration is provided. A gaze of one or more users is directed at the window. The multi-window display configuration has a plurality of windows that are each configured to display corresponding content. Further, a window attribute of the window is modified based upon the gaze. In addition, a request for the content corresponding to the window is sent to a server. The content corresponding to the window is received from the server. The content corresponding to the window is then displayed according to the modified window attribute at the window.
    Type: Grant
    Filed: May 4, 2015
    Date of Patent: March 8, 2022
    Assignee: DISNEY ENTERPRISES, INC.
    Inventor: Mehul Patel
  • Patent number: 11269410
    Abstract: In some implementations, a method includes: obtaining first input data while presenting a computer-generated reality (CGR) environment from the perspective of a first character associated with a first time slice within predetermined content; determining whether or not the first input data satisfies first performance criteria associated with the first character for the first time slice within the predetermined content; and, in response to determining that the first input data satisfies the first performance criteria associated with the first character for the first time slice within the predetermined content, updating the CGR environment from the perspective of the first character associated with a second time slice within the predetermined content.
    Type: Grant
    Filed: May 7, 2020
    Date of Patent: March 8, 2022
    Assignee: APPLE INC.
    Inventors: Ian M. Richter, Stephen Patrick Mullen, II, Michael Elliot Reisman
  • Patent number: 11262835
    Abstract: Methods, systems, computer-readable media, and apparatuses for selecting an Augmented Reality (AR) object on a head mounted device (HMD) are presented. In some embodiments, an HMD may define a Region-of-Interest (ROI) based on a gesture formed by at least one hand of a user. Subsequently the HMD may display to the user a shape on the HMD. In at least one arrangement, the shape outlines the ROI. Additionally, the HMD may display to the user a plurality of AR objects, each of the plurality of AR objects being associated with a target inside the ROI. Furthermore, the HMD may reduce the size of the ROI based on a first movement of the at least one hand of the user to form a reduced-sized ROI. In at least one arrangement, the reduced-sized ROI is used to select a specific AR object from the plurality of AR objects.
    Type: Grant
    Filed: September 25, 2018
    Date of Patent: March 1, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Arpit Mittal, Giuliano Maciocci, Michael L. Tunmer, Paul Mabbutt
  • Patent number: 11260856
    Abstract: An information display device includes a surrounding environment detector, a vehicle information acquirer, a predictor, an avoidance path provider, and an information display. The surrounding environment detector detects position relevant information related to a position of at least a surrounding object in a surrounding environment of a vehicle. The vehicle information acquirer detects vehicle information including a speed and a steering direction of the vehicle. The predictor predicts a contact of the vehicle with the surrounding object, based on the position relevant information and the vehicle information. When the predictor has predicted that there is a possibility of the contact of the vehicle with the surrounding object, the avoidance path provider assumes an avoidance path for avoiding the contact, based on the position relevant information and the vehicle information. The information display displays the avoidance path.
    Type: Grant
    Filed: September 5, 2019
    Date of Patent: March 1, 2022
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Daisuke Tokunaga, Nobuyuki Nakano, Toshiya Mori
  • Patent number: 11263777
    Abstract: Provided is an information processing apparatus including an estimating unit that estimates at least one of a location or an attitude of a predetermined chassis in real space on the basis of a first image captured by a first image capturing unit among a plurality of image capturing units held in the chassis. The information processing apparatus further includes a verifying unit that verifies a likelihood of the estimation result on the basis of a second image captured by a second image capturing unit having an optical axis different from an optical axis of the first image capturing unit among the plurality of image capturing units.
    Type: Grant
    Filed: February 21, 2018
    Date of Patent: March 1, 2022
    Assignee: SONY CORPORATION
    Inventor: Shunichi Homma
  • Patent number: 11258890
    Abstract: A holographic display system for a portable electronic device. The display system includes a case configured to receive the portable electronic device and a projector coupled to the case by a first hinge element. The projector includes a projector screen for generating images. A reflective element is coupled to the projector by a second hinge element. The reflective element is oriented to reflect light from the images in order to create holographic images perceptible to a user of the portable electronic device. The case may include a connector for receiving, from the portable electronic device, a video signal defining the images. The holographic display system may further include a substantially transparent touch screen attached to the first hinge element.
    Type: Grant
    Filed: March 11, 2020
    Date of Patent: February 22, 2022
    Assignee: IKIN, Inc.
    Inventor: Taylor Scott Griffith
  • Patent number: 11257392
    Abstract: A heavy equipment cockpit training apparatus, device, system, and method is disclosed. The disclosed features include at least one substantially clear, substantially seamless pane to at least partially present an approximation of physical portions of the cockpit, at least one projector capable of backprojecting a simulation of the cockpit onto the at least one substantially seamless pane, at least one tactile aspect, discrete from the at least one seamless pane, interactively provided in association with the simulation, and at least one processor having communicatively associated therewith non-transitory computing code for at least partially providing the simulation and the interaction with the at least one tactile aspect.
    Type: Grant
    Filed: June 15, 2020
    Date of Patent: February 22, 2022
    Assignee: FLIGHTSAFETY INTERNATIONAL INC.
    Inventors: Steven J. Smith, Randall A. Palmer, Justin M. Rempel, Jack E. Cochran, Kevin L. Greer, Douglas J. Middleton
  • Patent number: 11256092
    Abstract: A wearable optical display system comprising: a user attachment section; a partially transmissive partially reflective optical part, coupled with said user attachment section, and configured to be facing an eye of said user; and an electro-optical unit, coupled with at least one of said user attachment section and said partially transmissive partially reflective optical part, said electro-optical unit comprising: a plurality of lenses; a plurality of reflectors having a nose-positioned reflector being positioned at a side of a nose of said user, such to allow an unobstructed field of regard to said eye; and a light projection unit for projecting light beams onto said partially transmissive partially reflective optical part via said at least one nose-positioned reflector being interposed along an optical path between said light projection unit and partially transmissive partially reflective optical part, for viewing at least part of a projection of said light beams by said eye.
    Type: Grant
    Filed: April 10, 2017
    Date of Patent: February 22, 2022
    Assignee: EVERYSIGHT LTD.
    Inventors: Hanan Shamir, Sasson Abraham, Alla Zlochin, Asaf Ashkenazi
  • Patent number: 11250748
    Abstract: A projection display device includes: a light modulation unit that spatially modulates, in accordance with image data that has been input, light emitted by a light source; a projection optical system that projects the light that has been spatially modulated onto a projection surface of a vehicle; a measurement information acquisition unit that acquires measurement information measured by an information measuring device; an image display control unit that performs either first display control or second display control as defined herein; and a warning determination unit that determines, in accordance with the measurement information, whether or not a warning is necessary, and the image display control unit performs the second display control when the warning determination unit determines that the warning is necessary, and performs the first display control when the warning determination unit determines that the warning is not necessary.
    Type: Grant
    Filed: March 13, 2019
    Date of Patent: February 15, 2022
    Assignee: FUJIFILM Corporation
    Inventor: Hiroyuki Oshima
  • Patent number: 11252385
    Abstract: Image projection devices, high-speed fiber scanned displays and related methods for projecting an image onto a surface and interfacing with the projected image are provided. A method for projecting one or more images and obtaining feedback with an optical input-output assembly is provided. The input-output assembly comprising a light-scanning optical fiber and a sensor. The method includes generating a sequence of light in response to one or more image representations and a scan pattern of the optical fiber, articulating the optical fiber in the scan pattern, projecting the sequence of light from the articulated optical fiber, and generating a feedback signal with the sensor in response to reflections of the sequence of light.
    Type: Grant
    Filed: January 4, 2018
    Date of Patent: February 15, 2022
    Assignee: University of Washington
    Inventors: Charles D. Melville, Richard S. Johnston, Cameron M. Lee, Eric J. Seibel, Brian T. Schowengerdt
  • Patent number: 11243401
    Abstract: A method for customizing a head mounted device adapted to generate a virtual image for a wearer, the method comprises: obtaining a 3D eye pupil position of the wearer in a reference frame and corresponding to a predetermined gaze direction, and customizing the head-mounted device based on the 3D eye pupil position so that the position of a focus area (EMB) at least partly coincides with the position of the eye pupil in the predetermined gaze direction, wherein customizing the head-mounted device comprises controlling a recording of a holographic mirror based on the 3D eye pupil position in the reference frame.
    Type: Grant
    Filed: April 4, 2019
    Date of Patent: February 8, 2022
    Assignee: Essilor International
    Inventor: Cécile Petignaud
  • Patent number: 11237396
    Abstract: A conventional head-mounted display (HMDs) can display a virtual image at a fixed focus (e.g., infinite focus). If the user looks at an object that appears closer than the virtual image, then accommodation by the user's eyes will cause the virtual image to appear blurry. The HMDs disclosed herein include a dynamic electro-active focusing element that changes the focus of the virtual image to account for accommodation by the user. This dynamic electro-active focusing element may include a curved layer of electro-active material, such as nematic or bi-stable (e.g., cholesteric) liquid crystal, disposed between a static concave mirror and a convex surface on a beam splitter or other optical element. Changing the refractive index of the electro-active material causes the focus of the dynamic electro-active focusing element, making it possible to shift the virtual image's focus in as the user's eyes change focus.
    Type: Grant
    Filed: September 1, 2020
    Date of Patent: February 1, 2022
    Assignee: e-Vision Smart Optics, Inc.
    Inventor: Anthony Van Heugten
  • Patent number: 11237389
    Abstract: An optical system includes a first optical element having at least a first optical surface and a second optical surface, the first optical surface is not parallel to the second optical surface. The optical system includes a plurality of optical elements positioned adjacent to the second optical surface of the first optical element. The respective optical element of the plurality of optical elements is configured to receive light transmitted through the first optical surface at a first angle with respect to the second optical surface and direct the light back toward the first optical surface at a second angle, that is distinct from the first angle, with respect to the second optical surface.
    Type: Grant
    Filed: February 11, 2019
    Date of Patent: February 1, 2022
    Assignee: FACEBOOK TECHNOLOGIES, LLC
    Inventors: Robin Sharma, Andrew John Ouderkirk
  • Patent number: 11237624
    Abstract: A method for adapting auditory biofeedback cues to adjust a user's gait includes receiving a series of respective first signals from each sensor of an integrated sensor system and converting the series of respective first signals into a series of respective second signals. Each respective second signal within the series of respective second signals can be quantized as an audio biofeedback cue and modified so the timing of each respective second signal is aligned to a pre-selected temporal or musical grid. The user's gait is then analyzed as a function of the audio biofeedback cues and the pre-selected temporal or musical grid can be adapted to adjust entrainment of the user's gait.
    Type: Grant
    Filed: August 31, 2020
    Date of Patent: February 1, 2022
    Inventors: James M. O'Neil, William Sack, Jon Joseph Mrowczynski
  • Patent number: 11237390
    Abstract: This display system includes: a projection device including a phase-modulation-type spatial light modulator element, a light source radiating light to a display part of the element, and a control circuit controlling the element and the light source; and projecting reflection light of the part of the element; and a reflecting mirror reflecting projection light of the device. The control circuit displays, on the part of the element, a first pattern and a second pattern associated with display information having different definition degrees. The reflecting mirror includes a first reflection region causing reflection light of a portion where the first pattern is displayed to enter, and reflecting the light toward a first display region, and a second reflection region causing reflection light of a portion where the second pattern is displayed to enter, and reflecting the light toward a second display region.
    Type: Grant
    Filed: September 15, 2017
    Date of Patent: February 1, 2022
    Assignee: NEC CORPORATION
    Inventors: Go Watanabe, Fujio Okumura
  • Patent number: 11232594
    Abstract: The invention is related to a method for calibrating an eye tracking device within a head-mounted display (HMD) comprising the steps of acquiring with the HMD via an image sensor, at least one optical target image from an optical target, wherein the optical target contains image points in a pattern, indexing image points within the optical target image wherein the image points are indexed by, selecting a rigid region of the optical target image, assigning indices to image points within the rigid region, fitting a polynomial approximation function to at least one column and one row of the image points of the region, predicting the location of at least one image point using the fitted polynomial approximation function, assigning the predicted image point an index, inputting indexed image points into an optimization algorithm that calculates a hardware calibration of the HMD, and writing hardware calibration values calculated from the optimization algorithm to the HMD unit.
    Type: Grant
    Filed: October 23, 2020
    Date of Patent: January 25, 2022
    Assignee: Tobii AB
    Inventors: Pravin Kumar Rana, Macarena Garcia Romero, Yimu Wang, Rickard Lundahl
  • Patent number: 11226490
    Abstract: A virtual image display device presents a virtual image to a user via a virtual image presentation plate. The virtual image display device includes a display unit that generates an image display light; a concave mirror that reflects the image display light and projects the image display light toward the virtual image presentation plate; and a driving mechanism that changes an orientation of the concave mirror to change an incidence angle of the image display light on the concave mirror and change a distance a from the concave mirror to the display unit in accordance with the orientation of the concave mirror.
    Type: Grant
    Filed: November 20, 2020
    Date of Patent: January 18, 2022
    Assignee: JVCKENWOOD CORPORATION
    Inventor: Tatsuru Kobayashi
  • Patent number: 11222476
    Abstract: A head up display arrangement for a motor vehicle includes a source of a first video signal. A driver monitor system detects a location of at least a portion of a human driver of the motor vehicle. An electronic processor is communicatively coupled to the first video signal source and to the driver monitor system. The electronic processor produces a second video signal that is dependent upon the first video signal and that includes parallax information. The parallax information is based on the detected location of the portion of the driver. A head up display projection device produces a virtual image that is visible to the driver and that is based upon the second video signal.
    Type: Grant
    Filed: July 10, 2020
    Date of Patent: January 11, 2022
    Assignee: Panasonic Automotive Systems Company of America, Division of Panasonic Corporation of North America
    Inventors: David Kay Lambert, Derek Louis Didier
  • Patent number: 11222555
    Abstract: A display includes a plurality of light emissive panels. Each light emissive panel is flexible, has a light emissive surface with a plurality of pixels emitting light, has side edges, and is adjacent to other light emissive panels. The light emissive panels are in a flexed arrangement such that a total light emissive surface includes individual of the light emissive surfaces having a substantially full sphere surface or partial sphere surface shape.
    Type: Grant
    Filed: July 9, 2019
    Date of Patent: January 11, 2022
    Assignee: Rockwell Collins, Inc.
    Inventors: Todd M. Brown, Donald E. Mosier
  • Patent number: 11223718
    Abstract: [Object] To reduce power consumption even more. [Solution] Provided is a communication control device including a communication necessity information acquisition unit configured to acquire communication necessity information indicating necessity to communicate with an external device, and a drive control unit configured to control drive of a first communication unit and a second communication unit on a basis of the acquired communication necessity information, the first communication unit communicating with the external device using a first communication mode, the second communication unit communicating with the external device using a second communication mode capable of transferring data at a rate higher than the first communication mode.
    Type: Grant
    Filed: April 10, 2019
    Date of Patent: January 11, 2022
    Assignee: Sony Corporation
    Inventors: Hirotaka Ishikawa, Makoto Takahashi, Yuichi Suzuki, Yasuki Kanema, Chisako Kajihara, Tohru Kadono, Takeshi Iwatsu
  • Patent number: 11220213
    Abstract: A rear display device includes a camera, a display and a controller. The controller generates an overhead view image by performing an overhead view conversion process, controls the display to display one of a non-overhead view image and the overhead view image, detects a movement state of the vehicle, predicts a reversing course of the vehicle, and detects an object that is present within a predetermined detection range at the rear. The controller controls the display to display the overhead view image when the object is at the reversing course and a distance between the object and the vehicle is a distance determination reference value or less. The controller controls the display to display the non-overhead view image when the object is not at the reversing course or the distance between the object and the vehicle is higher than the distance determination reference value.
    Type: Grant
    Filed: May 1, 2020
    Date of Patent: January 11, 2022
    Assignee: SUZUKI MOTOR CORPORATION
    Inventor: Yuuichi Umezane
  • Patent number: 11217020
    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, an image generated by a camera of a user; displaying an option to crop an object depicted in the image; determining whether the object is depicted in the image; selectively enabling selection of the option to crop the object based on determining whether the object is depicted in the image; receiving input that selects the option to crop an object depicted in the image when the option is enabled; in response to receiving the input, segmenting the image to separate the object from other portions depicted in the image; extracting the object from the image; and adding the extracted object to a new image as a virtual object.
    Type: Grant
    Filed: April 28, 2020
    Date of Patent: January 4, 2022
    Assignee: Snap Inc.
    Inventors: Kyle Goodrich, Samuel Edward Hare, Maxim Maximov Lazarov, Tony Mathew, Andrew James McPhee, Daniel Moreno, Wentao Shang