Abstract: The present invention relates to a surgical microscope (1) with a field of view (9) and comprising an optical imaging system (3) which images an inspection area (11) which is at least partially located in the field of view (9), and to a method for a gesture control of a surgical microscope (1) having an optical imaging system (3). Surgical microscopes (1) of the art have the disadvantage that an adjustment of the microscope parameters, for instance the working distance, field of view (9) or illumination mode, requires the surgeon to put down his or her surgical tools, look up from the microscope's eyepiece (5) and perform the adjustment by operating the microscope handles. Also foot switches and mouth switches where proposed, whereas those are not intuitively operated, require training and are less accurate than hand control of the microscope handles. Thus, the surgeon may lose his or her focus, is confronted with inconveniences and delays and bears an increased risk of contamination.

Abstract: A display system including eye-tracking means, first image renderer, second image renderer, optical combiner and processor is described. Eye-tracking data is processed to determine gaze directions of user's eyes. Gaze location and gaze velocity and/or acceleration of user is determined based on gaze directions of user's eyes. It is detected whether or not gaze has been fixated for predefined time period based on gaze location and gaze velocity and/or acceleration of user. If gaze has been fixated, input image is processed to generate and render first image and second image substantially simultaneously. Projection of rendered first image and projection of rendered second image are combined optically by optical combiner to create extended-reality scene. If gaze has not been fixated, input image is processed to generate and render first image via first image renderer, whilst switching off or dimming second image renderer.

Abstract: A head-up display comprises an image display device, a virtual image optical system, a housing with a housing opening, an antiglare plate covering the housing opening, a camera for capturing an image of a face area including an eye of a driver, a viewpoint detection device for detecting a viewpoint of the driver based on the image captured by the camera, and a main controller. The camera is installed on a position outside the housing and withdrawn from an optical path of the image light emitted through the housing opening, as well as in an orientation for capturing an image of an area where a face including the eye of the driver is reflected on the antiglare plate. The main controller controls to adjust an emission direction of the image light based on a viewpoint position of the driver detected by the viewpoint detection device.

Abstract: Image light that travels between opposed parallel surfaces (100a, 100b) of the light guide (10) while being reflected by the opposed parallel surfaces is partially reflected by the outgoing-side reflection surfaces (102a, 102b) of a beam splitter. The image light took out from the light guide (10) is partially reflected by the two combiners (14, 15) and advances towards eyes of a user (E). The distance D of the combiners (14, 15) is set to be equal to or larger than A1/(2 cos ?·tan ?) and equal to or smaller than A2/(2 cos ?·tan ?), where ? is an incident angle ? of the image light to the combiner (14, 15), A1 is a light flux width of the image light reflected by one outgoing-side reflection surface, and A2 is a light flux width of the image light emitted from all of the outgoing-side reflection surfaces. This makes it possible to reduce the overlapping of images formed when viewed from the user, avoid the generation of partial image omission, and improve visibility.

Abstract: In some implementations, a method includes: obtaining first input data while presenting a computer-generated reality (CGR) environment from the perspective of a first character associated with a first time slice within predetermined content; determining whether or not the first input data satisfies first performance criteria associated with the first character for the first time slice within the predetermined content; and, in response to determining that the first input data satisfies the first performance criteria associated with the first character for the first time slice within the predetermined content, updating the CGR environment from the perspective of the first character associated with a second time slice within the predetermined content.

Abstract: A window in a multi-window display configuration is provided. A gaze of one or more users is directed at the window. The multi-window display configuration has a plurality of windows that are each configured to display corresponding content. Further, a window attribute of the window is modified based upon the gaze. In addition, a request for the content corresponding to the window is sent to a server. The content corresponding to the window is received from the server. The content corresponding to the window is then displayed according to the modified window attribute at the window.

Abstract: An information display device includes a surrounding environment detector, a vehicle information acquirer, a predictor, an avoidance path provider, and an information display. The surrounding environment detector detects position relevant information related to a position of at least a surrounding object in a surrounding environment of a vehicle. The vehicle information acquirer detects vehicle information including a speed and a steering direction of the vehicle. The predictor predicts a contact of the vehicle with the surrounding object, based on the position relevant information and the vehicle information. When the predictor has predicted that there is a possibility of the contact of the vehicle with the surrounding object, the avoidance path provider assumes an avoidance path for avoiding the contact, based on the position relevant information and the vehicle information. The information display displays the avoidance path.

Abstract: Provided is an information processing apparatus including an estimating unit that estimates at least one of a location or an attitude of a predetermined chassis in real space on the basis of a first image captured by a first image capturing unit among a plurality of image capturing units held in the chassis. The information processing apparatus further includes a verifying unit that verifies a likelihood of the estimation result on the basis of a second image captured by a second image capturing unit having an optical axis different from an optical axis of the first image capturing unit among the plurality of image capturing units.

Abstract: Methods, systems, computer-readable media, and apparatuses for selecting an Augmented Reality (AR) object on a head mounted device (HMD) are presented. In some embodiments, an HMD may define a Region-of-Interest (ROI) based on a gesture formed by at least one hand of a user. Subsequently the HMD may display to the user a shape on the HMD. In at least one arrangement, the shape outlines the ROI. Additionally, the HMD may display to the user a plurality of AR objects, each of the plurality of AR objects being associated with a target inside the ROI. Furthermore, the HMD may reduce the size of the ROI based on a first movement of the at least one hand of the user to form a reduced-sized ROI. In at least one arrangement, the reduced-sized ROI is used to select a specific AR object from the plurality of AR objects.

Abstract: A holographic display system for a portable electronic device. The display system includes a case configured to receive the portable electronic device and a projector coupled to the case by a first hinge element. The projector includes a projector screen for generating images. A reflective element is coupled to the projector by a second hinge element. The reflective element is oriented to reflect light from the images in order to create holographic images perceptible to a user of the portable electronic device. The case may include a connector for receiving, from the portable electronic device, a video signal defining the images. The holographic display system may further include a substantially transparent touch screen attached to the first hinge element.

Abstract: A wearable optical display system comprising: a user attachment section; a partially transmissive partially reflective optical part, coupled with said user attachment section, and configured to be facing an eye of said user; and an electro-optical unit, coupled with at least one of said user attachment section and said partially transmissive partially reflective optical part, said electro-optical unit comprising: a plurality of lenses; a plurality of reflectors having a nose-positioned reflector being positioned at a side of a nose of said user, such to allow an unobstructed field of regard to said eye; and a light projection unit for projecting light beams onto said partially transmissive partially reflective optical part via said at least one nose-positioned reflector being interposed along an optical path between said light projection unit and partially transmissive partially reflective optical part, for viewing at least part of a projection of said light beams by said eye.

Abstract: A heavy equipment cockpit training apparatus, device, system, and method is disclosed. The disclosed features include at least one substantially clear, substantially seamless pane to at least partially present an approximation of physical portions of the cockpit, at least one projector capable of backprojecting a simulation of the cockpit onto the at least one substantially seamless pane, at least one tactile aspect, discrete from the at least one seamless pane, interactively provided in association with the simulation, and at least one processor having communicatively associated therewith non-transitory computing code for at least partially providing the simulation and the interaction with the at least one tactile aspect.

Abstract: Image projection devices, high-speed fiber scanned displays and related methods for projecting an image onto a surface and interfacing with the projected image are provided. A method for projecting one or more images and obtaining feedback with an optical input-output assembly is provided. The input-output assembly comprising a light-scanning optical fiber and a sensor. The method includes generating a sequence of light in response to one or more image representations and a scan pattern of the optical fiber, articulating the optical fiber in the scan pattern, projecting the sequence of light from the articulated optical fiber, and generating a feedback signal with the sensor in response to reflections of the sequence of light.

Abstract: A projection display device includes: a light modulation unit that spatially modulates, in accordance with image data that has been input, light emitted by a light source; a projection optical system that projects the light that has been spatially modulated onto a projection surface of a vehicle; a measurement information acquisition unit that acquires measurement information measured by an information measuring device; an image display control unit that performs either first display control or second display control as defined herein; and a warning determination unit that determines, in accordance with the measurement information, whether or not a warning is necessary, and the image display control unit performs the second display control when the warning determination unit determines that the warning is necessary, and performs the first display control when the warning determination unit determines that the warning is not necessary.

Abstract: A method for customizing a head mounted device adapted to generate a virtual image for a wearer, the method comprises: obtaining a 3D eye pupil position of the wearer in a reference frame and corresponding to a predetermined gaze direction, and customizing the head-mounted device based on the 3D eye pupil position so that the position of a focus area (EMB) at least partly coincides with the position of the eye pupil in the predetermined gaze direction, wherein customizing the head-mounted device comprises controlling a recording of a holographic mirror based on the 3D eye pupil position in the reference frame.

Abstract: An optical system includes a first optical element having at least a first optical surface and a second optical surface, the first optical surface is not parallel to the second optical surface. The optical system includes a plurality of optical elements positioned adjacent to the second optical surface of the first optical element. The respective optical element of the plurality of optical elements is configured to receive light transmitted through the first optical surface at a first angle with respect to the second optical surface and direct the light back toward the first optical surface at a second angle, that is distinct from the first angle, with respect to the second optical surface.

Abstract: This display system includes: a projection device including a phase-modulation-type spatial light modulator element, a light source radiating light to a display part of the element, and a control circuit controlling the element and the light source; and projecting reflection light of the part of the element; and a reflecting mirror reflecting projection light of the device. The control circuit displays, on the part of the element, a first pattern and a second pattern associated with display information having different definition degrees. The reflecting mirror includes a first reflection region causing reflection light of a portion where the first pattern is displayed to enter, and reflecting the light toward a first display region, and a second reflection region causing reflection light of a portion where the second pattern is displayed to enter, and reflecting the light toward a second display region.

Abstract: A conventional head-mounted display (HMDs) can display a virtual image at a fixed focus (e.g., infinite focus). If the user looks at an object that appears closer than the virtual image, then accommodation by the user's eyes will cause the virtual image to appear blurry. The HMDs disclosed herein include a dynamic electro-active focusing element that changes the focus of the virtual image to account for accommodation by the user. This dynamic electro-active focusing element may include a curved layer of electro-active material, such as nematic or bi-stable (e.g., cholesteric) liquid crystal, disposed between a static concave mirror and a convex surface on a beam splitter or other optical element. Changing the refractive index of the electro-active material causes the focus of the dynamic electro-active focusing element, making it possible to shift the virtual image's focus in as the user's eyes change focus.

Abstract: A method for adapting auditory biofeedback cues to adjust a user's gait includes receiving a series of respective first signals from each sensor of an integrated sensor system and converting the series of respective first signals into a series of respective second signals. Each respective second signal within the series of respective second signals can be quantized as an audio biofeedback cue and modified so the timing of each respective second signal is aligned to a pre-selected temporal or musical grid. The user's gait is then analyzed as a function of the audio biofeedback cues and the pre-selected temporal or musical grid can be adapted to adjust entrainment of the user's gait.

Abstract: The invention is related to a method for calibrating an eye tracking device within a head-mounted display (HMD) comprising the steps of acquiring with the HMD via an image sensor, at least one optical target image from an optical target, wherein the optical target contains image points in a pattern, indexing image points within the optical target image wherein the image points are indexed by, selecting a rigid region of the optical target image, assigning indices to image points within the rigid region, fitting a polynomial approximation function to at least one column and one row of the image points of the region, predicting the location of at least one image point using the fitted polynomial approximation function, assigning the predicted image point an index, inputting indexed image points into an optimization algorithm that calculates a hardware calibration of the HMD, and writing hardware calibration values calculated from the optimization algorithm to the HMD unit.

Abstract: A virtual image display device presents a virtual image to a user via a virtual image presentation plate. The virtual image display device includes a display unit that generates an image display light; a concave mirror that reflects the image display light and projects the image display light toward the virtual image presentation plate; and a driving mechanism that changes an orientation of the concave mirror to change an incidence angle of the image display light on the concave mirror and change a distance a from the concave mirror to the display unit in accordance with the orientation of the concave mirror.

Abstract: A rear display device includes a camera, a display and a controller. The controller generates an overhead view image by performing an overhead view conversion process, controls the display to display one of a non-overhead view image and the overhead view image, detects a movement state of the vehicle, predicts a reversing course of the vehicle, and detects an object that is present within a predetermined detection range at the rear. The controller controls the display to display the overhead view image when the object is at the reversing course and a distance between the object and the vehicle is a distance determination reference value or less. The controller controls the display to display the non-overhead view image when the object is not at the reversing course or the distance between the object and the vehicle is higher than the distance determination reference value.

Abstract: A display includes a plurality of light emissive panels. Each light emissive panel is flexible, has a light emissive surface with a plurality of pixels emitting light, has side edges, and is adjacent to other light emissive panels. The light emissive panels are in a flexed arrangement such that a total light emissive surface includes individual of the light emissive surfaces having a substantially full sphere surface or partial sphere surface shape.

Abstract: [Object] To reduce power consumption even more. [Solution] Provided is a communication control device including a communication necessity information acquisition unit configured to acquire communication necessity information indicating necessity to communicate with an external device, and a drive control unit configured to control drive of a first communication unit and a second communication unit on a basis of the acquired communication necessity information, the first communication unit communicating with the external device using a first communication mode, the second communication unit communicating with the external device using a second communication mode capable of transferring data at a rate higher than the first communication mode.

Abstract: A head up display arrangement for a motor vehicle includes a source of a first video signal. A driver monitor system detects a location of at least a portion of a human driver of the motor vehicle. An electronic processor is communicatively coupled to the first video signal source and to the driver monitor system. The electronic processor produces a second video signal that is dependent upon the first video signal and that includes parallax information. The parallax information is based on the detected location of the portion of the driver. A head up display projection device produces a virtual image that is visible to the driver and that is based upon the second video signal.

Abstract: An image processing method, an image processing apparatus (700), an electronic device (10) and a computer-readable storage medium are provided. The image processing method includes: a temperature of a light emitter is detected (202); in condition that a temperature difference between a present temperature of the light emitter and an initial temperature exceeds a threshold, a target parameter is acquired (204); and a predetermined operation is performed according to the target parameter (206).

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, an image generated by a camera of a user; displaying an option to crop an object depicted in the image; determining whether the object is depicted in the image; selectively enabling selection of the option to crop the object based on determining whether the object is depicted in the image; receiving input that selects the option to crop an object depicted in the image when the option is enabled; in response to receiving the input, segmenting the image to separate the object from other portions depicted in the image; extracting the object from the image; and adding the extracted object to a new image as a virtual object.

Abstract: A user identification system includes an image recognition network to analyze image data and generate shape data based on the image data. The system also includes a generalist network to analyze the shape data and generate general category data based on the shape data. The system further includes a specialist network to compare the general category data with a characteristic to generate narrow category data. Moreover, the system includes a classifier layer including a plurality of nodes to represent a classification decision based on the narrow category data.

Abstract: Embodiments of the present disclosure sets forth a computer-implemented method for playing back media content comprising determining, based on sensor data, a first mental state associated with a user accessing media content, and modifying playback of media content based on the first mental state.

Abstract: This patent provides a method for performing enhanced viewing strategies available to a user wearing a head display unit with position and orientation tracking. Stereoscopic rendering is performed at a set of time points. A set of viewing parameters including position data and orientation data of said head display unit is stored in conjunction with time data. A process called recall rendering is performed and the stored parameters which will allow stereoscopic display of the volume along with the orientation data and position data of the head display unit.

Abstract: A motor vehicle includes a rearview camera capturing images of a scene behind the motor vehicle. An electronic processor receives the images captured by the camera. A virtual image projection arrangement is communicatively coupled to the electronic processor and presents a virtual image dependent upon the images captured by the camera. The virtual image is visible by a driver of the vehicle after being reflected by a windshield.

Abstract: Vehicle monitoring employs three-dimensional (3D) information in a region adjacent to a vehicle to visually highlight objects that are closer to the vehicle than a threshold distance. A vehicle monitoring system includes a 3D scanner to scan the region adjacent to the vehicle and provide a 3D model including a spatial configuration of objects located within the scanned region. The vehicle monitoring system further includes a 3D electronic display to display a portion of the scanned region using the 3D model and to visually highlight an object within the displayed portion that is located less than the threshold distance from the vehicle.

Abstract: Provided is an optical element with a Fresnel structure with several Fresnel segments. Each Fresnel segment has an optically active facet, the shape of which is part of a predetermined surface. The predetermined surfaces of the optically active facets differ in terms of their curvature profile.

Abstract: A heads-up display device includes a display unit which outputs a 3D image and at least one holographic optical element which is attached to a windshield of the vehicle to diffract and reflect the 3D image output from the display unit so that a reflection efficiency of the 3D image may be improved while minimizing a module volume.

Abstract: A method for enhancing a user's vision is disclosed.

Abstract: A virtual image display device includes a display light guiding unit, and an image forming unit that emits image light to the display light guiding unit, the display light guiding unit includes a first light guiding unit that guides image light corresponding to a first angle of view, and a second light guiding unit that guides image light corresponding to a second angle of view, among angles of view of image light emitted from the image forming unit, and the first light guiding unit and the second light guiding unit respectively include incident side diffraction elements that take the image light beams into the inside, and emission side diffraction elements that emit the image light beams to the outside.

Abstract: Disclosed is a head-up display for a vehicle. The head-up display includes a housing having an internal space formed therein and an entrance formed on one side thereof, a holder unit having a combiner coupled to one side of the holder unit, a moving unit positioned in the internal space of the housing, rotatably coupled to the holder unit, and coupled to the housing in such a way to reciprocate, a driving unit coupled to the moving unit and configured to move the moving unit, and a tilting unit coupled to the moving unit in such a way to slide and coupled to the driving unit, wherein when the tilting unit is moved by the driving unit, the combiner is tilted to form a cycloid trajectory based on a virtual center axis that traverses the combiner left and right.

Abstract: A method includes: determining, by a computing device, historic eye data of a user; determining, by the computing device, a current eye condition of the user based on: current data from a photodiode sensor of a smart contact lens worn by the user; current data from an image sensor of the smart contact lens worn by the user; and the historic eye data of the user; and adjusting, by the computing device, a transmittance of the smart contact lens worn by the user based on the determined current eye condition.

Abstract: An electronic device such as a head mounted device may have a display that displays an image for a user. Head-mounted support structures may be used to support the display and to support lenses. The image on the display is visible through the lenses from eye boxes. The presence of the user's nose and the presence of opaque lens holder structures presents a risk that some of the image will be obscured by undesired black regions. To reduce or eliminate these black regions, facial illumination may be generated using a light source in the electronic device. The facial illumination may be provided by a light source such as a light-emitting diode die or laser or may be provided by a corner region of the display that contains pixels that do not supply any part of the image.

Abstract: An onboard display control apparatus mounted on a vehicle and controlling a head-up display displaying information is provided. The onboard display apparatus includes: a space information acquisition section that acquires information representing a position of an object in front of the vehicle; an eye point information acquisition section that acquires information representing a position of an eye; a display controller that determines a display mode of a display image, causing the display image to be displayed and overlapped with a specific target in a visual field of a driver; an output section that provides the display image in accordance with the display mode. The display controller adjusts the display mode of the display image based on information representing behavior of the vehicle, information representing a property of an external environment, or information representing physical ability of the driver.

Abstract: The present technology relates to artificial reality systems. Such systems provide projections a user can create to specify object interactions. For example, when a user wishes to interact with an object outside her immediate reach, she can use a projection to select, move, or otherwise interact with the distant object. The present technology also includes object selection techniques for identifying and disambiguating between objects, allowing a user to select objects both near and distant from the user. Yet further aspects of the present technology include techniques for interpreting various bimanual (two-handed) gestures for interacting with objects. The present technology further includes a model for differentiating between global and local modes for, e.g., providing different input modalities or interpretations of user gestures.

Abstract: Aspects of the technology described herein relate to techniques for guiding an operator to use an ultrasound device. Thereby, operators with little or no experience operating ultrasound devices may capture medically relevant ultrasound images and/or interpret the contents of the obtained ultrasound images. For example, some of the techniques disclosed herein may be used to identify a particular anatomical view of a subject to image with an ultrasound device, guide an operator of the ultrasound device to capture an ultrasound image of the subject that contains the particular anatomical view, and/or analyze the captured ultrasound image to identify medical information about the subject.

Abstract: The purpose of the present invention is to enable information presented by an additionally displayed virtual image to be displayed in an easily recognizable manner. A projection unit projects, towards a projection-receiving part, display light capable of displaying virtual images in positions having different display distances from a viewer. A display distance determination unit is capable of adjusting, in a depth direction, the display distances of the virtual images displayed by the projection unit. If a display addition determination unit determines that a virtual image is to be additionally displayed, the display distance of an existing virtual image already displayed and the display distance of a virtual image to be additionally displayed are made to be different.

Abstract: A projection display for providing virtual display images on a plurality of display planes which are offset to one another, includes a projection unit for producing a projection beam; and an optical imaging element which is designed to direct the projection beam onto a combination surface and to image, depending on the projection beam, the virtual display images into the plurality of display planes. The projection unit has a plurality of transparent display elements which are arranged so as to be spaced apart and one after the other along the beam path of the projection unit.

Abstract: In an example, an augmented reality display system includes a reflective surface, a depth scanner and processing apparatus comprising an image processor and an image generation engine. The depth scanner may be to scan the reflective surface and a subject via the reflective surface to acquire depth data. The image processor may be to determine, based on the depth data, a viewpoint for an augmentation of a reflected image. The image generation engine may be to generate the augmentation for display on the reflective surface.

Abstract: A system may include an augmented reality (AR) aircraft window. The AR aircraft window may include a transparent emissive display layer, a camera, and a processor communicatively coupled to the transparent emissive display layer and the camera. The processor may be configured to: receive, from an avionics computing device, aircraft data including information of a location, an altitude, a heading, and a bank angle of an aircraft; receive video from the camera; perform head tracking operations to determine a position of at least one of eyes or a head of a user based at least on the video from the camera; generate graphical AR content aligned with the user's view through the AR aircraft window based at least on the aircraft data and performance of the head tracking operations; and output, to the transparent emissive display layer, the graphical AR content when at least one window shader element is transparent.

Abstract: A screen includes a surface inclined with respect to a reference plane. A driver moves the screen in a movement direction orthogonal to the reference plane. When forming a first virtual image serving as a virtual image on a first virtual plane whose inclination angle ? with respect to an optical axis of a projector is smaller than a predetermined value, a controller is configured to hold the screen in the movement direction. When forming a second virtual image serving as the virtual image on a second virtual plane whose inclination angle ß with respect to the optical axis of the projector is larger than the predetermined value, the controller is configured to move the screen in the movement direction.

Abstract: According to one embodiment, when displaying an image on a display panel, projecting an image which is displayed on the display panel, inclining the image which is projected from the display panel at a predetermined angle of bend, and reflecting the image which is projected from the display panel via a prism and guiding the image to a projection surface, a display device corrects input picture image of the prism based on characteristics contrary to the chromatic aberration characteristics of the prism.

Abstract: Holographic optical elements for augmented reality (AR) devices and methods of manufacturing and using the same are disclosed. An example AR device includes a holographic optical element (HOE) including a recorded optical function, and a projector to emit light toward the HOE. The HOE reflects the light based on the optical function to produce a full image corresponding to content perceivable by a user viewing the reflected light from within an eyebox. A first portion of the content is viewable from a first location within the eyebox. A second portion of the content is viewable from a second location within the eyebox. The first portion including different content than the second portion that is non-repeating between the first and second portions.

Abstract: The present disclosure relates to a color temperature adjustment method of a display. The display is a transparent display. The color temperature adjustment method includes: detecting current color temperature data of a background environment right behind the display, obtaining a color temperature compensation coefficient of the display, calculating a target color temperature of the display according to the color temperature data of the background environment and the color temperature compensation coefficient, obtaining a gamma voltage corresponding to the target color temperature, controlling the display to adjust the color temperature of the display to the target color temperature according to the obtained gamma voltage. The present disclosure further relates to a computer readable storage medium. As such, the color temperature of the transparent display may accurately be adjusted, and the user experience may be improved.