Abstract: Aspects of the present disclosure are directed to controlling optical parameters at a user's eye using an artificial reality system and tracked user conditions. For example, based on tracked user eye positioning, implementations can adjust the light that enters the user's eye to control an image shell generated at the user's eye. An image shell refers to the way light, that enters the eye, focuses on the retina of the eye. Example properties of an image shell include image shell centration, image shell curvature, image shell shape, etc. A user may focus on an object in an artificial reality environment (e.g., real-world object or virtual object) and light from the object can generate an image shell at the user's eyes. The image shell at the user's eyes can impact the user's vision and/or eye biology.

Abstract: Techniques for biometric authentication using a voice accelerometer and an acoustic transducer includes receiving a first signal representing an output by a voice accelerometer of a device and a second signal representing an output by an acoustic transducer of the device. Characteristics of each of the first signal and the second signal are compared with stored biometric characteristics for a user of the device. The user of the device is then authenticated based on the comparison.

Abstract: Embodiments of the disclosed is a system comprising a wearable command center. One such embodiment comprises a case clip top portion; a chest mount bottom portion; a hinge member assembly; a connector cartridge assembly; a case; and at least one structural guide rail.

Abstract: A holographic display and method for operating the holographic display can include: a holographic display operable in a plurality of modes, a computing system, and a sensor. The holographic display can option include a user interface device. Views displayed by the display can optionally be processed or modified based on a viewer pose relative to the display.

Abstract: An electronic device such as a head mounted device may have a head-mounted support structure. A portion of the head-mounted support structure may form a transparent housing member through which real-world objects can be viewed from eye boxes. A display system for the head-mounted device may have a display device that provides image light to a waveguide and may have an output coupler that couples the image light out of the waveguide toward the eye box. Peripheral portions of the transparent housing member or other peripheral device structures may be provided with a peripheral display that emits diffuse light into a user's peripheral vision. The peripheral display may use light guide structures, light sources, reflective structures, and other structures that provide transparency to real-world light.

Abstract: A setting apparatus includes: a CPU and a memory connected to the CPU. The memory is configured to store information regarding each of a plurality of users individually using a single space. The CPU is configured to perform: identifying a user to use the space; authenticating the user identified in the identifying; setting devices provided in the space based on the information stored in the memory. The information stored in the memory includes: first information; and second information given stricter restriction than the first information. The CPU is configured to perform: the setting including performing a predetermined setting of the devices provided in the space based on the first information of the user identified in the identifying.

Abstract: Examples are disclosed that relate to the restoration of degraded images acquired via a behind-display camera. One example provides a method of training a machine learning model, the method comprising inputting training image pairs into the machine learning model, each training image pair comprising an undegraded image and a degraded image that represents an appearance of the undegraded image to a behind-display camera, and training the machine learning model using the training image pairs to generate frequency information that is missing from the degraded images.

Abstract: The invention relates to a driver assistance system (100) for a vehicle (105) for detecting light conditions in the vehicle (105), having a sensor arrangement (102, 103, 104) designed to capture sensor data, and having a control device (101) designed to ascertain if the sight of a driver of the vehicle (105) is negatively influenced by a source of stray light external to the vehicle.

Abstract: A system for virtual therapy-based treatment of psychological issues is disclosed. The system receives a first input associated with a first scene via one or more sources. The system further extracts a set of audio signals associated with a set of objects within the first scene based on the received first input. The system further generates digital immersive content associated with the first scene based on the received first input and the extracted set of audio signals. The generated digital immersive content includes at least a first virtual object of a set of virtual objects associated with the set of objects and a first audio signal of the extracted set of audio signals. The system further renders the generated digital immersive content via a user platform. The user platform executes on the first user device associated with the first user.

Abstract: A system comprises a computer including a processor and a memory. The memory includes instructions such that the processor is programmed to: execute an autonomous vehicle algorithm simulating vehicle operations determine whether a notification that provides information on how a driver intervention for actuation by system feature functions has been at least one of previously presently or confirmed and cause the notification to be generated. The notification includes information for responding to a finite number of driving options determined by the driver intervention for actuation by system.

Abstract: A method for configuring a system having a wearable optical unit is disclosed. The method includes powering on the system, and in response to the system being powered on, using one or more processors to control the system to: determine whether to cause the system to run a configuration workflow, and in response to determining to cause the system to run the configuration workflow, (a) control the system in connection with configuring an interpupillary distance (IPD) for a user of the system, (b) determine whether the IPD is configured for the user, and (c) in response to determining that the IPD is configured for the user, control the system in connection with configuring a focus of the optical unit.

Abstract: A tactical system includes a first HUD system mountable to a first weapon and a second HUD system mountable to a second weapon. The first HUD system includes sensors providing position and orientation data of the first weapon, a processor to calculate a target position based on the position and orientation data, and a communications module to communicate the target position over a network. The second HUD system includes sensors providing position and orientation data of the second weapon, a communications module configured to import the target position from the network, and a processor to: calculate a position and an orientation of the second weapon based on the position and orientation data of the second weapon; calculate a target vector based on the target position and the position of the second weapon; and generate a target finder visualization based on the target vector and the orientation of the second weapon.

Abstract: The display control ECU changes the display color of the content in accordance with the display content of the content when displaying the content at a position where the windshield glass of the vehicle is located by the AR glass. Further, when the display color of the content is other than white, the display control ECU sets the display luminance of the border of the content to a second predetermined value or more or sets the brightness of the border of the content to a third predetermined value or more. The display control unit, when the color of the display of the content is white, the display luminance of the border of the content is less than the second predetermined value or is larger than the second predetermined value fourth predetermined value, or the brightness of the border of the content is less than the third predetermined value.

Abstract: Implementations discussed herein relate to systems, methods, and apparatuses for controlling one or more internet of things (IoT) devices via a graphical camera interface of a portable electronic device. The graphical camera interface can be presented at the portable electronic device in response to the user accessing a camera application via the portable electronic device and directing a camera of the portable electronic device at the IoT device. One or more images generated from an output of the camera can be processed to identify the IoT device that the user is intending to control. Information related to a context in which the user aimed their camera at the IoT device can be used to assist in narrowing down a selection of the IoT device from multiple different IoT devices that may be associated with the user and/or an image captured by the camera.

Abstract: In example implementations, a head mounted display (HMD) is provided. The HMD includes a first wireless radio, a second wireless radio, and a controller. The first wireless radio is to establish a connection to a host computer. The second wireless radio is to connect to a second HMD via a channel. The controller is communicatively coupled to the first wireless radio and the second wireless radio. The controller is to receive a notification of a presence of the second HMD from the host computer via the connection, track movement of the second HMD via the channel, and generate a collision avoidance alert when the second HMD is within a distance threshold of the HMD.

Abstract: In a saddle riding vehicle (1) including an external device (26) in which an external device (30) is installable, and a connector (27) for connecting the external device, the external device holder is located in front of a rider and above or in front of an instrument section, the connector is provided on one side (24b) in a vehicle body left-right direction, of the instrument section, and a cable supporter (29) that supports a cable (31) connecting to the connector is provided on a same one side (22b) of the instrument section.

Abstract: A system for displaying a driving scene to a passenger in a vehicle includes first and second cameras for capturing images of the driving scene; a processor that receives the images from the first and second cameras, applies noise filtering to the received images to at least partially remove occlusions from the images of the driving scene received from the first and second cameras related to a weather condition; and a display that receives the filtered images from the processor after application of the filtering operation and displays the filtered images of the driving scene.

Abstract: A device and a method for projecting image data onto a projection surface of a vehicle windowpane of a vehicle. An image data processing unit generates second image data from first image data based on recorded surroundings brightness of the vehicle. A gradation curve is used to generate the second image data in such a way that dark image regions of the first image data lying below a predetermined color brightness threshold compared to image regions lying above the color brightness threshold in the first image data are brightened in the second image data compared to the first image data with regard to color or greyscale spectra. A degree of brightening of the dark image regions in the first image data increases with an increase in the recorded surroundings brightness.

Abstract: The exemplary embodiments relate to a parking assistance system for a vehicle, designed to present surroundings of the vehicle. The parking assistance system can include at least one camera designed to record at least one image. The parking assistance system may use a grid structure to present the surroundings of the vehicle for a user. Additionally, the parking assistance system may have an image evaluation unit designed to determine the relative position and the orientation of another vehicle depicted in the image. Additionally, the image evaluation unit may be designed to adapt a grid structure on the basis of the determined orientation of the other vehicle, with the image being projected onto the adapted grid structure.

Abstract: Provided are an image processing method and an image processing device. The image processing method includes generating an image based on viewpoint information of a user; rendering the image based on information about what is in front of the user; and outputting the rendered image using an optical element.

Abstract: A head-up display system displays a virtual image superimposed on a real view that can be visually recognized through a window part. The head-up display system includes a display part, an optical system, a light source part, an operation part, and a controller. The controller controls a display area of the display part in accordance with an operation of the operation part by the observer. The light flux emitted from the display part is reflected by the window part and reaches a visually recognizable area where the observer can visually recognize the virtual image. The light emitted from the light source part is reflected inside an area where the light flux is reflected by the window part and reaches the visually recognizable area. The virtual image and the light from the light source part are superimposed, and can be visually recognized.

Abstract: A vehicle warning system includes a data processor, an image processor and an estimation unit. The data processor receives a first movement data of a first vehicle to generate a first predicted travel path and receives a second movement data of a second vehicle to generate a second predicted travel path. The image processor collects image(s) from at least one video device located within a predetermined area where the first predicted travel path passes and generates the second movement data. The estimation unit receives the first and second predicted travel paths and estimates whether the first and second travel paths are intersected and whether the first vehicle will collide with the second vehicle owing to path intersection.

Abstract: Systems and methods for executing content to be rendered on a screen of a head mounted display (HMD) are provided. One method includes executing the content to render interactive scenes on the screen and tracking an orientation direction of the HMD when worn on a head of a user and the interactive scenes are being rendered on the screen. The method includes changing view directions into the interactive scenes based on changes in the orientation direction of the HMD, such that movements of the head of the user causes the changes in the view directions into the interactive scenes. The method further includes receiving images of a real world space using a camera of the HMD. The camera of the HMD is configured to capture a location of real world objects in the real world space relative to the user of the HMD.

Abstract: A display driver includes image processing circuitry and drive circuitry. The image processing circuitry is configured to determine a total current of a display panel and perform an IR-drop compensation using the total current and a first graylevel for a first subpixel of the display panel to determine a first voltage level for the first subpixel. The drive circuitry is configured to update the first subpixel based at least in part on the first voltage level.

Abstract: Real-time two-way communication between a user immersed in a virtual reality (VR) environment and another party who is not in the VR environment. The sequence of video frames being presented to the VR user on, e.g., a head mounted display, i.e., the VR user's “field of view” in the VR environment, is shown to a guest user on their computing device. Simultaneously, video from a camera in a guest user computing device is shown to the VR user in a window in the VR environment. Audio is also exchanged in real time between the VR user and guest user by use of a microphone and loudspeaker in both the VR system and the guest user computing device. The VR user's system can also support both rotational and translational user movement thus properly changing the VR user's apparent distance from objects displayed in the VR environment.

Abstract: In a display control method, if a control system proposes an automatic lane change to a driver of a host-vehicle, an arrow icon for guiding an automatic lane change is displayed on a head-up display, and a display method for the arrow icon is switched depending on a plurality of processes in the control performed by the control system.

Abstract: A hybrid projector system for a head up display within a vehicle includes a digital light projector adapted to project a first graphical image onto an inner surface of a windshield of the vehicle, and a vector graphics projector adapted to project a second graphical image onto the inner surface of the windshield of the vehicle.

Abstract: An optical system includes a first optical element having at least a first optical surface and a second optical surface, the first optical surface is not parallel to the second optical surface. The optical system includes a plurality of optical elements positioned adjacent to the second optical surface of the first optical element. The respective optical element of the plurality of optical elements is configured to receive light transmitted through the first optical surface at a first angle with respect to the second optical surface and direct the light back toward the first optical surface at a second angle, that is distinct from the first angle, with respect to the second optical surface.

Abstract: A travel information notification method includes generating an augmented reality object composed of a plurality of lines that indicate a virtual trajectory corresponding to at least a portion of a predicted travel path of a vehicle; providing the generated augmented reality object on a head-up display of the vehicle so that the plurality of lines display the virtual trajectory in association with the road on which the vehicle is traveling; and providing travel information about the vehicle by controlling at least one among the spacing, colors, or shapes of the plurality of lines, displayed as the augmented reality object on the head-up display, according to travel conditions of the vehicle.

Abstract: The disclosure provides an optical waveguide, a manufacturing method of an optical waveguide, and a head-mounted display device. The optical waveguide has a first optical region and a second optical region for transmitting an image beam. The optical waveguide includes a plate body, multiple first light-guiding optical elements, and multiple optical microstructures. The first light-guiding optical elements are disposed in parallel lines on a light-guiding plane inside the plate body. The light-guiding plane is located in the first optical region, and there is a spacing between the adjacent first light-guiding optical elements. The image beam transmitted to the light-guiding plane is separated into multiple sub image beams, and the transmission paths of the sub image beams are at least partially different. The optical coupling-out structure is disposed in the plate body and is located in the second optical region.

Abstract: A head-up display device for a vehicle and superimposing a virtual image on the foreground of an occupant includes: a projector that emits light of a display image to be displayed as the virtual image; an adjustment mechanism that mechanically displaces the projection range of a projection member, which is arranged on the vehicle and projects the light emitted from the projector; and a state controller that controls a state of the display image to be projected by the projector so as to maintain the display position of the virtual image in accordance with the displacement of the projection range by the adjustment mechanism.

Abstract: In some implementations, a voice assistance device may receive an indication of a visualization change associated with the virtual or augmented reality environment. The voice assistance device may determine that a change value, calculated based on the indication of the visualization change, satisfies a relevance threshold. The voice assistance device may apply, based on the indicator of change satisfying the relevance threshold, a description model to determine at least one sentence describing the virtual or augmented reality environment. The voice assistance device may apply a text-to-speech model to the at least one sentence to generate a digital sound signal and may transmit, to an output component, the digital sound signal.

Abstract: A method for operating a field-of-vision display device for a motor vehicle, including an electrically controllable planar pixel assembly for generating a projection light beam having a display content and a reflection-suppressing deflection assembly, which is arranged on the planar pixel assembly and includes one or more flat reflection surfaces, extending along the planar pixel assembly at a predefined acute angle thereto and parallel to one another, for projecting the generated projection light beam onto a partially transparent, reflective projection pane, including a windshield of the motor vehicle, as a result of which a virtual display image shown in a field of vision of a user is generated behind the projection pane, wherein: the one or more reflection surfaces are each light-absorbing on the rear side thereof in order to suppress interfering reflection; at least one driving situation parameter is provided, in dependence on which different area segments of the planar pixel assembly are used to generate

Abstract: In virtual reality (VR) and augmented reality (AR), eye tracking may be performed to determine the user's gaze direction. The gaze direction may be used to enhance user interaction. However, when a user gazes in a particular direction, it could sometimes be the case that there are multiple items located in that gaze direction, each at a different depth. The gaze of direction alone might not be indicative of the item at which the user is looking. Therefore, in some embodiments, to try to further enhance user interaction, a gaze depth of the gaze may be determined. Some embodiments are directed to performing eye tracking to detect a gaze depth of a human's gaze and modifying a user interface (UI) responsive to a change in the gaze depth.

Abstract: A heads-up display system for a vehicle includes a display area on a surface of the vehicle and an optical projection unit for projecting graphic elements to the display area. An electronic control unit is operatively connected for computer communication to the optical projection unit. The electronic control unit determines a perspective view of a real road scene from a user while the user views the real road scene through the display area based on a ride height of the vehicle and an eyepoint of the user. The electronic control unit identifies road features that are visible to the user in the perspective view of the real road scene and adjusts a virtual image having inclined content based on the road features so that the inclined content substantially matches the perspective of the real road scene. Further, the electronic control unit controls the optical projection unit to project the virtual image to the display area.

Abstract: An extended-reality projectile-firing gaming system includes a projectile-firing device that includes a projectile repository, a battlefield object, a network configured to provide communication and control connectivity in accordance with at least one protocol to the projectile-firing device and the battlefield object, an extended-reality gaming application, and an extended-reality device. The extended-reality device includes at least one display and is configured to provide computer-aided vision of real and virtual objects and a computer-aided interface for interaction with the real and virtual objects, the computer-aided interface configured to receive commands or instructions associated with the real and virtual objects and corresponding to the gameplay configuration.

Abstract: A method for providing a signal for actuating an at least partially automated vehicle includes receiving surroundings data; detecting a vehicle which is leaving a parking space and is initiating or executing a parking-space-exiting maneuver, on the basis of the surroundings data; predicting a maneuvering area which the vehicle which is leaving the parking space requires to execute the parking-space-exiting maneuver; and providing a signal for actuating the at least partially automated vehicle on the basis of the predicted maneuvering area.

Abstract: A display system is for controlling a display of display content. The display system includes: a processor; and a memory having stored thereon instructions executable by the processor. The instructions include: performing image correction involving a change in a display position of the display content based on image correction data stored in advance; detecting an attitude change amount of a movable body; calculating, after the image correction is performed, a vibration correction amount of the display position of the display content based on the attitude change amount of the movable body and an image correction error of the image correction caused by vibration correction processing of correcting a display deviation caused by an attitude variation of the movable body; and controlling the display position of the display content based on the vibration correction amount.

Abstract: This document relates to an optical device that uses adaptive optics as part of an optical system. The adaptive optics can be used to correct light rays that correspond to a portion of an eye box based on information received from an eye-tracking unit, and can also correct for aberrations in the optics in the optical device. The adaptive optics include corrective elements that can be modified using modifying elements to correct the angle of light rays, such that rays associated with a specific pupil position and gaze direction of a user's eye can be made parallel and ensure a high quality image is viewed by the user.

Abstract: An object detection method is suitable for a virtual reality system. The object detection method includes a plurality of first cameras of a head-mounted display (HMD) to capture a plurality of first frames. A plurality of second frames are captured through a plurality of second cameras in a tracker, wherein, the object detector searches for the object position in the first frames and the second frames.

Abstract: A display control device includes a processor. The processor is configured to: determine content to be superimposed and displayed over an object on a first display unit fixed to a moving body or a second display unit worn on a human body, the object being a real image seen through the first display unit or the second display unit; select either the first display unit or the second display unit to display the content based on a predetermined condition; and superimpose and display the content over the object on the first display unit or the second display unit, the first display unit or the second display unit being selected to display the content.

Abstract: The disclosure relates to a motor vehicle that loads a motor vehicle movement dataset (KBD) indicative of accelerations of the motor vehicle, loads a passenger movement dataset (PBD) indicative of movements of a passenger of the motor vehicle, evaluate the motor vehicle movement dataset (KBD) and the passenger movement dataset (PBD) by means of a transfer function with a predetermined threshold value (SW) in order to generate an image dataset (BS) for an infotainment system of the motor vehicle, and outputs the image dataset (BS) by means of the infotainment system.

Abstract: A wearable device includes a body having fasteners and a frame coupled between two fasteners. The frame includes first and second sections. A first portion of the body includes the first section of the frame and one fastener and a second portion of the body includes the second section of the frame and the other fastener. A speaker and a microphone are connected to the first portion and another speaker and another microphone are connected to the second portion. The body also includes a processor, memory accessible to the processor, and programming in the memory for configuring the processor to selectively activate the speakers and microphones such that a first speaker emits an output sound signal while a first microphone and a second speaker are deactivated and a second microphone captures an input sound signal during the emission of the output sound signal by the first speaker.

Abstract: A guidance system, a method and a device for dynamically guiding a surgical needle catheter onto an organ to be surgically operated of a patient. In particular, the disclosure relates to a guidance system, a method and a device to aid in the percutaneous kidney puncture.

Abstract: A gaze initiated interaction technique for facilitating interaction between wearers of head-mountable devices. Methods are shown which allow users to interact with each other following an event of interlocking gaze. Methods are also shown which allows the operator of a personal point-of-interest beacon to control and limit interaction from the public thus ensuring a greater degree of privacy. Methods are also introduced which allow a mode of interaction to be determined by a remote service after mutual authorization of each interacting user. This disclosure also introduces a system of a head-mountable device which comprises a directional beacon transceiver system using beams in the infrared light spectrum enabling the detection of a gaze interlock event.

Abstract: A method includes sensing a plurality of luminance values associated with ambient light from a physical environment. The plurality of luminance values quantifies the ambient light arriving at a see-through display. The method includes obtaining a plurality of semantic values respectively associated with a plurality of portions within image data. The plurality of portions includes a first portion of the image data and a second portion of the image data. The method includes identifying a first one of the plurality of semantic values that satisfies a criterion. The first one of the plurality of semantic values is associated with the first portion of the image data. The method includes mapping, based on a function of a portion of the plurality of luminance values, the image data to predetermined display characteristics of the first portion of the image data within a performance threshold.

Abstract: A head up display arrangement for a motor vehicle includes an image source emitting a light field. A first freeform mirror is positioned to provide a first reflection of the light field. A generally concave second freeform mirror is positioned to receive the first reflection and provide a second reflection of the light field. The second reflection is reflected off of a windshield of the vehicle so as to be visible to a driver of the vehicle as a virtual image. The generally concave second freeform mirror includes a reflective surface having a shape such that the virtual image appears to be curved to the driver of the vehicle.

Abstract: A viewing angle expansion plate, which is a multi-pinhole mask, includes a plurality of cell areas; and a plurality of pinholes formed in the plurality of cell areas, wherein each cell area from among the plurality of cell areas corresponds to a respective pixel from among a plurality of pixels in a flat panel display. The flat panel display includes a light source configured to emit parallel light; a flat panel, on which the parallel light is incident, configured to provide a three-dimensional image; and the viewing angle expansion plate.

Abstract: A head-up display and a movable body can display a virtual image viewable at a position nearer a user. The head-up display includes a display device that displays a first image and emits image light from the first image in a first direction, a first optical member located in the first direction from the display device, and a second optical member located between the display device and the first optical member in the first direction. The second optical member reflects the first image in a first plane direction and a second plane direction and displays a virtual image of the first image in a space between the first optical member and a user.

Abstract: Systems and methods for rendering a 3D image are provided. The system receives texture and depth data (depth map) for an image. The system generates, based on the image data, a plurality of folded focal planes matrices. For each respective pixel matrix, the system preprocesses pixel values in the respective focal pixel plane matrix to generate a respective preprocessed matrix, wherein the respective preprocessed matrix clusters together pixel values of the respective folded focal plane matrix based on the depth data for the image. The system generates phase functions based on a plurality of the preprocessed matrices. The system configures a spatial light modulator of the SLM device in accordance with the generated phase functions. The system then provides the plurality of the preprocessed matrices as input to the SLM device to generate for display a 3D representation of the received image data.