Abstract: A method for simulating images with aberrations, or a non-transitory computer-readable storage medium on which are recorded instructions. The method includes ray tracing planes of objects to produce plane images, estimating point spread function from the ray tracing, and creating one or more perceived images. The method may include feeding a ray-tracing simulator with one more synthetic impulse images or scenes. The method may include feeding the perceived images into a perception pipeline and generating synthetic imagery from the plane images and the perceived images.

Abstract: A virtual imaging system includes: a projection display configured to display at least one object; a Fourier transform element comprising at least one telecentric lens and configured to Fourier transform the at least one object to generate at least one converted object, the at least one converted object being reverse Fourier transform converted by lenses of eyes of a viewer to a virtual image seen by retinas of the viewer; and a control module configured to control operation of the projection display to display the at least one object and, via the Fourier transform element, project the virtual image seen by the viewer.

Abstract: A system for generating a floating image for a passenger within a vehicle includes a passenger monitoring system adapted to monitor the position of the passenger's head and eyes, a compute engine adapted to calculate a holographic image and encode the holographic image to a display of a picture generating unit (PGU) hologram generator, and a display screen positioned for viewing by the passenger and adapted to selectively switch between a first mode, wherein the display screen is adapted to display images for viewing by the passenger, and a second mode, wherein the display screen is adapted to function as a beam steering device, wherein, when the display screen is operating in the second mode, the display is adapted to project the holographic image to the display screen and the display screen re-directs the projected holographic image to the eyes of the passenger.

Abstract: A system within a vehicle for communicating with a person in proximity to the vehicle includes a perception system in communication with a system controller and adapted to detect the presence of a person, a monitoring system adapted to monitor the position of the person's head and eyes, a holographic image generator including a visual compute engine adapted to calculate a holographic image and encode the holographic image onto a spatial light modulator of a picture generating unit, and a beam steering device, wherein the beam steering device is adapted to receive information related to a position of the person's head and eyes from the monitoring system, and the display is adapted to project the holographic image to the beam steering device and the beam steering device is adapted to re-direct the projected holographic image to the eyes of the person.

Abstract: An automobile includes an electronic control unit (ECU), at least one fiber optical cable, and a sensor unit. The ECU is operational to generate an optical power signal and a first optical communications signal. The fiber optical cable transports the optical power signal and the first optical communications signal. The sensor unit is operational to convert the optical power signal into an electrical power, convert the first optical communications signal into an electrical control signal, measure a first parameter related to the automobile, and generate a second optical communications signal that conveys the first parameter as measured. The fiber optical transports the second optical communications signal to the electronic control unit. The ECU is further operational to convert the second optical communications signal into a first electrical sensed signal that conveys the first parameter, and take an action based on the first parameter in the first electrical sensed signal.

Abstract: A system for a host vehicle operating on a road surface includes a polarimetric camera, a global positioning system (“GPS”) receiver, a compass, and an electronic control unit (“ECU”). The camera collects polarimetric image data of a drive scene, including a potential driving path on the road surface. The ECU receives the polarimetric image data, estimates the Sun location using the GPS receiver and compass, and computes an ideal representation of the road surface using the Sun location. The ECU normalizes the polarimetric image data such that the road surface has a normalized representation in the drive scene, i.e., an angle of linear polarization (“AoLP”) and degree of linear polarization (“DoLP”) equal predetermined fixed values. The ECU executes a control action using the normalized representation.

Abstract: A detection system for a host vehicle includes a camera, global positioning system (“GPS”) receiver, compass, and electronic control unit (“ECU”). The camera collects polarimetric image data forming an imaged drive scene inclusive of a road surface illuminated by the Sun. The GPS receiver outputs a present location of the vehicle as a date-and-time-stamped coordinate set. The compass provides a directional heading of the vehicle. The ECU determines the Sun's location relative to the vehicle and camera using an input data set, including the present location and directional heading. The ECU also detects a specular reflecting area or areas on the road surface using the polarimetric image data and Sun's location, with the specular reflecting area(s) forming an output data set. The ECU then executes a control action aboard the host vehicle in response to the output data set.

Abstract: A system includes a projector module configured to project a visual media for a user, a user tracking sensor configured to sense whether the user is observing the visual media, and a control module configured to detect whether the user is looking at the projector module based on the user tracking sensor, in response to detecting the user is looking at the projector module, control the projector module to initiate projecting of the visual media for the user, detect an interruption of the user observing the visual media based on the user tracking sensor, and in response to detecting the interruption of the user observing the visual media, control the projector module to pause projecting of the visual media for the user. Other example systems and methods for controlling projection of a visual media for a user in a vehicle are also disclosed.

Abstract: A system for generating a floating image for a plurality of passengers within a vehicle includes a passenger monitoring system adapted to monitor the position of head and eyes of each passenger, a compute engine in communication with the passenger monitoring system and adapted to calculate a holographic image and encode the holographic image to a display of a picture generating unit hologram generator, and a beam steering device adapted to receive information related to a position of the head and eyes of each of the passengers from the passenger monitoring system, and the display is adapted to project the holographic image to the beam steering device and the beam steering device is adapted to re-direct the projected holographic image to the eyes of each of the passengers, based on the information received from the passenger monitoring system.

Abstract: A multiview campfire display includes a light source configured to emit a light beam and a spatial light modulator (SLM) positioned to receive the light beam emitted by the light source. The holographic display also includes a user tracker configured to track the head and eyes of the vehicle occupants. The display also includes a controller in communication with the user tracker, the light source, and the SLM. The controller is programmed to receive a eye-tracking signal from the user tracker and control a polarization optics of the light beam emitted by the light source and modulated by the SLM to reroute the image encoded by the SLM for the plurality of vehicle occupants based on the eye-tracking signal, thereby allowing each of the plurality of vehicle occupants to view the image.

Abstract: A method of controlling a color display screen aboard a motor vehicle includes performing, via a host computer, a color calibration test of a user of the motor vehicle in which the user is subjected to a calibrated set of color-coded test information. The method includes receiving a color perception response of the user to the calibrated set of color-coded test information via the host computer. Additionally, the method includes mapping a reduced visual gamut of the user via the host computer using the color perception response, and then commanding adjustment of user-specific color settings of the motor vehicle using the reduced visual gamut to thereby accommodate a color perception deficiency of the user.

Abstract: A system includes a neural network module, a lane keeping assist (LKA) module, and a control module. The neural network module is configured to receive driver data, identify the driver, receive non-driver data, and generate a lane assist offset value specific to the identified driver based on the non-driver data and the driver data. The LKA module is configured to receive the lane assist offset value, receive vehicle data associated with one or more parameters of the vehicle while the vehicle is moving, the one or more parameters including a steering angle, a velocity, and a vehicle position between lane markings, and generate a steering angle control signal based on the received lane assist offset value and vehicle data. The control module is configured to control steering of the vehicle based on the generated steering angle control signal. Other example systems and methods are also disclosed.

Abstract: A method for deblurring a blurred image includes dividing the blurred image into overlapping regions each having a size and an offset from neighboring overlapping regions along a first direction as determined by a period of a ringing artifact in the blurred image, or by obtained blur characteristics relating to the blurred image and/or attributable to the optical system, or by a detected cause capable of producing the blur characteristics, stacking the overlapping regions to produce a stacked output, wherein the overlapping regions are sequentially organized along the first direction, convolving the stacked output through a first convolutional neural network (CNN) to produce a first CNN output having reduced blur as compared to the stacked output, and assembling the first CNN output into a re-assembled image, and processing the re-assembled image through a second CNN to produce a deblurred image having reduced residual artifacts as compared to the re-assembled image.

Abstract: A visual perception system includes a scanning camera, color sensor with color filter array (CFA), and a classifier node. The camera captures full color pixel images of a target object, e.g., a traffic light, and processes the pixel images through a narrow band pass filter (BPF), such that the narrow BPF outputs monochromatic images of the target object. The color sensor and CFA receive the monochromatic images. The color sensor has at least three color channels each corresponding to different colors of spectral data in the monochromatic images. The classifier node uses a predetermined classification decision tree to classify constituent pixels of the monochromatic images into different color bins as a corresponding color of interest. The color of interest may be used to perform a control action, e.g., via an automated driver assist system (ADAS) control unit or an indicator device.

Abstract: A system for generating an image display for passengers within a vehicle includes a controller, an image chamber including a first display adapted to project a first image, a first reflector adapted to receive the first image from the first display and reflect the first image to the first passenger, a second display adapted to project a second image, and a second reflector adapted to receive the second image from the second display and reflect the second image to the second passenger, a transparent touch screen display positioned between the first and second reflectors and the passengers and adapted to display information to the passengers within an image plane positioned in front of the first and second images, and a linear polarizer positioned between the transparent display and the first and second reflectors and adapted to filter light traveling from the transparent display toward the first and second reflectors.

Abstract: A multiview campfire display includes a light source configured to emit a light beam and a spatial light modulator (SLM) positioned to receive the light beam emitted by the light source. The holographic display also includes a user tracker configured to track the head and eyes of the vehicle occupants. The display also includes a controller in communication with the user tracker, the light source, and the SLM. The controller is programmed to receive a eye-tracking signal from the user tracker and control a polarization optics of the light beam emitted by the light source and modulated by the SLM to reroute the image encoded by the SLM for the plurality of vehicle occupants based on the eye-tracking signal, thereby allowing each of the plurality of vehicle occupants to view the image.

Abstract: A solid state steerable illumination system for a vehicle includes a first light source configured to generate light having a first wavelength, a first liquid crystal polarized grating (LCPG) device arranged to receive light from the first light source, and a vehicle control module configured to supply drive voltages to the first light source and the first LCPG device to generate a beam of light, wherein an output orientation angle of the beam of light is variable according to drive voltage applied to the first LCPG device.

Abstract: An optical arrangement includes at least one pair of displays, each pair having a first display and a second display configured to generate light in a visible spectral range. For each pair of displays, the optical arrangement includes a first polarizer configured to polarize the light incident from the first display, a second polarizer configured to polarize the light incident from the second display. The optical arrangement also includes first and second polarizing beam splitters for each pair of displays. Each polarizing beam splitter is configured to receive the polarized light from the first and second polarizers. Each polarizing beam splitter is also configured to reflect one of an s-polarized component and a p-polarized component of the received polarized light into at least one field of view (FOV) and transmit the other of the s-polarized component and the p-polarized component of the received polarized light into the subject FOV(s).

Abstract: An optical arrangement includes at least one pair of displays, each pair having a first display and a second display configured to generate light in a visible spectral range. For each pair of displays, the optical arrangement includes a first polarizer configured to polarize the light incident from the first display, a second polarizer configured to polarize the light incident from the second display. The optical arrangement also includes first and second polarizing beam splitters for each pair of displays. Each polarizing beam splitter is configured to receive the polarized light from the first and second polarizers. Each polarizing beam splitter is also configured to reflect one of an s-polarized component and a p-polarized component of the received polarized light into at least one field of view (FOV) and transmit the other of the s-polarized component and the p-polarized component of the received polarized light into the subject FOV(s).

Abstract: A system for generating a floating image for a passenger within a vehicle includes a passenger monitoring system adapted to monitor the position of the passenger's head and eyes, a compute engine in communication with the passenger monitoring system and adapted to calculate a holographic image and encode the holographic image onto a spatial light modulator (SLM) of a picture generating unit (PGU) hologram generator, a beam steering device, wherein the beam steering device is adapted to receive, via the compute engine, information related to a position of the passenger's head and eyes from the passenger monitoring system, and the SLM is adapted to project the holographic image to the beam steering device and the beam steering device is adapted to re-direct the projected holographic image to the eyes of the passenger, based on the information received from the passenger monitoring system.