Abstract: A computer-implemented method when executed by data processing hardware causes the data processing hardware to perform operations. The operations include receiving, from a plurality of seat sensors, sensor data associated with a seat of a vehicle, determining the sensor data exceeds an activation threshold of a seat sensor application, and activating, based on the sensor data exceeding the activation threshold, the seat sensor application. The operations also include aggregating the sensor data via the seat sensor application, classifying, based on the aggregated sensor data, an object at the seat into an object class, and generating, based on the object class, a signal corresponding to the object via the seat sensor application.

Abstract: A rear view imaging system for a vehicle includes a left side camera located at a left side of the vehicle, where the left side camera is oriented to view an area behind the vehicle that is by an occupant in a driver's seat of the vehicle when the occupant looks at an apparent location of a left outside rear-view mirror of the vehicle, a display device for displaying a left rear image at a first display region of a front left side window of the vehicle, wherein a line-of-sight between the occupant and the apparent location of the left outside rear-view mirror passes through the first display region, and a controller to control operation of the display device to display the left rear image in the first display region.

Abstract: A vehicle includes at least one window having an electrochromic layer. The at least one window is divided into a set of pixels. A driver facing camera defines a field of view including a driver position. A controller includes a gaze and pose monitoring module and a pixel shading control module. The controller is in communication with the driver facing camera and controllably coupled to the at least one window. The pixel shading control module is configured to identify a position of at least one object reflected from a drivers eye, map the identified position of the at least one object to at least one pixel in the set of pixels, and cause the electrochromic layer to darken the at least one pixel in the set of pixels.

Abstract: A steerable gated imaging system includes a light source, a camera including a camera sensor, a first liquid crystal polarized grating (LCPG) device, a second LCPG device, and a controller. The light source emits a pulse of light towards an object. The pulse of light creates a reflection of light off of the object. The camera captures an image when the camera sensor senses the reflection of light. The first LCPG device is adjacent to the light source. The pulse of light is emitted through the first LCPG device. The second LCPG device is adjacent to the camera. The reflection of light travels through the second LCPG device. The controller applies a voltage to the first LCPG device to steer the light pulse towards the object. The controller applies the voltage to the second LCPG device to steer the reflection of light towards the camera.

Abstract: A vehicle includes a camera in communication with a controller. An inertial motion unit (IMU) is in communication with the controller. The controller includes a processor and a non-transitory memory configured to store a set of sequential images generated by the camera and configured to associate vehicle velocity and acceleration data from the IMU with each image in the set of sequential images. An object size and distance determination module is stored in one or both of the controller and an external computer system. The object size and distance determination module is configured to determine a distance of an object in the set of sequential images from the vehicle using the images and the associated vehicle velocity and acceleration data.

Abstract: A system within a vehicle for communicating with a person in proximity to the vehicle includes a perception system in communication with a system controller and adapted to detect the presence of a person, a monitoring system adapted to monitor the position of the person's head and eyes, a holographic image generator including a visual compute engine adapted to calculate a holographic image and encode the holographic image onto a spatial light modulator of a picture generating unit, and a beam steering device, wherein the beam steering device is adapted to receive information related to a position of the person's head and eyes from the monitoring system, and the display is adapted to project the holographic image to the beam steering device and the beam steering device is adapted to re-direct the projected holographic image to the eyes of the person.

Abstract: A system for generating an image display for passengers within a vehicle includes a controller, an image chamber including a first display adapted to project a first image, a first reflector adapted to receive the first image from the first display and reflect the first image to the first passenger, a second display adapted to project a second image, and a second reflector adapted to receive the second image from the second display and reflect the second image to the second passenger, a transparent touch screen display positioned between the first and second reflectors and the passengers and adapted to display information to the passengers within an image plane positioned in front of the first and second images, and a linear polarizer positioned between the transparent display and the first and second reflectors and adapted to filter light traveling from the transparent display toward the first and second reflectors.

Abstract: A testing system includes an antenna assembly having a directional antenna, the alignment of which can be adjusted with respect to a device under test. The directional antenna includes a horn having a housing having a side piece with an opening. A reflecting surface is movable through the opening from a first position away from a beam axis of the directional antenna to a second position along the beam axis. A light source is configured to transmit a light beam to be incident on the reflecting surface. The light beam reflects at the reflecting surface to project along the beam axis to the device under test. A mounting stage coupled to the directional antenna can be adjusted to align the directional antenna by placing the light beam at a desired location of the device under test.

Abstract: A system for generating a floating image for a plurality of passengers within a vehicle includes a passenger monitoring system adapted to monitor the position of head and eyes of each passenger, a compute engine in communication with the passenger monitoring system and adapted to calculate a holographic image and encode the holographic image to a display of a picture generating unit hologram generator, and a beam steering device adapted to receive information related to a position of the head and eyes of each of the passengers from the passenger monitoring system, and the display is adapted to project the holographic image to the beam steering device and the beam steering device is adapted to re-direct the projected holographic image to the eyes of each of the passengers, based on the information received from the passenger monitoring system.

Abstract: A vehicle including a steering input, a driver monitoring system, a controlled electro-mechanical actuator, a controller in communication with the steering input and the driver monitoring system, the controller including a memory and a processor, the memory storing a driver command interpreter module and a vehicle motion control module, and wherein the driver command interpreter module is configured to estimate an upcoming vehicle maneuver based at least in part on a commanded steering operation from the steering input and a driver viewing direction from the driver monitoring system.

Abstract: A system for enabling vehicle display and interaction includes a vehicle display server in communication with a plurality of sensors and adapted to track head and eye position and movement of users within the vehicle, detect locations of users within the vehicle and when users change seating positions, detect when a user enters and exits the vehicle, detect and interpret facial and gesture inputs from users, capture images of users, and receive audio inputs from users within the vehicle, haptic feedback devices adapted to provide haptic feedback to users, and a user display system for viewing and interaction by users, the vehicle display server adapted to identify an identity of a user seated within the vehicle, select user specific content to be displayed for the user on the user display system, and automatically display the user specific content on the user display system for viewing by the user.

Abstract: A method includes receiving perception images of an area surrounding the vehicle with at least one sensor and detecting at least one perception task from the perception images with the at least one perception task identifying at least one neighboring vehicle. The method calculates a risk factor for the at least one neighboring vehicle by recognizing a behavior of the at least one neighboring vehicle from the perception images and plans the path for the vehicle based on the at least one perception task and the risk factor. The path is then executed for the vehicle.

Abstract: A system for generating a floating image for a passenger within a vehicle includes a passenger monitoring system adapted to monitor the position of the passenger's head and eyes, a compute engine in communication with the passenger monitoring system and adapted to calculate a holographic image and encode the holographic image onto a spatial light modulator (SLM) of a picture generating unit (PGU) hologram generator, a beam steering device, wherein the beam steering device is adapted to receive, via the compute engine, information related to a position of the passenger's head and eyes from the passenger monitoring system, and the SLM is adapted to project the holographic image to the beam steering device and the beam steering device is adapted to re-direct the projected holographic image to the eyes of the passenger, based on the information received from the passenger monitoring system.

Abstract: A system for enabling vehicle display and interaction includes a vehicle display server in communication with a plurality of sensors and adapted to track head and eye position and movement of users within the vehicle, detect locations of users within the vehicle and when users change seating positions, detect when a user enters and exits the vehicle, detect and interpret facial and gesture inputs from users, capture images of users, and receive audio inputs from users within the vehicle, haptic feedback devices adapted to provide haptic feedback to users, and a user display system for viewing and interaction by users, the vehicle display server adapted to identify an identity of a user seated within the vehicle, select user specific content to be displayed for the user on the user display system, and automatically display the user specific content on the user display system for viewing by the user.

Abstract: A testing system includes an antenna assembly having a directional antenna, the alignment of which can be adjusted with respect to a device under test. The directional antenna includes a horn having a housing having a side piece with an opening. A reflecting surface is movable through the opening from a first position away from a beam axis of the directional antenna to a second position along the beam axis. A light source is configured to transmit a light beam to be incident on the reflecting surface. The light beam reflects at the reflecting surface to project along the beam axis to the device under test. A mounting stage coupled to the directional antenna can be adjusted to align the directional antenna by placing the light beam at a desired location of the device under test.

Abstract: A multiplexed virtual display system includes: a beam splitting device including i) a first surface configured to reflect a S polarized light beam to display a first image to a first observer and transparent to a P polarized light beam, and ii) a second surface configured to perform as a primary mirror and reflective to the P polarized light beam; a secondary mirror configured to reflect the P polarized light beam to display a second image to a second observer; and a projector configured to iteratively alternate between generating the S polarized light beam and the P polarized light beam.

Abstract: A virtual display system includes: a frustrum prism including reflective surfaces or refractive surfaces; and a projector configured to generate a light beam having a hologram sub-divided into multiple sub-holograms respectively for multiple viewers, and direct the light beam at the frustrum prism. The frustrum prism is configured to split the light beam into multiple sub-light beams via the reflective surfaces or the refractive surfaces, and direct the sub-holograms at eyes of the viewers.

Abstract: A system includes a neural network module, a lane keeping assist (LKA) module, and a control module. The neural network module is configured to receive driver data, identify the driver, receive non-driver data, and generate a lane assist offset value specific to the identified driver based on the non-driver data and the driver data. The LKA module is configured to receive the lane assist offset value, receive vehicle data associated with one or more parameters of the vehicle while the vehicle is moving, the one or more parameters including a steering angle, a velocity, and a vehicle position between lane markings, and generate a steering angle control signal based on the received lane assist offset value and vehicle data. The control module is configured to control steering of the vehicle based on the generated steering angle control signal. Other example systems and methods are also disclosed.

Abstract: A system includes a projector module configured to project a visual media for a user, a user tracking sensor configured to sense whether the user is observing the visual media, and a control module configured to detect whether the user is looking at the projector module based on the user tracking sensor, in response to detecting the user is looking at the projector module, control the projector module to initiate projecting of the visual media for the user, detect an interruption of the user observing the visual media based on the user tracking sensor, and in response to detecting the interruption of the user observing the visual media, control the projector module to pause projecting of the visual media for the user. Other example systems and methods for controlling projection of a visual media for a user in a vehicle are also disclosed.

Abstract: A method for simulating images with aberrations, or a non-transitory computer-readable storage medium on which are recorded instructions. The method includes ray tracing planes of objects to produce plane images, estimating point spread function from the ray tracing, and creating one or more perceived images. The method may include feeding a ray-tracing simulator with one more synthetic impulse images or scenes. The method may include feeding the perceived images into a perception pipeline and generating synthetic imagery from the plane images and the perceived images.