Abstract: A disclosed method determines a distance from a camera to a face of a vehicle driver using information determined by phase detecting pixels of a digital image sensor of the camera. The method includes capturing an image of the driver including the driver's face and processing the image to determine a face region of the image. The method further includes determining a subset of phase detecting pixels of the digital image sensor that are associated with the face region of the image. A comparison of first and second image data generated by the determined phase detecting pixels is then used to determine a spatial image offset. The spatial image offset is then used to generate a first distance estimate of a distance between a region of the driver's face and the digital image sensor. The first distance estimate is used to track the driver's head or eyes.

Abstract: Described herein is an image pre-processing system and method. One embodiment provides a method (500) including: at step (501), receiving a plurality of images captured at a first frame rate, the plurality of images captured under at least two different image conditions; pre-processing the plurality of images by: at step (502) identifying one or more regions of interest within the images; at step (503), performing a visibility measure on the one or more regions of interest; and, at step (504), selecting a subset of the plurality of images based on the visibility measure; and, at step (505), feeding the subset of images to an image processing pipeline for subsequent processing at a second frame rate that is lower than the first frame rate.

Abstract: Described herein is a rearview mirror (100) for a vehicle (102). The rearview mirror (100) comprises a body (104) mounted to the vehicle (102) and supporting an electrically controllable reflective device (108). A camera (110) is mounted to or adjacent to the body (104). The camera (110) comprises an image sensor having a pixel array adapted to capture two or three dimensional images of an interior of the vehicle (102), including a rear window (112), in both the visible and infrared wavelength range. A processor (124) is configured to process the captured images to generate a control signal for controlling a transmittance of the electrically controllable reflective device (108). The control signal is derived based on a comparison of pixel brightness between pixels within an interior vehicle cabin pixel region (150) and a rear window pixel region (152) in the captured images.

Abstract: A fluid delivery system illustratively includes a spout, at least one valve in fluid communication with the spout, and a disinfectant device, illustratively an antibacterial device, fluidly coupled to the spout. The faucet is configured to selectively flow water through the disinfectant device in response to a user input to the faucet. In another illustrative embodiment, the fluid delivery system includes an outer housing, a plurality of fluid devices supported by the outer housing, and an ozone generator fluidly coupled to the fluid devices.

Abstract: Described herein is a method (800) and system for controlling one or more illumination devices in an eye tracker system (100) such that a measured pupil/iris contrast exceeds a predefined minimum pupil/iris contrast. The method (100) includes: a. capturing images of a subject (102), including one or both of the subject's eyes, during predefined image capture periods; b. illuminating, from one or more illumination devices (108 and 110), one or both of the subject's eyes during the predefined image capture periods, wherein at least one illumination device (108 and 110) is located sufficiently close to a lens of the camera to generate bright pupil effects; and c. selectively varying the output power of at least one of the illumination devices (108 and 110) to generate a bright pupil reflection intensity such that a measured pupil/iris contrast in a captured image exceeds a predefined minimum pupil/iris contrast.

Abstract: A fluid delivery system illustratively includes a spout, at least one valve in fluid communication with the spout, and a disinfectant device, illustratively an antibacterial device, fluidly coupled to the spout. The faucet is configured to selectively flow water through the disinfectant device in response to a user input to the faucet. In another illustrative embodiment, the fluid delivery system includes an outer housing, a plurality of fluid devices supported by the outer housing, and an ozone generator fluidly coupled to the fluid devices.

Abstract: A disclosed system is configured to estimate an attention state of a subject within a scene. An imaging camera captures digital images of the subject and one or more light sources illuminate the subject during a period in which the digital images are captured. The system also includes a processor that processes the captured images to generate subject attention data of the subject. The processor further generates a primary visual attention ray of the subject from current subject attention data; generates a distribution of visual attention rays having an origin common to the primary visual attention ray; projects the visual attention rays onto a digital representation of the scene having a plurality of predefined regions of interest; determines an intersection of the projected visual attention rays with one or more of the regions of interest; and based on the intersection, estimates an attention state of the subject's attention.

Abstract: Described herein is an imaging system (200) for a driver monitoring system (100). The imaging system (200) includes a light source (108) for generating an input light beam (202) and projecting the input light beam (202) along a path towards a driver (102) of a vehicle. System (200) also includes a dielectric metasurface (201) positioned within the path of the input light beam (202). The metasurface (201) has a two dimensional array of surface elements configured to impose predetermined phase, polarization and/or intensity changes to the input light beam (202) to generate an output light beam (204) for illuminating the driver (102). System (200) further includes an image sensor (106) configured to image reflected light (208) being light from the output light beam (204) that is reflected from the driver.

Abstract: Described herein is an imaging system (200) for imaging a scene. The system (200) includes a camera (106) having an image sensor for capturing images of the scene in both the visible and infrared wavelength ranges and at least one light source (108) configured to emit a beam of light to selectively illuminate the scene with infrared radiation during image capture by the camera (106). The system (200) also includes an electrically controllable filter (203) being configured to pass infrared wavelengths to the image sensor and selectively pass or filter visible light received at the image sensor based on a control signal.

Abstract: Described herein is a system and method for performing eye tracking. One embodiment provides a system (100) including a camera (106) for capturing images of a vehicle driver's (102) eye and light emitting diodes (LEDs—108 and 110) configured to selectively illuminate the driver's eye during image capture by the camera (106). A processor (118) is configured to process at least a subset of the captured images to determine one or more eye tracking parameters of the subjects eye and to determine one or more illumination characteristics of the images. A controller (120) is configured to send an LED control signal to the LEDs (108 and 110) to control the drive current amplitude and pulse time of the LEDs (108 and 110). The controller (120) selectively adjusts the drive current amplitude and/or pulse time based on the determined illumination characteristics of a previous captured image or images.

Abstract: A disclosed system is configured to estimate an attention state of a subject within a scene. An imaging camera captures digital images of the subject and one or more light sources illuminate the subject during a period in which the digital images are captured. The system also includes a processor that processes the captured images to generate subject attention data of the subject. The processor further generates a primary visual attention ray of the subject from current subject attention data; generates a distribution of visual attention rays having an origin common to the primary visual attention ray; projects the visual attention rays onto a digital representation of the scene having a plurality of predefined regions of interest; determines an intersection of the projected visual attention rays with one or more of the regions of interest; and based on the intersection, estimates an attention state of the subject's attention.

Abstract: Described herein are methods and systems of distinguishing between a glance event and an eye closure event in a subject monitoring system. A method includes capturing a number of images of the subject's face including at least one eye of the subject over a period of time; processing the images to determine a closure state of at least one eye; detecting potential eye closure events in which the closure state of at least one eye is determined to be in a closed state; for corresponding detected potential eye closure event, determining a head pitch angle of the subject and classifying the potential eye closure event as a glance event if a head pitch angle of the subject is detected to change by an angle greater than a predetermined head pitch angle and otherwise classifying the potential eye closure event as an eye closure event.

Abstract: Described herein is an imaging system (200) for a driver monitoring system (100). The imaging system (200) includes a light source (108) for generating an input light beam (202) and projecting the input light beam (202) along a path towards a driver (102) of a vehicle. System (200) also includes a dielectric metasurface (201) positioned within the path of the input light beam (202). The metasurface (201) has a two dimensional array of surface elements configured to impose predetermined phase, polarization and/or intensity changes to the input light beam (202) to generate an output light beam (204) for illuminating the driver (102). System (200) further includes an image sensor (106) configured to image reflected light (208) being light from the output light beam (204) that is reflected from the driver.

Abstract: Described herein is a method of registering a position and an orientation of one or more cameras in a camera imaging system. The method includes: receiving, from a depth imaging device, data indicative of a three dimensional image of the scene. The three dimensional image is calibrated with a reference frame relative to the scene. The reference frame includes a reference position and reference orientation. A three dimensional position of each of the cameras within the three dimensional image is determined relative to the reference frame. An orientation of each camera is determined to relative to the reference frame. The position and orientation of each camera is combined to determine a camera pose relative to the reference frame.

Abstract: Described herein is an image pre-processing system and method. One embodiment provides a method (500) including: at step (501), receiving a plurality of images captured at a first frame rate, the plurality of images captured under at least two different image conditions; pre-processing the plurality of images by: at step (502) identifying one or more regions of interest within the images; at step (503), performing a visibility measure on the one or more regions of interest; and, at step (504), selecting a subset of the plurality of images based on the visibility measure; and, at step (505), feeding the subset of images to an image processing pipeline for subsequent processing at a second frame rate that is lower than the first frame rate.

Abstract: Described herein are systems and methods of determining a pose of a camera within a vehicle scene. In one embodiment, a method includes the initial step of capturing an image of the vehicle scene from the camera. At step, reference data indicative of the vehicle scene is loaded, the reference data includes positions and orientations of known features within the vehicle scene. Next, at step, the geometric appearance of one or more of the known features is identified within the image. Finally, at step, the three dimensional position and orientation of the camera relative to the known features identified in step c) is determined from the geometric appearance, and a pose of the camera within the vehicle scene is calculated.

Abstract: Described herein is a system and method for performing eye tracking. One embodiment provides a system (100) including a camera (106) for capturing images of a vehicle driver's (102) eye and light emitting diodes (LEDs—108 and 110) configured to selectively illuminate the driver's eye during image capture by the camera (106). A processor (118) is configured to process at least a subset of the captured images to determine one or more eye tracking parameters of the subjects eye and to determine one or more illumination characteristics of the images. A controller (120) is configured to send an LED control signal to the LEDs (108 and 110) to control the drive current amplitude and pulse time of the LEDs (108 and 110). The controller (120) selectively adjusts the drive current amplitude and/or pulse time based on the determined illumination characteristics of a previous captured image or images.

Abstract: A method includes capturing images of a vehicle driver's face from a driver facing camera and images of a forward road scene from a forward facing camera. The images are analyzed to derive gaze direction data in a vehicle frame of reference. The gaze direction data are statistically collated to determine a frequency distribution of gaze angles. One or more peaks in the frequency distribution are identified and associated with corresponding reference points in the images to determine one or more reference gaze positions in the vehicle frame of reference. The one or more reference gaze positions are correlated with a position of the reference points in a forward facing camera frame of reference to determine a camera pose of a forward facing camera in the vehicle frame of reference.

Abstract: A disclosed method determines a distance from a camera to a face of a vehicle driver using information determined by phase detecting pixels of a digital image sensor of the camera. The method includes capturing an image of the driver including the driver's face and processing the image to determine a face region of the image. The method further includes determining a subset of phase detecting pixels of the digital image sensor that are associated with the face region of the image. A comparison of first and second image data generated by the determined phase detecting pixels is then used to determine a spatial image offset. The spatial image offset is then used to generate a first distance estimate of a distance between a region of the driver's face and the digital image sensor. The first distance estimate may be used to track the driver's head or eyes.

Abstract: A method includes capturing images of a vehicle driver's face from a driver facing camera and images of a forward road scene from a forward facing camera. The images are analyzed to derive gaze direction data in a vehicle frame of reference. The gaze direction data are statistically collated to determine a frequency distribution of gaze angles. One or more peaks in the frequency distribution are identified and associated with corresponding reference points in the images to determine one or more reference gaze positions in the vehicle frame of reference. The one or more reference gaze positions are correlated with a position of the reference points in a forward facing camera frame of reference to to determine a camera pose of a forward facing camera in the vehicle frame of reference.