Abstract: A disclosed monitoring system includes infrared light sources that illuminate a subject in a sequenced manner and a camera that captures images of the subject during periods in which the subject is illuminated by one of the light sources. The system includes a processor that analyzes captured images to determine a brightness measure of the images, and a controller controls output power of the infrared light sources in response to the brightness measure. In response to the processor detecting a brightness measure below a predetermined brightness threshold, the controller is configured to switch off or reduce an output illumination intensity of one of the infrared light sources. A disclosed method further determines whether an emission source is occluded by modulating an intensity of an electromagnetic emission source, detecting whether the modulation pattern is present in captured images, and determining that the emission source is occluded based on the detected modulation.

Abstract: Described herein is a method (1000) of detecting mobile device (400) use of a driver (102) of a vehicle (104). The method (1000) comprises the step (1001) of receiving a sequence of images of at least the driver's head captured from a camera (106, 420). At step (1002), the sequence of images are processed to determine visual attention of the driver (102) based on detected head and/or eye movements of the driver (102) over a period of time. At step (1003), mobile device use events are detected within the period of time in which a user interacts with the mobile device (400) that is located within the vehicle (104). At step (1004), a temporal correlation of the visual attention of the driver (102) with the mobile device use events is determined over the period of time. At step (1005), a determination is made that the driver (102) is using the mobile device (400) if the determined temporal correlation is greater than a threshold correlation coefficient.

Abstract: A disclosed system is configured to estimate an attention state of a subject within a scene. An imaging camera captures digital images of the subject and one or more light sources illuminate the subject during a period in which the digital images are captured. The system also includes a processor that processes the captured images to generate subject attention data of the subject. The processor further generates a primary visual attention ray of the subject from current subject attention data; generates a distribution of visual attention rays having an origin common to the primary visual attention ray; projects the visual attention rays onto a digital representation of the scene having a plurality of predefined regions of interest; determines an intersection of the projected visual attention rays with one or more of the regions of interest; and based on the intersection, estimates an attention state of the subject's attention.

Abstract: Described herein is a mount (1) for supporting a mobile device (3) having a wireless transceiver (60) within a vehicle (5) having a driver. The mount (1) includes a body (7) having a supporting formation (9) adapted to releasably support the mobile device (3) in a supported operative position within the vehicle (5). The mount (1) also includes an electrical interface (25) for connecting to an external power source, the interface (25) being positioned to engage a complementary electrical port (27) of the mobile device (3) when the mobile device (3) is in the operative position to supply power to the mobile device (3). The mount (1) and the mobile device (3) collectively define an illumination device (29, 31) and a first camera (33) that cooperate to obtain predetermined performance information about the driver.

Abstract: A disclosed system is configured to estimate an attention state of a subject within a scene. An imaging camera captures digital images of the subject and one or more light sources illuminate the subject during a period in which the digital images are captured. The system also includes a processor that processes the captured images to generate subject attention data of the subject. The processor further generates a primary visual attention ray of the subject from current subject attention data; generates a distribution of visual attention rays having an origin common to the primary visual attention ray; projects the visual attention rays onto a digital representation of the scene having a plurality of predefined regions of interest; determines an intersection of the projected visual attention rays with one or more of the regions of interest; and based on the intersection, estimates an attention state of the subject's attention.

Abstract: A disclosed monitoring system includes infrared light sources that illuminate a subject in a sequenced manner and a camera that captures images of the subject during periods in which the subject is illuminated by one of the light sources. The system includes a processor that analyzes captured images to determine a brightness measure of the images, and a controller controls output power of the infrared light sources in response to the brightness measure. In response to the processor detecting a brightness measure below a predetermined brightness threshold, the controller is configured to switch off or reduce an output illumination intensity of one of the infrared light sources. A disclosed method further determines whether an emission source is occluded by modulating an intensity of an electromagnetic emission source, detecting whether the modulation pattern is present in captured images, and determining that the emission source is occluded based on the detected modulation.

Abstract: Described herein is a method of registering a position and an orientation of one or more cameras in a camera imaging system. The method includes: receiving, from a depth imaging device, data indicative of a three dimensional image of the scene. The three dimensional image is calibrated with a reference frame relative to the scene. The reference frame includes a reference position and reference orientation. A three dimensional position of each of the cameras within the three dimensional image is determined relative to the reference frame. An orientation of each camera is determined to relative to the reference frame. The position and orientation of each camera is combined to determine a camera pose relative to the reference frame.

Abstract: Described herein are systems and methods of determining a pose of a camera within a vehicle scene. In one embodiment, a method includes the initial step of capturing an image of the vehicle scene from the camera. At step, reference data indicative of the vehicle scene is loaded, the reference data includes positions and orientations of known features within the vehicle scene. Next, at step, the geometric appearance of one or more of the known features is identified within the image. Finally, at step, the three dimensional position and orientation of the camera relative to the known features identified in step c) is determined from the geometric appearance, and a pose of the camera within the vehicle scene is calculated.

Abstract: A method includes: capturing, from one or more imaging devices, a sequence of time separated images of the subject's face including one or both of the subject's eyes; processing the images to detect specular reflections present in the images, and determining a two dimensional position of any detected specular reflections; characterizing the detected specular reflections into corneal reflections and non-corneal reflections; upon detection of at least one corneal reflection, performing a first eye gaze tracking procedure based on the relative positions of the at least one corneal reflection and at least one reference eye feature; upon detection of no corneal reflections, performing a second eye gaze tracking procedure on one or both eyes of the subject based on the estimation of head pose of the subject; and outputting eye gaze vectors of one or both eyes from the first or second eye gaze tracking procedure.

Abstract: A method includes capturing images of a vehicle driver's face from a driver facing camera and images of a forward road scene from a forward facing camera. The images are analyzed to derive gaze direction data in a vehicle frame of reference. The gaze direction data are statistically collated to determine a frequency distribution of gaze angles. One or more peaks in the frequency distribution are identified and associated with corresponding reference points in the images to determine one or more reference gaze positions in the vehicle frame of reference. The one or more reference gaze positions are correlated with a position of the reference points in a forward facing camera frame of reference to determine a camera pose of a forward facing camera in the vehicle frame of reference.

Abstract: A disclosed method determines a distance from a camera to a face of a vehicle driver using information determined by phase detecting pixels of a digital image sensor of the camera. The method includes capturing an image of the driver including the driver's face and processing the image to determine a face region of the image. The method further includes determining a subset of phase detecting pixels of the digital image sensor that are associated with the face region of the image. A comparison of first and second image data generated by the determined phase detecting pixels is then used to determine a spatial image offset. The spatial image offset is then used to generate a first distance estimate of a distance between a region of the driver's face and the digital image sensor. The first distance estimate may be used to track the driver's head or eyes.

Abstract: A method includes capturing images of a vehicle driver's face from a driver facing camera and images of a forward road scene from a forward facing camera. The images are analyzed to derive gaze direction data in a vehicle frame of reference. The gaze direction data are statistically collated to determine a frequency distribution of gaze angles. One or more peaks in the frequency distribution are identified and associated with corresponding reference points in the images to determine one or more reference gaze positions in the vehicle frame of reference. The one or more reference gaze positions are correlated with a position of the reference points in a forward facing camera frame of reference to to determine a camera pose of a forward facing camera in the vehicle frame of reference.

Abstract: Described herein are systems and methods of determining a pose of a camera within a vehicle scene. In one embodiment, a method includes the initial step of capturing an image of the vehicle scene from the camera. At step, reference data indicative of the vehicle scene is loaded, the reference data includes positions and orientations of known features within the vehicle scene. Next, at step, the geometric appearance of one or more of the known features is identified within the image. Finally, at step, the three dimensional position and orientation of the camera relative to the known features identified in step c) is determined from the geometric appearance, and a pose of the camera within the vehicle scene is calculated.

Abstract: A method of reducing the illumination power requirements for an object tracking system, the method including the steps of: (a) determining a current location of the object within a scene; (b) for a future frame: determining a band around the object of interest; determining a start and stop time for when the rolling shutter detector will be sampling the band; and illuminating the object only while the rolling shutter detector is sampling the band; (c) for a future frame predicting the location of the object relative to the tracking system; determining the ambient light levels; and illuminating the object with the minimum optical power required for the object to be imaged suitably for tracking.

Abstract: Described herein is a method of registering a position and an orientation of one or more cameras in a camera imaging system. The method includes: receiving, from a depth imaging device, data indicative of a three dimensional image of the scene. The three dimensional image is calibrated with a reference frame relative to the scene. The reference frame includes a reference position and reference orientation. A three dimensional position of each of the cameras within the three dimensional image is determined relative to the reference frame. An orientation of each camera is determined to relative to the reference frame. The position and orientation of each camera is combined to determine a camera pose relative to the reference frame.

Abstract: A method includes: capturing, from one or more imaging devices, a sequence of time separated images of the subject's face including one or both of the subject's eyes; processing the images to detect specular reflections present in the images, and determining a two dimensional position of any detected specular reflections; characterizing the detected specular reflections into corneal reflections and non-corneal reflections; upon detection of at least one corneal reflection, performing a first eye gaze tracking procedure based on the relative positions of the at least one corneal reflection and at least one reference eye feature; upon detection of no corneal reflections, performing a second eye gaze tracking procedure on one or both eyes of the subject based on the estimation of head pose of the subject; and outputting eye gaze vectors of one or both eyes from the first or second eye gaze tracking procedure.

Abstract: Described herein is a mount (1) for supporting a mobile device (3) having a wireless transceiver (60) within a vehicle (5) having a driver. The mount (1) includes a body (7) having a supporting formation (9) adapted to releasably support the mobile device (3) in a supported operative position within the vehicle (5). The mount (1) also includes an electrical interface (25) for connecting to an external power source, the interface (25) being positioned to engage a complementary electrical port (27) of the mobile device (3) when the mobile device (3) is in the operative position to supply power to the mobile device (3). The mount (1) and the mobile device (3) collectively define an illumination device (29, 31) and a first camera (33) that cooperate to obtain predetermined performance information about the driver.

Abstract: A method of reducing the illumination power requirements for an object tracking system, the method including the steps of: (a) determining a current location of the object within a scene; (b) for a future frame: determining a band around the object of interest; determining a start and stop time for when the rolling shutter detector will be sampling the band; and illuminating the object only whilst the rolling shutter detector is sampling the band; (c) for a future frame predicting the location of the object relative to the tracking system; determining the ambient light levels; and illuminating the object with the minimum optical power required for the object to be imaged suitably for tracking.

Abstract: A method of calibrating the eye gaze direction of a user, the method including the steps of: (a) monitoring a user's eye gaze direction whilst carrying out a series of predetermined tasks, each of the tasks having an expected subject gaze direction; and (b) correlating the user's eye gaze direction with the expected direction for a statistically significant period of time; (c) calculating, from the correlating step, a series of likely eye gaze direction usage parameters associated with the user.

Abstract: A method of calibrating the eye gaze direction of a user, the method including the steps of: (a) monitoring a user's eye gaze direction whilst carrying out a series of predetermined tasks, each of the tasks having an expected subject gaze direction; and (b) correlating the user's eye gaze direction with the expected direction for a statistically significant period of time; (c) calculating, from the correlating step, a series of likely eye gaze direction usage parameters associated with the user.