Abstract: A system for generating motion blur comprises: a frame camera, an event camera and an accumulator for accumulating event information from a plurality of events occurring within a window around the exposure time of an image frame in a plurality of event frames. A processor determines from the events in at least a first of the plurality of event frames, one or more areas of movement within the field of view of the event camera; determines from the events in at least a second of the plurality of event frames, a direction of movement for the one or more areas of movement; and applies blur in one or more areas of the image frame corresponding to the one or more determined areas of movement in accordance with at least the direction of movement for each of the one or more areas of movement to produce a blurred image.

Abstract: A system for generating motion blur comprises: a frame camera, an event camera and an accumulator for accumulating event information from a plurality of events occurring within a window around the exposure time of an image frame in a plurality of event frames. A processor determines from the events in at least a first of the plurality of event frames, one or more areas of movement within the field of view of the event camera; determines from the events in at least a second of the plurality of event frames, a direction of movement for the one or more areas of movement; and applies blur in one or more areas of the image frame corresponding to the one or more determined areas of movement in accordance with at least the direction of movement for each of the one or more areas of movement to produce a blurred image.

Abstract: A demosaicing module for an image signal processing pipeline comprises a neural network comprising a plurality of branches, each branch comprising a plurality of successively executable convolutional layers, one convolutional layer of each branch being configured to receive a plurality of image planes acquired from a colour filter array, CFA, image sensor, each image plane having a resolution equal to the image sensor, with only one image plane having a non-blank pixel value at any pixel location and with pixel information for each colour plane maintained in a spatial relationship corresponding to the pixel locations for each colour of the colour filter array. The convolutional layers of each branch are configured to combine the image plane information into a demosaiced image plane in a given image space.

Abstract: A method for calibrating a vehicle cabin camera having: a pitch, yaw and roll angle; and a field of view capturing vehicle cabin features which are symmetric about a vehicle longitudinal axis comprises: selecting points from within an image of the vehicle cabin and projecting the points onto a 3D unit circle in accordance with a camera projection model. For each of one or more rotations of a set of candidate yaw and roll rotations, the method comprises: rotating the projected points with the rotation; flipping the rotated points about a pitch axis; counter-rotating the projected points with an inverse of the rotation; and mapping the counter-rotated points back into an image plane to provide a set of transformed points. A candidate rotation which provides a best match between the set of transformed points and the locations of the selected points in the image plane is selected.

Abstract: An auto-exposure module determines a first set of exposure parameters to acquire a first image. The first image is acquired using the first set of exposure parameters. The module determines a target image histogram; calculates an image histogram based on intensity values of the pixels of the first image; determines an integral of the image histogram and of the target image histogram for a range of pixel intensity values; calculates a transfer curve for transforming the integral of the image histogram to match the integral of the target image histogram; calculates a slope of a line fitting at least a portion of the transfer curve; determines a correction factor based on the calculated slope; and adjusts the first set of exposure parameters according to the correction factor. A second image is then acquired using the adjusted first set of exposure parameters.

Abstract: A method for reducing camera motion blur comprises, before acquiring an image frame for a video stream, a camera measurement unit measuring data related to a camera module motion during a time window; determining camera module motion based on the measured data and predicting a camera motion blur during acquisition of the image frame based at least on the determined camera module motion and the lens projection model; determining whether the predicted camera motion blur exceeds a threshold; in response to determining that the predicted camera motion blur exceeds the threshold, determining a reduction of the provisional exposure time determined to acquire the image frame so that the predicted camera motion blur reaches the threshold, determining whether a corresponding increase in the provisional gain determined to acquire the image frame is below a maximum gain value, adjusting the provisional exposure time and gain, and acquiring the image frame.

Abstract: A method for calibrating a vehicle cabin camera having: a pitch, yaw and roll angle; and a field of view capturing vehicle cabin features which are symmetric about a vehicle longitudinal axis comprises: selecting points from within an image of the vehicle cabin and projecting the points onto a 3D unit circle in accordance with a camera projection model. For each of one or more rotations of a set of candidate yaw and roll rotations, the method comprises: rotating the projected points with the rotation; flipping the rotated points about a pitch axis; counter-rotating the projected points with an inverse of the rotation; and mapping the counter-rotated points back into an image plane to provide a set of transformed points. A candidate rotation which provides a best match between the set of transformed points and the locations of the selected points in the image plane is selected.

Abstract: A system for generating motion blur comprises: a frame camera, an event camera and an accumulator for accumulating event information from a plurality of events occurring within a window around the exposure time of an image frame in a plurality of event frames. A processor determines from the events in at least a first of the plurality of event frames, one or more areas of movement within the field of view of the event camera; determines from the events in at least a second of the plurality of event frames, a direction of movement for the one or more areas of movement; and applies blur in one or more areas of the image frame corresponding to the one or more determined areas of movement in accordance with at least the direction of movement for each of the one or more areas of movement to produce a blurred image.

Abstract: Techniques and arrangements that utilize speckle imaging and autocorrelation to estimate the PSF of an image sensor for a digital imaging apparatus, e.g., a camera or a scanner. In particular, a system of components described herein is a simple arrangement that does not require a complex setup. Therefore, the system is portable and easy to set up. Additionally, by utilizing autocorrelation, the calculations of PSF using data obtained by the system are simplified.

Abstract: A vehicle occupant monitoring system, OMS, comprises an image acquisition device with a rolling shutter image sensor configured to selectively operate in either: a full-resolution image mode where an image frame corresponding to the full image sensor is provided; or a region of interest, ROI, mode, where an image frame corresponding to a limited portion of the image sensor is provided. An object detector is configured to receive a full-resolution image from the image sensor and to identify a ROI corresponding to an object of interest within the image. A controller is configured to obtain an image corresponding to the ROI from the image sensor operating in ROI mode, the image having an exposure time long enough for all rows of the ROI to be illuminated by a common pulse of light from at least one infra-red light source and short enough to limit motion blur within the image.

Abstract: A vehicle occupant monitoring system, OMS, comprises: an image acquisition device comprising an image sensor and a lens assembly having a varying transmissivity across a field of view of the image sensor; at least one infra-red, IR, light source disposed within a cabin of the vehicle and being configured to illuminate at least one occupant of the vehicle with varying illumination across the field of view of the image sensor; and an image processing pipeline configured to obtain and pre-process an image acquired from the image sensor in accordance with a lens shading map and a cabin illumination map in order to compensate for both the varying transmissivity and the varying illumination in order to provide a more uniformly illuminated image to a controller for further analysis.

Abstract: A depth sensing camera system that comprises one or more fisheye lenses and infrared and/or near-infrared image sensors. In some examples, the image sensors may generate output signals based at least in part on receiving radiation via the fisheye lenses. A depth measurement may be calculated based at least in part on the output signals. For example, these output signals may be provided as input to a depth model, which may determine the depth measurement. In some examples, such a depth model may be integrated into an application-specific integrated circuit and/or may be operated by an application processor.

Abstract: A method for reducing camera motion blur comprises, before acquiring an image frame for a video stream, a camera measurement unit measuring data related to a camera module motion during a time window; determining camera module motion based on the measured data and predicting a camera motion blur during acquisition of the image frame based at least on the determined camera module motion and the lens projection model; determining whether the predicted camera motion blur exceeds a threshold; in response to determining that the predicted camera motion blur exceeds the threshold, determining a reduction of the provisional exposure time determined to acquire the image frame so that the predicted camera motion blur reaches the threshold, determining whether a corresponding increase in the provisional gain determined to acquire the image frame is below a maximum gain value, adjusting the provisional exposure time and gain, and acquiring the image frame.

Abstract: A method for reducing camera motion blur comprises, before acquiring an image frame for a video stream, a camera measurement unit measuring data related to a camera module motion during a time window; determining camera module motion based on the measured data and predicting a camera motion blur during acquisition of the image frame based at least on the determined camera module motion and the lens projection model; determining whether the predicted camera motion blur exceeds a threshold; in response to determining that the predicted camera motion blur exceeds the threshold, determining a reduction of the provisional exposure time determined to acquire the image frame so that the predicted camera motion blur reaches the threshold, determining whether a corresponding increase in the provisional gain determined to acquire the image frame is below a maximum gain value, adjusting the provisional exposure time and gain, and acquiring the image frame.

Abstract: A vehicle occupant monitoring system, OMS, comprises an image acquisition device with a rolling shutter image sensor comprising an array of sub-pixels which are respectively selectively sensitive to: red and infra-red; blue and infra-red; and green and infra-red light. The device is configured to selectively operate in either: a colour mode where a multi-plane image frame corresponding to the full image sensor is provided, each plane derived from red, green or blue sensitive sub-pixels respectively; or a monochrome mode, where sensor information from sub-pixels is aggregated to provide a single image plane.

Abstract: An auto-exposure module determines a first set of exposure parameters to acquire a first image. The first image is acquired using the first set of exposure parameters. The module determines a target image histogram; calculates an image histogram based on intensity values of the pixels of the first image; determines an integral of the image histogram and of the target image histogram for a range of pixel intensity values; calculates a transfer curve for transforming the integral of the image histogram to match the integral of the target image histogram; calculates a slope of a line fitting at least a portion of the transfer curve; determines a correction factor based on the calculated slope; and adjusts the first set of exposure parameters according to the correction factor. A second image is then acquired using the adjusted first set of exposure parameters.

Abstract: A vehicle occupant monitoring system, OMS, comprises an image acquisition device with a rolling shutter image sensor configured to selectively operate in either: a full-resolution image mode where an image frame corresponding to the full image sensor is provided; or a region of interest, ROI, mode, where an image frame corresponding to a limited portion of the image sensor is provided. An object detector is configured to receive a full-resolution image from the image sensor and to identify a ROI corresponding to an object of interest within the image. A controller is configured to obtain an image corresponding to the ROI from the image sensor operating in ROI mode, the image having an exposure time long enough for all rows of the ROI to be illuminated by a common pulse of light from at least one infra-red light source and short enough to limit motion blur within the image.

Abstract: A vehicle occupant monitoring system, OMS, comprises: an image acquisition device comprising an image sensor and a lens assembly having a varying transmissivity across a field of view of the image sensor; at least one infra-red, IR, light source disposed within a cabin of the vehicle and being configured to illuminate at least one occupant of the vehicle with varying illumination across the field of view of the image sensor; and an image processing pipeline configured to obtain and pre-process an image acquired from the image sensor in accordance with a lens shading map and a cabin illumination map in order to compensate for both the varying transmissivity and the varying illumination in order to provide a more uniformly illuminated image to a controller for further analysis.

Abstract: A vehicle occupant monitoring system, OMS, comprises an image acquisition device with a rolling shutter image sensor comprising an array of sub-pixels which are respectively selectively sensitive to: red and infra-red; blue and infra-red; and green and infra-red light. The device is configured to selectively operate in either: a colour mode where a multi-plane image frame corresponding to the full image sensor is provided, each plane derived from red, green or blue sensitive sub-pixels respectively; or a monochrome mode, where sensor information from sub-pixels is aggregated to provide a single image plane.

Abstract: A method for reducing camera motion blur comprises, before acquiring an image frame for a video stream, a camera measurement unit measuring data related to a camera module motion during a time window; determining camera module motion based on the measured data and predicting a camera motion blur during acquisition of the image frame based at least on the determined camera module motion and the lens projection model; determining whether the predicted camera motion blur exceeds a threshold; in response to determining that the predicted camera motion blur exceeds the threshold, determining a reduction of the provisional exposure time determined to acquire the image frame so that the predicted camera motion blur reaches the threshold, determining whether a corresponding increase in the provisional gain determined to acquire the image frame is below a maximum gain value, adjusting the provisional exposure time and gain, and acquiring the image frame.