Abstract: This disclosure provides systems, methods, and devices for image processing that support improved image quality from reduced artifacts and wobbles. In a first aspect, a method of image processing includes receiving motion data regarding movement of a mobile device; determining a first image sensor configuration based on the motion data; and configuring an image sensor with the first image sensor configuration. Other aspects and features are also claimed and described.

Abstract: The present disclosure generally relates to exposure control for image capture devices. One example method generally includes receiving sensor data indicating a movement associated with an image capture device capturing a first frame and a second frame, wherein the first frame is associated with a higher exposure setting as compared to the second frame; predicting, based on the sensor data, a shift for aligning one or more features of the first frame and one or more features of the second frame; applying the shift to align the one or more features of the first frame and the one or more features of second frame; and generating a frame output at least in part by combining at least a portion of the first frame with at least a portion of the second frame.

Abstract: The present disclosure generally relates to exposure control for image capture devices. One example method generally includes receiving sensor data indicating a movement associated with an image capture device capturing a first frame and a second frame, wherein the first frame is associated with a higher exposure setting as compared to the second frame; predicting, based on the sensor data, a shift for aligning one or more features of the first frame and one or more features of the second frame; applying the shift to align the one or more features of the first frame and the one or more features of second frame; and generating a frame output at least in part by combining at least a portion of the first frame with at least a portion of the second frame.

Abstract: Image frames for computational photography may be corrected, such as through rolling shutter correction (RSC), prior to fusion of the image frames to reduce wobble and jitter artifacts present in a video sequence of HDR-enhanced image frames. First and second motion data regarding motion of the image capture device may be determined for times corresponding to the capturing of the first and second image frames, respectively. The rolling shutter correction (RSC) may be applied to the first and second image frames based on both the first and second motion data. The corrected first and second image frames may then be aligned and fused to obtain a single output image frame with higher dynamic range than either of the first or second image frames.

Abstract: An imaging system receives depth data (corresponding to an environment) from a depth sensor and first image data (a depiction of the environment) from an image sensor. The imaging system generates, based on the depth data, first motion vectors corresponding to a change in perspective of the depiction of the environment in the first image data. The imaging system generates, using grid inversion based on the first motion vectors, second motion vectors that indicate respective distances moved by respective pixels of the depiction of the environment in the first image data for the change in perspective. The imaging system generates second image data by modifying the first image data according to the second motion vectors. The second image data includes a second depiction of the environment from a different perspective than the first image data. Some image reprojection applications (e.g., frame interpolation) can be performed without the depth data.

Abstract: Image frames for computational photography may be corrected, such as through rolling shutter correction (RSC), prior to fusion of the image frames to reduce wobble and jitter artifacts present in a video sequence of HDR-enhanced image frames. First and second motion data regarding motion of the image capture device may be determined for times corresponding to the capturing of the first and second image frames, respectively. The rolling shutter correction (RSC) may be applied to the first and second image frames based on both the first and second motion data. The corrected first and second image frames may then be aligned and fused to obtain a single output image frame with higher dynamic range than either of the first or second image frames.

Abstract: Digital image stabilization (DIS) may be implemented in image capture devices to address some or all above problems of local stabilization and in-frame distortions alone or in combination with electronic image stabilization (EIS) to reduce artifacts, shake leftovers, and other problems resulting from insufficient global stabilization. DIS may use image sensor motion data derived from image-based information, such as motion vectors between frames, to modify captured image data to generate corrected image frames having improved global stabilization and reduced distortion artifacts and shake leftovers resulting from camera motion. The image sensor motion data may be used in combination with non-image sensor motion data, such as data from a gyroscope an optical image stabilization (OIS) device, a magnetometer, an accelerometer, and/or auto-focus (AF) feedback to perform image stabilization. Image sensor motion data may be used to determine a translation (e.g.

Abstract: Techniques and systems are provided for processing one or more frames or images. For instance, a process for determining exposure for one or more frames includes obtaining a motion map for one or more frames. The process includes determining, based on the motion map, motion associated with the one or more frames of a scene. The motion corresponds to movement of one or more objects in the scene relative to a camera used to capture the one or more frames. The process includes determining, based on the determined motion, a number of frames and an exposure for capturing the number of frames. The process further includes sending a request to capture the number of frames using the determined exposure duration.

Abstract: Techniques and systems are provided for machine-learning based image stabilization. In some examples, a system obtains a sequence of frames captured by an image capture device during a period of time, and collects motion sensor measurements calculated by a motion sensor associated with the image capture device based on movement of the image capture device during the period of time. The system generates, using a deep learning network and the motion sensor measurements, parameters for counteracting motions in one or more frames in the sequence of frames, the motions resulting from the movement of the image capture device during the period of time. The system then adjusts the one or more frames in the sequence of frames according to the parameters to generate one or more adjusted frames having a reduction in at least some of the motions in the one or more frames.

Abstract: Example are described for combining optical image stabilization and electronic image stabilization for capture and processing of frames for video. An example device configured to perform electronic image stabilization in light of optical image stabilization performed may include a memory and one or more processors. The one or more processors may be configured to obtain optical image stabilization (OIS) information for OIS performed during capture of a sequence of frames by an image sensor and determine an electronic image stabilization (EIS) filter based on the OIS information. The one or more processors may also be configured to obtain camera position information, and the EIS filter may also be based on the camera position information. The one or more processors may also configure an image signal processor to perform EIS based on the EIS filter.

Abstract: Techniques and systems are provided for machine-learning based image stabilization. In some examples, a system obtains a sequence of frames captured by an image capture device during a period of time, and collects motion sensor measurements calculated by a motion sensor associated with the image capture device based on movement of the image capture device during the period of time. The system generates, using a deep learning network and the motion sensor measurements, parameters for counteracting motions in one or more frames in the sequence of frames, the motions resulting from the movement of the image capture device during the period of time. The system then adjusts the one or more frames in the sequence of frames according to the parameters to generate one or more adjusted frames having a reduction in at least some of the motions in the one or more frames.

Abstract: Techniques and systems are provided for machine-learning based image stabilization. In some examples, a system obtains a sequence of frames captured by an image capture device during a period of time, and collects motion sensor measurements calculated by a motion sensor associated with the image capture device based on movement of the image capture device during the period of time. The system generates, using a deep learning network and the motion sensor measurements, parameters for counteracting motions in one or more frames in the sequence of frames, the motions resulting from the movement of the image capture device during the period of time. The system then adjusts the one or more frames in the sequence of frames according to the parameters to generate one or more adjusted frames having a reduction in at least some of the motions in the one or more frames.

Abstract: Techniques and systems are provided for machine-learning based image stabilization. In some examples, a system obtains a sequence of frames captured by an image capture device during a period of time, and collects motion sensor measurements calculated by a motion sensor associated with the image capture device based on movement of the image capture device during the period of time. The system generates, using a deep learning network and the motion sensor measurements, parameters for counteracting motions in one or more frames in the sequence of frames, the motions resulting from the movement of the image capture device during the period of time. The system then adjusts the one or more frames in the sequence of frames according to the parameters to generate one or more adjusted frames having a reduction in at least some of the motions in the one or more frames.