Abstract: Systems and methods for image fusing are described. In examples, a first image of a scene may be obtained associated with a first parameter and a second image of the scene may be obtained associated with a second parameter. The first image and the second image may be fused to obtain at least one first fused image. A third image of the scene may be obtained associated with a third parameter and a fourth image of the scene may be obtained associated with a fourth image. At least one parameter associated with the third image and the fourth image used to obtain the images may be adjusted, wherein the adjustment may be based at least in part on a field of view of the at least one first fused image. The third image and the fourth image may be fused to obtain a second fused image.

Abstract: Systems and techniques are described herein for generating a composite image. For instance, a method for generating a composite image is provided. The method may include receiving first data representative of an image of a field of view from an array of photodiodes of an image sensor; receiving second data representative of an image of a region of interest within the field of view from a subset of the array of photodiodes, wherein the region of interest is smaller than the field of view, wherein the subset of the array of photodiodes within the array of photodiodes corresponds to the region of interest within the field of view, and wherein the subset of the array of photodiodes includes fewer photodiodes than the array of photodiodes; and generating a composite image of the field of view based on the first data and the second data.

Abstract: This disclosure provides systems, methods, and devices for image signal processing that support improved detail keeping in photography through increased dynamic range and/or highlight-keeping. The image signal processing may be performed on data received from a split-pixel image sensor with two sets of sensor elements with different sensitivities. The image signal processing may include receiving image data comprising: first data from a first set of sensor elements and second data from a second set of sensor elements capturing a representation of the scene with a different sensitivity that the first set of sensor elements; determining an output dynamic range for an output image frame; and determining an output image frame based on at least one of the first data and the second data and based on the output dynamic range. Other aspects and features are also claimed and described.

Abstract: This disclosure provides systems, methods, and devices for image signal processing. In a first aspect, a method of image processing includes controlling an image sensor to capture image data for determining a standard dynamic range (SDR) representation of a scene, the image data comprising a first series of image frames captured with a first exposure level and a second series of image frames captured at a second exposure level. The SDR representation of the scene may be generated by determining a first output image frame based on at least a first image frame of the first series of image frames. Determining of an exposure level for the image sensor during the SDR image capture may be based on a second image frame of the second series of image frames captured by the image sensor in a multi-frame sensor configuration. Other aspects and features are also claimed and described.

Abstract: Systems and techniques are provided for processing images. For example, a process can include obtaining a first color image including first one or more pixels from a first image sensor and obtaining a second color image including second one or more pixels from a second sensor, the second color image including infrared (IR) information from a second image sensor. The process can include determining a transformation between colors associated with the first one or more pixels and colors associated with the second one or more pixels based on a comparison associated with the first one or more pixels and the second one or more pixels. The process can include generating a color corrected image at least in part by transforming the second color image including IR information to a color corrected image based on the determined transformation.

Abstract: Systems and techniques are described for imaging. An imaging system includes an image sensor with a plurality of photodetectors, grouped into a first group of photodetectors and a second group of photodetectors. The imaging system can reset its image sensor. The imaging system exposes its image sensor to light from a scene. The plurality of photodetectors convert the light into charge. The imaging system stores analog photodetector signals corresponding to the charge from each the photodetectors. The imaging system reads first digital pixel data from a first subset of the analog photodetector signals corresponding to the first group of photodetectors without reading second digital pixel data from a second subset of the analog photodetector signals corresponding to the second group of photodetectors. The imaging system generates an image of the scene using the first digital pixel data.

Abstract: This disclosure provides systems, methods, and devices for image signal processing. In a first aspect, a method of image processing includes controlling an image sensor to capture image data for determining a standard dynamic range (SDR) representation of a scene, the image data comprising a first series of image frames captured with a first exposure level and a second series of image frames captured at a second exposure level. The SDR representation of the scene may be generated by determining a first output image frame based on at least a first image frame of the first series of image frames. Determining of an exposure level for the image sensor during the SDR image capture may be based on a second image frame of the second series of image frames captured by the image sensor in a multi-frame sensor configuration. Other aspects and features are also claimed and described.

Abstract: Systems and techniques are provided for processing images. For example, a process can include obtaining a first color image including first one or more pixels from a first image sensor and obtaining a second color image including second one or more pixels from a second sensor, the second color image including infrared (IR) information from a second image sensor. The process can include determining a transformation between colors associated with the first one or more pixels and colors associated with the second one or more pixels based on a comparison associated with the first one or more pixels and the second one or more pixels. The process can include generating a color corrected image at least in part by transforming the second color image including IR information to a color corrected image based on the determined transformation.

Abstract: Image frames for computational photography may be corrected, such as through rolling shutter correction (RSC), prior to fusion of the image frames to reduce wobble and jitter artifacts present in a video sequence of HDR-enhanced image frames. First and second motion data regarding motion of the image capture device may be determined for times corresponding to the capturing of the first and second image frames, respectively. The rolling shutter correction (RSC) may be applied to the first and second image frames based on both the first and second motion data. The corrected first and second image frames may then be aligned and fused to obtain a single output image frame with higher dynamic range than either of the first or second image frames.

Abstract: Systems and techniques are described for imaging. An imaging system includes an image sensor with a plurality of photodetectors, grouped into a first group of photodetectors and a second group of photodetectors. The imaging system can reset its image sensor. The imaging system exposes its image sensor to light from a scene. The plurality of photodetectors convert the light into charge. The imaging system stores analog photodetector signals corresponding to the charge from each the photodetectors. The imaging system reads first digital pixel data from a first subset of the analog photodetector signals corresponding to the first group of photodetectors without reading second digital pixel data from a second subset of the analog photodetector signals corresponding to the second group of photodetectors. The imaging system generates an image of the scene using the first digital pixel data.

Abstract: Apparatus for generating images using a mechanical infrared cut-off switch are disclosed herein. An example apparatus including an optical system for generating images includes a mechanical infrared light filter movable between a first position and a second position. The mechanical infrared light filter may be configured to allow infrared light to pass through the optical system while in the first position and configured to filter out infrared light from the optical system while in the second position. The example apparatus also includes an imaging sensor including imaging pixels and infrared pixels, and may be configured to receive light from the optical system. Additionally, the example apparatus includes a processor configured to receive visible light data and infrared light data from the image sensor. The processor may further be configured to generate a combined image based on the visible light data and the infrared light data.

Abstract: Systems, methods, and computer-readable media are provided for low power, variable focus. An example method can include obtaining, based on a trigger, a first image of a scene captured by an image sensor, the first image being captured with a lens of the image sensor in a first configuration of a plurality of available lens configurations; determining, based on the first image and a first detection result, whether an object of interest is present in the first image; in response to determining that the object of interest is not present in the first image, adjusting the lens to a second configuration selected from the plurality of lens configurations; obtaining, by the image sensor, a second image of the scene while the lens is in the second configuration; and determining, based on the second image and a second detection result, that the object of interest is present in the second image.

Abstract: Image frames for computational photography may be corrected, such as through rolling shutter correction (RSC), prior to fusion of the image frames to reduce wobble and jitter artifacts present in a video sequence of HDR-enhanced image frames. First and second motion data regarding motion of the image capture device may be determined for times corresponding to the capturing of the first and second image frames, respectively. The rolling shutter correction (RSC) may be applied to the first and second image frames based on both the first and second motion data. The corrected first and second image frames may then be aligned and fused to obtain a single output image frame with higher dynamic range than either of the first or second image frames.

Abstract: Techniques and systems are provided for processing image data. For example, an image signal processor can obtain (e.g., from a host processor) a first setting change indicator value indicating a change in parameter settings of the image signal processor. The image signal processor can obtain an image frame from an image sensor, and can determine a second setting change indicator value from the image frame. The second setting change indicator value can be provided to the image sensor from the host processor. The second setting change indicator value indicates a change in parameter settings of the image sensor. The image signal processor can compare the first setting change indicator value to the second setting change indicator value, and can determine whether to process the image frame or to drop the image frame based on comparing the first setting change indicator value to the second setting change indicator value.

Abstract: Techniques and systems are provided for processing image data. For example, an image signal processor can obtain (e.g., from a host processor) a first setting change indicator value indicating a change in parameter settings of the image signal processor. The image signal processor can obtain an image frame from an image sensor, and can determine a second setting change indicator value from the image frame. The second setting change indicator value can be provided to the image sensor from the host processor. The second setting change indicator value indicates a change in parameter settings of the image sensor. The image signal processor can compare the first setting change indicator value to the second setting change indicator value, and can determine whether to process the image frame or to drop the image frame based on comparing the first setting change indicator value to the second setting change indicator value.

Abstract: Apparatus for generating images using a mechanical infrared cut-off switch are disclosed herein. An example apparatus including an optical system for generating images includes a mechanical infrared light filter movable between a first position and a second position. The mechanical infrared light filter may be configured to allow infrared light to pass through the optical system while in the first position and configured to filter out infrared light from the optical system while in the second position. The example apparatus also includes an imaging sensor including imaging pixels and infrared pixels, and may be configured to receive light from the optical system. Additionally, the example apparatus includes a processor configured to receive visible light data and infrared light data from the image sensor. The processor may further be configured to generate a combined image based on the visible light data and the infrared light data.

Abstract: Techniques and systems are provided for providing a rendering engine model for raw media data. In some examples, a system obtains media data captured by a data capturing device and embeds, in a media item containing the media data, a rendering engine model including a description of a neural network configured to process the media data and generate a particular media data output, the description defining a neural network architecture for the neural network. The system then outputs the media item with the rendering engine model embedded in the media item, the rendering engine model indicating how to execute the neural network to process the media data in the media item and generate the particular media data output based on the description of the neural network.

Abstract: A capsule endoscopic system is disclosed, where the system comprises a capsule device and a docking device. The capsule device comprises a battery, a secondary coil, and a capsule housing to enclose the battery and the secondary coil in a sealed environment, where the capsule device consists of a first end and a second end in a longitudinal direction of the capsule device, and the battery is located in proximity to the first end and the secondary coil is located in proximity to the second end. The docking device comprises an opening on the docking device, a primary coil to generate an alternating magnetic field, and a primary core. The capsule endoscopic system is arranged so that at least a portion of the secondary coil is enclosed by the primary coil and the battery is outside the primary coil when the capsule device is at the docked position.

Abstract: A capsule endoscopic system is disclosed, where the system comprises a capsule device and a docking device. The capsule device comprises a battery, a secondary coil, and a capsule housing to enclose the battery and the secondary coil in a sealed environment, where the capsule device consists of a first end and a second end in a longitudinal direction of the capsule device, and the battery is located in proximity to the first end and the secondary coil is located in proximity to the second end. The docking device comprises an opening on the docking device, a primary coil to generate an alternating magnetic field, and a primary core. The capsule endoscopic system is arranged so that the primary coil is wrapped around at least a portion of the primary core.

Abstract: In general, techniques are described regarding a combined monochrome and chromatic camera sensor. A camera comprising a camera sensor and a processor may be configured to perform the techniques. The camera sensor may include pixel sensors, monochrome filters disposed over a first subset of the pixel sensors, and color filters disposed over a second subset of the pixel sensors. The first subset of the pixel sensors may be configured to capture a monochrome image of a scene. The second subset of the pixel sensors may be configured to capture, concurrently with the capture of the monochrome image, a color image of the scene, where a number of the first subset of the pixel sensors is greater than a number of the second subset of the pixel sensors. The processor may be configured to process the monochrome image and the color image to obtain an enhanced color image of the scene.