Abstract: Systems and techniques are described for imaging. An imaging system includes an image sensor with a plurality of photodetectors, grouped into a first group of photodetectors and a second group of photodetectors. The imaging system can reset its image sensor. The imaging system exposes its image sensor to light from a scene. The plurality of photodetectors convert the light into charge. The imaging system stores analog photodetector signals corresponding to the charge from each the photodetectors. The imaging system reads first digital pixel data from a first subset of the analog photodetector signals corresponding to the first group of photodetectors without reading second digital pixel data from a second subset of the analog photodetector signals corresponding to the second group of photodetectors. The imaging system generates an image of the scene using the first digital pixel data.

Abstract: This disclosure provides systems, methods, and devices for image signal processing. In a first aspect, a method of image processing includes controlling an image sensor to capture image data for determining a standard dynamic range (SDR) representation of a scene, the image data comprising a first series of image frames captured with a first exposure level and a second series of image frames captured at a second exposure level. The SDR representation of the scene may be generated by determining a first output image frame based on at least a first image frame of the first series of image frames. Determining of an exposure level for the image sensor during the SDR image capture may be based on a second image frame of the second series of image frames captured by the image sensor in a multi-frame sensor configuration. Other aspects and features are also claimed and described.

Abstract: Systems and techniques are provided for processing images. For example, a process can include obtaining a first color image including first one or more pixels from a first image sensor and obtaining a second color image including second one or more pixels from a second sensor, the second color image including infrared (IR) information from a second image sensor. The process can include determining a transformation between colors associated with the first one or more pixels and colors associated with the second one or more pixels based on a comparison associated with the first one or more pixels and the second one or more pixels. The process can include generating a color corrected image at least in part by transforming the second color image including IR information to a color corrected image based on the determined transformation.

Abstract: Image frames for computational photography may be corrected, such as through rolling shutter correction (RSC), prior to fusion of the image frames to reduce wobble and jitter artifacts present in a video sequence of HDR-enhanced image frames. First and second motion data regarding motion of the image capture device may be determined for times corresponding to the capturing of the first and second image frames, respectively. The rolling shutter correction (RSC) may be applied to the first and second image frames based on both the first and second motion data. The corrected first and second image frames may then be aligned and fused to obtain a single output image frame with higher dynamic range than either of the first or second image frames.

Abstract: Systems and techniques are described for imaging. An imaging system includes an image sensor with a plurality of photodetectors, grouped into a first group of photodetectors and a second group of photodetectors. The imaging system can reset its image sensor. The imaging system exposes its image sensor to light from a scene. The plurality of photodetectors convert the light into charge. The imaging system stores analog photodetector signals corresponding to the charge from each the photodetectors. The imaging system reads first digital pixel data from a first subset of the analog photodetector signals corresponding to the first group of photodetectors without reading second digital pixel data from a second subset of the analog photodetector signals corresponding to the second group of photodetectors. The imaging system generates an image of the scene using the first digital pixel data.

Abstract: Apparatus for generating images using a mechanical infrared cut-off switch are disclosed herein. An example apparatus including an optical system for generating images includes a mechanical infrared light filter movable between a first position and a second position. The mechanical infrared light filter may be configured to allow infrared light to pass through the optical system while in the first position and configured to filter out infrared light from the optical system while in the second position. The example apparatus also includes an imaging sensor including imaging pixels and infrared pixels, and may be configured to receive light from the optical system. Additionally, the example apparatus includes a processor configured to receive visible light data and infrared light data from the image sensor. The processor may further be configured to generate a combined image based on the visible light data and the infrared light data.

Abstract: Systems, methods, and computer-readable media are provided for low power, variable focus. An example method can include obtaining, based on a trigger, a first image of a scene captured by an image sensor, the first image being captured with a lens of the image sensor in a first configuration of a plurality of available lens configurations; determining, based on the first image and a first detection result, whether an object of interest is present in the first image; in response to determining that the object of interest is not present in the first image, adjusting the lens to a second configuration selected from the plurality of lens configurations; obtaining, by the image sensor, a second image of the scene while the lens is in the second configuration; and determining, based on the second image and a second detection result, that the object of interest is present in the second image.

Abstract: Image frames for computational photography may be corrected, such as through rolling shutter correction (RSC), prior to fusion of the image frames to reduce wobble and jitter artifacts present in a video sequence of HDR-enhanced image frames. First and second motion data regarding motion of the image capture device may be determined for times corresponding to the capturing of the first and second image frames, respectively. The rolling shutter correction (RSC) may be applied to the first and second image frames based on both the first and second motion data. The corrected first and second image frames may then be aligned and fused to obtain a single output image frame with higher dynamic range than either of the first or second image frames.

Abstract: Techniques and systems are provided for processing image data. For example, an image signal processor can obtain (e.g., from a host processor) a first setting change indicator value indicating a change in parameter settings of the image signal processor. The image signal processor can obtain an image frame from an image sensor, and can determine a second setting change indicator value from the image frame. The second setting change indicator value can be provided to the image sensor from the host processor. The second setting change indicator value indicates a change in parameter settings of the image sensor. The image signal processor can compare the first setting change indicator value to the second setting change indicator value, and can determine whether to process the image frame or to drop the image frame based on comparing the first setting change indicator value to the second setting change indicator value.

Abstract: Techniques and systems are provided for processing image data. For example, an image signal processor can obtain (e.g., from a host processor) a first setting change indicator value indicating a change in parameter settings of the image signal processor. The image signal processor can obtain an image frame from an image sensor, and can determine a second setting change indicator value from the image frame. The second setting change indicator value can be provided to the image sensor from the host processor. The second setting change indicator value indicates a change in parameter settings of the image sensor. The image signal processor can compare the first setting change indicator value to the second setting change indicator value, and can determine whether to process the image frame or to drop the image frame based on comparing the first setting change indicator value to the second setting change indicator value.

Abstract: Apparatus for generating images using a mechanical infrared cut-off switch are disclosed herein. An example apparatus including an optical system for generating images includes a mechanical infrared light filter movable between a first position and a second position. The mechanical infrared light filter may be configured to allow infrared light to pass through the optical system while in the first position and configured to filter out infrared light from the optical system while in the second position. The example apparatus also includes an imaging sensor including imaging pixels and infrared pixels, and may be configured to receive light from the optical system. Additionally, the example apparatus includes a processor configured to receive visible light data and infrared light data from the image sensor. The processor may further be configured to generate a combined image based on the visible light data and the infrared light data.

Abstract: Techniques and systems are provided for providing a rendering engine model for raw media data. In some examples, a system obtains media data captured by a data capturing device and embeds, in a media item containing the media data, a rendering engine model including a description of a neural network configured to process the media data and generate a particular media data output, the description defining a neural network architecture for the neural network. The system then outputs the media item with the rendering engine model embedded in the media item, the rendering engine model indicating how to execute the neural network to process the media data in the media item and generate the particular media data output based on the description of the neural network.

Abstract: A capsule endoscopic system is disclosed, where the system comprises a capsule device and a docking device. The capsule device comprises a battery, a secondary coil, and a capsule housing to enclose the battery and the secondary coil in a sealed environment, where the capsule device consists of a first end and a second end in a longitudinal direction of the capsule device, and the battery is located in proximity to the first end and the secondary coil is located in proximity to the second end. The docking device comprises an opening on the docking device, a primary coil to generate an alternating magnetic field, and a primary core. The capsule endoscopic system is arranged so that at least a portion of the secondary coil is enclosed by the primary coil and the battery is outside the primary coil when the capsule device is at the docked position.

Abstract: A capsule endoscopic system is disclosed, where the system comprises a capsule device and a docking device. The capsule device comprises a battery, a secondary coil, and a capsule housing to enclose the battery and the secondary coil in a sealed environment, where the capsule device consists of a first end and a second end in a longitudinal direction of the capsule device, and the battery is located in proximity to the first end and the secondary coil is located in proximity to the second end. The docking device comprises an opening on the docking device, a primary coil to generate an alternating magnetic field, and a primary core. The capsule endoscopic system is arranged so that the primary coil is wrapped around at least a portion of the primary core.

Abstract: In general, techniques are described regarding a combined monochrome and chromatic camera sensor. A camera comprising a camera sensor and a processor may be configured to perform the techniques. The camera sensor may include pixel sensors, monochrome filters disposed over a first subset of the pixel sensors, and color filters disposed over a second subset of the pixel sensors. The first subset of the pixel sensors may be configured to capture a monochrome image of a scene. The second subset of the pixel sensors may be configured to capture, concurrently with the capture of the monochrome image, a color image of the scene, where a number of the first subset of the pixel sensors is greater than a number of the second subset of the pixel sensors. The processor may be configured to process the monochrome image and the color image to obtain an enhanced color image of the scene.

Abstract: Systems and methods for synchronizing frame captures for cameras with different fields of capture are described. An example device includes a first camera and second camera. The first camera includes a first camera sensor and a first rolling shutter. The first camera is configured to prevent scanning pixels from a first row to a row n of the first camera sensor and configured to begin sequentially scanning pixels of the row n of the first camera sensor. The second camera includes a second camera sensor and a second rolling shutter. The second camera is configured to begin sequentially scanning pixels of a first row of the second camera sensor concurrently with beginning to sequentially scan pixels of the row n of the first camera sensor. The first row of the second camera sensor corresponds to a row within a predefined number of rows after the first camera sensor's row n.

Abstract: Techniques and systems are provided for providing a rendering engine model for raw media data. In some examples, a system obtains media data captured by a data capturing device and embeds, in a media item containing the media data, a rendering engine model including a description of a neural network configured to process the media data and generate a particular media data output, the description defining a neural network architecture for the neural network. The system then outputs the media item with the rendering engine model embedded in the media item, the rendering engine model indicating how to execute the neural network to process the media data in the media item and generate the particular media data output based on the description of the neural network.

Abstract: A capsule endoscopic system is disclosed, where the system comprises a capsule device and a docking device. The capsule device comprises a battery, a secondary coil, an optical transmitter all enclosed in a capsule housing. The docking device comprises a primary coil to generate an alternating magnetic field, a primary core and optical receiver to receive an optical signal. The alternating magnetic field is coupled to the secondary coil to supply power to the capsule device when the capsule device is at a docked position in the docking device. The primary core is arranged to concentrate the alternating magnetic field on the secondary coil when the capsule device is at the docked position. Furthermore, the capsule endoscopic system is arranged so that an optical path is formed between the optical transmitter and the optical receiver when the capsule device is at the docked position.

Abstract: Systems and methods for synchronizing frame captures for cameras with different fields of capture are described. An example device includes a first camera and second camera. The first camera includes a first camera sensor and a first rolling shutter. The first camera is configured to prevent scanning pixels from a first row to a row n of the first camera sensor and configured to begin sequentially scanning pixels of the row n of the first camera sensor. The second camera includes a second camera sensor and a second rolling shutter. The second camera is configured to begin sequentially scanning pixels of a first row of the second camera sensor concurrently with beginning to sequentially scan pixels of the row n of the first camera sensor. The first row of the second camera sensor corresponds to a row within a predefined number of rows after the first camera sensor's row n.

Abstract: In general, techniques are described regarding a combined monochrome and chromatic camera sensor. A camera comprising a camera sensor and a processor may be configured to perform the techniques. The camera sensor may include pixel sensors, monochrome filters disposed over a first subset of the pixel sensors, and color filters disposed over a second subset of the pixel sensors. The first subset of the pixel sensors may be configured to capture a monochrome image of a scene. The second subset of the pixel sensors may be configured to capture, concurrently with the capture of the monochrome image, a color image of the scene, where a number of the first subset of the pixel sensors is greater than a number of the second subset of the pixel sensors. The processor may be configured to process the monochrome image and the color image to obtain an enhanced color image of the scene.