Abstract: Method for leveraging battery residue energy and a capsule endoscope using the method are disclosed. The capsule endoscope is capable of performing one or more functions at a first throughput or a first peak current when the battery has sufficient energy. According to this method, whether the battery energy is sufficient is determined. Upon determining the battery energy being insufficient, at least one function of the one or more functions is performed at a second throughput lower than the first throughput, or at least one function of the one or more functions is switched to another function requiring a second peak current lower than the first peak current.

Abstract: A method of processing images captured using an endoscope comprising a camera is disclosed. According to this method, regular images captured by the camera are received while the endoscope travels through a human gastrointestinal (GI) tract. The regular images are mosaicked to determine any missed or insufficiently imaged area in a section of the human GI tract already travelled by the endoscope. If any missed or insufficiently imaged area is detected, information regarding any missed or insufficiently imaged area is provided. When a target area in the regular images is lack of parallax, the target area is determined as one missed area and an edge corresponding to a structure of the human lumen is highlighted. For a capsule endoscope, the endoscope can be configured to be controlled or steered to move so as to re-image the missed or insufficiently imaged area.

Abstract: A method and apparatus for sharpening gastrointestinal (GI) images are disclosed. A target distance between the target region and the imaging apparatus is determined for a target region in the regular image. One or more filter parameters of a de-blurring filter are selected from stored filter parameters according to the target distance. A processed target region is generated by applying the de-blurring filter to the target region to improve sharpness of the target region. A method for characterizing an imaging apparatus is also disclosed. The imaging apparatus is placed under a controlled environment. Test pictures for one or more test patterns are captured at multiple test distances in a range including a focus distance using the imaging apparatus. One or more parameters associated a target point spread function are determined from each test picture for characterizing image formation of the imaging apparatus at the selected distance.

Abstract: A capsule endoscopic device with movement control is disclosed. The capsule endoscopic device comprises a capsule housing, one or more electrodes disposed fixedly through the capsule housing, a signal generation/signal driver unit, an interface circuit and a switch module. The electrodes apply electrical stimulus to living body tissue in a patient's gastrointestinal track. The signal generation/signal driver unit generates the electrical stimulus for the electrodes. The switch module is coupled to the electrodes, the signal generation/signal driver unit and the interface circuit. Furthermore, the switch module is configured to connect the electrodes to the signal generation/signal driver unit or the interface circuit depending on an operation mode. The switch module, the signal generation/signal driver unit and the interface circuit are inside the capsule housing.

Abstract: A method and system for determining a travelled distance by a capsule camera are disclosed. A current global motion vector for a current image in the image sequence is determined, where the current global motion vector corresponds to movement made by the capsule camera between the current image and a reference image associated with the image sequence. A travelled distance by the capsule camera in the GI tract is determined according to the current global motion vector and prior global motion vectors derived for prior images between an initial image and the current image, where the travelled distance is measured from an initial location associated with the initial image to a current location associated with the current image. A method and system for displaying an image sequence captured by a capsule camera are also disclosed. The travelled distances associated with the image sequence are displayed on a display.

Abstract: A display device includes (a) a non-volatile memory containing corrective data for compensating input image data received; (b) display hardware receiving control and data signals for displaying an image; and (c) an image processing circuit that retrieves the corrective data from the non-volatile memory to generate the data signals for the display hardware, after applying the corrective data to each color component of each pixel in the input image data.

Abstract: A method and device for improving the accuracy of depth information derived from a structured-light image for a regular image are disclosed. In one example, an additional structured-light image is captured before a first structured-light image or after a regular image. The depth information for the regular image can be derived from the first structured-light image and corrected by incorporating depth information from the additional structured-light image. A model for depth information can be used to predict or interpolate depth information for the regular image. In another example, two regular sub-images may be captured with a structured-light image in between. If substantial frame differences or substantial global motion vector/block motion vectors are detected, the two regular sub-images will not be combined in order to avoid possible motion smear. Instead, one of the two sub-images will be selected and scaled as the output regular image.

Abstract: An integrated image sensor for capturing a mixed structured-light image and regular image using an integrated image sensor are disclosed. The integrated image sensor comprises a pixel array, one or more output circuits, one or more analog-to-digital converters, and one or more timing and control circuits. The timing and control circuits are arranged to perform a set of actions including capturing a regular image and a structured-light image. According to the present invention, the structured-light image captured before or after the regular image is used to derive depth or shape information for the regular image. An endoscope based on the above integrated image sensor is also disclosed. The endoscope may comprises a capsule housing adapted to be swallowed, where the components of integrated image sensor, a structured light source and a non-structured light source are enclosed and sealed in the capsule housing.

Abstract: An in vivo endoscope illuminates tissue using multiple sources. Light from a short-range source exits a tubular wall of the endoscope through a first illumination region that overlaps an imaging region, and the light returns through the imaging region after reflection by tissue, to form an image in a camera. Light from a long-range source exits the tubular wall through a second illumination region that does not overlap the imaging region. The endoscope of some embodiments includes a mirror, and light from an emitter for the short-range source is split and reaches the first illumination region from both sides of an optical axis of the camera. Illuminating the first illumination region with split fractions of light results in greater uniformity of illumination, than illuminating directly with an un-split beam. The energy generated by each source is changed depending on distance of the tissue to be imaged.

Abstract: An integrated image sensor circuit with multiple power modes is disclosed. The integrated circuit comprises a pixel array, an analog block to process analog signal associated with the pixel array, where the analog block comprises an analog to digital convertor (ADC), and a first control circuit to enable/disable the analog block or to configure the analog block to a high/low-power mode depending on whether the pixel array is in a readout frame or in a reset frame with no active readout. The integrated image sensor circuit may further comprise a post-processing block and a second control circuit to enable/disable the post-processing block or to configure the post-processing block to the high-power mode or the low-power mode depending on whether the pixel array is in the readout frame or in the reset frame with no active readout.

Abstract: A method of processing images captured by an in vivo capsule camera is disclosed. The images having large overlap exceeding a threshold are stitched into larger images. If the current image and none of its neighboring images has large overlap, the current image is designated as a non-stitched image. Any image, that exists between two images stitched and is not included in the stitched image, is also designated as a non-stitched image. The large-overlap stitching can be performed on the images iteratively by treating the stitched images and non-stitched image as to be processed images in the next round. A second stage stitching can be applied to stitch small-overlap images. The small-overlap image stitching can also be applied iteratively. A third stage stitching can be further applied to stitch the output images from the second stage processing.

Abstract: A method characterizes manufacturing imperfections in a camera and variations in its operating environment to allow images captured by the camera to be compensated for these defects. The method includes: (a) illuminating a field of view of the optical elements under a controlled condition; (b) exposing multiple images onto the image sensor under the controlled condition; (c) extracting from the multiple images parameter values for pixels of the image sensor; and (d) compensating images taken subsequently in the camera using the parameter values. The controlled condition includes an external light source for illumination, and the image sensor is sensitive to color components.

Abstract: A method and system for displaying images captured by an in vivo imaging device are disclosed. Embodiments according to the present invention display image sequence data in a first display area. When a first annotated image is displayed in the first display area, a first thumbnail image in a second display area corresponding to the first annotated image is replaced to indicate an occurring correspondence between the first annotated image and the first thumbnail image corresponding to the first annotated image being displayed. In one embodiment, the method further comprises displaying the first thumbnail image in the second display area when one other image of the image sequence data is displayed in the first display area after the first annotated image is displayed.

Abstract: A method for transmitting data to a camera without requiring in the camera a conventional wireless transmission capability includes (a) in the camera's field of view, providing an object which forms an image on which the data is encoded; (b) capturing an image of the object using optics of the camera; and (c) recovering the data from the image of the object. The data is encoded by an optically detectable quantity (e.g., light intensity or color) or a pattern in one or more portions of the object. The data can be carried by the distribution of the optically detectable quantity within the image or its derivative. The field of view of the camera may be divided into multiple sub-areas to allow providing multiple data-bearing images. A sequence of such images may be used to increase the amount of data that can be transmitted in this manner.

Abstract: A camera system uses one or more image sensor IC chips each having multiple pixel arrays on the same semiconductor substrate (i.e., “multiple pixel arrays on a chip”). In one embodiment, such a camera system includes: (a) optical components that create multiple images in close physical proximity of each other (e.g., within a few millimeters or centimeters); and (b) a single sensor substrate (“chip”) containing multiple 2-dimensional pixel arrays that are aligned to capture these multiple images, so as to convert the multiple images into electrical signal. The pixel arrays can be manufactured using a CCD or a CMOS compatible process. For manufacturing reasons, such a chip is typically two centimeters or less on a side. However, large chips can also be made. Optional electronic components for further signal processing of the captured images may be formed either on the sensor chip (i.e., in a “system-on-a-chip” implementation), or in a separate back-end application specific integrated circuit (ASIC).

Abstract: An integrated image sensor circuit with multiple power modes is disclosed. The integrated circuit comprises a pixel array, an analog block to process analog signal associated with the pixel array, where the analog block comprises an analog to digital convertor (ADC), and a first control circuit to enable/disable the analog block or to configure the analog block to a high/low-power mode depending on whether the pixel array is in a readout frame or in a reset frame with no active readout. The integrated image sensor circuit may further comprise a post-processing block and a second control circuit to enable/disable the post-processing block or to configure the post-processing block to the high-power mode or the low-power mode depending on whether the pixel array is in the readout frame or in the reset frame with no active readout.

Abstract: A multiple capsule camera apparatus is disclosed to enhance the rate of detection and/or extend the overall imaging period. The multiple capsule camera apparatus coordinates the operations of the camera according to a schedule so that one camera may enter an active mode when the other camera is anticipated to have a low battery level. The capsule cameras may also coordinate their operations by communication with each other through a wireless link. A base station may also be used to coordinate the capsule camera operations with a wireless link established between the base station and each capsule camera.

Abstract: A method for detecting a capsule camera entering into or exiting the GI tract, includes (a) taking a first test image under the condition that an illumination system of the capsule camera is disabled; (b) taking a second test image under the same condition as the first test image; (c) comparing selected corresponding pixel values of the first test image and the second test image to determine if a significant change in pixel values has occurred; and (d) upon detecting the significant change in pixel values, determining if the capsule camera has entered or exited the GI tract, and performing operations appropriate to follow such determination.

Abstract: A method characterizes manufacturing imperfections in a camera and variations in its operating environment to allow images captured by the camera to be compensated for these defects. The method includes: (a) illuminating a field of view of the optical elements under a controlled condition; (b) exposing multiple images onto the image sensor under the controlled condition; (c) extracting from the multiple images parameter values for pixels of the image sensor; and (d) compensating images taken subsequently in the camera using the parameter values. The controlled condition includes an external light source for illumination, and the image sensor is sensitive to color components.

Abstract: An in vivo endoscope illuminates tissue using multiple sources. Light from a short-range source exits a tubular wall of the endoscope through a first illumination region that overlaps an imaging region, and the light returns through the imaging region after reflection by tissue, to form an image in a camera. Light from a long-range source exits the tubular wall through a second illumination region that does not overlap the imaging region. The endoscope of some embodiments includes a mirror, and light from an emitter for the short-range source is split and reaches the first illumination region from both sides of an optical axis of the camera. Illuminating the first illumination region with split fractions of light results in greater uniformity of illumination, than illuminating directly with an un-split beam. The energy generated by each source is changed depending on distance of the tissue to be imaged.