Abstract: Systems and methods are provided for identifying dark areas in images captured by encapsulated cameras or endoscopes and enhancing the visibility of the dark area using intensity stretch. For capsule or endoscope images, there are often some dark areas caused by inadequate lighting. The poor visibility of detailed features in the dark area may reduce the detection rate of anomaly. The present invention calls for a method to detect the dark area based on contour. The intensities inside and outside the dark area are evaluated and are used to generate intensity transformation to stretch intensity in the dark area while minimizing the impact on the image quality outside the dark area.

Abstract: Systems and methods are provided for capture control of video data from a capsule camera system having an on-board storage or wireless transmission. The capsule camera system moves through the GI tract under the action of peristalsis and records images of the intestinal walls. For some periods of time, the capsule camera system may move very slowly and there are little differences in the image data between different frames. These frames can be designated for discard to conserve storage space or conserve power. A capsule control processing unit is incorporated to evaluate motion metric based on image data associated with a current frame and a previous frame. A decision is made based on a profile of the motion metric to select an operation mode from a group comprising Capture Mode and Conservation Mode. The capsule camera system is then operated according to the selected operation mode.

Abstract: Systems and methods are provided for displaying images captured from a panoramic capsule camera system. The panoramic images typically have a very wide aspect ratio and may cause fatigue when viewed by a diagnostician over an extended period on a display. The images taken by a capsule camera through the GI track may take a couple of hours or more to view at a typical frame rate of 30 frames per second or whatever rate that's deemed appropriate. The present invention discloses methods and systems that divide a sequence from panoramic capsule camera into multiple member sequences and form an aggregated video. The aggregated video not only makes viewing more comfortable, but also speeds up viewing time.

Abstract: Systems and methods are provided for displaying images captured from a capsule camera system. In order to increase the efficiency of viewing the image sequence, the image sequence is divided into multiple sub-sequences and the multiple sub-sequences are displayed in multiple viewing windows on a display screen concurrently. For images from a panoramic capsule system, the images typically have a very wide aspect ratio and may require different configuration for displaying in multiple viewing windows than that for image sequence having non-wide aspect ratio. The present invention also discloses methods and systems that divide a sequence from panoramic capsule camera into multiple member sequences and form an aggregated video. The aggregated video not only makes viewing more comfortable, but also speeds up viewing time.

Abstract: A multiple capsule camera apparatus is disclosed to enhance the rate of detection and/or extend the overall imaging period. The multiple capsule camera apparatus coordinates the operations of the camera according to a schedule so that one camera may enter an active mode when the other camera is anticipated to have a low battery level. The capsule cameras may also coordinate their operations by communication with each other through a wireless link. A base station may also be used to coordinate the capsule camera operations with a wireless link established between the base station and each capsule camera.

Abstract: A method for controlling a lighting source in a capsule camera improves image quality by avoiding over-exposure or under-exposure in all regions of an image, while concurrently reducing significantly power dissipation in the capsule camera. A capsule camera using the method includes: (1) one or more sensor arrays each having one or more pixels in one or more designated regions in the field of view of the capsule camera; (2) lighting elements each providing illumination to one or more of the designated regions; and (3) a control unit that (a) extracts a parameter value from the pixels of each region; (b) evaluates the parameter value at each region; and (c) adjusts the lighting elements providing illumination to each region according to the evaluation. The parameter value may be an average value of the pixels. The purpose of the adjustment is to bring the parameter value for the region to within a predetermined range.

Abstract: Systems and methods are provided for motion detection and capture control of video data from a capsule camera system having an on-board storage. The capsule camera system moves through the GI tract under the action of peristalsis and records images of the intestinal walls. The capsule's movement is episodic and jerky. The capacity of the on-board storage is limited. In order to avoid unnecessary capture of images when the capsule camera moves very slowly or stalls, motion detection technique is utilized to help control image capture. Furthermore, an adaptive capture control is disclosed that automatically adjusts the threshold level of capture control to maintain proper image capture. The invented capture control also conserves precious battery power by eliminating capture of unnecessary images when the capsule camera moves too slowly or stalls.

Abstract: Systems and methods are provided for capture control of video data from a capsule camera system having an on-board storage or wireless transmission. The capsule camera system moves through the GI tract under the action of peristalsis and records images of the intestinal walls. For some periods of time, the capsule camera system may move very slowly and there are little differences in the image data between different frames. These frames can be designated for discard to conserve storage space or conserve power. A capsule control processing unit is incorporated to evaluate motion metric based on image data associated with a current frame and a previous frame. A decision is made based on a profile of the motion metric to select an operation mode from a group comprising Capture Mode and Conservation Mode. The capsule camera system is then operated according to the selected operation mode.

Abstract: Systems and methods are provided for environment change sensing corresponding to the capsule camera entering the colon from the small intestine. In the environment change sensing mode, the capsule camera is operated in a very low power mode by configuring the image sensor to use a small region of interest or a high sub-sampling ratio. Image data is processed to estimate the light level. The variation of light level is used to detect environment change corresponding to entering the colon from the small intestine. Alternatively, the motion metric for a current frame and a reference frame is evaluated. The characteristic of the motion metric is extracted and used to detect environment change. In another configuration, the system determines environment change based on a combination of the variation of light intensity and the characteristic of the motion metric.

Abstract: Systems and methods are provided for motion detection and capture control of video data from a capsule camera system having an on-board storage. The capsule camera system moves through the GI tract under the action of peristalsis and records images of the intestinal walls. The capsule's movement is episodic and jerky. The capacity of the on-board storage is limited. In order to avoid unnecessary capture of images when the capsule camera moves very slowly or stalls, motion detection technique is utilized to help control image capture. Furthermore, an adaptive capture control is disclosed that automatically adjusts the threshold level of capture control to maintain proper image capture. The invented capture control also conserves precious battery power by eliminating capture of unnecessary images when the capsule camera moves too slowly or stalls.

Abstract: A capsule camera includes a wireless transmitter that transmits data and a receiving system having multiple receiving units to allowing storing multiple data streams simultaneously. The multiple stored data streams may be used at a later time to derive the best data stream for analysis, based on the network conditions at the time each data packet is received. The best data stream may be derived from the multiple stored data streams at a later time during the decoding process. For example, in a capsule camera application, the multiple data streams may be stored in the memory devices associated with the receiving units, which are typically attached to different locations on the body during diagnosis. The multiple data streams are maintained as the capsule passes through the gastrointestinal tract. Subsequently, after the diagnosis, the receiving units are recovered and connected to a computer or another standalone device for analysis.

Abstract: A camera system uses one or more image sensor IC chips each having multiple pixel arrays on the same semiconductor substrate (i.e., “multiple pixel arrays on a chip”). In one embodiment, such a camera system includes: (a) optical components that create multiple images in close physical proximity of each other (e.g., within a few millimeters or centimeters); and (b) a single sensor substrate (“chip”) containing multiple 2-dimensional pixel arrays that are aligned to capture these multiple images, so as to convert the multiple images into electrical signal. The pixel arrays can be manufactured using a CCD or a CMOS compatible process. For manufacturing reasons, such a chip is typically two centimeters or less on a side. However, large chips can also be made. Optional electronic components for further signal processing of the captured images may be formed either on the sensor chip (i.e., in a “system-on-a-chip” implementation), or in a separate back-end application specific integrated circuit (ASIC).

Abstract: An imaging review system that displays sequences of in-vivo panoramic images stitched together into a single video while providing edit/review/location information of the individual images within the body being imaged.

Abstract: A method for transmitting data to a camera without requiring in the camera a conventional wireless transmission capability includes (a) in the camera's field of view, providing an object which forms an image on which the data is encoded; (b) capturing an image of the object using optics of the camera; and (c) recovering the data from the image of the object. The data is encoded by an optically detectable quantity (e.g., light intensity or color) or a pattern in one or more portions of the object. The data can be carried by the distribution of the optically detectable quantity within the image or its derivative. The field of view of the camera may be divided into multiple sub-areas to allow providing multiple data-bearing images. A sequence of such images may be used to increase the amount of data that can be transmitted in this manner. In addition, the time domain can be used to create one further dimension of data encoding.

Abstract: A semiconductor memory device and an associated method suitable for use in specific applications with predictable memory access pattern, such as in a capsule camera. The memory device takes advantage of the memory access pattern to simplify address processing circuit to realize savings in power and silicon area. Because random access to the semiconductor device is not required, the interface from external to the semiconductor device is also simplified by eliminating at least the address port that is used to specify the memory locations accessed. The method is applicable not only to non-volatile memory technologies (e.g., flash memory), it is also applicable to volatile memory technologies, such as transient charge storage-based memory circuits (e.g., DRAMs) and metastable states-based memory circuits (e.g., SRAMs).

Abstract: A method for detecting a capsule camera entering into or exiting the GI tract, includes (a) taking a first test image under the condition that an illumination system of the capsule camera is disabled; (b) taking a second test image under the same condition as the first test image; (c) comparing selected corresponding pixel values of the first test image and the second test image to determine if a significant change in pixel values has occurred; and (d) upon detecting the significant change in pixel values, determining if the capsule camera has entered or exited the GI tract, and performing operations appropriate to follow such determination. The appropriate operations performed after detecting the capsule camera's exit from the GI tract includes stopping further taking or storing of images and, optionally, activating an audio signal to indicate the capsule camera has exited the GI tract.

Abstract: A method for controlling a lighting source in a capsule camera improves image quality by avoiding over-exposure or under-exposure in all regions of an image, while concurrently reducing significantly power dissipation in the capsule camera. A capsule camera using the method includes: (1) one or more sensor arrays each having one or more pixels in one or more designated regions in the field of view of the capsule camera; (2) lighting elements each providing illumination to one or more of the designated regions; and (3) a control unit that (a) extracts a parameter value from the pixels of each region; (b) evaluates the parameter value at each region; and (c) adjusts the lighting elements providing illumination to each region according to the evaluation. The parameter value may be an average value of the pixels. The purpose of the adjustment is to bring the parameter value for the region to within a predetermined range.

Abstract: A method is provided for characterizing manufacturing variations in a capsule camera and imperfections in its operating environment to allow images captured by the capsule camera to be compensated for these defects. In one embodiment, a method for characterizing a camera includes: (a) illuminating a field of view of the optical elements under a controlled condition; (b) exposing multiple images onto the image sensor under the controlled condition; (c) extracting parameter values of a model for the image provided on the image sensor from the multiple images; and (d) compensating images taken subsequently in the camera using the parameter values. The objects in the field of view may have a predetermined color, contrast or pattern. In one instance, the controlled condition includes an external light source for illuminating the field of view, and the image sensor is sensitive to a plurality of color components.

Abstract: A method is provided for characterizing manufacturing variations in a camera and imperfections in its operating environment to allow images captured by the camera to be compensated for these defects. In one embodiment, a method for characterizing a camera includes: (a) illuminating a field of view of the optical elements under a controlled condition; (b) exposing multiple images onto the image sensor under the controlled condition; (c) extracting parameter values of a model for the image provided on the image sensor from the multiple images; and (d) compensating images taken subsequently in the camera using the parameter values. The objects in the field of view may have a predetermined color, contrast or pattern. In one instance, the controlled condition includes an external light source for illuminating the field of view, and the image sensor is sensitive to a plurality of color components. The field of view may be illuminated at a predetermined light intensity for each of the color components.

Abstract: The invention is directed to a system and method for vivo image capturing system. The system includes a camera having an entrance pupil, where the camera is configured to capture a panoramic image of an environment surrounding the camera, wherein the panoramic image is captured on a single image plane. The system further includes a light source for providing an illumination source for the camera and a closed housing for enclosing the camera and the light source.