Abstract: A method and apparatus of aligning a lens module with respect to an image sensor device for a capsule camera are disclosed. The image sensor device comprises multiple pixel arrays and the lens module comprises multiple lens sets to form multiple images corresponding to multiple fields of view associated with the multiple lens sets, and each lens set forms one image for one corresponding pixel array associated with one field of view. A method according to the present invention present invention, one or more test images are presented in the multiple fields of view associated with the lens module. Multiple images in the multiple fields of view are captured using the multiple pixel arrays. Metric measurement is derived based on the multiple images captured by the multiple pixel arrays. Lens alignment between the lens module and the image sensor device is then adjusted based on the metric measurement.

Abstract: A method and apparatus for capturing an image sequence using a capsule camera are disclosed. According to the present invention, a first energy-based frame time for the special images is determined based on first light energy perceived by the image sensor and a second energy-based frame time for the regular images is determined based on second light energy perceived by the image sensor. The capsule camera captures the image sequence comprising one or more sets of mixed-type images by configuring the capsule camera to cause a mixed-frame distance between the first energy-based frame time for one special image in a target set of mixed-type images and the second energy-based frame time for one regular image in the target set of mixed-type images smaller than an average frame period.

Abstract: A method and apparatus for estimating or measuring a physical area or physical volume of an object of interest in one or more images captured using an endoscope are disclosed. According to the present method, an object of interest in an image or images is determined. Also, distance information associated with the object of interest with respect to an image sensor of the endoscope is received. The physical area size or physical volume size of the object of interest is then determined based on the image or images, and the distance information.

Abstract: A capsule endoscopic system is disclosed for receiving data from a capsule device and providing inductive power to the capsule device wirelessly, where the capsule endoscopic system incorporates a feature to automatically protect the capsule device and the docking device from damage if the capsule device is docked in a backward orientation. In one embodiment, the docking device comprises a current sense circuit to detect the current flowing through the primary coil or primary drive circuit. The occurrence of wrong orientation can be detected from the current. A detection/control circuit can be used to provide the needed control in order to prevent damage to the system. In another embodiment, a resonant circuit comprising a capacitor and the primary coil is used to provide the needed protection when the capsule device is docked with a wrong orientation.

Abstract: A method and system for displaying images captured by an in vivo imaging device are disclosed. Embodiments according to the present invention display image sequence data in a first display area. When a first bookmarked image with annotation information is displayed in the first display area, a first thumbnail image in a second display area corresponding to the first bookmarked image is replaced to indicate an occurring correspondence between the first bookmarked image and the first thumbnail image corresponding to the first bookmarked image being displayed. In one embodiment, the method further comprises displaying the first thumbnail image in the second display area when one other image of the image sequence data is displayed in the first display area after the first bookmarked image is displayed.

Abstract: An endoscopy capsule having an image collecting capacity includes a deformable member configured to inflate when exposed to body liquid. The deformable member includes an effervescent material. When the effervescent reacts with water the resulting Carbon-Dioxide gas reduces the specific gravity of the endoscopy capsule. The capsule is contained within a shell or dome when swallowed. The shell or dome is configured dissolve in either a low or high pH environment.

Abstract: A capsule endoscopic system is disclosed for receiving data from a capsule device and providing inductive power to the capsule device wirelessly, where the capsule endoscopic system incorporates a feature to automatically protect the capsule device and the docking device from damage if the capsule device is docked in a backward orientation. In one embodiment, the docking device comprises a current sense circuit to detect the current flowing through the primary coil or primary drive circuit. The occurrence of wrong orientation can be detected from the current. A detection/control circuit can be used to provide the needed control in order to prevent damage to the system. In another embodiment, a resonant circuit comprising a capacitor and the primary coil is used to provide the needed protection when the capsule device is docked with a wrong orientation.

Abstract: Method and apparatus of reconstruction of images from an in vivo multi-camera capsule are disclosed. In one embodiment of the present invention, the capsule comprises two cameras with overlapped fields of view (FOVs). Intra-image based pose estimation is applied to the sub-images associated with the overlapped area to improve the pose estimation for the capsule device. In another embodiment, two images corresponding to the two FOVs are fused by using disparity-adjusted, linear weighted sum of the overlapped sub-images. In yet another embodiment, the images from the multi-camera capsule are stitched for time-space representation.

Abstract: Disclosed herein are systems, methods, and structures providing accurate and easy to use size measurement of physiological features identified from endoscopic examination. In sharp contrast to the prior art, systems, methods, and structures according to the present disclosure employ structured light that advantageously enables size and/or distance information about lesions and/or other physiological features in a gastrointestinal (GI) tract. Advantageously, systems, methods, and structures according to the present disclosure are applicable to both capsule endoscopes and insertion endoscopes.

Abstract: A capsule endoscopic system is disclosed for receiving data from a capsule device and providing inductive power to the capsule device wirelessly, where the capsule endoscopic system incorporates a feature to automatically protect the capsule device and the docking device from damage if the capsule device is docked in a backward orientation. In one embodiment, the docking device comprises a current sense circuit to detect the current flowing through the primary coil or primary drive circuit. The occurrence of wrong orientation can be detected from the current. A detection/control circuit can be used to provide the needed control in order to prevent damage to the system. In another embodiment, a resonant circuit comprising a capacitor and the primary coil is used to provide the needed protection when the capsule device is docked with a wrong orientation.

Abstract: A method and apparatus for capturing images of a scene using a capsule device including a camera are disclosed. An image sequence is captured using the camera when the capsule device travels through a human gastrointestinal tract. Also, structured-light images are captured using the camera by projecting structured light to one or more objects in a field of view of the camera when the capsule device travels through the human gastrointestinal tract. The structured-light images are interleaved with regular images in the image sequence. The distance information with respect to the capsule camera associated with objects of the selected image is derived. Both the image sequence and the distance information are outputted. A method of determining the size of an object of interest utilizing the distance information is also disclosed. In another method, the distance information is used to scale object or adjust intensities.

Abstract: An integrated image sensor for capturing a mixed structured-light image and regular image using an integrated image sensor are disclosed. The integrated image sensor comprises a pixel array, one or more output circuits, one or more analog-to-digital converters, and one or more timing and control circuits. The timing and control circuits are arranged to perform a set of actions including capturing a regular image and a structured-light image. According to the present invention, the structured-light image captured before or after the regular image is used to derive depth or shape information for the regular image. An endoscope based on the above integrated image sensor is also disclosed. The endoscope may comprises a capsule housing adapted to be swallowed, where the components of integrated image sensor, a structured light source and a non-structured light source are enclosed and sealed in the capsule housing.

Abstract: A method and device for capturing a mixed structured-light image and regular image using an integrated image sensor are disclosed, where the structured-light image is captured using a shorter frame period than the regular image. In order to achieve a shorter frame period for the structured-light image, the structured-light image may correspond to an image captured with reduced dynamic range, reduced spatial resolution, or a combination of them. The capturing process comprises applying reset signals to a pixel array to reset rows of pixels of the pixel array, reading-out analog signals from the rows of pixels of the pixel array and converting the analog signals from the rows of pixels of the pixel array into digital outputs for the image using one or more analog-to-digital converters.

Abstract: A method and apparatus for capturing an image sequence using a capsule camera are disclosed. According to the present invention, a first energy-based frame time for the special images is determined based on first light energy perceived by the image sensor and a second energy-based frame time for the regular images is determined based on second light energy perceived by the image sensor. The capsule camera captures the image sequence comprising one or more sets of mixed-type images by configuring the capsule camera to cause a mixed-frame distance between the first energy-based frame time for one special image in a target set of mixed-type images and the second energy-based frame time for one regular image in the target set of mixed-type images smaller than an average frame period.

Abstract: A method and system for displaying images captured by an in vivo imaging device are disclosed. Embodiments according to the present invention display image sequence data in a first display area. When a first bookmarked image with annotation information is displayed in the first display area, a first thumbnail image in a second display area corresponding to the first bookmarked image is replaced to indicate an occurring correspondence between the first bookmarked image and the first thumbnail image corresponding to the first bookmarked image being displayed. In one embodiment, the method further comprises displaying the first thumbnail image in the second display area when one other image of the image sequence data is displayed in the first display area after the first bookmarked image is displayed.

Abstract: A method of processing images captured using a capsule camera is disclosed. According to one embodiment, two images designated as a reference image and a float image are received, where the float image corresponds to a captured capsule image and the reference image corresponds to a previously composite image or another captured capsule image prior to the float image. Automatic segmentation is applied to the float image and the reference image to detect any non-GI (non-gastrointestinal) region. The non-GI regions are excluded in match measure between the reference image and a deformed float image during the registration process. The two images are stitched together by rendering the two images at the common coordinate. In another embodiment, large area of non-GI regions are removed directly from the input image, and remaining portions are stitched together to form a new image without performing image registration.

Abstract: A method and device for improving the accuracy of depth information derived from a structured-light image for a regular image are disclosed. In one example, an additional structured-light image is captured before a first structured-light image or after a regular image. The depth information for the regular image can be derived from the first structured-light image and corrected by incorporating depth information from the additional structured-light image. A model for depth information can be used to predict or interpolate depth information for the regular image. In another example, two regular sub-images may be captured with a structured-light image in between. If substantial frame differences or substantial global motion vector/block motion vectors are detected, the two regular sub-images will not be combined in order to avoid possible motion smear. Instead, one of the two sub-images will be selected and scaled as the output regular image.

Abstract: A method and device for capturing a mixed structured-light image and regular image using an integrated image sensor are disclosed, where the structured-light image is captured using a shorter frame period than the regular image. In order to achieve a shorter frame period for the structured-light image, the structured-light image may correspond to an image captured with reduced dynamic range, reduced spatial resolution, or a combination of them. The capturing process comprises applying reset signals to a pixel array to reset rows of pixels of the pixel array, reading-out analog signals from the rows of pixels of the pixel array and converting the analog signals from the rows of pixels of the pixel array into digital outputs for the image using one or more analog-to-digital converters.

Abstract: A method and system for displaying images captured by an in vivo imaging device are disclosed. Embodiments according to the present invention display image sequence data in a first display area. When a first annotated image is displayed in the first display area, a first thumbnail image in a second display area corresponding to the first annotated image is replaced to indicate an occurring correspondence between the first annotated image and the first thumbnail image corresponding to the first annotated image being displayed. In one embodiment, the method further comprises displaying the first thumbnail image in the second display area when one other image of the image sequence data is displayed in the first display area after the first annotated image is displayed.

Abstract: An integrated circuit for capturing panoramic image is disclosed. The integrated circuit comprises a plurality of pixel arrays fabricated on a common substrate, wherein each pixel array being positioned to capture an image to be projected thereon, and wherein the orientation of each pixel array is rotated to match with the orientation of the image projected thereon. The integrated circuit also includes readout circuits coupled to the pixel arrays for reading electrical signals corresponding to the images captured from the pixel arrays. In one embodiment, the plurality of pixel arrays corresponds to four pixel arrays and the orientation of said each pixel array is substantially 90° apart from a neighboring pixel array. The integrated circuit further comprises a timing and control circuit, wherein the timing and control circuit is for controlling said one or more readout circuits and the plurality of pixel arrays.