Abstract: A method and device for improving the accuracy of depth information derived from a structured-light image for a regular image are disclosed. In one example, an additional structured-light image is captured before a first structured-light image or after a regular image. The depth information for the regular image can be derived from the first structured-light image and corrected by incorporating depth information from the additional structured-light image. A model for depth information can be used to predict or interpolate depth information for the regular image. In another example, two regular sub-images may be captured with a structured-light image in between. If substantial frame differences or substantial global motion vector/block motion vectors are detected, the two regular sub-images will not be combined in order to avoid possible motion smear. Instead, one of the two sub-images will be selected and scaled as the output regular image.

Abstract: A method and apparatus of aligning a lens module with respect to an image sensor device for a capsule camera are disclosed. The image sensor device comprises multiple pixel arrays and the lens module comprises multiple lens sets to form multiple images corresponding to multiple fields of view associated with the multiple lens sets, and each lens set forms one image for one corresponding pixel array associated with one field of view. A method according to the present invention present invention, one or more test images are presented in the multiple fields of view associated with the lens module. Multiple images in the multiple fields of view are captured using the multiple pixel arrays. Metric measurement is derived based on the multiple images captured by the multiple pixel arrays. Lens alignment between the lens module and the image sensor device is then adjusted based on the metric measurement.

Abstract: Disclosed herein are systems, methods, and structures providing accurate and easy to use size measurement of physiological features identified from endoscopic examination. In sharp contrast to the prior art, systems, methods, and structures according to the present disclosure employ structured light that advantageously enables size and/or distance information about lesions and/or other physiological features in a gastrointestinal (GI) tract. Advantageously, systems, methods, and structures according to the present disclosure are applicable to both capsule endoscopes and insertion endoscopes.

Abstract: A method and apparatus for processing gastrointestinal (GI) images are disclosed. According to this method, a regular image is received, where the regular image is captured using an imaging apparatus by projecting non-structured light onto a body lumen when the imaging apparatus is in the body lumen. One or more structured-light images captured using the imaging apparatus by projecting the body lumen with structured light are received. A target distance for a target region in the regular image is derived based on said one or more structured-light images. A filter is determined based on the target distance and camera parameters associated with the imaging apparatus. A first processed target region is generated by applying the filter to the target region to improve sharpness of the target region. A first processed regular image comprising the first processed target region is provided.

Abstract: A method and apparatus for sharpening gastrointestinal (GI) images are disclosed. A target distance between the target region and the imaging apparatus is determined for a target region in the regular image. One or more filter parameters of a de-blurring filter are selected from stored filter parameters according to the target distance. A processed target region is generated by applying the de-blurring filter to the target region to improve sharpness of the target region. A method for characterizing an imaging apparatus is also disclosed. The imaging apparatus is placed under a controlled environment. Test pictures for one or more test patterns are captured at multiple test distances in a range including a focus distance using the imaging apparatus. One or more parameters associated a target point spread function are determined from each test picture for characterizing image formation of the imaging apparatus at the selected distance.

Abstract: A capsule endoscopic system is disclosed, where the system comprises a capsule device and a docking device. The capsule device comprises a battery, a secondary coil, an optical transmitter all enclosed in a capsule housing. The docking device comprises a primary coil to generate an alternating magnetic field, a primary core and optical receiver to receive an optical signal. The alternating magnetic field is coupled to the secondary coil to supply power to the capsule device when the capsule device is at a docked position in the docking device. The primary core is arranged to concentrate the alternating magnetic field on the secondary coil when the capsule device is at the docked position. Furthermore, the capsule endoscopic system is arranged so that an optical path is formed between the optical transmitter and the optical receiver when the capsule device is at the docked position.

Abstract: A method and apparatus of capturing non-structured light images and structured light images for deriving depth information are disclosed. According to the method, one or more non-SL (non-structured light) images without structured light and one or more initial SL (structured light) images formed on a common image plane are captured by projecting structured light patterns in a visible spectrum with the structured light source adjusted to generate initial structured light at an initial intensity level. The signal quality of structured light patterns reflected from one or more objects is evaluated based on the non-SL images and the initial SL images. If the signal quality of structured light patterns is below a threshold, a next set of SL images are captured by increasing the structured light level from a previous level until the signal of the structured light patterns is satisfactory.

Abstract: A method and apparatus for sharpening gastrointestinal (images are disclosed. A target distance between the target region and the imaging apparatus is determined for a target region in the regular image. One or more filter parameters of a de-blurring filter are selected from stored filter parameters according to the target distance. A processed target region is generated by applying the de-blurring filter to the target region to improve sharpness of the target region. A method for characterizing an imaging apparatus is also disclosed. The imaging apparatus is placed under a controlled environment. Test pictures for one or more test patterns are captured at multiple test distances in a range including a focus distance using the imaging apparatus. One or more parameters associated a target point spread function are determined from each test picture for characterizing image formation of the imaging apparatus at the selected distance.

Abstract: A display device includes (a) a non-volatile memory containing corrective data for compensating input image data received; (b) display hardware receiving control and data signals for displaying an image; and (c) an image processing circuit that retrieves the corrective data from the non-volatile memory to generate the data signals for the display hardware, after applying the corrective data to each color component of each pixel in the input image data.

Abstract: A method and apparatus for imaging a body lumen are disclosed. According to the method, an imaging apparatus is induced into the body lumen. Structured light from the imaging apparatus is projected into the body lumen. The structured light reflected from anatomical features in the body lumen is detected by the imaging apparatus. A first structured light image is generated from the detected structured light by the imaging apparatus. Non-structured light is emitted from the imaging apparatus into the body lumen. The non-structured light reflected from the anatomical features in the body lumen is detected by the imaging apparatus. A non-structured light image is generated from the detected non-structured light by the imaging apparatus. The frame period of the first structured light image is shorter than the frame period of the non-structured light image. In one embodiment, the imaging apparatus corresponds to a capsule endoscope.

Abstract: A method and device for improving the accuracy of depth information derived from a structured-light image for a regular image are disclosed. In one example, an additional structured-light image is captured before a first structured-light image or after a regular image. The depth information for the regular image can be derived from the first structured-light image and corrected by incorporating depth information from the additional structured-light image. A model for depth information can be used to predict or interpolate depth information for the regular image. In another example, two regular sub-images may be captured with a structured-light image in between. If substantial frame differences or substantial global motion vector/block motion vectors are detected, the two regular sub-images will not be combined in order to avoid possible motion smear. Instead, one of the two sub-images will be selected and scaled as the output regular image.

Abstract: A method and apparatus of processing and displaying images captured using an in vivo capsule camera are disclosed. One or more overlapped areas between a target image and each image in a neighboring image group are determined, which comprises at least two neighboring images around the target image. Marked pixels in the target image are then determined, where a pixel in the target image is designated as a marked pixel if the pixel is within an overlapped area between the target image and at least one neighboring image. If the total number of the marked pixels in the target image exceeds a threshold and the number of the marked pixels associated with the overlapped area(s) between the target image and any image in the neighboring image group is below the threshold, the target image is excluded from a set of images to be displayed on a display device.

Abstract: Disclosed herein are systems, methods, and structures providing accurate and easy to use size measurement of physiological features identified from endoscopic examination. In sharp contrast to the prior art, systems, methods, and structures according to the present disclosure employ structured light that advantageously enables size and/or distance information about lesions and/or other physiological features in a gastrointestinal (GI) tract. Advantageously, systems, methods, and structures according to the present disclosure are applicable to both capsule endoscopes and insertion endoscopes.

Abstract: An integrated image sensor for capturing a mixed structured-light image and regular image using an integrated image sensor are disclosed. The integrated image sensor comprises a pixel array, one or more output circuits, one or more analog-to-digital converters, and one or more timing and control circuits. The timing and control circuits are arranged to perform a set of actions including capturing a regular image and a structured-light image. According to the present invention, the structured-light image captured before or after the regular image is used to derive depth or shape information for the regular image. An endoscope based on the above integrated image sensor is also disclosed. The endoscope may comprises a capsule housing adapted to be swallowed, where the components of integrated image sensor, a structured light source and anon-structured light source are enclosed and sealed in the capsule housing.

Abstract: A method and apparatus for processing gastrointestinal (GI) images are disclosed. According to this method, a regular image is received, where the regular image is captured using an imaging apparatus by projecting non-structured light onto a body lumen when the imaging apparatus is in the body lumen. One or more structured-light images captured using the imaging apparatus by projecting the body lumen with structured light are received. A target distance for a target region in the regular image is derived based on said one or more structured-light images. A filter is determined based on the target distance and camera parameters associated with the imaging apparatus. A first processed target region is generated by applying the filter to the target region to improve sharpness of the target region. A first processed regular image comprising the first processed target region is provided.

Abstract: A method and device for improving the accuracy of depth information derived from a structured-light image for a regular image are disclosed. In one example, an additional structured-light image is captured before a first structured-light image or after a regular image. The depth information for the regular image can be derived from the first structured-light image and corrected by incorporating depth information from the additional structured-light image. A model for depth information can be used to predict or interpolate depth information for the regular image. In another example, two regular sub-images may be captured with a structured-light image in between. If substantial frame differences or substantial global motion vector/block motion vectors are detected, the two regular sub-images will not be combined in order to avoid possible motion smear. Instead, one of the two sub-images will be selected and scaled as the output regular image.

Abstract: An integrated image sensor for capturing a mixed structured-light image and regular image using an integrated image sensor are disclosed. The integrated image sensor comprises a pixel array, one or more output circuits, one or more analog-to-digital converters, and one or more timing and control circuits. The timing and control circuits are arranged to perform a set of actions including capturing a regular image and a structured-light image. According to the present invention, the structured-light image captured before or after the regular image is used to derive depth or shape information for the regular image. An endoscope based on the above integrated image sensor is also disclosed. The endoscope may comprises a capsule housing adapted to be swallowed, where the components of integrated image sensor, a structured light source and a non-structured light source are enclosed and sealed in the capsule housing.

Abstract: A method and apparatus of capturing non-structured light images and structured light images for deriving depth information are disclosed. According to the method, one or more non-SL (non-structured light) images without structured light and one or more initial SL (structured light) images formed on a common image plane are captured by projecting structured light patterns in a visible spectrum with the structured light source adjusted to generate initial structured light at an initial intensity level. The signal quality of structured light patterns reflected from one or more objects is evaluated based on the non-SL images and the initial SL images. If the signal quality of structured light patterns is below a threshold, a next set of SL images are captured by increasing the structured light level from a previous level until the signal of the structured light patterns is satisfactory.

Abstract: A capsule endoscopic system is disclosed, where the system comprises a capsule device and a docking device. The capsule device comprises a battery, a secondary coil, and a capsule housing to enclose the battery and the secondary coil in a sealed environment, where the capsule device consists of a first end and a second end in a longitudinal direction of the capsule device, and the battery is located in proximity to the first end and the secondary coil is located in proximity to the second end. The docking device comprises an opening on the docking device, a primary coil to generate an alternating magnetic field, and a primary core. The capsule endoscopic system is arranged so that at least a portion of the secondary coil is enclosed by the primary coil and the battery is outside the primary coil when the capsule device is at the docked position.

Abstract: A capsule endoscopic system is disclosed, where the system comprises a capsule device and a docking device. The capsule device comprises a battery, a secondary coil, an optical transmitter all enclosed in a capsule housing. The docking device comprises a primary coil to generate an alternating magnetic field, a primary core and optical receiver to receive an optical signal. The alternating magnetic field is coupled to the secondary coil to supply power to the capsule device when the capsule device is at a docked position in the docking device. The primary core is arranged to concentrate the alternating magnetic field on the secondary coil when the capsule device is at the docked position. Furthermore, the capsule endoscopic system is arranged so that an optical path is formed between the optical transmitter and the optical receiver when the capsule device is at the docked position.