Abstract: An optical observation instrument has two optical transmission channels for transmitting two partial ray bundles (9A, 9B). The optical observation instrument has a main objective (1) common to the optical transmission channels, an electronic image sensor (7) for sequentially recording the partial ray bundles (9A, 9B), an intermediate imaging optical system (3) between the main objective (1) and the image sensor (7) and common to the optical transmission channels, and a tilting mirror matrix (5) between the main objective (1) and the image sensor (7). The intermediate imaging optical system (3) is arranged so that the respective partial ray bundle (9A, 9B) is deflected toward the image sensor (7) and passes the intermediate imaging optical system (3) both on the way from the main objective (1) to the tilting mirror matrix (5) and on the way from the tilting mirror matrix (5) to the image sensor (7).

Abstract: In illustrative implementations of this invention, multi-path analysis of transient illumination is used to reconstruct scene geometry, even of objects that are occluded from the camera. An ultrafast camera system is used. It comprises a photo-sensor (e.g., accurate in the picosecond range), a pulsed illumination source (e.g. a femtosecond laser) and a processor. The camera emits a very brief light pulse that strikes a surface and bounces. Depending on the path taken, part of the light may return to the camera after one, two, three or more bounces. The photo-sensor captures the returning light bounces in a three-dimensional time image I(x,y,t) for each pixel. The camera takes different angular samples from the same viewpoint, recording a five-dimensional STIR (Space Time Impulse Response). A processor analyzes onset information in the STIR to estimate pairwise distances between patches in the scene, and then employs isometric embedding to estimate patch coordinates.

Abstract: A control apparatus for controlling a three-dimensional (3D) display apparatus includes: an image processing unit to receive an image source signal and convert the image source signal to an interval signal. The interval signal is defined as a first timing interval and a second timing interval. A backlight control device, coupled to the image processing unit, receives the interval signal and generates a plurality of backlight control signals according to the interval signal. A backlight device, coupled to the backlight control device, receives the plurality of backlight control signals and provides a lighting source to a display device during the first timing interval and/or the second timing interval according to the plurality of backlight control signals.

Abstract: Certain aspects of an apparatus and method for determining information associated with a food product may include a server that is communicably coupled to a computing device. The server may deconstruct a three dimensional (3-D) image of the food product to identify one or more ingredients in the food product. Further, the server may compare the deconstructed 3-D image with a database of pre-stored images of food products to determine a type of the one or more ingredients in the food product. The server may determine nutritional information associated with the food product based on the determined type of the one or more ingredients.

Abstract: An image synthesizing method according to the present invention includes generating a depth image in a current picture by searching depth information using a plurality of color images obtained at different view points, performing filtering on the depth image using a 3-dimensional (3D) joint bilateral filter, and generating a synthesized image using the plurality of color images and the filtered depth image, wherein the 3D joint bilateral filter performs filtering on the generated depth image using color image information for at least one of previous pictures, the current picture, and subsequent pictures, and the color image information includes information on a boundary of an object in the color images and color information of the color images. According to the present invention, image processing performance may be enhanced.

Abstract: A broadband imager, which is able to image both IR and visible light, is disclosed. In one embodiment, an IR sensitive region of an IR pixel underlies the R, G, B sensitive regions of R, G, and B visible pixels. Therefore, the IR pixel receives IR light through a same surface area of the photosensor through which the R, G, and B pixels receive visible light. However, the IR light generates electron-hole pairs deeper below the common surface area shared by the RGB and IR pixels, than visible light. The photosensor also has a charge accumulation region for accumulating charges generated in the IR sensitive region and an electrode above the charge accumulation region for providing a voltage to accumulate the charges generated in the IR pixel.

Abstract: Provided are a computer program product, system, and method for processing a source video stream of frames of images providing a first type of output format to generate a supplemental video stream, wherein the source video stream and the supplemental video stream are processed by a video processor to produce an output video stream having a second type of output format. The source video stream has a plurality of frames of digital images comprising an array of pixels in the first type of output format. The frames of the source video stream are processed by transforming color values for the pixels in the images in the frames to different color values to produce a modified video stream whose frames are merged with the corresponding frames in the source video stream to produce the supplemental video stream.

Abstract: An 3D camera module includes a first and a second imaging units, a storage unit, a color separation unit, a main processor unit, an image processing unit, a driving unit, an image combining unit and two OIS units. The first and second imaging units capture images of an object(s) from different angles. The color separation unit separates the images into red, green and blue colors. The main processor unit calculates MTF values of the images and determines a shooting mode of the 3D camera module. The image processing unit processes the images to compensate for blurring of the images caused by being out of focus. The driving unit drives the first and second imaging units to optimum focusing positions according to MTF values. The image combining unit combines the images into a 3D image. The OIS units respectively detect and compensate for shaking of the first and second imaging units.

Abstract: A computation system comprising an orientation detection device configured to detect position information comprising a position and an orientation of the computation system, a multi-sensor system coupled to the orientation detection device, wherein the multi-sensor system is configured to capture environmental input data, wherein the multi-sensor system comprises at least one of an audio capturing system and a three-dimensional (3D) image capturing system, and wherein the environmental input data comprises at least one of audio and an image, and at least one signal processing component coupled to the orientation detection device and to the multi-sensor system, wherein the processor is configured to modify the captured environmental input data based on the position information.

Abstract: A digital photographing apparatus that recommends a suitable auto focus (AF) candidate area to a user before photographing, allows a user to select an AF area or automatically selects the AF area, and allows a user to conveniently and accurately capture a desired image, and a method of controlling the digital photographing apparatus are disclosed. A method is provided that includes calculating information about a distance to an object existing in an image stereoscopically input through a first lens and a second lens; matching the information about the distance to red green blue (RGB) information of the image; displaying a plurality of AF candidate areas on the image based on the matched RGB information; and capturing an image centered on an AF candidate area having a first priority when a photographing button is pressed.

Abstract: Systems and methods for receiving a blurred two-dimensional image captured using an optic system. The blurred two-dimensional image is deconvoluted using a point spread function for the optic system. A stack of non-blurred two-dimensional images is generated, each non-blurred image having a z-axis coordinate. A three-dimensional image is constructed from the stack of two-dimensional images.

Abstract: Systems and methods for receiving a blurred two-dimensional image captured using an optic system. The blurred two-dimensional image is deconvoluted using a point spread function for the optic system. A stack of non-blurred two-dimensional images is generated, each non-blurred image having a z-axis coordinate. A three-dimensional image is constructed from the stack of two-dimensional images.

Abstract: One embodiment provides a communication device for transmitting a video to an external device through first to third transmission lines, the communication device including: a transmission module configured to transmit first color difference information and second color difference information concerned with adjacent two pixels through the first transmission line, to transmit first luminance information concerned with one of the two pixels through the second transmission line, and to transmit second luminance information concerned with the other of the two pixels through the third transmission line.

Abstract: Various embodiments of the present invention are directed to negative refractive index-based holograms that can be electronically controlled and dynamically reconfigured to generate one or more color three-dimensional holographic images. In one aspect, a hologram comprises a phase-control layer having a plurality of phase modulation elements. The phase-modulation elements are configured with a negative effective refractive index and selectively transmit wavelengths associated with one of three primary color wavelength. The hologram also includes an intensity-control layer including a plurality of intensity-control elements. One or more color three-dimensional images can be produced by electronically addressing the phase-modulation elements and intensity-control elements in order to phase shift and control the intensity of light transmitted through the hologram. A method for generating a color holographic image using the hologram is also provided, as is a system for generating a color holographic image.

Abstract: A method and apparatus for generating three-dimensional image information is disclosed. The method involves directing light captured within the field of view of the lens to an aperture plane of the lens, receiving the captured light at a spatial discriminator located proximate the aperture plane, the discriminator including a first portion disposed to transmit light having a first optical state through a first portion of the single imaging path and a second portion disposed to transmit light having a second optical state through a second portion of the single imaging path. The first and second portions of the single imaging path provide respective first and second perspective viewpoints within the field of view of the lens for forming respective first and second images at an image sensor disposed at an image plane of the lens.

Abstract: An image sensor includes a unit pixel including a plurality of color pixels with a depth pixel. A first signal line group of first signal lines is used to supply first control signals that control operation of the plurality of color pixels, and a separate second signal line group of second signal lines is used to supply second control signals that control operation of the depth pixel.

Abstract: A method and an arrangement for an improved outlier detection for colour mapping are recommended, wherein a neighborhood of a partially colour compensated test-image by comparing the initially corrected test-image with a reference image in a neighborhood comparator is used for outlier detection and not outlier detection of at least two images for colour mapping.

Abstract: An image generating apparatus may include a first reflector and a second reflector. When a light emitter emits an infrared light, the infrared light may be reflected from a first reflector and be omni-directionally reflected. The reflected infrared light that is the infrared light reflected from the object may be reflected from a second reflector and be transferred to a sensor. The sensor may receive the reflected infrared light and generate a depth image of the object.

Abstract: A three-dimensional (3D) image acquisition apparatus is provided. The 3D image acquisition apparatus includes: an interchangeable lens unit comprising a lighting unit that irradiates light toward an object, a color image lens unit that forms a color image of the object, and a depth image capturing unit that comprises a depth image lens unit for obtaining depth image information relating to the object; and a main body comprising a first image sensor that converts an optical image formed by the color image lens unit into an electric signal and an image processor that forms a 3D image using the electric signal of the first image sensor and depth information of the depth image capturing unit, wherein the interchangeable lens unit is detachable from the main body.

Abstract: Digitizing objects in a picture is discussed herein. A user presents the object to a camera, which captures the image comprising color and depth data for the front and back of the object. For both front and back images, the closest point to the camera is determined by analyzing the depth data. From the closest points, edges of the object are found by noting large differences in depth data. The depth data is also used to construct point cloud constructions of the front and back of the object. Various techniques are applied to extrapolate edges, remove seams, extend color intelligently, filter noise, apply skeletal structure to the object, and optimize the digitization further. Eventually, a digital representation is presented to the user and potentially used in different applications (e.g., games, Web, etc.).

Abstract: In accordance with at least some embodiments of the present disclosure, a process for enhancing a two-dimensional (2D) image is described. The process may include generating a depth map for the 2D image based on edges detected from the 2D image, wherein the depth map can be used to convert the 2D image to a 3D image. The process may further include enhancing the 2D image using the depth map.

Abstract: An autostereoscopic display apparatus includes a backlight unit, a polarizing plate disposed in front of the backlight unit; a display panel displaying a left eye image and a right eye image by interlacing pixel lines of the left and right eye images alternately and sequentially; a lenticular lens sheet, disposed between the polarizing plate and the display panel, separating light emitted from the backlight unit into a left eye zone and a right eye zone; and a polarization switch controlling a polarization direction of light proceeding towards the left eye viewing zone so that light is incident on pixel lines of the display panel displaying the left eye image and a polarization direction of light proceeding towards the right eye viewing zone so that light is incident on pixel lines of the display panel displaying the right eye image, in synchronization with a vertical scanning time of the display panel.

Abstract: An optical observation instrument has two optical transmission channels for transmitting two partial ray bundles (9A, 9B). The optical observation instrument has a main objective (1) common to the optical transmission channels, an electronic image sensor (7) for sequentially recording the partial ray bundles (9A, 9B), an intermediate imaging optical system (3) between the main objective (1) and the image sensor (7) and common to the optical transmission channels, and a tilting mirror matrix (5) between the main objective (1) and the image sensor (7). The intermediate imaging optical system (3) is arranged so that the respective partial ray bundle (9A, 9B) is deflected toward the image sensor (7) and passes the intermediate imaging optical system (3) both on the way from the main objective (1) to the tilting mirror matrix (5) and on the way from the tilting mirror matrix (5) to the image sensor (7).

Abstract: A method of fabricating a microlens includes forming layer of photoresist on a substrate, patterning the layer of photoresist, and then reflowing the photoresist pattern. The layer of photoresist is formed by coating the substrate with liquid photoresist whose viscosity is 150 to 250 cp. A depth sensor includes a substrate and photoelectric conversion elements at an upper portion of the substrate, a metal wiring section disposed on the substrate, an array of the microlenses for focusing incident light as beams onto the photoelectric conversion elements and which beams avoid the wirings of the metal wiring section. The depths sensor also includes a layer presenting a flat upper surface on which the microlenses are formed. The layer may be a dedicated planarization layer or an IR filter, interposed between the microlenses and the metal wiring section.

Abstract: A disparity estimation system, apparatus, and method of estimating a consistent depth from a multi-view video. When estimating a disparity at a plurality of viewpoints, the disparity estimation system may estimate a temporally consistent disparity considering a temporal smoothness between proximate frames.

Abstract: An embodiment of the invention provides an active illumination imaging system comprising a first camera and a second camera, each having an optical axis and a field of view (FOV) characterized by a view angle in a plane that contains the optical axis and wherein the optical axes of the cameras intersect at an intersection region common to their FOVs at an angle substantially equal to half a sum of their view angles.

Abstract: In illustrative implementations of this invention, multi-path analysis of transient illumination is used to reconstruct scene geometry, even of objects that are occluded from the camera. An ultrafast camera system is used. It comprises a photo-sensor (e.g., accurate in the picosecond range), a pulsed illumination source (e.g. a femtosecond laser) and a processor. The camera emits a very brief light pulse that strikes a surface and bounces. Depending on the path taken, part of the light may return to the camera after one, two, three or more bounces. The photo-sensor captures the returning light bounces in a three-dimensional time image I(x,y,t) for each pixel. The camera takes different angular samples from the same viewpoint, recording a five-dimensional STIR (Space Time Impulse Response). A processor analyzes onset information in the STIR to estimate pairwise distances between patches in the scene, and then employs isometric embedding to estimate patch coordinates.

Abstract: An image processing apparatus and method using a three-dimensional (3D) image format are provided. According to an embodiment, the 3D image format may be configured to generate a mono video, a stereo video, and a multiview video, so that various images may be outputted through various displays without changing an existing an infrastructure.

Abstract: A system for background image subtraction includes a computing device coupled with a 3D video camera, a processor of the device programmed to receive a video feed from the camera containing images of one or more subject that include depth information. The processor, for an image: segments pixels and corresponding depth information into three different regions including foreground (FG), background (BG), and unclear (UC); categorizes UC pixels as FG or BG using a function that considers the color and background history (BGH) information associated with the UC pixels and the color and BGH information associated with pixels near the UC pixels; examines the pixels marked as FG and applies temporal and spatial filters to smooth boundaries of the FG regions; constructs a new image by overlaying the FG regions on top of a new background; displays a video feed of the new image in a display device; and continually maintains the BGH.

Abstract: A 3-D depth camera system, such as in a motion capture system, tracks an object such as a human in a field of view using an illuminator, where the field of view is illuminated using multiple diffracted beams. An image sensing component obtains an image of the object using a phase mask according to a double-helix point spread function, and determines a depth of each portion of the image based on a relative rotation of dots of light of the double-helix point spread function. In another aspect, dual image sensors are used to obtain a reference image and a phase-encoded image. A relative rotation of features in the images can be correlated with a depth. Depth information can be obtained using an optical transfer function of a point spread function of the reference image.

Abstract: A depth camera illuminator with a superluminescent light-emitting diode (SLED) in a motion tracking system. One or more SLEDs have a sufficient power, such as 75-200 milliwatts, to extend in a field of view in an area such as a room in a home. To correct for chromatic aberration which would otherwise exist due to the wider range of wavelengths which are emitted by an SLED compared to a laser, an achromatic diffractive optical element is used to disperse the light over the field of view. The achromatic diffractive optical element can have a stepped multi-level profile with three or more levels, or a continuous profile. Based on a tracked movement of a human target, an input is provided to an application in a motion tracking system, and the application performs a corresponding action such as updating a position of an on-screen avatar.

Abstract: Disclosed is a three dimensional liquid crystal display device (3D LCD device) which facilitates to improve a picture quality of a three-dimensional image (3D image) by color and luminance corrections, and a method for driving the same, wherein the device comprises an image data analyzer which analyzes a luminance level for each of R, G, and B colors of original image data inputted to display the 3D image; an image data converter which generates color correction data for adjusting a color balance of the R, G, and B colors distorted by the shutter glass, and generates gamma correction data for compensating a luminance reduction, on the basis of luminance analyzing results provided from the image data analyzer; and a timing controller which converts the input image data into image data of a frame unit, reflects the color correction data and the gamma correction data in the image data of the frame unit, and supplies the corrected image data to a data driver.

Abstract: A method that includes capturing depth information associated with a first field of view of a depth camera. The depth information is represented by a first plurality of depth pixels. The method also includes capturing color information associated with a second field of view of a video camera that substantially overlaps with the first field of view of the depth camera. The color information is represented by a second plurality of color pixels. The method further includes enhancing color information represented by at least one color pixel of the second plurality of color pixels to generate an enhanced image. The enhanced image adjusts an exposure characteristic of the color information captured by the video camera. The at least one color pixel is enhanced based on depth information represented by at least one corresponding depth pixel of the first plurality of depth pixels.

Abstract: According to one embodiment, an image processor comprises an image converter and a controller. The image converter is configured to convert a first video signal of a first resolution to a second video signal of a second resolution higher than the first resolution. The conversion is based on a parameter indicating a ratio of high-frequency component pixels of the first video signal to be interpolated and pixels forming the first video signal to be interpolated. The controller is configured to change the parameter based on a type of broadcast wave of the first video signal. The type of broadcast wave may include, but is not limited or restricted to satellite broadcasting or terrestrial broadcasting.

Abstract: In a method for processing video signals acquired from multiple cameras, the present invention provides a method for processing video signals including receiving a multiview video coded bit stream including color pictures and depth pictures, wherein the depth picture indicates a group of digitalized information on a distance between a base camera and an object; acquiring data type identification information from the multiview video coded bit stream, wherein the data type identification information indicates whether or not depth-coded data are included in the multiview video coded bit stream; acquiring reference information between views of the depth picture based upon the data type identification information, wherein the reference information between views of the depth picture includes a number of depth-view reference pictures, and a view identification number of the depth-view reference picture; acquiring an estimation value of the depth picture by using the reference information between views of the depth p

Abstract: A 3D image control apparatus receives from shutter glasses an identification signal for identifying a type of the shutter glasses, reading a shutter opening and closing characteristic of the shutter glasses of the type identified based on the identification signal from a storage unit storing shutter characteristics of the shutter glasses in association with the type of the shutter glasses. The 3D image control apparatus controls display timing of an image display unit based on the shutter opening and closing characteristic in such a manner that display periods of the right eye image and the left eye image are respectively within opening periods of the right shutter and the left shutter.

Abstract: A 3D color image sensor and a 3D optical imaging system including the 3D color image sensor are provided. The 3D color image sensor includes a semiconductor substrate, having a plurality of first photodiodes and a plurality of second photodiodes, and a wiring layer formed under the first photodiodes and the second photodiodes. A light filter array layer is disposed on the first and the second photodiodes, having a plurality of color filter patterns and infrared (IR) light filter patterns, wherein each of the IR light filter patterns receives depth information of 3D color image of an object and corresponds to the first photodiode, and each of the color filter patterns receives color image information of 3D color image of the object and corresponds to the second photodiode.

Abstract: An apparatus and method for obtaining a three-dimensional image. A first multi-view image may be generated using patterned light of infrared light, and a second multi-view image may be generated using non-patterned light of visible light. A first depth image may be obtained from the first multi-view image, and a second depth image may be obtained from the second multi-view image. Then, stereo matching may be performed on the first depth image and the second depth image to generate a final depth image.

Abstract: There is described a method to synchronize the orientation of an IGD 3D Coordinate System and the orientation of a 3DM 3D Coordinate System, in which the IGD's gravity direction measurement device and electronic compass are used explicitly. There is also described how an IGD, once its orientation has been synchronized to the orientation of a 3DM, can be used to display 3D graphics that guide the measurement process.

Abstract: A communication network comprising a collaborative photography group including a plurality of cameras having synchronized photographing times, is provided. The plurality of cameras may share location information, direction angle information, and image information generated by photographing an object, and generate a three-dimensional (3D) image of the object.

Abstract: Disclosed herein is a system which transmits an image using a lossless compression method in a robot to provide a service over a network and a method thereof. The network-based robot separates an image acquired by a stereo camera into various image formats and transmits the various image formats to a service server. The service server synthesizes the separated image formats to suit an image request such as face recognition, object recognition, navigation or monitoring to restore and provide an original image. When the network-based robot transmits the separated image formats to the server, the original image is transmitted using the lossless method to improve the performance of the server. Even when a service using a new image is added, separated images are transmitted with respect to the image format requested by this service to more flexibly cope with the service using the new image. Since channels are separated in order to receive lossless data, network gain is obtained.

Abstract: An apparatus and method which display a three dimensional (3D) video signal, the apparatus comprising: a receiver which receives a video signal; a video signal processor which processes the received video signal; a display unit which displays thereon the processed video signal; and a controller which, in response to the received video signal being a 3D video signal, controls the video signal processor to convert the received 3D video signal into a two dimensional (2D) video signal, and displays the 2D video signal on the display unit.

Abstract: A dual lens camera for producing a three-dimensional image includes plural lens systems and a zoom mechanism. Initial correction data is constituted by a displacement vector of an amount and a direction of misalignment between plural images according to a superimposed state thereof for each of zoom positions of the lens systems. A vector detector, if a calibration mode is set, obtains a current displacement vector related to one first zoom position. A data processor outputs current correction data by adjusting the initial correction data according to the initial correction data and current displacement vector. If the current correction data is stored, a displacement vector is obtained from the current correction data according to a zoom position of the lens systems upon forming the plural images, to carry out image registration between the images according to the obtained displacement vector for producing the three-dimensional image.

Abstract: To make it possible to stably provide a stereoscopic image which can be viewed by each viewer in the state where the stereoscopic effect and the sense of reality are maximized. Left eye and right eye images (images for measurement), the parallax between which is continuously or stepwise changed, are outputted beforehand to a stereoscopic image display device, and the face of the viewer viewing the images for measurement is photographed. The pupil width of the photographed viewer is measured, and based on the state of the change in the pupil width, the fusion limit of the viewer is measured and registered. In the case where a stereoscopic image for appreciation is displayed, the stereoscopic image is outputted by controlling the parallax of the stereoscopic image so as to prevent the parallax from exceeding the fusion limit of the viewer, which is measured beforehand.

Abstract: A three-dimensional (3D) compressing method and apparatus is disclosed. The 3D video compressing apparatus determines whether a motion of consecutive frames exists when a depth of a multi-view video is estimated, performs a depth estimation when the motion exists, and compresses the 3D video by using a color video motion vector as a depth video motion vector.

Abstract: The invention relates to an optical measurement device with an image acquisition unit, which has at least two camera units (10) on a holding structure, assigned to each other, using local arrangement and alignment. A stable, low-cost design is obtained by the fact that the holding structure has a one-piece supporting body (1) with mounting structures molded thereon, in which the camera units (10) are accommodated (FIG. 2).

Abstract: A lens and aperture device for determining 3D information. An SLR camera has a lens and aperture that allows the SLR camera to determine defocused information.

Abstract: A 3-dimensional (3D) video receiver may be operable to convert a decompressed 3D video frame having a 3D video interlaced format to generate a first 3D video frame having a first 3D video progressive format by performing an inverse pulldown. The generated first 3D video frame having the first 3D video progressive format may be converted to generate a second 3D video frame having a second 3D video progressive format. The generated first 3D video frame having the first 3D video progressive format may be scaled to generate the second 3D video frame having the second 3D video progressive format. When the 3D video receiver is operating in an electronic program guide (EPG) mode or in a graphics over video mode, the generated second 3D video frame having the second 3D video progressive format may be blended with graphics.

Abstract: A system and method for displaying images in three dimensions. The system may include a dual axis four lens system, four LCD switching elements, a pair of LCD switched dual filtered dichroic mirrors, and a pair of half silvered dichroic color filter elements, and two charge coupled device pickups. The system may process light through a number of axis to produce optical disparity for presenting three dimensional video.

Abstract: An image capturing system including a plurality of image capturing stations, wherein each of the image capturing stations captures a first image and a second image of an object and transmits the captured images, the first image and the second image of the object being from different perspectives; and a processor in communication with each of the image capturing stations, the processor adapted to transmit a control signal to each of the image capturing stations, receive each of the captured images, process the captured images, and transmit the processed captured images, wherein the processing of the captured images includes combining the images to appear as a seamless single rotational image viewable in at least one of a two-dimensional and a three-dimensional format.