Abstract: Enabling height recognition processing by setting a height of an arbitrary plane to zero for convenience of the recognition processing. A parameter for three-dimensional measurement is calculated and registered through calibration and, thereafter, an image pickup with a stereo camera is performed on a plane desired to be recognized as having a height of zero in actual recognition processing. Three-dimensional measurement using the registered parameter is performed on characteristic patterns (marks m1, m2 and m3) included in this plane. Based on a positional relationship between a plane defined as having a height of zero through the calibration and the plane expressed by the calculation equation, a transformation parameter (a homogeneous transformation matrix) for displacing points in the former plane into the latter plane is determined, and the registered parameter is changed using the transformation parameter.

Abstract: A 3D camera and a mobile terminal having the same include a plurality of cameras capturing a 3D image, a camera printed circuit board (PCB) to which the plurality of cameras are coupled, and a bracket coupled to at least one of the plurality of cameras and the camera PCB, and preventing movement of the plurality of cameras. The bracket has a coupling recess provided such that at least one other PCB is coupled thereto.

Abstract: The invention relates to the remote measurement of the dielectric permittivity of dielectrics. A 3D microwave and a 3D optical range images of an interrogated scene are recorded at the same time moment. The images are digitized and overlapped. A space between the microwave and optical image is measured, and a dielectric permittivity of the space between these images is determined. If the dielectric permittivity is about 3, then hidden explosive materials or components of thereof are suspected. The invention makes it possible to remotely determine the dielectric permittivity of a moving, irregularly-shaped dielectric objects.

Abstract: A system of stereo imagers, including image processing units and methods of blurring an image, is presented. The image is received from an image sensor. For each pixel of the image, a depth filter component is determined based on a focal area of the image and a depth map associated with the image. For each pixel of the image, a trilateral filter is generated that includes a spatial filter component, a range filter component and the depth filter component. The respective trilateral filter is applied to corresponding pixels of the image to blur the image outside of the focal area. A refocus area or position may be determined by imaging geometry or may be selected manually via a user interface.

Abstract: There is provided an image processing device including capturing portions that respectively capture a first image and a second image that form an image for a right eye and an image for a left eye which can be stereoscopically viewed in three dimensions, a comparison portion that compares the first image and the second image captured by the capturing portions, a determination portion that determines, based on a comparison result of the comparison portion, which of the first image and the second image is the image for the right eye and which is the image for the left eye, and an output portion that outputs each of the first image and the second image, as the image for the right eye and the image for the left eye, based on a determination result of the determination portion.

Abstract: A stereo camera module includes a substrate provided with a plurality of installation brackets, a plurality of camera modules rotatably coupled to the installation brackets, a rotating part provided on the installation brackets so as to be rotatably coupled to a rotation coupling part provided on the camera modules, a driving unit provided on the installation brackets for rotatably driving the camera modules using magnetic force, and a control unit for adjusting the magnetic force generated by the driving unit by applying a current, which corresponds to inputted angle-adjustment data, to the driving unit to thereby control the rotation of the camera modules using the adjusted magnetic force.

Abstract: An image display device and controlling method thereof are disclosed, by which a 3D stereoscopic image are more comfortably appreciated in consideration of appreciation environment. In a mobile terminal including a display unit configured to variably display a 2D (2-dimensional) image and a 3D stereoscopic image of a parallax barrier type, the present invention includes determining a play mode of a source image including a left eye image and a right eye image for implementation of the 3D stereoscopic image, if the determined play mode is a 3D play mode, determining a brightness of the source image, and enhancing an output brightness of the source image in accordance with an output brightness of the source image.

Abstract: A stereoscopic imaging apparatus includes: an objective optical system acquiring light rays emitted from a subject and guiding the light rays to a downstream component; a separation optical system having a partially reflective surface reflecting part of the light rays and transmitting part thereof; first image forming optical system disposed on a path along which the light rays reflected off the separation optical system travel and focusing the reflected light rays to form a parallax image; second image forming optical system disposed on a path along which the light rays passing through the separation optical system travel and focusing the transmitted light rays to form a parallax image; a first imaging device converting the parallax image formed by the first image forming optical system into an image signal; and a second imaging device converting the parallax image formed by the second image forming optical system into an image signal.

Abstract: An apparatus and method generate a three-dimensional image by determining, using a light-field camera, a depth map corresponding to an environment. The depth map represents how light falls in the environment. The method also includes determining a parallax occlusion map of the environment and creating, using the depth map and the parallax occlusion map, a three-dimensional image representing the environment. In some embodiments, the method includes taking a first picture of the environment with a first flash intensity and a second picture of the environment with a greater second flash, determining differences between the first picture of the environment and the second picture of the environment, determining one or more properties of the environment based at least in part on the determined differences and dynamically re-lighting the three-dimensional image using the depth map, the parallax occlusion map, and one or more of the determined properties of the environment.

Abstract: An automated three dimensional mapping method estimating three dimensional models taking advantage of a plurality of images. Positions and attitudes for at least one camera are recorded when images are taken. The at least one camera is geometrically calibrated to indicate the direction of each pixel of an image. A stereo disparity is calculated for a plurality of image pairs covering a same scene position setting a disparity and a certainty measure estimate for each stereo disparity. The different stereo disparity estimates are weighted together to form a 3D model. The stereo disparity estimates are reweighted automatically and adaptively based on the estimated 3D model.

Abstract: Stabilization, via active-feedback positional drift-correction, of an optical microscope imaging system in up to 3-dimensions is achieved using the optical measurement path of an image sensor. Nanometer-scale stability of the imaging system is accomplished by correcting for positional drift using fiduciary references sparsely distributed within or in proximity to the experimental sample.

Abstract: A light amount adjusting apparatus includes: a two-dimensional (2D) aperture assembly that adjusts an opening area of a via hole through which light is transmitted; a three-dimensional (3D) aperture plate that forms a first opening and a second opening by blocking a part of the via hole, or moving to outside of the via hole to open the via hole; a first shielding plate that is movable to open or close the first opening; and a second shielding plate that is movable so as to close the second opening when the first shielding plate opens the first opening and to open the second opening when the first shielding plate closes the first opening.

Abstract: The embodiments of the present invention relates to a method and a processor for representing a 3D scene. In the method, one 3D component of the 3D scene to be represented, captured at least three different views (v1, v2, v3) is projecting to a predefined view (vF). A value associated with each projected view regarding the 3D component is then determined and consistency among the projected views regarding the 3D component is detected. Moreover, a consistency value regarding the 3D component is determined based on the determined values associated with the respective projected view, and the determined values are replaced by the determined consistency value on at least one of the three projected 3D components.

Abstract: Various configurations of cameras and cameral elements such as CCDs or the like are disclosed for use in three-dimensional imaging of interior spaces based upon distance measurements.

Abstract: A 3D image signal processing device performs a signal processing on at least one image signal of a first viewpoint signal as an image signal generated at a first viewpoint and a second viewpoint signal as an image signal generated at a second viewpoint different from the first viewpoint. The device includes an image processor that executes a predetermined image processing on at least one image signal of the first viewpoint signal and the second viewpoint signal, and a controller that controls the image processor. The controller controls the image processor to perform an feathering process on at least one image signal of the first viewpoint signal and the second viewpoint signal, the feathering process being a process for smoothing pixel values of pixels positioned on a boundary between an object included in the image represented by the at least one image signal and an image adjacent to the object.

Abstract: A portable electronic device includes a first image capturing device that is configured to capture a first image in substantially a first direction at a first position and a second image in at least substantially a second direction at a second position. A second image capturing device is configured to capture a third image in substantially the first direction at a third position. A processor is coupled to the first and second image capturing devices for generating a representation of a stereoscopic image based on the first and third images.

Abstract: A method and scanner system for scanning interior surfaces include providing a probe shaped scanner having an axis, the probe shaped scanner includes at least one light source configured to create and project structured light, and at least one camera configured to record 2D images; entering the probe shaped scanner into a cavity of an object, where the cavity is bounded by an interior surface of the object; creating and projecting structured light from the light source of the probe producing a pattern on the interior surface of the object; recording a series of 2D images of the reflection of the pattern from the interior surface using the camera; combining the series of 2D images to obtain 3D real world coordinates of the interior surface; and providing data and processing the data such that surface information for areas of the surface, where image scanning is not complete, is created.

Abstract: An image sensor having a pixel structure for capturing a depth image and a color image. The image sensor has a pixel structure that shares a floating diffusion (FD) node and a readout node, and operates with different pixel structures, according to a depth mode and a color mode.

Abstract: A stereoscopic imaging system includes: first and second imaging control units respectively controlling the operation of first and second imaging devices outputting first and second image signals in first and second processing frames according to incident light on a subject through first and second lenses; first and second access control units respectively controlling access to first and second image signal recording mediums recording the first and second image signals in the first and second processing frames; a first synchronization control unit notifying, if the capacity of a first image signal recording medium accessed by the first access control unit is insufficient, the timing of switching access to another first image signal recording medium; and a second synchronization control unit controlling switching access to another second image signal recording medium different from the second image signal recording medium accessed by the second access control unit in synchronization with the notified timing.

Abstract: Provided is a three-dimensional measuring method that can select a large number of line sections for calculating formulas of three-dimensional lines to perform three-dimensional measurement of a measurement object.

Abstract: A three-dimensional imaging unit includes a plurality of image pickup devices that image an image and a rotation drive device which rotates the image pickup devices and adjusts optical axes such that reflections of an object to be measured in a space to be measured have a predetermined amount of overlap. An association calculating unit calculates position association information of pixels when a required measurement point is mapped onto a plurality of images. A three-dimensional shape calculating unit calculates a three-dimensional shape of the object to be measured using the position association information and rotational information of the rotation drive device. A three-dimensional shape estimation calculating unit estimates, from the three-dimensional shape, a three-dimensional shape of a region of the object to be measured where the three-dimensional shape is not obtained.

Abstract: A 3D rendering method is proposed to increase the performance when projecting and compositing multiple images or video sequences from real-world cameras on top of a precise 3D model of the real world. Unlike previous methods that relied on shadow-mapping and that were limited in performance due to the need to re-render the complex scene multiple times per frame, the proposed method uses, for each camera, one Camera Projection Mesh (“CPM”) of fixed and limited complexity per camera. The CPM that surrounds each camera is effectively molded over the surrounding 3D world surfaces or areas visible from the video camera. Rendering and compositing of the CPMs may be entirely performed on the Graphic Processing Unit (“GPU”) using custom shaders for optimal performance. The method also enables improved view-shed analysis and fast visualization of the coverage of multiple cameras.

Abstract: Embodiments of imaging devices of the present disclosure automatically utilize simultaneous image captures in an image processing pipeline. In one embodiment, control processing circuitry initiates simultaneous capture of the first image by the first image sensor and the second image by the second image sensor; and image processing circuitry generates an enhanced monoscopic image comprising at least portions of the first image and the second image.

Abstract: A system and method receives image or video feeds from at least two cameras positioned on a platform such as a vehicle, to view a scene from different viewing points. A relative displacement between the video feeds may be selected (e.g., pre-selected, or selected by a system), and display of the feeds may be alternated on a display a chosen flicker or alternation rate, where the video feeds are displaced at the relative displacement.

Abstract: A handheld digital camera device including: a digital camera unit having a first image sensor for capturing images and a color display for displaying captured images to a user; an integral processor configured for: controlling operation of the first image sensor and color display; decoding an imaged coding pattern printed on a substrate, the printed coding pattern employing Reed-Solomon encoding; and performing an action in the handheld digital camera device based on the decoded coding pattern. The decoding includes the steps of: detecting target structures defining an extent of a data area; determining the data area using the detected target structures; and Reed-Solomon decoding the coding pattern contained in the determined data area.

Abstract: An apparatus, a system, and a method for recording a multi-view video and processing images, and a decoding method are disclosed. The apparatus for recording a multi-view video and processing images includes a video recording unit, a collecting unit, a selecting unit, and an encoding unit, which are connected in sequence. The video recording unit is configured to record a video including recording a multi-view video, and output 3D video data. The collecting unit is configured to collect 3D video data output by the video recording unit. The selecting unit is configured to select at least one channel of data among the 3D video data. The encoding unit is configured to encode data including encoding the 3D video data selected by the selecting unit.

Abstract: A camera system including: a substrate having a coding pattern printed thereon and a handheld digital camera device. The camera device includes: a digital camera unit having a first image sensor for capturing images and a color display for displaying captured images to a user; an integral processor configured for: controlling operation of the first image sensor and color display; decoding an imaged coding pattern printed on a substrate, the printed coding pattern employing Reed-Solomon encoding; and performing an action in the handheld digital camera device based on the decoded coding pattern. The decoding includes the steps of: detecting target structures defining the extent of the data area; determining the data area using the detected target structures; and Reed-Solomon decoding the coding pattern contained in the determined data area.

Abstract: An electronic camera includes an imager. An imager repeatedly outputs an image indicating a space captured on an imaging surface. A displayer displays the image outputted from the imager. A superimposer superimposes an index indicating a position of at least a focal point onto the image displayed by the displayer. A position changer changes a position of the index superimposed by the superimposer according to a focus adjusting operation. A setting changer changes a focusing setting in association with the process of the position changer.

Abstract: A three-dimensional camera rig includes multiple lenses located along a mounting mechanism, where the multiple lenses are separated at an interocular distance along the mounting mechanism necessary to capture a three-dimensional image capable of distribution, and where the three-dimensional image is viewable in a plurality of formats.

Abstract: A method for determining three-dimensional coordinates of an object point on a surface of an object, the method including steps of: sending a beam of light to a diffraction grating; sending a first diffracted beam and a second diffracted beam to an objective lens to form at least two spots of light, which are passed through transparent regions of a plate to produce a first fringe pattern on the surface of the object; imaging the object point illuminated by the first fringe pattern onto a photosensitive array to obtain a first electrical data value; moving the plate to a second position; sending spots through plate to produce a second fringe pattern on the surface of the object; imaging the point onto the array point to obtain a second electrical data value; and calculating the three-dimensional coordinates of the first object point.

Abstract: The amount of parallax of a 3D image can be adjusted by intuitive operation. A zoom lever is thrown to telephoto side to cause the graphic processing unit to generate images for the left eye and the right eye adjusted such that a position where a component is drawn is far from a center line and the zoom lever is thrown to wide angle side to cause the graphic processing unit to generate images for the left eye and the right eye adjusted such that the position where the component is drawn is near the center line.

Abstract: There is a communicating of 3D video having associated metadata. The communicating may involve devices and includes receiving a first video bitstream with the 3D video encoded in a first format, receiving the associated metadata. The communicating also includes forming a protocol message, utilizing a processor, including the associated metadata. The communicating also includes transmitting a second video bitstream with the 3D video encoded in a second format and transmitting the protocol message separate from the second video bitstream. The protocol message includes data fields holding processing data, based on the associated metadata, describing the rendering of the 3D video. The processing data is operable to be read and utilized to direct a client device to process the 3D video extracted from a video bitstream and present the 3D video on a display. Also, there is a processing of the 3D video. The processing utilizes the protocol message.

Abstract: There is provided an image processing apparatus including a first polarizing unit that has a first polarization region and a second polarization region to transmit different polarized light corresponding to different viewing point images, a second polarizing unit that includes a third polarization region to transmit only transmission light of the first polarization region, a fourth polarization region to transmit only transmission light of the second polarization region, and a total transmission region to transmit the total transmission light of the first polarization region and the second polarization region, an imaging element, and an image processing unit that executes signal processing with respect to an output signal of the imaging element. The image processing unit executes correction processing to generate a two-dimensional image and executes image conversion of the two-dimensional image to generate a left eye image and a right eye image for three-dimensional image display.

Abstract: A method and apparatus for reducing convergence accommodation conflict. The method includes estimating disparities between images for different lens, analyzing the estimated disparities, selecting a point of convergence, determining the amount of shift relating to the convergence point selected, and performing adjustment to the disparity to maintain a disparity value below a threshold.

Abstract: According to the embodiment, a camera module has a variable aperture unit and a control driver. In the variable aperture unit, switching is made between transmitting and blocking of the light incident from the imaging lens for each region. In the variable aperture unit, at least one of an area and a position of the transmissive region for transmitting light can be changed. The control driver can adjust the imaging timing of the image sensor in response to at least one of the area and the position of the transmissive region.

Abstract: An augmentation device for an imaging system has a bracket structured to be attachable to an imaging component, and a projector attached to the bracket. The projector is arranged and configured to project an image onto a surface in conjunction with imaging by the imaging system. A system for image-guided surgery has an imaging system, and a projector configured to project an image or pattern onto a region of interest during imaging by the imaging system. A capsule imaging device has an imaging system, and a local sensor system. The local sensor system pro-vides information to reconstruct positions of the capsule endoscope free from external monitoring equipment.

Abstract: A system and method for locating and displaying aircraft information, such as three-dimensional models and various information about an aircraft component. The system may include a portable display, a remote processor, and one or more location and/or orientation-determining components. The models and other various information displayed on the portable display may correspond with a location and orientation of the portable display relative to the aircraft component. The location and/or orientation-determining components may include one or more infrared cameras for communicating with the remote processor and a plurality of infrared targets or infrared markers. The remote processor may be configured to filter the information provided to the portable display based on the portable display's location and orientation relative to the aircraft component, geographic location, user input, or other various parameters.

Abstract: A system is provided for use with a video input signal and a video unit. The video input signal can be one of a two dimensional video signal and a three dimensional video signal. The video unit can display a three dimensional video and a two dimensional video. The system includes a receiver portion, a processing portion, a switching portion and an output portion. The receiver portion can receive the video input signal. The processing portion can output a first signal in a first mode of operation and can output a second signal in a second mode of operation, wherein the first signal is based on the video input signal and the second signal is based on the video input signal. The switching portion can switch the processing portion from the first mode of operation to the second mode of operation.

Abstract: An image capture device includes a lens arrangement having a first lens associated with a first digital image sensor and a second lens associated with a second digital image sensor; the first digital image sensor having photosites of a first predetermined color pattern for producing a first digital image; the second digital image sensor having photosites of a different second predetermined color pattern for producing a second digital image. The image capture device also includes a device for causing the lens arrangement to capture a first digital image from the first digital image sensor and a second digital image from the second digital image sensor at substantially the same time; a processor aligning the first and second digital images; and the processor using values of the second image based on the alignment between the first and second images operates on the first digital image to produce the enhanced digital image.

Abstract: A portable hand-held device is provided having a digital camera and a processor. The digital camera has two image sensors respectively arranged to capture corresponding images of the same scene. The processor image processes the images captured by the image sensors so as to output three dimensional stereoscopic images. The processor has two interfaces for respectively receiving the images captured by the image sensors.

Abstract: A method and device are provided for time-sequential recording of three-dimensional images each of which has at least one first and one second partial image. The device has a sensor (13) with pixels (16) subdivided into two mutually different pixel groups. An imaging optical unit has a switchable changeover device (9) that images the partial images of the three-dimensional image time-sequentially onto the sensor (13). A control unit is connected to the sensor (13) and the changeover device (9) to control the reading of the sensor (13) and the switching states of the changeover device (9) so that the changeover device (9), during the imaging of the partial images onto the sensor (13) assumes at least one switching state in which excerpts of different partial images are fed to the different pixel groups of the sensor (13).

Abstract: Systems and methods are disclosed that determine a mapping between a first camera system's coordinate system and a second camera system's coordinate system; or determine a transformation between a robot's coordinate system and a camera system's coordinate system, and/or locate, in a robot's coordinate system, a tool extending from an arm of the robot based on the tool location in the camera's coordinate system. The disclosed systems and methods may use transformations derived from coordinates of features found in one or more images. The transformations may be used to interrelate various coordinate systems, facilitating calibration of camera systems, including in robotic systems, such as an image-guided robotic systems for hair harvesting and/or implantation.

Abstract: A method, apparatus, system, and computer program product for of digital imaging. Multiple cameras comprising lenses and digital images sensors are used to capture multiple images of the same subject, and process the multiple images using difference information (e.g., an image disparity map, an image depth map, etc.). The processing commences by receiving a plurality of image pixels from at least one first image sensor, wherein the first image sensor captures a first image of a first color, receives a stereo image of the first color, and also receives other images of other colors. Having the stereo imagery, then constructing a disparity map and an associated depth map by searching for pixel correspondences between the first image and the stereo image. Using the constructed disparity map, captured images are converted into converted images, which are then combined with the first image, resulting in a fused multi-channel color image.

Abstract: From a bit stream, at least the following are decoded: a stereoscopic image of first and second views; a maximum positive disparity between the first and second views; and a minimum negative disparity between the first and second views. In response to the maximum positive disparity violating a limit on positive disparity, a convergence plane of the stereoscopic image is adjusted to comply with the limit on positive disparity. In response to the minimum negative disparity violating a limit on negative disparity, the convergence plane is adjusted to comply with the limit on negative disparity.

Abstract: A three-dimensional imaging device (10) according to an aspect of the present invention, which outputs first and second viewpoint images due to a pupil division on a light flux from a single imaging optical system (12, 14), includes a defocus map calculation unit (61) calculating a defocus map representing a defocus amount at each position in the first and second viewpoint images; a restoration filter storage (62) storing restoration filters corresponding to the defocus amount and an image height at each position in the viewpoint images, the restoration filters being deconvolution filters based on a point image intensity distribution representing an imaging performance of the imaging optical system; and a restoration unit (63) selecting a restoration filter, which corresponds to the defocus amount and the image height at each position in the viewpoint images, for each position in the first and second viewpoint images, and restoring the first and second viewpoint images by performing a deconvolution for each p

Abstract: A system described herein includes a receiver component that receives a first digital image from a color camera, wherein the first digital image comprises a planar object, and a second digital image from a depth sensor, wherein the second digital image comprises the planar object. The system also includes a calibrator component that jointly calibrates the color camera and the depth sensor based at least in part upon the first digital image and the second digital image.

Abstract: This invention is of the electronic endoscope providing 3-dimensional image data which is inserted into the patient's body. It contains the frame in a tube shape forming the hollow; A pair of link members located side by side in the hollow of the frame; The filming part forming the link joint where the moving axis are connected on both side of the back to connect to the end of the link member, filming element where a pair of lens are installed at regular distance on the front, and the illuminator throwing a light on the affected area. It is able to minimize the incision during surgery by minimizing the circumference of the endoscope frame with link member.

Abstract: A dynamic scene is reconstructed as depths and an extended depth of field video by first acquiring, with a camera including a lens and sensor, a focal stack of the dynamic scene while changing a focal depth. An optical flow between the frames of the focal stack is determined, and the frames are warped according to the optical flow to align the frames and to generate a virtual static focal stack. Finally, a depth map and a texture map for each virtual static focal stack is generated using a depth from defocus, wherein the texture map corresponds to an EDOF image.

Abstract: A three-dimensional image capturing apparatus generates depth information to be used for generating a three-dimensional image from an input image, and includes: a capturing unit obtaining the input image in capturing; an object designating unit designating an object in the input image; a resolution setting unit setting depth values, each representing a different depth position, so that in a direction parallel to a depth direction of the input image, depth resolution near the object is higher than depth resolution positioned apart from the object, the object being designated by the object designating unit; and a depth map generating unit generating two-dimensional depth information corresponding to the input image by determining, for each of regions in the input image, a depth value, from among the depth values set by the resolution setting unit, indicating a depth position corresponding to one of the regions.

Abstract: It is an object to measure a position of a feature around a road. An image memory unit stores images in which neighborhood of the road is captured. Further, a three-dimensional point cloud model memory unit 709 stores a point cloud showing three-dimensional coordinates obtained by laser measurement which is carried out simultaneously to the image-capturing of the images as a road surface shape model. Using an image point inputting unit 342, a pixel on a feature of a measurement target is specified by a user as a measurement image point. A neighborhood extracting unit 171 extracts a point which is located adjacent to the measurement image point and superimposed on the feature for the measurement target from the point cloud. A feature position calculating unit 174 outputs three-dimensional coordinates shown by the extracted point as three-dimensional coordinates of the feature for the measurement target.