Abstract: Methods and devices for generating a stereoscopic image are described. In one aspect, the electronic device includes a first camera for generating first camera data, a second camera for generating second camera data and a third camera for generating third camera data. The cameras are positioned on a same side of the electronic device and in spaced relation to each other. The electronic device also includes a controller coupled with the first camera, the second camera and the third camera. The controller is configured to: identify an orientation of the electronic device; and generate a stereoscopic image based on the first camera data and the second camera data when the electronic device is at a first orientation, and generate the stereoscopic image based on the first camera data and the third camera data when the electronic device is at a second orientation.

Abstract: The present invention relates to an annotating method comprising the steps of: capturing (100) data representing a light field with a plenoptic image capture device (4); matching (101) the captured data with a corresponding reference data; retrieving an annotation associated with an element of said reference data (102); rendering (103) a view generated from said captured data and including at least one annotation.

Abstract: Methods and devices for generating a stereoscopic image are described. In one aspect, the electronic device includes a main body and a support rotatably coupled with the main body about an axis of rotation. The support is rotatable between a plurality of positions including a first position and a second position. The electronic device also includes a first camera module for generating first camera data and a second camera module for generating second camera data. The second camera module is positioned in spaced relation to the first camera module and coupled to the support away from the axis of rotation. The electronic device further includes a controller coupled with the first camera module and the second camera module.

Abstract: Described are methods and apparatus for adjusting images of a stereoscopic image pair. The methods and apparatus may capture a first and second image with first and second imaging sensors. The two imaging sensors have intrinsic and extrinsic parameters. A normalized focal distance of a reference imaging sensor may also be determined based on intrinsic and extrinsic parameters. A calibration matrix is then adjusted based on the normalized focal distance. The calibration matrix may be applied to an image captured by a image sensor.

Abstract: A stereographic camera system and method of operating a stereographic camera system. A camera platform may include a first camera head including first left and right cameras separated by a first interocular distance, the first camera head providing first left and right video streams, and a second camera head aligned with the first camera head, the second camera head including second left and right cameras separated by a second interocular distance, the second camera head providing second left and right video streams. An output selector may select either the first left and right video streams or the second left and right video streams to output as a 3D video output. The first interocular distance may be settable over a first range, and the second interocular distance may be settable over a second range, at least a portion of the second range smaller than the first range.

Abstract: A controlled three-dimensional (3D) communication endpoint system and method for simulating an in-person communication between participants in an online meeting or conference and providing easy scaling of a virtual environment when additional participants join. This gives the participants the illusion that the other participants are in the same room and sitting around the same table with the viewer. The controlled communication endpoint includes a plurality of camera pods that capture video of a participant from 360 degrees around the participant. The controlled communication endpoint also includes a display device configuration containing display devices placed at least 180 degrees around the participant and display the virtual environment containing geometric proxies of the other participants. Placing the participants at a round virtual table and increasing the diameter of the virtual table as additional participants are added easily achieves scalability.

Abstract: An apparatus and method for a video capture device for recording 3 Dimensional (3D) stereoscopic video with motion sensors is provided are provided. The apparatus includes includes a camera unit having one lens for capturing video, a video encoder/decoder for encoding the captured video, a motion sensor for capturing motion data of the video capture device corresponding to the captured video, and a controller for controlling the video encoder/decoder and motion sensor to encode the captured video with the captured motion data.

Abstract: A stereoscopic image with a predetermined parallax can be automatically taken, and a stereoscopic image with an arbitrary parallax can also be taken based on selection made by a photographer. An imaging apparatus includes two or more imaging systems. First, a guidance indicating that a first imaging system is used to take a first image and that a second imaging system is used to take a second image, is displayed on a monitor of the imaging apparatus. After the first image is shot by the first imaging system, a live view image shot by the second imaging system is displayed in a semi-transparent manner with the shot first image on the monitor, and a guidance is also displayed on the monitor. When the release switch is depressed, the second image is shot by the right imaging system.

Abstract: A system and method for stereoscopic image capture. The method includes capturing a first image with a first camera and capturing a second image with a second camera. The second camera comprises a lower resolution sensor than a sensor of the first camera. The method further includes determining a third image based on adjusting the first image to a resolution of the lower resolution sensor of the second camera and generating a stereoscopic image comprising the second image and the third image.

Abstract: In free space detection system and method for a vehicle, left and right images captured from the vehicle environment in a direction of travel of the vehicle are transformed to obtain a depth image with disparity values. The depth image is transformed to obtain a road function and an occupancy grid map. A cost estimation value corresponding to each disparity value on the same image column in a detecting area of the occupancy grid map is estimated using a cost function and the road function such that initial boundary disparity values each defined by one disparity value on the same image column whose the cost estimation value is maximum are optimized to obtain optimized boundary disparity values by which a free space is determined.

Abstract: Disclosed herein is a method for counting the number of the targets using the layer scanning method. The steps of this method includes constructing a background frame, filtering the noise of foreground frame and classifying the targets, and screening the area of targets based on layer scanning to calculate the number of targets by determining the highest positions of the respective targets. In addition, the dynamic numbers of targets are calculated using algorithm. Accordingly, the present invention is beneficial in automatically, effectively and precisely calculating the number of the targets in/out a specific area, achieving the flow control for targets and reducing artificial error upon calculation.

Abstract: In a particular embodiment, a method includes evaluating, at a mobile device, a first area of pixels to generate a first result. The method further includes evaluating, at the mobile device, a second area of pixels to generate a second result. Based on comparing a threshold with a difference between the first result and the second result, a determination is made that the second area of pixels corresponds to a background portion of a scene or a foreground portion of the scene.

Abstract: A camera objective for a camera includes a mask having a plurality of masking sections which are permeable for radiation of a first spectral range and are impermeable for radiation of a second spectral range different from the first spectral range. A camera system includes a digital camera for taking images. The camera system includes such a camera objective and an optoelectronic sensor arrangement having a plurality of sensor elements for generating exposure-dependent received signals which form a respective image. The plurality of sensor elements includes a first group of sensor elements for generating received signals in dependence only on radiation of the first spectral range and a second group of sensor elements for generating received signals in dependence on radiation of the second spectral range.

Abstract: This document describes various apparatuses and techniques for changing perspectives of a microscopic-image device based on a viewer's perspective. Various embodiments of these techniques sense a change to a viewer's perspective based on the viewer's head position and control a microscopic-image device effective to display images of an object based on the change to the viewer's perspective.

Abstract: Disclosed are an apparatus and method for processing a digital signal including a 3D image. The apparatus includes a receiver for receiving a first digital signal including a main image and a second digital signal including an additional image, the main image and the additional image being 3D images, and the additional image being an expanded image of the main image seamlessly connected to an edge region of the main image, an image processor for generating the main image and the additional image to output a 3D image by decoding the first and second digital signals, and a display unit for displaying the output 3D image. The display unit includes a first display unit for displaying the main image, and a transparent second display unit connected to an edge of the first display unit, the second display unit configured to display the additional image.

Abstract: An exemplary embodiment providing one or more improvements includes an endoscopic synthetic stereo imaging method and apparatus which can produce a stereo image of a field of view of a working assembly of the endoscope.

Abstract: Various embodiments of TOF depth cameras and methods for illuminating image environments with illumination light are provided herein. In one example, a TOF depth camera configured to collect image data from an image environment illuminated by illumination light includes a light source including a plurality of surface-emitting lasers configured to generate coherent light. The example TOF camera also includes an optical assembly configured to transmit light from the plurality of surface-emitting lasers to the image environment and an image sensor configured to detect at least a portion of return light reflected from the image environment.

Abstract: A stereo image displaying system including an image displaying apparatus and an imaging element is provided. The image displaying apparatus displays image beams along an optic axis. The imaging element has a curved-surface. The curved-surface receives the image beams and converts the image beams into deformation images. The imaging element transmits the deformation images. Furthermore, a stereo image capturing system is also provided.

Abstract: The present invention discloses a naked eye 3D video system for backing a vehicle and vehicles including the system. The naked eye 3D video system includes: two cameras for being installed on the rear of the vehicle and configured to capture images of the scene behind the vehicle respectively; a processor configured to divide the images captured by the two cameras into image strips in equidistance respectively, and integrate alternatively the divided image strips together into a integrated image in the manner of interleave; and a display device for being installed on the instrument panel of the vehicle, and configured to display the integrated image in the form of three dimensions for a driver to watch with the naked eye. The above naked eye 3D video system for backing a vehicle provided by the present invention can make the driver see clearly any obstacle in the scene behind the vehicle and understand spatial distribution information between the vehicle and the obstacle.

Abstract: Embodiments for a depth sensing camera with a wide field of view are disclosed. In one example, a depth sensing camera comprises an illumination light projection subsystem, an image detection subsystem configured to acquire image data having a wide angle field of view, a logic subsystem configured to execute instructions, and a data-holding subsystem comprising stored instructions executable by the logic subsystem to control projection of illumination light and to determine depth values from image data acquired via the image sensor. The image detection subsystem comprises an image sensor and one or more lenses.

Abstract: The present invention provides an apparatus that includes a color and polarization image capturing section 201, a whole sky polarization map getting section 202, a weather determining section 203, a fine-weather sky part separating section 204, a cloudy-weather normal estimating section 207, and a pseudo 3D image generating section 208. The apparatus obtains polarization information outdoors with the polarization state of the sky taken into account, and estimates surface normal information at an object's surface on a two-dimensional image, thereby generating a surface normal image. Using that normal image, the apparatus divides the object into multiple ranges, extracts three-dimensional information and generates a viewpoint changed image, thereby generating a pseudo 3D image.

Abstract: A method for preparing an article of lenticular imaging. The method comprises receiving a plurality of source images, superimposing at least one deghosting element on the plurality of source images, the deghosting element being formed to reduce an estimated ghosting artifact from the article, interlacing the plurality of processed source images so as to form a spatially multiplexed image, and preparing the article by attaching an optical element to the spatially multiplexed image.

Abstract: There is provided a display device including a display unit which periodically arranges and displays a plurality of images and a parallax barrier which is disposed in front of a pixel plane of the display unit and separates light from the display unit. The display device includes a disparity extraction unit which extracts information on a distribution of disparities between the view images, a parameter calculation unit which calculates a shift amount based on the disparity distribution information, a shift processing unit which performs shift processing on at least one of the view images based on the calculated shift amount, and a mapping processing unit which rearranges the at least one shift-processed view image on the display unit.

Abstract: Embodiments are disclosed that relate to augmenting an appearance of a surface via a see-through display device. For example, one disclosed embodiment provides, on a computing device comprising a see-through display device, a method of augmenting an appearance of a surface. The method includes acquiring, via an outward-facing image sensor, image data of a first scene viewable through the display. The method further includes recognizing a surface viewable through the display based on the image data and, in response to recognizing the surface, acquiring a representation of a second scene comprising one or more of a scene located physically behind the surface viewable through the display and a scene located behind a surface contextually related to the surface viewable through the display. The method further includes displaying the representation via the see-through display.

Abstract: Embodiments of imaging devices of the present disclosure automatically utilize sequential image captures in an image processing pipeline. In one embodiment, control processing circuitry captures a plurality of sub-frames, each of the sub-frames comprising a representation of a scene captured at a different focus position of a lens. A depth map of the scene may be generated comprising a depth of the portion of the scene based at least upon the focus position at which the one of the sub-frames was captured. An output frame of the scene may also be generated by utilizing pixel values of the sub-frame which are determined to be at optimal focus positions.

Abstract: A system and method for adjusting the parameters of a camera based upon the elements in an imaged scene are described. The frame rate at which the camera captures images can be adjusted based upon whether the object of interest appears in the camera's field of view to improve the camera's power consumption. The exposure time can be set based on the distance of an object form the camera to improve the quality of the acquired camera data.

Abstract: A three-dimensional printer includes a laser line scanner and hardware to rotate the scanner relative to an object on a build platform. In this configuration, three-dimensional surface data can be obtained from the object, e.g., for use as an input to subsequent processing steps such as the generation of tool instructions to fabricate a three-dimensional copy of the object, or various surfaces thereof.

Abstract: Methods and systems for using a mobile device with a multi-element display, a camera, and a controller to determine a 3D model of a target object. The multi-element display is configured to generate a light field. At least a portion of the light field reflects from a target object. The camera is configured to capture a plurality of images based on the portion of the light field reflected from the target object. The controller is configured to determine a 3D model of the target object based on the images. The 3D model includes three-dimensional shape and color information about the target object. In some examples, the light field could include specific light patterns, spectral content, and other forms of modulated/structured light.

Abstract: Methods and systems for image acquisition are described. In an example, a computing device may be configured to cause incremental relative rotation of a projector with respect to an image-capture device through multiple discrete angles. At each angle of the multiple discrete angles, the computing device may be configured to cause the image-capture device to capture a first image of an object, cause the projector to project a pattern on the object, and cause the image-capture device, while the pattern is projected on the object, to capture a second image of the object.

Abstract: A method and apparatus for simulating depth of field (DOF) in microscopic imaging, the method comprising computing a blur quantity for each pixel of an all-focus image, performing point spread function operations on one or more regions of the all-focus image, computing intermediate and normalized integral images on the regions and determining an output pixel for the each pixel based on the intermediate and normalized integral images.

Abstract: A camera device comprises more than three image capture modules used to capture more than perspective images of a 3D (3-dimensional) object; and an administration module electrically connecting with the image capture modules, receiving and administrating the perspective images of the 3D object. The present invention uses the image capture modules to capture the perspective images of the 3D object from different shooting angles and synthesizes the perspective images of the 3D object into a 3D panoramic image of the 3D object. Besides, the present invention can precisely obtain the dimensional information, such as the size, length and width, of the object in the image. Therefore, present invention can effectively promote the quality of 3D panoramic images of a 3D object.

Abstract: An alignment apparatus and method is disclosed, for ensuring correct alignment of a patient's eye with respect to an ophthalmic or optometric instrument. Graphical objects are provided which represent an ideal and an actual position of the eye, and provide for easy and intuitive feedback to an eye care professional operating the instrument on the alignment position of the patient.

Abstract: A method for improving depth for field (DOF) in microscopic imaging, the method comprising combining a sequence of images captured from different focal distances to form an all-focus image, comprising computing a focus measure at every pixel, finding the largest peaks at each position in the focus measure as multiple candidate values and blending the multiple candidates values according to the focus measure to determine the all-focus image.

Abstract: A method for obtaining 3D information of an object including the steps of retrieving two or more images of the object, the object being covered in an elastic covering comprising a uniform, matching a plurality of corresponding points in the two or more images based on the pattern, and generating a point cloud representing an object based the plurality of corresponding points.

Abstract: An exemplary imaging system operates by capturing image information as a lens moves within a defined focal length range during image exposure, where a focused image having an extended depth of field can be generated by using a profile of lens motion in processing the image.

Abstract: An imaging system and method are disclosed. In one aspect, the system includes an edge-detecting module detecting edge coordinates in a first image; first and second disparity-estimating modules respectively configured to obtain a first and second estimated disparity map, a cross-checking module configured to cross check the first estimated disparity map using the second estimated disparity map to identify occlusion pixels in the first estimated disparity map, an occlusion-refining module configured to refine the occlusion pixels by identifying at least a pixel under refinement on the first estimated disparity map as occluded based on the number of occlusion pixels in a refining base region, and a hole-filling module configured to fill the refined set of occlusion pixels. The imaging system improves the quality of a disparity map and controls the complexity of stereo-matching.

Abstract: Systems and methods according to principles disclosed here provide a screen space transform, e.g., implemented as a node, that may be employed to correct alignment issues between left and right eyes of a native stereo plate. The transformations may be in a number of homographic ways, including via translation, rotation, and scaling. By properly aligning stereographic images, subsequent images are properly aligned throughout the animation pipeline. In addition, the viewer experience is significantly improved.

Abstract: A device and method for three-dimensional (3-D) imaging using a defocusing technique is disclosed. The device comprises a lens, a central aperture located along an optical axis for projecting an entire image of a target object, at least one defocusing aperture located off of the optical axis, a sensor operable for capturing electromagnetic radiation transmitted from an object through the lens and the central aperture and the at least one defocusing aperture, and a processor communicatively connected with the sensor for processing the sensor information and producing a 3-D image of the object. Different optical filters can be used for the central aperture and the defocusing apertures respectively, whereby a background image produced by the central aperture can be easily distinguished from defocused images produced by the defocusing apertures.

Abstract: Tracking and following technique embodiments are presented that are generally employed to track and follow a person using a mobile robotic device having a color video camera and a depth video camera. A computer associated with the mobile robotic device is used to perform various actions. Namely, in a tracking mode, a face detection method and the output from the color video camera is used to detect potential persons in an environment. In addition, a motion detection method and the output from the depth video camera is also used to detect potential persons in the environment. Detection results obtained using the face and motion detection methods are then fused and used to determine the location of one or more persons in the environment. Then, in a following mode, a mobile robotic device following method is used to follow a person whose location was determined in the tracking mode.

Abstract: A depth imaging system comprises a depth camera input to receive a depth map representing an observed scene imaged by a depth camera, the depth map including a plurality of pixels and a depth value for each of the plurality of pixels. The depth imaging system further comprises a tag identification module to identify a 3D tag imaged by the depth camera and represented in the depth map, the 3D tag comprising one or more depth features, each of the one or more depth features comprising one or more characteristics recognizable by the depth camera. The depth imaging system further comprises a tag decoding module to translate the one or more depth features into machine-readable data.

Abstract: A camera system (10) includes: a camera (12) that obtains a test image (200); and an image processor (30). The image processor (30): analyzes said test image (200) to detect an object (22) appearing in the test image (200); determines a location where the detected object (22) appears in the test image (200); compares the determined location with a reference location; and determines if the camera (12) is one of properly aligned or misaligned based upon a result of said comparison.

Abstract: A method for intensifying identification of three-dimensional objects identification includes utilizing a left eye camera and a right eye camera to capture a left eye image and a right eye image, calibrating the left eye image and the right eye image to generate a calibrated left eye image and a calibrated right eye image, using the calibrated left eye image and the calibrated right eye image to generate a disparity map, differentiating a three-dimensional object from a background image according to the disparity map, projecting the three-dimensional object onto a plan view, filtering noise out of the plan view to generate a filtered three-dimensional object, determining whether the filtered three-dimensional object contains at least two three-dimensional objects, and separating the at least two three-dimensional objects if the filtered three-dimensional object contains at least two three-dimensional objects.

Abstract: A mobile device including an imaging device with a display and capable of obtaining a pair of images of a scene having a disparity between the pair of images. The imaging device estimating the distance between the imaging device and a point in the scene indicated by a user on the display. The imaging device displaying the scene on the display.

Abstract: Techniques for generating robust depth maps from stereo images are described. A robust depth map is generated from a set of stereo images captured with and without flash illumination. The depth map is more robust than depth maps generated using conventional techniques because a pixel-matching algorithm is implemented that weights pixels in a matching window according to the ratio of light intensity captured using different flash illumination levels. The ratio map provides a rough estimate of depth relative to neighboring pixels that enables the flash/no-flash pixel-matching algorithm to devalue pixels that appear to be located at different depths than the central pixel in the matching window. In addition, the ratio map may be used to filter the generated depth map to generate a smooth estimate for the depth of objects within the stereo image.

Abstract: Cloud based FVV streaming technique embodiments presented herein generally employ a cloud based FVV pipeline to create, render and transmit FVV frames depicting a captured scene as would be viewed from a current synthetic viewpoint selected by an end user and received from a client computing device. The FVV frames use a similar level of bandwidth as a conventional streaming movie would consume. To change viewpoints, a new viewpoint is sent from the client to the cloud, and a new streaming movie is initiated from the new viewpoint. Frames associated with that viewpoint are created, rendered and transmitted to the client until a new viewpoint request is received.

Abstract: Spatio-temporal light field cameras that can be used to capture the light field within its spatio temporally extended angular extent. Such cameras can be used to record 3D images, 2D images that can be computationally focused, or wide angle panoramic 2D images with relatively high spatial and directional resolutions. The light field cameras can be also be used as 2D/3D switchable cameras with extended angular extent. The spatio-temporal aspects of the novel light field cameras allow them to capture and digitally record the intensity and color from multiple directional views within a wide angle. The inherent volumetric compactness of the light field cameras make it possible to embed in small mobile devices to capture either 3D images or computationally focusable 2D images. The inherent versatility of these light field cameras makes them suitable for multiple perspective light field capture for 3D movies and video recording applications.

Abstract: A system including a 3-D scanner adapted for connection to a user's workspace computer, including an infrared light source, an infrared light detector, a three-dimensional camera and an RGB camera. The 3-D scanner is operatively connected to a user's computer, and captures a three-dimensional image of a user's posture. An algorithm is also provided which is adapted to receive the three-dimensional image of the user's posture and to receive other information relating to the user's ergonomic characteristics. The algorithm is configured to analyze the user's posture and the other information relating to the user's ergonomic characteristics and to provide a report on the user's ergonomic attributes. The method of using the system is also disclosed.

Abstract: The glancing angle exclusion technique described herein selectively limits projective texturing near depth map discontinuities. A depth discontinuity is defined by a jump between a near-depth surface and a far-depth surface. The claimed technique can limit projective texturing on near and far surfaces to a different degree—for example, the technique can limit far-depth projective texturing within a certain distance to a depth discontinuity but not near-depth projective texturing.

Abstract: A stereoscopic imaging apparatus comprising a single photographic optical system; an image sensor, on which subject images that have passed through different first and second areas in a predetermined direction, respectively, are formed after being pupil-split, photoelectrically converting the subject images that have passed through the first and second areas, respectively, to output a first image and a second image; a diaphragm restricting a light flux incident on the image sensor; a subject information acquiring device acquiring distance information of a subject within a photographic angle of view or a device acquiring an amount of parallax of the subject; and a diaphragm control device controlling an F-number of the diaphragm so that a parallax between the first image and the second image is in a predetermined range based on the acquired distance information of the subject or the acquired amount of parallax of the subject.

Abstract: A system and method are configured to provide super-reality entertainment for a user to realistically experience an activity as if he/she is actually participating in the activity. The method includes preparing multiple activities for each user to select from, providing a participant in each activity with one or more cameras and one or more microphones to capture images and sounds as perceived by the participant during the activity, obtaining information pertaining to the user, including account information and selection of an activity, managing transactions, processing the images and sounds; and transmitting the processed images and sounds to a client terminal of the user who selected the activity.