Abstract: What is disclosed is a method which combines structured illumination in the SWIR wavelength range with the detection capabilities of NIR to generate a 3D image of a scene for accurate vehicle occupancy determination. In one embodiment, structured light is projected through a customized optical element comprising a patterned grid. Wavelengths of the received structured pattern are shifted to a CCD detectable range. The shifted light comprises an image in a structured pattern. The wavelength-shifted light is detected using an infrared detector operating in the NIR. For each pixel in the detected patterned image, an amount of distortion caused by 3D surface variation at this pixel location is determined. The distortion is converted to a depth value. The process repeats for all pixels. A 3D image is constructed using each pixel's depth value. The number of occupants in the vehicle is determined from the constructed 3D image.

Abstract: A system for automatically video filming an ongoing sports activity within a field uses an imaging device to continuously capture the entire field and the activities of the players involved in the game, and generate video signals. A position measuring arrangement, including multiple transmitters coupled to the different players, regularly measures the spatial locations of the different players with time, as the game continues, and generates position signals that indicate these spatial positions as functions of time. A data processor is coupled to the imaging device and the position measuring arrangement. The data processor receives the position signals and the video signals, and analyzes the position signals to edit the video signals, and to generate an edited output video content which is delivered to the spectators of the sports activity.

Abstract: By providing 3D representations of noteworthy locations for comparison with images, the 3D location of the imaging device, as well as the orientation of the device may be determined. The 3D location and orientation of the imaging device then allows for enhanced navigation in a collection of images, as well as enhanced visualization and editing capabilities. The 3D representations of noteworthy locations may be provided in a database that may be stored local or remote to the imaging device or a programmable device processing images obtained from the imaging device.

Abstract: A portable electronic device includes a carrier unit and an image-capturing unit. The carrier unit includes a carrier body. The image-capturing unit includes a rotatable element rotatably disposed on the carrier body, two image-capturing modules embedded in the rotatable element, and a weight element disposed inside the rotatable element. The rotatable element has a first geometric center point concurrently passed by a first horizontal line and a vertical line, each image-capturing module has a second geometric center point itself passed by the first horizontal line, the weight element has a third geometric center point passed by a second horizontal line and the vertical line, and the first horizontal line and the second horizontal line are horizontal to each other. Therefore, because the two image-capturing modules are always held in a horizontal state, the portable electronic device can capture high quality 3D images at any usage angle.

Abstract: A three-dimensional display method is provided in the present disclosure. The three-dimensional display method includes obtaining position information of an observer; and adjusting displaying content of a stereoscopic image according to the position information. A tracking three-dimensional display unit and an image processing device are also provided in the present disclosure. In the present disclosure, three-dimensional displaying contents may be adjusted according to the position information of the observer to introduce movement parallax, so as to achieve mutual effect between the observer and displaying contents, and enhance the sense of reality of three-dimensional displaying.

Abstract: A multiple-view virtual camera system comprising one or more image source units, an image processing unit, a parameter setting unit in signal communication with the image processing unit, and a display in signal communication with the image processing unit. The display is configured to display images generated by the image processing unit to a user of the virtual camera system, where the displayed images are configured according to image-related parameters input by a user of the multiple-view camera system through the parameter setting unit. The parameter setting unit may include a user interface, such as a single-touch or multi-touch touchscreen display, configured to accept input from the user that adjusts the parameters that are transmitted to the image processing unit and utilized by the image processing unit. A method of interactively controlling the virtual camera system by a user of a motor vehicle is also disclosed.

Abstract: A mobile device generates a 3D reconstruction of a human subject by capturing a video frame sequence of the human subject. A pre-generated marker, which may be reticle or a 3D model of a humanoid, is displayed on the display while capturing the video frame sequence. The human subject is also displayed and the mobile device is held to cause the human subject to be displayed coincidently with the pre-generated marker. The video frame sequence that is captured while the mobile device is held to cause the human subject to be displayed coincidently with the pre-generated marker is used to generate a 3D reconstruction of the human subject, which may then be stored and transmitted to a remote server if desired. Sensors may be used to determine the pose of the mobile device with respect to the human subject, which may then be used to adjust the pre-generated marker appropriately.

Abstract: System and method for adjusting the parameters of an image capturing device, such as a camera that captures a sequence of images and generates another image from the captured sequence of images using parameters that identify a virtual location and overlaying the generated image with a 3D generated image where distortion compensation has occurred been applied to the image.

Abstract: A method for processing data includes receiving a depth map of a scene containing at least an upper body of a humanoid form. The depth map is processed so as to identify a head and at least one arm of the humanoid form in the depth map. Based on the identified head and at least one arm, and without reference to a lower body of the humanoid form, an upper-body pose, including at least three-dimensional (3D) coordinates of shoulder joints of the humanoid form, is extracted from the depth map.

Abstract: A mobile device can generate a three-dimensional model of a person's face by capturing and processing a plurality of two-dimensional images. During operation, the mobile device uses an image-capture device to capture a set of images of the person from various orientations as the person or any other user sweeps the mobile device in front of the person's face from one side of his/her face to the opposing side. The device determines orientation information for the captured images, and detects a plurality of features of the person's face from the captured images. The device then generates a three-dimensional model of the person's face from the detected features and their orientation information. The three-dimensional model of the person's face facilitates identifying and/or authenticating the person's identity.

Abstract: A lens docking station used for detachably connecting to an electronic device is disclosed, wherein the electronic device includes a first lens module and a first transmission interface. The lens docking station includes a chute, a second lens module, and a second transmission interface. The chute is located next to the first lens module. The second lens module can slide along the chute to a position corresponding to the first lens module. The second transmission interface is used for communicating to the first transmission interface, and for electrically connecting to the second lens module, allowing the electronic device to control the second lens module to capture an image, and obtain the image; whereby the two images captured by the first lens module and the second lens module can be integrated to form a three-dimensional image.

Abstract: A 3D ultraviolet (UV) imaging LADAR system includes a UV source configured to generate a UV interrogation beam, a sensor configured to receive a UV return beam reflected from a target and to produce an electrical signal, and an imaging module coupled to the sensor and configured to receive the electrical signal and to generate a corresponding 3D image of the target. In one example, the sensor includes a down-shifting device configured to down-shift the UV return beam to a down-shifted light beam of a different wavelength, for example, in the visible or SWIR wavelength ranges.

Abstract: Systems and methods are provided for viewing and displaying 3D imagery. In one implementation, a method of displaying 3D imagery comprises receiving layout data comprising data representing a first camera, the first camera being non-editable; generating a first pair of a left camera and a right camera from the layout data based on the first camera, wherein the left camera and the right camera are editable; retrieving, from an external memory, streaming geometry data corresponding to the layout data; and generating the 3D imagery using the first pair of the left camera and the right camera and the streaming geometry data.

Abstract: An electronic device for creating a three-dimensional image includes a number of image capturing units, an outline detecting unit, a coordinate determining unit, and an image synthesizing unit. Each image capturing unit captures an object located in one corresponding direction of a three-dimensional scene with different focal length and then captures a number of images of the object in each direction. The outline detecting unit detects an outline of the object in each captured image. The coordinate determining unit determines three-dimensional coordinates of each point on the detected outline. The image synthesizing unit synthesizes the detected outlines of objects from the captured images captured in the same direction together according to the three-dimensional coordinates of the outlines, creates a three-dimensional image along each direction with the corresponding synthesized outlines, and stitches the three-dimensional images of different directions together to obtain a combined image.

Abstract: A mobile stereo imaging and processing device includes an ordinary mobile device such as tablet computers and smartphones; two or more digital cameras with stereo mounting requirements; a photography timing controller to operate the cameras, preferably with synchronized image capture capacity; a processor instruction package (software processing units) to control and operate the device, visualize and measure the images, compute and derive 3-dimentional object information from the captured 2-dimentional images; and some optional components such as remote control, GPS and IMU and optional processor instruction units for the control, operation and processing of the corresponding components.

Abstract: A method for stereo rectifying a pair of images include: for each image of the pair of images, determining a position of an epipole in an image plane associated with a first camera orientation of a camera that captures the image; for each image of the pair of images, positioning the epipole in a center of a virtual image plane associated with a second camera orientation of the camera; subsequent to the positioning, aligning the pair of images relative to each other by rotating around a stereo base line that intersects the epipoles of the pair of images, and rotating the virtual image planes to position the virtual image plane substantially parallel to the stereo base line and their normal vectors substantially parallel to each other so as to obtain a stereo rectified pair of image planes. An embodiment of the invention also relates to a method and system for accurately determining the epipoles when they are unknown.

Abstract: A system for generation of stereo video imagery. The system includes a first video camera, a second video camera, and an analysis subsystem. Positioning of the first and second video cameras is dynamically adjusted in near real time in response to a control signal that is generated by the analysis subsystem in response to the difference between a disparity signal and a reference parallax signal to dynamically minimize the difference between the disparity signal and the reference parallax signal.

Abstract: Provided is a method for generating a 3D stereoscopic image, which includes: generating at least one 3D mesh surface by applying 2D depth map information to a 2D planar image; generating at least one 3D solid object by applying a 3D template model to the 2D planar image; arranging the 3D mesh surface and the 3D solid object on a 3D space and fixing a viewpoint; providing an interface so that cubic effects of the 3D mesh surface and the 3D solid object are correctable on the 3D space, and correcting the cubic effects of the 3D mesh surface and the 3D solid object according to a control value input through the interface; and obtaining a 3D solid image by photographing the corrected 3D mesh surface and 3D solid object with at least two cameras.

Abstract: An optical adjusting device includes: a rotating unit that includes and rotates about a through-hole through which light passes; at least one moving unit that is movably disposed relative to the rotating unit and is linearly movable between an advance position corresponding to the through-hole and a retreat position outside the through-hole; a transmitting unit that is disposed between the rotating unit and the moving unit and transmits a rotational force of the rotating unit to the moving unit; and an optical unit that is disposed on the moving unit and blocks at least part of light passing through the through-hole.

Abstract: According to an image processing device includes an acquiring unit and a correcting unit. The acquiring unit is configured to acquire a stereoscopic image containing a plurality of parallax images each having a mutually different parallax. The correcting unit is configured to perform, for each pixel of the stereoscopic image, correction to set a parallax number of a parallax image viewed at a viewpoint position to a first parallax number of a parallax image to be viewed at the viewpoint position by using correction data representing a difference value between the first parallax number and a second parallax number of a parallax image that is actually viewed at the viewpoint position and on which distortion correction for correcting distortion of light beams has been performed.

Abstract: A method and a device for generating a three-dimensional image are provided. In the method, in an Nth time slot, an Nth left-eye image is received and stored in a download buffer of a first memory unit by a first control unit. An Nth right-eye image is received and stored in a download buffer of a second memory unit by a second control unit, where N is a positive integer from 1 to M, and M is a positive integer. In an (N+1)th time slot, the Nth right-eye image is received from the second control unit through a data transmission interface and stored in a receive buffer of the first memory unit. In an (N+2)th time slot, the Nth left-eye image and the Nth right-eye image are combined into an Nth three-dimensional image stored in a display buffer of the first memory unit for real time display.

Abstract: Disclosed are various embodiments of a stereoscopic panoramic camera device, which can include camera devices, positioned about a center point. The camera devices capture image data corresponding to a 360 degree field of view around a center point. Image capture logic initiates capture of image data by the camera devices, which corresponds to the 360 degree field of view. A stereoscopic panoramic image of the 360 degree field of view is generated using stereoscopic information for sectors surrounding the center point, where the stereoscopic information is generated from adjacent camera devices having an overlapping field of view.

Abstract: Stereoscopic image capture is provided. A blur value expected for multiple pixels in left and right images is predicted. The blur value is predicted based on designated capture settings. A disparity value expected for multiple pixels in the left and right images is predicted. The disparity value is predicted based on the designated capture settings. Stressed pixels are identified by comparing the predicted disparity value to a lower bound of disparity value determined from the predicted blur value using a predetermined model. A pixel with predicted disparity value less than the lower bound is identified as a stressed pixel. The predicted disparity is adjusted by modifying the designated capture settings to reduce the number of stressed pixels, or an alert to the presence of stressed pixels is given to the user.

Abstract: An embodiment of the invention provides a 3D camera module. The 3D camera module comprise a first lens, a second lens, a shutter control device, a first mirror, a second mirror and an image sensor. The first lens receives a first light beam. The second lens receives a second light beam. The shutter control device to control the first lens and the second camera and only one of the first shutter and the second shutter is turned on in one time period. The first mirror reflects the first light beam to the image sensor. The second mirror reflects the second light beam to the image sensor. The image sensor receives the first light beam and the second light beam to capture a first image and a second image and a 3D image is generated according to the first image and the second image.

Abstract: In embodiments of imaging structure emitter calibration, an imaging unit includes an emitter structure that direct emits light, and optics direct the light along a light path in the imaging unit to illuminate a projection surface. A reflective panel reflects a portion of the light to illuminate a light sensor. An imaging application receives the sensor data from the light sensor, where the sensor data corresponds to emitted light output from the emitter structure. The imaging application can then initiate a calibration input to the emitter structure to adjust the emitted light output from the emitter structure.

Abstract: Methods and devices for producing an enhanced image are described. In one example aspect, a method includes: providing a three-dimensional operating mode in which stereoscopic images are obtained using a first camera and a second camera; and providing a two-dimensional operating mode and while operating within the two-dimensional operating mode: receiving substantially simultaneously captured two-dimensional images from the first camera and the second camera; and merging the two-dimensional images to produce an enhanced two-dimensional image.

Abstract: An embodiment of the invention relates to providing a method of illuminating a scene imaged by a camera, which includes illuminating the scene with a train of light pulses and adjusting exposure times of the camera relative to transmission times of the light pulses so that the light pulses emulate a light pulse having a desired pulse shape.

Abstract: An exemplary digital signage method includes obtaining an image captured by a camera, the image comprising distance information indicating distances between the camera and objects shot by the camera. The method then creates a 3D scene model according to the captured image and the distances between the camera and objects captured by the camera. Next, the method determines whether one or more persons appear in the created 3D scene model. The method then determines a distance between the one or more persons and the digital signage when one or more persons appear in the created 3D scene model, determines the content according to a stored relationship and the determined distance, obtains the determined content, and further controls the at least one display to display the obtained content.

Abstract: In order to increase the accuracy of the calibration of an imaging system of a radiation treatment system operable to generate a treatment beam, an imaging device generates first data representing a reticle disposed in a beam path of the treatment beam. A first transformation between at least two dimensions of a coordinate system of a radiotherapy device of the radiation treatment system and a two-dimensional (2D) image coordinate system for the imaging device is determined based on the first data. The imaging device generates second data representing a phantom including a plurality of markers. A position of the phantom in the coordinate system of the radiotherapy device is determined based on the second data and the first transformation. A second transformation between three dimensions of the coordinate system of the radiotherapy device and the 2D image coordinate system for the imaging device is determined based on the second data and the determined position of the phantom.

Abstract: Methods and devices for selecting objects in images are described. In one example aspect, a method includes: receiving stereoscopic image data, the stereoscopic image data includes a first image obtained from a first camera and a second image obtained from a second camera; identifying an object in the first image by analyzing the first image and the second image; displaying the first image, the identified object in the first image being selectable.

Abstract: An expanded three-dimensional (3D) stereoscopic image display system is provided. The expanded 3D stereoscopic image display system according to an embodiment of the present invention provides a display platform that presents integrated services by fusing homogeneous and heterogeneous display devices in a single space, and an operation technique of the display platform.

Abstract: An apparatus for generating depth information includes a sensing unit and a final depth providing unit. The sensing unit is configured to sense light received from multiple subjects, and to provide initial depth data having distance information about the subjects and two-dimensional (2D) image data having 2D image information about an image obtained from the subjects. The final depth providing unit is configured to generate estimated depth data having estimated distance information about the subjects by transforming the 2D image data into three-dimensional (3D) data, and to provide final depth data based on the initial depth data and the estimated depth data.

Abstract: A method for determining a three-dimensional model of a scene from a collection of digital images, wherein the collection includes a plurality of digital images captured from a variety of camera positions. A set of the digital images from the collection are selected, wherein each digital image contains overlapping scene content with at least one other digital image in the set of digital images, and wherein the set of digital images overlap to cover a contiguous portion of the scene. Pairs of digital images from the set of digital images to determine a camera position for each digital image. A set of target camera positions is determined to provide a set of target digital images having at least a target level of overlapping scene content. The target digital images are analyzed using a three-dimensional reconstruction process to determine a three-dimensional model of the scene.

Abstract: The spatial resolution of captured plenoptic images is enhanced. In one aspect, the plenoptic imaging process is modeled by a pupil image function (PIF), and a PIF inversion process is applied to the captured plenoptic image to produce a better resolution estimate of the object.

Abstract: The present invention relates to a method and apparatus for standoff facial and ocular acquisition. Embodiments of the invention address the problems of atmospheric turbulence, defocus, and field of view in a way that minimizes the need for additional hardware. One embodiment of a system for acquiring an image of a facial feature of a subject includes a single wide field of view sensor configured to acquire a plurality of images over a large depth of field containing the subject and a post processor coupled to the single sensor and configured to synthesize the image of the facial feature from the plurality of images.

Abstract: Disclosed is a stereo matching method for calculating disparity from binocular images. The stereo matching method extracting distance information of objects included in images by using binocular images, includes receiving the binocular images acquired from a first camera and a second camera for acquiring the binocular images; processing the images so as to increase contrast between objects and background objects included in the received images by using a predetermined first algorithm; and performing, stereo matching using the processed images. An exemplary embodiment of the present invention outputs a disparity map in which objects and background are divided, thereby robustly recognizing a person or obstacles.

Abstract: A method for determining a three-dimensional model of a scene from a digital video captured using a digital video camera, the digital video including a temporal sequence of video frames. The method includes determining a camera position of the digital video camera for each video frame, and fitting a smoothed camera path to the camera positions. A sequence of target camera positions spaced out along the smoothed camera path is determined such that a corresponding set of target video frames has at least a target level of overlapping scene content. The target video frames are analyzed using a three-dimensional reconstruction process to determine a three-dimensional model of the scene.

Abstract: The disclosed subject matter relates to providing panoramic stereo vision captured with a single camera scheme employing a catadioptric optical path. In an aspect the presently disclosed subject matter can capture a stereo image over a full 360-degree horizontal field of view or portions thereof. Further, the vertical FOV is enlarged compared to conventional cata-fisheye schemes. A system according to the instant subject matter can be calibrated with a computational model that can accommodate a non-single viewpoint imaging model to conduct 3D reconstruction in Euclidean space.

Abstract: Head pose tracking technique embodiments are presented that use a group of sensors configured so as to be disposed on a user's head. This group of sensors includes a depth sensor apparatus used to identify the three dimensional locations of features within a scene, and at least one other type of sensor. Data output by each sensor in the group of sensors is periodically input, and each time the data is input it is used to compute a transformation matrix that when applied to a previously determined head pose location and orientation established when the first sensor data was input identifies a current head pose location and orientation. This transformation matrix is then applied to the previously determined head pose location and orientation to identify a current head pose location and orientation.

Abstract: Disclosed herein are methods, devices, and non-transitory computer readable media that relate to stereoscopic image creation. A camera captures an initial image at an initial position. A target displacement from the initial position is determined for a desired stereoscopic effect, and an instruction is provided that specifies a direction in which to move the camera from the initial position. While the camera is in motion, an estimated displacement from the initial position is calculated. When the estimated displacement corresponds to the target displacement, the camera automatically captures a candidate image. An acceptability analysis is performed to determine whether the candidate image has acceptable image quality and acceptable similarity to the initial image. If the candidate image passes the acceptability analysis, a stereoscopic image is created based on the initial and candidate images.

Abstract: Systems, structures, devices and methods for lensless compressive image acquisition are disclosed herein with which images may be obtained from a single detection element while performing fewer times than a number of pixels associated with the image. Advantageously such systems, structures, devices and methods may be adapted to acquiring images at wavelengths that are difficult or impossible with contemporary CCD or CMOS imagers.

Abstract: A method for assessing a attentiveness to visual stimuli received through a head-mounted display device. The method employs first and second detectors arranged in the head-mounted display device. An ocular state of the wearer of the head-mounted display device is detected with the first detector while the wearer is receiving a visual stimulus. With the second detector, the visual stimulus received by the wearer is detected. The ocular state is then correlated to the wearer's attentiveness to the visual stimulus.

Abstract: A 3D imager comprising two cameras having fixed wide-angle and narrow angle FOVs respectively that overlap to provide an active space for the imager and a controller that determines distances to features in the active space responsive to distances provided by the cameras and a division of the active space into near, intermediate, and far zones.

Abstract: An image sensor for three-dimensional (“3D”) imaging includes a first, a second, and a third pixel unit, where the second pixel unit is disposed between the first and third pixel units. Optical filters included in the pixel units are disposed on a light incident side of the image sensor to filter polarization-encoded light having a first polarization and a second polarization to photosensing regions of the pixel units. The first pixel unit includes a first optical filter having the first polarization, the second pixel unit includes a second optical filter having the second polarization, and the third pixel unit includes a third optical filter having the first polarization.

Abstract: An object's position and/or motion in three-dimensional space can be captured. For example, a silhouette of an object as seen from a vantage point can be used to define tangent lines to the object in various planes (“slices”). From the tangent lines, the cross section of the object is approximated using a simple closed curve (e.g., an ellipse). Alternatively, locations of points on an object's surface in a particular slice can also be determined directly, and the object's cross-section in the slice can be approximated by fitting a simple closed curve to the points. Positions and cross sections determined for different slices can be correlated to construct a 3D model of the object, including its position and shape. A succession of images can be analyzed to capture motion of the object.

Abstract: A geospatial and image data collection system includes a laser source configured to direct laser radiation toward a geospatial area, and an image sensor. The image sensor is configured to be operable in a first sensing mode to sense reflected laser radiation from the geospatial area representative of three dimensional (3D) geospatial data, and a second sensing mode to sense ambient radiation from the geospatial area representative of two dimensional (2D) image data. In addition, a controller is configured to operate the image sensor in the first and second sensing modes to generate the 3D geospatial data and 2D image data registered therewith.

Abstract: A method for testing a 3D camera is provided. The method includes: making a first camera of the 3D camera align with a first picture of a reference picture, wherein, the reference picture includes a second picture, a central point of the first picture and the second picture respectively has a first label and a second label; obtaining an image captured by a second camera of the 3D camera; identifying the first label, the second label, and a central point of the image; calculating an actual angle difference and an actual distance difference according to coordinates of the first label, the second label, and the central point; determining whether the 3D camera is installed appropriately by comparing the actual distance difference with the reference distance difference and the actual angle difference with the reference angle difference respectively.

Abstract: Disclosed is a technique for acquiring many images in different positions using multiple cameras to three dimensionally restore an object. The technique acquires images obtained by capturing an object by multiple cameras and corrects brightnesses between images captured by the multiple cameras based on an average brightness value calculated from the images captured by the multiple cameras so as to be constantly maintained. Therefore, it is possible to precisely restore a 3D model using images captured by multiple cameras having corrected brightness.

Abstract: The invention is directed to systems, methods and computer program products for providing focus control for an image-capturing device. An exemplary method includes capturing an image frame using an image-capturing device and recording video tracking data and gaze tracking data for one or more image frames following the captured image frame and/or for one or more images frames prior to the captured image frame. The exemplary method additionally includes calculating a focus distance and a depth of field based at least partially on the recorded video tracking data and recorded gaze tracking data. The exemplary method additionally includes displaying the captured image frame based on the calculated focus distance and the calculated depth of field.

Abstract: A depth calculation method of a depth sensor includes outputting a modulated light to a target object, detecting four pixel signals from a depth pixel based on a reflected light reflected by the target object, determining whether each of the four pixel signals is saturated based on results of comparing a magnitude of each of the four pixel signals with a threshold value, and calculating depth to the target object based on the determination result.