Abstract: A display device includes a plurality of reception units receiving a plurality of content, a storage unit, a plurality of scaler units reducing data sizes of the plurality of content, storing the respective content with the reduced data sizes in the storage unit, and reading the respective content stored in the storage unit according to an output timing, a plurality of frame rate conversion units converting frame rates of the respective read content, and a video output unit combining and displaying the respective content output from the plurality of frame rate conversion units. Accordingly, the resources can be minimized.

Abstract: A three-dimensional (3D) image generating device including a first memory unit, a first (master) processor, and a second (slave) processor is provided. The first processor and the second processor respectively include a first image processing unit and a second image processing unit. The first processor further includes a data access unit. The first image processing unit and the second image processing unit respectively receive images representing a first human eye and a second human eye and generate a first image and a second image through image processing. The data access unit receives the first image from the first image processing unit and writes it into the first memory unit according to a predetermined 3D image format. The second image processed by the second image processing unit is transmitted to the data access unit and written into the first memory unit according to the predetermined 3D image format.

Abstract: In an embodiment, an image processing device includes: a first acquiring unit that acquires a plurality of parallax images having parallax between one another; a second acquiring unit that acquires identification information of a parallax image to be observed from a predetermined observing point position in each of a plurality of regions into which a display area on which three-dimensional image is configured to be displayed is divided, each of the regions including at least one element image, and the element image including each pixel in the plurality of parallax images; a corrector that corrects pixels at positions corresponding to the regions in the parallax images into pixels of parallax images identified by the identification information; and a first generator that generates the three-dimensional image from the parallax images resulting from the correction.

Abstract: An imaging device includes a first imaging optical system; a first imaging unit that converts an optical image of a subject formed via the first imaging optical system into an electrical signal and produces an image signal of a first imaged image; a second imaging optical system; a second imaging unit that converts an optical image of the subject formed via a second imaging optical system into an electrical signal and produces an image signal of a second imaged image; and a control unit that independently control the first imaging optical system and the second imaging optical system and performs individually a focus adjustment of the first imaged image and the second imaged image.

Abstract: An approach for enabling users to generate an interpolated view of content based on footage captured by multiple cameras is described. An interpolation platform receives a plurality of images from a plurality of video cameras providing overlapping fields of view. A camera angle that is different from angles provided by the plurality of cameras is selected. The interpolation platform then generates an interpolated image corresponding to the selected camera angle using a portion or all of the plurality of images from the plurality of cameras.

Abstract: A 3D AF camera module includes first and second imaging units, a storage unit, a color separation unit, a main processor unit, an image processing unit, first and second driving units, and an image combining unit. The first and second imaging units each capture an image of a scene from different angles. The color separation unit separates the images into red, green and blue colors. The main processor unit calculates MTF values of the images and determines a shooting mode of the 3D AF camera module. The image processing unit processes the images according to the MTF values to compensate for blurring of the images caused by being out of focus. The first and second driving units drive the first and second imaging units to points of optimum focuses according to MTF values. The image combining unit combines the images into a single 3D image.

Abstract: An exemplary driving assistance method includes obtaining images of a surrounding environment of a vehicle captured by cameras mounted on the vehicle, each of the captured images comprising distance information indicating a distance between the corresponding camera and object captured by the corresponding camera. Next, the method includes extracting the distance information from the obtained captured images. The method then creates 3D models based on the extracted distance information, coordinates of each pixel of the at least one captured image and a reference point determined according to the captured images. Further, the method includes controlling display devices to display the created 3D models.

Abstract: A stereo image capturing device includes two image capturing modules, an image processing unit, a storage unit storing the image processing unit and a processor for executing the image processing unit. Each image capturing module includes a lens unit and an image sensor. The image processing unit includes a WDF module, a focus control module, and an image synthesize module. The WDF module determines the sharpness of the colors in images detected by the image sensor and acquires object distances of the images according to the sharpness. When the object distance is bigger than a predetermined distance, the WDF module can modify the sharpness of the images, otherwise the focus control module drives the lens unit to change focal distance of the lens unit. The image synthesize module synthesizes the images into stereo images.

Abstract: A stereoscopic image generating device includes: a brightness calculation unit that, on an image that is photographed using a stereo adapter, obtains the brightness representative value of the first area where neither of two beams from the object is incident; a threshold value determining unit that obtains a threshold value based on the brightness representative value; and an object area extracting unit that extracts two sets of pixels having brightness value higher than the threshold value on the image, as a second area where one of the two beams is incident and a third area where the another of the two beams is incident, and produces a stereoscopic image by a pair of a first partial image that is cut out from the second area, and a second partial image that is cut out from the third area.

Abstract: A device for measuring three dimensional shape includes a first irradiation unit, a first grating control unit, a second irradiation unit, a second grating control unit, an imaging unit, and an image processing unit. After performance of a first imaging operation as imaging processing of a single operation among a multiplicity of imaging operations performed by irradiation of said first light pattern of multiply varied phases, a second imaging operation is performed as imaging processing of a single operation among a multiplicity of imaging operations performed by irradiation of said second light pattern of multiply varied phases. After completion of the first imaging operation and the second imaging operation, shifting or switching operation of the first grating and the second grating is performed simultaneously.

Abstract: A thermal imaging camera may include an electronic compass that can be calibrated after assembly of the thermal imaging camera. The electronic compass may include a magnetic sensor configured to sense three orthogonal components of a magnetic field. In some examples, the camera includes a processor configured to receive a plurality of measurements from the magnetic sensor as a physical orientation of the magnetic sensor is changed in a three-dimensional space. The processor may generate a plurality of data points from the plurality of measurements and control a display so as to display a simulated three-dimensional plot of the data points. The processor may control the display so the display updates in substantially real-time as new data points are generated by changing the physical orientation of the magnetic sensor.

Abstract: A stereoscopic image shooting system including an image shooting module and a score evaluation module is provided. The image shooting module is used for shooting a plurality of multi-view images of an object. The score evaluation module analyzes a plurality of stereoscopic images formed from the multi-view images to calculate a stereoscopic quality score of the stereoscopic images.

Abstract: Methods and systems for capturing and displaying multiple-angle imagery of physical objects are presented. With respect to capturing, multiple images of an object are captured from varying angles in response to user input. The images are analyzed to determine whether at least one additional image is desirable to allow generation of a visual presentation of the object. The user is informed to initiate capturing of the at least one more image based on the analysis. The additional image is captured in response to second user input. The presentation is generated based on the multiple images and the additional image. For displaying, a visual presentation of an object is accessed, the presentation having multiple images of the object from varying angles. The presentation is presented to the user of a mobile device according to user movement of the device. The user input determines a presentation speed and order of the images.

Abstract: An exemplary object measuring method includes changing a focal length of a zoom lens in response to a user operation and taking images. The method then displays the images or one of them, determines a selected area, and defines the selected area as representing a object in the image. The method further determines virtual X and Y coordinate differences between a center point of an image and the object in the image. Next, the method calculates the actual differences between the testing device and the object. The method then controls the driving unit to drive the testing device to move a determined distance in an X direction and to move a determined distance in a Y direction.

Abstract: In a household monitoring method using a computing device, the computing device is connected to one or more depth-sensing cameras and an alarm device. The computing device controls the depth-sensing cameras to capture real-time images of monitored areas in front of the depth-sensing cameras. A presence of a person is detected from the images. If the person is detected to be in exigency, the computing device notifies relevant personnel of the exigency.

Abstract: A portable electronic device with 3D image capture capability and an image difference control method thereof are disclosed. The portable electronic device comprises a first and a second image capture module, a subject distance estimator and an image difference control mechanism. The first and second image capture modules are operative to capture a first image and a second image, respectively, to form a 3D image. Before image capturing, the subject distance estimator estimates a subject distance indicating how far a subject to be captured is, and the image difference control mechanism adjusts a distance between the first and second image capture modules based on the subject distance by moving at least one of the first and second image capture modules. In this manner, the image difference between the first and second images is properly controlled to perfectly form the 3D image.

Abstract: A computation system comprising an orientation detection device configured to detect position information comprising a position and an orientation of the computation system, a multi-sensor system coupled to the orientation detection device, wherein the multi-sensor system is configured to capture environmental input data, wherein the multi-sensor system comprises at least one of an audio capturing system and a three-dimensional (3D) image capturing system, and wherein the environmental input data comprises at least one of audio and an image, and at least one signal processing component coupled to the orientation detection device and to the multi-sensor system, wherein the processor is configured to modify the captured environmental input data based on the position information.

Abstract: A method for monitoring safety of a waste collection vehicle, a digital image is captured by an image capturing device positioned on the waste collection vehicle. The method detects a person in the digital image, and controls a safety device to cut of power being supplied to the waste collection vehicle if the person has been detected. The method further outputs alarm messages by lighting one or more signal lamps of the waste collection vehicle.

Abstract: A method for establishing a 3D object includes the following steps. Multiple featured patches, with different textured features, on the surface of an object are captured and stored. An image capture unit is utilized to detect the featured patches on the surface of the object. A processing unit is utilized to build a spatial relationship matrix corresponding to the featured patches according to detected space information of the featured patches. The processing unit is utilized to trace and describe the object according to the spatial relationship matrix.

Abstract: A methodology for performing a depth estimation procedure with defocused images under extreme lighting conditions includes a camera device with a sensor for capturing blur images of a photographic target under extreme lighting conditions. The extreme lighting conditions may include over-exposed conditions and/or under-exposed conditions. The camera device also includes a depth generator that performs the depth estimation procedure by utilizing the captured blur images. The depth estimation procedure includes a clipped-pixel substitution procedure to compensate for the extreme lighting conditions.

Abstract: An approach is provided for generating multi-channel video. A media platform segments a plurality of media items into one or more media segments based on a plurality of viewpoints of at least one event. The media platform then generates a plurality of media channels for respective one or more plurality of viewpoints. The plurality of media channels compiles the one or more media segments that depict the respective one or more of the plurality of viewpoints. The media platform then compiles the plurality of media channels into a multi-channel media item.

Abstract: A gate control system includes a system control unit, a gate device, and an image obtaining unit. The system control unit further includes a gate control unit and a determination unit. The image obtaining unit captures image of a scene in an operating area of the gate device and obtains distance information. The gate control unit generates three dimension data according to the captured images and the distance information, and the determination unit determines according to the three dimension data whether a person has passed through the gate device. The system control unit controls the gate device according to the determination unit. The disclosure further provides a gate control method.

Abstract: By utilizing at least one pair of cameras having a user-configurable displacement, it will be more precise to determine a depth map of a resulting 3D image and smoothening the 3D image, without the expense of using expensive depth cameras.

Abstract: An exemplary street view creating method includes obtaining images captured by at least three cameras in close proximity. The method then extracts the distance information from the obtained images. Next, the method determines images captured by cameras in different orientations and at different precise locations. The method further creates virtual 3D models based on the determined images and the extracted distance information. Then, the method determines any overlapping portion between any two original images. The method aligns any portions of synchronous images which are determined as common or overlapping.

Abstract: The aerial photograph image pickup method comprises a first step of acquiring still images along an outward route and a return route respectively, a second step of preparing a stereo-image with regard to three images adjacent to each other in advancing direction, and of preparing another stereo-image by relative orientation on one more set of adjacent images and of preparing two sets of stereo-images, a third step of connecting two sets of stereo-images by using feature points extracted from a portion of an image common to the two sets of stereo-images, a step of connecting all stereo-images in the outward route direction and in the return route direction according to images acquired in the first step by repeating the second and third steps, and a step of selecting common tie points from the images adjacent to each other in the adjacent course and connecting the adjacent stereo-images in the course.

Abstract: By determining reliability by a deviation between a left image and a right image to guide a user to use a correction algorithm only when sufficient reliability is secured and presenting an image to which an automatic correction algorithm is applied to perform fine adjustment, the user may capture a higher quality 3D image. A method of controlling a digital photographing apparatus includes: capturing a left image and a right image received from a left lens and a right lens, respectively; calculating Sum-of-Absolute-Difference (SAD) values of the right image compared with the left image; determining a reliability indicating a deviation of a moved position of the right image compared with the left image based on a degree that positions at which smallest SAD values are obtained deviate from an average position; and guiding a user to recapture or not based on the determined reliability.

Abstract: According to one embodiment, an apparatus for calibrating a camera while a vehicle is moving includes a rearward monitoring camera mounted in a vehicle to acquire image information, a memory that stores a camera calibration program for computationally determining and calibrating mounting parameters of the camera while the vehicle is moving, using the image information acquired by the camera, a gear position detector to detect gear positions of the vehicle and generates position signals according to the gear positions and a control unit that receives the image information, and when the gear position detector detects a position signal for other than a reverse gear position, that reads out and executes the camera calibration program stored in the memory.

Abstract: A two-parallel-channel reflector (TPCR) with focal length and disparity control is used after being combined with an imaging device. A left parallel channel and a right parallel channel are formed in the TPCR, so that the imaging device can synchronously perform an imaging operation on a left side view and a right side view of a scene, so as to obtain a stereoscopic image. Each parallel channel is bounded by two curved reflecting mirrors, so that captured light rays may be parallelly reflected in the channel, and an operator may adjust a convergence angle and an interocular distance between the left side view and the right side view, so as to control the focal length and disparity during imaging as require.

Abstract: A method for stabilizing an input digital video. Input camera positions are determined for each of the input video frames, and an input camera path is determined representing input camera position as a function of time. A smoothing operation is applied to the input camera path to determine a smoothed camera path, and a corresponding sequence of smoothed camera positions. A stabilized video frame is determined corresponding to each of the smoothed camera positions by: selecting an input video frame having a camera position near to the smoothed camera position; warping the selected input video frame responsive to the input camera position; warping a set of complementary video frames captured from different camera positions than the selected input video frame; and combining the warped input video frame and the warped complementary video frames to form the stabilized video frame.

Abstract: To overcome problems with vergence, a binocular head mounted display (HMD) is used in a simulator in which an out-the-window scene is displayed in real time on a screen arrangement. Imagery for the left and right eyes of the HMD is derived by generating a starting HMD image for a Cyclops viewpoint between the user's eves, and then rendering respective views for each eve from the position of the eye in a virtual 3D model of the screen arrangement, wherein the starting HMD image is frustum projected against the screen arrangement of the 3D model.

Abstract: A 3D camera for photographing a 3D image which can be viewed in a monoscopic manner without three-dimensional glasses by using an existing camera. The present invention provides: a device which rotates a monoscopic camera so that an image is photographed at various angles on various frames within one second by rotating the existing camera by 360 degrees toward a front subject in order to photograph the subject; and a 3D camera having an embedded device in which a lens of the camera is rotated by 360 degrees toward the front subject. Further, the present invention provides a 3D image photographing device and a 3D camera which enable free adjustment of a rotational width of the monoscopic lens and thus free adjustment of the depth of horizontal and vertical images when photographing the images, thereby solving eyestrain and dizziness which may occur when the 3D image is viewed.

Abstract: Optical sensor information captured via one or more optical sensors imaging a scene that includes a human subject is received by a computing device. The optical sensor information is processed by the computing device to model the human subject with a virtual skeleton, and to obtain surface information representing the human subject. The virtual skeleton is transmitted by the computing device to a remote computing device at a higher frame rate than the surface information. Virtual skeleton frames are used by the remote computing device to estimate surface information for frames that have not been transmitted by the computing device.

Abstract: A method of recognizing stairs in a 3D data image includes an image acquirer that acquires a 3D data image of a space in which stairs are located. An image processor calculates a riser height between two consecutive treads of the stairs in the 3D data image, identifies points located between the two consecutive treads according to the calculated riser height, and detects a riser located between the two consecutive treads through the points located between the two consecutive treads. Then, the image processor calculates a tread depth between two consecutive risers of the stairs in the 3D data image, identifies points located between the two consecutive risers according to the calculated tread depth, and detects a tread located between the two consecutive risers through the points located between the two consecutive risers.

Abstract: A preprocessing apparatus in a stereo matching system is provided. In the preprocessing apparatus, coordinate information of a stereo camera is stored, a new address of the pixel is specified using the coordinate information, and left and right images received from the stereo camera are rectified using the new address of the pixel.

Abstract: A mobile terminal may include a camera module and a controller. The camera module may include a first capture unit to capture a subject to acquire a first image, a second capture unit to capture the subject to acquire a second image, an actuator disposed at least one of the first capture unit and the second capture unit, and a drive unit configured to drive the actuator. The controller may analyze a perceived 3-dimensional (3D) image formed by using the first image and the second image, and may produce a relative position compensation value corresponding to a relative displacement between the first capture unit and the second capture unit according to a result of the analysis. The drive unit may drive the actuator to control a relative position between the first capture unit and the second capture unit based on the relative position compensation value.

Abstract: A method for mapping a sensor pixel array to an illumination pixel array according to a surface forms a group map by assigning each pixel on the sensor array to a corresponding group of an ordered set of groups, each group defined by a set of p adjacent pixels on the illumination pixel array by projecting and recording at least n projected images from a first set of n binary patterns, with transitions between pixels in each of the n binary patterns only at group boundaries. At least m images from a second set of m binary patterns are projected and recorded, with one or more transitions between pixels in each of the m binary pattern offset from group boundaries. At least p multiline images are projected and recorded. Lines in the recorded multiline images are correlated with lines in the multiline images according to the group map.

Abstract: A method for mapping a sensor pixel array to an illumination pixel array according to a surface forms a group mapping by assigning each pixel to a corresponding group, each group with p adjacent pixels on the illumination array and each ordered set having k groups, by projecting and recording a sequence of group index images. Each group index image has, in at least two of the groups, no illuminated pixels and in fewer than (k?1) groups, from 2 to (p?1) adjacent illuminated pixels. The sequence of group index images uses pixels from each of the k groups. At least p multiline images are projected and recorded, wherein each multiline image projects a line within each group. Lines in the multiline images are correlated according to the group mapping and the correlation stored in memory. Integers k and p are greater than or equal to 3.

Abstract: A display device comprising a storage unit that stores a video signal of a subject, image capturing position information, and shooting direction information, a display unit, a display posture information acquiring unit, a calculating unit that calculates a relative positional relation of a plurality of image capturing positions in a stereoscopic space based on the image capturing position information stored in the storage unit, and calculates a relative directional relation of a plurality of shooting directions in the display direction of the display unit based on the shooting direction information stored in the storage unit and the display direction information acquired by the display posture information acquiring unit, and a control unit that controls the display unit displaying a rotation video obtained by rotating the video of the subject corresponding to the video signal stored in the storage unit according to the relative directional relation calculated by the calculating unit.

Abstract: Disclosed herein is a stereo camera module. The stereo camera module according to an exemplary embodiment of the present invention includes a sensor unit having heterogeneous sensors having different number of pixels and a lens unit adjusting an angle of view of the sensor unit.

Abstract: A 3-dimensional (3D) location sensing system and method. The 3D location sensing system includes: an emitter which emits light including a plurality of markers onto an object; two or more photographing units which sense the light reflected from the object to respectively sense one or more markers; and a controller which calculates a 3D location coordinate of the object based on information about the one or more markers sensed by the two or more photographing units.

Abstract: A time-of-flight 3D camera and related method for illuminating a camera field of view and capturing return image light are disclosed herein. In one example, the time-of-flight 3D camera includes a light source that emits source light along an optical axis, and a collimator that receives and collimates the source light to create collimated light. A refractive diffuser is tuned to the camera field of view and receives and diffuses the collimated light to create refracted light having a varying intensity profile. The refractive diffuser guides the refracted light to illuminate the camera field of view to reduce wasted source light.

Abstract: A three-dimensional (3D) image photographing apparatus including: an image sensor; a 3D shutter which is disposed on the light path of the image light and comprises a first opening and a second opening, and which sequentially executes a first operation of passing a first image light by opening only the first opening, a second operation of blocking both the first opening and the second opening, and a third operation of passing a second image light by opening only the second opening; and a control unit which is electrically connected to the image sensor and the 3D shutter and which synchronizes a vertical synchronization signal which is applied to the image sensor with a starting time of the second operation by controlling the image sensor and the 3D shutter.

Abstract: A stereo image capturing device includes two image capturing modules, an image processing unit, a memory and a processor for respectively storing and executing the image processing unit. Each image capturing module includes a liquid crystal lens, a voltage drive chip, and an image sensor. The image processing unit includes a WDF module, a focus control module, and an image synthesize module. The WDF module determines the sharpness of the colors of images, and acquires object distance of the images according to the sharpness. When the object distance is bigger than a predetermined distance, the WDF module modifies the sharpness of the images, otherwise the focus control module drives the voltage drive chip to change focal distance of the liquid crystal lens according to the object distance. The image synthesize module synthesizes the images to stereo images.

Abstract: In accordance with various example embodiments, methods, apparatuses, and computer program products are provided. A method comprises facilitating capturing of a first image of a scene from a first position of the apparatus, tracking a movement of the apparatus for facilitating movement of the apparatus from the first position to a second position, and facilitating capturing of a second image of the scene from the second position of the apparatus. The apparatus comprises at least one processor and at least one memory comprising computer program code, configured to, cause the apparatus to perform facilitating capturing of a first image of a scene from a first position, tracking a movement of the apparatus for facilitating movement of the apparatus from the first position to a second position, and facilitating capturing of a second image of the scene from the second position of the apparatus.

Abstract: A strain measurement apparatus includes: a stereo camera device that produces a first stereo image and a second stereo image of a measurement object; an actual strain calculation portion configured to find a three-dimensional configuration of the measurement object from the first stereo image and the second stereo image to find actual strain of the measurement object; a temperature distribution detector that detects a temperature distribution of the measurement object; a free thermal strain calculation portion configured to find free thermal strain of the measurement object from the temperature distribution detected by the temperature distribution detector; and a constraint strain calculation portion configured to find as constraint strain of the measurement object a difference obtained by subtracting the free thermal strain found by the free thermal strain calculation portion from the actual strain found by the actual strain calculation portion.

Abstract: Surface segmentation from RGB and depth images is described. In one example, a computer receives an image of a scene. The image has pixels which each have an associated color value and an associated depth value representing a distance between from an image sensor to a surface in the scene. The computer uses the depth values to derive a set of three-dimensional planes present within the scene. A cost function is used to determine whether each pixel belongs to one of the planes, and the image elements are labeled accordingly. The cost function has terms dependent on the depth value of a pixel, and the color values of the pixels and at least one neighboring pixel. In various examples, the planes can be extended until they intersect to determine the extent of the scene, and pixels not belonging to a plane can be labeled as objects on the surfaces.

Abstract: An image processing apparatus may include a sensor unit which generates both a color image and a depth image. A color-depth time difference correcting unit may correct a mismatching that occurs due to a time difference between a point in time when the color image is generated and a point in time when the depth image is generated. An image generator may generate a stereoscopic image or a multi-view image using the color image and the depth image after the mismatching is corrected.

Abstract: An apparatus for reconstructing appearance of a dynamic object and automatically skinning the dynamic object, includes an image capturing unit configured to generate a multi-view image and multi-view silhouette information of a dynamic object and a primary globally fitted standard mesh model; and a 3D image reconstruction unit configured to perform global and local fitting on the primary globally fitted standard mesh model, and then generate a Non Uniform Rational B-Spline (NURBS)-based unique mesh model of the dynamic object. Further, the apparatus includes a data output unit configured to generate and output a final unique mesh model and animation data based on the NURBS-based unique mesh model of the dynamic object and at least two pieces of operation information about the dynamic object.

Abstract: The imaging apparatus includes: a multiband image sensor with a light receiving surface which includes two-dimensional arrays of at least three visible light pixels and an infrared pixels, the visible light pixels having sensitivity in different visible light wavelength ranges, the infrared pixels having sensitivity in the infrared wavelength range; a coded aperture which is disposed on the light receiving surface side of the multiband image sensor and serves as an aperture in a predetermined shape with respect to light in the wavelength range in which the infrared pixel has sensitivity while directly transmitting light in other wavelengths; and a processor for processing an image obtained by the multiband image sensor. The processor generates a depth map based on an image obtained by the multiband image sensor to thereby perform processing of a blurred image.

Abstract: Laser light pulses are reflected off a scanning mirror. A time-of-flight distance measurement device receives reflected light pulses and determines distances. The light pulses have abrupt changes in amplitude. Reflected pulses are differentiated to reduce sensitivity to amplitude variations. Differentiated pulses may be compressed to keep the receiver from saturating. Distance measurements are combined with location information to produce a 3D image of a surface.