Abstract: A three-dimensional video processing apparatus includes: a video obtaining unit which obtains a 3D video for three-dimensional viewing; a position obtaining unit which obtains a position of a first area which is an area included in a part of the 3D video; a disparity obtaining unit which obtains disparity amounts of the 3D video; a determination unit which determines a size of an enlargement area; and an area selection unit which selects, as the enlargement area, at least one second area that has disparity amounts within a predetermined range, includes the first area, and has a size determined by the determination unit.

Abstract: Feature points are extracted from left and right viewpoint images (Step S12), and the amount of parallax of each feature point is calculated (Step S13). The maximum amount of parallax on a near view side and the maximum amount of parallax on a distant view side are acquired from the calculated amount of parallax of each feature point (Step S14). The maximum display size which enables binocular fusion from a supposed visual distance when a stereoscopic image based on the left and right viewpoint images is displayed on a stereoscopic display is acquired on the basis of at least the maximum amount of parallax on the distant view side (Step S15). The acquired maximum display size is recorded along with image information (Step S16). The image reproduction device which reads the 3D image file recorded in this way can be appropriately displayed on the basis of the maximum display size.

Abstract: A method and an apparatus for obtaining image data for video communication in an electronic device are provided. In an embodiment, a method and an apparatus for providing a video communication function that simultaneously uses image data obtained via a plurality of cameras. In the method, first image data is obtained using a first camera. Second image data is obtained using a second camera. The first image data is merged with the second image data. The merged image data is transmitted to a second electronic device. Other embodiments are possible.

Abstract: A camera processor image-processes an image for left eye captured by a left-eye image capturing unit and an image for right eye captured by a right-eye image capturing unit to generate a parallax image of the left-eye image and the right-eye image. A vertical timing adjuster adjusts timings of driving a left-eye image sensor and a right-eye image sensor using a frame synchronizing drive controller to reduce as close to zero as possible an amount of vertical displacement between a framing position of a target object image in the left-eye image and a framing position of a target object image in the right-eye image.

Abstract: Various embodiments enable a primary user to be identified and tracked using stereo association and multiple tracking algorithms. For example, a face detection algorithm can be run on each image captured by a respective camera independently. Stereo association can be performed to match faces between cameras. If the faces are matched and a primary user is determined, a face pair is created and used as the first data point in memory for initializing object tracking. Further, features of a user's face can be extracted and the change in position of these features between images can determine what tracking method will be used for that particular frame.

Abstract: Disclosed are devices, systems, methods, and non-transitory computer-readable storage media for displaying useful countdown timers on a media capture device. A media capture device can increase contrast between countdown timer and the video of a scene to be captured by a media capture device and adjust the position and size of a counter displayed on the device based on whether the object is determined to be closer or further than a predetermined threshold distance. Countdown timers can be triggered by detection of objects and gestures.

Abstract: Technologies are described herein for using linear functions to calculate depth information for scenes illuminated with structured light. Instead of performing matrix operations to determine depth information for each dot of light projected onto a scene, the depth information associated with each projected dot is calculated of light using a linear function.

Abstract: A method and non-transitory program for determining a plane in a depth image includes dividing a portion of a depth image into a plurality of areas, fitting a two-dimensional line to depth points in each of the plurality of areas, and combining two or more of the plurality of two-dimensional lines to form a three-dimensional plane estimate.

Abstract: A recording unit recording the plurality of time-series parallax images outputted from the plurality of imaging units on a recording medium when the moving image is photographed, reading out the first and second information from the storage unit, and recording the first information and the second information read out from the storage unit on the recording medium in association with the plurality of parallax images.

Abstract: A method and apparatus for providing optimal correction to depth mapping between captured and displayed stereoscopic content. The solution is derived in a continuous form that can be implemented through CGI scaling techniques compatible with image rendering techniques. Similar correction can be implemented with variable depth-dependent camera separation and disparity re-mapping. The latter is applicable to correcting existing stereoscopic content.

Abstract: Real-time camera tracking using depth maps is described. In an embodiment depth map frames are captured by a mobile depth camera at over 20 frames per second and used to dynamically update in real-time a set of registration parameters which specify how the mobile depth camera has moved. In examples the real-time camera tracking output is used for computer game applications and robotics. In an example, an iterative closest point process is used with projective data association and a point-to-plane error metric in order to compute the updated registration parameters. In an example, a graphics processing unit (GPU) implementation is used to optimize the error metric in real-time. In some embodiments, a dense 3D model of the mobile camera environment is used.

Abstract: An image display device includes: a display unit that displays images; an imaging unit that captures an image of a subject that faces the display unit; a detection unit that detects motion with respect to the image display device by the user of the image display device; an estimation unit that, when predetermined motion has been detected by the detection unit, estimates the inclination with respect to the display unit of a person's face that was captured by the imaging unit; and a display orientation alteration unit that alters the orientation of images displayed on the display unit according to the inclination that was estimated.

Abstract: A method for tracking a target object utilizing a binocular system includes capturing first and second images, the first image captured from a first camera device and the second image captured from a second camera device. A plurality of image patches are applied to the first and second images and a plurality of detection costs each associated with respective ones of the image patches applied to the first and second images is determined. A plurality of matching costs each corresponding to respective ones of selected matching pairs of image patches between the first and second images is determined. At least one cost flow path is determined from a source vertex of the first image to a sink vertex of the second image based on the detection costs and the matching costs and the target object is tracked based on the at least one cost flow path.

Abstract: Systems and methods for processing a pair of 2-D images are described. In one example, a stereoscopic set of images is converted into a collection of regions that represent individual 3-D objects in the pair of images. In one embodiment, the system recovers the 3-D point P for each point p that appears in both images. It estimates the 3-D orientation of the floor plane, and the image capture planes and their height from the floor. The system then identifies the collection B of points P that do not represent points on the floor and generates a projection C of B onto a plane parallel to the floor. It blurs the projection C and identifies peaks in the blurred image, then fits symmetric figures to the points in C around the identified peaks. The system projects the 3-D figures associated with the symmetric figures back onto the 2-D images.

Abstract: In a video signal processor, a difference value calculation section calculates a difference value between video signals at two or more different points of view, which have been input to a video signal input section, at each predetermined timing. A compensation value calculation section holds the difference value between the video signals, which have been obtained at the predetermined timing, at each predetermined time interval. The compensation value calculation section calculates a compensation value with reduced compensation variations along a time axis using the held difference value. A video signal compensation section compensates the video signals using the obtained compensation value. Furthermore, the compensation value calculation section also calculates the compensation value with reduced compensation variations along the time axis based on information at imaging, which has been obtained by an information input section at each predetermined timing.

Abstract: A method for operating a graphics subsystem of a reproduction device for display of video information comprising auxiliary information is described. Wherein the graphics subsystem is capable of generating left and right channel data for stereoscopic 3D display of auxiliary information in a 3D mode and of generating 2D data for 2D display of auxiliary information in a 2D mode, and can be switched between the display modes. The method has the steps of: providing 3D auxiliary information in the 3D mode, receiving a signal indicative to a change of the display mode, and leaving the graphics subsystem in the 3D mode while providing 2D auxiliary information to the graphics subsystem in response to said signal so as to provide the left and right channel with identical 2D auxiliary information to provide a 2D display of the same.

Abstract: An image processing apparatus includes an attention area detection unit, a luminance parallax conversion unit, and a parallax estimation unit. The attention area detection unit is configured to detect an attention area including a desired subject from a standard image. The luminance parallax conversion unit is configured to perform a luminance parallax conversion with respect to the attention area on the basis of a luminance parallax conversion characteristic estimated by using a past frame. The parallax estimation unit is configured to perform parallax estimation on the basis of the standard image and a reference image, a viewpoint position of which is different from that of the standard image, and perform, in the attention area, the parallax estimation by using a luminance parallax conversion result obtained by the luminance parallax conversion unit.

Abstract: Techniques for facilitating interaction with an application in a motion capture system allow a person to easily begin interacting without manual setup. A depth camera system tracks a person in physical space and determines a probabilistic measure of the person's intent to engage of disengage with the application based on location, stance and movement. Absolute location in a field of view of the depth camera, and location relative to another person, can be evaluated. Stance can include facing a depth camera, indicating a willingness to interact. Movements can include moving toward or away from a central area in the physical space, walking through the field of view, and movements which occur while standing generally in one location, such as moving one's arms around, gesturing, or shifting weight from one foot to another.

Abstract: A mobile terminal and 3D image controlling method therein are provided, by which a user can be informed of a state of a 3D effect on one or more objects in a 3D image. The mobile terminal includes a first camera configured to capture a left-eye image for generating a 3D image, a second camera configured to capture a right-eye image for generating the 3D image, a display unit configured to display the 3D image generated based on the left-eye image and the right-eye image, and a controller configured to determine an extent of a 3D effect on at least one object included in the 3D image, and to control the display unit to display information indicating the determined extent of the 3D effect.

Abstract: A camera system and method are suitable for use in applications in which three dimensional images are generated without using complicated procedures. A camera system includes: a first camera and a second camera; a camera adaptor box; and a camera control unit. The camera adaptor box controls the operations of the first and second cameras and transmits the images from the first and second cameras to the camera control unit. The camera control unit outputs a control signal, received from a control panel to control the cameras, to the camera adaptor box. The camera control unit outputs a video signal received from the camera adaptor box to a display apparatus and a recording apparatus.

Abstract: A photographing device includes a display unit, a movement detection unit and a display control unit. The display unit displays a preview image of being a target to photograph. The movement detection unit detects the preview image being moving from status at which the preview has been photographed as a reference photographed image. The display control unit displays a reference line on the preview image. The reference line has been set in the reference photographed image. The display control unit changes a display position and a direction of the reference line in the display unit based on a detected result by the movement detection unit.

Abstract: Disclosed herein are through-the-lens tracking systems and methods which can enable sub-pixel accurate camera tracking suitable for real-time set extensions. That is, the through-the-lens tracking can make an existing lower precision camera tracking and compositing system into a real-time VFX system capable of sub-pixel accurate real-time camera tracking. With this enhanced level of tracking accuracy the virtual cameras can be used to register and render real-time set extensions for both interior and exterior locations.

Abstract: The present invention relates to a small three-dimensional imaging device, including a tilt part that is plastically deformed by an external force so as to compensate for tilting between camera modules, and therefore reduces defects in order to improve productivity. The small three-dimensional imaging device of the present invention includes a main member and a camera module. The camera modules includes a first camera module and a second camera module, which are mounted on the top portion of the main member and are space apart from each other to capture a subject image in three dimensions. The main member include a tilt part for tilting the first camera module or the second camera module relative to the other by means of plastic deformation resulting from an external force.

Abstract: Provided is an imaging system and a method of autofocusing the same. The imaging system includes a camera array including a plurality of cameras to image an image, and a control circuit to control the plurality of cameras to autofocus, and to output a single image by combining images output from the plurality of cameras.

Abstract: A liquid crystal display device includes first and second substrates, at least one of which is transparent, a liquid crystal layer which is disposed between the first and second substrates, a pixel electrode and a common electrode which are formed on one of the first and second substrates and which apply an electric field to the liquid crystal layer, a plurality of active elements which is connected to the pixel electrode and the common electrode, an alignment film which is disposed on at least one of the first and second substrates and has one surface contacting the liquid crystal layer, and an underlying layer which is disposed on at least one of the first and second substrates and contacts the other surface of the alignment film. The pixel electrode is laminated on the common electrode having a plane shape through an isolation film.

Abstract: A 3D imaging device obtains a 3D image (3D video) that achieves an appropriate 3D effect and/or intended placement. The 3D imaging device estimates (calculates) an ideal disparity of a main subject based on a preset viewing environment (display condition) and a distance to the main subject, and obtains a disparity (an actual disparity) of the subject (main subject) actually occurring on a virtual screen. The 3D imaging device obtains a correction disparity using the ideal disparity and the actual disparity, and adds the calculated correction disparity to the 3D image (horizontally shifts the image) to perform appropriate disparity correction. The 3D imaging device obtains a 3D image (3D video) that achieves an appropriate 3D effect and/or intended placement without being affected by a disparity occurring in the horizontal direction caused by insufficient precision (in particular, insufficient optical precision).

Abstract: A display apparatus including a flexible display unit configured to discriminately output a left eye image and a right eye image; a transparent sensor unit disposed on one face of the flexible display unit and configured to be flexed together with the flexible display unit; and a control unit configured to receive a signal from the transparent sensor unit corresponding to an electrical variation generated in accordance with a flex of the flexible display unit, and to adjust a 3D depth value of a flexed region of the flexible display.

Abstract: A 3D tablet terminal (100) which is an example of a stereoscopic image display control apparatus includes: a most projecting position determination unit (104) which determines a most projecting position at which an object projects most from a display surface and a most receding position at which the object recedes most therefrom; and a display control unit (105) which causes a display device to display the object, wherein the display control unit (105) adjusts a display position of the object so that an amount of projection at the most projecting position is equal to a proper amount of projection, and processes, by a predetermined method, a portion of the object on a far side relative to the display surface when an amount of recession at the most receding position after adjusting the display position exceeds a proper amount of recession.

Abstract: An electronic device is provided including a communication unit configured to receive audio/video data (A/V data) streamed from a first electronic device, a display unit configured to display the video data of the A/V data, and a controller configured to obtain shape feature information of a first real object included in the video data, to determine whether there is first personal information of the first real object based on the shape feature information, and to display a first virtual object including the first personal information on the display unit in association with the first real object when there is the first personal information.

Abstract: An image pickup system includes two lens apparatuses each including a movable optical member, a driving unit that drives the movable optical member, and a driving signal generating unit that generates a driving signal for causing the driving unit to drive the movable optical member, a command signal generating unit that generates a command signal to command driving of the movable optical member, a posture determining unit that determines the posture of each lens apparatus, and a master-slave setting unit that sets each lens apparatus, based on the determined posture of the lens apparatus, as one of a master lens apparatus in which the driving signal generating unit generates the driving signal based on the command signal and a slave lens apparatus in which the driving signal generating unit generates the driving signal based on the position of the movable optical member in the other lens apparatus.

Abstract: An imaging device determines an in-focus position by contrast autofocus. The device includes a first optical system including a first lens and a first image sensor, a second optical system including a second lens and a second image sensor, a signal processing unit to read an image signal from at least one of the first image sensor and the second image sensor and generate an image for display, and a display unit to display the generated image. In the contrast autofocus, the signal processing unit reads a part of the image signal from the first image sensor and calculates a contrast value based on the read part of the image signal, and generates the image for display from the image signal read from the second image sensor.

Abstract: A method for identifying a person using a mobile communication device, having a camera unit adapted for recording three-dimensional (3D) images, by recording a 3D image of the person's face using the camera unit, performing face recognition on the 2D image data in the recorded 3D image to determine at least two facial points on the 3D image the of person's face, determining a first distance between the at least two facial points in the 2D image data, determining a second distance between the at least two facial points using the depth data of the recorded 3D image, determining a third distance between the at least two facial points using the first distance and the second distance, and identifying the person by comparing the determined third distance to stored distances in a database, wherein each of the stored distances are associated with a person.

Abstract: A computer implemented method for synchronizing information from a scene using two heterogeneous sensing devices. Scene capture information is provided by a first sensor and a second sensor. The information comprises video streams including successive frames provided at different frequencies. Each frame is separated by a vertical blanking interval. A video output comprising a stream of successive frames each separated by a vertical blanking interval is rendered based on information in the scene. The method determines whether an adjustment of the first and second video stream relative to the video output stream is required by reference to the video output stream. A correction is then generated to at least one of said vertical blanking intervals.

Abstract: A correction value calculation apparatus that includes circuitry configured to: acquire a relative position of a feature point to a reference point in a left/right image formed by a left/right lens as a left/right pixel position in the case where the left/right lens is moved in a coordinate system constructed with a pitch axis and a yaw axis; detect a relative position of the left/right lens to a reference position as a left/right lens detection position; generate a characteristic representing a relationship between the left/right pixel position and the left/right lens detection position; set each of the left/right lens detection position as a correction object position and determine an adjustment position which is a position on a straight line connecting the left and right pixel positions; and calculate correction values which are differences between the left and right lens detection positions.

Abstract: A composite eye camera has: imaging sections (21A, 21B) that generate plural viewpoint images per frame by imaging a same subject from plural viewpoints; a three-dimensional processing section (30) that acquires a parallax amount on the basis of the generated plural viewpoint images; and a CPU (35) that judges that there is an abnormality in the parallax amount in at least one case among a case in which fluctuation of a fixed interval in the acquired parallax amount is greater than a predetermined value, and a case in which the parallax amount reaches a predetermined allowed limit value, and a case in which an object of acquisition of the parallax amount can no longer be detected, and judges that there is no abnormality in the parallax amount in a case that is none of these, and, when it is judged that there is no abnormality in the parallax amount, carries out first parallax adjustment, and, when it is judged that there is an abnormality in the parallax amount, switches to control of a second parallax adjust

Abstract: An integrated broadcast/auxiliary camera system includes a broadcast camera and an auxiliary camera. The broadcast camera may capture a first image of a scene, wherein operational parameters of the broadcast camera including a broadcast focus distance, a broadcast focal length, a broadcast pan angle and a broadcast tilt angle are operator controlled. The auxiliary camera may capture a second image of the scene, the second image different from the first image. A controller may automatically control operational parameters of the auxiliary camera including an auxiliary focus distance, an auxiliary focal length, an auxiliary pan angle and an auxiliary tilt angle based on the operational parameters of the broadcast camera.

Abstract: An image system comprises a light source, an image sensing device, and a computing apparatus. The light source is configured to illuminate an object comprising at least one portion. The image sensing device is configured to generate a picture comprising an image. The image is produced by the object and comprises at least one part corresponding to the at least one portion of the object. The computing apparatus is configured to determine an intensity value representing the at least one part and to determine at least one distance between the at least one portion and the image sensing device using the intensity value and a dimension of the at least one part of the image.

Abstract: Provided is a three-dimensional (3D) display system. The 3D display system synthesizes a 3D image and position information data of an observer obtained through a camera with an optimal viewing area image with respect to horizontal and vertical directions of a display panel in a 3D space, and displays the synthesized image on the display panel such that the observer can visually know an optimal viewing area. Accordingly, the 3D display system enables the observer to visually check the optimal viewing area with ease and induces the observer to move to a position in the optimal viewing area.

Abstract: A mobile device comprising a processor configured to merge a plurality of images each having a distinct focus position in a scene to generate a focus-stacked image that encompasses all focus positions of the plurality of images. Also, an apparatus comprising a camera configured to capture a plurality of color images for one scene each with a distinct focus distance and a processor configured to register the plurality of color images to generate a plurality of registered color images, generate a plurality of luminance (Y) channels from the plurality of registered color images, and stack the plurality of Y channels to generate a focus-stacked Y channel.

Abstract: A camera system comprising: stereoscopic optics; a right image sensor for acquiring a right image from the stereoscopic optics and a left image sensor for acquiring a left image from the stereoscopic optics; a horizontal line switch for receiving the right image from the right image sensor and the left image from the left image sensor and creating a composite image wherein the horizontal line signals from the right image sensor are alternated with the horizontal line signals from the left image sensor; and a single camera processor for receiving the composite image from the horizontal line switch for presenting to a display.

Abstract: In order to provide a small, stereo camera with stable errors of distance measurement, there are provided: an image acquisition unit that acquires plural images imaged by plural imaging units; a first region processing unit that divides each of the plural images acquired by the image acquisition unit into first regions composed of predetermined plural pixels, and measures a distance for each of the divided first regions to generate a first distance image; a target object extraction unit that extracts a target object from the distance image or the image, and extracts a second region composed of the plural first regions including the extracted target object; an error factor identification unit that extracts a predetermined representative value from the inside of the second region, compares the brightness value of an arbitrary pixel in the second region with that in a correspondence region up to the position moved from the arbitrary pixel by a disparity represented by the representative value, and determines an

Abstract: A railway installation monitoring system may include: a laser generator that is provided on a train; a camera that is operated in connection with the laser generator so as to be capable of monitoring a railway installation and of acquiring image information data that is measured; a three-dimensional image information conversion device that uses the image information data acquired by the laser generator and the camera and converts the data into three-dimensional image information; a position determination unit that determines the position of the railway installation to be measured; a signal processing device that sends an operating command for the laser generator or/and the camera; and an overall data processing device that processes, analyzes, interprets, or stores the image information data, the three-dimensional image information, or the data transmitted from the position determination unit.

Abstract: A 3-D image pick-up device is disclosed, the device including: a PCB mounted with two camera modules including an image sensor; and a reinforcing member mounted with two exposure windows, wherein the PCB and the reinforcing member are mutually adhered to allow the camera modules of the PCB to be exposed through the exposure window of the reinforcing member.

Abstract: Auto-calibration of stereo cameras installable behind the windshield of a host vehicle and oriented to view the environment through the windshield. Multiple first image points are located of one of the first images captured from the first camera at a first time and matched with first image points of at least one other of the first images captured from the first camera at a second time to produce pairs of corresponding first image points respectively in the first images captured at the different times. World coordinates are computed from the corresponding first image points. Second image points in the second images captured from the second camera are matched to at least a portion of the first image points. The world coordinates as determined from the first camera are used, to solve for camera parameters of the second camera from the matching second image points of the second camera.

Abstract: A system and method for corrected imaging including an optical camera that captures at least one optical image of an area of interest, a depth sensor that captures at least one depth map of the area of interest, and circuitry that correlates depth information of the at least one depth map to the at least one optical image to generate a depth image, corrects the at least one optical image by applying a model to address alteration in the respective at least one optical image, the model using information from the depth image, and outputs the corrected at least one optical image for display in 2D and/or as a 3D surface.

Abstract: To obtain an image processing device and a method of processing an image that improve distance accuracy and is capable of performing accurate distance even about an object at a greater distance than before, when a distance to an object is measured, one image object region 302 including an image of an object is extracted from one image of a pair of images imaged by a pair of imaging elements at the same time in the same direction. The degree of background that is likelihood of whether either an object image configuration part 304 or a background image configuration part 303 is calculated for each of a plurality of image configuration parts that configures the one image object region 302. Then, the other image object region 503 having an image similar to the one image object region 302 is extracted from the other image 501 using the degree of background, and a parallax between the one image object region 302 and the other image object region 503 is calculated.

Abstract: An image processing device configured to be installed in a vehicle includes an image acquirer, an image selector, a first luminance adjuster, a synthetic image generator, and an image provider. The image acquirer acquires camera images captured by cameras provided on the vehicle. The image selector selects one of the camera images as a representative image based on luminances of the camera images. The first luminance adjuster adjusts a luminance of at least one of the other camera images based on a luminance of the representative image. The synthetic image generator generates a synthetic image showing a periphery of the vehicle, based on the representative image and the other camera images the luminance of at least one of which has been adjusted by the first adjuster. The image provider outputs, to a display device installed in the vehicle, information corresponding to the synthetic image.

Abstract: Disclosed herein are a stereo camera system and a method for controlling convergence, including: a camera unit photographing both-eyes images; a filter unit filtering signal values of pixels for each line for any one of the both-eyes images along a line direction to detect a reference line of any one image; a line memory unit storing data for the reference line and a reference line of the other one image corresponding to the reference line; and a convergence control unit calculating the image control amount so as to align convergences of the both-eyes images by performing a comparison operation on the data for the reference lines and generating an optimal synthesis image of the both-eyes images by applying the image control amount.

Abstract: In an image analysis apparatus, by control of a stereo camera, left and right cameras capture images of a common area ahead of an own vehicle, and generate pieces of image data (left and right image data) expressing the captured images. At this time, exposure timings of the left camera and the right camera are controlled so that the exposure timing of the left camera is shifted from that of the right camera. Pieces of image data (left and right image data) having differing exposure timings are obtained. Based on either piece of image data, candidates for vehicle light are extracted. Furthermore, a flashing light is detected by the left image data and the right image data being compared. The detected flashing light is eliminated from the extracted candidates for vehicle light. A light source that ultimately remains as the candidate for vehicle light is detected as the vehicle light.

Abstract: Computing devices can collaborate in order to take advantage of various components distributed across those devices. In various embodiments, image information captured by multiple devices can be used to identify and determine the relative locations of various persons and objects near those devices, even when not every device can view those persons or objects. In some embodiments, one or more audio or video capture elements can be selected based on their proximity and orientation to an object to be captured. In some embodiments, the information captured from the various audio and/or video elements can be combined to provide three-dimensional imaging, surround sound, and other such capture data.