Abstract: Apparatus for the automatic positioning of at least two, or for the automatic selection from at least three cameras (K), coupled for three-dimensional image recording, including a device for distance measurement (EM), which is configured to measure the distances of relevant points (0) in the object space (OR) relative to the recording apparatus (A) and to supply corresponding output signals, wherein the relevant points (0) can be selected manually or automatically; a computer unit (RE), which is configured to calculate the parameters such as stereo base, swivel angle, correction parameters and internal parameters of the cameras (K) and/or a positioning device (P), to adjust the cameras (K) depending on the calculated parameters; and a switching apparatus (S), which together with the computer unit (RE) can form a single unit which can effect a selection of camera bundles depending on the size of the stereo base.

Abstract: The disclosure includes a system and method for receiving viewing data that describes a location of a first user's gaze while viewing virtual reality content. The method also determining an object of interest in the virtual reality content based on the location of the first user's gaze. The method also includes generating a social network that includes the first user as a member of the social network. The method also includes performing an action in the social network related to the object of interest.

Abstract: A system and method for inspecting a railway track bed using a plurality of sensors that are synchronized for rapid interrogation of a railway track bed while the sensors are in motion at a high rate of speed.

Abstract: Wired portable or permanent pylon-mounted, single or multiple camera assemblies providing high-definition images, remote video parameter adjustment, real time imaging, lower camera mounting, microphone use, no overheating problems, longer run times, and installation and removal without disturbing field surface. Pylon is molded from high-density, impact resistant foam, integrated with a break-away connect providing for non-destructively breaking and remaking electrical connections. Increased content of high impact, resistant material provides player and pylon protection. Camera wiring extends internally to integral connecting base fitted with magnets for quick and accurate mating with stationary turf base. Wires in turf carry signals from camera to a fiber optic transmitter that powers the pylon cameras, converts the electrical signals to optical signals, and receives control signals converting them to electrical signals.

Abstract: The present disclosure relates to a method for transmitting two consecutive pairs of images. The method may include decimating each image with a ratio of 2, assembling the two decimated images of each pair in a composite image, transmitting the composite images, and reconstructing complete images from the composite images. In decimation, the information removed from the images of the first pair may be kept in the images of the second pair, from the spatial point of view, and the complete images may be reconstructed by de-interlacing processing from the composite images.

Abstract: The present disclosure relates to a method for transmitting two consecutive pairs of images. The method may include decimating each image with a ratio of 2, assembling the two decimated images of each pair in a composite image, transmitting the composite images, and reconstructing complete images from the composite images. In decimation, the information removed from the images of the first pair may be kept in the images of the second pair, from the spatial point of view, and the complete images may be reconstructed by de-interlacing processing from the composite images.

Abstract: A method for scanning and obtaining three-dimensional (3D)l coordinates is provided. The method includes providing a 3D measuring device having a projector, a first camera and a second camera. The method records images of a light pattern emitted by the projector onto an object. A deviation in a measured parameter from an expected parameter is determined. The calibration of the 3D measuring device may be changed when the deviation is outside of a predetermined threshold.

Abstract: A video frame processing method, which comprises: (a) capturing at least two video frames via a multi-view camera system comprising a plurality of cameras; (b) recording timestamps for each the video frame; (c) determining a major camera and a first sub camera out of the multi-view camera system, based on the timestamps, wherein the major camera captures a major video sequence comprising at least one major video frame, the first sub camera captures a video sequence of first view comprising at least one video frame of first view; (d) generating a first reference video frame of first view according to one first reference major video frame of the major video frames, which is at a reference timestamp corresponding to the first reference video frame of first view, and according to at least one the video frame of first view surrounding the reference timestamp; and (e) generating a multi-view video sequence comprising a first multi-view video frame, wherein the first multi-view video frame is generated based on the

Abstract: A 3-dimensional (3D) video rendering device may convert a first left view video of a decompressed 3D video having a first frame rate to generate a second left view video having a second frame rate, and convert a first right view video having the first frame rate to generate a second right view video having the second frame rate. The second left view video having a particular pixel resolution may be converted by the 3D video rendering device to generate a third left view video having full pixel resolution of the decompressed 3D video. The second right view video having the particular pixel resolution may be converted to generate a third right view video having the full pixel resolution. The 3D video rendering device may generate a sequence of video frames for 3D video display based on the third left view video and the third right view video.

Abstract: A method for providing an operating device in a vehicle, wherein a control device generates graphics data which control a display surface so that a graphics object relating to an executed application is displayed, and the geometric structure of an actuating object is detected in a detection space in front of the display surface and, depending upon the detected structure, a control signal for controlling the executed application is generated. A control signal for stopping the executed application is generated by the control system if a geometric structure of the actuating object has been detected in the detection space, wherein a substantially planar surface of the actuating object which is oriented substantially parallel to the display surface is spaced apart from the display surface. Also disclosed is a corresponding operating device for carrying out the method and a vehicle having such an operating device.

Abstract: Representation and coding of multi-view images using tapestry encoding are described. A tapestry comprises information on a tapestry image and a world coordinates map associated with the tapestry image, each of which may contain information from one or more perspectives of a scene. Perspective images of a scene can be generated from the tapestry image and the world coordinates map.

Abstract: A cleaning robot (1) which is an autonomous mobile system performs coordinate conversion of three-dimensional coordinate data acquired by measurement in a distance image sensor (20) which is arranged in a frontward and obliquely downward direction to generate three-dimensional coordinate data of a floor surface reference. Labels are applied to this data by judging a level difference or an obstacle according to height from a floor surface (F) to create overhead view image data seen from directly above a cleaning robot main body. The overhead view image data is scanned, and only when the labels are arranged in a specific order, processing for substituting an unspecified area with a level difference is performed. Thereby, positional deviation of an edge of the level difference, which is caused by a blind spot, is corrected and a position of the level difference is able to be grasped accurately.

Abstract: A method for measuring phase shift to detect irregularities of a surface is described. Additionally, a system for measuring phase shift to detect irregularities of a surface is provided. Further, a non-transitory computer-readable storage medium having computer-executable instructions embodied thereon is described. The computer-executable instructions are for measuring phase shift to detect irregularities of a surface.

Abstract: A controlled three-dimensional (3D) communication endpoint system and method for simulating an in-person communication between participants in an online meeting or conference and providing easy scaling of a virtual environment when additional participants join. This gives the participants the illusion that the other participants are in the same room and sitting around the same table with the viewer. The controlled communication endpoint includes a plurality of camera pods that capture video of a participant from 360 degrees around the participant. The controlled communication endpoint also includes a display device configuration containing display devices placed at least 180 degrees around the participant and display the virtual environment containing geometric proxies of the other participants. Placing the participants at a round virtual table and increasing the diameter of the virtual table as additional participants are added easily achieves scalability.

Abstract: Provided is an imaging apparatus including an imaging lens, and an image sensor array of first and second image sensor units, wherein a single first image sensor unit includes a single first microlens and a plurality of image sensors, a single second image sensor unit includes a single second microlens and a single image sensor, light passing through the imaging lens and reaching each first image sensor unit passes through the first microlens and forms an image on the image sensors constituting the first image sensor unit, light passing through the imaging lens and reaching each second image sensor unit passes through the second microlens and forms an image on the image sensor constituting the second image sensor unit, an inter-unit light shielding layer is formed between the image sensor units, and a light shielding layer is not formed between the image sensor units constituting the first image sensor unit.

Abstract: Provided are video encoding device that encodes high-quality video, restricting increase of the required bandwidth, while maintaining playback compatibility with playback devices conforming to MPEG-2 standard, and video playback device. Data creation device 5401 includes: 2D compatible video encoder 2602 that generates stream conforming to MPEG-2 format by compress-encoding original video of normal quality; base-view video encoder 2605 that generates stream, composed of black images, that includes the same number of pictures as stream that is obtained by compress-encoding original video; and dependent-view video encoder 5409 that generates dependent-view video stream by compress-encoding higher-quality original video, by using, as reference pictures, pictures included in stream conforming to the MPEG-2 format that have the same time information as pictures included in the base-view video stream that correspond to pictures constituting higher-quality original video.

Abstract: A dual-view image display device includes a signal input module, a video processing module, a dual-view processing module and a display module, and the video processing module includes a nonlinear processing module. A dual-view image display method includes: inputting a video signal having a frame image that is split into two first images, processing the video signal to obtain the two first images, horizontally or vertically splitting each of the two first images into areas, nonlinearly enlarging each of the areas, and interpolating pixels to each of the enlarged areas to obtain two fullscreen second images. The nonlinear enlargement is used to allow the enlarged images generated during the dual-view image display to be robust to distortion, resulting in better image quality.

Abstract: An example system for testing camera modules includes: a structure for holding camera modules under test, where each of the camera modules includes an image sensor, and where the camera modules are arranged in a same plane on the structure and offset from each other in the plane; and a target for use in testing the camera modules concurrently, where the target includes multiple tiles that are repeated, where each tile contains information for use in testing a camera module, and where the camera modules and the tiles are arranged so that different camera modules face different tiles but see at least some of the same information at the same angle.

Abstract: The features relate generally to acquiring, formatting, and distributing video content to a variety of devices in multiple geographies. Some features described herein relate to preserving the stereoscopic effect for the formatting and distribution of 3D video content. Additionally, features described herein relate to customized and/or dynamic generation of a 3D stream based on a user device and/or user preferences.

Abstract: The present invention relates to a method for making 3D stereo digital broadcast service compatible in an MPEG-2-TS format which is used for transmitting and receiving digital TV. To this end, suggested is a method for transmitting detailed information which supports both TS-level multiplexing and ES-level multiplexing when left and right compressed bitstreams are multiplexed, when service compatibility is enabled.

Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.

Abstract: An image processing apparatus includes an image obtaining unit configured to obtain a plurality of images, which are images of the same subject captured from different viewpoints; an image offset correction unit configured to modify the plurality of images obtained by the image obtaining unit on the basis of parameters for correcting image offset and generate a correction image for each of the obtained images; an evaluation value calculation unit configured to calculate, as an evaluation value, an integration value, for an entire screen, of an error amount indicating a degree at which association in a parallax direction among the plurality of correction images generated by the image offset correction unit is not possible; and an update unit configured to change a parameter that is necessary for association in the parallax direction among the parameters so as to update the parameter so that the evaluation value becomes a minimum.

Abstract: A camera holding assembly that is configured to hold a plurality of cameras in a predetermined orientation includes a support having a plurality of receptacles. Each of the receptacles include at least one feature enabling a camera to be releasably retained therein as well as at least one and preferably at least three attachment features configured for enabling the camera holding assembly to be secured to another object. The receptacles are oriented about the support so that each camera, when loaded into the defined receptacles, is aimed in a different angular orientation. Images obtained from each retained camera can be stitched to create either a composite 360 degree×180 degree full spherical image or a composite 360 degree composite image of a scene of interest.

Abstract: Provided are an apparatus and method for predictive coding/decoding for improving a compression rate of multiview video using one or two additional reference frame buffers. The predictive encoding apparatus includes: a multiview reference picture providing unit for providing a reference picture for a predictive encoding according to temporal and spatial GOP structure information; a prediction unit for creating a vector by predicting which part of the reference picture inputted from the multiview reference picture providing unit is referred by a picture to currently encode; a transforming and quantizing unit for obtaining a difference signal between the predicted signal inputted from the prediction unit and a picture signal to currently encode, transforming the obtained difference signal, quantizing the transformed signal, and compressing the quantized signal; and an entropy encoding unit for encoding the quantized signal and the vectors according to a predetermined scheme and outputting the encoded signal.

Abstract: There is provided in accordance with some embodiments of the present invention an optical assembly including a set of optical paths, wherein two or more optical paths receive an image from a common surface. The optical paths may direct received images onto a common image sensor generating a complex multidimensional data set, an image processing block may extrapolate each of the subset of optical paths printed on the image sensor and may generate a multidimensional data set based on the collected images.

Abstract: A method and system for producing a single view video signal based on a multiview video coding (MVC) signal stream. A MVC signal stream representing multiple spatially related views of a scene, including a base view and at least one dependent view, is decoded to provide multiple decoded video signals representing the spatially related views, with respective portions of the MVC signal stream representing one of multiple temporally adjacent video frames, and the MVC signal stream representing multiple sequences of spatially adjacent video frames. The decoded video signals are processed to provide a processed video signal representing one of the spatially related views using image information from more than one of the decoded video signals. As a result, more image data is used during processing, thereby improving the spatial and temporal image quality.

Abstract: Present invention provides a single-eye stereoscopic image capturing device which can reduce the discomfort of a photographer by constantly maintaining a parallax quantity of a left-eye image and a right-eye image that are stereoscopically-displayed even if a focus lens is moved. The single-eye stereoscopic image capturing device comprises, a photographic optical system, pupil division part, imaging part, focus lens driving part, parallax correction quantity calculation part, parallax correction part, and output part.

Abstract: An image processing device configured to be installed in a vehicle includes an image acquirer, an image selector, a first luminance adjuster, a synthetic image generator, and an image provider. The image acquirer acquires camera images captured by cameras provided on the vehicle. The image selector selects one of the camera images as a representative image based on luminances of the camera images. The first luminance adjuster adjusts a luminance of at least one of the other camera images based on a luminance of the representative image. The synthetic image generator generates a synthetic image showing a periphery of the vehicle, based on the representative image and the other camera images the luminance of at least one of which has been adjusted by the first adjuster. The image provider outputs, to a display device installed in the vehicle, information corresponding to the synthetic image.

Abstract: Computing devices can collaborate in order to take advantage of various components distributed across those devices. In various embodiments, image information captured by multiple devices can be used to identify and determine the relative locations of various persons and objects near those devices, even when not every device can view those persons or objects. In some embodiments, one or more audio or video capture elements can be selected based on their proximity and orientation to an object to be captured. In some embodiments, the information captured from the various audio and/or video elements can be combined to provide three-dimensional imaging, surround sound, and other such capture data.

Abstract: An exemplary technique is provided for obtaining an improved depth precision for a stereo image of an object of interest. The technique includes imaging a first image of the object of interest from a first position, imaging a second image of the object of interest from a second position different from the first position, determining a rough estimate of a depth for the object of interest based on the first image and the second image, determining an improved set of imaging positions corresponding to an improved depth precision for the object of interest based on the rough estimate of the depth, imaging improved images from the improved set of imaging positions, and determining an improved depth based on the improved images.

Abstract: A three-dimensional image measuring apparatus includes a measurement platform, a movable optical head, a three-dimensional calculator module, a moving module and a calibration controlling module. The movable optical head includes a beam splitter unit, a projecting module, an image-capturing module and an indicator module. The measurement platform supports an object under measurement. The projecting module generates a structure light of parallel sinusoid strips pattern to the object under measurement. The image-capturing module includes image-capturing units facing the object under measurement from different directions or angles. Each image-capturing unit is configured to capture a reflection image which is formed from the structure light of parallel sinusoid strips pattern reflected by the object under measurement. The indicator module projects an alignment beam onto the object under measurement for forming an alignment mark.

Abstract: Switching device (1) for the alternating connection of at least one television camera (2) to one of at least two television camera control units (3) or for the alternating connection of at least one television camera control unit (3) to one of at least two television cameras (2); with the switching device (1) having connectors (4, 5) for the television camera(s) (2) and the television camera control unit(s) (3); and each connector (4, 5) having electrical supply contacts (6, 7) for the power and voltage supply of the television camera (2) through the television camera control unit (3); and having at least one optical contact (8, 9) for the transmission of information over fiberoptic cables between the television camera (2) and the television camera control unit (3); and with the switching device (1) having at least one power supply line switch (10) and at least one optical switch (11) and at least one switching control unit (12) to actuate the power supply line switch (10) and to actuate the optical switch (1

Abstract: A stereo camera system useful in, for example, range finding applications. The system is designed for simple manufacture and long term stability. It includes a thermally stable substrate onto which are mounted multiple imagers. The relative positions of the imagers and corresponding optical elements are maintained in precise alignment.

Abstract: Systems, methods and articles of manufacture for minimizing parallax based on depth map generation are described herein. Embodiments of the present disclosure relate to cameras positioned on a camera assembly that capture digital photographic images. The digital photographic images are stitched together into a panoramic image. In order to minimize the parallax while stitching, the procedure includes estimating a distance of a pixel corresponding to a scene point on the scene surface from a panoramic center of projection positioned on the camera assembly to the scene surface. A depth map is generated that provides the estimated depth of the pixel. Based on the estimated depth, the pixel may be projected onto each camera. A panoramic pixel corresponding to the scene point may be obtained from the values of each projected pixel. The panoramic pixel may then be mapped onto the panoramic image with parallax minimized.

Abstract: A method for automatically detecting and tracking multiple targets in a multi-camera surveillance zone and system thereof. In each camera view of the system only a simple object detection algorithm is needed. The detection results from multiple cameras are fused into a posterior distribution, named TDP, based on the Bayesian rule. This TDP distribution represents a likelihood of presence of some moving targets on the ground plane. To properly handle the tracking of multiple moving targets with time, a sample-based framework which combines Markov Chain Monte Carlo (MCMC), Sequential Monte Carlo (SMC), and Mean-Shift Clustering, is provided. The detection and tracking accuracy is evaluated by both synthesized videos and real videos. The experimental results show that this method and system can accurately track a varying number of targets.

Abstract: A 3D camera (10) in accordance with the stereoscopic principle for detecting depth maps (52) of a monitored zone 12) is set forth which has at least two camera modules (14a-b) each having an image sensor (16a-b) in mutually offset perspectives for taking two-dimensional starting images (42) as well as a stereoscopic unit (28) which is configured for the application of a stereoscopic algorithm for generating a depth map (46, 50) in that mutually associated part regions are recognized in two two-dimensional images taken within a disparity zone from offset perspectives and their distance is calculated with reference to the disparity.

Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.

Abstract: According to one embodiment, a solid state imaging device includes a first imaging device, a second imaging device, and a calculating unit. The first imaging device includes a first optical system, a first imaging unit, and a second optical system provided between the first optical system and the first imaging unit. The second imaging device includes a third optical system, a second imaging unit, and a fourth optical system provided between the third optical system and the second imaging unit. The calculating unit is configured to perform a first calculation and a second calculation. The first calculation includes deriving a first distance from stereo disparity. The second calculation includes deriving a second distance from a parallax image. The calculating unit is configured to estimate a target distance based on at least one selected from the first distance and the second distance.

Abstract: An image capturing device includes at least two image sensors and an image processing unit that performs image processing on image information that is captured by image sensors and an image display unit that displays the image information on which the image processing is performed by the image processing unit. The image processing unit displays two base points on the image display unit in a same direction as a direction in which the two image sensors are arranged, calculates a disparity value between a first base point and a second base point that are the two base points with the two image sensors, calculates a length between the first base point and the second base point, and displays a result of calculation of the length between the first base point and the second base point on the image display unit.

Abstract: A method of providing an image to be displayed includes providing captured scene data representing one or more images of a real scene and providing illumination data representing real illumination impinging on the real scene, providing a virtual reality image of a theoretical object by modeling said theoretical object using said illumination data to define illumination impinging on the theoretical object, and providing a combined image including elements of the real scene based on said captured scene data and including said virtual reality image.

Abstract: An item tracking system includes a plurality of items for storage and removal from a compartment. The system includes tags affixed to the items and configured to store identifiers for the items. A tag reader receives data from the tags in response to the items being removed from and returned to the compartment. A sensor in the compartment identifies a state change associated with the compartment. A processor identifies removal of an item with data received by the tag reader, identifies the state change with the sensor after the item is removed and before it is returned, and generates an output with an output device including the identifier corresponding to the item in response to the state change in the compartment.

Abstract: A method for registering a first imaging detector to a surface projects a sequence of k images toward the surface, wherein k?4, wherein each of the k images has a pattern of lines that extend in a direction that is orthogonal to a movement direction. The pattern encodes an ordered sequence of labels, each label having k binary elements, such that, in the movement direction, any portion of the pattern that is k equal increments long encodes one label of the ordered sequence. The method obtains, for at least a first pixel in the first imaging detector, along at least one line that is parallel to the movement direction, a first sequence of k signal values indicative of the k binary elements of a first label from the ordered sequence of labels and correlates the at least the first pixel in the first imaging detector to the surface.

Abstract: A system and methods for geometric calibration and use of head-worn multi-camera eye tracking system are provided. The system calibrates the internal and external parameters of the cameras as well as the parameters of a compact geometric model of the human eye. An exo-camera determines a relative pose with regard to a computer monitor and endo-cameras determine the eyeball position and orientation. An endo-exo calibration and an endo-eye calibration each with an optimization step are included. A homography and a joint optimization step are also provided. A single point calibration re-establishes calibration. The system in operational mode determines a user's gaze direction to perform a computer input function.

Abstract: A 3D camera (10) having at least one image sensor (16, 16a-b) for detecting three-dimensional image data from a monitored zone (12, 34, 36) and having a mirror optics (38) disposed in front of the image sensor (16, 16a) for expanding the field of view (44) is provided. In this respect, the mirror optics (38) has a front mirror surface (40) and a rear mirror surface (42) and is arranged in the field of view (44) of the image sensor (16, 16a-b) such that the front mirror surface (40) generates a first partial field of view (34) over a first angular region and the rear mirror surface (42) generates a second partial field of view (36) over a second angular region, with the first angular region and the second angular region not overlapping and being separated from one another by non-monitored angular regions.

Abstract: Systems in accordance with embodiments of the invention can perform parallax detection and correction in images captured using array cameras. Due to the different viewpoints of the cameras, parallax results in variations in the position of objects within the captured images of the scene. Methods in accordance with embodiments of the invention provide an accurate account of the pixel disparity due to parallax between the different cameras in the array, so that appropriate scene-dependent geometric shifts can be applied to the pixels of the captured images when performing super-resolution processing. In a number of embodiments, generating depth estimates considers the similarity of pixels in multiple spectral channels. In certain embodiments, generating depth estimates involves generating a confidence map indicating the reliability of depth estimates.

Abstract: Systems in accordance with embodiments of the invention can perform parallax detection and correction in images captured using array cameras. Due to the different viewpoints of the cameras, parallax results in variations in the position of objects within the captured images of the scene. Methods in accordance with embodiments of the invention provide an accurate account of the pixel disparity due to parallax between the different cameras in the array, so that appropriate scene-dependent geometric shifts can be applied to the pixels of the captured images when performing super-resolution processing. In a number of embodiments, generating depth estimates considers the similarity of pixels in multiple spectral channels. In certain embodiments, generating depth estimates involves generating a confidence map indicating the reliability of depth estimates.

Abstract: This document describes techniques and apparatuses for implementing an asymmetric sensor array for capturing images. These techniques and apparatuses enable better resolution, depth of color, or low-light sensitivity than many conventional sensor arrays.

Abstract: A method of image processing in a structured light imaging device is provided that includes capturing a plurality of images of a scene into which a structured light pattern is projected by a projector in the structured light imaging device, extracting features in each of the captured images, finding feature matches between a reference image of the plurality of captured images and each of the other images in the plurality of captured images, rectifying each of the other images to align with the reference image, wherein each image of the other images is rectified based on feature matches between the image and the reference image, combining the rectified other images and the reference image using interpolation to generate a high resolution image, and generating a depth image using the high resolution image.

Abstract: Stereo imaging can be provided on an electronic device without the need for two matched, high resolution, large format cameras. In various embodiments, two or more cameras of disparate types can be used to capture stereoscopic images. Various processing algorithms can be used to adjust aspects such as the effective pixel size and depth of focus in order to provide for sufficient information to generate three-dimensional images without significant artifacts resulting from differences in the mismatched cameras.

Abstract: An imaging device for a photo finish system, including a first camera aligned on a finish line and a mechanism for display of three dimensional stereoscopic images.