Abstract: Example embodiments may help multi-camera devices determine disparity information scene, and use the disparity information in an autofocus process. An example method involves: (a) receiving image data of a scene that comprises at least one image of the scene captured by each of two or more image-capture systems of a computing device that includes a plurality of image-capture systems; (b) using the image data captured by the two or more image-capture systems as a basis for determining disparity information for the scene; and (c) performing, by the computing system, an autofocus process based at least in part on the disparity information, wherein the autofocus process provides a focus setting for at least one of the image-capture systems of the computing device.

Abstract: Methods of stitching data generated by a plurality of census transforms are disclosed. The methods include performing a plurality of census transforms on an array of pixels in a first direction. First and second code words of the census transform results are stored in arrays. The arrays are transposed and interleaved. The first and second code words are stitched by reading a vertical column of the array of interleaved code words.

Abstract: A method and system to analyze sports motions using the motion sensors of a mobile device, such as a smart phone, is provided. This method uses the mobile device motion sensor output to define the impact point with a virtual object, such as a golf ball, baseball or tennis ball. The motion sensor signature of the sports motion is analyzed for characteristics, specific to each type of sports motion. A method is disclosed using multiple sensors outputs in a mobile device to compute the impact point with a virtual object, such as a golf ball, baseball, tennis ball. Further, a method is disclosed where moving virtual sports objects interact with virtual sports motions and the responsive outputs are displayed on the mobile device and/or any Web-enabled display device.

Abstract: Disclosed are various embodiments for implementing a zooming application that pairs an optical head mounted display (OHMD) device with an electroencephalogram (EEG) sensor to facilitate the control and the level of magnification as well as the text-to-speech conversion of any text depicted on an optical head mounted display device. The zooming application may be configured to perform various operations such as, for example, zoom-in, zoom-out, text-to-speech, freeze, and/or other operations on an image as well as text depicted on an optical head mounted display device in response to a triggering signal obtained from the electroencephalogram (EEG) sensor, motion detecting sensor, neural implant, or other sensor.

Abstract: An image processing apparatus includes a depth control signal generation unit generating a depth control signal controlling emphasis of the feel of each region of an input image based on the depth position of a subject in each region of the input image; a face skin region control signal generation unit generating a face skin region control signal controlling emphasis of the feel of each region in the input image based on the human face skin region in the input image; a person region control signal generation unit generating a person region control signal controlling emphasis of the feel of each region in the input image based on the region of the person in the input image; and a control signal synthesis unit synthesizing the depth control signal, the face skin region control signal, and the person region control signal to generate a control signal.

Abstract: Techniques for rectification of camera arrays are described. In one embodiment, for example, an apparatus may comprise a processor circuit and an imaging management module, and the imaging management module may be operable on the processor circuit to determine a composite rotation matrix for a camera array comprising a plurality of cameras, determine a composite intrinsic parameter matrix for the camera array, and compute one or more rectification maps for the camera array based on the composite rotation matrix and the composite intrinsic parameter matrix, each of the one or more rectification maps corresponding to one of the plurality of cameras. Other embodiments are described and claimed.

Abstract: The present invention provides a method for adjusting stereoscopic image parallax. An original camera is provided. A scene space corresponding to the original camera is preset, including presetting a depth range of the scene space. Preset viewing environment parameters for displaying stereoscopic images of a scene in the scene space are configured, including presetting a depth range of an actual view space. The method further includes establishing a mapping relationship between the depth range of the actual view space and the depth range of the scene space. According to the mapping relationship, the preset viewing environment parameters and the scene space, camera parameters for adjusting stereoscopic image parallax are calculated. The original camera is adjusted based on the camera parameters to capture the scene. Thus, the stereoscopic images of the scene can be generated and presented.

Abstract: In a method, a first video stream is received from a video camera, and a second video stream is received from a depth camera. A pixel mapping between the video camera and the depth camera is known. The video camera has an update rate greater than that of the depth camera. Optical flow in successive frames of the first video stream is measured, and a portion of the optical flow attributable to depth change is extracted. A scaling factor is calculated for each pixel in successive frames of the first video stream to determine whether a depth change has occurred. A perspective depth correction is applied to each pixel having a depth change. The perspective depth correction is based upon the depth of the corresponding pixel in the most recent frame from the second video stream. A combined video stream having an update rate of the video camera and depth information from the depth camera is obtained.

Abstract: Provided is a rectification apparatus of a stereo vision system and a method thereof. The method comprises: distinguishing variables and parameters preset in a determinant configured with parameters of the stereo cameras and rectification parameters for axial movement of the rectification, and converting the determinant into a linear function by substituting constant parameters for the parameters preset in the determinant; storing left and right images transmitted from the stereo cameras; sequentially performing a coordinate operation; calculating a weight and coordinates of a camera image plane; and linearly interpolating the pixel value by using the calculated weight and coordinates of the camera image plane, and then mapping the pixel value to the coordinates of the rectified image plane.

Abstract: Devices and methods for performing a surgical step or surgical procedure with visual guidance using an optical head mounted display are disclosed.

Abstract: A current problem with 3D scanners using structured light patterns is choosing a single light pattern to accommodate all possible object/range conditions. Objects far from the 3D scanner often require different patterns than objects that located close to the 3D scanner. In addition, large objects often require different patterns than small objects. To automatically sense and adapt to a wide variety of size/range conditions, the present invention embraces a 3D scanner for dimensioning that has two projectors for projecting two different light patterns. Based on the scanning requirements for a particular object, one of the two projected patterns may be used to obtain information regarding the shape of an object. In one possible embodiment, this shape information is used to obtain the object's dimensions.

Abstract: A system, article, and method of planar surface detection for image processing.

Abstract: Methods, systems, apparatuses, and computer program products are provided for creating multiple patterns of flood illumination for a time of flight (TOF) camera system. Light is generated, and from the generated light, illumination light is formed that is projected into an image environment. The illumination light is formed by: diverging the generated light to form divergent light characterized by a light profile that is less intense in a first region centered on an optical axis of the divergent light than in a second region that at least partially rings the first region, and converting the divergent light into a plurality of illumination light patterns to be projected into the illumination environment. The illumination light patterns are each projected to a corresponding region of the illumination environment.

Abstract: Embodiments are provided to search for a dictionary image corresponding to a target image. The method includes detecting keypoints in a set of dictionary images. The set of dictionary images includes at least one dictionary image having a plurality of pixels. At least one random pair of pixels is selected among the detected keypoints of the dictionary image on the basis of candidate coordinates for pixels distributed around the detected keypoints of the dictionary image. A feature vector of each keypoint of the dictionary image is calculated, including calculating a difference in brightness between the selected pairs of pixels of the dictionary image. The calculated difference in brightness is an element of the feature vector. Keypoints of a target image are detected.

Abstract: A depth sensing multiple camera system is described that uses depth sensing cameras. In one example, the camera system includes a primary auto-focus camera to capture an image of a scene at a first focus distance, the primary camera having a fixed field of view through different focus distances, a secondary auto-focus camera to capture an image of the same scene at a second focus distance, the secondary camera having a fixed field of view through different focus distances, and a processor having a port coupled to the primary camera to receive images from the primary camera and also coupled to the secondary camera to receive images from the secondary camera and to determine a depth map for the captured primary camera image using the captured secondary camera image.

Abstract: Embodiments enable detecting an occurrence such as an impact event, which can occur when an electronic device impacts a surface or object (e.g., from a fall), which may have occurred while the device was powered off, in a low power mode, or other state where the device cannot detect such an impact using an accelerometer or other such sensor. Various calibration processes can be used to determine an amount of misalignment between two or more cameras of the device, where an amount of misalignment more than an allowable threshold can be indicative of the impact event, at which point one or more system checks can be performed to determine whether the device components (e.g., memory, hard-disk, drives, antennas, etc.) or certain portions or components of the device are operating properly.

Abstract: Embodiments are provided to search for a dictionary image corresponding to a target image. The method includes detecting keypoints in a set of dictionary images. The set of dictionary images includes at least one dictionary image having a plurality of pixels. At least one random pair of pixels is selected among the detected keypoints of the dictionary image on the basis of candidate coordinates for pixels distributed around the detected keypoints of the dictionary image. A feature vector of each keypoint of the dictionary image is calculated, including calculating a difference in brightness between the selected pairs of pixels of the dictionary image. The calculated difference in brightness is an element of the feature vector. Keypoints of a target image are detected.

Abstract: There is provided an image processing device including a first composition setting unit configured to set composition for a two-dimensionally displayed input image based on a first technique, and a second composition setting unit configured to set composition for a three-dimensionally displayed input image based on a second technique different from the first technique.

Abstract: It is provided a method for detecting an object in a left view image and a right view image, comprising steps of receiving the left view image and the right view image; detecting a coarse region containing the object in one image of the left view image and the right view image; detecting the object within the detected coarse region in the one image; determining a coarse region in the other image of the left view image and the right view image based on the detected coarse region in the one image and offset relationship indicating position relationship of the object in a past left view image and a past right view image; and detecting the object within the determined coarse region in the other image.

Abstract: An image reducer executes a reduction process on a comparison image to generate a reduced comparison image, and executes a reduction process on a reference image to generate a reduced reference image. A disparity value deriver (a deriving unit) derives a disparity value by setting the minimum value of synthesized costs of pixels in the reduced comparison image in connection with a reference pixel in the reduced reference image, which have been calculated by a cost synthesizer. A disparity image generator generates a reduced disparity image, which is an image obtained by replacing the luminance values of the respective pixels in the reduced reference image with the disparity values corresponding to the pixels. The disparity image enlarger executes an enlargement process for enlarging the image size of the reduced disparity image generated by the disparity image generator to generate a disparity image.

Abstract: A terminal having a camera and a method of processing an image in the camera are disclosed. The method includes collecting, using a camera, a user image captured at a user focal length and a link image captured at a selective focal length, and storing the user image and the link image by linking the link image with the user image. Using this method, a user can capture a subject and circumstances around the subject when the image is captured.

Abstract: Embodiments efficiently account for variations in camera position across an image, when the image is texture mapped from a single position associated with the image. In an embodiment, each pixel of an image is texture mapped to a three dimensional model. A time offset mask for the image and a value representing a speed of the camera are received. The time offset mask and speed values are used to create an offset mask. The offset mask is applied to the texture mapped model to correct for variations in camera position across an image.

Abstract: The disclosure includes a system and method for calibrating a binocular optical see-through augmented reality display. A calibration application renders one or more images of a virtual object on the one or more displays of the human interface device, and receives a user input to adjust a position of the one or more images on the one or more displays. In response to the input, the calibration application identifies a first and second boundary of a target range surrounding a real-world object at a first and second depth, respectively. The calibration application determines a first and second disparity corresponding to the first and second boundary and may record the disparities in relation to the depth of the real-world object.

Abstract: A method and apparatus for rendering content are provided. The content rendering method includes determining at least one reference plane set to three dimensional (3D) content, in response to a request for displaying 3D content; classifying objects, displayed on the 3D content, based on a location of each object relative to a location of the reference plane into objects corresponding to at least one of a first left image or a first right image, and objects corresponding to at least one common image, respectively; creating the first left image, the first right image and the at least one common image, according to the respective classified objects; and combining the at least one common image with each of the first left image and the first right image to form a second left image and a second right image, respectively.

Abstract: A dimensioning system can include stored data indicative of coordinate locations of each reference element in a reference image containing a pseudorandom pattern of elements. Data indicative of the coordinates of elements appearing in an acquired image of a three-dimensional space including an object can be compared to the stored data indicative of coordinate locations of each reference element. After the elements in the acquired image corresponding to the reference elements in the reference image are identified, a spatial correlation between the acquired image and the reference image can be determined. Such a numerical comparison of coordinate data reduces the computing resource requirements of graphical comparison technologies.

Abstract: An image pickup apparatus includes: an image pickup device arranged such that a light receiving surface is orthogonal to an optical axis of an image pickup lens, the image pickup device acquiring primary image data; an input device that receives input of correction angles including a first angle that is an angle formed in a pitch direction relative to the light receiving surface and a second angle that is an angle formed in a yaw direction relative to the light receiving surface; an image processing unit that uses a focal length of the image pickup lens and the correction angles to generate secondary image data obtained by applying a modification process of projecting the primary image data onto a plane forming the first angle in the pitch direction relative to the light receiving surface and the second angle in the yaw direction relative to the light receiving surface.

Abstract: The present disclosure provides a system, method, and apparatus for collecting sensor data by a remote vehicle. The method involves determining, by at least one first processor, at least one scene to collect by using information in a demand map. The method further involves configuring, by at least one processor, a field of view for at least one sensor associated with the remote vehicle to collect at least one scene. Further, the method involves collecting, by at least one sensor, at least one scene.

Abstract: Systems, methods, and non-transitory computer-readable media can initiate a video capture mode that provides a camera view. A touch gesture can be detected via a touch display. A drawing can be rendered based on the touch gesture. The drawing can be rendered to appear to overlay the camera view. A first video image frame can be acquired based on the camera view. At least a portion of the first video image frame and the drawing can be combined to produce a first combined frame. The drawing can appear to overlay the first video image frame. The first combined frame can be stored in a video buffer.

Abstract: A computer-implemented depth estimation method based on non-parametric Census transform with adaptive window patterns and semi-global optimization. A modified cross-based cost aggregation technique adaptively creates the shape of the cross for each pixel distinctly. In addition, a depth refinement algorithm fills holes within the estimated depth map using the surrounding background depth pixels and sharpens the object boundaries by exerting a trilateral filter to the generated depth map. The trilateral filter uses the curvature of pixels as well as texture and depth information to sharpen the edges.

Abstract: Provided is a disparity correcting device which rapidly corrects disparity information generated on the basis of a left image and disparity information generated on the basis of a right image through a simple configuration, and a method thereof, in stereo vision which generates a 3-dimensional image using a left image and a right image captured from left and right cameras.

Abstract: The present disclosure provides a computer-implemented method of, and system for, characterizing the phenotype of a plant. The method includes: (i) obtaining mesh data representing a surface of the plant, said mesh data including data representing a plurality of polygons having respective sets of vertices, each vertex having a spatial coordinate; and (ii) applying at least two segmentations of progressively finer resolution to the mesh data to assign the vertices to distinct morphological regions of the plant.

Abstract: A dimensioning system can include stored data indicative of coordinate locations of each reference element in a reference image containing a pseudorandom pattern of elements. Data indicative of the coordinates of elements appearing in an acquired image of a three-dimensional space including an object can be compared to the stored data indicative of coordinate locations of each reference element. After the elements in the acquired image corresponding to the reference elements in the reference image are identified, a spatial correlation between the acquired image and the reference image can be determined. Such a numerical comparison of coordinate data reduces the computing resource requirements of graphical comparison technologies.

Abstract: A light switching module including a first refractive element, a second refractive element and a shifting device. The first refractive element and the second refractive element include substrates with a plurality of micro-lens structures, patterned retardation microstructures disposed on the plurality of micro-lens structures and birefringent layers on the patterned retardation microstructures. Therefore, the birefringent layers have different optical axis regions. The shifting device can adjust the relative position of the first refractive element and the second refractive element to switch penetrating or refracting of incident light and to change the light switching module to transparent state or opaque state.

Abstract: A wearable display device, system and method are described. The display system includes a wearable display to be worn by a person; a display buffer to receive display data from a graphics engine, which data includes data regarding position of a wearer in a virtual environment; a display processor unit to process vision direction data using the display data from the graphics engine, wherein the display processor unit sends the display data to the wearable display. In an example, the display system is a component to a gaming system or environment.

Abstract: Described herein are methods and systems for closed-form 3D model generation of non-rigid complex objects from incomplete and noisy scans. An image processing module receives a scan of a non-rigid complex object captured by a sensor, a 3D model corresponding to the object, and a camera trace, where the scan includes one or more holes. The module cleans the scan and the 3D model using the camera trace. The module deforms the cleaned 3D model to the cleaned scan and matches the deformed 3D model to the cleaned scan. The module determines one or more portions of the deformed 3D model that are unmatched and deforms the unmatched portions of the deformed 3D model to the scan using the matched portions of the deformed 3D model to generate a closed-form 3D model that closes the holes in the scan.

Abstract: An imaging device 12 includes a first camera 22 and a second camera 24. Each of the cameras captures a subject from left and right positions that are apart by a known width at the same timing and frame rate. Each of the captured frame images is converted into image data with a plurality of predetermined resolutions. An input information acquisition section 26 of an information processor 14 acquires an instruction input from the user. A position information generation section 28 roughly estimates, as a target area, a subject area or an area with motion using low-resolution and wide-range images of pieces of stereo image data and performs stereo matching using high-resolution images only for the area, thus identifying the three-dimensional position of the subject. An output information generation section 32 performs a necessary process based on the position of the subject, thus generating output information. A communication section 30 requests image data to the imaging device 12 and acquires such image data.

Abstract: The present invention provides a binocular camera resetting method and a binocular camera resetting apparatus, wherein the binocular camera resetting method comprises: obtaining a first image and a second image photographed by two cameras at the same time respectively after completing a rough adjustment of the two cameras; calculating a relative rotation angle between optical axes of the two cameras using a plurality of feature points of the first image acquired by one of the two cameras and the feature points of the second image acquired by the other one of the two cameras; controlling one of the two cameras to rotate the relative rotation angle to parallelize the optical axes of the rotated camera and the other camera; and adjusting a spaced distance between the two cameras to a preset distance.

Abstract: A camera rig for shooting multi-view images and videos includes a plurality of cam sockets, a plurality of cam mounts for fixing a plurality of cameras to the respective cam sockets, and an adjustment unit that adjusts the cam sockets such that all of the cameras are directed to a subject.

Abstract: An image display apparatus includes a stereoscopic image display apparatus configured to display a stereoscopically visible image, and a planar image display apparatus configured to display a planar image. An adjustment section of the image display apparatus adjusts relative positions, relative sizes, and relative rotations of a left-eye image taken by a left-eye image imaging section and a right-eye image taken by a right-eye image imaging section. The adjusted left-eye image and the adjusted right-eye image are viewed by the left eye and the right eye of the user, respectively, thereby displaying the stereoscopic image on the stereoscopic image display apparatus. The adjusted left-eye image and the adjusted right-eye image are made semi-transparent and superimposed one on the other, and thus a resulting superimposed planar image is displayed on the planar image display apparatus.

Abstract: Disclosed is a stereoscopic imaging device which answers the need for system compatibility over the entire range of long-distance (telescopic) imaging to close-up imaging, and which can faithfully reproduce stereoscopic images on the display side without adjustment. To that end, stereoscopic imaging device is disclosed in which the imaging lens optical axes (phi (L), (R)) in an imaging unit provided with imaging lenses and imaging elements (S) are arranged so as to be laterally parallel, and the distance between the optical axes (DL) is set to the interpupillary distance (B) of a human. One reference window (Wref) is defined as a virtual view frame in the image viewfield of said imaging unit.

Abstract: An image pickup apparatus 12 includes a first camera 22 and a second camera 24. The cameras pick up an image of a target at the same timing and at the same frame rate from left and right positions spaced by a known distance from each other. Picked up frame images are converted into image data of a predetermined plurality of resolutions. An input information acquisition section 26 of an information processing apparatus 14 acquires an instruction input from a user. A position information production section 28 approximately estimates a region of the target or a region which involves some movement on an image of a low resolution and a wide range from within stereo image data as a target region and carries out stereo matching only in regard to the region on an image of a high resolution to specify a three-dimensional position of the target. An output information production section 32 carries out a necessary process based on the position of the target to produce output information.

Abstract: In a computer-implemented method and system for capturing the condition of a structure, the structure is scanned with a three-dimensional (3D) scanner. The 3D contact scanner includes a tactile sensor system having at least one tactile sensor for generating 3D data points based on tactile feedback resulting from physical contact with at least part of the structure. A 3D model is constructed from the 3D data and is then analyzed to determine the condition of the structure.

Abstract: The image processing method includes acquiring multiple parallax images produced by image capturing of an object, the parallax images having a parallax to one another. The method further includes acquiring, by using the respective parallax images as base images, relative difference information on a relative difference between each of the base images and at least one other parallax image in the multiple parallax images, and detecting an unwanted component contained in each of the parallax images by using the relative difference information.

Abstract: A current problem with 3D scanners using structured light patterns is choosing a single light pattern to accommodate all possible object/range conditions. Objects far from the 3D scanner often require different patterns than objects that located close to the 3D scanner. In addition, large objects often require different patterns than small objects. To automatically sense and adapt to a wide variety of size/range conditions, the present invention embraces a 3D scanner for dimensioning that has two projectors for projecting two different light patterns. Based on the scanning requirements for a particular object, one of the two projected patterns may be used to obtain information regarding the shape of an object. In one possible embodiment, this shape information is used to obtain the object's dimensions.

Abstract: This disclosure describes a system configured to present primary and secondary, tertiary, etc., virtual reality content to a user. Primary virtual reality content may be displayed to a user, and, responsive to the user turning his view away from the primary virtual reality content, a sensory cue is provided to the user that indicates to the user that his view is no longer directed toward the primary virtual reality content, and secondary, tertiary, etc., virtual reality content may be displayed to the user. Primary virtual reality content may resume when the user returns his view to the primary virtual reality content. Primary virtual reality content may be adjusted based on a user's interaction with the secondary, tertiary, etc., virtual reality content. Secondary, tertiary, etc., virtual reality content may be adjusted based on a user's progression through the primary virtual reality content, or interaction with the primary virtual reality content.

Abstract: A method and a system for generating adaptive fast forward of egocentric videos are provided here. The method may include the following steps: obtaining a video footage containing a sequence of image frames captured by a non-stationary capturing device; estimating a moving direction of the non-stationary capturing device for a plurality of frames in the sequence of image frames; and generating a shortened video footage having fewer frames than said video footage, by sampling the sequence of image frames, wherein the sampling is carried out by selecting specific image frames and that minimize an overall cost associated with a deviation from a specific direction related to the moving direction, calculated for each of said plurality of image frames.

Abstract: A device for scanning and obtaining three-dimensional coordinates is provided. The device may be a hand-held scanner that includes a carrying structure having a front and reverse side, the carrying structure having a first arm, a second arm and a third arm arranged in a T-shape or a Y-shape. A housing is coupled to the reverse side, a handle is positioned opposite the carrying structure, the housing and carrying structure defining an interior space. At least one projector is configured to project at least one pattern on an object, the projector being positioned within the interior space and oriented to project the at least one pattern from the front side. At least two cameras are provided spaced apart from each other, the cameras being configured to record images of the object. The cameras and projector are spaced apart from each other by a pre-determined distance.

Abstract: In an image acquisition device, an optical path length difference in a second light figure can be formed by arrangement of an optical path difference generating member, without need for splitting light in a second optical path for focus control. Therefore, it reduces the quantity of light into the second optical path necessary for acquisition of information of focal position while ensuring the quantity of light enough for execution of imaging by a first imaging device. Furthermore, in this image acquisition device, a light reduction portion is provided between a first face and a second face of the optical path difference generating member. This light reduction portion can narrow a light superimposed region on the imaging surface of the second imaging device, which allows control of the focal position to a sample to be accurately carried out.

Abstract: A master device for surgical robots may comprise: handle units, each of which includes at least one multi-joint robot finger configured to control a robotic surgical instrument on a robot arm of a slave device; and/or a micro motion generation unit configured to generate a control signal to control an end of the at least one multi-joint robot finger so as to move along a virtual trajectory. A master device for surgical robots may comprise: a first unit that comprises at least one multi-joint robot finger on a robot arm of a slave device; and/or a second unit configured to generate a first control signal to control the at least one multi-joint robot finger so as to move along a virtual trajectory.

Abstract: An embodiment contemplates a method of calibrating multiple image capture devices of a vehicle. A plurality of image capture devices having different poses are provided. At least one of the plurality of image capture devices is identified as a reference device. An image of a patterned display exterior of the vehicle is captured by the plurality of image capture devices. The vehicle traverses across the patterned display to capture images at various instances of time. A processor identifies common landmarks of the patterned display between each of the images captured by the plurality of image capture devices and the reference device. Images of the patterned display captured by each of the plurality of image devices are stitched using the identified common landmarks. Extrinsic parameters of each image capture device are adjusted relative to the reference device based on the stitched images for calibrating the plurality of image capture devices.