Abstract: A method and apparatus for generating three-dimensional (3D) image data by using 2D image data including a dummy component and an image component relating to an input image, wherein the dummy component is used to adjust a resolution of the input image, are provided. The method includes: generating a depth map that corresponds to the 2D image data; detecting a dummy area including the dummy component from the 2D image data; and correcting depth values of pixels that correspond to the dummy area in the depth map.

Abstract: The invention relates to a method for acquiring a substantially complete depth map from a 3-D scene. Both depth values and derivates of depth values may be used to calculate a pixel dense depth map with the steps of acquiring partial depth map from said 3-D scene, acquiring derivates of depth information from said scene, and extending said partial depth map by adding non-relevant information to said partial depth map, creating a pixel dense full depth map being spatially consistent with both said partial depth map and said derivates of depth information.

Abstract: This invention provides a system and method for determining correspondence between camera assemblies in a 3D vision system implementation having a plurality of cameras arranged at different orientations with respect to a scene, so as to acquire contemporaneous images of a runtime object and determine the pose of the object, and in which at least one of the camera assemblies includes a non-perspective lens. The searched 2D object features of the acquired non-perspective image, corresponding to trained object features in the non-perspective camera assembly, can be combined with the searched 2D object features in images of other camera assemblies (perspective or non-perspective), based on their trained object features to generate a set of 3D image features and thereby determine a 3D pose of the object. In this manner the speed and accuracy of the overall pose determination process is improved. The non-perspective lens can be a telecentric lens.

Abstract: A mapping method is provided. The environment is scanned to obtain depth information of environmental obstacles. The image of the environment is captured to generate an image plane. The depth information of environmental obstacles is projected onto the image plane, so as to obtain projection positions. At least one feature vector is calculated from a predetermined range around each projection position. The environmental obstacle depth information and the environmental feature vector are merged to generate a sub-map at a certain time point. Sub-maps at all time points are combined to generate a map. In addition, a localization method using the map is also provided.

Abstract: Methods and apparatus for interactively rotating three-dimensional (3D) objects using multitouch gestures. To perform a roll gesture, multiple touch points are detected on a multitouch-enabled device. The touch points are associated with, or select, a 3D object displayed on the device. The centroid of the touch points is computed, and motion of the centroid, resulting from motion of the touch points, is tracked. When motion of the centroid is detected, a displacement is obtained, and the displacement is mapped to a rotation transformation. The 3D object may then be rotated according to the rotation transformation, and a 2D projection of the rotated 3D object is displayed. If the number of touch points changes, rotation may be reset without rotating the object. Alternatively, displacement from the previous centroid to the new centroid is determined and the object is rotated accordingly.

Abstract: An image processing apparatus is for rendering a three-dimensional (3D) effect by transforming a first quadrilateral image to a second quadrilateral image. The apparatus includes a target image determining unit, a block determining unit and a graphic unit. The target image determining unit generates an outline associated with the second quadrilateral image according to the first quadrilateral image and the 3D effect. The block determining unit divides an area within the outline into a plurality of second blocks and correspondingly determines a plurality of first blocks from the first quadrilateral image. The graphic unit scales image data of the first blocks to respectively generate image data of the second blocks to obtain the second quadrilateral image.

Abstract: Embodiments described herein facilitate or enhance the implementation of image recognition processes which can perform recognition on images to identify objects and/or faces by class or by people.

Abstract: Data-driven guarded evaluation of conditional-data associated with data objects is used to control activation and processing of the data objects in an interactive geographic information system. Methods of evaluating conditional-data to control activation of the data objects are disclosed herein. Data structures to specify conditional data are also disclosed herein.

Abstract: In the present invention, whether three-dimensional measurement or checking processing with a model is properly performed by setting information and recognition processing result can easily be confirmed. After setting processing is performed to a three-dimensional visual sensor including a stereo camera, a real workpiece is imaged, the three-dimensional measurement is performed to an edge included in a produced stereo image, and restored three-dimensional information is checked with a three-dimensional model to compute a position of the workpiece and a rotation angle for an attitude indicated by the three-dimensional model.

Abstract: Video drive-by data provides a street level view of a neighborhood surrounding a selected geographic location. A video and data server farm incorporates a video storage server that stores video image files containing video drive-by data corresponding to a geographic location, a database server that processes a data query received from a user over the Internet corresponding to a geographic location of interest, and an image processing server. In operation, the database server identifies video image files stored in the video storage server that correspond to the geographic location of interest contained in the data query and transfers the video image files over a pre-processing network to the image processing server. The image processing server converts the video drive-by data to post-processed video data corresponding to a desired image format and transfers the post-processed video data via a post-processing network to the Internet in response to the query.

Abstract: Enabling height recognition processing by setting a height of an arbitrary plane to zero for convenience of the recognition processing. A parameter for three-dimensional measurement is calculated and registered through calibration and, thereafter, an image pickup with a stereo camera is performed on a plane desired to be recognized as having a height of zero in actual recognition processing. Three-dimensional measurement using the registered parameter is performed on characteristic patterns (marks m1, m2 and m3) included in this plane. Based on a positional relationship between a plane defined as having a height of zero through the calibration and the plane expressed by the calculation equation, a transformation parameter (a homogeneous transformation matrix) for displacing points in the former plane into the latter plane is determined, and the registered parameter is changed using the transformation parameter.

Abstract: There is provided a method of measuring 3D depth of a stereoscopic image, comprising providing left and right eye input images, applying an edge extraction filter to each of the left and right eye input images, and determining 3D depth of the stereoscopic image using the edge extracted left and right eye images. There is also provided an apparatus for carrying out the method of measuring 3D depth of a stereoscopic image.

Abstract: A computer implemented method of adjusting original rational polynomial coefficients of an RPC model for an image acquired by an image sensor comprising providing rational polynomial coefficients associated with the image calculating a pseudo position and attitude angles for the sensor using the original coefficients providing at least one ground control point associated with the image adjusting the pseudo position and attitude angles using the at least one ground control point; and adjusting the original coefficients for the image using the adjusted pseudo position and attitude angles.

Abstract: Provided are a method and apparatus for receiving and generating an image data stream including a three dimensional (3D) image. The method of receiving an image data stream includes receiving an image data stream including at least one of two dimensional (2D) and 3D image data periods; extracting local 3D image parameters, which are parameters of each image data period, from the image data stream; and restoring at least one of 2D and 3D images by using the local 3D image parameters. In the method, each 3D image is composed of at least one of a base image and an additional image, and the local 3D image parameters include stereoscopic arrangement order information representing an arrangement order of the base image and additional image of the 3D image.

Abstract: Methods and apparatus, including computer program products, implementing and using techniques for document authentication. An electronic document is presented to a user. The electronic document has data representing a signed state and a current state. A disallowed difference between the signed state and the current state is detected, based on one or more rules that are associated with the electronic document. A digital signature associated with the electronic document is invalidated in response to the detecting.

Abstract: A mobile communication terminal having an image conversion function arranges and displays area-specific images in a three-dimensional (3D) space on the basis of distance information of the area-specific images of a two-dimensional (2D) image.

Abstract: A system and method for displaying images of internal anatomy includes an image processing device configured to provide high resolution images of the surgical field from low resolution scans during the procedure. The image processing device digitally manipulates a previously-obtained high resolution baseline image to produce many representative images based on permutations of movement of the baseline image. During the procedure a representative image is selected having an acceptable degree of correlation to the new low resolution image. The selected representative image and the new image are merged to provide a higher resolution image of the surgical field. The image processing device is also configured to provide interactive movement of the displayed image based on movement of the imaging device, and to permit placement of annotations on the displayed image to facilitate communication between the radiology technician and the surgeon.

Abstract: An apparatus for generating depth information includes a sensing unit and a final depth providing unit. The sensing unit is configured to sense light received from multiple subjects, and to provide initial depth data having distance information about the subjects and two-dimensional (2D) image data having 2D image information about an image obtained from the subjects. The final depth providing unit is configured to generate estimated depth data having estimated distance information about the subjects by transforming the 2D image data into three-dimensional (3D) data, and to provide final depth data based on the initial depth data and the estimated depth data.

Abstract: A method for identifying a blur profile of a multi image display with a first image separating mask. The method comprises displaying a calibration pattern through a second image separating mask, allowing an evaluator to provide a visual estimation indicating a blur brought about to the calibration pattern by the second image separating mask, and generating a blur profile of at least the first image separating mask according to the visual estimation. The first and second image separating masks having a substantially similar optical profile.

Abstract: Over the past few years there has been a dramatic proliferation of digital cameras, and it has become increasingly easy to share large numbers of photographs with many other people. These trends have contributed to the availability of large databases of photographs. Effectively organizing, browsing, and visualizing such .seas. of images, as well as finding a particular image, can be difficult tasks. In this paper, we demonstrate that knowledge of where images were taken and where they were pointed makes it possible to visualize large sets of photographs in powerful, intuitive new ways. We present and evaluate a set of novel tools that use location and orientation information, derived semi-automatically using structure from motion, to enhance the experience of exploring such large collections of images.

Abstract: Satellite-based navigation techniques can help determine a user's position on a map and can also determine directions to a destination. Functionality can be implemented to determine the user's orientation and direction of motion based on a captured image taken in the direction of motion. The captured image may be preprocessed to compensate for a camera angle and to vary image properties before being transmitted to a server. The user's orientation may be determined based, at least in part, on knowledge of a user's position on a map and comparing the captured image to a set of other images. Walking directions can accordingly be tailored based on the user's orientation.

Abstract: A model generator computes a first image perimeter color difference value for each of a plurality of first pixels included in a first image that is captured using a first focal length, and selects one of the first image perimeter color difference values that exceeds a perimeter color difference threshold. Next, the model generator computes a second image perimeter color difference value for each of a plurality of second pixels included in a second image that is captured using a second focal length, and selects one of the second image perimeter color difference values that exceeds the perimeter color difference threshold. The model generator then determines that an edge is located at the first focal length by detecting that the selected first image perimeter color difference value is greater than the selected second image perimeter color difference value, and generates an image accordingly.

Abstract: A method, apparatus, system, article of manufacture, and computer readable storage medium provides the ability to determine two or more camera viewpoint optical centers. A first image and a second image captured by camera devices (and the rotations for the camera devices) are obtained. For each pair of matched points between the first image and the second image, a linear equation is defined that utilizes the rotations, pixel coordinates of the matched points and optical centers. A matrix ATA is computed where each row of A corresponds to a pair of matched points and the number of columns is 3N (N representing the number of camera devices). The matrix is solved resulting in an eigenvector that holds the optical centers that are used to output image information.

Abstract: A method of associating a computer generated camera with an object in a three-dimensional computer generated space. The method receives a command to associate the camera with an object in the simulated space. Based on the command the method determines a path for moving the camera to a position near the object and aiming the camera at the object. The method creates a video from the simulated camera's perspective of the three-dimensional simulated space.

Abstract: In one embodiment, L dimensional images are trained, mapped, and aligned to an M dimensional topology to obtain azimuthal angles. The aligned L dimensional images are then trained and mapped to an N dimensional topology to obtain 2N vertex classifications. The azimuthal angles and the 2N vertex classifications are used to map L dimensional images into O dimensional images.

Abstract: The present invention provides a method for generating images of multi-views. The method includes obtaining a 2D original image of an article and background figures of multi-views; calculating the background image range and the main body image range of the 2D original image of the article; cutting the main body image out; generating a depth model according to an equation; cutting the depth model according to the main body image range of the cut 2D image of the article; shifting every pixel in the main body image of the 2D original image of the article according to the cut depth model to obtain shifted main body images of multi-views; and synthesizing the shifted main body images of multi-views and the background figures of multi-views to obtain the final images of multi-views for 3D image reconstruction.

Abstract: A method for image alignment is disclosed. In one embodiment, the method includes acquiring a facial image of a person and using a discriminative face alignment model to fit a generic facial mesh to the facial image to facilitate locating of facial features. The discriminative face alignment model may include a generative shape model component and a discriminative appearance model component. Further, the discriminative appearance model component may have been trained to estimate a score function that minimizes the angle between a gradient direction and a vector pointing toward a ground-truth shape parameter. Additional methods, systems, and articles of manufacture are also disclosed.

Abstract: A stochastic method and system for fast stereoscopic ranging includes selecting a pair of images for stereo processing, in which the pair of images are a frame pair and one of the image is a reference frame, seeding estimated values for a range metric at each pixel of the reference frame, initializing one or more search stage constraints, stochastically computing local influence for each valid pixel in the reference frame, aggregating local influences for each valid pixel in the reference frame, refining the estimated values for the range metric at each valid pixel in the reference frame based on the aggregated local influence, and post-processing range metric data. A valid pixel is a pixel in the reference frame that has a corresponding pixel in the other frame of the frame pair. The method repeats n iterations of the stochastically computing through the post-processing.

Abstract: A set of feature points for defining features of a face is detected in a target image and a reference image. The target image is warped to accommodate a selected feature from the reference image using the set of feature points and a set of three-dimensional models. The reference image is warped to a pose of the target image using the set of feature points and the set of three-dimensional models. The selected feature is copied from the reference image to the target image.

Abstract: A system, including a computer system running image processing software, receives an identification of a desired area to be imaged and collected into an oblique-mosaic image, creates a mathematical model of a virtual camera having a sensor higher in elevation from which the source oblique images were captured and looking down at an oblique angle, the mathematical model having an oblique-mosaic pixel map for the sensor of the desired area encompassing multiple source images, determines geographic coordinates for pixels, and selects source oblique images of the geographic coordinates captured at an oblique angle and compass direction similar to the oblique angle and compass direction of the virtual camera. The computer system reprojects at least one source oblique image pixel of the area to be imaged for each pixel included in the oblique-mosaic pixel map to create the oblique-mosaic image.

Abstract: A method for determining a three-dimensional model from three or more images comprising: receiving three or more images, each image being captured from a different viewpoint and including a two-dimensional image together with a corresponding range map; designating a plurality of pairs of received images, each pair including a first image and a second image. For each of the designated pairs a geometric transform is determined by identifying a set of corresponding features in the two-dimensional images; removing any extraneous corresponding features to produce a refined set of corresponding features; and determining the geometrical transformation for transforming three-dimensional coordinates for the first image to three-dimensional coordinates for the second image responsive to three-dimensional coordinates for the refined set of corresponding features.

Abstract: A method for determining a three-dimensional model from two images comprising: receiving first and second images captured from first and second viewpoints, respectively, each image including a two-dimensional image together with a corresponding range map; identifying a set of corresponding features in the first and second two-dimensional images; removing any extraneous corresponding features in the set of corresponding features responsive to the first and second range maps to produce a refined set of corresponding features; determining a geometrical transform for transforming three-dimensional coordinates for the first image to be consistent three-dimensional coordinates for the second image responsive to three-dimensional coordinates for the refined set of corresponding features, the three-dimensional coordinates comprising two-dimensional pixel coordinates from the corresponding two-dimensional image together with a range coordinate from the corresponding range map; and determining a three-dimensional model

Abstract: A system and method are disclosed for learning a random multinomial logit (RML) classifier and applying the RML classifier for scene segmentation. The system includes an image textonization module, a feature selection module and a RML classifier. The image textonization module is configured to receive an image training set with the objects of the images being pre-labeled. The image textonization module is further configured to generate corresponding texton images from the image training set. The feature selection module is configured to randomly select one or more texture-layout features from the texton images. The RML classifier comprises multiple multinomial logistic regression models. The RML classifier is configured to learn each multinomial logistic regression model using the selected texture-layout features. The RML classifier is further configured to apply the learned regression models to an input image for scene segmentation.

Abstract: A system and method for generating a multi-dimensional image of an object in a scene is disclosed. One inventive aspect includes a spectral estimation module configured to convert a two-dimensional (2D) high-resolution light intensity image of the scene to a spectral-augmented image of a selected channel. The system further includes a high-resolution depth image generation module configured to generate a high-resolution depth image of the object based on a three-dimensional (3D) low-resolution depth image of the scene and the spectral-augmented image.

Abstract: Methods and mark verification systems for evaluating the quality of a two-dimensional matrix dot peen mark on an object are provided. An exemplary embodiment of the methods includes scanning a two-dimensional matrix dot peen mark disposed on a surface of an object with a laser displacement sensor to generate three-dimensional scanned data for the mark, the mark including a plurality of dots disposed in a plurality of rows and columns on the surface; and determining whether the mark passes a verification test based on the scanned data.

Abstract: Embodiments of the invention provide methods and systems for generating a color-textured three-dimensional dental model that is specific to a patient. According to one embodiment, generating a patient-specific color-textured three-dimensional dental model can comprise obtaining a three-dimensional dental model of a patient. For example, obtaining the three-dimensional dental model can comprise obtaining volumetric image data of a dentition of the patient and generating the three-dimensional dental model based on the volumetric image data. Two-dimensional intra-oral image data of the patient can also be obtained. For example, obtaining the two-dimensional intra-oral image data can comprise obtaining a plurality of photographs. The patient-specific color-textured three-dimensional dental model can be generated based on the three-dimensional dental model and the two-dimensional intra-oral image data.

Abstract: A method estimates a 3D pose of a 3D specular object in an environment. In a preprocessing step, a set of pairs of 2D reference images are generated using a 3D model of the object, and a set of poses of the object, wherein each pair of reference images is associated with one of the poses. Then, a pair of 2D input images are acquired of the object. A rough 3D pose of the object is estimated by comparing features in the pair of 2D input images and the features in each pair of 2D reference images using a rough cost function. The rough estimate is optionally refined using a fine cost function.

Abstract: A method for identifying a structure in a volume of interest is provided. The method comprises acquiring a plurality of points related to the structure in a continuous mode, and subsequently registering at least one of the points to a previously acquired imaging dataset of the structure. An apparatus, system and a computer-readable medium are also provided. The present invention provides faster acquisition of EAM points by modifying the mapping system so that catheter tip locations are automatically and continuously recorded without requiring explicit navigation to and annotation of fiducial landmarks on the endocardium.

Abstract: Optimizing and presenting various sequences of images and/or photographs for viewing with a Web browser, is accomplished without the necessity of loading the entire image set, for example in connection with the 3D display of a product of interest. To represent an object that is rotating, a set of images must be taken. These images are taken at various angles, typically using either using a fixed camera or a turntable. The illusion of an object being rotated is created when the captured images based on the angle being viewed are displayed. To ensure a seamless rotation of an object, a technique is taught that significantly concentrates on reducing the loading time of the captured images by prioritizing which images should be transferred first according to their size, and their number of object views or view angles. A seamless rotation is thus achieved while less than the total number of images is loaded.

Abstract: A method of operation of a display system includes: receiving a current input image with current input pixels; identifying an input object, having input object pixels, based on differences in characteristics of the current input pixels; calculating an object pixel depth for the input object pixels from an image depth map of the current input image based on a weighted average of depth candidates; and generating a processed image, having a perceived depth, from the current input image with the image depth map and the object pixel depth for displaying on a device.

Abstract: There is provided a 3D human machine interface (“3D HMI”), which 3D HMI may include: (1) an image acquisition assembly, (2) an initializing module, (3) an image segmentation module, (4) a segmented data processing module, (5) a scoring module, (6) a projection module, (7) a fitting module, (8) a scoring and error detection module, (9) a recovery module, (10) a three dimensional correlation module, (11) a three dimensional skeleton prediction module, (12) an output module and (13) a depth extraction module.

Abstract: A system and method for three-dimensional (3D) acquisition and modeling of a scene using two-dimensional (2D) images are provided. The system and method provides for acquiring first and second images of a scene, applying a smoothing function to the first image to make feature points of objects, e.g., corners and edges of the objects, in the scene more visible, applying at least two feature detection functions to the first image to detect feature points of objects in the first image, combining outputs of the at least two feature detection functions to select object feature points to be tracked, applying a smoothing function to the second image, applying a tracking function on the second image to track the selected object feature points, and reconstructing a three-dimensional model of the scene from an output of the tracking function.

Abstract: A system that incorporates teachings of the exemplary embodiments may include, for example, means for generating a disparity map based on a depth map, means for determining accuracy of pixels in the depth map where the determining means identifies the pixels as either accurate or inaccurate based on a confidence map and the disparity map, and means for providing an adjusted depth map where the providing means adjusts inaccurate pixels of the depth map using a cost function associated with the inaccurate pixels. Other embodiments are disclosed.

Abstract: An image transformation method for use in a computer program product and an image display device is provided. In the image transformation method, a two dimensional image and a corresponding depth image are acquired first. A motion process is performed on the two dimensional image to obtain a plurality of motion images according to the depth image and a plurality of gain values. Then, a plurality of view images are provided and an interpolation process is performed on each motion image to obtain the corresponding view image. Finally, a synthesis process is performed on the view images to obtain a three dimensional image.

Abstract: An information processing apparatus comprises a data conversion unit for converting second 3D image information, to which first image information can be pasted, into 3D photo frame data including three-dimensional object information representing a three-dimensional shape of an object included in the second 3D image information and parameter information including a pasting position of the first image information, a parse calculation unit for calculating an image of the 3D photo frame data projected onto a display screen, an image pasting unit for pasting the first image information to the 3D photo frame data, and a display control unit for outputting to the display screen the 3D photo frame data or the 3D photo frame data pasted with the first image information.

Abstract: Conventionally, there has been a problem that a viewer is tired when playing back images mixedly including 2D images and 3D images, because images change frequently. A storage part stores 2D images and 3D images, an image conversion part that converts the 2D image stored in the storage part into a new 3D image, and an image output part that outputs the 3D image stored in the storage part and the new 3D image converted by the image conversion part. Consequently, it is possible to prevent a viewer from tiring when playing back images mixedly including 2D images and 3D images.

Abstract: A method for screening color separations of a lenticular image having a lenticular frequency of lenticular lenses for viewing the image, with a lens width l. An amplitude-modulated halftone image is calculated for each color separation at one screen angle with a rational number tangent and screen frequency. The screen has non-orthogonal screen cells spanned by vectors u, v for a specific color separation. A distance k is defined. Directions of vectors u, v relating to perpendicular direction relative to image strips of the lenticular image are defined for the specific color separation. First (n, m) and second (i, j) pairs of rational numbers are defined, to satisfy a system of equations: n*ux+m*vx=0, n*uy+m*vy=1, i*ux?j*vx=k and i*uy?j*vy=0 for vectors u=(ux, uy) and v=(vx, vy) spanning screen cells. A computer program product is also provided.

Abstract: Image registration of low contrast image sequences is provided. In one aspect, a desired region of an image is automatically segmented and only the desired region is registered. Active contours and adaptive thresholding of intensity or edge information may be used to segment the desired regions. A transform function is defined to register the segmented region, and sub-pixel information may be determined using one or more interpolation methods.

Abstract: A system, method and computer program product for parameterizing a 3D surface of genus g and arbitrary topology to the 2D plane. The method includes receiving an input 3D mesh of genus g; computing n discrete harmonic one-forms on the surface of the mesh to obtain n numbers for every edge in the graph represented by an input mesh; selecting two compatible linearly independent discrete harmonic one-forms for parameterization; assigning an arbitrary vertex in the mesh as an origin, and then summing each of the two harmonic one-forms along the edges of the graph using a traversal strategy to form 2D coordinates for every other vertex of the mesh to form the 2D parameterization of the 3D surface; detecting all singularities in the 2D parameterization; and, removing faces connected to the singularity and parameterizing the vertices of the removed faces using a 2D parameterization method, and connecting these vertices using a 2D polygonalization algorithm.

Abstract: A system processes 2D images of 2D or 3D objects, creating a model of the object that is consistent with the image and as veridical as the perception of the 2D image by humans. Vertices of the object that are hidden in the image are recovered by using planarity and symmetry constraints. The 3D shape is recovered by maximizing 3D compactness of the recovered object and minimizing its surface area. In some embodiments, these two criteria are weighted by using the geometric mean.