Abstract: Three dimensional models corresponding to a target image and a reference image are selected based on a set of feature points defining facial features in the target image and the reference image. The set of feature points defining the facial features in the target image and the reference image are associated with corresponding 3-dimensional models. A 3D motion flow between the 3-dimensional models is computed. The 3D motion flow is projected onto a 2D image plane to create a 2D optical field flow. The target image and the reference image are warped using the 2D optical field flow. A selected feature from the reference image is copied to the target image.

Abstract: An image processing apparatus and a method of processing an image are provided. The image processing apparatus includes a depth estimation unit for estimating a depth of an input three-dimensional (3D) image; a text area detection unit for detecting a text area included in the 3D image; a mask generation unit for generating a text mask for the text area; and a depth correction unit for correcting a depth of the text area based on the estimated depth of the input 3D image and the text mask.

Abstract: Disclosed herein are various techniques for improving global path optimization in a system that uses camera path for three-dimensional reconstruction. A subset of frames of data for the global path, the key frames, may be used to reduce the computational complexity of the optimization, while preserving full three-dimensional detail in the optimized model by relating other measurements to the optimized key frame path.

Abstract: Site modeling using image data fusion. Geometric shapes are generated to represent portions of one or more structures based on digital height data and a two-dimensional segmentation of portions of the one or more structures is generated based on three-dimensional line segments and digital height data. A labeled segmentation of the one or more structures is generated based on the geometric shapes and the two-dimensional segmentation. A three-dimensional model of the one or more structures is generated based on the labeled segmentation.

Abstract: A method for classifying tissue as normal or abnormal tissue includes obtaining segmented reconstructed volumetric image data for predetermined tissue of interest, generating a 2D voxel representation of the segmented reconstructed volumetric image data, and classifying voxels of the segmented reconstructed volumetric image data as corresponding to abnormal and normal tissue based on the 2D voxel representation.

Abstract: Provided is an image processing apparatus. In the case of a multi-view image, the image processing apparatus may warp a color image and/or a depth image of a reference view to correspond to a target view. An occlusion region may be extracted by comparing the warped color image and/or depth image of the reference view with a color image and/or a depth image of the target view. The image processing apparatus may encode the extracted occlusion region information without loss, and decrease an amount of data in the multi-view image.

Abstract: A method and apparatus for multiview image generation using depth map information is described. In one embodiment, a computer-implemented method comprises converting a input image and an input depth map into a projected image and a projected depth map using values from physical pixel locations that map to projected pixel locations, wherein the projected image and the projected depth map are associated with a particular view of the input image, inpainting the projected image and the projected depth map and producing an output image in a direction of the particular view using the inpainted projected image and the inpainted projected depth map.

Abstract: Provided are an apparatus, method, and medium for generating a panoramic image. In the apparatus, a previously captured image and a currently captured image are projected onto a predetermined curved surface so as to form a first mapping image and a second mapping image, respectively. Movement values in predetermined directions are calculated for maximizing a color similarity between overlapped sections of the first and second mapping images. A panoramic image is generated using the first and second mapping images and the calculated movement values. Therefore, overlapped sections of neighboring images can be precisely superposed and aligned when a panoramic image is generated using a series of images.

Abstract: A viewer relying on a conformal projection process to perserve local shapes is provided employing a rotated cylindriac mapping. In the image generation process, the source panoramic image, which can be elliptical, is placed on a sphere according to the angular location of pixels in the panomorph. The sphere is rotated around its center to a desired orientation before being projected to a cylinder also centered at the sphere's center with its longitudinal axis along the sphere's z-axis. The projected image on the cylinder is unwrapped and displayed by the viewer.

Abstract: An information processing section of a game apparatus executes a program for implementing a step S100 of acquiring a camera image; a step S200 of detecting a marker; a step S400 of calculating a position and an orientation of a virtual camera; a step S600 of generating an animation in which a hexahedron is caused to appear on the marker when the start of a game is requested; a step S800 of generating an animation in which the hexahedron is unfolded so as to position thereon virtual objects representing targets; a step S900 of mapping the photographed image on objects; a step S1000 of taking an image of the objects by means of the virtual camera; and a step S1100, S1200 of displaying the camera image and an object image which is superimposed on the camera image.

Abstract: Methods and systems to improve operator control of mobile robots are disclosed. The invention comprises in various embodiments the aggregation of multiple image feeds to improve operator situational awareness and the dynamic selection of command reference frames to improve operator intuitive control. The disclosed methods and systems reduce operator workload, reduce task completion times, and extend the capabilities of mobile manipulation systems.

Abstract: Disclosed herein is a method for graphically representing the condition of an anatomical structure that is the subject of a medical examination. The method includes displaying a background image representative of the anatomical structure, the image including a plurality of layers corresponding to different layers of the anatomical structure, selecting a layer of the background image, presenting a plurality of symbols, each corresponding to an anatomical pathological state and selected from a group associated with the selected layer, each symbol having a plurality of parameters which determine the rendering condition of a symbol on the background, selecting one of the presented symbols, selecting an X-Y position within the selected layer and displaying the symbol on the selected layer.

Abstract: A chart generation unit generates an adjustment chart, and a projection unit projects the adjustment chart onto a circular cylinder. A parameter acquiring unit acquires 12 parameters in total, relating to the positions of four corners and middle points of a top side and a bottom side of a chart and lateral expansion of the chart, the chart being input by a user through manipulations of an operation unit. A transform function determination unit calculates, from the total of 12 parameters, an accurate transform function for projecting an image onto the circular cylinder. An image conversion unit applies geometric transformation to the image based on the calculated transform function.

Abstract: One embodiment of the present invention sets forth a technique for generating a three-dimensional (3D) model of an individual. The technique involves receiving pose data that includes image data associated with the individual being in a pose, selecting from a database a morphable 3D generic human model based on a gender of the individual, adjusting a pose of the morphable 3D generic model based on the image data, identifying, based on the image data, one or more 3D appearance parameter objects included in the database, and adjusting via one or more processors one or more properties of the morphable 3D generic model based on the image data as well as the one or more 3D appearance parameter objects to produce the 3D model of the individual.

Abstract: The invention relates to a method for processing video signals from a video sensor, in order to extract 3d shape information about objects represented in the video signals, the method comprising the following steps: providing a memory in which objects are stored in a 3d shape space, the shape space being an abstract feature space encoding the objects' 3d shape properties, and mapping a 2d video signal representation of an object in the shape space, the coordinates of the object in the shape space indicating the object's 3d shape.

Abstract: A method and a device for generating 3-dimensional (3D) panoramic video streams, a videoconference method, and a videoconference device are disclosed. The method includes: obtaining depth information of at least two video images; obtaining image data in multiple depth positions from a corresponding video image according to the depth information of each video image; stitching data of the video images according to the obtained image data in multiple depth positions, and generating 3D panoramic video streams. The technical solution of the present invention provides users with high-resolution 3D panoramic seamless telepresence conference video images based on different display modes of different display devices.

Abstract: A depth generation method adapted for a 2D to 3D image conversion device is provided. The depth generation method includes the following steps. Motion vectors in an image frame are obtained by motion estimation. A global motion vector of the image frame is obtained. Motion differences between the motion vectors of each block and the global motion vector are calculated. A depth-from-motions of each block is obtained based on the motion differences. Furthermore, a depth generation apparatus using the same is also provided.

Abstract: The present invention relates to annotating images. In an embodiment, the present invention enables users to create annotations corresponding to three-dimensional objects while viewing two-dimensional images. In one embodiment, this is achieved by projecting a selecting object onto a three-dimensional model created from a plurality of two-dimensional images. The selecting object is input by a user while viewing a first image corresponding to a portion of the three-dimensional model. A location corresponding to the projection on the three-dimensional model is determined, and content entered by the user while viewing the first image is associated with the location. The content is stored together with the location information to form an annotation. The annotation can be retrieved and displayed together with other images corresponding to the location.

Abstract: A shell texture image shared for use among multilayer shell polygons and including a plurality of areas having transparency different from one another, is distorted to varying degrees depending on a position of each layer of the shell polygons, so as to texture-map each layer of the shell polygons therewith and so as to position the multilayer shell polygons in a virtual three-dimensional space. Thus, it is possible to realistically represent hair, grass, and the like with little effort in three-dimensional image processing.

Abstract: A method of combining a first image of a first region and a second image of a second region, having an overlapping region therebetween. The method including determining a superposed image as a weighted superposition of the first image and the second image in the overlap region, transforming the first image and the second image on the basis of a comparison of at least one of the first image and the second image with the determined superposed image; determining a further superposed image from the transformed first image and the transformed second image; and generating an overall image from the further superposed image when at least one convergence criterion is satisfied.

Abstract: The present invention relates to a method of creating an animatable digital clone includes receiving input multi-view images of an actor captured by at least two cameras and reconstructing a three-dimensional appearance therefrom, accepting shape information selectively based on a probability of photo-consistency in the input multi-view images obtained from the reconstruction and transferring a mesh topology of a reference human body model onto a shape of the actor obtained from the reconstruction. The method further includes generating an initial human body model of the actor via transfer of the mesh topology utilizing sectional shape information of the actor's joints, and generating a genuine human body model of the actor from learning genuine behavioral characteristics of the actor by applying the initial human body model to multi-view posture learning images where performance of a predefined motion by the actor is recorded.

Abstract: Disclosed are an image processing apparatus and an image processing method for producing a three-dimensional image frame. The image processing method includes: applying an offset value to an object abstracted from a two-dimensional image frame; obtaining image information corresponding to a distorted area from another image frame; and compensating the distorted area with the obtained image information, with respect to the distorted area of the image information in the two-dimensional image frame by the offset value.

Abstract: Embodiments of methods and/or apparatus for 3-D volume image reconstruction of a subject, executed at least in part on a computer for use with a digital radiographic apparatus can obtain image data for 2-D projection images over a range of scan angles. For each of the plurality of projection images, an enhanced projection image can be generated. In one embodiment, through the application of a resolution increasing interpolator, a prescribed CBCT routine scanning mode with preset binning can increase a spatial resolution, Nyquist frequency or MTF.

Abstract: A solid imaging apparatus and method employing sub-pixel shifting in multiple exposures of the digitally light projected image of a cross-section of a three-dimensional object on a solidifiable liquid medium. The multiple exposures provide increased resolution, preserving image features in a three-dimensional object and smoothing out rough or uneven edges that would otherwise be occur using digital light projectors that are limited by the number of pixels in an image projected over the size of the image. Algorithms are used to select pixels to be illuminated within the boundary of each image projected in the cross-section being exposed.

Abstract: Interactive three-dimensional (3D) virtual tours are generated from ordinary two-dimensional (2D) still images such as photographs. Two or more 2D images are combined to form a 3D scene, which defines a relationship among the 2D images in 3D space. 3D pipes connect the 2D images with one another according to defined spatial relationships and for guiding virtual camera movement from one image to the next. A user can then take a 3D virtual tour by traversing images within the 3D scene, for example by moving from one image to another, either in response to user input or automatically. In various embodiments, some or all of the 2D images can be selectively distorted to enhance the 3D effect, and thereby reinforce the impression that the user is moving within a 3D space. Transitions from one image to the next can take place automatically without requiring explicit user interaction.

Abstract: A system which generates a floor plan of a building includes: a camera which obtains a series of images as it is moved, each image represented by a first data set representing color and a second 3D data set representing depth. A processor generates the floor plan from the image data, defined by polylines that represent structures of the building and polygons that represent an area which has been observed by the camera. Suitably, the processor: performs a local matching sub-process which is operative to align two adjacent images with one another; performs a global matching sub-process in which key images and registered to one another; finds a 2D subset of points from the image data associated with each image, corresponding to a plane defined therethrough; determines the polylines based on said subset of points; and defines the polygons based on the polylines and a determined pose of the camera.

Abstract: The invention relates to a method for texturizing virtual three-dimensional objects, particularly virtual three-dimensional building objects and city models with a photographic image (1) of a real object, particularly of a picture of a façade.

Abstract: An image processing apparatus includes a combining processing unit combining plural images into a piece of combined image. The plural images is taken by a plurality of image-capturing from a certain position to different plural directions. The combining processing unit configured to extract a parameter by performing block matching processes at individual boundaries in such a manner that boundaries a plurality of selected images are disposed in overlapping relation, perform block matching processes of all boundaries to be combined based on the parameter, evaluate results of the block matching processes with respect to all the boundaries, and perform combining the images to reduce errors by updating an optical axis direction so as to reduce errors in all the boundaries.

Abstract: A three-dimensional (3D) image processor and processing method are described. The 3D image processor includes a space division unit to divide a virtual object space where a virtual 3D object is located into a plurality of sub-spaces, and a plurality of processors to correspond to each of the divided sub-spaces and to compute a trajectory of a ray within each of the corresponding sub-spaces, the ray being transmitted into each of the corresponding sub-spaces.

Abstract: Methods and apparatus for detecting and removing poorly conditioned points in bundle adjustment. A detection technique may be used to detect poorly conditioned points during the bundle adjustment process or portion of a feature-based 3D reconstruction pipeline. Once the poorly conditioned points are detected, the technique removes the points from the bundle adjustment process. The technique detects and removes the poorly conditioned points before the optimization is performed, and therefore ensures that the optimization will be successful.

Abstract: A quality of a virtual image for a synthetic viewpoint in a 3D scene is determined. The 3D scene is acquired by texture images, and each texture image is associated with a depth image acquired by a camera arranged at a real viewpoint. A texture noise power is based on the acquired texture images and reconstructed texture images corresponding to a virtual texture image. A depth noise power is based on the depth images and reconstructed depth images corresponding to a virtual depth image. The quality of the virtual image is based on a combination of the texture noise power and the depth noise power, and the virtual image is rendered from the reconstructed texture images and the reconstructed depth images.

Abstract: An information processing method includes acquiring an image of an object captured by an imaging apparatus, acquiring an angle of inclination measured by an inclination sensor mounted on the object or the imaging apparatus, detecting a straight line from the captured image, and calculating a position and orientation of the object or the imaging apparatus, on which the inclination sensor is mounted, based on the angle of inclination, an equation of the detected straight line on the captured image, and an equation of a straight line in a virtual three-dimensional space that corresponds to the detected straight line.

Abstract: The invention relates to a method and a device for determining the exposure of a three-dimensional object in an image, characterised in that it comprises the following steps: acquiring a three-dimensional generic model of the object, projecting the three-dimensional generic model according to at least one two-dimensional representation and associating to each two-dimensional representation an exposure information of the three-dimensional object, electing and positioning a two-dimensional representation onto the object in said image, and determining the three-dimensional exposure of the object in the image from at least the exposure information associated with the selected two-dimensional representation.

Abstract: Methods and apparatus for patch-based construction of an object shape from the shading of an image are disclosed. An image is divided into a set of image subregions. For each image subregion, a set of subregion dictionary entries is identified. Each of the set of subregion dictionary entries includes a subregion entry appearance matching an appearance of the respective image subregion and a subregion entry geometry. A set of optimal subregion dictionary entries is identified. Identifying the set of optimal subregion dictionary entries includes minimizing an energy function of the sets of subregion dictionary entries for all image subregions. Each optimal subregion dictionary entry is, for a respective one of the image subregions, a subregion entry associated with a minimum of the energy function. The shape includes a shape construction parameter from a subregion geometry entry of each optimal subregion geometry entry of the set of optimal subregion geometry entries.

Abstract: A method for detecting terrain, through foliage, includes the steps of: receiving point cloud data in a three-dimensional (3D) space from an airborne platform, in which the point cloud data includes foliage that obscures the object; reformatting the point cloud data from the 3D space into a one-dimensional (1D) space to form a 1D signal; and decomposing the 1D signal using a wavelet transform (WT) to form a decomposed WT signal. The decomposed WT signal is reconstructed to form a low-pass filtered profile. The method classifies the low-pass filtered profile as terrain. The terrain includes a natural terrain, or a ground profile.

Abstract: The present invention provides methods and apparatus for generating a continuum of image data sprayed over three-dimensional models. The three-dimensional models can be representative of features captured by the image data and based upon multiple image data sets capturing the features. The image data can be captured at multiple disparate points along another continuum.

Abstract: A system may determine a number of floors of a building based on image data of the building. The system may determine a background color of a façade of the building shown in the image data. Using this background color, predefined deviations may then be detected that form the background color in the façade of the building. A mean number of predefined deviations in the vertical direction of the façade of the building may be determined, and the number of floors of the building based on the determined mean number of predefined deviations can be then be deduced.

Abstract: An image filter and method of smoothing pixel values. A pixel value of a pixel to be smoothed is compared with block average pixel values of each of a plurality of pixel blocks. The pixel to be smoothed may be downstream from each of the pixel blocks. If the difference between the pixel value and each of the block average pixel values is less than a corresponding sigma threshold value for each of the pixel blocks, a first sigma filter utilizing the block average pixel values is applied to the pixel to be smoothed. If the difference between the pixel value and any one of the block average pixel values is not less than a corresponding sigma threshold value, a second sigma filter is applied to the pixel to be smoothed.

Abstract: A plurality of polygons are placed in a 3-dimensional virtual space. Each of plural types of first textures corresponding to plural types of attributes which the plurality of polygons have is mapped to the polygon that has the attribute of the type corresponding to the first texture, the 3-dimensional virtual space is shot by a first virtual camera, and thereby a main image is generated. In addition, each of the plural types of second textures corresponding to plural types of attributes which the plurality of polygons have is mapped to the polygon that has the attribute of the type corresponding to the second texture, the 3-dimensional virtual space is shot by a second virtual camera, and thereby a main image is generated.

Abstract: A computer system running image processing software receives an identification of a desired geographical area to be imaged and collected into an oblique-mosaic image; creates a mathematical model of a virtual camera looking down at an oblique angle, the mathematical model having an oblique-mosaic pixel map of the desired area encompassing multiple source images; assigns surface locations to pixels included in the oblique-mosaic pixel map; creates a ground elevation model of the ground and vertical structures within the oblique-mosaic pixel map using overlapping source images of the desired geographical area, wherein the source oblique images were captured at an oblique angle and compass direction similar to that of the virtual camera; and reprojects, with the mathematical model, source oblique image pixels of the overlapping source images for pixels included in the oblique-mosaic pixel map using the ground elevation model to thereby create an oblique-mosaic image of the desired area.

Abstract: In the case where a three-dimensional image including a plurality of element figures, such as a quadrangular plane, a curved surface including a ridgeline, and a cylinder, is edited using an image editing apparatus such as a three-dimensional CAD apparatus, when one element figure in the three-dimensional image is specified, other element figures connected to the specified one element figure, or other element figures included in the same three-dimensional image in which the one element figure is included are retrieved, and other element figure in the retrieved other element figures, which was determined as having a specific relationship to the one element figure is related to the one element figure. Then, the specified element figure and the element figures related to the specified element figure are edited collectively based on an operation received by the image editing apparatus.

Abstract: An information processing section of a game apparatus executes a program for implementing a step S100 of acquiring a camera image; a step S200 of detecting a marker; a step S400 of calculating a position and an orientation of a virtual camera; a step S600 of generating an animation in which layed-flat surfaces of a hexahedron appear, and the hexahedron is folded so as to confine virtual objects representing targets therein when a stage is cleared; a step S800 of generating an animation in which the folded hexahedron is unfolded so as to position different virtual objects thereon; a step S900 of mapping the photographed image on objects; a step S1000 of taking an image of the objects by means of the virtual camera; and a step S1100, S1200 of displaying the camera image and an object image which is superimposed on the camera image.

Abstract: Embodiments of the invention relate to the visualization of geographical information and the combination of image information to generate geographical information. Specifically, embodiments of the invention relate to a process and system for correlating oblique images data and terrain data without extrinsic information about the oblique imagery. Embodiments include a visualization tool to allow simultaneous and coordinated viewing of the correlated imagery. The visualization tool may also provide distance and measuring, three-dimensional lens, structure identification, path finding, visibility and similar tools to allow a user to determine distance between imaged objects.

Abstract: An image processing apparatus includes a projective transformation unit that performs projective transformation on left and right images captured from different points of view, a projective transformation parameter generating unit that generates a projective transformation parameter used by the projective transformation unit by receiving feature point information regarding the left and right images, a stereo matching unit that performs stereo matching using left and right projective transformation images subjected to projective transformation, and a matching error minimization control unit that computes image rotation angle information regarding the left and right projective transformation images and correspondence information of an error evaluation value of the stereo matching.

Abstract: A method and system comprising: generating at least one slice image by carpeting a multitude of digital images based upon a two-dimensional (2-D) reference system, each of the multitude of digital images associated with a location in the 2-D reference system and each showing a representation of an arborization and/or landmark such that digital images not showing a representation of an arborization and/or landmark are excluded; carpeting the multitude of digital images together to create a slice image; aligning the slice image with other similarly created slice images using landmark information to determine the amount of 2-D rotation and/or translation to be applied to each slice image; vectorizing the representation of the arborization on each slice image, the vectorization creating a series of segments; assigning a type to at least one of the series of segments based on a unique characteristic of arborization; and grouping related segments together.

Abstract: A 3D image capturing device includes a first lens module, a second lens module, a single sensor, an image sensor; a cross dichroic prism; a first mirror; and a second mirror. The first and second lens module have a first optical axis and a second optical axis, respectively. The second lens module is located juxtaposed with the first lens module. The second optical axis is parallel with the first optical axis. The first and second mirrors are arranged at opposite sides of the cross dichroic prism. The first and second mirrors are configured for reflecting and directing light beams from the first and second lens modules to the cross dichroic prism. The cross dichroic prism is configured to redirect the reflected light beams from the first and second mirrors to the image sensor.

Abstract: Methods and apparatus for construction of an object shape from an image using a light-space graphical model are disclosed. A set of normal vectors for a set of pixels in an image is defined. Each normal vector is defined in terms of an azimuth and a zenith measured in a spherical coordinate system centered on a light source illuminating the image. The zenith of each normal vector is constrained based on an observed shading of a respective pixel. A shape is constructed from the image. Constructing the shape includes minimizing an energy function to specify an azimuth value and a zenith value of each normal vector. Minimizing the energy function further includes constraining the azimuth of each normal vector based on an image gradient of the image at each respective pixel to enforce a coplanar assumption between the image gradient expressed in a three-dimensional space and the respective normal vector.

Abstract: Provided are a display device and method for altering images, the apparatus including: an input unit operable to receive a left image and a right image; and an image altering unit which is operable to alter the received left image and the received right image and to output an output image signal including the altered left image and the altered right image, wherein the left image is altered by changing a first portion, which is near a boundary area in the left image, and wherein the right image is altered by changing a second portion, which is near a boundary area in the right image.

Abstract: A video processing apparatus according to the present invention acquires a change rate per unit time of a parallax amount that is a shift amount in a direction of an interpupillary distance between a frame-image for left-eye and a frame-image for right-eye of one set. Then, the video processing apparatus determines, based on the change rate, a display parallax amount for displaying an object to be stereoscopically viewed by a user as approaching him at the change rate that is equal to or higher than a predetermined threshold. At that time, the display parallax amount is determined such that the object is stereoscopically viewed by the user as approaching him at a change rate smaller than the acquired change rate.

Abstract: An image converting device includes; a downscaling unit which downscales a two-dimensional image to generate at least one downscaling image, a feature map generating unit which extracts feature information from the downscaling image to generate a feature map, a visual attention calculating unit which generates a low-level attention map based on a visual attention of the feature map, and an image expansion unit which up-scales the low-level attention map, wherein an increasing gray value may be added to image data disposed on the upper portion in the low-level attention map, and 0 or a decreasing gray value may be added to the image data disposed on the lower portion.