Abstract: This invention introduces, as one aspect, an apparatus for creating three-dimensional object model, comprising photographing means for photographing an object to be modeled for obtaining images to be used for creating the three-dimensional object model, setting means for longitudinally and latitudinally setting a relative position between the object and said photographing means, said setting means being capable of setting the object and said photographing means a plurality of different relative longitudinal and latitudinal positions, and control means for controlling said photographing means and said setting means so that a number of photographs taken from different relative longitudinal positions at a first relative latitudinal position is larger than that taken from different relative longitudinal positions at a second relative latitudinal position, the first relative latitudinal position being closer to a lateral position than the second relative latitudinal position.

Abstract: A plurality of texture maps for a 3D computer model of an object are generated by processing images of the object, data defining the computer model, and data defining the relative positions and orientations of the images and computer model. A respective texture map is generated for the viewing position and direction of each image. Each texture map stores texture data for all parts of the computer model which are visible from the associated viewing position and direction and also texture data for all invisible parts of the computer model. Each texture map therefore stores texture data that can be used for rendering accurate images of the 3D computer model over a wide range of viewing positions and directions.

Abstract: A method of generating model data representative of a model in a three-dimensional space of an object from input signals representative of a set of images of the object taken from a plurality of respective camera positions includes the steps of displaying a model image derived from the model data and having a plurality of primitives for viewing by a user, receiving at least one primitive selection signal responsive to user actuation of an input whereby each primitive selection signal identifies a respective selected primitive of the model, and defining a plurality of virtual cameras in the three dimensional space having positions and look directions relative to the model which correspond substantially to those of the respective actual cameras relative to the object.

Abstract: Customer computer processing apparatus (2, 4) are connected to a service apparatus (6) via the Internet (8). Service apparatus (6) processes requests and payment details from a customer apparatus (2, 4), and, in response to a valid payment, sends instructions to the customer apparatus to enable the customer apparatus to control a printer (18) or a display panel (19) to print or display a photographic mat (24). Service apparatus (6) retains details of the photographic mat pattern for subsequent use. Images of a subject object on the photographic mat are recorded at different positions and orientations with a camera (16). Data defining the images is returned from the customer processing apparatus (2, 4) to the service apparatus (6). The service apparatus processes the image data along with the stored pattern data to identify the photographic mat features in the images and to calculate the position and orientation at which each image was recorded.

Abstract: View-dependent texture images and view-independent texture data for a 3D computer model are processed to compress each view-dependent texture image by subtracting the view-dependent data and view-independent data in a common 2D image space to generate a difference image, and compression encoding the difference image. The difference images, 3D computer model and view-independent texture data are transmitted to a second apparatus, where the difference data and view-independent texture data are recombined in a common 2D image space as part of the processing to render an image.

Abstract: A texture map for texturing the polygon mesh of a 3D computer model during rendering is generated by defining a respective triangle within the texture map for each triangle in the polygon mesh to create a texture coordinate map, and allocating image data to each defined triangle. To generate the texture coordinate map, the triangles are defined so that the area of each triangle is dependent upon the content of texture data to be stored therein. More particularly, triangles required to store texture data with a relatively large amount of detail have a relatively large area and triangles which are required to store texture data with relatively little detail have a relatively small area. In this way, more area is allocated for the storage of detailed texture data, thereby reducing the amount of information which is lost from the texture data during the creation of a texture map.

Abstract: A texture map (188) for texturing a polygon mesh 3D computer model (150) during rendering is generated by defining a respective triangle within the texture map for each triangle in the polygon mesh to create a texture coordinate map (170), and allocating image data to each defined triangle. To generate the texture coordinate map, the triangles in the polygon mesh are processed to generate a plurality of lists, each list identifying adjacent triangles in the mesh having shapes which can be packed into strips (173-179) of the texture coordinate map without significant shape distortion. The triangle lists are then packed into the texture coordinate map strips. No padding is defined between triangles in the same list, only between triangles of different lists. Image data is allocated to each triangle.

Abstract: In an image processing system, a subject object 210 is placed on top of an object support 220 on a calibration object 34 having a known pattern of features thereon. Images recorded at different positions and orientations are processed to generate a three-dimensional computer model of the subject object alone or the subject object together with the calibration object. By imaging the subject object 210 on an object support instead of placing it directly on the calibration object, the user is provided with flexibility in the selection of the pattern and color of the calibration and the selection of the imaging positions and orientations. By providing an object support 220 having a top surface on which the subject object 210 sits which does not protrude from beneath the base of the subject object 210, the user is provided with flexibility in the selection of lighting conditions.

Abstract: There is disclosed an apparatus and method for combining three or more texture maps 200–208 together to generate a single, combined texture map 220. The texture maps are repeatedly combined together in pairs, with each pair generating a larger texture map for subsequent combination with another texture map, until only one texture map remains containing all of the original texture maps.

Abstract: Creation of a computer representation of a three-dimensional object surface is described. The viewing cones for camera positions at which images of the object were taken are determined and the intersection of these viewing cones is used to define an initial three-dimensional space within which the object surface lies. This initial space is divided into voxels. Each non-occluded voxel is checked for photoconsistency by comparing the colors (or average colors) of the pixel patches in the images to which that voxel projects. Photo-inconsistent voxels are removed. A voxel may be determined to be photo-inconsistent if there exists no set of photoconsistent pixel regions or the pixel patches do not share a color value range. The pixel patch into which each voxel projects in a further image may be compared with the stored color for that voxel and any photo-inconsistent voxels removed. This process can then be repeated for further images.

Abstract: To generate texture data for a 3D computer model 150 of a real-life object 210, images 300–316 of the subject object are recorded from different viewing positions and directions. The image data is processed by an image processing apparatus 2 to register the viewing positions and directions of the images 300–316 based on the positions of features in the images. The 3D computer model 150 of the subject object is registered with the resulting registered set of images, and texture data is generated for the 3D computer model from the images.

Abstract: In an image processing apparatus 20 an input sequence 130 of video images is processed to determine the different positions and orientations at which the images were recorded in an efficient and accurate manner. A subset of the input images are selected as keyframes to form a sequence 250 of keyframes. Respective triples of keyframes having different, non-overlapping positions in the sequence 250 are selected and processed to determine the relative positions and orientations at which the keyframes in each triple were recorded to form respective sets of keyframes. The positions and orientations of keyframes between the keyframes in each triple are then calculated to form expanded sets of keyframes 266, 276, 286. The sets are further expanded by calculating the positions and orientations of keyframes which lie between sets in the sequence 250. The sets are merged by calculating the relationship between the coordinate systems in which the positions and orientations of the keyframes in each set are defined.

Abstract: To generate a 3D computer model of a subject object 210, images 300-316, 380-384 of the subject object are recorded from different viewing positions and directions. The image data is processed to generate a plurality of sets of images, each set containing images having registered imaging positions and directions. A preliminary 3D computer model 390 is generated using the images from a first of the sets such that the position and orientation of the preliminary 3D computer model 390 is registered with the images in the set. The imaging positions and directions of the images in the first set are then registered with the imaging positions and directions of the images in each other respective set.

Abstract: In a computer processing apparatus 3002, a number of depth maps 3200-3270 of a subject object 3300 are processed to generate a 3D computer model of the subject object. The points in each depth map are connected to give a 2D mesh, and each 2D mesh is then projected into 3D space in dependence upon the depths of the points in the mesh, thereby giving a 3D mesh 3610. Side faces for each edge of the 3D mesh are added extending away from the depth map, thereby generating a respective polyhedron 3600 for each depth map. The 3D computer model of the subject object is generated by calculating the intersections of the polyhedra.

Abstract: A texture map (188) for texturing a polygon mesh 3D computer model (150) during rendering is generated by defining a respective triangle within the texture map for each triangle in the polygon mesh to create a texture coordinate map (170), and allocating image data to each defined triangle. To generate the texture coordinate map, the triangles in the polygon mesh are processed to generate a plurality of lists, each list identifying adjacent triangles in the mesh having shapes which can be packed into strips (173-179) of the texture coordinate map without significant shape distortion. The triangle lists are then packed into the texture coordinate map strips. No padding is defined between triangles in the same list, only between triangles of different lists. Image data is allocated to each triangle.

Abstract: A 3D computer model of an object is generated by calculating the intersections of polyhedra. Each polyhedron defines a volume of 3D space containing at least part of the object. The 3D points of intersection of the planar faces of the polyhedra are calculated and each point is labeled with the planar faces which meet thereat. The points are connected to form a polygon mesh using the labels to determine which points should be connected together. In calculating the points, a volume containing the object is subdivided into parts, each part is tested against the polyhedra and then discarded, subdivided further, or the point of intersection of planar faces within the volume part is calculated. A volume part is discarded if it is outside at least one polyhedron. The volume part is subdivided into further parts if it is intersected by more than a predetermined number of polyhedra faces.

Abstract: A 3-D model of an object is created by processing images taken from a series of camera positions. An initial sequence of the images is processed to define respective image co-ordinates of matching features to generate a set of model data defining model points in a 3-D space of the model and to obtain respective camera solutions representative of positions and orientations of virtual cameras in the 3-D space defining views of the model corresponding to the images. A new image is added to the sequence and processed to obtain a camera solution for a corresponding new virtual camera for use in generating further model data.

Abstract: A texture map for texturing the polygon mesh of a 3D computer model during rendering is generated by defining a respective triangle within the texture map for each triangle in the polygon mesh to create a texture coordinate map, and allocating image data to each defined triangle. To generate the texture coordinate map, the triangles are defined so that the area of each triangle is dependent upon the content of texture data to be stored therein. More particularly, triangles required to store texture data with a relatively large amount of detail have a relatively large area and triangles which are required to store texture data with relatively little detail have a relatively small area. In this way, more area is allocated for the storage of detailed texture data, thereby reducing the amount of information which is lost from the texture data during the creation of a texture map.

Abstract: In an image processing apparatus 2, images of a subject object 210 and data defining the positions and orientations at which the images were recorded are processed to generate a three-dimensional computer model of the subject object 210. As part of the processing, image data relating to the subject object 210 is segmented from other image data in each input image to define the silhouette of the subject object in each image, and the silhouettes are processed to generate the three-dimensional computer model.

Abstract: There is disclosed an apparatus and method for combining three or more texture maps 200-208 together to generate a single, combined texture map 220. The texture maps are repeatedly combined together in pairs, with each pair generating a larger texture map for subsequent combination with another texture map, until only one texture map remains containing all of the original texture maps.