System and method for morphable model design space definition
A method, system, and apparatus for preparing geometric models for use in a design tool are disclosed. The method comprises generating a first base shape model, separating the first base model into components, and characterizing the components. Further, the method provides for comparing the second base model, similarly prepared and characterized, to the first, and adjusting the features used to characterize the base model components until the two objects can be placed in correspondence. The system comprises a processor capable of processing instructions for generating base shape models wherein the processor is capable of processing instructions for separating a base model into components and further capable of processing instructions for characterizing base model components. Accordingly, the method may provide for defining a geometric model template by adjusting a base model to match a succession of input models.
Latest General Motors Patents:
This application claims priority to U.S. Provisional Application No. 60/598,290, titled, “SYSTEM AND METHOD FOR GEOMETRIC SHAPE DESIGN,” filed Aug. 3, 2004, which itself claims priority to U.S. Provisional Application Ser. No. 60/552,975, titled, “CAPTURING AND MANIPULATING AUTOMOTIVE DESIGN CHARACTERISTICS IN A STATISTICAL SHAPE MODEL,” filed Mar. 12, 2004, both of which are incorporated by reference herein in their entirety.
TECHNICAL FIELDA design tool for use in manufacture is disclosed. More particularly, this disclosure describes a computer-aided geometric shape design tool and process, method, apparatus and product for preparing exemplars therefore.
BACKGROUND OF THE INVENTIONComputer design tools useful for industrial design are most commonly “computer aided design” (CAD) based. Users of CAD programs often undergo training and have much experience in the use of CAD before their proficiency reaches a level high enough for complex design and engineering.
In the automotive industry, car body designers typically sketch their designs. Car body designers are creative artists who produce styling sketches and typically do not use CAD programs. From sketches and discussion with the car body designer, a CAD designer will rework the sketch onto the computer. Accordingly, the sketch is engineered into three-dimensional detail. There are often many instances of refinement discussed between the artist and CAD user. Oftentimes, for example, the designer's sketches are not in correct perspective and details may need to be added and changed, and therefore, the process to completion by a CAD user may become tedious and repetitive. The CAD tool requires construction of a shape, piece by piece. The overall shape may not emerge until a significant amount of work has been done.
It would be advantageous for a designer to have available a design tool that is simple to operate and can interactively create 3-dimensional shapes from direct manipulation or other inputs, and whose resultant design is captured in a computer file. Therefore, the time consuming step of refinement between the artist and a CAD designer may be substantially eliminated.
In automobile design, a designer often desires to keep the design within certain style parameters. For example, the task at hand for the designer may be to design a new CADILLAC. In this circumstance, it may be advantageous for the designer to have all available CADILLAC designs and then to change some aspect or another to create a new look in keeping with the brand character of the CADILLAC.
Alternatively, a designer may want to create a design that is intermediate between two designs, or is a blend of three or more designs. In any of these events, the process currently depends on the designer's strong familiarity with the various automobiles' designs. In this case, the ability to use a computer to maintain data on designs and morph automobile designs from any number of combinations would be particularly advantageous for the design process.
Complex design shapes such as automobiles may have topologies that vary greatly. The list of automobiles, even for just one automobile manufacturer, is extensive and the styling is diverse and includes many discrete variations. A computer based design tool that would allow a designer to combine any number of models to form a resultant new style or model would be advantageous.
Furthermore, it would be advantageous if the design tool visually offered to the artist a plurality of automobiles to choose from and provided the ability to combine them into a combined resultant automobile design. If the designer desires a sportier car, or, for example, a BUICK to be more CADILLAC-like, or to use the grill of one car on another car, it would be advantageous to provide in a design tool the flexibility to the user to reach their design goals or otherwise explore options.
Once a user has created a resultant combined design by combining as many models as desired, an additional benefit would come from the ability to change or morph that resultant design. A design tool that would be useful for independently varying base components of automobile designs is preferably flexible enough to allow a designer to explore different combinations and then provide the ability to morph the different combinations into many possible designs.
A collection or library of exemplars from which a user could choose exemplar models to combine with each other in accordance with above-described desirable design tool is desirable. Hereafter, this will be called a catalog. Exemplars having common points, curves, and/or other features to operatively match to produce a resultant mixed model is furthermore desirable.
SUMMARY OF THE INVENTIONIn this disclosure a system, method, apparatus and product for preparing model exemplars is described. Elements of a mathematical description, such as in terms of curves, points or surfaces, or a combination of such with respect to a model's features, are used to enable correspondence of components and/or characteristics of the modeled object with components and/or characteristics of other objects of similar types. Such elements of a mathematical description as referred to hereinafter as describers. In one embodiment, a template of the model, or a portion thereof, having an initial layout may first be provided. Similar describers of a plurality of models are adjusted so that there is correspondence between describers of the models. The segmentation system, method, apparatus and product described herein provide user flexibility in describing geometric shapes so that they may be mixed or combined in subsequent operations.
Moreover, the segmented models are categorized as exemplars and are collected in a catalog for use in design tools for designing geometrically shaped objects.
Furthermore, on a display screen, exemplars are offered in the form of a catalog of exemplars. In a subsequent step a user may choose from the catalog a set of exemplars to mix or combine into a resultant design space that is described mathematically. The user then has the ability to explore that mathematical space and therefore to manipulate a resultant design. During this process of controlling the shape, output may be generated and in this way a new design may be created.
A system, method, apparatus and product are provided for reducing, defining by describers, and putting into registration or correspondence the characteristics of 2-D as well as 3-D objects. Therefrom, a plurality of object characteristics may be mixed or combined in accordance with computer instructions to create a statistical model in a combined design space. The average of the mix is a resultant model that is displayed to a user on a display screen. The ability of the user to manipulate features in accordance with the describers of an object within and around the combined space allows for the user to explore the design space and potentially develop new designs and/or “cross-breeds.” Accordingly, segmentation as described herein allows registration or correspondence of some or many object types including vehicles.
In an operation on segmented objects, a user can select models from different classes, groups, sets or individuals. The models have been fit so that particular curves, points or surfaces are numbered and are in correspondence with one another. For example, a plurality of classifications of vehicles may be described by the same number of describers. The number of degrees of freedom it might take to adequately describe a particular object may be determined by some adjustment and consideration of the particular object type by those of skill in the art of design of objects of the particular object type.
Models of complex geometric shapes, for example, those of automobiles, are made available to the apparatus and system as shown in
Described herein are a number of computer-implemented processes and apparatuses. Embodiments may be in the form of computer program code containing instructions embodied in tangible media, such as floppy diskettes, CD-ROMs, hard drives, or any other computer-readable storage medium, wherein, when the computer program code is loaded into and executed by a computer, the computer becomes an apparatus. Computer program code is disclosed herein, for example, whether stored in a storage medium, loaded into and/or executed by a computer, or transmitted over some transmission medium, such as over electrical wiring or cabling, through fiber optics, or via electromagnetic radiation, wherein, when the computer program code is loaded into and executed by a computer, the computer becomes an apparatus. When implemented on a general-purpose microprocessor, the computer program code segments configure the microprocessor to create specific logic circuits.
Vehicles are a subset of objects and the two terms are used interchangeably herein. The number and type of vehicle classes included in a design space may determine a describer representation approach employed. For example, the type of describer, the number used, and the certain adjustments made to correlate segments is variable. The functional categories of automobiles for a single manufacturer may be broken down as coupes, sedans, SUVs, sports cars, and trucks. Secondary categories may include minivans, wagons and convertibles.
The segmentation process, method, apparatus and product include providing a detailed input model 200 as shown in
The models shown in
Similar considerations are taken in segmenting three-dimensional and two-dimensional models. To reduce the amount of computational time in mixing and morphing models, the surfaces and curves describe the base vehicle shape while common details are avoided or eliminated. In this reduction, detail features that deviate from the base or basic shape are preferably ignored, including moldings, bumper grooves, antennas, rear spoilers and outside mirrors. The curves of a base shape or a detail may be included in the common representation when there is corresponding curve information for most input vehicles. Other common details such as whether the car is 2-door or 4-door, may be added later while manipulating or morphing or during another stage of processing to enhance vehicle individuality.
While 71 curves provide a high dimensional space, in use, the simplified and segmented models are reduced to principal components by mappings described below. It will be appreciated that any suitable number of describers, in this case curves, may be used to describe portions or the whole of the subject shape.
The same curves as shown in
A situation may arise where the same number of curves for the first and then subsequent objects such as vehicles does not result. In this instance, the user of the segmentation method, system and apparatus described herein may make adjustments to the first object to either increase or decrease the number of describers, and then follow through a stretching operation again and until registration of the plural objects has been achieved.
Additional features may be further included as describers and incorporated into the model. Consumer response, aesthetics, brand identity and function may be represented. Numerical values to associate with these additional features can be determined by examining consumer databases, by calculating appropriate values from the describers, or soliciting opinions from experts. For example, consumer response may be represented numerically in the form of a consumer response score.
The module chart of
Reduction module 606 inputs the selected designs and performs a reduction algorithm to remove details, transforming the selected designs into reduced designs. The process of matching geometric features in one input model to another is performed by matching the models to a reference model. The reference model may be the first base model generated. Since individual models vary significantly, and have features that are not common to others, the reference model will be defined as the base shape. Previously created CAD models, for example, may be simplified to a base model that contains components that are common across vehicles of interest.
Segmentation module 608 segments the reduced designs into component parts of the reference model as shown in
Turning to
In
However, if the fit is not satisfactory, the reference model is modified 812. At a step 814 reference model feature information may be added or removed. At a step 816 all input models previously registered to the reference model are re-registered to the modified reference model. The modified reference model becomes available again as a template at 802, and steps of
Returning to
The user 110 may view on display screen 108 a variety of models in a catalog as shown in
Exemplars that correspond to existing models may inherently incorporate engineering constraints. Packaging and criteria information may be incorporated into the registered models cataloged in datastore 116 to assist in providing information early in the design process. Existing models used as input to the statistical model may already have well-coordinated packaging and aesthetic characteristics.
The design tool therefore provides the ability to manipulate or morph models in many ways. Features that are selectable for alteration, manipulation and morphing include primary criteria such as vehicle height, wheelbase, H-point, and steering wheel position.
Therefore, the catalog of
There may be a style that the designer may want to emulate, e.g., a BUICK—having a particular brand flavor or identity that in this example should remain in the mix. Alternatively, favorite models may be mixed together and new design elements may be added. It will be appreciated that there are many ways to approach design including such considerations as aesthetics, brand identity, and function. Selectable morphable features include features named herein as well as others that may be recognized by persons skilled in the art of vehicle design.
In one embodiment, the user's interaction 110 with the system and method is driven by a user interface, the display 108 and manual input 112. Referring now to
Returning again to
Under the ADD button 1410 there may be general categories in a drop down menu. Options that may be provided are, for example: processing all exemplars, processing only the cars, processing only the trucks, processing only the CHEVROLETs, or processing only the GMCs.
Similarly, one could also remove the items by the REMOVE button 1314. For example, all vehicles may be chosen and the CADILLACs removed. Accordingly, everything would then be in a selected set except the CADILLACs.
The exemplars in the catalog on display 108 have been through a registration process that may be automatic, semiautomatic or manual. Exemplars have been fit so that there is a one-to-one correspondence between them. For example, as shown in
The user 110 uses the interface driven by the MIX button 1302 to select exemplars and then build the morphable model 1312. As shown in
A morphable model is a statistical model derived from the exemplars chosen to populate the design space. Initially, by selecting a mix as described above, the initial probabilities and initial mathematical space were set. As shown in
As an example shown in
On the display screen 108, the morphable model 1402 may be shown in one color for example and the exemplars may be in other colors behind the average model indicating the mixture. The designer may choose the colors.
For example, in
In this example the user then may pick a point or a curve on the average vehicle to pursue changes to the morphable model. For example, the user may pick a point at the rear window 1404a. By selecting the rear glass to modify the user can move that point up to make the model more HUMMER like and move it down to make it more CORVETTE like. It may continue to include some of the character of the SSR.
A drop-down menu may provide a list of points and/or segmented curves for the designer to pick from to alter the resultant vehicle model. Or the user may simply click near or on the rear window to select the point 1404a. In the example, the point 1404a represents the rear window. By clicking the point 1404a, a cluster of points 1406a, 1406b and 1406c may be provided on the display 108. The cluster of points shows the space in which the mix of cars' rear windows reside. That is, the cluster of points gives the user an immediate indication as to the extent of the design space for that feature from the exemplars. The cluster may or may not be shown on the display but if shown may be used as a guide. In this way the user can drag the point 1404 to the position of 1504 in
The average vehicle model 1402 morphs into the morphed vehicle model 1502. As the point is dragged, or as any manipulating or morphing occurs, the morphing may show on the screen in a continuous interactive manner. From the registration process, all curves that are related to each other from the exemplars defining the design space change consistently together. Manipulating exterior vehicle curves will change the packaging curves and vice versa. This dynamic interaction of styling and packaging is available immediately to the designer to aid the aesthetic creation process. Alternatively, when the point is dragged, the morphed model 1502 may be visible when the mouse button is released.
Geometric design data, coded into a representation such that different, but related, designs may be put into correspondence, comprise the catalog of designs. The coding may, for example, entail segmenting each geometric design into points or vertices connected by curves. Some or all designs in the catalog may be represented as an array of values that characterize the vertices and curves for that design. Corresponding values in different arrays map to corresponding vertices and curves in different designs. On the other hand, one or more catalogs may be included.
In summary, a segmentation tool method and apparatus may be incorporated in or separate from the design tool system and apparatus previously described.
Manipulation module 1606 of the modeling module 1602 is adapted to allow a designer to manipulate the statistical model by applying designer selections 110 received from designer input 112, via e.g., a mouse, keyboard, touch-screen, or other user input device. Modeling module 1606 communicates the currently derived shape from the statistical model to the designer via output 1608. The shape may be stored in the datastore 116 and visually rendered to the designer on a display 108. The designer evaluates the derived shape at 1610, and may save the shape in datastore 1612 as a new vehicle concept. Multiple vehicle concepts may therefore be developed and employed in a vehicle design process.
Pattern and extraction module 1604 preferably performs dimensionality reduction on the covariance matrix CX of the statistical model to find salient features and reduce the dimensions of the feature space to a tractable size as illustrated in
Manipulation module 1606 allows a vehicle designer to vary the patterns of the model in order to generate any number of concept vehicle designs. Based on designers' inputs 112 a statistical model is manipulated by a collection of mathematical techniques to yield designs. The reduction and segmentation described in detail above provides the initial input and subsequent output to the catalog 1318 for further manipulation as herein described.
While the invention has been described with reference to exemplary embodiments, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted for elements thereof without departing from the scope of the invention. In addition, many modifications may be made to adapt a particular situation or material to the teachings of the invention without departing from the essential scope thereof. Therefore, it is intended that the invention not be limited to the particular embodiment disclosed as the best mode contemplated for carrying out this invention, but that the invention will include all embodiments falling within the scope of the appended claims. Moreover, the use of the terms first, second, etc. do not denote any order or importance, but rather the terms first, second, etc. are used to distinguish one element from another.
Claims
1. A method for preparing a set of exemplars for use in a design tool, each exemplar in the set being registered to a common template model, said method comprising:
- registering each exemplar to the template model by the same set of points and features where the points and features define a describer;
- generating a first base model to be one of the exemplars;
- separating the first base model into separate components to form first base model components where the separate components are each defined by the describer and can be separately used to design a model; and
- characterizing the first base model components by the describer so that the first base model becomes part of the set of exemplars that have common features.
2. A method as recited in claim 1 further comprising:
- generating a second base model;
- separating the second base model into components to form second base model components; and
- characterizing the second base model components by a type of describer.
3. A method as recited in claim 2 further comprising:
- correlating the first base model components to the second base model components to form corresponding first and second base models exemplars.
4. A method as recited in claim 1 wherein the first base model components are described by curves.
5. A method as recited in claim 1 wherein the first base model components are described by points.
6. A method as recited in claim 3 wherein the first base model comprises outline components and the second base model comprises outline components and interior components, the method further comprising correlating a first base model outline component to a second base model interior component.
7. A method as recited in claim 3 further comprising stretching the components.
8. A method as recited in claim 3 further comprising contracting components.
9. A method as recited in claim 3 wherein the correlated first and second base model exemplars are input to a computer database to form a catalog.
10. A method as recited in claim 1 wherein the first base model is a vehicle.
11. A method as recited in claim 1 wherein the first base model is described by a plurality of Bezier curves.
12. An apparatus comprising:
- a database module for storing model representations which comprise details, said database module including a plurality of exemplars where each exemplar in the plurality of exemplars is registered to a common template model by the same set of points and features where the points and features define a describer, wherein each of the exemplars includes separate exemplar components where each separate exemplar component is defined by the describer;
- a selection module for choosing at least one of the model representations stored in the database module;
- a simplification module for removing details from the selected model representation;
- a segmentation module for describing the selected model representation with the describer.
13. An apparatus as recited in claim 12 wherein the describers are curves.
14. An apparatus as recited in claim 12 wherein the describers are points.
15. An apparatus as recited in claim 12 further comprising:
- a correspondence module for providing that the describers of the first selected model representation and the describers of a second model representation are in correspondence with one another.
16. An apparatus as recited in claim 12 wherein the first selected model representation's describers refer to outline components and wherein the second selected model representation's describers refer to outline components and interior components, the correspondence module further for correlating a first selected model representation's outline component to a second selected model representation's interior component.
17. A system for preparing exemplars, comprising:
- a processor processing instructions for generating a first base model, said processor including a database module for storing model representations which comprise details, said database module including a plurality of exemplars where each exemplar in the plurality of exemplars is registered to a common template model by the same set of points and features where the points and features define a describer, wherein each of the exemplars includes separate exemplar components where each separate exemplar component is defined by the describer,and wherein:
- the processor processing instructions for separating the first base model into components to form first base model components; and
- the processor processing instructions for characterizing the first base model components by a type of describer.
18. A system as recited in claim 17, wherein:
- the processor is capable of processing instructions for generating a second base model;
- the processor is capable of processing instructions for separating the second base model into components to form second base model components; and
- the processor is capable of processing instructions for characterizing the second base model components by a type of describer.
19. A system as recited in claim 18 wherein:
- the processor is capable of processing instructions for correlating the first base model components the second base model components to form corresponding first and second base models exemplars.
20. A system as recited in claim 19 wherein the first base model includes outline components and the second base model includes outline components and interior components, the processor further capable of processing instructions correlating a first base model's outline component to a second base model's interior component.
5119309 | June 2, 1992 | Cavendish et al. |
5905501 | May 18, 1999 | Kato |
5923573 | July 13, 1999 | Hatanaka |
6525744 | February 25, 2003 | Poggio et al. |
6556196 | April 29, 2003 | Blanz et al. |
6760693 | July 6, 2004 | Singh et al. |
6898560 | May 24, 2005 | Das |
7038700 | May 2, 2006 | Kawaguchi et al. |
7275023 | September 25, 2007 | Chen et al. |
7295959 | November 13, 2007 | Noma et al. |
- V. Blanz et al., A Morphable Model for the Synthesis of 3D Faces, Proceedings Siggraph, 1999.
- C. R. Shelton, Three-Dimensional Correspondence, A. I. Technical Report No. 1650, M.I.T. Artificial Intelligence Laboratory, 1998.
- C. R. Shelton, Morphable Surface Models, International Journal of Computer Vision, 38(1), pp. 75-91, 2000.
- Shenchang Eric Chen et al., Shape Averaging and its Applications to Industrial Design, IEEE Computer Graphics and Applications, vol. 9, Issue 1, pp. 47-54, Jan. 1989.
- Brett Allen et al., The space of human body shapes: reconstruction and parameterization from range scans, ACM Transactions on Graphics, vol. 22, Issue 3, Proceedings of SIGGRAPH 2003, pp. 587-594, Aug. 2003.
- Thomas Vetter, Michael J. Jones, Tomaso Poggio, “A Bootstrapping Algorithm for Learning Linear Models of Object Classes,” CVPR '97 (IEEE Conference on Computer Vision and Pattern Recognition), pp. 40-46, Puerto Rico, 1997.
Type: Grant
Filed: Jul 20, 2005
Date of Patent: Oct 28, 2008
Patent Publication Number: 20060031057
Assignee: GM Global Technology Operation, Inc. (Detroit, MI)
Inventors: Randall C. Smith (Rochester Hills, MI), Richard R. Pawlicki (Sterling Heights, MI), David R. Warn (Royal Oak, MI)
Primary Examiner: Alexander J Kosowski
Application Number: 11/185,930
International Classification: G06F 19/00 (20060101);