Tool for generating a re-generative functional test
A host system for generating a software built-in self-test engine (SBE) is provided for enabling on-chip generation and application of a re-generative functional test on a complex device such as a microprocessor under test. The host system comprises user directives provided to indicate user desired actions; instruction information provided to define a suite of instructions; and a SBE generation tool arranged to generate a software built-in self-test engine (SBE) based on the user directives, the instruction information and device constraints, for subsequent storage on-board of a complex device such as a microprocessor under test and activation of a re-generative functional test on the complex device under test (DUT).
Latest Patents:
This application is a continuation of U.S. application Ser. No. 09/922,639 filed on Aug. 7, 2001 which is incorporated herein by reference.
This application relates to prior application for Functional Random Instruction Testing (FRIT) Method For Complex Devices Such As Microprocessors filed on Jul. 31, 2001, there duly assigned Ser. No. 09/917,661.
TECHNICAL FIELDThe present invention relates to the manufacture and functional testing of complex devices such as microprocessors, and more particularly, relates to a tool for generating a re-generative functional test in the form of a kernel for enabling on-chip generation and application of functional tests.
BACKGROUNDApplication specific integrated circuit (ASIC) technology has undergone rapid changes in recent years. Current ASIC chips may include functional blocks, such as microprocessors, interfaces, memory arrays, and DSPs (digital signal processors) all of which need to be validated for design correctness and/or tested for manufacturing defects.
Microprocessor testing is typically considered one of the most complex problems in ASIC testing, whether the microprocessor happens to be an ASIC core or a stand-alone device. This is because modern microprocessors are highly complex and typically enhanced with additional operating modes and features. For example, newer ×86 microprocessors such as Pentium® processors as marketed by Intel® Corporation are designed to maintain software compatibility with previous 80×86 microprocessor generations (e.g., 8086/8, 80286, 80386, and 80486). These newer ×86 microprocessors include multiple operating modes and are equipped with cache memory systems and added hardware support features for operation in multi-processor environments. Errors in the designs of microprocessors and defects introduced during manufacturing may cause the microprocessors to produce incorrect results during operation.
Traditionally functional tests have been used to ensure that complex devices such as microprocessors under test produce correct results in all possible operating environments. Functional tests may be manually written by designers/programmers but are typically generated by random instruction test (RIT) tools, via a host computer under an operating system (OS) as described, for example, in the “Native Mode Functional Test Generation For Processors With Applications To Self Test and Design Validation” by Jian Shen and Jacob A. Abraham of the Computer Engineering Research Center, University of Texas, IEEE International Test Conference, pp. 990-999, August 1998. In general, these functional tests include software instructions which cause a microprocessor under test to perform a desired activity and to produce a test result. The test result is compared with an expected test result derived from a functional specification of the microprocessor under test. Any difference between the test result produced by the microprocessor under test and the expected test result represents a failure of the functional test. Such a functional test failure may indicate improper microprocessor operation due to a design error or a manufacturing defect.
However, manual development of functional tests is very costly in terms of the (human) resources needed. Likewise, RIT tools are not very efficient in terms of high fault coverage and, often, require a large number of tests and a large tester memory to produce high coverage. In addition, large scale, high pin count and expensive automatic test equipments (ATE) such as IC testers with several hundreds test pins (test channels), each of which includes a pattern generator, a timing generator and a frame processor, are required.
Other types of testing, such as design-for-test (DFT) techniques and built-in self-test (BIST) schemes such as scan, partial scan, logic BIST, and scan-based BIST, have been utilized to structurally test various logic blocks within a microprocessor. However, structural test tools require a large amount of test data and additional hardware area (extra logic circuits) to implement the test logic. In addition, there are inherent problems relating to high performance penalty and low collateral coverage.
Therefore there is need to develop a new tool programmed to generate a re-generative functional test in the form of a kernel that can be loaded on-board of a complex device such as a microprocessor to generate and execute its own functional tests in real time so as to avoid test data volume issues and achieve high collateral coverage with at-speed test application.
BRIEF DESCRIPTION OF THE DRAWINGSA more complete appreciation of exemplary embodiments of the present invention, and many of the attendant advantages of the present invention, will become readily apparent as the same becomes better understood by reference to the following detailed description when considered in conjunction with the accompanying drawings in which like reference symbols indicate the same or similar components, wherein:
The present invention is applicable to the testing of microprocessors, complex digital systems, and chipsets and new chipsets having memory and logic components incorporated therein which may become available as computer technology develops in the future. In addition, testing can be conducted on automated test equipment such as low cost testers, functional testers or even computer systems. The present invention is also applicable to the testing of one or more complex devices such as microprocessors integrated on one or more chipsets on board. However, for the sake of simplicity, discussions will concentrate mainly on random instruction testing of a single complex device such as a microprocessor, although the scope of the present invention is not limited thereto.
Attention now is directed to the drawings and particularly to
Generally, a simulation software (simulator) and a simulation model are utilized by a computer system (not shown) for computing the expected response of a complex device under test (DUT) 130. The simulation model may indicate a software representation of a complex device under test (DUT) 130, and may be written using hardware description languages such as Verilog or VHDL, and may be provided on a computer tangible medium, such as memory devices; magnetic disks (fixed, floppy, and removable); other magnetic media such as magnetic tapes; optical media such as CD-ROM disks, or via Internet downloads, which may be available for plug-in or download into an existing operating system (OS) for computing the expected response of a complex device under test (DUT) 130.
As shown in
Test programs 120 configured for functional tests have been commonly used to ensure that complex devices such as microprocessors produce correct results in all possible operating environments and indicate improper microprocessor operation due to design errors or manufacturing defects. However, functional tests are very costly in terms of the (human) resources needed. Traditional RIT tools may be used to generate functional tests, but are not very efficient in terms of high fault coverage and, often, require higher test data volume on a host computer under an operating system (OS).
For example,
Due to high equipment costs and test generation costs inherent to functional tests, various design-for-test (DFT) techniques and built-in self-test (BIST) schemes such as scan, partial scan, logic BIST, scan-based BIST may be utilized to structurally test various logic blocks within a microprocessor, via low cost tester 110 without the need for high pin count and high speed test. As a result, test programs 120 configured for structural tests have been recently used to indicate improper microprocessor operation due to manufacturing defects. Structural tests may be generated by scan automatic test pattern generation (ATPG) tools and executed in the same manner described with reference to
The main problem in these structural test approaches is the requirement of large amount of test data and additional hardware area (extra logic circuits) to implement the test logic. This is because test patterns are serially shifted into the microprocessor at slow speeds which can be very costly in terms of test time. In addition, these test schemes also cause a 5-10% performance penalty, typically, in a signal propagation delay. For example, in the scan implementation, each flip-flop circuit in the microprocessor is preceded by a selector (multiplexer) to selectively provide the flip-flop either a scan-in signal or a normal signal. Such an additional selector causes a delay time in the overall performance of the flip-flop circuit. Thus, the design-for-test (DFT) and built-in self-test (BIST) schemes may adversely affect the microprocessor's performance, such as an operating speed because of the signal propagation delays. Moreover, the collateral coverage from application of structural tests may be more limited compared to that achieved through the application of functional patterns.
Turning now to
As shown in
The FRIT kernel 420 may include a software built-in, self-test (BIST) engine (SBE) 420A configured to repeatedly generate and execute functional tests of a complex device under test (DUT) 430, and an expected test result (expected response) 420B computed based on a computer model of the same complex device under test (DUT) 430. Alternatively, the expected test result (expected response) 420B may be incorporated into the software built-in, self-test (BIST) engine (SBE) 420A. In either situation, the SBE 420A of the FRIT kernel 420 may operate independently from any operating system (OS) and may, therefore, provide an environment to store and run the re-generative functional test. The SBE 420A of the FRIT kernel 420 may be written in any computer language such as C or C++ code language, and may be provided on a computer tangible medium, such as memory devices; magnetic disks (fixed, floppy, and removable); other magnetic media such as magnetic tapes; optical media such as CD-ROM disks, or via Internet downloads, which may be available for plug-in or download into the controller 412 of the tester 410 for executing random functional instructions (machine code). In addition, the expected test result (expected response) 420B may be obtained by alternative techniques. For example, one technique to generate the expected response is to run the re-generative functional test on a good device first and then use the test results of a known good device to construct the expected response.
As shown in
As shown in
As shown in
Individual module of the SBE generation tool 600 shown in
During test application, the SBE 420A of the FRIT kernel 420 enables generation and execution of multiple functional tests. Each functional test may include a sequence of random instructions. The number of instructions in each functional test and the number of functional tests that need to be generated may be user controlled and are part of the user directives 602. Based on these user directives 602, a test execution environment 622A may be produced by the test execution directive composer 620 which ensures appropriate testing is accomplished. In addition, the test execution environment 622A may also include an exception handler to handle illegal conditions, such as illegal memory accesses, infinite loops etc., that occur during test execution. The RIT environment 622B has the basic environment that accomplishes operating system (OS) functions needed by the RIT generator 612.
The test result compaction module composer 630 generates the test result compaction module code (trcomp.asm) 632 that is used by the target complex device under test (DUT) 430 in order to compress the test results obtained by application of the several functional tests that get generated and executed during testing.
The RIT-G composer 610 may be a complex piece of software that is responsible for producing compact RIT-G programs based on user directives 602. The target RIT generator 612 has several constraints that must be followed. For a target complex device under test (DUT) 430, the ISA (instruction set architecture) information 604 defines the entire suite of possible instructions that a RIT generator 612 can potentially use. However based on the user directives 602, specific instruction sequences may only be produced by any particular RIT generator 612. Examples of such user directives 602 include, but are not limited to the following cases: Specifying a class of instructions like floating point, integer, branch, etc., specifying sequences of instruction classes like memory operations followed by integer/floating point instructions, specifying a ratio of the desired mix of the instruction classes etc.
The RIT-G composer 610 may be capable of taking such user directives and crafting specific RIT-G programs that when executed by the complex device under test (DUT) 430 in real time during test application, produce functional tests in accordance with the user directives 602 provided. The RIT-G code (RIT-G.c) 612 is a program (sequence of target DUT instructions) that meets the following constraints: it is compact in memory utilization, efficient in terms of instruction generation cost, is able to work around the lack of an operating system (OS) by using the provided run time environment 622, and when executed on the target DUT 430 during test, generates sequences of DUT instructions. The RIT-G code 612 includes an instruction generation module. The algorithm of the instruction generation module is shown in
In the example SBE tool implementation shown in
At block 818, all such instructions may be handled, and appropriate pre and post instructions may be generated. At block 820, the generated instruction may then be stored in the on-board memory of the target complex device under test (DUT) 430 at the location assigned by the test execution environment 622.
Referring now to
The controller 412 of the low-cost tester 410 may then receive and store the kernel test patterns in the tester memory 414 at block 912. Next, the controller 412 of the low cost tester 410 may then load the kernel test patterns (SBE “420A”) into on-board memory 434 of the complex device under test (DUT) 430, via an interface 432 at block 914. Once loaded into the on-board memory 434 of the complex device under test (DUT) 430, the controller 412 of the low cost tester 410 may enable execution of the kernel test patterns (SBE “420A”), that is, the kernel test patterns (SBE “420A”) may be automatically activated and repeatedly applied to the complex device under test (DUT) 430 at block 916. The test results may store in the on-board memory 434 of the complex device under test (DUT) 430. The controller 412 of the tester 410 may then unload the test results (device response) from the on-board memory 434 of the complex device under test (DUT) 430, via the interface 432, and compare the test results from the on-board memory 434 of the complex device under test (DUT) 430 with the test expected result 420B stored in the tester memory 414 in order to check for manufacturing defects at block 918.
Referring now back to
After the test result of a particular test sequence is obtained and compressed for compaction, the microprocessor 430 may determine if all data sets (M) associated with a test sequence of a particular loop are completed or done at block 1020. If all data sets associated with a test sequence of a particular loop are not completed or done, the microprocessor 430 may return to generate associated data at block 1014 and continue to run the test sequence at block 1016 until the test result is obtained and compressed at block 1018. However, if the data sets associated with a test sequence are completed or done, the microprocessor 430 may determine if all (“N”) instruction sequences are completed or done at block 1022. If all instruction sequences (N) are not completed or done, the microprocessor 430 may return to generate a new test sequence at block 1012, associated data of the new test sequence at block 1014 and continue to run the test sequence at block 1016 until the test result of the new test sequence is obtained and compressed at block 1018. When all the N instruction loops and M data sets have been executed, i.e., N times M number of instruction sequences have been executed, the microprocessor 430 may dump the test results of the FRIT kernel 420 from the on-board memory 434 of the microprocessor 430 back to the low cost tester 410, via low pin interface 432.
As shown in
As described from the foregoing, the SBE generation tool according to an embodiment of the present invention advantageously generates a testing component, SBE 420A of the FRIT kernel 420 for on-chip generation and application of functional tests. The FRIT kernel 420 then enables automated test generation in real time that is functional test based at speed and inexpensive to implement in silicon, and can be applied on low cost structural testers in order to achieve high collateral coverage while avoiding delay defect screening issues. The FRIT kernel 420 also allows a large number of tests to be applied without corresponding increase in test vector, that is, the increase in test data volume that exist with traditional RIT tools. The FRIT method offers tremendous benefits in containing the cost and ensuring quality of the microprocessors that are produced with practically no design changes and no silicon overhead. In addition, the FRIT kernel can be used at any test phase (SORT, Burn-In, Class) to reduce test data volume on the tester.
While there have been illustrated and described what are considered to be exemplary embodiments of the present invention, it will be understood by those skilled in the art and as technology develops that various changes and modifications may be made, and equivalents may be substituted for elements thereof without departing from the true scope of the present invention. For example, the testing system as shown in
Claims
1. A system, comprising:
- user directives provided to indicate user desired actions;
- instruction information provided to define a suite of instructions; and
- a software built-in self-test engine generation tool arranged to generate a software built-in self-test engine based on the user directives, the instruction information and device constraints, for subsequent storage on-board of a complex device under test and activation of a re-generative functional test on the complex device under test;
- wherein the software built-in self-test engine generation tool includes a test execution directive composer adapted to provide a run time environment.
2. The system of claim 1, wherein the test execution directive composer is adapted to receive the user directives and the device constraints and create the run time environment to enable the re-generative functional test to repeatedly generate functional tests and execute generated tests on-board the complex device under test.
3. The system of claim 1, wherein the software built-in self-test engine is to be merged with an expected test result and then loaded on-board a complex device under test so as to activate a re-generative functional test on the complex device under test and make a comparison between test results of the re-generative functional test and the expected test result to check for design validations and/or manufacturing defects.
4. The system of claim 3, wherein the expected test result is obtained from computer modeling of the complex device under test or from a known good device.
5. The system of claim 2, wherein the software built-in self-test engine generation tool further includes a random instruction test generator (RIT-G) composer to receive the user directives and the instruction information and generate a compact RIT-G code.
6. The system of claim 5, wherein the software built-in self-test engine generation tool further includes a test result compaction module composer to generate a test result compaction module code.
7. The system of claim 6, wherein the software built-in self-test engine generation tool further includes a code merger to merge code from the RIT-G composer, the test execution directive composer and the test result compaction module composer to generate the software built-in self-test engine.
8. The system of claim 7, wherein the software built-in self-test engine generation tool is a software tool installed to generate the software built-in self-test engine, and wherein individual components of the software built-in self-test engine generation tool, including the random instruction test generator (RIT-G) composer, the test execution directive composer, the test result compaction module composer, and the code merger, are software modules written in any computer language.
9. The system of claim 8, wherein the software built-in self-test engine generation tool is provided on a computer readable medium.
10. The system of claim 7, wherein the software built-in self-test engine generation tool is a hardware implementation installed to generate the software built-in self-test engine.
11. The system of claim 7, wherein the run time environment includes a test execution environment including an exception handler to handle illegal conditions such as undesirable memory accesses, deadlock, shut-down, and infinite loops, and a RIT environment to provide equivalent operating system (OS) functions needed by the RIT generator to generate the re-generative functional test.
12. The system of claim 7, wherein the compact RIT-G code produced is a C-language program compiled by a C-compiler to produce an assembly language version of the RIT-G code, and when the run time environment, the test result compaction module code and the assembly language version of the RIT-G code are assembled by an assembler, a single program indicating the software built-in self-test engine in the target device under test's object code is obtained.
13. The system of claim 12, wherein the compact RIT-G code includes an instruction generation module to generate individual instructions during testing application.
14. The system of claim 1, wherein the software built-in self-test engine comprises:
- a RIT generator including RIT machine code reside on-board the complex device under test for generating the re-generated functional test;
- a test program execution module including test execution directives for providing a run time environment to store and run the re-generated functional test; and
- a test result compaction module including compression machine code to compress test results of the re-generated functional test for storage on-board the complex device under test.
15. The system of claim 14, wherein the test execution environment employs an exception handler to handle illegal conditions, including undesirable memory accesses, deadlock, shut-down, and infinite loops.
16. The system of claim 1, wherein the complex device under test includes a microprocessor.
17. The system of claim 16, wherein, when test patterns of the software built-in self-test engine are applied to the microprocessor from an on-board memory, the microprocessor performs the following:
- beginning a set-up for executing test patterns;
- executing the test patterns to generate a series of test sequences and associated data for respective test sequences;
- running the test sequences, and at the end of the test sequences, obtaining the test results for storage in the on-board memory; and
- dumping the test results of the test patterns for making a comparison with the expected test result to check for design validations and/or manufacturing defects.
18. A method for generating a software built-in self-test engine comprising:
- obtaining user directives which indicate user desired actions;
- obtaining instruction information which defines a suite of instructions; and
- generating a software built-in self-test engine based on the user directives, the instruction information and device constraints, for subsequent storage on-board of a complex device under test and activation of a re-generative functional test on the complex device under test;
- wherein the software built-in self-test engine is generating by creating a run time environment to enable the re-generative functional test to repeatedly generate functional tests and execute generated tests on-board the complex device under test based on the device constraints.
19. The method of claim 18, wherein the software built-in self-test engine is further generated by:
- generating a compact random instruction test generator code based on the user directives and the instruction information;
- generating a test result compaction module code based on the user directives and the device constraints; and
- merging the compact random instruction test generator code, the run time environment and the test result compaction module code to obtain the software built-in self-test engine.
20. The method of claim 18, wherein the software built-in self-test engine is to be merged with an expected test result and then loaded on-board a complex device under test so as to activate a re-generative functional test on the complex device under test and make a comparison between test results of the re-generative functional test and the expected test result to check for design validations and/or manufacturing defects.
21. The method of claim 20, wherein the expected test result is obtained from computer modeling of the complex device under test or from a known good device.
22. The method of claim 19, wherein the run time environment includes a test execution environment including an exception handler to handle illegal conditions such as undesirable memory accesses, deadlock, shut-down, and infinite loops, and a RIT environment to provide equivalent operating system functions needed by the RIT generator to generate the re-generative functional test.
23. The method of claim 19, wherein the compact RIT-G code produced is a C-language program compiled by a C-compiler to produce an assembly language version of the RIT-G code, and when the run time environment, the test result compaction module code and the assembly language version of the RIT-G code are assembled by an assembler, a single program indicating the software built-in self-test engine in the target device under test's object code is obtained.
24. The method of claim 19, wherein the complex device under test includes a microprocessor.
25. The method of claim 19, wherein, when test patterns of the software built-in self-test engine are applied to the microprocessor from an on-board memory, the microprocessor performs the following:
- beginning a set-up for executing test patterns;
- executing the test patterns to generate a series of test sequences and associated data for respective test sequences;
- running the test sequences, and at the end of the test sequences, obtaining the test results for storage in the on-board memory; and
- dumping the test results of the test patterns for making a comparison with the expected test result to check for design validations and/or manufacturing defects.
26. The method of claim 25, wherein the software built-in self-test engine is programmed to generate and execute one or more (“N”) instruction sequences, each sequence being executed on one or more (M) data sets during testing, where N and M represent an integer no less than “1” and are user-specified numbers used in generating the software built-in self-test engine.
27. The method of claim 26, wherein the software built-in self-test engine is further programmed to generate one or more signatures to provide a unique identification of the test result of each test sequence and indicate whether the test result of a particular test sequence is “good” or “bad”.
28. A computer readable medium having stored thereon a software built-in self-test engine generation software tool which, when executed by a host system, causes the system to perform:
- obtaining user directives which indicate user desired actions;
- obtaining instruction information which defines a suite of instructions; and
- generating a software built-in self-test engine based on the user directives, the instruction information and device constraints, for subsequent storage on-board of a complex device under test and activation of a re-generative functional test on the complex device under test;
- wherein the software built-in self-test engine is generated by creating a run time environment to enable the re-generative functional test to repeatedly generate functional tests and execute generated tests on-board the complex device under test based on the device constraints.
29. The computer readable medium of claim 28, wherein the software built-in self-test engine comprises:
- a random instruction test generator including compact random instruction test machine code reside on-board the complex device under test for generating the re-generated functional test;
- a test program execution module including test execution directives for providing a run time environment to store and run the re-generated functional test; and
- a test result compaction module including compression machine code to compress test results of the re-generated functional test for storage on-board the complex device under test.
Type: Application
Filed: Jul 26, 2005
Publication Date: Nov 24, 2005
Applicant:
Inventors: Praveen Parvathala (Phoenix, AZ), Kailasnath Maneparambil (Chandler, AZ), William Lindsay (Chandler, AZ), Kamalnayan Jayaraman (Chandler, AZ), Geliang Zhou (Santa Clara, CA)
Application Number: 11/189,621