DETERMINING FUNCTIONAL DESIGN/REQUIREMENTS COVERAGE OF A COMPUTER CODE

Abstract

A method that includes: running a set of functional tests over a computer code; determining, for each code element of the computer code, which functional test covered it, to yield a tests-elements coverage map; associating portions of the computer code with corresponding design portions or requirements derived from a design document or a requirements document respectively, associated with the computer code, to yield a design/requirements-code tracing map; deriving, from the tests-code coverage map and the design/requirements-code tracing map, a design/requirements-tests coverage map, exhibiting coverage of the computer code by the functional tests, in terms of the design or the requirements, wherein at least one of the running, the determining, the associating, and the deriving is executed by at least one processor.

Description

BACKGROUND

1. Technical Field

The present invention relates to computer code testing and more particularly, to determining design/requirements coverage of functional tests for a given computer code.

2. Discussion of the Related Art

Functional tests are used throughout the life cycle of computer code development in order to verify that the computer code being developed meets the functional requirements or the design according to which the computer code has been written. The functional requirements are usually set forth in a specification document, possibly written in a natural language by the client. A design is then written, also in a natural language by a computer system engineer. The design contains high level description, in computer system terms, detailing how to address the requirements.

An important quantitative parameter in the code testing domain is the coverage of the design/requirements. The design/requirements coverage usually relates to the amount of the code that a given set of tests covers in terms of the design or the requirements according to which, the code has been written. Existing solutions for assessing the aforementioned coverage require explicit mapping between the design/requirements and the tests, either directly or indirectly in accordance with a specified model. Currently, there are no known methods to achieve such a coverage assessment without an explicit link between the design/requirements and the tests.

BRIEF SUMMARY

One aspect of the invention provides a method that includes: running a set of functional tests over a computer code; determining, for each code element of the computer code, which functional test covered it, to yield a tests-elements coverage map; associating portions of the computer code with corresponding design portions or requirements derived from a design document or a requirements document respectively, associated with the computer code, to yield a design/requirements-code tracing map; deriving, from the tests-code coverage map and the design/requirements-code tracing map, a design/requirements-tests coverage map, exhibiting coverage of the computer code by the functional, in terms of the design or the requirements, wherein at least one of the running, the determining, the associating, and the deriving is in operative association with at least one processor.

Other aspects of the invention may include a system arranged to execute the aforementioned method and a computer readable program configured to execute the aforementioned method. These, additional, and/or other aspects and/or advantages of the embodiments of the present invention are set forth in the detailed description which follows; possibly inferable from the detailed description; and/or learnable by practice of the embodiments of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS

For a better understanding of embodiments of the invention and to show how the same may be carried into effect, reference will now be made, purely by way of example, to the accompanying drawings in which like numerals designate corresponding elements or sections throughout.

In the accompanying drawings:

FIG. 1 is a high level schematic block diagram illustrating an environment of a system according to some embodiments of the invention;

FIG. 2 is a high level schematic block diagram illustrating a system according to some embodiments of the invention;

FIG. 3 is a high level flowchart diagram illustrating a method according to some embodiments of the invention;

FIG. 4 is a high level flowchart diagram illustrating an aspect relating to the method according to some embodiments of the invention;

FIG. 5 shows a high level schematic block diagram illustrating an aspect according to some embodiments of the invention;

FIGS. 6A and 6B show a block diagram and a graph diagram respectively illustrating an aspect according to some embodiments of the invention; and

FIG. 7 is a high level flowchart diagram illustrating an aspect relating to the method according to some embodiments of the invention.

The drawings together with the following detailed description make apparent to those skilled in the art how the invention may be embodied in practice.

DETAILED DESCRIPTION

Prior to setting forth the detailed description, it may be helpful to set forth definitions of certain terms that will be used hereinafter.

The term “requirement” or “functional requirement” as used herein in this application refers to a requirement that defines a function of a software system or its component. A function is described as a set of inputs, the behavior, and outputs. Functional requirements may be calculations, technical details, data manipulation and processing and other specific functionality that define what a system is supposed to accomplish. Behavioral requirements describing all the cases where the system uses the functional requirements are captured in use cases. Functional requirements are supported by non-functional requirements (also known as quality requirements), which impose constraints on the design or implementation.

The term “design” as used herein in this application refers to a high level description, usually in computer system terms, detailing how to address the requirements. This document, usually written in natural language is usually written by a computer system engineer after reading the requirements document.

The term “system testing” as used herein in this application refers to testing conducted on a complete, integrated system to evaluate the system's compliance with its specified requirements. System testing falls within the scope of black box testing, and as such, should require no knowledge of the inner design of the code or logic.

The term “test coverage” or simply, “coverage” as used herein in this application refers to a measure used in system testing. It describes the degree to which the source code of a program has been tested. It is a form of testing that inspects the code directly and is therefore a form of white box testing.

With specific reference now to the drawings in detail, it is stressed that the particulars shown are by way of example and for purposes of illustrative discussion of the preferred embodiments of the present invention only, and are presented in the cause of providing what is believed to be the most useful and readily understood description of the principles and conceptual aspects of the invention. In this regard, no attempt is made to show structural details of the invention in more detail than is necessary for a fundamental understanding of the invention, the description taken with the drawings making apparent to those skilled in the art how the several forms of the invention may be embodied in practice.

Before explaining at least one embodiment of the invention in detail, it is to be understood that the invention is not limited in its application to the details of construction and the arrangement of the components set forth in the following description or illustrated in the drawings. The invention is applicable to other embodiments or of being practiced or carried out in various ways. Also, it is to be understood that the phraseology and terminology employed herein is for the purpose of description and should not be regarded as limiting.

FIG. 1 is a high level schematic block diagram illustrating an exemplary environment of a system according to some embodiments of the invention. According to the exemplary embodiment, computer network 10 may include a personal computer 20 connected to a server 30. It is understood however, that any type of computer may be used instead of server 30. Server 30 may be fed with computer code 110 and design/requirements 170. In addition, server 30 may be in communication with a functional test repository 120.

In operation, computer code 110, design/requirements 170, and tests from functional test repository 120 may be used by server 30 to generate a corresponding design/requirements-tests coverage map 190. Design/requirements-tests coverage map 190 indicates which design portions or requirements 170 are covered by computer code 110. The generation of design/requirements-tests coverage map 190 may include two stages. The first stage may include applying some of the tests functional test repository 120 to computer code 110 and summarizing the information of which functions and/or classes where covered by the tests. The second stage may include the use of traceability between code and documentation techniques. These techniques are based on information retrieval, and therefore do not require prior knowledge regarding the mapping between the code and the requirements. The code covered by the tests may be linked to the appropriate design portions or requirements, thus providing links between tests and the design portions or requirements or they cover.

FIG. 2 is a high level schematic block diagram illustrating a system 100 according to some embodiments of the invention. System 100 may include a testing component 130 being in operative association with a functional tests repository 120. System 100 may further include a tracing component 150 in operative association with design/requirements 170 which may be in the form of human generated documents. System 100 may further include an analysis component 180 and may in some embodiments, further include a scoring component 192.

In operation, testing component 130 is configured to run a set of functional tests selected from functional tests repository 120 on a computer code 110 and to determine, for each element of computer code 110, which of functional tests 120 covered it, to yield a tests-elements coverage map 140.

Tracing component 150 may be configured to associate portions of computer code 110 with corresponding design/requirements 170 associated with computer code 110 to yield a design/requirements-code tracing map 160.

Analysis component 180 may be configured to derive, from tests-code coverage map 140 and design/requirements-code tracing map 160, a design/requirements-tests coverage map 190 that presents coverage of the computer code by the functional tests, in terms of the design or the requirements.

According to some embodiments, scoring component 192 may be configured to apply a scoring function to requirements-tests coverage map 190, to yield a design/requirements-coverage score 194 for each of design/requirement 170, representing a test coverage in design/requirement terms, for each one of the functional tests of functional tests repository 120 that were run over computer code 110. According to other embodiments, scoring component 192 may be configured to apply a scoring function to design/requirements-tests coverage map 190, wherein the scoring function associates a specified weight for each one of design/requirements 170 in accordance with a respective importance index, to yield a requirements-coverage score 194 for the set of functional tests of functional tests repository 120 representing the set's coverage in design/requirement terms, in view of the respective importance index of respective design/requirements.

FIG. 3 is a high level flowchart diagram illustrating a method 200 according to some embodiments of the invention. The method may include the following steps: running a set of functional tests over a computer code 210; determining, for each element of the computer code, which functional test covered it, to yield a tests-elements coverage map 220; associating portions of the computer code with corresponding design or requirements of a design/requirements document associated with the computer code to yield a design/requirements-code tracing map 230; and deriving, from the tests-code coverage map and the design/requirements-code tracing map, a design/requirements-tests coverage map, exhibiting coverage of the functional tests of the computer code, in terms of the design or the requirement 240.

In order to implement the aforementioned method, a computer (not shown) may receive instructions and data from a read-only memory or a random access memory or both. At least one of aforementioned running 210, determining 220, associating, and deriving 230 is performed by at least one processor associated with a computer. The essential elements of a computer are a processor for executing instructions and one or more memories for storing instructions and data. Generally, a computer will also include, or be operatively coupled to communicate with, one or more mass storage devices for storing data files. Storage modules suitable for tangibly embodying computer program instructions and data include all forms of non-volatile memory, including by way of example semiconductor memory devices, such as EPROM, EEPROM, and flash memory devices and also magneto-optic storage devices.

According to some embodiments of the invention, method 200 may further include applying a scoring function to the requirements-tests coverage map, to yield a design/requirements-coverage score for each design portion or requirement, representing test coverage in requirement terms, for each one of the functional tests that were run over the computer code 250. Alternatively, the scoring function associates a specified weight for each one of the design/requirements in accordance with a respective importance index, to yield a design/requirements-coverage score for the set of functional tests representing the set's coverage in design/requirement terms, in view of the respective importance index of respective design/requirements.

According to a non-limiting exemplary embodiment, the aforementioned scoring function may include the following steps: initializing the coverage score for each design/requirement by r_i=0, for each i. Then, for each design/requirement retrieved, counting the number of links pointing to this design/requirement, c_i. Then, calculating the coverage score for a design/requirement using a normalization of the number of links pointing to that design/requirement, for example: r_i=c_iΣ{c_j}. Finally, the output of the scoring function may show the design/requirements coverage scores {r_i}.

According to some embodiments of the invention, the computer code has been generated, either by a human developer, automatically, or semi-automatically in order to meet the design/requirements. At least some of the elements of the code that are the subject of the functional tests are functions and at least some of the tested elements are classes. The design/requirements, in turn are usually written in a natural language, possibly by a system engineer.

FIG. 4 is a high level flowchart diagram illustrating an aspect relating to method 200 according to some embodiments of the invention. The aforementioned step of associating portions of the computer code with corresponding design requirements to yield a design/requirements-code tracing map 230, may implement the use of traceability from code to requirements. Associating 230 may include the following steps: segmenting the design requirements document into sections, such that each section exhibits a single design portion or requirement 232; indexing the sections into a search engine 234; creating a query according to words obtained from the code, wherein the words are ranked according to their respective semantic meaning, for each segment of the computer code 236; and retrieving respective design/requirements by applying the search engine to each one of respective queries 238.

The following is a more detailed embodiment of the traceability process. The traceability process starts with segmentation of the design requirements document into sections, wherein each section comprises a single design portion or requirement. The segmentation may be followed by pre-processing each section using various techniques. Non-limiting examples of such techniques may include filter stop words (frequent words) and stemming. After pre-processing an indexing of all design/requirements segments into a search engine is performed. Then, given a code segment, the following process is performed in order to find the design/requirement(s) from which that section follows from: first, the given code is preprocessed using a pre-processing technique such as the aforementioned techniques. Then, words concatenated, for example, by CamelCase or underlines are separated. Subsequently, a query is created from the code. For example, for a Java class the following information may be used as words in creating the query: class name, public function names, class comments, public function arguments and return types, super class names and implemented interfaces, and public function comments. Then words are being ranked according to the semantic meaning of their respective source, Thus for example, a class name will be ranked higher than a comment. Finally, the query is being entered into the search engine to retrieve the related design/requirements.

FIG. 5 shows a high level schematic block diagram illustrating an aspect according to some embodiments of the invention. Computer code 110 contains code elements (functions and/or classes) 112, 114, 116, and 118 is in operative association with functional test repository 120 which contains functional tests 122, 124, 126, and 128, and further in operative association with design/requirements documents 170 containing design/requirements 172, 174, 176, and 178. The diagram illustrates how each code element may be traced back to a respective design portion or requirement, in addition, how each code element may be associated with a respective test, and finally how the tracing and the association yield a mapping of tests to design/requirements. For example, code element 112 may determined to be tested by functional test 122. In addition, same code element 112 may be traced back to design/requirement 172. Thus, in embodiments of the aforementioned method, functional test 122 may be mapped into design/requirement 172.

In embodiments of the invention, test-code element coverage map 140, requirements-code coverage map 160, and design/requirements-test coverage map 190 may be in the form of tables or any other form of data structure that enables a description of bi-directional connection of pairs.

FIGS. 6A and 6B show a block diagram and a graph diagram respectively illustrating an aspect according to some embodiments of the invention. In FIG. 6A, computer code 110 is shown, containing testable code elements (functions and/or classes) 111-118. FIG. 6B shows a respective graph 500 that shows the dependencies between code elements 111-118.

FIG. 7 is a high level flowchart diagram illustrating another aspect relating to the method according to some embodiments of the invention. There is provided a sub process for improving the results of method 200. Sub process 600 comprises: building a graph representing dependencies between elements of a computer code, wherein the computer code is associated with design or requirements, and a plurality of functional tests in a specified order 610; detecting tested elements, by running the functional tests on the computer code while monitoring the elements 620; mapping the tested elements and elements that depend thereupon in view of the graph, into corresponding design or requirements by tracing portions of the computer code to corresponding portions of the design requirements document, to yield a map of requirements in view of the tested elements and the elements that depend thereupon 630; and optionally applying a scoring function to the map, to yield a design/requirements coverage score for each requirement, representing a coverage in requirement terms, of the functional tests that were run on the computer code 640.

According to some embodiments of the invention, another sub process is provided for improving the precision of the coverage score of functions. Upon the completion of method 200 that yields the design/requirements-tests map and respective coverage score, for every class and/or function there is a list of design/requirements covered by this class/function. Specifically, some classes/functions may not point to all the design/requirements covered by them due to the nature of the aforementioned traceability technique. In order to address these issues, there is provided a sub process of improving the coverage score. The sub process may include the following steps: computing a dependencies graph (or a call graph in case where only functions are considered) between the code elements of the computer code as shown in FIG. 6B; extracting, for each design/requirement, all the code elements (function/classes) pointing to that design/requirement, based on the results achieved by the traceability technique; investigating, for each design/requirement, the dependencies tree to find all the elements that this element depends on; adding, for each element found in the previous step, a pointer to the relevant design/requirement, in case that it was not found during the aforementioned traceability step; and computing the coverage score of the design/requirement in accordance with aforementioned method 200.

According to some embodiments of the invention, another sub process is provided for improving the precision of the coverage score of functions. This may be achieved by generating a wider query which combines terms from both the tested elements and the elements that the tested elements depend from according to the dependencies graph.

As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or computer program product. Accordingly, aspects of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “circuit,” “module” or “system.” Furthermore, aspects of the present invention may take the form of a computer program product embodied in one or more computer readable medium(s) having computer readable program code embodied thereon.

Any combination of one or more computer readable medium(s) may be utilized. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in base band or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.

Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wire-line, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).

Aspects of the present invention are described above with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.

The computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.

The aforementioned flowchart and diagrams illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

In the above description, an embodiment is an example or implementation of the inventions. The various appearances of “one embodiment,” “an embodiment” or “some embodiments” do not necessarily all refer to the same embodiments.

Although various features of the invention may be described in the context of a single embodiment, the features may also be provided separately or in any suitable combination. Conversely, although the invention may be described herein in the context of separate embodiments for clarity, the invention may also be implemented in a single embodiment.

Reference in the specification to “some embodiments”, “an embodiment”, “one embodiment” or “other embodiments” means that a particular feature, structure, or characteristic described in connection with the embodiments is included in at least some embodiments, but not necessarily all embodiments, of the inventions.

It is to be understood that the phraseology and terminology employed herein is not to be construed as limiting and are for descriptive purpose only.

The principles and uses of the teachings of the present invention may be better understood with reference to the accompanying description, figures and examples.

It is to be understood that the details set forth herein do not construe a limitation to an application of the invention.

Furthermore, it is to be understood that the invention can be carried out or practiced in various ways and that the invention can be implemented in embodiments other than the ones outlined in the description above.

It is to be understood that the terms “including”, “comprising”, “consisting” and grammatical variants thereof do not preclude the addition of one or more components, features, steps, or integers or groups thereof and that the terms are to be construed as specifying components, features, steps or integers.

If the specification or claims refer to “an additional” element, that does not preclude there being more than one of the additional element.

It is to be understood that where the claims or specification refer to “a” or “an” element, such reference is not be construed that there is only one of that element.

It is to be understood that where the specification states that a component, feature, structure, or characteristic “may”, “might”, “can” or “could” be included, that particular component, feature, structure, or characteristic is not required to be included.

Where applicable, although state diagrams, flow diagrams or both may be used to describe embodiments, the invention is not limited to those diagrams or to the corresponding descriptions. For example, flow need not move through each illustrated box or state, or in exactly the same order as illustrated and described.

Methods of the present invention may be implemented by performing or completing manually, automatically, or a combination thereof, selected steps or tasks.

The term “method” may refer to manners, means, techniques and procedures for accomplishing a given task including, but not limited to, those manners, means, techniques and procedures either known to, or readily developed from known manners, means, techniques and procedures by practitioners of the art to which the invention belongs.

The descriptions, examples, methods and materials presented in the claims and the specification are not to be construed as limiting but rather as illustrative only.

Meanings of technical and scientific terms used herein are to be commonly understood as by one of ordinary skill in the art to which the invention belongs, unless otherwise defined.

The present invention may be implemented in the testing or practice with methods and materials equivalent or similar to those described herein.

Any publications, including patents, patent applications and articles, referenced or mentioned in this specification are herein incorporated in their entirety into the specification, to the same extent as if each individual publication was specifically and individually indicated to be incorporated herein. In addition, citation or identification of any reference in the description of some embodiments of the invention shall not be construed as an admission that such reference is available as prior art to the present invention.

While the invention has been described with respect to a limited number of embodiments, these should not be construed as limitations on the scope of the invention, but rather as exemplifications of some of the preferred embodiments. Other possible variations, modifications, and applications are also within the scope of the invention. Accordingly, the scope of the invention should not be limited by what has thus far been described, but by the appended claims and their legal equivalents.

Claims

1. A method comprising:

running a set of functional tests over a computer code;

determining, for each code element of the computer code, which functional test covered it, to yield a tests-elements coverage map;

associating portions of the computer code with corresponding design portions or requirements derived from a design document or a requirements document respectively, associated with the computer code, to yield a design/requirements-code tracing map; and

deriving, from the tests-code coverage map and the design/requirements-code tracing map, a design/requirements-tests coverage map, exhibiting a coverage of the computer code by the functional tests, in terms of the design or the requirements,

wherein at least one of the running, the determining, the associating, and the deriving is executed by at least one processor.

2. The method according to claim 1, further comprising applying a scoring function to the design/requirements-tests coverage map, to yield a design/requirements-coverage score for each design portion or requirement, representing a test coverage in design or requirement terms, for each one of the functional tests that has been run over the computer code.

3. The method according to claim 1, further comprising applying a scoring function to the design/requirements/tests coverage map, wherein the scoring function associates a specified weight for each one of the requirements or design portion in accordance with a respective importance index, to yield a design/requirement-coverage score for the set of functional tests representing the set's coverage in design or requirement terms, in view of the respective importance index of respective design/requirement.

4. The method according to claim 1, wherein the associating comprising:

segmenting the design or the requirements document into sections, each section having a single design portion or a single requirement;

indexing the sections into a search engine;

creating a query according to words obtained from the code, wherein the words are ranked according to their respective semantic meaning, for each segment of the computer code; and

retrieving respective requirements or design portions by applying the search engine to each one of respective queries.

5. The method according to claim 1, wherein the computer code has been generated in order to meet the design or the requirements.

6. The method according to claim 1, wherein at least some of the elements are functions and at least some of the elements are classes.

7. The method according to claim 1, wherein the design document or the requirements document are provides in a natural language form.

8. The method according to claim 1, further comprising building a graph representing dependencies between the code elements, wherein the determining is further applied to each dependent code element being a code element that depends upon another code element, based on the graph, such that the tests-elements coverage map further relates to dependent code elements.

9. A system comprising:

a testing component configured to: run a set of functional tests over a computer code; and determine, for each element of the computer code, which functional test covered it, to yield a tests-elements coverage map;

a tracing component configured to associate portions of the computer code with corresponding design portions or requirements of a design document or requirements document respectively, associated with the computer code, to yield a design/requirements-code tracing map; and

an analysis component configured to derive, from the tests-code coverage map and the design/requirements-code tracing map, a design/requirements-tests coverage map, exhibiting coverage of the functional tests of the computer code, in terms of the design portions or the requirements.

10. The system according to claim 9, further comprising a scoring component configured to apply a scoring function to the design/requirements-tests coverage map, to yield a design/requirements-coverage score for each design portion or requirement, representing a test coverage in design or requirements terms, for each one of the functional tests that have been run over the computer code.

11. The system according to claim 9, further comprising a scoring component configured to apply a scoring function to the design/requirements-tests coverage map, wherein the scoring function associates a specified weight for each one of the design/requirements in accordance with a respective importance index, to yield a design/requirements-coverage score for the set of functional tests representing the set's coverage in design/requirements terms, based on the respective importance index of respective design/requirements.

12. The system according to claim 9, wherein the tracing component is further configured to:

segment the design or requirements document into sections, each section having a single design portion or a single requirement;

index the sections into a search engine;

create a query according to words obtained from the code, wherein the words are ranked according to their respective semantic meaning, for each segment of the computer code; and

retrieve respective design portions or requirements by applying the search engine to each one of respective queries.

13. The system according to claim 9, further comprising a builder component configured to build a graph representing dependencies between the elements,

wherein the determining of the testing component is further applied to each dependent element that depends upon an element of the computer code, based on the graph, such that the tests-elements coverage map further relates to dependent elements.

14. A computer program product, the computer program product comprising:

a computer readable storage medium having computer readable program embodied therewith, the computer readable program comprising:

computer readable program configured to run a set of functional tests over a computer code; and

computer readable program configured to determine, for each element of the computer code, which functional test covered it, to yield a tests-elements coverage map;

computer readable program configured to associate portions of the computer code with corresponding design portions or requirements of a design document or a requirements document respectively, associated with the computer code, to yield a design/requirements-code tracing map; and

computer readable program configured to derive, from the tests-code coverage map and the design/requirements-code tracing map, a design/requirements-tests coverage map, exhibiting coverage of the functional tests of the computer code, in terms of the design or the requirements.

15. The computer program product according to claim 14, further comprising a computer readable program configured to apply a scoring function to the design/requirements-tests coverage map, to yield a design/requirements-coverage score for each design portion or requirement, representing a test coverage in design or requirement terms, for each one of the functional tests that have been run over the computer code.

16. The computer program product according to claim 14, further comprising a computer readable program configured to apply a scoring function to the design/requirements-tests coverage map, wherein the scoring function associates a specified weight for each one of the design portions or the requirements in accordance with a respective importance index, to yield a design/requirements-coverage score for the set of functional tests representing the set's coverage in design or requirements terms, based on the respective importance index of respective design portion or requirement.

17. The computer program product according to claim 14, wherein the computer readable program configured to associate, is further configured to:

segment the design document or the requirements document into sections, each section having a single design portion or single requirement respectively;

index the sections into a search engine;

create a query according to words obtained from the code, wherein the words are ranked according to their respective semantic meaning, for each segment of the computer code; and

retrieve respective design portions or requirements by applying the search engine to each one of respective queries.

18. The computer program product according to claim 14, further comprising a computer readable program configured to build a graph representing dependencies between the code elements,

wherein the determining of the testing component is further applied to each dependent code element that depends upon a code element of the computer code, in view of the graph, such that the tests-elements coverage map further relates to dependent code elements.

19. The computer program product according to claim 14, wherein the computer code has been generated in order to meet the design or the requirements.

20. The computer program product according to claim 14, wherein the design document or the requirements document are provided in a natural language form.