Abstract: Systems and methods for dynamically determining potentially applicability of product regulations to product protocols. According to certain aspects, an electronic device may access new or updated product regulations for various jurisdictions as well as product protocols associated with certain products. The electronic device may employ various data analyses technologies to determine which product regulations are potentially applicable to which product protocols. The electronic device may present information associated with the data analyses, and enable users to review information, further assess applicability, and make selections.

Abstract: A system for providing context tree based on data model is disclosed. The system comprises an interface, a processor, and a memory. The interface is configured to receive a data model entry point, and to receive one or more context filters. The processor is configured to determine context tree data based on the one or more context filters and the data model entry point from any context tree provider that has appropriate context tree information. The memory is coupled to the processor and is configured to provide the processor with instructions.

Abstract: A test control device includes a test variable generation device and a test processing device. The test variable generation device uses a test prediction model to generate a first manipulated variable based on a difference between a target value and a first controlled variable value from a device under test. The test processing device acquires a second controlled variable value from the device under based on use of the first manipulated variable value. The test variable generation device notifies the device under test of end of a test if the second controlled variable value is equal to or greater than the target value or uses the test prediction model to generate a second manipulated variable based on a difference between the target value and the second controlled variable value when the second controlled variable value is less than the target value.

Abstract: A port manager is configured to implement adaptive port ceiling assignment for background Input/Output (I/O) operations between heterogeneous storage arrays. The port manager generates a set of test I/O operations, applies the I/O operations to a port under test, determines a response time to complete the I/O operations on the port under test, and compares the response time of the current test with response times of a set of previous tests. Based on the test values, the port manager identifies a throughput inflection point for the port under test, which is used to set a maximum throughput of the port under test. The adaptive ceiling for the port under test is then set based on the maximum throughput times a ceiling percentage threshold value. The determined adaptive ceiling value is then used to prospectively limit background I/O operations on the port under test.

Abstract: A redundant circuit assigning method includes: executing a first test item to obtain first test data including position data of fail bits acquired during execution of the first test item; determining a first redundant circuit assigning result according to the first test data, where the first redundant circuit assigning result includes a number of assigned local redundant circuits and their corresponding position data; executing a second test item to obtain second test data including position data of fail bits acquired during execution of the second test item; and determining a second redundant circuit assigning result according to the first test data and the second test data, when the fail bits acquired during the execution of the second test item include one or more fail bits beyond a repair range of the assigned local redundant circuits and assigned global redundant circuits and when assignable local redundant circuits have been assigned.

Abstract: A hardware-programmable digital signal path component for processing events from sensor mixed signal devices. A system includes a mixed signal component and a reconfigurable signal path component. The mixed signal component includes a group of sensor devices and generates one or more events from among the group of sensor devices. The signal path component receives the event(s), and includes a control unit component and a digital signal processor (DSP) component. The control unit component includes a programmable function enable mechanism, and distributes the received event(s) in combination with one or more functions among a set of predefined functions enabled by the programmable function enable mechanism. The DSP component is configured to perform one or more operations associated with the distributed event(s) in accordance with the enabled function(s).

Abstract: An example method includes obtaining, by one or more processors, data indicating resource dependencies between a plurality of resources in a network and event dependencies between a plurality of network events and one or more of the plurality of resources; generating a Bayesian model based on resource types of the plurality of resources and event types of the plurality of network events; receiving an indication of a fault in the network; collecting fault data and generating, based on the Bayesian model and the fault data, a plurality of root cause hypotheses for the fault; ordering the plurality of root cause hypotheses based on respective root cause probabilities associated with the plurality of root cause hypotheses; and outputting the ordered plurality of root cause hypotheses.

Abstract: A robotic integrated circuit placement system includes a test board comprising a socket for holding an integrated circuit, a tester coupled to the test board, a chip tray having a plurality of slots for storing respective integrated circuits including the integrated circuit, and a robotic arm system. The robotic arm system includes a robotic arm having a stepper motor for controlling a position of an end of the robotic arm, a camera, and a controller coupled to the robotic arm and adapted to operate the robotic arm automatically. The controller performs image processing on images acquired by the camera, and moves the integrated circuit between the chip tray and the socket using the robotic arm in response to the image processing.

Abstract: A redundant circuit assigning method a includes: first test item is executed and first test data is acquired; a first redundant circuit assigning result including the number of assigned local redundant circuits and position data of the assigned local redundant circuits is determined according to the first test data; a second test item is executed and second test data is acquired; when fail bits acquired during execution of the second test item include one or more fail bits beyond the repair range of the assigned local redundant circuits and assigned global redundant circuits, and the assignable redundant circuits have been assigned out, target position data of fail bits in a target subdomain and a related subdomain is acquired based on the first test data and the second test data; and a second redundant circuit assigning result is determined according to the first test data and the second test data.

Abstract: The invention relates to a measurement instrument, such as an oscilloscope, comprising a measurement unit adapted to receive an input signal, and a processing unit adapted to classify the input signal, preferably based on signal parameters or characteristics of the input signal. wherein the processing unit is adapted to determine a signal analysis category for the input signal based on said classification of the input signal, and to match the determined signal analysis category to a control configuration, which defines settings and/or configurations of the measurement instrument, based on an adjustment function.

Abstract: A mechanism for securing a series of related function calls for firmware services using session tokens is discussed.

Abstract: A test-driven development system utilizes a neural transformer model with attention to generate method bodies for a focal method given its associated test cases, and optionally a method signature and a docstring of the focal method. The candidate method bodies are validated for syntactic correctness, tested using the given test cases, and tested with a donor class in a target system. Those candidate method bodies passing the validation and testing are then ranked based on a PLUM score that analyzes the candidate method bodies against various quality and performance metrics.

Abstract: Embodiments of the present invention relate to methods, systems, and computer program products for event management. In a method, a plurality of notes that are comprised in a plurality of event records are obtained in a computer system. A plurality of paragraphs that are comprised in the plurality of notes are classified into a plurality of content types based on a content analysis of the plurality of paragraphs. The plurality of notes are classified into a plurality of semantic types based on the plurality of content types and a syntactic parsing to the plurality of notes. A knowledge item is generated for managing an event in the computer system based on a group of notes in the plurality of notes that are classified into the plurality of semantic types. With these embodiments, knowledge items for managing events may be obtained in an easier and more effective way.

Abstract: Systems and techniques for multi-factor cloud service storage device error prediction are described herein. A set of storage device metrics and a set of computing system metrics may be obtained. A feature set may be generated using the set of storage device metrics and the set of computing system metrics. Members of the feature set may be validated by evaluating a validation training dataset using the members of the feature set. A modified feature set may be created based on the validation. A storage device failure model may be created using the modified feature set. A storage device rating range may be determined by minimizing a cost of misclassification of a storage device. A set of storage devices to be labeled may be identified as having a high probability of failure.

Abstract: An example system includes a processing resource and a switch board coupled to a system under test (SUT) and the processing resource. The SUT includes a memory device. The switch board can be configured to provide power to the SUT, communicate a first signal from the SUT to the processing resource, and provide a second signal to the SUT that simulates an input to the SUT during operation of the SUT. The processing resource can be configured to receive a function, selected from a library of functions, to execute during a test of the memory device and cause the switch board to provide the second signal during the test of the SUT.

Abstract: The invention relates to an electrical, preferably portable and battery-powered, measurement device. The device comprises: an electrical measurement unit supplying electrical measurement signals, a processing unit processing said electrical measurement signals, a memory, and a display controlled by the processing unit and displaying the processed electrical signals, wherein the processor is arranged to execute an operating system stored in the memory, and wherein the in the memory furthermore a local web browser application is stored which can be executed by the processor in order to control the display.

Abstract: A system comprising an inner kernel of an operating system (OS) running at a higher privilege level than an outer kernel of the OS, the inner kernel to measure a data structure in a memory; a device including a measurement engine to measure the data structure in the memory, wherein the device operates independently of the OS; and a trusted execution environment including an application to compare measurements from the inner kernel and the measurement engine.

Abstract: Embodiments autonomously test a logical model for inconsistencies. For example, metadata descriptive of a logical model can be received, where the logical model includes an abstraction for a database schema, the database schema is implemented at a database, and the database schema includes a fact table and a dimension table. Logical queries can be automatically generated including at least first and second logical queries based on the retrieved metadata, where the first and second logical queries target a logical object of the logical model. At least the first and second logical queries can be issued to a server that hosts the logical model, where, at the server, the first and second logical queries are translated to first and second database queries, and the first and second database queries target at least a fact table and a dimension table from the database schema. Query results received from execution of the first and second database queries can be compared.

Abstract: A test controller functionally tests components of a modular data center (MDC) that is being manufactured. Functional test(s) for quality assurance of an environmental control system (ECS) are determined for an information technology pre-assembled component (ITPAC) module and an environmental system (ES) module that are configured for being coupled together for cooling of heat-generating equipment of the ITPAC module at a deployed location. For each functional test(s), the test controller identifies input signal value(s) associated with one of the modules. The test controller emulates, via a communication test cable connected between the one module and the test controller, the identified input signal value(s). The test controller determines, via the communication test cable, any response by the one module to the input signal value(s). The test controller compares the determined response to an expected response and generates and outputs test data based on the comparison.

Abstract: A system and method that improves the efficiency and accuracy of template selection process by applying machine learning to perform natural language processing (NLP) to automatically interpret the intent of the test scenarios and to match the intent of the test scenarios to appropriate test template(s). The system and method can use keyphrases and part-of-speech (POS) tokens to accurately capture the intent of test scenarios and templates. The system and method can additionally use machine learning to perform NLP to identify information from the test scenario(s) that relates to fields in templates to automatically fill in fields in the selected test template(s). In situations where the processing of the test scenario(s) does not provide all of the information necessary to fill every field of a template, the system and method can use machine learning to perform NLP to automatically create and execute a search statement to find the missing information related to empty fields in an application database.

Abstract: Multiple edits to a hierarchical data structure may be atomically applied. A request to perform modifications with respect to a portion or the entire hierarchical data structure may be received. A copy of the requested portion of the hierarchical data structure may be created separate from the hierarchical data structure. The portion of the hierarchical data structure may remain available for read access. Modifications may be applied to the copy of the portion of the hierarchical data structure. In response to a request to commit the modifications to the portion of the hierarchical data structure, the copy of the portion of the hierarchical data structure may atomically replace the portion of the hierarchical data structure.

Abstract: Methods, non-transitory computer readable media, and runner servers are disclosed that execute a web application test with a headless browser activated in response to a request to schedule the test received from a dashboard server. The test includes test actions. An input request that includes a hint and a session identifier is sent to the dashboard server in response to a user input trigger associated with one of the test actions during the execution of the test. The associated one of the test actions is then executed with the headless browser using input data received from the dashboard server in response to the input request. During the execution of the web application test, web page(s) associated with the web application and analysis results are recorded. The recorded web page(s) and analysis results are then output to the dashboard server when the web application test is complete.

Abstract: Techniques for test orchestration are disclosed. A system executes multiple test execution plans, using instances of a same test container image that encapsulates a test environment and instances of at least two different test support container images that are specified by different user-defined test configurations and each configured to perform, respectively, one or more test support operations. To execute each of the test execution plans, the system generates a respective instance of the test container image and one or more test support containers. A particular test execution plan includes generating a test support container that is specified in a corresponding user-defined test configuration and that is different from any test support container specified in another user-defined test configuration.

Abstract: Transforming input data to enable execution of second executable code using trace data gathered during execution of first executable code. A trace of an execution of the first code is accessed. The trace stores data of an input that was consumed by first executable instructions of the first code. It is determined that the stored data of the input is usable as an input to second executable instructions of the second code. A difference in size/format of the stored data as used by the first instructions, compared to an input size/format expected by the second executable instructions, is identified. Based on the identified difference, a data transformation is determined that would enable the second instructions to consume the stored data. Execution of the second instructions is emulated using the stored data, including projecting the data transformation to enable the second instructions to consume the stored data.

Abstract: A system is disclosed that comprises a field programmable gate array (FPGA), a network interface, and hardware description code, wherein the hardware description code is compilable into a plurality of bit configuration files for loading onto the FPGA, wherein each bit configuration file defines a pipelined processing operation for a hardware template. The FPGA comprises configurable hardware logic, and the FPGA can be accessible over a network via the network interface for commanding the FPGA to load a bit configuration file from among the bit configuration files onto the FPGA to thereby configure hardware logic on the FPGA to perform the pipelined processing operation defined by the loaded bit configuration file, and wherein the FPGA is configured to (1) receive streaming data and (2) process the streaming data through the configured hardware logic to perform the pipelined processing operation defined by the loaded bit configuration file on the streaming data.

Abstract: A sensor system including one sensor element for acquiring at least one measured variable, a circuit system for operating the sensor device and for generating sensor data based on the sensor signals, and a configuration data memory for configuration data. The sensor system is able to be alternatively operated in at least in an active mode, and in a sleep mode. The circuit system is configured in such a way that the memory content of the configuration data memory is independent of the respective operating mode of the sensor system, so that the stored configuration data are maintained in a sleep mode, and the sensor system is configured in such a way that the at least one part that is switched to a currentless state in the sleep mode is reconfigured on the basis of the stored configuration data when a change to an active mode is initiated.

Abstract: A system and system for personal pathogen status verifying allows an entity to control access to an area of congregation (AOC) at one or more points of entry (POE) is a configurable manner. In one embodiment, the system may be used for the SARS-CoV-2 virus, but may be similarly used for other pathogens.

Abstract: Disclosed are various examples for managing and customizing policy configurations on user devices enrolled in an enterprise management service. The policy configurations can include machine policies and/or user policies. An administrator can customize a baseline including a list of policies supported by an operating system of managed user devices. A management component on the user devices can obtain the baseline specified by the administrator from a managing service and apply the policies to the user device.

Abstract: In general, techniques are described for providing diversity in simulation datasets during modeling. A device comprising a memory and a processor may be configured to perform the techniques. The memory may store simulation configuration files for conducting simulations of the network device within a test environment. The processor may conduct, based on the simulation configuration files, each of the simulations with respect to the network device to collect corresponding simulation datasets indicative of an operating state of the network device. The processor may determine a level of similarity between the simulation datasets, and select, responsive to a comparison of the level of similarity to a diversity threshold, a subset of the simulation datasets. The processor may generate, based on the selected subset of the simulation datasets, a model representative of the network device that predicts, responsive to configuration parameters for the network device, an operating state of the network device.

Abstract: A method is provided for controlling external noise in an audio output device. A speech signal is detected in the vicinity of the audio output device. The speech signal is transcribed into text. The transcribed text is compared with reference text. When at least a portion of the transcribed text matches with a portion of the reference text, it is determined to reduce at least one of a level of active noise reduction or a level of noise masking to enable a user of the audio output device to hear sounds external to the audio output device.

Abstract: A test system tests a DUT configured as a wireless device. A golden device is configured to provide bidirectional communication between it and the DUT. A measurement device acquires a first signal S1 including at least an output SDUT of the DUT. An interface unit monitors a second signal S2 including at least one of the output SGD of the golden device and the output SDUT of the DUT. In response to the occurrence of a predetermined waveform pattern in the second signal, the interface unit generates a trigger signal TRIG for instructing the measurement device to acquire a signal.

Abstract: A method for detecting and localizing a fault in a system under test (SUT) includes generating an initial set of test vectors that provides complete n-wise coverage of the reduced test space. The method further includes generating an initial set of test cases from the initial set of test vectors and executing the initial set of test cases. The method further includes generating a set of new test cases from a selected failing test case, wherein generating the set of new test cases comprises generating, in relation to each attribute in the selected failing test case, a respective subset of new test cases at least in part by changing a respective attribute value for the attribute in the selected failing test case to each other candidate attribute value for the attribute that is not present in any of the one or more test cases that failed execution.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for accessing a database comprising multiple datasets. Each dataset includes data derived from a respective application. A machine-learning engine determines an analytical rule using at least one dataset of the multiple datasets. The analytical rule is determined by processing input data obtained from the at least one dataset derived from the respective application. A structured dataset is generated based on the determined analytical rule. The structured dataset is generated in response to using the determined analytical rule to analyze data from each dataset of the multiple datasets derived from the respective application. One or more data sequences that represent information flow of a transaction process are determined based on the structured dataset.

Abstract: A method for sequential equivalence checking (SEC) of two representations of an electronic design may include using a processor, automatically selecting a plurality of cutpoints in the two representations of the electronic design; using a processor, automatically executing a prove-from strategy on the plurality of cut point pairs to identify a failed cut point pair in the two electronic designs; and using the processor, automatically extending a trace corresponding to the identified failed cut point pair to identify a deeper failed cut point pair or a failed output pair in the two electronic designs.

Abstract: There is provided a computer-implemented method of testing an application. The method, responsive to first mark data being included in second mark data, obtains second temporary test scripts for testing at least one test case of the second version of the application, wherein the second temporary test scripts being recorded with the second mark data. The method obtains a second correspondence between increased test data and increased data in the second mark data compared with the first mark data. The method substitutes the test data and the increased test data for the second mark data in the second temporary test scripts based on both the first and second correspondences to obtain second test scripts for testing the at least one test case of the second version of the application.

Abstract: Methods and measurements systems are disclosed relating to dynamic measurement prioritization by multiple software interfaces. A first software interface with a low priority may be conducting a first measurement on a device under test (DUT) through a driver connected to a measurement device. A second software interface with a higher priority may initiate a request to conduct a second measurement on the DUT. In response, the driver may automatically determine that the second software interface has a higher priority than the first software interface and may halt the first measurement and conduct the second measurement. The driver may notify the first software interface that its access to the measurement hardware has been revoked, and the first software interface may enter a monitoring mode to monitor the results of the second measurement.

Abstract: Constant-output-value gates and buffer gates are determined for gates in a circuit design based on a hold-toggle pattern. The hold-toggle pattern determines in which shift clock cycles in a segment of consecutive shift clock cycles one or more scan chains receive bits based on corresponding bits of a test pattern or same bits as bits of previous shift clock cycles during a shift operation. Activation probabilities and observation probabilities are then determined for circuit nodes of the circuit design based at least in part on the constant-output-value gates and the buffer gates. Finally, test patterns are generated based on the activation probabilities and the observation probabilities.

Abstract: Methods, non-transitory computer readable media, and dashboard servers are disclosed that initiate a test of a web application on a runner server in response to a command. A test action associated with the test includes a user input trigger and a hint. A user input request, generated when the user input trigger is encountered during execution of the test with a headless browser, is received from the runner server. The user input request includes a session identifier and the hint. Input data is obtained from a user device via an input field that is output along with the hint to an input panel provided to the user device. The input panel is associated with the session identifier. The input data is then sent to the runner server in response to the user input request.

Abstract: A method, computer system, and computer program product for distributing a composite application is provided. The composite application includes several components, and is adapted to be distributed on multiple systems implementing runtime environments. The components have associated distribution descriptors. The distribution descriptors specify requirements for the at least one target runtime environment. The method includes selecting a composite application from a code asset repository and upon the selection of the composite application, creating a distributing workflow by a distributing unit. The distributing workflow includes a configuration. The configuration specifies the at least one target runtime environment. The method further includes executing the distributing workflow. The executing can include evaluating the distribution descriptor of each component according to the configuration, based on the evaluating, creating a distribution script for each component, and executing the distribution scripts.

Abstract: A health status platform includes a receiving component that receives a test result a test of a biological sample collected from a human patient. The test result includes an indication of a presence of an infectious disease in the patient, and an identification and a verification of the patient. The platform includes a certificate component that issues a certificate of origin of the biological sample; and a data merging component that cooperates with a venue access manager that controls access to a venue. The data merging component implements a distributed ledger system that stores encrypted test results of the patient and the identification and verification of the patient, and an end-to-end encryption system that receives an encrypted venue access request from a venue access manager, decrypts the access request, determines if an access request is valid, and if valid, provides an encrypted certificate of origin to the venue access manager.

Abstract: A system and method for performing regression testing on source code provides a data sample to one or more candidate instances executing a candidate version of source code for a code base and provides the data sample to plurality of baseline instances executing a baseline version of the source code. The baseline version of the source code and the candidate version of the source code differ. The regression testing system and method obtains candidate outputs from the one or more candidate instances and obtains baseline outputs from the plurality of baseline instances based on the provided data sample. One or more faults in the candidate version of the source code can be determined by comparing the candidate outputs the baseline outputs. A filter for excluding one or more data fields from the comparison can be generated based on a comparison between baseline outputs from one of the plurality of baseline instances and baseline outputs from another of the plurality of baseline instances.

Abstract: An additional test pattern acquiring unit acquires a test pattern, which is not yet executed to the semiconductor device serving as a target of executing an additional test among test patterns stored in a test pattern information DB, as an additional test pattern with reference to a semiconductor manufacturing history information DB. Also, an additional test transmitting unit transmits the additional test pattern acquired by the additional test pattern acquiring unit to the semiconductor device serving as the target of the additional test through a network. An additional test result acquiring unit acquires a test execution result together with an ID of the semiconductor device, and a registration unit registers identification information of the executed test pattern, an execution result of the test pattern, and an execution timing of the test in a semiconductor product history information DB so as to be associated with the acquired ID of the semiconductor device.

Abstract: The present disclosure is directed to an automated system and method of analyzing performance of engines in a test cell. The method includes electronically accessing engine operational data in a stored database of the test cell. Another step includes electronically retrieving operational data corresponding to the new test if at least one new test is detected in the stored database for an engine. Further, the method includes inputting the operational data corresponding to the new test into a performance model specific to an engine type for the engine. The method also includes electronically analyzing an output of the performance model. An additional step includes electronically generating at least one summary report of engine health of the engine based on the analyzed output. Thus, the method also includes providing the summary report as electronic output to a user.

Abstract: Computer-implemented methods of verifying an integrated circuit hardware design to implement an integer divider wherein the integer divider is configured to receive a numerator N and a denominator D and output a quotient q and a remainder r. The method includes (a) verifying a base property is true for the integrated circuit hardware design and (b) formally verifying that one or more range reduction properties are true for the integrated circuit hardware design. The base property is configured to verify that an instantiation of the integrated circuit hardware design will generate a correct output pair q,r in response to any input pair N,D in a subset of non-negative input pairs.

Abstract: A method, computer program product, and computing system for receiving usage and configuration data from a storage system. The usage and configuration data is compared to one or more best practice models to determine one or more recommendations. The one or more recommendations are provided to a user of the storage system.

Abstract: Techniques for parallel testing of multiple mobile devices simultaneously at an MCellblock are described. In one example, an MCellblock receives a request to perform a test run on multiple mobile devices located at the MCellblock. The request includes multiple test scripts that can be used by the MCellblock to execute a test run on each of the multiple mobile devices. The MCellblock creates a thread for each of the multiple mobile devices to perform the test run. Then, the MCellblock performs the test run on each of the multiple mobile devices located at the MCellblock simultaneously via each of the threads. Performing the test run includes executing a test script on each of the respective multiple mobile devices. The MCellblock monitors the multiple mobile devices as the test run is performed for results of the test run, and outputs the results of the test run.

Abstract: According to an embodiment of the present invention, a computer implemented method and system for automated test and retesting in a virtual test environment, comprises: an input interface, comprising at least one processor, configured to receive one or more commands from a user, wherein the one or more commands comprise at least one test procedure and at least one system version parameter; a test and retest engine, comprising at least one processor, configured to execute the one or more commands on at least one system under test on a virtual environment based at least in part on the at least one system version parameter; and an output interface, comprising at least one processor, configured to receive results data responsive to execution of the one or more commands and further configured to display the results to the user.

Abstract: An apparatus and method for inducing high-speed wobble motions to a sample of interest is provided. After the sample is securely attached to a sample mounting block, the sample is variably tilted by using a hexapod stage and simultaneously rotated at a high speed about a rotation axis that is substantially perpendicular to a planar top surface of the hexapod stage. The position of the sample is continuously adjusted during the wobble motion to align a surface center of the sample with a testing center of an X-ray diffractometer. The simultaneous variable tilting and high-speed rotation of the sample induces wobble motions to the sample for randomizing orientations of a sample material's crystallites relative to the source and detector of an X-ray diffractometer.

Abstract: A method and system, the method including receiving a set of requirements for a software application, the set of requirements comprising a plurality of software requirements identified for the software application; analyzing the set of requirements to determine dependencies between the plurality of software requirements in the set of requirements; generating a visualization of the determined dependencies and test boundaries between the plurality of software requirements in the set of requirements; storing the generated visualization of the determined dependencies and test boundaries between the plurality of software requirements in the set of requirements in a record; and applying the determined dependencies in the record to at least one of (i) optimize test steps in a test procedure and (ii) generate an executable test procedure that exercises external inputs and outputs for the software application.

Abstract: A method and an apparatus for testing software for autonomous vehicles by means of a loop simulation involves hardware in the form of one or more real autonomous vehicles able to carry out autonomous test drives in the real world. In response to a work order given by a user, a check is automatically carried out in order to determine which vehicles, among a plurality of real autonomous vehicles which are able to carry out autonomous test drives on globally distributed test tracks in the real world, are currently available for one or more tests defined in the work order. The performance of the software tests and the test drives is then automatically planned and coordinated.