Abstract: Methods, apparatus, and processor-readable storage media for regression testing using automation technologies are provided herein. An example computer-implemented method includes generating application programming interfaces related to regression testing; obtaining user input, via at least one user interface, pertaining to at least one regression testing test case; selecting at least one of the application programming interfaces based at least in part on the user input; generating at least one regression testing automation tool using the at least one selected application programming interface and at least a portion of one or more software testing automation technologies; and performing one or more automated actions utilizing the at least one generated regression testing automation tool.

Abstract: A new snapshot of a storage volume is created by instructing computing nodes to suppress write requests. Once pending write requests from the computing nodes are completed, storage nodes create a new snapshot for the storage volume by allocating a new segment to the new snapshot and finalizes and performs garbage collection with respect to segments allocated to the previous snapshot. An orchestration layer implements a bundled application that is provisioned with virtualized storage and computation resources. A snapshot of the bundled application may be created and used to rollback or clone the application. Clones snapshots of storage volumes may be gradually populated with data from prior snapshots to reduce loading on a primary snapshot. Chaos testing of the bundled application may be performed and storage volumes may be created, expanded, and/or moved based on usage of the bundled application.

Abstract: A test apparatus for characterizing a device under test includes a test case generator, a test unit, a data storage unit, and a data analysis unit. The test case generator is configured to randomly generate a plurality of test cases, which include values of one or more input variables of a set of input variables. The test unit is configured to perform the plurality of test cases on the device under test. The data storage unit may store sets of test data, which are associated to the test cases and include values of input variables of a respective test case and corresponding values of output variables of the device under test related to the respective test case. The data analysis unit may further analyze the test data and is further configured to determine dependencies within a subset of variables of the test data to characterize the device under test.

Abstract: Described herein is a computer implemented method. The method comprises receiving, by an issue tracking system, a deployment update from a deployment system which includes deployment information in respect of one or more issues maintained by the issue tracking system. The method further comprises associating one or more issues maintained by the issue tracking system with deployment information by identifying the one or more issues to which the deployment information in the deployment update relates, extracting the deployment information from the deployment update, and associating the deployment information with each of the identified issues.

Abstract: A data analysis system processes data generated by instrumented software. The data analysis system receives data streams generated by instances of instrumented software executing on systems. The data analysis system also receives metadata describing data streams. The data analysis system receives an expression based on the metadata. The data analysis system receives data of data streams for each time interval and computes the result of the expression based on the received data values. The data analysis system repeats these steps for each time interval. The data analysis system may quantize data values of data streams for each time interval by generating an aggregate value for the time interval based on data received for each data stream for that time interval. The data analysis system evaluates the expression using the quantized data for the time interval.

Abstract: Performing a mirror test for localization testing includes executing a mirror test, the mirror test includes an execution of actions on target controls on a master device and mimicking the actions on the target controls on a number of slave devices for localization testing, identifying the target controls on the number of slave devices to mimic the execution of the actions on the target controls of the master device, capturing at least one screenshot of the mirror test, and displaying the at least one screenshot to a user.

Abstract: Embodiments include apparatuses, methods, and systems for computer assisted or autonomous driving. An apparatus may include a storage and a safety operation controller disposed in a computer assisted or autonomous driving vehicle. The storage may store a safety operation configuration and a list of safety operations to be performed on one or more device components. The safety operation configuration and the list of safety operations may be provided by a first party. The safety operation configuration may be used to configure selected ones of the list of safety operations by a second party different from the first party to obtain configured safety operations to be performed on the one or more device components. The safety operation controller may perform the configured safety operations on the one or more device components. Other embodiments may also be described and claimed.

Abstract: The purpose of the present invention is to decrease the time required to create fault injection test data when performing an ECU simulation test. An ECU simulation device according to the present invention is provided with a database in which fault modes are defined for each type of circuit element, reads out, from the database, fault modes for each circuit element provided in an ECU, and generates a test pattern for each of the fault modes.

Abstract: Methods, systems, and devices for spare substitution in a memory system are described. A controller may, as part of a background operation, assign a spare bit to replace a bit of a code word and save an indication of the spare bit assignment in a memory array. The code word may include a set of bits that each correspond to a respective Minimum Substitution Region (MSR) within a memory medium that retains the code word. An MSR corresponding to the bit to be replaced may include a quantity of erroneous bits relative to a threshold. The controller may, during a read operation, identify the spare bit in a first portion of the code word, determine the bit to be replaced based on accessing the memory array, and replace the bit with the spare bit concurrently with receiving a second portion of the code word.

Abstract: A distributed key-value database management system may provide transactions having a high degree of conformance to ACID properties. A data element may be maintained as a versioned list, where each entry may comprise a timestamp and a value indicative of a corresponding version of the data element. The timestamp may be based at least in part on a vended time value. Timestamps may be monotonically increasing and unique across all entries in a distributed system. Conflicting updates to a data element may be detected directly, prior to the completion of involved transactions.

Abstract: Systems, methods, and computer-readable media are described for performing revision control for a System Under Test (SUT) such as a body of source code. Prior to committing code changes, a collection of breakpoints associated with the portion(s) of source code being changed are determined. Stored fingerprints corresponding to regression test cases are evaluated to identify a set of stored fingerprints that are cumulatively indicative of the collection of breakpoints. Attributes respectively stored in association with the set of stored fingerprints are determined and a corresponding group of regression test cases are determined. The code changes are committed responsive to successful execution of the selected group of regression test cases.

Abstract: Systems, methods, and computer-readable media are described for generating fingerprints for regression tests that identify code paths taken during execution of the regression tests. Breakpoint values are assigned to breakpoints encountered during execution of a regression test and a fingerprint is generated based on the assigned breakpoint values and a code path taken during execution of the regression test. Various breakpoint value assignment/fingerprint generation algorithms are described herein that generate a fingerprint from which a corresponding code path taken can be reconstructed including which breakpoints are encountered, the number of times each such breakpoint is encountered, and the order in which the breakpoints are encountered.

Abstract: Methods and systems for verifying that logic for implementing a pipelined process in hardware correctly moves data through the pipelined process. The method includes: (a) monitoring data input to the pipelined process to determine when watched data has been input to the pipelined process; (b) in response to determining the watched data has been input to the pipelined process counting a number of progressing clock cycles for the watched data; and (c) evaluating an assertion written in an assertion based language, the assertion establishing that when the watched data is output from the pipelined process the counted number of progressing clock cycles for the watched data should be equal to one of one or more predetermined values.

Abstract: Systems and methods for identifying a location of a fault in an RF transmission system includes characterizing the RF transmission system and selecting one of the stage in the RF transmission system as an initial selected stage. An output of the initial selected stage can be measured in the characterized RF transmission system. The measured output of the initial selected stage is propagated through a baseline RF model and a point of deflection is identified in a resulting RF model of the RF transmission system.

Abstract: Embodiments described herein are directed to computer-implemented methods, systems, and computer program products for regression testing. New techniques for software regression testing are provided in which the regression test scenarios are directly synchronized with the user's system and environment. This can be referred to as a customized-regression-test process. A non-limiting example of a computer-implemented method includes receiving a history log having application data for an application during normal use and generating a regression test scenario for a new version of the application based on a pattern of use of the application. The method further includes determining whether one or more existing regression test scenarios stored in a test scenario data store match the generated regression test scenario and executing a regression test on the new version of the application using the regression test scenario.

Abstract: Integrated circuit failures caused by metastability related to assertion of asynchronous resets frequently escape detection before fabrication, causing design respins and severe economic loss. The numerous reset signals, flip-flops and complex logical interactions inherent in an integrated circuit cause an analysis for reset-metastability failures to be extremely noisy, reporting an unmanageable number of false failures and making early removal of failures impractical. Said noisy reporting arises because many flip-flops where reset-metastability manifests do not necessarily cause overall failure. An effective analysis of reset-metastability failures must identify all potential failures, but also must only report true failure potential. The present invention maximizes noise reduction by applying special conditions to identify flip-flops manifesting reset-metastability without causing integrated circuit failure, which can thereby be deemed safe.

Abstract: A simulation of software test program executing upon a primary model of a portion of a data processing apparatus is performed to identify uncovered (undetected) failures. A formal method analysis is then performed upon a combination of the primary model and a fault-simulating model simulating the uncovered failures in order to identify software stimuli that can render the uncovered failures detectable. The identified software stimuli are then added to the software test program to increase the failure coverage. The process is performed iteratively until a desired level of failure coverage is achieved.

Abstract: The described technology is generally directed towards automated acceptance testing of network functions so that only certified network functions are deployed in a wireless network. When a network function attempts to register in a network, e.g., with a network function repository, the registration attempt triggers a workflow that obtains a result of automated testing of the network function. The automated testing operation can be based on a test suite selected according to the network function type and the network slice in which the network function is to be deployed. Only upon determining that the network function passed the automated testing operation is the network function registered (by the network function repository) for operation in the wireless network.

Abstract: A system, method and computer-readable medium for testing a service-based application identifies a set of use cases for the service-based application. Each use case in the set is mapped to a test case to generate a first set of test cases. Each of the test cases is refined to generate an updated set of test cases and the updated set of test cases is executed.

Abstract: An industrial asset may be associated with a plurality of monitoring nodes, each monitoring node generating a series of monitoring node values over time representing current operation of the industrial asset. An abnormality detection computer may determine that at least one abnormal monitoring node is currently being attacked or experiencing a fault. A virtual sensing estimator may continuously execute an adaptive learning process to create or update virtual sensor models for the monitoring nodes. Responsive to an indication that a monitoring node is currently being attacked or experiencing a fault, the virtual sensing estimator may be dynamically reconfigured to estimate a series of virtual node values for the abnormal monitoring node or nodes based on information from normal monitoring nodes and appropriate virtual sensor models. The series of monitoring node values from the abnormal monitoring node or nodes may then be replaced with the virtual node values.

Abstract: A dynamic cloud stack testing system comprises a cloud network with cloud components and a cloud stack server coupled to the network. The server includes an interface, a memory, a cloud stack configuration engine, and a cloud stack testing engine. The interface receives a cloud stack request from a user device that includes functionality parameters. The memory stores historic cloud stack combinations. The cloud stack configuration engine identifies cloud components associated with the functionality parameters and determines a cloud stack configuration that incorporates them. The cloud stack testing engine determines a cloud stack configuration test. The cloud stack testing engine executes the test, and stores results and the associated cloud stack configuration in the memory.

Abstract: A library model addition engine adds library models to a library knowledge base by defining a template for a library configuration file that conveys information about each library model, custom inputs and code snippets to facilitate library comparison operations, and education content for the library model, where the library configuration file template may be automatically filled by populating selected data fields in the template with information identifying the library model, scraping documentation pages to extract test cases, and then scraping test case code to extract the test case input parameters for input to an input/output matching engine to evaluate a repository of code snippets and identify a set of functionally similar code snippets for inclusion one or more data fields in the template.

Abstract: Techniques for debugging of a collection of instructions executed by a computing system including a set of actors are described herein. A first sub-set of actors from the set of actors to be monitored for debugging and one or more error condition associated with the collection of instructions may be identified. A set of indications including indications of messages processed by the actors, indications of associated actor states prior to processing of the messages, and indications of associated actor states subsequent to processing of the messages may be received from the sub-set of actors. It may then be determined that a first actor of the sub-set of actors has satisfied the error condition. Based at least in part on the set of indications, one or more messages associated with satisfaction of the error condition may then be identified, for example for re-processing and debugging.

Abstract: Disclosed herein are methods, systems, and processes to generate and perform parallelizable data-driven single instruction multiple data (SIMD) tests. A base abstract class that defines shared testing parameters for tests to be performed on an application is designated. Inheriting classes of the base abstract class are defined and a data source key is derived from the inhering classes. A test data source is accessed to perform the tests on the application and a result of tests is generated based on the data source key.

Abstract: According to an aspect of an embodiment, operations may include determining a plurality of event correspondences. Each event correspondence may indicate a correspondence between a respective change of a plurality of changes made to first source code of a first software program and a respective event type that occurs with respect to the first software program. The plurality of event correspondences may be determined by performing two or more event type inference operations of a plurality of event type inference operations. The plurality of event type inference operations may include determining a fault introduction event, determining a fault correction event, determining a defect introduction event, determining a defect correction event, and determining a platform migration event.

Abstract: A method and apparatus are provided for enhancing operable testing functionality for program code by mutating a code segment in a received program code to generate a mutated code segment, by monitoring execution of a test suite against the mutated code segment to detect a surviving mutation, and by evaluating the surviving mutation against the test suite to identify a first test case to blame for the surviving mutation by analyzing a coverage of the plurality of test cases in the test suite for the surviving mutation to identify one or more test cases from the test suite which cover the surviving mutation and then select the first test case which meets one or more predetermined selection criteria.

Abstract: An apparatus, including: a deterministic monitored device; an interconnect to communicatively couple the monitored device to a support circuit; a super queue to queue transactions between the monitored device and the support circuit, the super queue including an operational segment and a shadow segment; a debug data structure; and a system management agent to monitor transactions in the operational segment, log corresponding transaction identifiers in the shadow segment, and write debug data to the debug data structure, wherein the debug data are at least partly based on the corresponding transaction identifiers.

Abstract: Embodiments disclose systems and methods for testing and determining outages of communication systems. A server can receive signal-reception-related information from set-top boxes (STBs) in a particular geographical region, where a STB: receives signals having a predefined pattern, generates a comparison of the predefined pattern to reference patterns stored on the STB, generates the signal-reception-related information based on the comparison, and sends the signal-reception-related information. The server can determine an outage status for the particular geographical region based on the signal-reception-related information. The server can generate an output based on the outage status. The output is configured to provide information related to the outage status of the particular geographical region and information for possible responses related to the outage status. The server can send the output.

Abstract: Exemplary methods, apparatuses, and systems include receiving time series data for each of a plurality of performance metrics. The time series data is sorted into buckets based upon an amount of variation of time series data values for each performance metric. The time series data in each bucket is divided into first and second clusters of time series data points. The bucket having the greatest distance between clusters is used to determine a performance metric having a greatest distance between clusters. The performance metric having the greatest distance between clusters is reported as a potential root cause of a performance issue.

Abstract: Analysis of system information includes retrieving selected snapshots comprising the system information to be analyzed. Further, one or more operations can be performed on the system information to extract resultant information. The resultant information can be provided over a graphical user interface to a user.

Abstract: Simulating a circuit design can include detecting, using a processor, an assignment for a signal of a circuit design during a delta cycle of a simulation of the circuit design and comparing, using the processor, a range of the assignment for the signal with a range of an existing event for the signal for the delta cycle. In response to determining that the range of the assignment for the signal and the range of the existing event meet a condition, the existing event is updated, using the processor, resulting in a merged event. The merged event is scheduled for execution for the delta cycle using the processor.

Abstract: A data analysis system processes data generated by instrumented software. The data analysis system receives data streams generated by instances of instrumented software executing on systems. The data analysis system also receives metadata describing data streams. The data analysis system receives an expression based on the metadata. The data analysis system receives data of data streams for each time interval and computes the result of the expression based on the received data values. The data analysis system repeats these steps for each time interval. The data analysis system may quantize data values of data streams for each time interval by generating an aggregate value for the time interval based on data received for each data stream for that time interval. The data analysis system evaluates the expression using the quantized data for the time interval.

Abstract: An instrumentation analysis system processes data streams by executing instructions specified using a data stream language program. The data stream language allows users to specify a search condition using a find block for identifying the set of data streams processed by the data stream language program. The set of identified data streams may change dynamically. The data stream language allows users to group data streams into sets of data streams based on distinct values of one or more metadata attributes associated with the input data streams. The data stream language allows users to specify a threshold block for determining whether data values of input data streams are outside boundaries specified using low/high thresholds. The elements of the set of data streams input to the threshold block can dynamically change. The low/high threshold values can be specified as data streams and can dynamically change.

Abstract: A data analysis system processes data generated by instrumented software. The data analysis system receives data streams generated by instances of instrumented software executing on systems. The data analysis system also receives metadata describing data streams. The data analysis system receives an expression based on the metadata. The data analysis system receives data of data streams for each time interval and computes the result of the expression based on the received data values. The data analysis system repeats these steps for each time interval. The data analysis system may quantize data values of data streams for each time interval by generating an aggregate value for the time interval based on data received for each data stream for that time interval. The data analysis system evaluates the expression using the quantized data for the time interval.

Abstract: A device receives test parameters associated with testing an application that utilizes source data, and causes source containers, for the source data, to be temporarily created in a cloud computing environment, based on the test parameters. The device provides the source data to the source containers in the cloud computing environment, and causes other containers, for the application, to be temporarily created in the cloud computing environment, based on the test parameters. The device creates a file for testing the application with the source containers and the other containers, based on the test parameters, and causes the application to be executed with the source containers and the other containers, based on the file. The device receives results associated with executing the application with the source containers and the other containers.

Abstract: A data analysis system processes data generated by instrumented software. The data analysis system receives data streams generated by instances of instrumented software executing on systems. The data analysis system also receives metadata describing data streams. The data analysis system receives an expression based on the metadata. The data analysis system receives data of data streams for each time interval and computes the result of the expression based on the received data values. The data analysis system repeats these steps for each time interval. The data analysis system may quantize data values of data streams for each time interval by generating an aggregate value for the time interval based on data received for each data stream for that time interval. The data analysis system evaluates the expression using the quantized data for the time interval.

Abstract: An improved method, system, and computer program product to perform post-layout simulation of an electronic design is provided. According to one approach, a circuit design is divided into multiple partitions for simulation. Simulation is then performed using the established partitions and results are obtained for the different partitions. When any layout editing occurs, identification can be made of any partitions that have been affected by the editing. The affected partitions are re-processed for simulation. The unaffected partitions do not necessarily need to be reprocessed.

Abstract: The disclosure provides a method for detection of an uninitialized variable. The method includes running a first function, wherein the first function comprises a local variable and a first flag associated with the local variable for indicating an initialization state of the local variable; calling a second function from the first function, with the local variable as a parameter of the second function, wherein the second function comprises a second flag associated with the parameter for indicating an initialization state of the parameter; and updating the first flag based at least on the second flag returned from the second function.

Abstract: The present disclosure relates to a method and device for automatically generating test data for testing software applications. In one embodiment, a plurality of test cases associated with test scenarios is determined by analyzing requirements of the software applications. The plurality of test cases is then processed to generate a plurality of test data scripts that are further executed on a first data source to obtain the test data. If it is determined that the execution of the plurality of test cases fail, then the plurality of test data scripts is executed on a second data source to obtain the test data. The first data source is then updated with the test data obtained for future test data requirements. Thus, the technology enables automatic generation of test data obtained from external data sources and thereby improving the testing efficiency and quality of the applications being tested.

Abstract: Methods and systems for verifying that logic for implementing a pipelined process in hardware correctly moves data through the pipelined process. The method includes: (a) monitoring data input to the pipelined process to determine when watched data has been input to the pipelined process; (b) in response to determining the watched data has been input to the pipelined process counting a number of progressing clock cycles for the watched data; and (c) evaluating an assertion written in an assertion based language, the assertion establishing that when the watched data is output from the pipelined process the counted number of progressing clock cycles for the watched data should be equal to one of one or more predetermined values.

Abstract: Error checking for a computer processor design under test. In multiple processing threads, and in accordance with a hardware model of a computer processor design under test, the instructions of multiple instruction sequences corresponding to the processing threads are processed, thereby resulting in an order in which the instructions are processed in accordance with the hardware model, and producing an actual result for each of the instructions. An expected result is determined for any of the instructions in accordance with a reference model of the computer processor design under test and in accordance with the order in which the instructions were processed in accordance with the hardware model. Any of the instructions whose expected result and actual result differ are identified.

Abstract: Verifying architectural compliance of a processor core using processor-sparing functions. A simulation of a model for a register-transfer level design of the processor core is performed. A first state of the model is dumped, when no error exists. An error is injected in the model. A second state of the model is dumped, after the injected error is detected in the simulation. Upon dumping the second state, the model is reset and initialized with the first state. State information of the second state is loaded in the reset and initialized model.

Abstract: A transaction evaluation system may include a configurable and/or scalable transaction rate input model which models historical and/or recent transaction input rate patterns of a transaction processing system for a specified time period with configurable and/or scalable transactional amplitude for use in evaluating performance of the transaction processing system. The system may operate to inject particular volumes of transactions into the transaction processing system at specific times and/or periods of time.

Abstract: For monitoring diagnostic rules of a power system, an exemplary method is disclosed and includes collecting operational diagnostic data from a first primary device; identifying a change of a diagnostic indicator based on the operational diagnostic data; adapting a diagnostic rule to the identified change, wherein the diagnostic rule is applicable to the diagnostic data for determining a diagnostic warning which indicates a diagnostic state of a primary device; and providing a diagnostic warning of a second primary device by applying the adapted diagnostic rule to operational diagnostic data collected for the second primary device.

Abstract: An analysis apparatus compares first code describing a plurality of first components with second code describing a plurality of second components, to extract difference components. The analysis apparatus sends a plurality of requests to an execution apparatus on which the plurality of second components are deployed, obtains first log information indicating the execution state of each difference component, and specifies relevant requests related to the execution of the difference components. The analysis apparatus sends the specified relevant requests to the execution apparatus and obtains second log information indicating the execution state of each of the plurality of second components. The analysis apparatus generates path information about second components executed in response to each relevant request among the plurality of second components, on the basis of the second log information.

Abstract: The disclosure provides a method for detection of an uninitialized variable. The method includes running a first function, wherein the first function comprises a local variable and a first flag associated with the local variable for indicating an initialization state of the local variable; calling a second function from the first function, with the local variable as a parameter of the second function, wherein the second function comprises a second flag associated with the parameter for indicating an initialization state of the parameter; and updating the first flag based at least on the second flag returned from the second function.

Abstract: A method and associated system for testing a virtual network function by a virtual network tester, wherein a predefined certification context specification specifies services based on the virtual network function in form of different usage patterns, and wherein a predefined test case selection matrix specifies applicable test cases for each usage pattern. In response to selecting a usage pattern from the different sage patterns, the applicable test cases are determined from the test case selection matrix and control parameters of the test case selection matrix based on the selected usage pattern.

Abstract: A selection of a plurality of graphical user interface (GUI) components of a GUI is received. The selection is received so that the GUI can be tested. Attributes of the selection of GUI components are determined. Using the attributes, a default procedure for testing the GUI is determined. The default procedure includes a first set of input values for GUI components of the plurality of GUI components. The default procedure includes a first sequence in which the first set of input values are provided. Modifications to the default procedure are received. Using the modifications, a final procedure with a second set of input values provided in a sequence is generated. The GUI is tested with the final procedure. Testing the GUI includes providing the second set of input values to respective GUI components in the second sequence.

Abstract: A measurement system of a data transmission interface includes a signal generator and a signal receiver. The signal generator transmits an input data to the data transmission interface. The signal receiver receives an output data from the data transmission interface. The signal receiver measures a jitter tolerance capability of the data transmission interface according to error feedback data of the output data. The data transmission interface includes a receiving circuit, a synchronous circuit, and a transmitting circuit. The receiving circuit receives the input data and generates an error signal when a data error occurs. The synchronous circuit receives the error signal to generate an error indication signal. The transmitting circuit transmits the output data to the signal receiver and receives the error indication signal when the data error occurs, in order to generate the error feedback data in the output data according to the error indication signal.

Abstract: A device receives test parameters associated with testing an application that utilizes source data, and causes source containers, for the source data, to be temporarily created in a cloud computing environment, based on the test parameters. The device provides the source data to the source containers in the cloud computing environment, and causes other containers, for the application, to be temporarily created in the cloud computing environment, based on the test parameters. The device creates a file for testing the application with the source containers and the other containers, based on the test parameters, and causes the application to be executed with the source containers and the other containers, based on the file. The device receives results associated with executing the application with the source containers and the other containers.