Abstract: A library model addition engine adds library models to a library knowledge base by defining a template for a library configuration file that conveys information about each library model, custom inputs and code snippets to facilitate library comparison operations, and education content for the library model. The library configuration file template may be automatically filled with extracted data using an iterative sequence of operations to retrieve, scrape, or extract data to automatically populate data fields in a library configuration file template for validation processing to ensure that the file is in the correct format and satisfies the constraints provided by the library recommendation engine.

Abstract: Methods and systems for verifying that logic for implementing a pipelined process in hardware correctly moves data through the pipelined process. The method includes: (a) monitoring data input to the pipelined process to determine when watched data has been input to the pipelined process; (b) in response to determining the watched data has been input to the pipelined process counting a number of progressing clock cycles for the watched data; and (c) evaluating an assertion written in an assertion based language, the assertion establishing that when the watched data is output from the pipelined process the counted number of progressing clock cycles for the watched data should be equal to one of one or more predetermined values.

Abstract: Example methods and systems for software bug reproduction. One example method may comprise obtaining log information associated with multiple transactions processed by a control-plane node to configure a set of data-plane nodes and transform an initial network state to a first network state; and configuring a replay environment that is initialized to the initial network state, and includes a mock control-plane node and a set of mock data-plane nodes. The method may also comprise, based on the log information, replaying the multiple transactions using the mock control-plane node to configure the set of mock data-plane nodes and transform the replay environment from the initial network state to a second network state. Based on a comparison between the first network state and the second network state, a determination may be made as to whether a software bug is successfully reproduced in the replay environment.

Abstract: An information processing apparatus comprises: acquiring a first image including at least a part of an inspection device and a second image including at least a part of a subject; estimating a position of the inspection device based on the first image; estimating position and orientation information for the subject based on the second image; identifying an inspection region of the subject from results of estimating; and receiving a finalization instruction to finalize an inspection result to be recorded or output to an external apparatus based on sequentially acquired inspection results of the subject, and a finalization instruction to finalize inspection region information to be recorded or output to the external apparatus in association with the inspection result, wherein the finalization instruction for the inspection region information is received before the finalization instruction for the inspection result.

Abstract: Vehicular maintenance is predicted using real time telematics data and historical maintenance data. Different statistical models are used, and an intersecting set of results is generated. Environmental weather may also be used to further refine predictions.

Abstract: Disaggregated distributed measurement analysis systems provide a test and measurement automation platform that uses solution workflow metadata to create automation test suites as solutions to be deployed in an automation engine of a test and measurement automation platform. The automation platform provides tools and techniques to develop measurements and deploy solutions in an automation engine without requiring the system to restart. The system enables, by the test and measurement automation platform, a user to develop measurements for the solutions and deploy and execute each of the solutions in the automation engine of the test and measurement automation platform without requiring the solution to compile.

Abstract: Regression test case identification for automated regression testing includes identifying program code file(s) in which changes made to program code of an application are contained, selecting application feature(s) of the application as candidate(s) on which to perform automated regression testing, which selecting includes accessing mappings indicating features implemented by the identified program code files and identifying those features as the selected application feature(s), based on the selected application feature(s), selecting regression test cases to be included in the automated regression testing, and commencing execution of the automated regression testing using the selected regression test cases.

Abstract: Software application dependency trees can be generated and used for white-box testing. In some examples, a method may involve receiving a request to generate a dependency tree for a first software application associated with a computing device. The method may also include identifying a set of software applications also associated with the computing device, each of which the first software application is determined to be dependent upon based on information included in a specification for the first software application. The method may also include receiving, by the computing device with respect to the set of software applications, a corresponding set of dependency trees. The method may further include incorporating each of the dependency trees in the set of dependency trees into the dependency tree for the first software application via a respective incorporation point, and returning the dependency tree for the first software application in response to the request.

Abstract: The disclosed embodiments provide a system for testing machine learning workflows. During operation, the system obtains a configuration for a staging test of a machine learning model, wherein the configuration includes a model name for the machine learning model, a duration of the staging test, and a use case associated with the machine learning model. Next, the system selects a staging test host for the staging test. The system then deploys the staging test on the staging test host in a staging environment, wherein the deployed staging test executes the machine learning model based on live traffic received from a production environment. After the staging test has completed, the system outputs a set of metrics representing a system impact of the machine learning model on the staging test host.

Abstract: A test script is divided into tests having a sequential order within the test script. An analysis tree of the tests can be generated. Each unique path through the analysis tree includes a subset of the tests as sequentially ordered within the test script. A maximally parallel subset of the unique paths that covers all the tests and according to which the tests are successfully executable is identified. Each test appears in only one unique path of the maximally parallel subset.

Abstract: It is possible to make data for manufacturing devices available in a standard format using an adapter that would automatically interrogate the device and use the information gained from the machine to generate a data translation file. The data translation file could subsequently be used by an agent to interpret a data stream provided by the adapter for the manufacturing device.

Abstract: A method including: identifying a set of dependent virtualised network functions included in a first virtual network, the set including at least a virtualised network function to be updated; creating a second virtual network including clones of virtual machines implementing the dependent virtualised network functions of the set; interconnecting, in the second virtual network, clones of the dependent virtualised network functions, identically to an interconnection in the first network of dependent virtualised network functions; identifying an input data packet of the dependent virtualised network functions, duplicating the packet and sending the duplicated packet to the second network; applying a patch to the clone of the virtualised network function to be updated in the second network; triggering an alert when a performance value of a dependent virtualised network function of the first virtual network differs from a performance value on the clone of the virtualised network function in the second network.

Abstract: A computer-implemented method according to one embodiment includes simulating, for a predetermined time period, output of a first task that periodically runs within a system to create a simulated output, comparing the simulated output to actual output of the first task for the predetermined time period, and generating an alert in response to determining that the simulated output does not match the actual output for the predetermined time period.

Abstract: The present invention generally relates to system test, and more specifically, related to online system test. In an aspect, a computer-implemented method for online system test is provided. In this method, a test rule for testing the online system is obtained. And a test result from a real user action of the online system based on the test rule will be retrieved. And a test report is generated at least based on the test result from the real user action.

Abstract: A method includes generating on a host machine a validated verification test scenario comprising a graph defining a scheduled performance order of a plurality of actions to be performed on a DUT and a corresponding verification environment; obtaining a subset of one or more actions to be added to the validated scenario while maintaining the plurality of actions of the validated scenario and the scheduled performance order, forming an amended verification test scenario; and applying a runtime solver in a target language of the DUT and the corresponding verification environment on the amended verification test scenario to generate a test in a target code and to apply the test on the DUT and the corresponding verification environment wherein inclusion of any of said one or more actions or an order of performance of said one or more actions of the subset in the test is determined at runtime.

Abstract: A method, computer program product, and a computer system are disclosed for processing information in a processor that in one or more embodiments includes generating workload information of a performance base test; determining characteristics of the workload information; determining one or more constraints that can cause behavioral changes to a design of the processor; combining the determined characteristics and the determined one or more constraints to generate one or more example constraints; testing the one or more example constraints in one or more example performance tests; and generating one or more performance benchmarks for the performance base test and the one or more example performance tests.

Abstract: A hybrid electronic system including an emulator side including a processor and a first clock, a simulated side including one or more models to simulate one or more prototypes and a second clock, a first interface to the emulator side, and a second interface to the simulated side is disclosed. The processor is configured to determine using the first interface a first amount of time corresponding to an amount of time advanced on the emulator side by the first clock. The processor is configured to determine using the second interface a second amount of time corresponding to an amount of time advanced on the simulated side by the second clock, and set a value of a clock frequency of the second clock based on an initial value of the clock frequency of the second clock and a ratio of the first amount of time to the second amount of time.

Abstract: A simulation model recovery method, system, and computer program product include initiating a simulation model, during an operation of a model, periodically writing a solution space of the model to a checkpoint restart file, during an operation of the model, periodically writing diagnostic information on model progression to a log file, detecting a failure of the model, based on the log of the model, determining a time of the failure, based on the model outputs and restart files, determining a period of a numerical instability preceding the failure, selecting a checkpoint of the model preceding the period of the numerical instability, based on the numerical instability and diagnostic information in log files, modifying a configuration of the model, and restarting the model based on the selected checkpoint and the modified configuration.

Abstract: Methods, apparatus, and processor-readable storage media for regression testing using automation technologies are provided herein. An example computer-implemented method includes generating application programming interfaces related to regression testing; obtaining user input, via at least one user interface, pertaining to at least one regression testing test case; selecting at least one of the application programming interfaces based at least in part on the user input; generating at least one regression testing automation tool using the at least one selected application programming interface and at least a portion of one or more software testing automation technologies; and performing one or more automated actions utilizing the at least one generated regression testing automation tool.

Abstract: A test apparatus for characterizing a device under test includes a test case generator, a test unit, a data storage unit, and a data analysis unit. The test case generator is configured to randomly generate a plurality of test cases, which include values of one or more input variables of a set of input variables. The test unit is configured to perform the plurality of test cases on the device under test. The data storage unit may store sets of test data, which are associated to the test cases and include values of input variables of a respective test case and corresponding values of output variables of the device under test related to the respective test case. The data analysis unit may further analyze the test data and is further configured to determine dependencies within a subset of variables of the test data to characterize the device under test.

Abstract: A new snapshot of a storage volume is created by instructing computing nodes to suppress write requests. Once pending write requests from the computing nodes are completed, storage nodes create a new snapshot for the storage volume by allocating a new segment to the new snapshot and finalizes and performs garbage collection with respect to segments allocated to the previous snapshot. An orchestration layer implements a bundled application that is provisioned with virtualized storage and computation resources. A snapshot of the bundled application may be created and used to rollback or clone the application. Clones snapshots of storage volumes may be gradually populated with data from prior snapshots to reduce loading on a primary snapshot. Chaos testing of the bundled application may be performed and storage volumes may be created, expanded, and/or moved based on usage of the bundled application.

Abstract: Described herein is a computer implemented method. The method comprises receiving, by an issue tracking system, a deployment update from a deployment system which includes deployment information in respect of one or more issues maintained by the issue tracking system. The method further comprises associating one or more issues maintained by the issue tracking system with deployment information by identifying the one or more issues to which the deployment information in the deployment update relates, extracting the deployment information from the deployment update, and associating the deployment information with each of the identified issues.

Abstract: A data analysis system processes data generated by instrumented software. The data analysis system receives data streams generated by instances of instrumented software executing on systems. The data analysis system also receives metadata describing data streams. The data analysis system receives an expression based on the metadata. The data analysis system receives data of data streams for each time interval and computes the result of the expression based on the received data values. The data analysis system repeats these steps for each time interval. The data analysis system may quantize data values of data streams for each time interval by generating an aggregate value for the time interval based on data received for each data stream for that time interval. The data analysis system evaluates the expression using the quantized data for the time interval.

Abstract: Performing a mirror test for localization testing includes executing a mirror test, the mirror test includes an execution of actions on target controls on a master device and mimicking the actions on the target controls on a number of slave devices for localization testing, identifying the target controls on the number of slave devices to mimic the execution of the actions on the target controls of the master device, capturing at least one screenshot of the mirror test, and displaying the at least one screenshot to a user.

Abstract: Embodiments include apparatuses, methods, and systems for computer assisted or autonomous driving. An apparatus may include a storage and a safety operation controller disposed in a computer assisted or autonomous driving vehicle. The storage may store a safety operation configuration and a list of safety operations to be performed on one or more device components. The safety operation configuration and the list of safety operations may be provided by a first party. The safety operation configuration may be used to configure selected ones of the list of safety operations by a second party different from the first party to obtain configured safety operations to be performed on the one or more device components. The safety operation controller may perform the configured safety operations on the one or more device components. Other embodiments may also be described and claimed.

Abstract: The purpose of the present invention is to decrease the time required to create fault injection test data when performing an ECU simulation test. An ECU simulation device according to the present invention is provided with a database in which fault modes are defined for each type of circuit element, reads out, from the database, fault modes for each circuit element provided in an ECU, and generates a test pattern for each of the fault modes.

Abstract: Methods, systems, and devices for spare substitution in a memory system are described. A controller may, as part of a background operation, assign a spare bit to replace a bit of a code word and save an indication of the spare bit assignment in a memory array. The code word may include a set of bits that each correspond to a respective Minimum Substitution Region (MSR) within a memory medium that retains the code word. An MSR corresponding to the bit to be replaced may include a quantity of erroneous bits relative to a threshold. The controller may, during a read operation, identify the spare bit in a first portion of the code word, determine the bit to be replaced based on accessing the memory array, and replace the bit with the spare bit concurrently with receiving a second portion of the code word.

Abstract: A distributed key-value database management system may provide transactions having a high degree of conformance to ACID properties. A data element may be maintained as a versioned list, where each entry may comprise a timestamp and a value indicative of a corresponding version of the data element. The timestamp may be based at least in part on a vended time value. Timestamps may be monotonically increasing and unique across all entries in a distributed system. Conflicting updates to a data element may be detected directly, prior to the completion of involved transactions.

Abstract: Systems, methods, and computer-readable media are described for performing revision control for a System Under Test (SUT) such as a body of source code. Prior to committing code changes, a collection of breakpoints associated with the portion(s) of source code being changed are determined. Stored fingerprints corresponding to regression test cases are evaluated to identify a set of stored fingerprints that are cumulatively indicative of the collection of breakpoints. Attributes respectively stored in association with the set of stored fingerprints are determined and a corresponding group of regression test cases are determined. The code changes are committed responsive to successful execution of the selected group of regression test cases.

Abstract: Systems, methods, and computer-readable media are described for generating fingerprints for regression tests that identify code paths taken during execution of the regression tests. Breakpoint values are assigned to breakpoints encountered during execution of a regression test and a fingerprint is generated based on the assigned breakpoint values and a code path taken during execution of the regression test. Various breakpoint value assignment/fingerprint generation algorithms are described herein that generate a fingerprint from which a corresponding code path taken can be reconstructed including which breakpoints are encountered, the number of times each such breakpoint is encountered, and the order in which the breakpoints are encountered.

Abstract: Systems and methods for identifying a location of a fault in an RF transmission system includes characterizing the RF transmission system and selecting one of the stage in the RF transmission system as an initial selected stage. An output of the initial selected stage can be measured in the characterized RF transmission system. The measured output of the initial selected stage is propagated through a baseline RF model and a point of deflection is identified in a resulting RF model of the RF transmission system.

Abstract: Methods and systems for verifying that logic for implementing a pipelined process in hardware correctly moves data through the pipelined process. The method includes: (a) monitoring data input to the pipelined process to determine when watched data has been input to the pipelined process; (b) in response to determining the watched data has been input to the pipelined process counting a number of progressing clock cycles for the watched data; and (c) evaluating an assertion written in an assertion based language, the assertion establishing that when the watched data is output from the pipelined process the counted number of progressing clock cycles for the watched data should be equal to one of one or more predetermined values.

Abstract: Embodiments described herein are directed to computer-implemented methods, systems, and computer program products for regression testing. New techniques for software regression testing are provided in which the regression test scenarios are directly synchronized with the user's system and environment. This can be referred to as a customized-regression-test process. A non-limiting example of a computer-implemented method includes receiving a history log having application data for an application during normal use and generating a regression test scenario for a new version of the application based on a pattern of use of the application. The method further includes determining whether one or more existing regression test scenarios stored in a test scenario data store match the generated regression test scenario and executing a regression test on the new version of the application using the regression test scenario.

Abstract: A simulation of software test program executing upon a primary model of a portion of a data processing apparatus is performed to identify uncovered (undetected) failures. A formal method analysis is then performed upon a combination of the primary model and a fault-simulating model simulating the uncovered failures in order to identify software stimuli that can render the uncovered failures detectable. The identified software stimuli are then added to the software test program to increase the failure coverage. The process is performed iteratively until a desired level of failure coverage is achieved.

Abstract: Integrated circuit failures caused by metastability related to assertion of asynchronous resets frequently escape detection before fabrication, causing design respins and severe economic loss. The numerous reset signals, flip-flops and complex logical interactions inherent in an integrated circuit cause an analysis for reset-metastability failures to be extremely noisy, reporting an unmanageable number of false failures and making early removal of failures impractical. Said noisy reporting arises because many flip-flops where reset-metastability manifests do not necessarily cause overall failure. An effective analysis of reset-metastability failures must identify all potential failures, but also must only report true failure potential. The present invention maximizes noise reduction by applying special conditions to identify flip-flops manifesting reset-metastability without causing integrated circuit failure, which can thereby be deemed safe.

Abstract: The described technology is generally directed towards automated acceptance testing of network functions so that only certified network functions are deployed in a wireless network. When a network function attempts to register in a network, e.g., with a network function repository, the registration attempt triggers a workflow that obtains a result of automated testing of the network function. The automated testing operation can be based on a test suite selected according to the network function type and the network slice in which the network function is to be deployed. Only upon determining that the network function passed the automated testing operation is the network function registered (by the network function repository) for operation in the wireless network.

Abstract: A system, method and computer-readable medium for testing a service-based application identifies a set of use cases for the service-based application. Each use case in the set is mapped to a test case to generate a first set of test cases. Each of the test cases is refined to generate an updated set of test cases and the updated set of test cases is executed.

Abstract: An industrial asset may be associated with a plurality of monitoring nodes, each monitoring node generating a series of monitoring node values over time representing current operation of the industrial asset. An abnormality detection computer may determine that at least one abnormal monitoring node is currently being attacked or experiencing a fault. A virtual sensing estimator may continuously execute an adaptive learning process to create or update virtual sensor models for the monitoring nodes. Responsive to an indication that a monitoring node is currently being attacked or experiencing a fault, the virtual sensing estimator may be dynamically reconfigured to estimate a series of virtual node values for the abnormal monitoring node or nodes based on information from normal monitoring nodes and appropriate virtual sensor models. The series of monitoring node values from the abnormal monitoring node or nodes may then be replaced with the virtual node values.

Abstract: A dynamic cloud stack testing system comprises a cloud network with cloud components and a cloud stack server coupled to the network. The server includes an interface, a memory, a cloud stack configuration engine, and a cloud stack testing engine. The interface receives a cloud stack request from a user device that includes functionality parameters. The memory stores historic cloud stack combinations. The cloud stack configuration engine identifies cloud components associated with the functionality parameters and determines a cloud stack configuration that incorporates them. The cloud stack testing engine determines a cloud stack configuration test. The cloud stack testing engine executes the test, and stores results and the associated cloud stack configuration in the memory.

Abstract: A library model addition engine adds library models to a library knowledge base by defining a template for a library configuration file that conveys information about each library model, custom inputs and code snippets to facilitate library comparison operations, and education content for the library model, where the library configuration file template may be automatically filled by populating selected data fields in the template with information identifying the library model, scraping documentation pages to extract test cases, and then scraping test case code to extract the test case input parameters for input to an input/output matching engine to evaluate a repository of code snippets and identify a set of functionally similar code snippets for inclusion one or more data fields in the template.

Abstract: Techniques for debugging of a collection of instructions executed by a computing system including a set of actors are described herein. A first sub-set of actors from the set of actors to be monitored for debugging and one or more error condition associated with the collection of instructions may be identified. A set of indications including indications of messages processed by the actors, indications of associated actor states prior to processing of the messages, and indications of associated actor states subsequent to processing of the messages may be received from the sub-set of actors. It may then be determined that a first actor of the sub-set of actors has satisfied the error condition. Based at least in part on the set of indications, one or more messages associated with satisfaction of the error condition may then be identified, for example for re-processing and debugging.

Abstract: Disclosed herein are methods, systems, and processes to generate and perform parallelizable data-driven single instruction multiple data (SIMD) tests. A base abstract class that defines shared testing parameters for tests to be performed on an application is designated. Inheriting classes of the base abstract class are defined and a data source key is derived from the inhering classes. A test data source is accessed to perform the tests on the application and a result of tests is generated based on the data source key.

Abstract: A method and apparatus are provided for enhancing operable testing functionality for program code by mutating a code segment in a received program code to generate a mutated code segment, by monitoring execution of a test suite against the mutated code segment to detect a surviving mutation, and by evaluating the surviving mutation against the test suite to identify a first test case to blame for the surviving mutation by analyzing a coverage of the plurality of test cases in the test suite for the surviving mutation to identify one or more test cases from the test suite which cover the surviving mutation and then select the first test case which meets one or more predetermined selection criteria.

Abstract: According to an aspect of an embodiment, operations may include determining a plurality of event correspondences. Each event correspondence may indicate a correspondence between a respective change of a plurality of changes made to first source code of a first software program and a respective event type that occurs with respect to the first software program. The plurality of event correspondences may be determined by performing two or more event type inference operations of a plurality of event type inference operations. The plurality of event type inference operations may include determining a fault introduction event, determining a fault correction event, determining a defect introduction event, determining a defect correction event, and determining a platform migration event.

Abstract: Embodiments disclose systems and methods for testing and determining outages of communication systems. A server can receive signal-reception-related information from set-top boxes (STBs) in a particular geographical region, where a STB: receives signals having a predefined pattern, generates a comparison of the predefined pattern to reference patterns stored on the STB, generates the signal-reception-related information based on the comparison, and sends the signal-reception-related information. The server can determine an outage status for the particular geographical region based on the signal-reception-related information. The server can generate an output based on the outage status. The output is configured to provide information related to the outage status of the particular geographical region and information for possible responses related to the outage status. The server can send the output.

Abstract: An apparatus, including: a deterministic monitored device; an interconnect to communicatively couple the monitored device to a support circuit; a super queue to queue transactions between the monitored device and the support circuit, the super queue including an operational segment and a shadow segment; a debug data structure; and a system management agent to monitor transactions in the operational segment, log corresponding transaction identifiers in the shadow segment, and write debug data to the debug data structure, wherein the debug data are at least partly based on the corresponding transaction identifiers.

Abstract: Exemplary methods, apparatuses, and systems include receiving time series data for each of a plurality of performance metrics. The time series data is sorted into buckets based upon an amount of variation of time series data values for each performance metric. The time series data in each bucket is divided into first and second clusters of time series data points. The bucket having the greatest distance between clusters is used to determine a performance metric having a greatest distance between clusters. The performance metric having the greatest distance between clusters is reported as a potential root cause of a performance issue.

Abstract: Analysis of system information includes retrieving selected snapshots comprising the system information to be analyzed. Further, one or more operations can be performed on the system information to extract resultant information. The resultant information can be provided over a graphical user interface to a user.

Abstract: A data analysis system processes data generated by instrumented software. The data analysis system receives data streams generated by instances of instrumented software executing on systems. The data analysis system also receives metadata describing data streams. The data analysis system receives an expression based on the metadata. The data analysis system receives data of data streams for each time interval and computes the result of the expression based on the received data values. The data analysis system repeats these steps for each time interval. The data analysis system may quantize data values of data streams for each time interval by generating an aggregate value for the time interval based on data received for each data stream for that time interval. The data analysis system evaluates the expression using the quantized data for the time interval.

Abstract: Simulating a circuit design can include detecting, using a processor, an assignment for a signal of a circuit design during a delta cycle of a simulation of the circuit design and comparing, using the processor, a range of the assignment for the signal with a range of an existing event for the signal for the delta cycle. In response to determining that the range of the assignment for the signal and the range of the existing event meet a condition, the existing event is updated, using the processor, resulting in a merged event. The merged event is scheduled for execution for the delta cycle using the processor.