Abstract: Provided is a method for automated verification of a software program in a Behavior-Driven Development environment and a data processing system configured to execute such a method. Individual test steps of BDD test scenarios are first matched and then assigned to existing test step definitions from a BDD framework. If a one-to-one matching is not possible, natural language processing is used to decide if an assignment is possible with a certain matching probability. The assigned test step definitions are used to generate graphical test models for the test scenarios, e.g., UML diagrams. Finally, executable test scripts are generated to test the software program. The present invention relates particularly to Behavior-Driven Development and combines traditional BDD advantages with Model Based Testing for improved convenience and automatization in case of complex software packages.

Abstract: A computer-implemented method for testing a functionality of a computing platform, the computing platform comprising a first microservice, the method comprising: receiving, by an injector microservice, a test configuration file; determining from the test configuration file: a test input message; a test input communication mechanism; and a test output communication mechanism. The method further comprises: generating a test identifier for identifying that a message is being used for testing purposes; transmitting, by the injector microservice, the test input message to the first microservice using the test input communication mechanism, wherein the test input message comprises the test identifier; identifying, by the injector microservice, an output message transmitted via the test output communication mechanism that comprises the test identifier; and recording, by the injector microservice, the output message comprising the test identifier.

Abstract: Methods and systems for performing timing analysis during the design of a circuit are described. In one embodiment, a simulation system can generate an effective resistance value (or an impedance value based on the effective resistance value) for an instance and use the effective resistance value in a simulation to determine a minimum timing delay for the instance when only the instance switches during such simulations.

Abstract: Example techniques may be implemented as a method, a system or more non-transitory machine-readable media storing instructions that are executable by one or more processing devices, Operations performed by the example techniques include obtaining data representing results of tests executed by one or more test instruments on an initial set of devices under test (DUTs) in a test system; and using the data to train a machine learning model. The machine learning model is for predicting which of the tests will produce failing results for a different set of DUTs. DUTs in the different set have one or more features in common with DUTs in the initial set.

Abstract: Provided is an API adapter test system capable of easily determining the health of an API adapter. An API adapter test system 1 includes: an API adapter test assistance device 20 that assists a health determination test of a predetermined API adapter; a developer terminal 10; and a wholesale API simulation device 30.

Abstract: Systems and methods of debugging a design under test for metastability issues using formal verification. In one aspect, the method includes determining, by a server, that a functionality of the DUT failed an assertion; generating, by the server, a plurality of first waveforms for a plurality of clock domain crossing (CDC) pairs that are in a cone of influence of the assertion; applying, by the server, a constraint including a condition to the plurality of waveforms; and generating, by the server, one or more second waveforms for a first subset of the plurality of CDC pairs, wherein the first subset of the CDC pairs satisfied the condition.

Abstract: A computer-implemented method of monitoring security of a set of computing devices in a distributed system, the distributed system having a plurality of computing devices, in communication with one another over a network, by a security software running in a computer node. The method includes comparing an app signature of the application running in a selected one of the set of computing devices to a reference app signatures generated from a respective functional replica of the application.

Abstract: Method for testing an integrated circuit device, by defect modelling of the integrated circuit device, fault modelling of the integrated circuit device based on the information obtained from the defect modelling, test development based on information obtained from the fault modelling, and executing the test on the integrated circuit device. Defect modelling of the integrated circuit device including executing a physical defect analysis of the integrated circuit device to provide a set of effective technology parameters modified from a set of defect-free technology parameters associated with the integrated circuit device, and executing an electrical modelling of the integrated circuit device using the set of effective technology parameters to provide a defect-parametrized electrical model based on a defect-free electrical model of the integrated circuit device. The present methods allow parts-per-billion testing capabilities.

Abstract: Systems and methods are provided for management of data item recovery operations based on classification of data items with respect to a target recovery time. Data items may be classified using metadata regarding versioning and other data storage operations performed on the data items, and the timing of those storage operations with respect to the target recovery time (TRT). Each class may be associated with one or more recovery actions. The recovery actions may involve modifying the metadata rather than the underlying data items.

Abstract: Methods, apparatus, and processor-readable storage media for automatically classifying cloud infrastructure components for prioritized multi-tenant cloud environment resolution using artificial intelligence techniques are provided herein. An example computer-implemented method includes obtaining historical data pertaining to a multi-tenant cloud environment; training one or more artificial intelligence techniques, using at least a portion of the obtained historical data, for classifying cloud infrastructure components for prioritizing incident-related resolution; classifying one or more cloud infrastructure components, within the multi-tenant cloud environment and associated with one or more server-related issues, into one or more of multiple resolution priority classes; and performing one or more automated actions based at least in part on the classifying of the one or more cloud infrastructure components.

Abstract: According to a first embodiment, a method may include initiating, by a user equipment, at least one transient-inducing event. The method may further include entering, by the user equipment, at least one first state associated with at least one first state requirement configuration. The method may further include transmitting, by the user equipment, at least one first signal to a network entity according to the at least one first state requirement configuration.

Abstract: A method is disclosed. The method including receiving at a telemetry service a plurality of transaction responses from a plurality of components distributed across a network, wherein the plurality of transaction responses is generated to process a request originating from a source component, wherein the request includes a request identifier, wherein the plurality of transaction responses includes a plurality of code path identifiers. The method including generating a fingerprint associated with the request by concatenating the plurality of code path identifiers, wherein each transaction response includes the request identifier and a corresponding code path identifier. The method including storing the fingerprint in a data storage.

Abstract: An example method for visual testing of programmed display of content includes obtaining a workflow of test scenarios for visual testing of a display controlled by a set-top box (STB) device. The method also includes obtaining images that capture content displayed on the display, feeding the images to a trained machine learning model to detect display elements, and performing visual testing based on the detected display elements in accordance with visual expectations specified by the test scenarios.

Abstract: Threats to systems and data captured by such systems can be automatically detected and remediated. Inbound traffic on an enterprise network can be monitored and analyzed to detect a threat based on parameters of the inbound traffic. In response, a patch can be identified or generated to address known or unknown threats based on a comparison of parameters. Once identified or generated, the patch can be conveyed to a target computing resource for deployment to address the threat.

Abstract: An apparatus includes a plurality of processor circuits, a cache memory circuit, and a trace control circuit. The trace control circuit may be configured, in response to activation of a mode to record information indicative of program execution of at least one processor circuit of the plurality of processor circuits, to monitor memory requests transmitted between ones of the plurality of processor circuits and the cache memory circuit, and then to select a particular memory request of monitored memory requests using an arbitration algorithm. The trace control circuit may be further configured to allocate space in a trace buffer to the particular memory request, and to store, in the trace buffer, information associated with the particular memory request.

Abstract: A system and method for remote testing of enterprise software applications (ESA) allows one or more testers to remotely access an ESA and remotely test the ESA. In at least one embodiment, the ESA resides in a testing platform that includes one more computers that are provisioned for testing. “Provisioning” a computer system (such as one or more servers) refers to preparing, configuring, and equipping the computer system to provide services to one or more users. In at least one embodiment, the computer system is provisioned to create an ESA operational environment in accordance with a virtual desktop infrastructure (VDI) template interacting with virtualization software.

Abstract: Examples of the present disclosure describe a testing framework for adaptive virtual services. In an example, a function vendor provides a network function having stated specifications to a service provider. A derived signature is generated for the network function (e.g., based on associated metadata, an image associated with the network function, and/or a network signature for the network function), which is used to classify the network function. The testing framework is used to test the network function according to its classification, thereby determining a set of capabilities. In examples, a network function having the same or similar signature as a previously tested network function may be categorized according to the previously tested network function. The network function is categorized according to its determined capabilities and added to an inventory of network functions for the service provider. Network functions in the inventory can then be selected to form a computer network.

Abstract: A semiconductor device includes a debug port, a first access port, a second access port, a first processing unit, a second processing unit, and an embedded emulator unit. The first access port is coupled to the debug port. The second access port is coupled to the debug port. The first processing unit is coupled to the first access port. The second processing unit is coupled to the second access port. The embedded emulator unit is coupled to the debug port, the first processing unit and the second processing unit. The first processing unit generates a debug instruction to access the embedded emulator unit, so that the embedded emulator unit generates a debug signal. The debug signal is output to the second processing unit through the debug port and the second access port, so as to perform a debug operation on the second processing unit.

Abstract: Embodiments of the present disclosure include a method, an electronic device, and a computer program product for training a failure analysis model. In a method for training a failure analysis model in an illustrative embodiment, at least one set of log files including multiple preprocessed log files is obtained, the at least one set of log files including a marked failure cause of a storage system, and preprocessed log files in the multiple preprocessed log files including one or more potential failure causes of the storage system and scores associated with the potential failure causes; a failure cause of the storage system is predicted according to a failure analysis model and based on the potential failure causes and the scores in the multiple preprocessed log files; and parameters of the failure analysis model are updated based on a probability that the predicted failure cause is the marked failure cause.

Abstract: The method disclosed herein includes preprocessing large amounts of input data into a smaller input data sets based on first predetermined associations, sorting the smaller input data sets into groups based on second predetermined associations, filtering grouped data based on upper and lower thresholds, updating a hierarchical processing decision tree within a processor of a computing system, processing data based on the updated hierarchical processing decision tree, and recursively restarting the preprocessing of the large amounts of input data to dynamically update the hierarchical processing decision tree within a user device.

Abstract: There is provided a system and method for performing system integration on an embedded system of a connected and/or autonomous vehicle. Integration testing may include obtaining one or more requirements and/or specifications for a system under test; generating a metamodel based on the requirements and/or specifications; generating test cases based on the metamodel; prioritizing said test cases based on hazards associated with said test cases; executing one or more of said prioritized test cases; and obtaining a verdict for each of said one or more prioritized test cases.

Abstract: A method for executing new instructions includes the following steps. An instruction is received. A determination is made as to whether the received instruction is a new instruction. When the received instruction is the new instruction, a emulation flag is generated. The emulation flag is a first value. A system management interrupt is generated according to the emulation flag. In response to the system management interrupt, entering the system management mode and simulating the execution of the received instruction in the system management mode to generate a simulation execution result. The simulation execution result is stored in a system management memory.

Abstract: A method, system, and computer program product for automated testing of Internet of Things devices are provided. The method generates a device table for a set of devices. The device table includes a set of inputs and a set of controllable outputs for each device. A set of input signals are detected for a device for a subset of inputs associated with the device. The set of input signals are detected from one or more controllable outputs of a subset of devices. The device table is modified based on the set of input signals and the one or more controllable outputs to generate an association table representing a relation of the subset of inputs with the one or more controllable outputs. The method detects a fault in one or more device of the set of devices based on a test input signal and the association table.

Abstract: A method is described that includes processing, by a memory subsystem, a read memory command that is addressed to a first die of a memory device. The memory subsystem determines whether processing the read memory command failed to correctly read user data from the first die and, in response to determining that processing the read memory command failed to correctly read user data from the first die, determines whether the first die has failed. In response to determining that the first die has failed, the memory subsystem performs an abbreviated error recovery procedure to successfully perform the read memory command instead of a full error recovery procedure.

Abstract: A method for performing verification and testing of a device under test (DUT) is described. The method includes receiving, by a processing device, inputs from a user regarding a hardware design for the DUT. The processing device presents cover group attribute suggestions to the user based on the hardware design and receives cover group information from the user corresponding to one or more cover group attributes of one or more cover groups based on the cover group attribute suggestions. Based on the cover group information, the processing device automatically generates verification code, including one or more cover group definitions.

Abstract: The present disclosure provides a semiconductor test method. The semiconductor test method includes the operations of: receiving a source code written in an interpreted language; and performing, by a first test apparatus, a first test on a device under test (DUT) based on the source code. The operation of performing, by the first test apparatus, the first test on the DUT based on the source code includes the operations of: interpreting, by a processor, the source code to generate a first interpreted code; and performing the first test on the DUT according to the first interpreted code. The first test apparatus is configured to execute the first interpreted code written in a first language.

Abstract: A method and system for managing performance of over a multimedia content distribution network (MCDN), such as a digital subscriber line network, involves receiving an indication of an impairment in network performance from an MCDN client. The MCDN node associated with the client may be identified and a community of MCDN clients coupled to the MCDN node may be further identified. Impairment information, representative of MCDN equipment, may be collected for each of the MCDN clients. Detailed network diagnostics and field service may be performed for MCDN clients based on a characterization of the impairment parameters. After remediation of the MCDN node, collection of the impairment information may be terminated.

Abstract: A conferencing system may include a data input port and an ingest system to receive signals through the data input port from a separate conference data source. The ingest system may include a notification subsystem to: identify an error state with respect to the signals received through the data input port; and output a human interface device (HID) notification to a conferencing application, wherein the HID notification includes the identified error state.

Abstract: A method for autonomously generating network function test cases includes detecting a failure case in a network function of a core network of a telecommunications network. The method includes, in response to detecting the failure case, autonomously generating a network function test case based on the failure case. The network function test case includes one or more network status parameters detected when detecting the failure case. The method includes supplying the network function test case to a network testing system configured for executing the network function test case by repeating the one or more network status parameters and determining whether or not the network function repeats the failure case.

Abstract: Systems and methods for implementing an end-to-end automation framework. The method includes receiving a testing data file associated with applications. The method also includes initiating a first automation framework corresponding to a first application. The method further includes storing first data generated from the first automation framework in a data file. The method also includes initiating a second automation framework corresponding to a second application. The method further includes storing second data generated from the second automation framework based on at least the first data in the data file. The method also includes generating a data log based on the data file. The method further includes generating for display the data log on a user device.

Abstract: In an embodiment, an asset may utilize one or more scanning techniques to detect a first set of software components that is not being natively tracked by an operating system of the asset, the one or more scanning techniques comprising one or more of an evaluation of metadata associated with one or more running processes of the asset, and an evaluation of file system information that characterizes the first set of software components. The asset may further store an indication of the first set of software components detected in accordance with the one or more scanning techniques, and may optionally report the indication to an external entity (e.g., a vulnerability management system).

Abstract: Embodiments of the present disclosure relate to a memory system and an operating method thereof. According to the embodiments of the present disclosure, the memory system may, when setting a firmware as a target firmware, generate a plurality of test commands to test the target firmware, test the target firmware by processing the plurality of test commands, and randomly generate logical block address (LBA) values corresponding to each of the plurality of test commands based on a seed value corresponding to each of the plurality of test commands.

Abstract: Circuits, methods, and systems are provided which facilitate testing of asynchronous circuits having one or more global or local feedback loops. A circuit includes a data path and a scan path. The data path has an input configured to receive a data input signal, and a first output. The scan path includes a first multiplexer having a first input configured to receive the data input signal, a latch coupled to an output of the first multiplexer, a scan isolator coupled to an output of the latch, and a second multiplexer having a first input coupled to the first output of the data path and a second input coupled to an output of the scan isolator. The second multiplexer is configured to output a data output signal.

Abstract: A library model addition engine adds library models to a library knowledge base by defining a template for a library configuration file that conveys information about each library model, custom inputs and code snippets to facilitate library comparison operations, and education content for the library model. The library configuration file template may be automatically filled with extracted data using an iterative sequence of operations to retrieve, scrape, or extract data to automatically populate data fields in a library configuration file template for validation processing to ensure that the file is in the correct format and satisfies the constraints provided by the library recommendation engine.

Abstract: Methods and systems for verifying that logic for implementing a pipelined process in hardware correctly moves data through the pipelined process. The method includes: (a) monitoring data input to the pipelined process to determine when watched data has been input to the pipelined process; (b) in response to determining the watched data has been input to the pipelined process counting a number of progressing clock cycles for the watched data; and (c) evaluating an assertion written in an assertion based language, the assertion establishing that when the watched data is output from the pipelined process the counted number of progressing clock cycles for the watched data should be equal to one of one or more predetermined values.

Abstract: Example methods and systems for software bug reproduction. One example method may comprise obtaining log information associated with multiple transactions processed by a control-plane node to configure a set of data-plane nodes and transform an initial network state to a first network state; and configuring a replay environment that is initialized to the initial network state, and includes a mock control-plane node and a set of mock data-plane nodes. The method may also comprise, based on the log information, replaying the multiple transactions using the mock control-plane node to configure the set of mock data-plane nodes and transform the replay environment from the initial network state to a second network state. Based on a comparison between the first network state and the second network state, a determination may be made as to whether a software bug is successfully reproduced in the replay environment.

Abstract: An information processing apparatus comprises: acquiring a first image including at least a part of an inspection device and a second image including at least a part of a subject; estimating a position of the inspection device based on the first image; estimating position and orientation information for the subject based on the second image; identifying an inspection region of the subject from results of estimating; and receiving a finalization instruction to finalize an inspection result to be recorded or output to an external apparatus based on sequentially acquired inspection results of the subject, and a finalization instruction to finalize inspection region information to be recorded or output to the external apparatus in association with the inspection result, wherein the finalization instruction for the inspection region information is received before the finalization instruction for the inspection result.

Abstract: Vehicular maintenance is predicted using real time telematics data and historical maintenance data. Different statistical models are used, and an intersecting set of results is generated. Environmental weather may also be used to further refine predictions.

Abstract: Disaggregated distributed measurement analysis systems provide a test and measurement automation platform that uses solution workflow metadata to create automation test suites as solutions to be deployed in an automation engine of a test and measurement automation platform. The automation platform provides tools and techniques to develop measurements and deploy solutions in an automation engine without requiring the system to restart. The system enables, by the test and measurement automation platform, a user to develop measurements for the solutions and deploy and execute each of the solutions in the automation engine of the test and measurement automation platform without requiring the solution to compile.

Abstract: Regression test case identification for automated regression testing includes identifying program code file(s) in which changes made to program code of an application are contained, selecting application feature(s) of the application as candidate(s) on which to perform automated regression testing, which selecting includes accessing mappings indicating features implemented by the identified program code files and identifying those features as the selected application feature(s), based on the selected application feature(s), selecting regression test cases to be included in the automated regression testing, and commencing execution of the automated regression testing using the selected regression test cases.

Abstract: Software application dependency trees can be generated and used for white-box testing. In some examples, a method may involve receiving a request to generate a dependency tree for a first software application associated with a computing device. The method may also include identifying a set of software applications also associated with the computing device, each of which the first software application is determined to be dependent upon based on information included in a specification for the first software application. The method may also include receiving, by the computing device with respect to the set of software applications, a corresponding set of dependency trees. The method may further include incorporating each of the dependency trees in the set of dependency trees into the dependency tree for the first software application via a respective incorporation point, and returning the dependency tree for the first software application in response to the request.

Abstract: The disclosed embodiments provide a system for testing machine learning workflows. During operation, the system obtains a configuration for a staging test of a machine learning model, wherein the configuration includes a model name for the machine learning model, a duration of the staging test, and a use case associated with the machine learning model. Next, the system selects a staging test host for the staging test. The system then deploys the staging test on the staging test host in a staging environment, wherein the deployed staging test executes the machine learning model based on live traffic received from a production environment. After the staging test has completed, the system outputs a set of metrics representing a system impact of the machine learning model on the staging test host.

Abstract: A test script is divided into tests having a sequential order within the test script. An analysis tree of the tests can be generated. Each unique path through the analysis tree includes a subset of the tests as sequentially ordered within the test script. A maximally parallel subset of the unique paths that covers all the tests and according to which the tests are successfully executable is identified. Each test appears in only one unique path of the maximally parallel subset.

Abstract: It is possible to make data for manufacturing devices available in a standard format using an adapter that would automatically interrogate the device and use the information gained from the machine to generate a data translation file. The data translation file could subsequently be used by an agent to interpret a data stream provided by the adapter for the manufacturing device.

Abstract: A method including: identifying a set of dependent virtualised network functions included in a first virtual network, the set including at least a virtualised network function to be updated; creating a second virtual network including clones of virtual machines implementing the dependent virtualised network functions of the set; interconnecting, in the second virtual network, clones of the dependent virtualised network functions, identically to an interconnection in the first network of dependent virtualised network functions; identifying an input data packet of the dependent virtualised network functions, duplicating the packet and sending the duplicated packet to the second network; applying a patch to the clone of the virtualised network function to be updated in the second network; triggering an alert when a performance value of a dependent virtualised network function of the first virtual network differs from a performance value on the clone of the virtualised network function in the second network.

Abstract: A computer-implemented method according to one embodiment includes simulating, for a predetermined time period, output of a first task that periodically runs within a system to create a simulated output, comparing the simulated output to actual output of the first task for the predetermined time period, and generating an alert in response to determining that the simulated output does not match the actual output for the predetermined time period.

Abstract: The present invention generally relates to system test, and more specifically, related to online system test. In an aspect, a computer-implemented method for online system test is provided. In this method, a test rule for testing the online system is obtained. And a test result from a real user action of the online system based on the test rule will be retrieved. And a test report is generated at least based on the test result from the real user action.

Abstract: A method includes generating on a host machine a validated verification test scenario comprising a graph defining a scheduled performance order of a plurality of actions to be performed on a DUT and a corresponding verification environment; obtaining a subset of one or more actions to be added to the validated scenario while maintaining the plurality of actions of the validated scenario and the scheduled performance order, forming an amended verification test scenario; and applying a runtime solver in a target language of the DUT and the corresponding verification environment on the amended verification test scenario to generate a test in a target code and to apply the test on the DUT and the corresponding verification environment wherein inclusion of any of said one or more actions or an order of performance of said one or more actions of the subset in the test is determined at runtime.

Abstract: A method, computer program product, and a computer system are disclosed for processing information in a processor that in one or more embodiments includes generating workload information of a performance base test; determining characteristics of the workload information; determining one or more constraints that can cause behavioral changes to a design of the processor; combining the determined characteristics and the determined one or more constraints to generate one or more example constraints; testing the one or more example constraints in one or more example performance tests; and generating one or more performance benchmarks for the performance base test and the one or more example performance tests.

Abstract: A simulation model recovery method, system, and computer program product include initiating a simulation model, during an operation of a model, periodically writing a solution space of the model to a checkpoint restart file, during an operation of the model, periodically writing diagnostic information on model progression to a log file, detecting a failure of the model, based on the log of the model, determining a time of the failure, based on the model outputs and restart files, determining a period of a numerical instability preceding the failure, selecting a checkpoint of the model preceding the period of the numerical instability, based on the numerical instability and diagnostic information in log files, modifying a configuration of the model, and restarting the model based on the selected checkpoint and the modified configuration.