Abstract: There are provided systems and methods for machine learning model verification for assessment pipeline deployment. A service provider may provide AI hosting platforms that allow for clients, customers, and other end users to upload AI models for execution, such as machine learning models. A user may utilize one or more user interfaces to provide model data and files, such as model artifacts, model requirements, and model test data. Thereafter, a model deployer may validate that the AI hosting platform has the required code packages and other model framework requirements for the AI model. The model test data may be used to ensure that the AI model is behaving correctly and providing the correct predictions based on input data and features. If so, the AI model may be deployed in a live production computing environment and used for predictive services.

Abstract: An embedded terminals remote online development system is divided into three parts: an embedded terminal, a cloud forwarding platform and an IDE. Under remote online development, the cloud forwarding platform establishes a communication connection with the IDE through the Internet and establishes a connection with a communication module of the embedded terminal through a communication base station, so that the communication between the IDE and embedded terminal is completed. To be compatible with a local development mode, it is also possible to establish a connection between the IDE and the embedded terminal in a wired manner such as serial communication, to realize local online development. The embedded terminals remote online development system with good universality and flexibility is established in combination with a cloud platform, so the development difficulty of embedded terminals is lowered, repetitive work during development is reduced, development cycle is shortened, and development cost is reduced.

Abstract: An embodiment of the present invention is directed to a novel approach of predicting software failures while executing in an operational or production environment. The innovative method and system provides analytic capabilities that monitor a system and input conditions and further provides a prediction mechanism to anticipate a software failure and present an improved course of action.

Abstract: In an embodiment, a processor includes hardware circuitry which may be used to authenticate instruction operands. The processor may execute instructions that perform operand authentication both speculatively and non-speculatively. During speculative execution of such instructions, the processor may execute authentication such that no differences in observable state of the processor, relative to authentication result, are detectable via a side channel. During speculative execution, a result of authentication may be deferred until speculative execution of the instruction, and additional instructions, may be completed. Upon resolution of a condition that indicates acceptance of the speculative execution, a speculative execution result may cause a processor exception and stalling of execution at the instruction to be performed.

Abstract: A system optimal control technique with accuracy guarantee that enables high-speed calculations is provided. One aspect of the present invention is related to a system optimal control device including a graph converting unit configured to convert, based on an upper bound of an probability of arrival from an initial state to a final state of a stochastic game representing system information, the stochastic game into a flow analysis graph, a path selecting unit configured to select a path having a maximum width among paths from each state node to a final state node in the converted flow analysis graph, a width of each of the paths being defined as a minimum weight of edges forming the path, and a convergence determining unit configured to determine convergence of the upper bound and a lower bound of the probability of arrival of the stochastic game based on information about the selected path.

Abstract: Systems and methods for providing an automated quality assurance framework for infrastructure as code (“IaC”) implementations are provided. Pull requests with proposed change to existing IaC source code (“changed code”) are received from user devices, each associated with either a service enablement team member or an applications development team member. Team specific versions of the quality assurance framework are automatically triggered for the changed code which require successful passage through multiple modules, such as in a successive manner, before automatically being merged into the existing IaC source code.

Abstract: A system, method, and computer program are provided for unattended test execution based on impacted application code. A change made to an application is detected. One or more features of the application impacted by the change made to the application are determined. A plurality of existing tests associated with the one or more features of the application impacted by the change made to the application are identified. A probability of each existing test in the plurality of existing tests exposing a defect in the application is predicted. At least a portion of the plurality of existing tests are executed for the application in an order that based on the predicted probabilities.

Abstract: A digital assistant can provide support for automated testing of applications. A natural language interface can be provided by which a testing user can specify a request for one or more testing actions. A natural language processing model can recognize intents in the request, and the intents can be used to execute executable code to perform the requested testing actions. Multiple actions per request can be supported. An object repository can be leveraged to determine user interface control identifiers, and a test data container can store values for use during testing. Testing functionality can thus be provided to a wider base of testing users. A real time, scriptless approach can conserve computing resources.

Abstract: A test method and a multi-processor SOC chip are provided. The method includes: parsing a first command line in a host system input buffer by a host system to obtain a first command and a first parameter corresponding to the first command line, when the first command is a command of the host system in a host system command set, executing the first command by the host system, and when the first command is a command corresponding to a subsystem, sending, by the host system, the first parameter to a subsystem input buffer corresponding to the subsystem as a second command line; and parsing the second command line by a subsystem to obtain a second command and a second parameter corresponding to the second command line, and when the second command is a command in a subsystem command set of the subsystem, executing the second command by the subsystem.

Abstract: Techniques for improved data and/or resource validation provide a real-time validation of data and resources. A resource may include an aggregation of related data into a single unique unit. The validation may be performed based on one or more events or triggers, such as on the occurrence of a data change, deployment of an application, when the resource(s) are utilized, etc. The validation may be on demand (e.g., based on one or more events and/or triggers) and/or manually (e.g., via a call via an application program interface by a user).

Abstract: A UWB ranging performance testing method is disclosed in which a control terminal device sends a test request signal message to multiple devices to be tested. The test request signal message includes communication time slots distributed by the control terminal device to multiple devices to be tested. Communication time slots of different devices to be tested are different. All devices to be tested return the response signal message for UWB ranging performance testing in their respective corresponding communication time slots.

Abstract: In one embodiment, a computer-implemented method comprises using a script automation processor that is hosted using a virtual compute instance and a virtual storage instance associated with one or more second non-transitory computer-readable storage media storing one or more second sequences of instructions defining an API implementation of the API, a graph server, and one or more programming language runtime interpreters, receiving a user pipeline automation script comprising one or more first sequences of instructions specifying one or more API calls to an application programming interface (API), and a user application; using the script automation processor, creating and storing one or more programmatic containers in memory of the script automation processor, the containers corresponding to functions that user pipeline automation script and user application invoke; using the script automation processor, creating and storing a directed acyclic graph (DAG) in the memory of the script processor, the DAG compri

Abstract: Introduced here are computer programs that are able to generate computer vision data through local analysis of image data (also referred to as “raw data” or “input data”). The image data may be representative of one or more digital images that are generated by an image sensor. Also introduced here are apparatuses for generating and handling the image data and computer vision data.

Abstract: A system is provided for automated intelligent testing of desktop applications through machine learning. In particular, the system may combine process automation technologies with artificial intelligence/machine learning capabilities to perform end-to-end testing of both simple and complex applications. The system may comprise a test automation component that may produce real runtime outputs of the testing process, and an artificial intelligence engine that may produce predicted outputs based on historical data. The system may analyze both the real runtime outputs with the predicted outputs and determine a delta between the real runtime outputs and the predicted outputs. The results of the analysis may be backpropagated to the artificial intelligence engine to iteratively improve the machine learning model over time. In this way, the system may provide an efficient way to test computer applications.

Abstract: Methods and systems are presented for providing a framework to securely integrate third-party logic into electronic transaction processing workflow. Third-party programming code that implements different third-party logic may be obtained and stored in a repository. A transaction processing request is received from a third-party server, and an instance of a transaction processing module is instantiated within an operating runtime environment to process a transaction according to a workflow. When the instance of the transaction processing module has reached an interruption point, the instance of the transaction processing module is suspended, and a third-party programming code is executed within an isolated runtime environment. The third-party programming code is configured to provide an output value based on attributes of the transaction. The instance of the transaction processing module then determines whether to authorize or deny the transaction based in part on the output value.

Abstract: Functions associated with functional safety certification of a software package can be identified using a rule engine. For example, a computing system can identify the functions in a codebase of the software package by executing the rule engine that is configured to identify the functions using a rule set. In response to identifying the functions, the computing system can tag the functions with a function identifier usable to filter the codebase to define a subset of the codebase consisting of the functions. The computing system can execute a targeted test suite to generate a code coverage report of the codebase such that the targeted test suite is limited to the subset of the codebase based on the function identifier.

Abstract: A storage port receives a login request. The storage port configures an audit mode indicator as enabled in a login response to a host port to enter a security enabled mode to indicate to the host port that Input/Output (I/O) operations are to be transmitted from the host port to the storage port even if authentication or security association negotiation with the storage port cannot be completed successfully.

Abstract: Methods, systems and computer program products for lockless acquisition of memory for RDMA operations. A contiguous physical memory region is allocated. The contiguous physical memory region is divided into a plurality of preregistered chunks that are assigned to one or more process threads that are associated with an RDMA NIC. When responding to a request from a particular one of the one or more process threads, a buffer carved from the preregistered chunk of the contiguous physical memory region is assigned to the requesting process thread. Since the memory is pre-registered, and since the associations are made at the thread level, there is no need for locks when acquiring a buffer. Furthermore, since the memory is pre-registered, the threads do not incur registration latency. The contiguous physical memory region can be a contiguous HugePage contiguous region from which a plurality of individually allocatable buffers can be assigned to different threads.

Abstract: A set of test methods for performing a live test of service in a production environment, where the service is provided by a set of configured instances in the production environment and each configured instance is composed of a set of components. The methods including a method that includes instantiating components under test from the set of components to setup paths that are to be taken by test traffic, instantiating test configuration components for the service, executing a test case on a created path, generating a snapshot of a first serving component from the set of components, replacing a tested component under test with a second serving component cloned from the snapshot, relocating the service to the second serving component, replacing the serving component of the snapshot with a new component under test to create a new path to be tested, and determining whether all paths have been tested.

Abstract: Approaches presented herein provide for the optimization of tasks performed for an operation such as the rendering of an image. A Frame Interceptor (FI) can generate a resource dependency graph (RDG) by intercepting API calls during the rendering process and determining dependencies. FI can analyze the RDG to identify potential optimizations, such as may correspond to reordering or parallel execution of certain tasks. FI can automatically test optimizations to determine whether sufficient improvement is obtained. This testing can be performed in real time by replacing the originally intercepted API calls with the newly ordered API calls generated by FI. FI can then issue a report that indicates information such as the changes made, the time taken to render the image, and potentially the fact that the images were determined to be identical.

Abstract: A method for verifying a set of computer-executable instructions using at least one failing test generated by a test-case generator is disclosed herein. The method comprises verifying the set of computer-executable instructions by a verification module using a plurality of predefined verification conditions; determining if the verification is successful; in response to successful verification, label the set of computer-executable instructions as successful; and in response to unsuccessful verification, generate at least one counterexample, with respect to a proof failure and corresponding to at least one failed verification condition of the plurality of the predefined verification conditions, and generate a failing test, by a test-case generator, based on at least one counterexample. A program verification tool for testing the set of computer-executable instructions is also disclosed.

Abstract: In the context of software security, reachability analysis provides a mechanism to assess the ease of exploitability of a particular vulnerability or whether a vulnerability is exploitable at all. The present techniques provide a mechanism to compute reachability for one or more binary executables within the context of an execution environment. These reachability analyses can be used to determine whether the executables or components therein present any potential vulnerabilities which, in turn, can cause a computing system executing such binary executable to exhibit undesired behavior. The analyses include determining reachability metrics for each of a plurality of program locations. These metrics are used to determine an environment-aware reachability metric reflecting the runtime properties of a computing environment specified by artefacts associated with the software.

Abstract: In one embodiment, a device obtains testing parameters used by a plurality of agents in a network to perform testing with respect to an online application. The device identifies overlapping parameters among the testing parameters and generates a consolidated set of testing parameters for the overlapping parameters. The device configures the plurality of agents such that a singular testing agent performs testing with respect to the online application using the consolidated set of testing parameters instead of multiple testing agents performing testing with respect to the online application using the overlapping parameters.

Abstract: Test cases written to test a software application can be dynamically distributed among different sets of test cases that can be executed simultaneously in different parallel threads, thereby speeding up testing relative to executing the test cases sequentially in a single thread. Although executing the test cases in parallel threads can cause the test cases to execute in a different order than intended by developers, any test cases that fail due to database conflicts or other errors as a result of the parallelization can be retried at least once. Re-executing failed test cases at a later time can lead to the full set of test cases ultimately succeeding, despite errors that may have been caused by the parallelization.

Abstract: Techniques are provided for managing and isolating build process pipelines. The system can encapsulate all the information needed for each build process step in a build context structure, which may be accessible to the build process step. Each build process step can receive input from the build context, and can generate a child build context as output. Accordingly, the build pipeline may be parallelized, duplicated, and/or virtualized securely and automatically, and the build context can carry, organize, and isolate data for each task. The build context from each step can also be stored and subsequently inspected, e.g. for problem-solving. A computing device can execute a first build step configured to generate the build context including a plurality of output objects. The computing device further executes a second build step based on the build context, which is accessible to the second build step but isolated from other processes.

Abstract: A method of testing a network node in a communication system according to some embodiments includes obtaining a test case specification that describes a test scenario associated with the network node and extracting textual features from the test case specification. A feature vector is generated that includes the extracted textual features, and the feature vector is mapped to a plurality of available test scripts. The method selects one or more of the plurality of available test scripts for execution in response to the mapping of the feature vector. For one or more of the selected test scripts the method generates a confidence score that measures a confidence of an association of the test case specification with the selected test script. Related systems are disclosed.

Abstract: The present disclosure discloses a defect location method and device based on coverage information, the method including: characterizing program structure information and test case coverage information of a target program in a graph to obtain a graph-characterized structure; generating a node attribute sequence and an adjacency matrix based on the graph-characterized structure; and inputting the node attribute sequence and the adjacency matrix to a trained graph neural network model, so that the graph neural network model outputs a suspicious degree list of the target program based on the node attribute sequence and the adjacency matrix. Through the graph-based unified information characterization, the coverage information can be saved without loss and compression, and the structure information may also be considered, thereby improving the accuracy of defect location.

Abstract: A central computer system receives a first plurality of event records, each event record identifying one or more events that have occurred in a device of a plurality of different devices. The central computer system identifies, from the first plurality of event records, a first group of event records that identify a same first set of one or more events that occurred on a first subset of the devices. The central computer system determines that a total number of the event records in the first group of event records exceeds a first threshold criterion. In response to determining that the total number of the event records in the first group of event records exceeds the first threshold criterion, the central computer system sends to a destination, information about the first set of one or more events.

Abstract: Annotations associated with test cases written to test a software application can allow related test cases to be dynamically distributed among different sets of test cases that can be executed simultaneously in different parallel threads, thereby speeding up testing relative to executing the test cases sequentially in a single thread. The annotations can also allow test cases to be identified that are relevant to code changes, such that testing times can be further reduced by executing a subset of test cases relevant to code changes instead of a full set of test cases.

Abstract: The present invention relates to a method for protecting a program in a computer system, the method comprising: when a subroutine of said program is called, pushing a return address on to a stack to start forming a stack frame; when pushing said return address, generating a checksum for said stack frame; each time a predetermined opcode is detected for said subroutine, updating said checksum according to an operand associated with said predetermined opcode; if the predetermined opcode is a pop opcode, in addition to said updating, determining whether the operand associated with said pop opcode is said return address; if it is determined that said operand is said return address, verifying said checksum before executing said predetermined opcode in order to detect an attack.

Abstract: In some implementations, a first device may receive, from a second device, network function (NF) configuration information indicating that an NF instance is to be provisioned to support a combination of network slices. The NF configuration information may include first network slice information regarding the first network slice and second network slice information regarding the second network slice. The first device may obtain, from a data structure, first slice configuration information associated with the NF instance supporting the first network slice and second slice configuration information associated with the NF instance supporting the second network slice. The first device may generate configuration parameters to provision the NF instance to support the combination of network slices and provide the configuration parameters to cause the NF instance to be provisioned to support the combination of network slices.

Abstract: According to one embodiment, an integrated circuit verification device includes: a condition property information generation unit configured to generate a plurality of condition properties that have information which imposes limitations on circuit operations or input signals, based on condition statements in a code list of a design data file; an exclusion code generation unit configured to generate, from the code list, exclusion code which is proved not to be statically covered, and a first exclusion code list to which the plurality of condition properties are applied; and an exclusion code comparison unit configured to generate a second exclusion code list from a difference between the exclusion code and the first exclusion code list.

Abstract: A computer implemented method for the automated analysis or use of data is implemented by a voice assistant. The method comprises the steps of:(a) storing in a memory a structured, machine-readable representation of data that conforms to a machine-readable language (‘machine representation’); the machine representation including representations of user speech or text input to a human/machine interface; and (b) automatically processing the machine representations to analyse the user speech or text input.

Abstract: The disclosure provides a method and system for managing a life cycle iteration of a test case, where the method includes the following steps: writing a test case according to a mind map template; importing the written test case in batches based on the mind map template; storing the imported test case, and marking the test case, where the marking includes marking the test case as a manual test case; and creating an automated test case, and associating the automated test case with the manual test case.

Abstract: An example method for visual testing and issue communication of programmed display of content includes obtaining a workflow of test scenarios for visual testing a display. The content displayed on the display is controlled by a set-top box (STB) device executing target instructions. The example method further includes identifying a visual testing issue associated with executing the test scenarios, and communicating the workflow and issue to a remote device for reproduction of the issue.

Abstract: A safety device is provided for monitoring at least one machine that has at least one sensor for generating sensor data on the machine and a processing unit for the sensor data that is connected at least indirectly to the sensor and to the machine and that is configured as a runtime environment having at least one computing node and to allow at least one logic unit to run on the computing node, wherein at least one logic unit comprises a safety functional unit for a safety relevant evaluation of the sensor data to output in the case of a safety relevant event a safety signal to the machine for triggering a safety response, In this respect, the processing unit is furthermore configured to generate and resolve logic units and/or to assign them to a computing node.

Abstract: A system, computer program product, and method are presented for executing a validation test on at least a portion of a refactored application. The refactored application is resident within a partitioned computing architecture including a plurality of partitions and communication between the partitions uses one or more boundary methods. The refactored application is at least partially similar to a transformed monolithic application. The method includes automatically generating one or more test sequences for exercising one or more functional behaviors for each boundary method of the one or more boundary methods.

Abstract: Systems, software, and methods for evaluating the scope of computer system changes related to automatic migration from one set of computing hardware to another provide methods and techniques that include evaluations for compliance with one or more policies prior to implementation, and then sequence and automate the migration tasks. A domain-specific language describes activity specifications and asset metadata, which is then used to generate interdependent activities in a project workstream on the basis of stored expert knowledge embedded in knowledge templates. Disaster recovery and “what-if” migration scenarios are tested in order to test and compare options of one or more proposed infrastructure changes.

Abstract: Disclosed is a method for feedback of a program, which is performed by a computing device including at least one processor, which include: matching respective functions included in a first program received from an external device with respective functions included in a prestored correct answer program corresponding to the first program; identifying error functions different from the respective functions included in the correct answer program among the respective functions included in the first program; generating at least one repair template including at least one reference function extracted based on a calling-context for a function of a specific function in order to repair the error function among the prestored functions; generating a first edit script for repairing the error function to at least one reference function based on a first repair template among one or more repair templates; and transmitting a signal including the first edit script to the external device.

Abstract: In non-limiting examples of the present disclosure, systems, methods and devices for assisting with testing custom application software are provided. An input that modifies an application action may be received. A request to execute a test action corresponding to the application may be received. One or more test steps for executing the test action may be identified. Each of the one or more test steps may be executed in a test framework utilizing test metadata. A determination may be made as to whether an unexpected result occurred during the execution of the one or more steps. If an unexpected result is determined to have occurred, a graphical representation of the unexpected result may be caused to be displayed.

Abstract: In accordance with an embodiment, described herein is a query execution debugger, for use with a computing environment such as, for example, a business intelligence environment, database, data warehouse, or other type of environment that supports data analytics. A query engine, for example a business intelligence server instance, serves analytics queries or requests from clients, directed to data stored at a database, in accordance with a query execution plan, wherein a logical query can include query language statements received from the clients; while a physical query includes database-specific statements that the query engine sends to the database to retrieve data when processing the logical query. The system can create a query execution debugger file that includes a record metadata portion or section, and a data portion or section, and which can be used to review, simulate, or debug the processing of queries against the database.

Abstract: The technology described herein provides an automated software-testing platform that functions in an undefined action space. The technology described herein starts with an undefined action space but begins to learn about the action space through random exploration. Both the action taken during testing and the resulting state may be communicated to a centralized testing service. The technology described herein also mines the action telemetry data and state telemetry data to identify action patterns that produce a sought after result. Once a plurality of action patterns is identified and, at least, a partial model of the action space is built, the testing on the test machines may be split into random test mode, replay test mode, and a pioneering test mode.

Abstract: A method includes receiving, at a chaos level engine, initial input parameters. The method may further include, with the chaos level engine, determining scaled input parameters based on the initial input parameters. The scaled input parameters define how the initial input parameters effect a computing environment to be tested. The method may further include, with the chaos level engine determining a chaos level for performing a chaos experiment on the computing environment based on the scaled input parameters and sending the chaos level to the computing environment for the chaos experiment. The method may further include, with the chaos level engine, receiving, from the computing environment, feedback defining an impact caused by the chaos experiment created at the computing environment and an intended level of chaos.

Abstract: Information is provided to a service mesh by a Kubernetes (K8s) controller. The information enables the service mesh to determine an IP address of application pods to which a monitoring request is destined. The K8s controller detects which of the application pods are scheduled to be monitored by the monitoring service. The K8s controller creates dummy headless services that match the application pods scheduled to be monitored. The service mesh is programmed information from the dummy headless services to cause the service mesh to intercept the monitoring request and identify that the monitoring request is destined to the dummy headless service based on the addresses. In response the service mesh encrypts the monitoring request.

Abstract: Disclosed in some examples are systems, devices, machine-readable mediums, and methods for customizing an in-memory versioning mode for each memory location according to a predicted access behavior to optimize memory device performance. Usage data in a previous time period may be utilized along with policy rules to determine whether to configure a particular memory address as a zero copy or direct copy mode. For example, memory addresses that are read frequently may be configured as direct copy mode to reduce the read latency penalty. This improves the functioning of the memory system by reducing read latency for memory addresses that are frequently read but written to less frequently, and reduces write latency for memory locations that are frequently written to, but not read as frequently.

Abstract: The present disclosure relates to a system and method for creating a backup and restoring the exact clean system state prior to malware detection. The system includes a security system, in communication with one or more applications of a computing system, and a backup unit. The security system detects malware during execution of the applications or events based on a memory dump analysis. The backup unit creates a backup copy of the system state corresponding to each event, labels each copy and creates an index. When the security system detects presence of the malware at a particular event, the backup system parses the index, and with use of the labels, retrieves the exact backup copy that belongs to the event preceding the other event that caused the malware attack.

Abstract: Systems, apparatuses, and methods for implementing a discard engine in a graphics pipeline are disclosed. A system includes a graphics pipeline with a geometry engine launching shaders that generate attribute data for vertices of each primitive of a set of primitives. The attribute data is consumed by pixel shaders, with each pixel shader generating a deallocation message when the pixel shader no longer needs the attribute data. A discard engine gathers deallocations from multiple pixel shaders and determines when the attribute data is no longer needed. Once a block of attributes has been consumed by all potential pixel shader consumers, the discard engine deallocates the given block of attributes. The discard engine sends a discard command to the caches so that the attribute data can be invalidated and not written back to memory.

Abstract: A method includes receiving a request to perform a job from a second computing device, where the job includes one or more steps to be completed in a period, and where the request includes a job description for the job, storing the job description into a data store, retrieving a step description corresponding to one of the steps of the job to be performed from the data store, where each of the steps is performed by a corresponding worker system, sending the commands to the communication endpoint for the corresponding worker system, receiving a status update comprising results for the commands from the corresponding worker system, and storing the status update to the data store.

Abstract: A method and system for using a configuration-based framework for testing an application programming interface (API) are provided. The method includes receiving identification information about one or more APIs to be tested; defining, based on the first information, at least two API endpoints and one or more dependencies to be tested; retrieving an authentication model to be used for accessing the APIs; generating a testing plan based on the API endpoints, the dependencies, and the authentication model; executing a test of the APIs based on the testing plan; and displaying at least one result of the executed test on a graphical user interface (GUI).

Abstract: An automation controller is disclosed which provides central management of an automated upgrade process in an IT infrastructure. In an example, one or more hardware processors are configured as a central initiation point for the automated upgrade process by machine-readable instructions. The machine-readable instructions are executable to identify, based on at least one automation input file, at least one target node in the at least one IT infrastructure to be upgraded. The machine-readable instructions are also executable to associate at least one patch firmware bundle with the at least one target node in the at least one IT infrastructure. The machine-readable instructions are also executable to execute an automation code script. The machine-readable instructions are also executable to manage the automated upgrade process through to exception or successful completion of the automated upgrade process at the at least one target node in the at least one IT infrastructure.