Abstract: Technologies are shown for function level permissions control for smart contract execution to implement permissions policy on a blockchain. Permissions control rules control function calls at a system level utilizing function boundary detection instrumentation in a kernel that executes smart contracts. The detection instrumentation generates a call stack that represents a chain of function calls in the kernel for a smart contract. The permissions control rules are applied to the call stack to implement permissions control policy. Permissions control rules can use dynamic state data in the function call chain. If the dynamic state data observed in function call chains does not meet the requirements defined in the permissions control rules, then the function call can be blocked from executing or completing execution. The permissions control rules can be generated for a variety of different entities, such as a domain, user or resource.

Abstract: Aspects of the invention include constructing a knowledge graph by writing a plurality of data structures to connect correlated log messages in a system log. Detecting an anomalous log message based on the knowledge graph, wherein the anomalous log message is connected to a plurality of candidate root cause error log messages. Determining respective sequences from each of the plurality of candidate root cause error log messages to the anomalous log message. Calculating a deviation score for each respective sequence based on a deviation of an expected sequence for each candidate root cause error log message and the determined sequence. Determining a root cause log error message based on the calculated deviation scores.

Abstract: Systems and methods for generating embeddings for nodes of a corpus graph are presented. More particularly, embedding information of a target node may be based on the node itself, as well as related, relevant nodes to the target node within a corpus graph. The information of various nodes among the relevant nodes to the target node can be used to weight or influence the embedding information. Disclosed systems and methods include generating neighborhood embedding information for a target node, where the neighborhood embedding information includes embedding information from neighborhood nodes of the target node's relevant neighborhood, and where certain nodes having more relevance to the target node can be weighted to influence the generation of the neighborhood embedding information over nodes having less relevance to the target node.

Abstract: Systems and methods for generating embeddings for nodes of a corpus graph are presented. More particularly, operations for generation of an aggregated embedding vector for a target node is efficiently divided among operations on a central processing unit and operations on a graphic processing unit. With regard to a target node within a corpus graph, processing by one or more central processing units (CPUs) is conducted to identify the target node's relevant neighborhood (of nodes) within the corpus graph. This information is prepared and passed to one or more graphic processing units (GPUs) that determines the aggregated embedding vector for the target node according to data of the relevant neighborhood of the target node.

Abstract: A method and apparatus for event attribution during software experimentation is described. The method may include receiving, by a server computer system, a plurality of event tracking messages associated with an end user system, each event tracking message including at least a customer identifier, an end user identifier, and a timestamp. The method may also include storing each event tracking messages with the received customer identifier, end user identifier, and timestamp in a customer data store. Furthermore, the method may include applying, by the server computer system, a feature treatment to a configurable application executing on the end user system, the feature treatment specified by a customer system associated with the customer identifier, and the feature treatment configures one or more features of the configurable application associated with the end user identifier.

Abstract: Methods and systems for tracking source code deployments are disclosed.

Abstract: Various methods and systems for tracking incomplete purchases in correlation with application performance, such as application errors or crashes, are provided. In this regard, aspects of the invention facilitate monitoring transaction and application error events and analyzing data associated therewith to identify data indicating an impact of incomplete purchases in relation to an error(s) such that application performance can be improved. In various implementations, application data associated with an application installed on a mobile device is received. The application data is used to determine that an error that occurred in association with the application installed on the mobile device correlates with an incomplete monetary transaction initiated via the application. Based on the error correlating with the incomplete monetary transaction, a transaction attribute associated with the error is determined.

Abstract: A method addresses a defect in software. The method periodically captures snapshots of versions of code for a particular software program as one or more functionalities are added to the particular software program. The method determines that a current version of the particular software program has a defect, and then iteratively tests previous versions of that particular software program until a most-recent non-defective version of the particular software program is detected. A software developer is directed to either debug the current version of the particular software program, or else re-create the current version of the particular software program from the most-recent non-defective version of the particular software program, depending on which approach is faster.

Abstract: The present disclosure includes execution of an application process on a first computer system, where the first computer system is arranged within a first security zone. Access credentials for the application process may be stored in a storage device, where the storage device is arranged within a second security zone. The application process may interact with a further application process. The further application process may be executed on a third computer system, where the further application process is controlled by a graphical user interface of the further application process. An application robot may be executed on the first computer system. The application robot may execute the application process. Further, a login into the first computer system from a second computer system may be executed for gaining access to the application process using the access credentials.

Abstract: Certain aspects of the present disclosure provide techniques for automating testing of applications. One example method generally includes obtaining a user interface (UI) source from an application defining pages of the application and fields associated with UI elements of each page of the pages and receiving a selection of a scenario. The method further includes generating scenario data based on a section of test data associated with the selection of the scenario and executing a test using the scenario data. To execute the test, the method includes identifying, by a runner, a first UI element of a first page of the application, identifying, by the runner, a first element of the scenario data mapped to the first UI element and entering, by the runner, the first element of the scenario data into the first UI element.

Abstract: A method for displaying visual representation of test case coverage is described. A computer-implemented method can include receiving updates during test case runtime to generate a tree that represents a hierarchical ordering of test cases within related branches, providing a test coverage map of the tree in a form of a tree representation; receiving a request through interaction with a node of the tree representation, and performing operation corresponding to the request. In some cases, a tree may include nodes representing completed tests and nodes representing incomplete accepted tests. The nodes representing completed tests and the nodes representing incomplete accepted tests each include one or more tags that represent the environment in which a piece of functionality is tested. Percentage completion can be based on the number of completed test cases to the number of incomplete accepted test cases.

Abstract: A simulation method executed by a computer includes: dividing an analysis domain into divided domains; generating a calculation data model on the divided domains that includes the volume of each divided domain and a characteristic of the domain with respect to each adjacent domain as the quantities not requiring the vertices and connectivity; generating a requested number of aggregated domains by aggregating the divided domains; generating a calculation data model on the aggregated domains that includes the volume of each aggregated domain and a characteristic quantity of the domain with respect to each adjacent domain as the quantities not requiring the vertices and connectivity; and calculating with respect to the physical quantity, based on a physical property in the analysis domain and the calculation data model on the aggregated domains, conductance representing transfer characteristic between the aggregated domains, and capacitance representing accumulation characteristic for each aggregated domain.

Abstract: A computer-implemented method for testing a system under test (SUT) in an active environment includes generating multiple test cases. The method further includes executing, by the testing system, a first set of test cases from those generated, and determining a test case that failed. Further a code path that is exercised by the test case is detected, the code path having a defect. The method further includes identifying, by the testing system, a second set of test cases from the test cases that are generated, wherein each test case from the second set of test cases has not been executed and exercises the code path that is identified. The method further includes reordering, by the testing system, at runtime, the test cases to omit execution of the second set of test cases.

Abstract: Performing reverse execution debugging of an application. The method includes identifying a snapshot of application state for an application in an application framework. The method further includes emulating execution of the application, using bytecode, in a forward direction from the snapshot to an end point, causing generation of historical execution state at various points along the emulation of the application. The method further includes collecting the historical execution state. The method further includes using the collected historical execution state, emulating reverse execution of the application by substituting collected historical execution state, when needed, to restore previous state needed as a result of emulation of reverse execution of the application.

Abstract: Systems and methods are provided for loading data based on a data hierarchical framework for an entity. An exemplary method includes, for a data load related to the entity, determining whether a data loader associated with a root node requires action. And, when the data loader associated with the root node requires action, the method includes identifying a first dependency of the data loader associated with the root node of the hierarchical framework on another data loader associated with another node of the hierarchical framework, and executing the another data loader and then executing the data loader associated with the root node, whereby data is loaded to the data structure consistent with the data hierarchical framework.

Abstract: A regression test generator device configured for real-time monitoring of a user's interaction with an application running within a production environment and definition of a scope of regression testing to be carried out on one or more components of the application in response to changes made within a development environment. The regression test generator device identifies new user flows through an application, and stores the underlying software classes used to facilitate a given task associated with the new user flows. In addition, the regression test generator device monitors software classes changed in a development environment, and matches the changed software classes to one or more flows that are to be regression tested.

Abstract: The invention provides an automatic compiling method for graphical programming, which mainly comprises the following steps of allocating a graphical program memory, allocating a graphical program thread, analyzing a graphical program storage structure and generating a graphical program executable file. An executable file corresponding to a graphical program is generated based on automatic compiling of graphical programming, a user freely combines graphical modules according to functional requirements to form a program, an automatic compiling method for graphical programming is used for compiling the graphical program, and a file which can be directly operated in a controller is generated.

Abstract: Concepts and technologies are disclosed herein for end-to-end validation of virtual machines. A control system including a processor can detect a validation request that can include a request to create an end-to-end validation function to perform end-to-end validation of a service. The processor can analyze a policy to determine components of the end-to-end validation function and a virtual machine that will host the end-to-end validation function. The components can include a generator function and a receiver function that can encompass the service. The processor can load, or trigger loading of, an image to the virtual machine and instantiation of the virtual machine. The image can include the end-to-end validation function. The processor also can validate the service using the end-to-end validation function based upon a test scenario stored in a test library of the end-to-end validation function.

Abstract: Systems, methods and apparatuses may include technology to group data objects of a dataset into first and second groups respectively based on a first and second number of clusters for a search of the dataset, evaluate the first and second groups to determine respective first and second cluster validation indexes, and adjust one or more of the first and second number of clusters based on the first and second cluster validation indexes.

Abstract: A system for performing software testing uses machine learning to extract features from a user interface of an app, classify screen types and screen elements of the user interface, and implement flows of test sequences to test the app. Training is performed to train the system to learn common application states of an application graph and to navigate through an application. In some implementations, the training includes Q-learning to learn how to navigate to a selected screen state. In some implementations, there is reuse of classifiers cross-application and cross platform.

Abstract: A method, system, and computer program product to integrate service management tools with enterprise product development tools to determine Ops readiness scores. The method may include receiving one or more logs of bug tracking information from a client module, where the bug tracking information corresponds to one or more applications with one or more production bugs. The method may also include compiling the one or more logs. The method may also include receiving reports of at least Ops issues of the one or more applications and latest requirements of the one or more applications from a company module, where the latest requirements include at least current deliverables. The method may also include mapping the compiled one or more logs and the reports. The method may also include generating an Ops readiness score for each of the current deliverables, based on the mapping.

Abstract: A method and apparatus are provided that includes, in a same framework, storing an artificial intelligence (AI) model, loading the AI model into a serving platform, loading and testing a test unit against the AI model loaded into the serving platform, and collecting reports from results of storing the AI model, loading the AI model into the serving platform and testing the test unit.

Abstract: Systems and methods for provisioning a mobile device are described. Provisioning of a mobile device may include binding the device to financial account(s) associated with a financial institution computing system or binding an application installed on the device to the financial account(s). Such systems and methods may use ATMs to facilitate communication with the device and retrieve a unique identifier. The unique identifier, whether received from the ATM or through another communication channel, may be used to further verify the identity of a user of the device as well as verify that the device belongs to or is being used by the same user that has the financial. Once the user is verified and the mobile device is determined to belong to or used by the user, the mobile device can be provisioned by binding either the entire device or an application on the device to the financial account(s).

Abstract: A method for memory modification resulting in a test probe for examining a program under test substantially during run-time is provided. The ability to inject faults or errors in order to test a reaction of the program to a fault in a particular state and to individually replace access to a regular operand by accessing a shadow operand allow for non-intrusive tests while the program is substantially executed in real-time. The program itself is not substantially altered for testing purposes.

Abstract: Various methods, apparatuses/systems, and media for implementing an automated testing module are disclosed. A processor creates a draft test suite that incorporates a plurality of features, each feature including a test scenario that comprises steps that describe the test scenario in a human readable form. The processor also compiles the steps of the test scenario into a single step in a reusable format; receives a request to perform a testing for an application; de-compiles the single step, in response to received request, to create a complete list of steps used in the scenario; generates a final test suite based on the de-complied single step in response to the received request; and automatically executes the final test suite to test the application without rewriting code.

Abstract: The present application relates to systems for programming devices, such as unmanned autonomous vehicles or “drones,” with a card-based format and methods for using the same. The system and methods generally comprise a programming system that receives one or more instructional cards selected by a user. The system generates an executable program based on the instructional cards received, and transmits the program to a device for execution.

Abstract: According to an example, persistent memory garbage collection may include determining whether termination of a program is based on a specified termination of the program during execution of the program or an unspecified termination of the program during the execution of the program. In response to a determination that the termination of the program is based on the specified termination of the program during the execution of the program, persistent metadata stored in a persistent memory may be used to restart the program. In response to a determination that the termination of the program is based on the unspecified termination of the program during the execution of the program, the persistent metadata stored in the persistent memory may be used to collect garbage from the persistent memory and to restart the program.

Abstract: A method includes receiving hierarchy data indicating a capability hierarchy associated with a customer network, the capability hierarchy indicating that a first capability is a sub-capability of a second capability. The method further includes receiving application data from a MID server of the customer network, the application data associated with an application utilized by the customer network for the first capability. The method further includes determining, based on the application data, an application score indicating an effectiveness level of the application for the first capability. The method further includes determining, based on the application score, a first capability score associated with the first capability. The method further includes determining, based on the first capability score and the capability hierarchy, a second capability score of the second capability, the second capability score indicating a health metric of the second capability within the customer network.

Abstract: Apparatuses, methods and storage medium associated with cloud computing for mobile client devices are disclosed herein. In embodiments, a cloud server may include one or more processors, and a mobile computing operating system to host execution of an application. The cloud server may also include a cloud application server to interact with a cloud application client of a mobile client device to provide audio and video streams to the mobile client device, and to receive touch, key and sensor events from the mobile client device, to enable the application to be executed for the mobile client device. Other embodiments may be described or claimed.

Abstract: Computerized systems and methods are provided to intelligently and dynamically test one or more changes made to one or more applications. Requirements are received for generating one or more changes to a first application and a second version of the first application is generated with one or more changes. A failure probability value for each change is determined and a first set of tests to be executed on the one or more changes based on the failure probability value are identified and then executed on the second version of the first application. If the second version of the first application passes the first set of tests, it moves on to being tested by a second set of tests which are also based on the determined failure probability values. If the second version of the first application does not pass the first set of tests, the defects are identified and the second version is regenerated to cure the defects.

Abstract: Techniques for designing tests of a service catalog without having to write and/or edit the underlying scripts are disclosed. A library of tests step templates is populated and provided to a user. The tests step templates in the library may be selected by the user and edited to fill in specific parameters that specify the actions to be taken during execution of the test step. The test step may then be combined with other test steps to form a test. In some embodiments, the library may include test templates made up of frequently used sequences of individual test steps. Once a test has been designed, the test may be run, either manually triggered by a user or according to a schedule. The system may then run through the steps of the test, as specified by the user, by running the underlying scripts. As the test is run, results are generated.

Abstract: A method, non-transitory computer readable medium and a computerized system for adaptive regression testing. The method may include (a) generating or receiving monitoring results that are indicative of relevant data segments and relevant source code segments; (b) generating, based on the monitoring results, a first mapping that maps test cases of the multiple test cases to at least some of the relevant data segments; (c) detecting detected data changes introduced during a monitoring period that follows the execution of the regression tests; (d) selecting, based on the detected data changes and the first mapping, one or more selected test cases for evaluating an impact of the detected data changes; and (e) evaluating the impact of the detected data changes by executing the one or more selected test changes.

Abstract: A remote network management platform software application containing application programming interfaces (APIs) may be configured to facilitate the use of plugin software. A particular API may be associated with logic configured to check whether a toggle variable is active or inactive. A first unit of program code may be configured to execute when the toggle variable is inactive, and a second unit of program code may be configured to execute when the toggle variable is active. First plugin software may be implemented in a scripting language. The first plugin software, whether enabled or disabled, might not affect the toggle variable. Second plugin software may also be implemented in the scripting language. The second plugin software, when enabled, is configured to set the toggle variable as active.

Abstract: Systems and methods are disclosed that determine a duration and resources for testing software. In some implementations, the system performs operations including determining functions performed by applications of the software product, and determining categories based on the functions, the categories including a lowest-criticality category and a highest-criticality category. The operations also include determining degrees of change to the applications and test scripts corresponding to the degrees of change. The operations also include generating a data structure based on the categories and the degrees of change, the data structure including columns identifying the categories in an order from lowest to highest criticality. The operations also include determining weights corresponding to distances of the categories from the highest-criticality category.

Abstract: A computer-implemented method, system, and computer program product for rendering a visualization. A computer program executes steps in a rendering sequence to render a visualization for a host application. The steps comprise default steps. The computer program is configured to include additional steps provided by the host application in the steps of the rendering sequence to include a host application visualization feature in the visualization. The visualization is displayed on a display device.

Abstract: A method displays a chart that includes visual marks representing a data set, displayed according to contents of displayed shelf regions, which determine characteristics of the chart. The method detects selection of a plurality of visual marks, and visually emphasizes the selected plurality of visual marks. The method also detects a first input on one of the selected marks, and displays a moveable icon corresponding to the selected visual marks while maintaining display of the visual marks. The method detects a second input on the moveable icon, and moves the moveable icon over a first shelf region. Upon ceasing to detect the input, the method updates the content of the first shelf region based on the selected visual marks, and updates the chart in accordance with updated content of the first shelf region.

Abstract: Tracing computer software program execution includes copying a software instruction at an instrumentation point within an original instruction stream, and replacing the software instruction with a jump instruction. The jump instruction branches to a multi-level trampoline that includes at least a first-level trampoline specific to an associated software tracing probe, and a second-level trampoline generic to plural software tracing probes. The first-level trampoline preserves partial CPU state and branches to the second-level trampoline, passing it software tracing probe identifying information. The second-level trampoline preserves a remainder of the CPU state, implements software tracing operations in accordance with the software tracing probe, restores the CPU state that it previously preserved, and returns program control to the first-level trampoline. Either the first-level or second-level trampoline may execute or emulate the original instruction.

Abstract: Techniques are provided to use historic execution state information to visualize tracepoint data. For example, historic execution state information corresponding to an application's previous execution is accessed. This historic execution state information was collected while the application was executing. After correlating the historic execution state information to the application's code, a tracepoint is associated with a portion of the code. Consequently, when the code is replayed based on the historic execution state information, the tracepoint causes a behavior of that code portion to be logged while the code is replayed uninterrupted. The code is then actually replayed based on the historic execution state information. During the replay, the tracepoint causes the behavior of the code portion to be logged. The logged behavior is visualized on a user interface.

Abstract: Style sheets for resources are generated during runtime. Style sheets may be generated using current values for attributes of a resource. A new style sheet may be generated, at runtime, after a request for the resource has been received. The resource is modified to reference the new style sheet and the modified resource is transmitted to the client device. The new style sheet is transmitted to the client device in response to another request, from the client device, for the new style sheet identified in the modified resource.

Abstract: A method for real-time remediation of a software script includes, during execution of the script, attempting to identify a first user interface (UI) object. In response to failing to identify the first UI object, similarity scores are calculated based on the data of the plurality of UI objects and historical data associated with the first UI object. A second UI object is identified, from the plurality of UI objects, based on the calculated similarity scores. The script and/or an object repository referenced by the script are then automatically modified so that subsequent execution of the script includes attempting to identify the second UI object instead of the first UI object.

Abstract: Disclosed herein is a method and system for migrating automation assets in an enterprise system. The method includes receiving, by an asset management system, an input data associated with the automation assets from a source application. Also, the method includes configuring a first set of data types associated with the input data, by identifying a corresponding data type from a second set of data types, configured in a target application. Further, the method includes generating a relationship between each of a plurality of entities associated with the first set of data types and a corresponding plurality of entities associated with the second set of data types in the target application. Finally, the method includes migrating the plurality of entities associated with the first set of data types from the source application to the target application based on the generated relationship.

Abstract: Method and apparatus for automatically generating, verifying and using software bindings. A function collector extracts functions from a library written in a first computer language in the form of exposed application program interfaces (APIs), and writes identifying information for the functions to a knowledge base. A document collector concurrently extracts human readable text, such as in the form of embedded comments and user manual documentation, and links this text in the knowledge base to the extracted functions. A set of generators operate to generate software language bindings and a user interface to enable a user to activate and review the human readable text using a different, second computer language. A test script generator can automatically validate operation of the software language bindings using verified test data sets.

Abstract: A system and method include detection of a set of sequential interactions with a user interface, storage of a recording comprising data associated with a set of sequential calls to a user interface entry point application programming interface of a server application caused by the set of sequential user interface interactions, association of the recording with an incident identifier, reception of a request to analyze an incident associated with the incident identifier, and, in response to the request, initiation of playback of the recording, wherein playback of the recording comprises reading of the data of the recording and, based on the read data, issuing the set of sequential calls to the user interface entry point application programming interface of the server application.

Abstract: Unstructured data items are stored at an object storage service. A filtering requirement to be used to generate a result set for an access request is determined. Using a transformed representation of the filtering requirement, a target set of tokens of the filtering requirement which are to be obfuscated within a log record is identified. A log record that comprises substitute tokens for the target set of tokens is generated and stored.

Abstract: Systems and methods are provided for executing a program that produces one or more data streams. A visual graph can be generated based at least in part on the data streams. A given data stream can be represented in the visual graph as a dot and a connection between a pair of data streams can be represented in the visual graph as an arc connecting a pair of dots representing the pair of data streams. The visual graph can be provided for presentation through an interface. The visual graph can provide a visual representation of an execution state of the program during execution.

Abstract: A novel and useful system and method of time traveling source code debugging including several advanced capabilities that significantly improve the source code debugging process. Upon hitting a breakpoint or opening a dump file, the debugger travels to the future which can be altered by a user by modifying code on the fly (live coding) and receiving immediate feedback to validate bug fixes. Visual annotations including values of variables and expressions are provided as a heads up display effectively flattening time and space. A pivoting capability allows a user to switch the execution context of the code at any time. Point in time links that store the state of the debugging session can be created and activated. An asynchronous collaboration and messaging system enables multiple participants to share a debugging session. An optional redaction capability is also provided for obscuring or replacing sensitive private information.

Abstract: A computer-implemented method includes downloading respective instances of an enterprise mobile application to a plurality of mobile devices. The instances of the enterprise mobile applications, while executing on respective mobile devices, capture, for each session, a session log that includes indications of ordered user actions occurring during the session, and optionally time intervals between user actions and/or user attributes. Captured session logs stored at and are mined by one or more servers to discover a particular pattern or sequence of user actions that occurred across multiple, different user sessions. If the number and/or rate of occurrences of the particular pattern is greater than a threshold, a new test case corresponding to the pattern is automatically generated and added to a suite of test cases for the UI functionality of the enterprise mobile application. The updated test suite may be automatically executed on a test version of the enterprise mobile application.

Abstract: A computer-implemented method of simulating automation applications based on input from a user includes a computer creating a system design in a three-dimensional workspace based on one or more instructions provided by the user. The system design comprises a sensor component representative of a physical sensor controlled by a physical controller, and one or more detectable components representative of objects detectable by the physical sensor. The computer assigns a tag value to each of the one or more detectable components and executes a simulation of the system design in response to a command from the user. The sensor component simulates detection of the one or more detectable components using the tag value assigned to each respective detectable component.

Abstract: Methods and systems are presented for automatically configuring a staging environment to facilitate testing of online use-case scenarios for an online service provider. In response to receiving a request to test an online use-case scenario, a user account configuration may be derived from the use-case scenario. Account data for creating a user account is generated based on the user account configuration. The account data is inserted into a database of the staging environment to create the user account within the staging environment. A workflow associated with the online use-case scenario is automatically performed based on the newly generated user account in the staging environment. One or more defects observed while performing the workflow is reported to a user.

Abstract: A method and apparatus for certification of facts introduces a certifier and a fact certificate into the fact-exchange cycle that enables parties to exchange trustworthy facts. Certification is provided to a fact presenter during the first part of the fact-exchange cycle, and verification is provided to the fact receiver during the last part of the cycle. To request a certification, a fact presenter presents the Certifier with a fact. In return, the certifier issues a fact certificate, after which the fact presenter presents the fact certificate to the fact receiver instead of presenting the fact itself. The receiver inspects the received certificate in order to evaluate the fact's validity and trustworthiness. For some facts and notions of verification, the certificate is sufficient and its inspection does not require any communication. For others, the receiver requests a verification service from the Certifier in order to complete the verification.