Abstract: A method and system for debugging SQL statements by computing and saving to memory metadata for each component part of the statement. The system includes a user interface, memory, and a processor, the processor configured to compute and save to memory metadata of SQL statements. The stored metadata may be used for later computation of modified SQL statements. The metadata may also be displayed through a user interface to assist a user in the process of debugging component portions of an SQL statement.

Abstract: A method and system for predicting post-upgrade outcomes in information technology environments through proactive upgrade issue testing. At least with respect to computing, an upgrade may entail the replacement of a product—in the form of hardware, software, and/or firmware—with a newer or better version, which may serve to bring the product up to date, improve the characteristic(s) of the product, and/or resolve any issue(s) inflicting the product. Further, the process of upgrading a product in view of an issue therein is often reactive—that is, it is often required that a customer experiences and reports an issue for a product to a vendor prior to the issuance of an upgrade to the customer that addresses the issue for the product by the vendor. Presently, what is lacking is a mechanism through which product upgrades may be presented to customers proactively in order to minimize product failure and/or downtime.

Abstract: A system including first computer memory storing a full data set representable in rows and columns, a second computer memory storing executable instructions, and processors configured to execute the instructions to cause presentation of data of the full data set on a display including columns of data each having data fields, receive user input identifying a column of the data set, determine items to modify in information in the data fields of the identified column, generate and cause display of an indication of a proposed change action to modify the determined items, and in response to a user input indicating a selection of the indication of the proposed change action, update the presentation of the data based on the change action to modify information displayed in the data fields of the identified column of the data, and store a log of the change action.

Abstract: A device and method for analyzing a performance of an n-tier application capable of carrying out on-the-fly anonymization processing of production data. The production data is generated following a performance test request message transmitted to the n-tier application. The anonymization processing is implemented by an anonymization module that identifies, from a sensitive data identification repository, data to be anonymized in the response message. The anonymization processing also includes generating, from an anonymization repository, anonymized data from the previously identified data to be anonymized, and generating an anonymized response message from the anonymized data and the response message.

Abstract: Embodiments of the present disclosure are directed to, among other things, providing resource allocation advice, configuration recommendations, and/or migration advice regarding data storage, access, placement, and/or related web services. In some examples, a web service may utilize or otherwise control a client instance to control, access, or otherwise manage resources of a distributed system. Based at least in part on one or more resource usage checks and/or configuration checks, resource usage information and/or configuration information of an account utilizing a web service, and/or user preferences and/or settings, resource allocation advice, system configuration recommendations, and/or migration advice may be provided to a user of an account. Additionally, in some examples, one or more remediation operations may be performed automatically.

Abstract: Techniques for evaluating software systems are provided, including measurement of performance ratings of features of an app-under-test are described. The evaluation may include analysis of a video recording of the user interface of the app-under-test, where the video analysis may include comparing the changes over time of co-located pixel in the video to produce a performance rating, for example a speed index. The results of multiple such tests can be compared by comparing the performance rating produced during execution of different tests.

Abstract: In one aspect, a computerized method useful for automated software testing comprising: writing a test suite in a human-readable language; implementing an Artificial Intelligent (AI) process test suite; and creating a set of scripts, data, and execute tests.

Abstract: A method identifies a proposed change associated with a source code file that comprises changed content, identifies a review comment associated with the proposed change, wherein the review comment is further associated with reviewed content of the source code file, presents, via a user interface, a notification indicating that the proposed change has been reviewed, receives, via the user interface, a request to present the review comment, and, responsive to receiving the request to present the review comment, presents, via the user interface, the review comment in association with the reviewed content. The review comment may be presented in visual association with the reviewed content in the user interface. A line of text of the review comment may be presented at a location adjacent to a line of text of the reviewed content in the user interface.

Abstract: The instant invention provides a Dynamic Enterprise Application Platform and a method accordingly for development of application software in a computer system in which users develop application software for their enterprise without the assistance of software consultants. The platform comprises an Enterprise Software Design Model which works with and an Enterprise Software Engine. Data and information gathered by users are configured by the Enterprise Software Design Model and saved into database in the Enterprise Software Engine. The Enterprise Software Engine performs a mapping and reduction procedure to create functional enterprise software application using visual editor with drag and drop interface.

Abstract: A method that includes identifying a processing error, obtaining user input information for a determined period prior to identifying the processing error, determining steps undertaken during the determined period prior to identifying the processing error based on the input information, and obtaining context awareness information related to the one or more processors. The method also includes obtaining network user input information and network context awareness information related to the processing error from other electronic devices within a network, determining a reduced amount of steps from the steps undertaken during the determined period to identify the processing error to form an error reproduction plan by analyzing the network user input information and the network context awareness information in comparison to the user input information and context awareness information, and communicating the error reproduction plan to a user or third party.

Abstract: Methods, computer-readable media, software, and apparatuses may determine source code keywords via analysis of a source code file, map the source code keywords to test keywords, based on a similarity between the source code keywords and the test keywords, wherein the test keywords are associated with test cases, and cause execution of one or more of the test cases. Artificial intelligence driven testing utilizes artificial intelligence in analysis of source code and may automatically select and perform tests on the source code based on results of the analysis.

Abstract: Described herein are methods, computer program products, and computer systems for video-based user interface (UI) application testing. The method includes receiving first test video data corresponding to test video images of an application executing on a first UI, generating the test video images on a first display, generating application video images on a second display. Further, the method may include determining that a first frame of the test video images and a second frame of the application video images fail to satisfy a predetermined similarity threshold, generating a third UI comprising the second frame of the second UI on a third display, receiving user inputs at the third UI for a first duration, capturing replacement test video images from the third display for the first duration, and generating second test video images, wherein the first frame of the test video images is replaced by the replacement test video images.

Abstract: The disclosed embodiments provide a system that modifies execution of a target process in a computer system. During loading of a marker library by a target process, the system modifies import dependency data of the marker library to include an injection library as a dependency of a marker library. After the modified import dependency data is used to load the injection library into the target process by the operating system or loader, the system executes the injection library prior to execution of the marker library to revert the import dependency data to an original state and modify execution of the target process.

Abstract: A system configures a test case including a test script to validate a new product. The test script has a logic flow for communications through a sequence of network nodes and the test case includes pass/fail criteria for parameter data of packets communicated between the sequence of network nodes. The system initiates an automation engine that is configured to execute the test script and validates the new product based on actual parameter data relative to the pass/fail criteria. The system simulates the enhanced calling or messaging communications service to utilize by the new product during the test. The system instantiates a network probe that captures packets of the network nodes and extracts actual parameter data, which is compared to expected parameter data to generate test results relative to the pass/fail criteria. The system can present an indication that the new product passed/failed the test case based on the test results.

Abstract: A method for processing a medical image is provided. The method may include obtaining the medical image, and processing the medical image using a processing program. The processing program may include one or more optimized computation units. The one or more optimized computation units may be optimized by an instruction set supported by the at least one CPU. The instruction set may be configured to optimize at least one of an operation time of the processing program, a resource of the at least one CPU occupied by the processing program, and a count of instructions included in the processing program.

Abstract: A library model addition engine adds library models to a library knowledge base by defining a template for a library configuration file that conveys information about each library model, custom inputs and code snippets to facilitate library comparison operations, and education content for the library model, where the library configuration file template may be automatically filled by populating selected data fields in the template with information identifying the library model and a set of custom inputs for the library model, and then passing a set of test cases from the set of custom inputs to an input/output matching engine to evaluate a repository of code snippets and identify a set of functionally similar code snippets for inclusion one or more data fields in the template.

Abstract: A device configured to identify automated process instructions for a network device. The automated process instructions include instructions for performing a series of actions on the network device. The instructions include machine-executable code partitioned into a plurality of code segments using breakpoints where each breakpoint temporarily pauses the execution of the machine-executable code between a pair of code segments. The device is further configured to identify a first time instance for executing the automated process instructions that does not occur within a time interval associated with a system update for the network device. The system update is configured to modify one or more settings on the network device. The device is further configured to execute the machine-executable code at the first time instance to perform the series of actions on the network device.

Abstract: A scalable test workflow service facilitates management, automated generation and execution of numerous test cases. Test definitions representing tasks to be executed to validate a capability, parameter providers that provide metadata options, and step executors that execute the individual steps of the tasks are all specified. In response to a request to perform a test, an iterative process builds, based on the test definitions and the corresponding parameters, test instances that are executed to obtain the test results. For example, a run tests workflow initiates a test initialization workflow for each test definition. The test initialization workflows call the parameter providers to obtain parameter combinations used to create test instances, and initiate test execution workflows for each parameter combination. Each test execution workflow calls a step executor for each step of the test definition using parameters for the test instance, and returns the results. Results are aggregated and returned.

Abstract: A method and apparatus are provided that includes, in a same framework, storing an artificial intelligence (AI) model, loading the AI model into a serving platform, loading and testing a test unit against the AI model loaded into the serving platform, and collecting reports from results of storing the AI model, loading the AI model into the serving platform and testing the test unit.

Abstract: A computer-implemented method includes downloading respective instances of an enterprise mobile application to a plurality of mobile devices. The instances of the enterprise mobile applications, while executing on respective mobile devices, capture, for each session, a session log that includes indications of ordered user actions occurring during the session, and optionally time intervals between user actions and/or user attributes. Captured session logs stored at and are mined by one or more servers to discover a particular pattern or sequence of user actions that occurred across multiple, different user sessions. If the number and/or rate of occurrences of the particular pattern is greater than a threshold, a new test case corresponding to the pattern is automatically generated and added to a suite of test cases for the UI functionality of the enterprise mobile application. The updated test suite may be automatically executed on a test version of the enterprise mobile application.

Abstract: An embodiment of a method can create a directed acyclic graph (DAG) from a programmer specified set of computation units to solve, in a computer program, physics based simulations of physical systems, and the DAG can be used to analyze and debug the computer program. In this method, the computer program can be created by automatically determining dependency relationships in the set of computation units and automatically schedule their execution. The method can also automatically allocate memory for the computation units.

Abstract: A user interface (“UI”) code coverage system and process determines the coverage by test code of UI Components in a computer program. In other words, the UI code coverage system and process determine whether the test code tests a UI Component. In at least one embodiment, the UI code coverage system and process identify the particular UI Components tested by the test code, provide coverage (i.e. tested) statistics, provide a visualization of the UI Component tested, provide a visualization of tested and not-tested (also referred to respectively as “covered” and “not covered”) UI Components of a UI Screen.

Abstract: Systems and methods of assessing climate transition risk. A computing system receives a user indication of a selected climate change scenario from a remote client device. The system identifies one or more energy factors from among energy sources. The system retrieves historical financial information directed to one or more securities from remote financial data sources. The system predicts one or more future returns for the securities, by applying the historical financial data and the energy factors to at least one hierarchical linear model. The system adjusts the predicted future returns based on a first climate scenario and the selected climate scenario, to form respective first and second adjusted returns. The system generates a climate transition risk for the securities based on a spread between the first adjusted returns and the second adjusted returns. The system provides a data set representing the climate transition risk to the remote client device.

Abstract: In some embodiments, a method comprises obtaining a pipeline of operations, the pipeline of operations including a plurality of functions providing any of one or more modification operations or visualization operations for a plurality of datasets. A first dynamic visualization of the pipeline of operations at a first level of granularity is generated. A second dynamic visualization of the pipeline of operations at a second level of granularity is generated in response to user input.

Abstract: Various methods, apparatuses/systems, and media for automatic risk-based testing of an application are disclosed. A processor accesses a database to obtain data corresponding to a plurality of test results of test runs conducted over a certain period of time for a set of plurality of tests and data corresponding to a change set; generates historical data based on the data corresponding to the plurality of test results and the change set; assigns a test failing probability value for each test among the set of plurality of tests based on analyzing the historical data; identities a first test whose assigned test failing probability value is below a predetermined threshold value; and filters out the identified first test from the set of plurality of tests whose assigned test failing probability value is below the predetermined threshold value so that the identified first test is not utilized for future test runs.

Abstract: The disclosed technology teaches correctly assembling a sequence of components for interacting with a user, including providing a sequence setup GUI with components that accept inputs and have input chain dependencies and outputs. The GUI supports construction of an executable sequence by connecting at least five of the components in a directed graph and tracing multiple paths through the components in the directed graph, resulting from at least one conditional branch at a first component, as the components are connected in the directed graph. Also taught is testing whether input chain dependencies of components under evaluation are satisfied when the components are invoked following any of the multiple paths and locating at least one error in use of a second component that results from failure to satisfy the input chain dependencies of the second component and reporting the error to a user, before executing the sequence and causing the error.

Abstract: A computer-implemented method dynamically detects and corrects an error in a query. The method includes identifying an error in a first query. The method further includes generating a set of alternate execution structures for the first query. The method includes running each of the alternate execution structures, including generating a set of results corresponding to each set of alternate execution structure, comparing each of the set of results against each other of the set of results, and storing each of the set of alternate execution structures to include a result of the set of results, for each alternate structure. The method further includes selecting, from the set of alternate execution structures, a first alternate execution structure based on a predetermined criteria, and implementing the first alternate structure in place of the first query.

Abstract: A method and apparatus for performing a user interface test by a middleware server including determining a state change of a portion of the user interface, receiving a test command indicative of a user interface functional test from a test interface, determining an auxiliary test associated with the test command, generating an altered test command requesting performance of the user interface functional test and the auxiliary test, transmitting the altered test command to the user interface, receiving a functional result from the user interface in response to the altered test command, generating an altered test result indicative of the functional result, and transmitting the altered test result to the test interface.

Abstract: A system for performing remote usability testing of a website includes a module for generating particular tasks, a module for moderating a session with a number of participants, and a module for receiving usability data. The system further includes an analytics module for analyzing the received usability data. The module for generating the particular tasks includes a research server configured to interface with user experience researchers and storing multiple testing modules for selecting qualified participants from the number of participants and for generating the particular tasks having research metrics associated with a target web site. In an embodiment, the research server randomly assigns one or more of the multiple testing modules to one of the participants. The multiple testing modules may include card sorting studies for optimizing a web site's architecture or layout.

Abstract: A code coverage method for an embedded System on Chip (SoC) includes detecting a presence of a utility function in target source code; adding a hook function to the target source code; and recording at least one property of the utility function based on the hook function in a bit array in a memory of the SoC. The method may further include extracting at least one recorded property from bit arrays in the memory; and generating a code coverage report based on an analysis of the extracted properties.

Abstract: A system receives binary data and first identification data. The binary data includes hashes of strings of bits, bytes, words or characters. The system receives vulnerability data and second identification data. The system determines a correspondence between the binary data and the vulnerability data based on matching the first identification data with the second identification data. The vulnerability data includes a country of origin for a product identified by the second identification data. The system generates a binaries-to-vulnerabilities database. The system scans target binary data from a target device to to find matches between the target binary data and the binary data using the binaries-to-vulnerabilities database. The system determines a known security vulnerability based on the results of the scanning and the correspondence between the binary data and the vulnerability data. The known security vulnerability includes the country of origin for the product in the target device.

Abstract: In an aspect, a test platform for testing an embedded control system having a plurality of interconnected components is operable to: receive, at run time, configuration data for configuring a system under test (“SUT”) representing the embedded control system, the configuration data specifying: which of the components shall be simulated versus hardware-in-the-loop (HIL) components in the SUT; and an inter-component signal mapping that maps input signals to output signals of the specified simulated or HIL components of the SUT; for each of the simulated or HIL components, automatically activate, at run time, a corresponding object code portion for simulating the embedded system component in the test platform or a corresponding object code portion for facilitating communication with the HIL component connected to the test platform, respectively; and automatically map input signals of the activated object code portions to output signals of the activated code portions according to the signal mapping.

Abstract: Systems and methods to enable on-the-fly modification of running processes on a webserver more quickly and efficiently are discussed herein. A code vault is used to store binaries for use in production code running on a server, which are downloaded and implemented in the running process when authorized by developers. The process retrieves the binaries from the code vault to deploy the modifications to a specified audience without having to re-instantiate or run a parallel process with the new binaries. Binaries for different audiences or subsequent experiments may be downloaded onto the same machine, but remain isolated. Control of the deployments may require multi-factor or multi-user authentication and are logged for change control.

Abstract: A software development infrastructure can enable user developers to select remote hardware devices to develop and test their software programs. For some tests and development activity, physical access to the remote device can be provided by the infrastructure administrator by replacing the internal calls of an application with mimic code, which can respond to application requests for sensor data, as if the user was physically handling the remote device at the same location.

Abstract: Systems and methods are provided for using encoded representations of numbers in various applications. The encoded representations of numbers, also referred to as number embeddings, may be multi-element data structures (e.g., multi-dimensional vectors) in which each element is a real-numbered value. The values of a given number embedding collectively encode information from which properties of the number represented by the number embedding may be derived. Number embeddings may be compared or otherwise analyzed with respect to each other to identify patterns or similarities in the numbers represented by each number embedding.

Abstract: The disclosed technology teaches testing with a test parameter data structure, applied to an AUT that operates in both API and UI mode, processing a configurable script to test in both modes. UI mode renders and interacts with UI elements utilizing values stored in the structure, used by the script in both modes, providing display mark-up in the script that is rendered in UI mode and formats fields to receive data that map to specific elements, leaving to be completed a mapping connection between the fields in the display and specific elements in the structure. The method includes providing a mapping of fields to elements, based on names, and while processing the script in UI mode, rendering the mark-up from the script, using a bot to interact with and complete the mark-up, applying the mapping to identify elements to complete fields, and causing processing of the fields in the mark-up.

Abstract: A method may include obtaining first cybersecurity data using a hardware probe disposed within a network. The first cybersecurity data may correspond to an analysis of the hardware probe regarding network data that is transmitted through the network. The method may further include obtaining second cybersecurity data using a software probe operating on a network element within the network. The second cybersecurity data may correspond to an analysis of the software probe regarding one or more configuration settings of the network element. The method may further include determining a cybersecurity maturity score using the first cybersecurity data and the second cybersecurity data. The cybersecurity maturity score may be based on a maturity model. The method may further include transmitting, based on the cybersecurity maturity score, a remediation command that adjusts a configuration setting of the network.

Abstract: An error revision suggestion method for customized software integration applications may comprise storing a plurality of customized software integration applications for specific integration processes for transforming data to enable electronic data exchange, generated from a customized visual model with a plurality of visual modeling elements representing customized executable code sets. The method may further comprise transmitting an executable run-time engine for a first of the plurality of customized software integration applications and a first customized code set for execution at a specific user business process system, receiving an indication an error has occurred during execution of the first customized code set, and transmitting an instruction to the user indicating a correction to erroneous user input is required to resolve the error if the error is associated in a resolve database with a previously executed correction to erroneous user input.

Abstract: An electronic product testing system includes: a testing device configured to generate and to provide a digital image that includes a feature of a product being tested, and to provide product testing instruction for the product; and a tracking device configured for tracking a cursor movement with respect to the digital image, and/or a selection of an item in the digital image, and to generate product testing data based on a result of the tracking; wherein the tracking device is also configured to output the product testing data for storage in a non-transitory medium, the non-transitory medium having a database structure that is configured to store the product testing data in association with the digital image and the product testing instruction.

Abstract: A method for performing sentiment analysis on Arabic text may be described. Training text data may be preprocessed by removing non-Arabic characters, numbers, control characters or graphics. Since Arabic words may include the same letters but written in a different format, an embodiment may identify common letters and unify them in order to remove or avoid duplicates. An annotator may label portions of the data, such as words, terms, or phrases, as positive, negative. A lexicon may be formed based on the labeled training data. The bag-of-phrases may be formed from the training text data, which may be used to analyze the targeted data for sentiment. Based on the distribution of words or phrases, a sentiment may be formed indicating a sentiment of each portion of the target data.

Abstract: An integrated code inspection framework using check variants is provided herein. Integrated code inspection can include associating a check variant with a development object in a development project. Additionally, a check variant can be associated with a development project. A check variant associated with a development project can cascade to development objects in the development project. A check variant associated with a development object can cascade to related development objects, based on their hierarchical relationship. A check variant can be executed against a development object to identify code which triggers check rules of the check variant. The check variants executed can come from the development project or related development objects based on the cascade of check variants. Results of the code inspection via the check variants can be aggregated and displayed in a user interface, and integrated with the code of a development object.

Abstract: An electronic product testing system includes: a testing device having a processing unit configured to provide a digital image that includes a feature of a product to be tested based at least in part on an instruction file; wherein the testing device is configured to test the product based at least in part on a set of digits by submitting the set of digits for processing by a repository.

Abstract: Systems and methods for visualizing and/or analyzing trace data collected during execution of a computer system are described. Algorithms and user interface elements are disclosed for providing user interfaces, data summarization technologies, and/or underlying file structures to facilitate such visualization and/or analysis. Trace data history summarization algorithms are also disclosed. Various combinations of the disclosed systems and methods may be employed, depending on the particular requirements of each implementation.

Abstract: Methods, apparatus, and systems for traversing a representation of an application source code, such as an abstract syntax tree (AST), are disclosed. Steps for traversing the AST include specifying a plurality of runtime binding rules which are associated with one or more locations within the AST, beginning to traverse the AST, monitoring a history of the traverse, continuing to traverse the AST based on the history of the traverse, and updating the history of the traverse. Continuing to traverse the AST may include identifying a plurality of concrete implementations of a method invocation and traversing less than all of the concrete implementations based at least in part on the runtime binding rules, the concrete implementations being traversed being selected based on the history of the traverse.

Abstract: Dump data of a memory is allowed to be easily and appropriately managed. In a storage apparatus including a CPU, a DRAM, and a drive, the CPU executes storage processing to store data of the DRAM to be stored into the drive as dump data upon a failure occurrence in the storage apparatus. The CPU deduplicates the dump data in the storage processing or after storing the dump data into the drive. The CPU may execute deduplication processing between the dump data and other dump data stored in the drive or may execute deduplication processing within the data to be stored.

Abstract: A method for performing an automated computer test that causes a test computer system to control a graphical user interface (GUI) of a system under test (SUT). The method includes: a) receiving a reference image representative of an expected image on the GUI of the SUT, the reference image having an image boundary; b) identifying whether one or more text characters are present within the image boundary; c) responsive to any identified text characters in step b), defining a mask region within the reference image boundary based on the identified text characters; d) identifying a transformed expected image on the GUI of the SUT using one or more transforms of the reference image, the identifying comprises matching an unmasked portion of a transformed reference image to a portion of the GUI; e) responsive to the identification of a transformed expected image, performing subsequent operations and/or verification steps on the SUT.

Abstract: Embodiments described herein include systems and methods for encapsulating HTML. A remote browser executing on a server may be configured to provide a document object model (DOM) of HTML of a webpage rendered by the remote browser at the server. A transcoding agent executing in the remote browser may be configured to encapsulate the HTML. The transcoding agent may be configured to send the encapsulated HTML via a remote delivery session to a local browser for rendering. The local browser may execute on a client device and may maintain a DOM for the encapsulated HTML. The transcoding agent may be configured to receive events corresponding to the DOM maintained by the local browser. The remote browser may further be configured to cause the received events to execute on the DOM provided by the remote browser.

Abstract: Systems, computer program products, and methods are described herein for intelligent code update for a test automation engine. The present invention is configured to receive, from a test automation engine, one or more exceptions associated with one or more automated test scripts; initiate an execution one or more machine learning algorithms on the one or more exceptions; classify the one or more exceptions into one or more exception types; generate an exception handling routine based on at least classifying the one or more exceptions into the one or more exception types; initiate an execution of the exception handling routine on the automated test script, wherein the exception handling routine comprises computer instructions for updating a source code of the one or more automated test scripts; and initiate an execution of the one or more updated automated test scripts on the test automation engine.

Abstract: A code completion tool uses a neural transformer model to generate candidate sequences to complete a line of source code. The neural transformer model is trained using a conditional language modeling objective on a large unsupervised dataset that includes source code programs written in several different programming languages. The neural transformer model is used within a beam search that predicts the most likely candidate sequences for a code snippet under development.

Abstract: An aspect includes displaying a list of test case functions via a user interface. Each of the test case functions includes a corresponding set of instructions that is extracted from a development application, and each of the test case functions is configured to execute an atomic action with respect to a test case. The set of instructions is transparent to a user of the user interface. An aspect further includes receiving, via the user interface, a user-inputted selection of the test case functions from the list. For each test function of the selected test case functions, an aspect includes displaying, via the user interface, a field for receiving a device identifier for a device subject to the test case; receiving, via the user interface, a user-inputted device identifier; assembling the test case from the selected test case functions and the device identifier; and executing the test case for the device.