Testing Or Debugging Patents (Class 717/124)
  • Patent number: 10983786
    Abstract: Examples for automatically evaluating a software project requirement are disclosed. In an example, a neural word vector corresponding to a requirement file is generated and the neural word vector based on a score based vector is updated. An output vector comprising a conditional probability distribution of a plurality of answers associated with a plurality of questions identified from the updated neural word vector is generated. Further, a set of input parameters associated with at least one of the software project and the requirement is obtained. Based on the output vector and the set of input parameters, an effort required for completing the requirement may be estimated. A validation score associated with the requirement based on the output vector and a plurality of validation and classification parameters may be determined.
    Type: Grant
    Filed: August 5, 2019
    Date of Patent: April 20, 2021
    Assignee: ACCENTURE GLOBAL SOLUTIONS LIMITED
    Inventors: Rakeshkumar Harsukhlal Sodha, Mihir Nanal, Sasmita Pattajoshi
  • Patent number: 10984102
    Abstract: Systems, methods, and software can be used to analyze security risks of a set of binary software code based on its functional context. In some aspects, a computer-implemented method comprises: receiving, by a server, a set of binary software code; determining, by the server, a functional context of the set of binary software code; determining, by the server, a security risk assessment of the set of binary software code; retrieving, by the server, a plurality of security risk assessment of other software codes having a same functional context as the functional context of the set of binary software code; comparing, by the server, the security risk assessment of the set of binary software code and the plurality of security risk assessments of other software codes having the same functional context; and generating, by the server, a security notification indicating a result of the comparing.
    Type: Grant
    Filed: October 1, 2018
    Date of Patent: April 20, 2021
    Assignee: BlackBerry Limited
    Inventor: Adam John Boulton
  • Patent number: 10977161
    Abstract: In a method for automatically testing a service via a programming interface of the service includes, a set of operation descriptions describing a set of operations supported by the service is obtained. The set of operation descriptions includes respective descriptions of requests associated with respective operations in the set of operations and responses expected in response to the requests. Based on the set of operation descriptions, dependencies among the requests associated with the respective operations are determined, and a set of test request sequences that satisfy the determined dependencies is generated. Test request sequences in the set of test request sequences are executed to test the service via the programming interface of the service.
    Type: Grant
    Filed: May 30, 2018
    Date of Patent: April 13, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Patrice Godefroid, Marina Polishchuk, Evangelos Atlidakis
  • Patent number: 10970090
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for a self-learning robotic process automation are disclosed. In one aspect, a method includes receiving an automated script that includes one or more commands and that is configured to interact with graphical elements that appear on a user interface. The method further includes executing a command of the one or more commands of the automated script. The method further includes determining that an error occurred during execution of the command of the one or more commands of the automated script. The method further includes determining a modification for the command by applying a script repair model. The method further includes executing the modified command. The method further includes determining whether the error or another error occurred during execution of the modified command. The method further includes determining whether to update the automated script with the modified command.
    Type: Grant
    Filed: March 5, 2019
    Date of Patent: April 6, 2021
    Assignee: Accenture Global Solutions Limited
    Inventors: Simon Hall, Vitalie Schiopu, Jeroen van den Heuvel, Adrien Jacquot
  • Patent number: 10970055
    Abstract: A method is provided for building calling context trees of an application to identify a thread or a device affecting a throughput of a transaction relating to the application. The method obtains profiles of call stacks of multiple threads. The method obtains wake-up profiles which are the call stacks of a notifier thread and a waiter thread, from among the multiple threads, in a case that the waiter thread leaves from a sleep state. The method builds the calling context trees to indicate transitions of methods tracing callee relations and wake-up relations based on the profiles of the call stacks and the wake-up profiles, wherein each method is represented by a node having an average thread number. The method extracts and displays tree portions which are transitively reachable from a calling context tree for the transaction and which include the thread or device affecting throughput.
    Type: Grant
    Filed: August 21, 2018
    Date of Patent: April 6, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Tatsushi Inagaki, Yohei Ueda, Moriyoshi Ohara, Yu Chin Fabian Lim, Chun Hui Suen, Venkatraman Ramakrishna, Takuya Nakaike
  • Patent number: 10965663
    Abstract: The automatic troubleshooting of failed single sign on attempts via an identity provider to a service provider. When an error message is encountered due to that failed single sign on attempt, that error message is used to automatically identify a root cause of the failure of the single sign on attempt. In some embodiments, a resolution of the failure is also identified, and a tool for the resolution automatically provided to the user. Such failures in single sign on attempts usually are due to improper configuration information being provided to the identity provider. The principles described herein allow a user to test ahead of time whether they have provided proper configuration information to the identity provider, and potentially correct any problems in the single sign on experience in advance, perhaps well in advance of actually needing a resource provided by the service provider.
    Type: Grant
    Filed: July 26, 2018
    Date of Patent: March 30, 2021
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Mayukh Ray, Luis Carlos Leon Plata, Ivona Furtado
  • Patent number: 10956302
    Abstract: Selected information to be used for code coverage collection of an application is obtained. The selected information is a subset of debug information determined for the application and includes entry point offset information for entry points of the application. Using the entry point offset information, one or more traps are installed in the application. Code coverage collection is performed, in which a determination is made as to whether a trap has been reached. Based on the trap being reached, reach information is provided. The reach information is used to determine code being utilized in the application and for which one or more test cases are to be specifically targeted, rather than testing the application in its entirety, to reduce cycle time within the processor.
    Type: Grant
    Filed: October 19, 2018
    Date of Patent: March 23, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Violaine Batthish, Alan S. Boxall, Thomas L. Ellis, Trong Truong
  • Patent number: 10956307
    Abstract: In non-limiting examples of the present disclosure, systems, methods and devices for detecting a code defect associated with a cloud-based service are presented. A correlation between an operation failure spike in an outermost development ring prior to a production environment for a current software build and an operation failure spike in a development ring that precedes the outermost development ring for the current software build may be identified. A determination may be made that an operation failure spike corresponding to the spike in the outermost development ring in a previous software build did not exist. A determination may be made that an operation failure spike corresponding to the development ring that precedes the outermost development ring for a previous software build did not exist. An operation associated with the failure spikes may be flagged as being related to the code defect based on the findings.
    Type: Grant
    Filed: September 12, 2018
    Date of Patent: March 23, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Donovan Allen Isaak, Dmitry Valentinovich Kholodkov
  • Patent number: 10958659
    Abstract: Application permissions can be set in a cloud computing environment based on a user's authorization level in the cloud computing environment. For example, a system can determine that a user has a particular authorization level in a cloud computing environment. The system can determine that the user is to have particular permissions for a continuous integration tool by mapping the particular authorization level to the particular permissions. The system can then set a permission setting for the continuous integration tool to limit the user to the particular permissions.
    Type: Grant
    Filed: August 30, 2017
    Date of Patent: March 23, 2021
    Assignee: Red Hat, Inc.
    Inventors: David Michael Eads, Benjamin Michael Parees, Jordan Thomas Liggitt, Gabriel Garcia Montero
  • Patent number: 10949172
    Abstract: A system, method, and computer program product are provided for determining incremental code coverage of a software project. In operation, a system provides computation of project specific incremental (delta) code coverage in parallel in scenarios of multiple project teams working on different projects on a same module (or in the same repository). Further, an incremental code/mutation coverage analyzer engine associated with the system may be integrated with a project management tool and a version control software to obtain the changed code lines with respect to each project, using what it calculates as the incremental code and/or the mutation coverage.
    Type: Grant
    Filed: October 17, 2018
    Date of Patent: March 16, 2021
    Assignee: AMDOCS DEVELOPMENT LIMITED
    Inventors: Swatantra Jain, Ankit Nevatia, Dhruv Upadhyaya
  • Patent number: 10949325
    Abstract: Embodiments disclosed herein include a system that is capable of processing test data across multiple sessions of a video game. In some cases, the tests are performed over multiple video games that share a game engine. The generated test data may be analyzed as the test is being performed and key performance indicators may be extracted from the test data reducing the test data by at least an order of magnitude. Further, the extracted key performance indicators are used to automatically conduct further testing, such as regression testing, based on an analysis of the key performance indicators with respect to trend data generated from prior tests of the video game or of a shared game engine used by multiple video games.
    Type: Grant
    Filed: August 18, 2017
    Date of Patent: March 16, 2021
    Assignee: ELECTRONIC ARTS INC.
    Inventors: Milan Culibrk, Newman Scott Hunter, Martin Talbot, Andrew Gearhart
  • Patent number: 10949329
    Abstract: Methods, system, and computer readable medium are presented for predicting defects using a machine learning component based on a generated signature. A trained machine learning component that has been trained with historic data that represents a series of events that occurred within a plurality of heterogeneous systems over a plurality of periods of change for the heterogeneous systems can be received. A base signature for a first heterogeneous system that includes a first mix of modules can be compared to a current signature for the first heterogeneous system to identify one or more irregularities. The trained machine learning component can predict one or more defects for the first heterogeneous system based on the identified irregularity.
    Type: Grant
    Filed: December 26, 2018
    Date of Patent: March 16, 2021
    Assignee: Oracle International Corporation
    Inventors: Manoj Mathen, Raghothama Vijendran
  • Patent number: 10942840
    Abstract: A data processing device includes persistent storage and a software development manager. The persistent storage stores a code repository. The software development manager generates commit impact information based on: pre-commit code for a code base stored in the code repository, and dependency data based on committed code of the code base; displays a pre-commit analysis graphic user interface (GUI) reflecting the commit impact information and testing information for the pre-commit code; obtains, using the displayed pre-commit analysis GUI, reviewer feedback regarding approval of the pre-commit code; makes a determination, based on the reviewer feedback, that the pre-commit code has been approved; in response to the determination: performs limited testing of the code base based upon the dependency data to obtain testing results; and commits the pre-commit code to the committed code when the testing results match a predetermined behavior.
    Type: Grant
    Filed: April 30, 2019
    Date of Patent: March 9, 2021
    Assignee: EMC IP Holding Company LLC
    Inventors: Venkat Mattapalli Reddy, Gayatri Singh Balaji, Debra J. Robitaille, Mark Adam Arakelian, Belagapu Pradeep Kumar, Santosh Govindrao Bhandiwad, Sindhura Chamala
  • Patent number: 10942839
    Abstract: A system and method for debugging web applications, the system comprising a multiplexer, and a workstation comprising a debug environment, wherein the multiplexer is configured to redirect to the debug environment, any debugging request, the debug environment further configured to instantiate a development version of a web application, and debugging the development web application in the debug environment.
    Type: Grant
    Filed: October 28, 2016
    Date of Patent: March 9, 2021
    Assignee: INGRAM MICRO INC.
    Inventor: Vladimir Grebenschikov
  • Patent number: 10921154
    Abstract: In example implementations, an apparatus is provided. The apparatus includes an interface, an inheritance engine, an anomaly detection module and a processor. The interface communicates with a sensor array. The inheritance engine is used to create a model of the sensor array based on information collected from the each one of a plurality of nodes in the sensor array over the interface. The anomaly detection engine is used to monitor the sensor array in accordance with the model to detect an anomaly and initiate a corrective action to correct the anomaly in two or more of the plurality of nodes within the sensor array simultaneously. The processor is in communication with the inheritance engine and the anomaly detection engine is used to execute instructions associated with the inheritance engine and the anomaly detection engine.
    Type: Grant
    Filed: July 22, 2015
    Date of Patent: February 16, 2021
    Assignee: Hewlett Packard Enterprise Development LP
    Inventors: Parag Doshi, Satwant Kaur, Babak Makkinejad, Corey Wick
  • Patent number: 10924362
    Abstract: Methods, systems and computer programs are disclosed for managing data bugs in a data processing system comprising one or more data resources. The method may comprise receiving an indication of one or more bugs relating to one or more data resources, and contextual information for the one or more bugs and determining, from the received indication, one or more bug types and grouping the bugs by bug type for the same data resource to produce a aggregated list of open issues requiring fixing. Further operations may comprise presenting the aggregated list of one or more open issues on a user interface for selection, the one or more open issues being selectable, and, responsive to receiving selection of a particular open issue, presenting contextual information for the one or more bugs within the group on the user interface.
    Type: Grant
    Filed: March 29, 2018
    Date of Patent: February 16, 2021
    Assignee: Palantir Technologies Inc.
    Inventors: Amr Al Mallah, Mahmoud Abdelsalam, Michael Nazario, Peter Wang, Vivek Lakshmanan
  • Patent number: 10924590
    Abstract: A computer system to track and enhance performance of a virtual workspace system is provided. The computer system receives requests to profile phases of a distributed process executed by hosts coupled to one another via a network. Each of phase includes operations executed by processes hosted by the hosts. Each of phase either starts with receipt of a request via a user interface of a virtualization client or ends with provision of a response to the request via the user interface. The computer system identifies event log entries that each include an identifier of an event marking a start or an end of one of the operations, constructs a performance profile based on the event log entries, and transmits the performance profile to the user interface.
    Type: Grant
    Filed: February 18, 2020
    Date of Patent: February 16, 2021
    Assignee: Citrix Systems, Inc.
    Inventors: Xiao Zhang, Ze Chen, Tao Zhan, Bo Chen
  • Patent number: 10922214
    Abstract: Various methods, apparatuses/systems, and media for implementing a test optimization module are provided. A processor utilizes a static analysis technique which analyzes an application's byte code to determine what files and line-numbers have been changed in a source code based on comparing successive versions of the application. The processor creates a change dependency graph (CDG) based on a change scope and analyzed bytecode, traverses the CDG to generate a list of test cases among a plurality of test cases, accessed from a test repository, that are directly and/or indirectly related to the modification to the source code, and automatically executes only the test cases selected from the generated list to test the latest version of the application.
    Type: Grant
    Filed: August 23, 2019
    Date of Patent: February 16, 2021
    Assignee: JPMORGAN CHASE BANK, N.A.
    Inventors: Alla Nadein, Itai Wiseman, Victor M. Bonilla Pardo, Viacheslav Lisianskii, Zhi Zhang
  • Patent number: 10915436
    Abstract: Embodiments of the present systems and methods may provide techniques that may provide unit-level test of an SUT, but which translates the unit-level test into a valid test of the SUT itself. For example, in an embodiment, a computer-implemented method for testing a system, the method may comprise analyzing the system to determine sub-components of the system and inputs to the sub-components, performing dynamic testing of the system and collecting pairs of inputs to the system and inputs to the sub-components, training a machine learning model to translate from inputs to the sub-components to inputs to the system input using the collected pairs of inputs to the system and inputs to the sub-components and performing sub-component level testing and translating the sub-component level testing to system level testing.
    Type: Grant
    Filed: December 8, 2018
    Date of Patent: February 9, 2021
    Assignee: International Business Machines Corporation
    Inventors: Fady Copty, Karen Yorav
  • Patent number: 10901783
    Abstract: Techniques for reducing the startup latency of functions in a Functions-as-a-Service (FaaS) infrastructure are provided. In one set of embodiments, a function manager of the FaaS infrastructure can receive a request to invoke a function uploaded to the infrastructure and can retrieve information associated with the function. The retrieved information can include an indicator of whether instances of the function may be sticky (i.e., kept in host system primary memory after function execution is complete), and a list of zero or more host systems in the FaaS infrastructure that currently have an unused sticky instance of the function in their respective primary memories. If the indicator indicates that instances of the function may be sticky and if the list identifies at least one host system with an unused sticky instance of the function in its primary memory, the function manager can select the at least one host system for executing the function.
    Type: Grant
    Filed: February 7, 2019
    Date of Patent: January 26, 2021
    Assignee: VMWARE, INC.
    Inventor: Amol Manohar Vaikar
  • Patent number: 10891272
    Abstract: The present disclosure relates generally to a data enrichment service that extracts, repairs, and enriches datasets, resulting in more precise entity resolution and correlation for purposes of subsequent indexing and clustering. As the data enrichment service can include a visual recommendation engine and language for performing large-scale data preparation, repair, and enrichment of heterogeneous datasets. This enables the user to select and see how the recommended enrichments (e.g., transformations and repairs) will affect the user's data and make adjustments as needed. The data enrichment service can receive feedback from users through a user interface and can filter recommendations based on the user feedback.
    Type: Grant
    Filed: September 24, 2015
    Date of Patent: January 12, 2021
    Assignee: ORACLE INTERNATIONAL CORPORATION
    Inventors: Alexander Sasha Stojanovic, Luis E. Rivas, Philip Ogren, Glenn Allen Murray
  • Patent number: 10891219
    Abstract: Target testing code based on failure paths can improve hit rates and reduce memory consumption. Aggregating failure signatures into clusters can help to identify additional tests to perform. Further, the signature clusters can be used to automate testing of a video game by, for example, identifying tests that test elements of the video game that are common to the signatures within a cluster and automatically executing the tests without user involvement. The results of the tests can be used to modify the video game state. The process of testing and modifying the video game can be performed iteratively until a signature for the video game no longer matches the cluster.
    Type: Grant
    Filed: August 7, 2017
    Date of Patent: January 12, 2021
    Assignee: ELECTRONIC ARTS INC.
    Inventors: Panagiotis Dimitropoulos, Michael Marlowe
  • Patent number: 10885448
    Abstract: This disclosure describes a platform and taxonomy for analyzing the results of testing data, such as data generated through usability test of the User Experience (UX) of a software product or service. The analysis outputs actions that can be performed automatically to modify the software product or service under test. The usability test results that are analyzed can include qualitative data, such as words, sentences, phrases, comments, and or other (e.g., natural language) information that have been provided by end-users engaged in the usability testing. The platform and taxonomy described herein provided a framework through which a semantic analysis of results can be performed, with actions performed based on the semantic analysis.
    Type: Grant
    Filed: May 31, 2019
    Date of Patent: January 5, 2021
    Assignee: SAP SE
    Inventors: Panagiotis Germanakos, Ludwig Fichte
  • Patent number: 10884906
    Abstract: Generation of scripts that facilitate execution of tasks within different run-time environments that utilize different languages and syntax is provided herein. A system comprises a memory that stores executable components and a processor, operatively coupled to the memory, that executes the executable components. The executable components comprise an identification manager component that identifies one or more elements of input data. The input data can comprise test data that comprises respective identifications of an input variable, an output variable, a test vector comprising an initial value of a test input, and an expected output variable against which test results are compared. The executable components can also comprise a template tool component that generates output data that facilitates execution of tasks within different run-time environments that utilize different languages and syntax.
    Type: Grant
    Filed: June 18, 2018
    Date of Patent: January 5, 2021
    Assignee: GE Aviation Systems LLC
    Inventor: Scott Thomson
  • Patent number: 10878804
    Abstract: Methods, systems and computer program products for voice controlled generation of keywords for test cases are provided. Aspects include receiving a verbal test plan for a computing system and analyzing the verbal test plan to identify a plurality of keywords. Aspects also include mapping each known keyword of the plurality of keywords to an existing grammar and obtaining, from a user, a definition for a new grammar for each unknown keyword of the plurality of keywords. Aspects further include analyzing a software being tested on the computing system and creating a test plan by respectively applying the new grammar and the existing grammar of the plurality of keywords to the software being tested.
    Type: Grant
    Filed: October 10, 2018
    Date of Patent: December 29, 2020
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Jerry Cimo, Omar Hashmi, Megan Bridge
  • Patent number: 10877747
    Abstract: A device may receive operational data associated with software provided by an enterprise resource planning (ERP) platform, and may receive customization tables associated with the software provided by the ERP platform. The device may receive configuration data associated with the software provided by the ERP platform, and may receive test result data associated with the software provided by the ERP platform. The device may process the operational data, based on the configuration data, to identify a set of tasks, from tasks performed by the software, that have been configured, and may determine a plurality of links between the set of tasks and a plurality of customization tables, of the customization tables, based on the test result data. The device may perform one or more actions based on the operational data, the plurality of customization tables, the configuration data, and the plurality of links.
    Type: Grant
    Filed: September 13, 2019
    Date of Patent: December 29, 2020
    Assignee: Accenture Global Solutions Limited
    Inventors: Antoine Sebilleau, Michel-Etienne Liegard, Aymeric Piganeau
  • Patent number: 10880197
    Abstract: According to one method, the method occurs at a network equipment test device. The method includes receiving one or more source code files for programming a packet forwarding plane of a network node; analyzing the one or more source code files to determine test metadata, wherein analyzing the one or more source code files to determine the test metadata includes identifying source code portions that indicate conditions for rejecting or accepting packets and determining the test metadata based on the conditions; generating, using the test metadata, one or more test plans for testing the network node, wherein the one or more test plans define test packets to be sent to the network node for testing the network node's implementation of the conditions for rejecting or accepting packets; and testing the network node using the one or more test plans.
    Type: Grant
    Filed: July 13, 2018
    Date of Patent: December 29, 2020
    Assignee: KEYSIGHT TECHNOLOGIES, INC.
    Inventors: Rudrarup Naskar, Prasenjit Ranjan Adhikary, Kingshuk Mandal
  • Patent number: 10871753
    Abstract: A system provides feedback driven end-to-end state control of a data model. A data model may be used to model the behavior of a monitored system to predict future events. The system may be used to ensure proper operation of the data model. Contingency data models may be executed when a failure is detected. Further, when the system detects accuracy that is out of tolerance, the system may initiate retraining of the data model being currently used.
    Type: Grant
    Filed: February 28, 2017
    Date of Patent: December 22, 2020
    Assignee: Accenture Global Solutions Limited
    Inventors: Jaeyoung Christopher Kang, Jürgen Albert Weichenberger, Teresa Sheausan Tung, William R. Gatehouse, Tiffany Cecilia Dharma, Jan Andre Nicholls
  • Patent number: 10866881
    Abstract: A method for firmware debug trace capture includes creating a hand-off block (“HOB”), capturing first debug trace statements during a boot sequence of a computer and writing the first debug trace statements to the HOB. A trace memory buffer can be created and the first debug trace statements can be copied from the HOB to the trace memory buffer. Second debug trace statements are captured during the boot sequence and appended to the trace memory buffer. In some configurations, the first debug trace statements can be written to the HOB during the pre-Extensible Firmware Interface initialization (“PEI”) phase of the boot sequence and the second debug trace statements can be written to the trace memory buffer during the driver execution (“DXE”) phase of the boot sequence.
    Type: Grant
    Filed: February 7, 2020
    Date of Patent: December 15, 2020
    Assignee: American Megatrends International, LLC
    Inventors: Michael Harry Deiderich, III, Matthew Hoffmann, Thomas Gilreath
  • Patent number: 10853115
    Abstract: Systems and methods are described for providing auxiliary functions in an on-demand code execution system in a manner that enables efficient execution of code. A user may generate a task on the system by submitting code. The system may determine the auxiliary functions that the submitted code may require when executed on the system, and may provide these auxiliary functions by provisioning sidecar virtual machine instances that work in conjunction with the virtual machine instance executing the submitted code. The sidecars may provide auxiliary functions on a per-task, per-user, or per-request basis, and the lifecycles of the sidecars may be determined based on the lifecycles of the virtual machine instances that execute submitted code. Auxiliary functions may thus be provided only when needed, and may be provided securely by preventing a user from accessing the sidecars of other users.
    Type: Grant
    Filed: June 25, 2018
    Date of Patent: December 1, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Niall Mullen, Philip Daniel Piwonka, Timothy Allen Wagner, Marc John Brooker
  • Patent number: 10853225
    Abstract: A control method includes: executing a receiving process that includes receiving designation, the designation indicating a program, a data kind and a data type; executing a identifying process that includes identifying a data type associated with the designated program and data kind by referring to a storage unit, the storage unit being configured to store information associating a data type of a target data of processing to be executed by a program with the program and a data kind of the data; executing a generating process that includes generating information associating the identified data type with the designated program and data type.
    Type: Grant
    Filed: February 25, 2019
    Date of Patent: December 1, 2020
    Assignee: FUJITSU LIMITED
    Inventor: Takashi Ohata
  • Patent number: 10852920
    Abstract: The present disclosure relates to a method and system for automating execution of processes by a process automation system. The process automation system captures environment data and application data associated with at least one of applications and systems which are utilized for performing a process and records each of user actions performed on at least one of the applications and the systems with reference to the environment data. The process automation system determines one or more automation rules for each set of connected user actions within and between the at least one of the applications and the systems from the recorded user actions for execution of a corresponding activity in the process and creates an execution sequence comprising the one or more automation rules for automating the process.
    Type: Grant
    Filed: August 24, 2016
    Date of Patent: December 1, 2020
    Assignee: Wipro Limited
    Inventors: Suresh Babu Ponnan, Padmanaban Vadivel, Kumaran Sethuraman, Naveen Muralidharan
  • Patent number: 10846207
    Abstract: Systems and methods are provided for determining a first test automate is associated with the same application as a second test automate, and for each action in the first test automate, determining a common action in the second test automate, determining that an element identifier in the first test automate for the common action has changed in the second test automate, and recording the changed element identifier in a data store, the data store comprising a list of changed element identifiers for each of a plurality of applications. The data store is provided so that element identifiers in at least one custom test automate corresponding to the changed element identifiers for at least one application are automatically determined based on the list of changed element identifiers for each of the plurality of applications.
    Type: Grant
    Filed: January 15, 2019
    Date of Patent: November 24, 2020
    Assignee: SAP SE
    Inventors: Warren Mark Fernandes, Anal Jyoti Goswami, Senthilnathan K
  • Patent number: 10831648
    Abstract: Systems and methods for testing a subject system with a software testing process are described. The system receives Boolean states responsive to repeatedly applying a first test case to a subject system. Each Boolean state signifies an outcome of an application of the first test case to a version of a first software feature over a span of time. The system identifies test case outcomes for the first test case that are adjacent in time and different and generates an intermittency value for the first test case. The system determines that the intermittency value for the first test case exceeds an intermittency threshold and alerts an engineering resource. Finally, the system repeats the above operations until the intermittency value for the first test case does not exceed the intermittency threshold.
    Type: Grant
    Filed: January 31, 2019
    Date of Patent: November 10, 2020
    Assignee: Splunk Inc.
    Inventors: Jian Zhang, Minghao Lu, Xiaolu Ye, Ning He
  • Patent number: 10824541
    Abstract: Systems and methods for building and executing a test for a software application. The system includes a database for storing variable value protocols, output files, and data related thereto. A computing device is in communication with the database and is configured to create and/or modify the variable value protocols. The computing device includes an interface having a plurality of sections for displaying the variable value protocols and variables related thereto. The computing device is configured to receive values to define selected variables of the variable value protocols and receive values from a data fabrication engine for variables that were not selected. The computing device is configured to notify a user that a current version of the software application treats one of the selected variables different than a previous version of the software application.
    Type: Grant
    Filed: October 18, 2018
    Date of Patent: November 3, 2020
    Assignee: State Farm Mutual Automobile Insurance Company
    Inventors: Venkata Ramarao Kongara, Matthew Joseph Jarrett
  • Patent number: 10817403
    Abstract: A method displays a user interface (UI) that includes a flow diagram having a plurality of nodes, receives user specification of a validation rule for a first node of the plurality of nodes in the flow diagram, and determines that an intermediate data set violates the validation rule. In response to determining that the first intermediate data set violates the validation rule, the method identifies errors corresponding to rows in the intermediate data set, and displays an error resolution UI that provides information about the errors. The error resolution UI includes a data flow trace region providing lineage of the errors in the flow. When a user selects an error in the data flow trace region, the data flow trace region is updated to provide the lineage of the selected error, including an updated graphic depiction for the respective error at each visually represented node.
    Type: Grant
    Filed: August 9, 2019
    Date of Patent: October 27, 2020
    Assignee: Tableau Software, Inc.
    Inventors: Richard Lee Cole, Heidi Lap Mun Lam
  • Patent number: 10802807
    Abstract: Embodiments herein use control application programming interfaces (APIs) to control the execution of a dataflow graph in a heterogeneous processing system. That is, embodiments herein describe a programming model along with associated APIs and methods that can control, interact, and at least partially reconfigure a user application (e.g., the dataflow graph) executing on the heterogeneous processing system through a local executing control program. Using the control APIs, users can manipulate such remotely executing graphs directly as local objects and perform control operations on them (e.g., for loading and initializing the graphs; dynamically adjusting parameters for adaptive control; monitoring application parameters, system states and events; scheduling operations to read and write data across the distributed memory boundary of the platform; controlling the execution life-cycle of a subsystem; and partially reconfiguring the computing resources for a new subsystem).
    Type: Grant
    Filed: May 23, 2019
    Date of Patent: October 13, 2020
    Assignee: XILINX, INC.
    Inventors: Chia-Jui Hsu, Shail Aditya Gupta, Samuel R. Bayliss, Philip B. James-Roxby, Ralph D. Wittig, Vinod Kathail
  • Patent number: 10795801
    Abstract: A novel and useful system and method of time traveling source code debugging including several advanced capabilities that significantly improve the source code debugging process. Upon hitting a breakpoint or opening a dump file, the debugger travels to the future which can be altered by a user by modifying code on the fly (live coding) and receiving immediate feedback to validate bug fixes. Visual annotations including values of variables and expressions are provided as a heads up display effectively flattening time and space. A pivoting capability allows a user to switch the execution context of the code at any time. Point in time links that store the state of the debugging session can be created and activated. An asynchronous collaboration and messaging system enables multiple participants to share a debugging session. An optional redaction capability is also provided for obscuring or replacing sensitive private information.
    Type: Grant
    Filed: January 7, 2019
    Date of Patent: October 6, 2020
    Assignee: OZCODE LTD
    Inventors: Omer Raviv, Alon Mordechai Fliess
  • Patent number: 10795669
    Abstract: Systems and methods are disclosed that provide a cloud-based platform having an endpoint that receives a change event to a software application hosted by a virtual server from a management application. The change event includes a commit event, build event, or test event implemented on the software application. The management application manages commit events, build events, or test events implemented on the software application. The platform includes a change event processor that determines that the change event was generated by the management application and sends the change event to a handler based on the management application. The platform also includes the handler of a set of handlers that processes the change event based on the management application to update the software application. Each handler of the set of handlers corresponds to a respective management application and is configured to process a respective change event generated by the respective management application.
    Type: Grant
    Filed: June 15, 2018
    Date of Patent: October 6, 2020
    Assignee: ServiceNow, Inc.
    Inventors: Tarun Kumar Murala, Arun Vydianathan
  • Patent number: 10783067
    Abstract: A software quality determination apparatus includes a bug convergence determination unit and a display unit. The bug convergence determination unit determines, for each component and for each test viewpoint, the convergence of the bug generated in the test of the component and the test viewpoint after a test execution amount of the component and the test viewpoint has reached an execution reference amount, which serves as a reference of the execution amount of the component and the test viewpoint. The display unit displays, for the each component and the each test viewpoint, the result of the determination of the convergence of the bug generated in the test of the component and the test viewpoint. The execution amount and the execution reference amount for the each component and the each test viewpoint are weighted in accordance with an index value that indicates a scale of the component.
    Type: Grant
    Filed: October 8, 2018
    Date of Patent: September 22, 2020
    Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
    Inventor: Eisuke Aoki
  • Patent number: 10783064
    Abstract: A system and method of generating one or more integration tests are disclosed herein. A computing system receives a URL from a client device. The URL corresponds to a website hosted by a third party server. The computing system generates a recurrent neural network model for testing of the website. The one or more variables associated with the recurrent neural network model are defined by a genetic algorithm. The computing system inputs code associated with the website into the recurrent neural network model. The recurrent neural network model learns a plurality of possible paths through the website by permutating through each possible set of options on the website. The recurrent neural network mode generates, as output, a plurality of integration tests for at least the test website. The computing system compiles the plurality of integration tests into a format compatible with a testing service specified by the client device.
    Type: Grant
    Filed: November 27, 2019
    Date of Patent: September 22, 2020
    Assignee: Capital One Services, LLC
    Inventors: Austin Walters, Jeremy Goodsitt, Fardin Abdi Taghi Abad, Mark Watson, Anh Truong, Reza Farivar
  • Patent number: 10776097
    Abstract: A method includes grouping nodes into a first level clusters. For each first level cluster, a leader node is promoted. For each first level cluster that has a size exceeding a predetermined threshold, nodes of the cluster are grouped into second level clusters. For each second level cluster, a leader node is promoted. If no single node is trusted to patch its cluster, a fragmentation scheme is applied to enable nodes to check validity of the receiving patch. This grouping scheme is applied in a hierarchical manner until the size of all clusters are found to be under the predetermined threshold. A software patch is transmitted to the leader nodes of the first level clusters, which then transmit the software patch to next level leaders (if any) or to all other nodes within the same cluster. The patch transmission is done in a hierarchical manner for subsequent levels.
    Type: Grant
    Filed: July 30, 2018
    Date of Patent: September 15, 2020
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Kam Hou U, Angel A. Merchan, Thomas D. Fitzsimmons
  • Patent number: 10778795
    Abstract: A system is provided for synchronizing a property value between a proxy of an application of a client and a corresponding remote object of a server. The application instantiates a proxy of a proxy class corresponding to a remote object of a remote object class where the proxy class specifies a property with a proxy getter. The application sends to the server an invocation request message to invoke a remote object member function of a remote object and receives an invocation response message. When the invocation response message includes a property update, the application extracts from the invocation response message the value of the property from the property update and stores the extracted value in the proxy. When the proxy getter for the property is invoked, the value of the property can be retrieved from the proxy without having to send an invocation request message to the server.
    Type: Grant
    Filed: January 30, 2017
    Date of Patent: September 15, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Aaron Lahman, Yasser Shaaban, Mariyan Fransazov, Alexander Jon Dobin
  • Patent number: 10768893
    Abstract: A device may obtain test case information for a set of test cases. The test case information may include test case description information, test case environment information, and/or test case defect information. The device may determine a set of field-level similarity scores by using a set of similarity analysis techniques to analyze a set of test case field groups associated with the test case information. The device may determine a set of overall similarity scores for a set of test case groups by using a machine learning technique to analyze the set of field-level similarity scores. The device may update a data structure that stores the test case information to establish one or more associations between the test case information and the set of overall similarity scores. The device may process a request from a user device using information included in the updated data structure.
    Type: Grant
    Filed: November 20, 2017
    Date of Patent: September 8, 2020
    Assignee: Accenture Global Solutions Limited
    Inventors: Janardan Misra, Divya Rawat, Neville Dubash, Sanjay Podder
  • Patent number: 10769300
    Abstract: A hybrid cluster environment with a public cloud cluster having nodes storing data and a plurality of private clusters is provided, wherein each of the plurality of private clusters has nodes storing data. Registration data that indicates a customer identifier, a new private cluster, and a file transfer server is received. The new private cluster is added to the plurality of private clusters in the hybrid cluster environment. Input to design a job to process data in the hybrid cluster environment is received. It is determined that the job is to be deployed to the new private cluster. The job is deployed to the new private cluster using the file transfer server, wherein the job is executed at the new private cluster. Job status information and one or more job logs are received with the file transfer server.
    Type: Grant
    Filed: June 26, 2019
    Date of Patent: September 8, 2020
    Assignee: International Business Machines Corporation
    Inventors: Lawrence A. Greene, Yong Li, Ryan Pham, Xiaoyan Pu, Yeh-Heng Sheng
  • Patent number: 10762234
    Abstract: A hybrid cluster environment with a public cloud cluster having nodes storing data and a plurality of private clusters is provided, wherein each of the plurality of private clusters has nodes storing data. Registration data that indicates a customer identifier, a new private cluster, and a file transfer server is received. The new private cluster is added to the plurality of private clusters in the hybrid cluster environment. Input to design a job to process data in the hybrid cluster environment is received. It is determined that the job is to be deployed to the new private cluster. The job is deployed to the new private cluster using the file transfer server, wherein the job is executed at the new private cluster. Job status information and one or more job logs are received with the file transfer server.
    Type: Grant
    Filed: March 8, 2018
    Date of Patent: September 1, 2020
    Assignee: International Business Machines Corporation
    Inventors: Lawrence A. Greene, Yong Li, Ryan Pham, Xiaoyan Pu, Yeh-Heng Sheng
  • Patent number: 10762200
    Abstract: Disclosed herein are systems and methods for enabling the automatic detection of executable code from a stream of bytes. In some embodiments, the stream of bytes can be sourced from the hidden areas of files that traditional malware detection solutions ignore. In some embodiments, a machine learning model is trained to detect whether a particular stream of bytes is executable code. Other embodiments described herein disclose systems and methods for automatic feature extraction using a neural network. Given a new file, the systems and methods may preprocess the code to be inputted into a trained neural network. The neural network may be used as a “feature generator” for a malware detection model. Other embodiments herein are directed to systems and methods for identifying, flagging, and/or detecting threat actors which attempt to obtain access to library functions independently.
    Type: Grant
    Filed: May 20, 2020
    Date of Patent: September 1, 2020
    Assignee: Sentinel Labs Israel Ltd.
    Inventors: Shlomi Salem, Roy Ronen, Assaf Nativ, Amit Zohar, Gal Braun, Pavel Ferencz, Eitan Shterenbaum, Tal Maimon
  • Patent number: 10754641
    Abstract: A system and method for optimizing CI using code review quality includes a memory, a processor in communication with the memory, a classifier executing on the processor, a high priority integration queue, and a low priority integration queue. In an example, the classifier may receive pull requests for code changes and determine reliability factors. The classifier may also determine a reliability value of the pull requests based on the reliability factors and classify each of the pull requests into a classification, such as a trusted classification and an untrusted classification. Then, the classifier sends the pull requests in the trusted classification to the high priority integration queue and the pull requests in the untrusted classification to the low priority integration queue.
    Type: Grant
    Filed: May 30, 2017
    Date of Patent: August 25, 2020
    Assignee: Red Hat, Inc.
    Inventors: Huamin Chen, Jay Vyas
  • Patent number: 10742477
    Abstract: A method for connecting webservers and web application servers (WAS's) is provided. The method includes steps of: (a) a WAS admin server, while managing multiple existing WAS managed servers and communicating with multiple existing webservers, if a new webserver except the multiple existing webservers or a new WAS managed server except the multiple existing WAS managed servers is determined as being operated, receiving connection state information of the new webserver or that of the new WAS managed server; and (b) the WAS admin server delivering the connection state information of the new webserver or that of the new WAS to the multiple existing WAS managed servers and the multiple existing webservers.
    Type: Grant
    Filed: August 22, 2018
    Date of Patent: August 11, 2020
    Assignee: TMAXSOFT CO., LTD.
    Inventors: Sung Bae Yoon, Young Hwi Jang
  • Patent number: 10740212
    Abstract: Systems and methods for implementing content-level anomaly detection for devices having limited memory are provided. At least one log content model is generated based on training log content of training logs obtained from one or more sources associated with the computer system. The at least one log content model is transformed into at least one modified log content model to limit memory usage. Anomaly detection is performed for testing log content of testing logs obtained from one or more sources associated with the computer system based on the at least one modified log content model. In response to the anomaly detection identifying one or more anomalies associated with the testing log content, the one or more anomalies are output.
    Type: Grant
    Filed: May 3, 2018
    Date of Patent: August 11, 2020
    Assignee: NEC Corporation
    Inventors: Biplob Debnath, Hui Zhang, Erik Kruus