Testing Or Debugging Patents (Class 717/124)
  • Patent number: 10831648
    Abstract: Systems and methods for testing a subject system with a software testing process are described. The system receives Boolean states responsive to repeatedly applying a first test case to a subject system. Each Boolean state signifies an outcome of an application of the first test case to a version of a first software feature over a span of time. The system identifies test case outcomes for the first test case that are adjacent in time and different and generates an intermittency value for the first test case. The system determines that the intermittency value for the first test case exceeds an intermittency threshold and alerts an engineering resource. Finally, the system repeats the above operations until the intermittency value for the first test case does not exceed the intermittency threshold.
    Type: Grant
    Filed: January 31, 2019
    Date of Patent: November 10, 2020
    Assignee: Splunk Inc.
    Inventors: Jian Zhang, Minghao Lu, Xiaolu Ye, Ning He
  • Patent number: 10824541
    Abstract: Systems and methods for building and executing a test for a software application. The system includes a database for storing variable value protocols, output files, and data related thereto. A computing device is in communication with the database and is configured to create and/or modify the variable value protocols. The computing device includes an interface having a plurality of sections for displaying the variable value protocols and variables related thereto. The computing device is configured to receive values to define selected variables of the variable value protocols and receive values from a data fabrication engine for variables that were not selected. The computing device is configured to notify a user that a current version of the software application treats one of the selected variables different than a previous version of the software application.
    Type: Grant
    Filed: October 18, 2018
    Date of Patent: November 3, 2020
    Assignee: State Farm Mutual Automobile Insurance Company
    Inventors: Venkata Ramarao Kongara, Matthew Joseph Jarrett
  • Patent number: 10817403
    Abstract: A method displays a user interface (UI) that includes a flow diagram having a plurality of nodes, receives user specification of a validation rule for a first node of the plurality of nodes in the flow diagram, and determines that an intermediate data set violates the validation rule. In response to determining that the first intermediate data set violates the validation rule, the method identifies errors corresponding to rows in the intermediate data set, and displays an error resolution UI that provides information about the errors. The error resolution UI includes a data flow trace region providing lineage of the errors in the flow. When a user selects an error in the data flow trace region, the data flow trace region is updated to provide the lineage of the selected error, including an updated graphic depiction for the respective error at each visually represented node.
    Type: Grant
    Filed: August 9, 2019
    Date of Patent: October 27, 2020
    Assignee: Tableau Software, Inc.
    Inventors: Richard Lee Cole, Heidi Lap Mun Lam
  • Patent number: 10802807
    Abstract: Embodiments herein use control application programming interfaces (APIs) to control the execution of a dataflow graph in a heterogeneous processing system. That is, embodiments herein describe a programming model along with associated APIs and methods that can control, interact, and at least partially reconfigure a user application (e.g., the dataflow graph) executing on the heterogeneous processing system through a local executing control program. Using the control APIs, users can manipulate such remotely executing graphs directly as local objects and perform control operations on them (e.g., for loading and initializing the graphs; dynamically adjusting parameters for adaptive control; monitoring application parameters, system states and events; scheduling operations to read and write data across the distributed memory boundary of the platform; controlling the execution life-cycle of a subsystem; and partially reconfiguring the computing resources for a new subsystem).
    Type: Grant
    Filed: May 23, 2019
    Date of Patent: October 13, 2020
    Assignee: XILINX, INC.
    Inventors: Chia-Jui Hsu, Shail Aditya Gupta, Samuel R. Bayliss, Philip B. James-Roxby, Ralph D. Wittig, Vinod Kathail
  • Patent number: 10795801
    Abstract: A novel and useful system and method of time traveling source code debugging including several advanced capabilities that significantly improve the source code debugging process. Upon hitting a breakpoint or opening a dump file, the debugger travels to the future which can be altered by a user by modifying code on the fly (live coding) and receiving immediate feedback to validate bug fixes. Visual annotations including values of variables and expressions are provided as a heads up display effectively flattening time and space. A pivoting capability allows a user to switch the execution context of the code at any time. Point in time links that store the state of the debugging session can be created and activated. An asynchronous collaboration and messaging system enables multiple participants to share a debugging session. An optional redaction capability is also provided for obscuring or replacing sensitive private information.
    Type: Grant
    Filed: January 7, 2019
    Date of Patent: October 6, 2020
    Assignee: OZCODE LTD
    Inventors: Omer Raviv, Alon Mordechai Fliess
  • Patent number: 10795669
    Abstract: Systems and methods are disclosed that provide a cloud-based platform having an endpoint that receives a change event to a software application hosted by a virtual server from a management application. The change event includes a commit event, build event, or test event implemented on the software application. The management application manages commit events, build events, or test events implemented on the software application. The platform includes a change event processor that determines that the change event was generated by the management application and sends the change event to a handler based on the management application. The platform also includes the handler of a set of handlers that processes the change event based on the management application to update the software application. Each handler of the set of handlers corresponds to a respective management application and is configured to process a respective change event generated by the respective management application.
    Type: Grant
    Filed: June 15, 2018
    Date of Patent: October 6, 2020
    Assignee: ServiceNow, Inc.
    Inventors: Tarun Kumar Murala, Arun Vydianathan
  • Patent number: 10783067
    Abstract: A software quality determination apparatus includes a bug convergence determination unit and a display unit. The bug convergence determination unit determines, for each component and for each test viewpoint, the convergence of the bug generated in the test of the component and the test viewpoint after a test execution amount of the component and the test viewpoint has reached an execution reference amount, which serves as a reference of the execution amount of the component and the test viewpoint. The display unit displays, for the each component and the each test viewpoint, the result of the determination of the convergence of the bug generated in the test of the component and the test viewpoint. The execution amount and the execution reference amount for the each component and the each test viewpoint are weighted in accordance with an index value that indicates a scale of the component.
    Type: Grant
    Filed: October 8, 2018
    Date of Patent: September 22, 2020
    Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
    Inventor: Eisuke Aoki
  • Patent number: 10783064
    Abstract: A system and method of generating one or more integration tests are disclosed herein. A computing system receives a URL from a client device. The URL corresponds to a website hosted by a third party server. The computing system generates a recurrent neural network model for testing of the website. The one or more variables associated with the recurrent neural network model are defined by a genetic algorithm. The computing system inputs code associated with the website into the recurrent neural network model. The recurrent neural network model learns a plurality of possible paths through the website by permutating through each possible set of options on the website. The recurrent neural network mode generates, as output, a plurality of integration tests for at least the test website. The computing system compiles the plurality of integration tests into a format compatible with a testing service specified by the client device.
    Type: Grant
    Filed: November 27, 2019
    Date of Patent: September 22, 2020
    Assignee: Capital One Services, LLC
    Inventors: Austin Walters, Jeremy Goodsitt, Fardin Abdi Taghi Abad, Mark Watson, Anh Truong, Reza Farivar
  • Patent number: 10778795
    Abstract: A system is provided for synchronizing a property value between a proxy of an application of a client and a corresponding remote object of a server. The application instantiates a proxy of a proxy class corresponding to a remote object of a remote object class where the proxy class specifies a property with a proxy getter. The application sends to the server an invocation request message to invoke a remote object member function of a remote object and receives an invocation response message. When the invocation response message includes a property update, the application extracts from the invocation response message the value of the property from the property update and stores the extracted value in the proxy. When the proxy getter for the property is invoked, the value of the property can be retrieved from the proxy without having to send an invocation request message to the server.
    Type: Grant
    Filed: January 30, 2017
    Date of Patent: September 15, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Aaron Lahman, Yasser Shaaban, Mariyan Fransazov, Alexander Jon Dobin
  • Patent number: 10776097
    Abstract: A method includes grouping nodes into a first level clusters. For each first level cluster, a leader node is promoted. For each first level cluster that has a size exceeding a predetermined threshold, nodes of the cluster are grouped into second level clusters. For each second level cluster, a leader node is promoted. If no single node is trusted to patch its cluster, a fragmentation scheme is applied to enable nodes to check validity of the receiving patch. This grouping scheme is applied in a hierarchical manner until the size of all clusters are found to be under the predetermined threshold. A software patch is transmitted to the leader nodes of the first level clusters, which then transmit the software patch to next level leaders (if any) or to all other nodes within the same cluster. The patch transmission is done in a hierarchical manner for subsequent levels.
    Type: Grant
    Filed: July 30, 2018
    Date of Patent: September 15, 2020
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Kam Hou U, Angel A. Merchan, Thomas D. Fitzsimmons
  • Patent number: 10768893
    Abstract: A device may obtain test case information for a set of test cases. The test case information may include test case description information, test case environment information, and/or test case defect information. The device may determine a set of field-level similarity scores by using a set of similarity analysis techniques to analyze a set of test case field groups associated with the test case information. The device may determine a set of overall similarity scores for a set of test case groups by using a machine learning technique to analyze the set of field-level similarity scores. The device may update a data structure that stores the test case information to establish one or more associations between the test case information and the set of overall similarity scores. The device may process a request from a user device using information included in the updated data structure.
    Type: Grant
    Filed: November 20, 2017
    Date of Patent: September 8, 2020
    Assignee: Accenture Global Solutions Limited
    Inventors: Janardan Misra, Divya Rawat, Neville Dubash, Sanjay Podder
  • Patent number: 10769300
    Abstract: A hybrid cluster environment with a public cloud cluster having nodes storing data and a plurality of private clusters is provided, wherein each of the plurality of private clusters has nodes storing data. Registration data that indicates a customer identifier, a new private cluster, and a file transfer server is received. The new private cluster is added to the plurality of private clusters in the hybrid cluster environment. Input to design a job to process data in the hybrid cluster environment is received. It is determined that the job is to be deployed to the new private cluster. The job is deployed to the new private cluster using the file transfer server, wherein the job is executed at the new private cluster. Job status information and one or more job logs are received with the file transfer server.
    Type: Grant
    Filed: June 26, 2019
    Date of Patent: September 8, 2020
    Assignee: International Business Machines Corporation
    Inventors: Lawrence A. Greene, Yong Li, Ryan Pham, Xiaoyan Pu, Yeh-Heng Sheng
  • Patent number: 10762234
    Abstract: A hybrid cluster environment with a public cloud cluster having nodes storing data and a plurality of private clusters is provided, wherein each of the plurality of private clusters has nodes storing data. Registration data that indicates a customer identifier, a new private cluster, and a file transfer server is received. The new private cluster is added to the plurality of private clusters in the hybrid cluster environment. Input to design a job to process data in the hybrid cluster environment is received. It is determined that the job is to be deployed to the new private cluster. The job is deployed to the new private cluster using the file transfer server, wherein the job is executed at the new private cluster. Job status information and one or more job logs are received with the file transfer server.
    Type: Grant
    Filed: March 8, 2018
    Date of Patent: September 1, 2020
    Assignee: International Business Machines Corporation
    Inventors: Lawrence A. Greene, Yong Li, Ryan Pham, Xiaoyan Pu, Yeh-Heng Sheng
  • Patent number: 10762200
    Abstract: Disclosed herein are systems and methods for enabling the automatic detection of executable code from a stream of bytes. In some embodiments, the stream of bytes can be sourced from the hidden areas of files that traditional malware detection solutions ignore. In some embodiments, a machine learning model is trained to detect whether a particular stream of bytes is executable code. Other embodiments described herein disclose systems and methods for automatic feature extraction using a neural network. Given a new file, the systems and methods may preprocess the code to be inputted into a trained neural network. The neural network may be used as a “feature generator” for a malware detection model. Other embodiments herein are directed to systems and methods for identifying, flagging, and/or detecting threat actors which attempt to obtain access to library functions independently.
    Type: Grant
    Filed: May 20, 2020
    Date of Patent: September 1, 2020
    Assignee: Sentinel Labs Israel Ltd.
    Inventors: Shlomi Salem, Roy Ronen, Assaf Nativ, Amit Zohar, Gal Braun, Pavel Ferencz, Eitan Shterenbaum, Tal Maimon
  • Patent number: 10754641
    Abstract: A system and method for optimizing CI using code review quality includes a memory, a processor in communication with the memory, a classifier executing on the processor, a high priority integration queue, and a low priority integration queue. In an example, the classifier may receive pull requests for code changes and determine reliability factors. The classifier may also determine a reliability value of the pull requests based on the reliability factors and classify each of the pull requests into a classification, such as a trusted classification and an untrusted classification. Then, the classifier sends the pull requests in the trusted classification to the high priority integration queue and the pull requests in the untrusted classification to the low priority integration queue.
    Type: Grant
    Filed: May 30, 2017
    Date of Patent: August 25, 2020
    Assignee: Red Hat, Inc.
    Inventors: Huamin Chen, Jay Vyas
  • Patent number: 10740212
    Abstract: Systems and methods for implementing content-level anomaly detection for devices having limited memory are provided. At least one log content model is generated based on training log content of training logs obtained from one or more sources associated with the computer system. The at least one log content model is transformed into at least one modified log content model to limit memory usage. Anomaly detection is performed for testing log content of testing logs obtained from one or more sources associated with the computer system based on the at least one modified log content model. In response to the anomaly detection identifying one or more anomalies associated with the testing log content, the one or more anomalies are output.
    Type: Grant
    Filed: May 3, 2018
    Date of Patent: August 11, 2020
    Assignee: NEC Corporation
    Inventors: Biplob Debnath, Hui Zhang, Erik Kruus
  • Patent number: 10742477
    Abstract: A method for connecting webservers and web application servers (WAS's) is provided. The method includes steps of: (a) a WAS admin server, while managing multiple existing WAS managed servers and communicating with multiple existing webservers, if a new webserver except the multiple existing webservers or a new WAS managed server except the multiple existing WAS managed servers is determined as being operated, receiving connection state information of the new webserver or that of the new WAS managed server; and (b) the WAS admin server delivering the connection state information of the new webserver or that of the new WAS to the multiple existing WAS managed servers and the multiple existing webservers.
    Type: Grant
    Filed: August 22, 2018
    Date of Patent: August 11, 2020
    Assignee: TMAXSOFT CO., LTD.
    Inventors: Sung Bae Yoon, Young Hwi Jang
  • Patent number: 10733070
    Abstract: A functional test execution engine (“FTEE”) may be configured to execute test scripts with respect to a server stack. The FTEE may be communicatively coupled to a test script storage device, which may store the test scripts. The FTEE may select one or more test scripts for execution with respect to the server stack. The one or more test scripts may carry out maintenance or diagnostic functions for the server stack. The FTEE may determine the processing resources of the server stack and, based on those processing resources, select a first set of test scripts from the one or more test scripts to execute. The FTEE may cause the first set of test scripts selected to execute with respect to the server stack in order to generate test script results. The FTEE may store the test script results for subsequent analysis and use during execution of subsequent test scripts.
    Type: Grant
    Filed: March 29, 2018
    Date of Patent: August 4, 2020
    Assignee: Bank of America Corporation
    Inventors: Pratap Dande, Manikumar Juttukonda, Daniel P. McCoy, John Mckenzie
  • Patent number: 10732962
    Abstract: Systems and methods as described herein may relate to the use of card pipelines in the deployment of a service and/or library change. Cards may, for example, include code and/or run-time systems that utilize the service/library component. A system such as a release controller may detect a change to a service/library component that is utilized by a plurality of cards, trigger a card pipeline to cause the execution of one or more tests, and if a test failure is attributable to the change to the service component, halt the deployment of the card pipeline, a second card pipeline (e.g., being deployed and/or tested in parallel). The order in which the card pipelines are exercised may be determined based on card quality scores generated based on quality metrics collected in association with operation of the cards over time.
    Type: Grant
    Filed: June 25, 2018
    Date of Patent: August 4, 2020
    Assignee: Amazon Technologies, Inc.
    Inventor: Dan-Constantin Florescu
  • Patent number: 10735300
    Abstract: A method includes receiving, at a test identification service, a request to test a first service in an enterprise environment, identifying a service call of the first service, and identifying, using an endpoint of the service call, a second service called by the first service, the second service executing in the enterprise environment. The method further includes identifying a subset of tests from a test registry service including multiple tests, the subset of tests being configured to test the second service, and testing, using the subset of tests, the second service in the enterprise environment.
    Type: Grant
    Filed: November 30, 2018
    Date of Patent: August 4, 2020
    Assignee: Intuit Inc.
    Inventors: Michael Willson, Jason T. Northcote
  • Patent number: 10733088
    Abstract: According to one method, the method occurs at a network equipment test device. The method includes receiving source code metadata derived from one or more source code files for programming a packet forwarding plane of a network node; analyzing the source code metadata to generate test metadata, wherein analyzing the source code metadata to determine the test metadata includes identifying source code metadata portions that indicate elements to test and determining the test metadata based on the elements; generating, using the test metadata, one or more test plans for testing the network node or an application programming interface (API) associated with the network node; and testing the network node or the API using the one or more test plans.
    Type: Grant
    Filed: March 1, 2019
    Date of Patent: August 4, 2020
    Assignee: KEYSIGHT TECHNOLOGIES, INC.
    Inventor: Christian Paul Sommers
  • Patent number: 10732942
    Abstract: This disclosure relates to methods, non-transitory computer readable media, and systems that use a design-component-neural network to categorize a design component from an interface-design file as a platform widget corresponding to a particular computing platform. Having categorized the design component as a platform widget, in certain implementations, the disclosed systems compare and validate properties of the design component against user-interface guidelines for the particular computing platform. Upon determining that the design component does not comply with a user-interface guideline, the systems can provide and implement options to modify the design component to comply with the user-interface guideline.
    Type: Grant
    Filed: September 10, 2018
    Date of Patent: August 4, 2020
    Assignee: ADOBE INC.
    Inventors: Nikhil Gupta, Shivam Mishra, Ashish Anand, Arpit Kumar Singh
  • Patent number: 10725846
    Abstract: A system and method of collecting debugging information for code running in a multi-threaded computing system. An association record is generated in an associative registry. The association record has a timestamp, an object pointer and/or further information. Upon detection of a bug, the computing system generates a debug report based on the association record and the detected bug, the debug reference comprising a reference type that references a portion of the code running in the multi-threaded computing system. Based on the debug reference, a lifecycle check of the portion of the code running in the multi-threaded computing system is generated, the lifecycle check annotating the bug within the portion of the code running in the multi-threaded computing system.
    Type: Grant
    Filed: April 2, 2019
    Date of Patent: July 28, 2020
    Assignee: SAP SE
    Inventor: Ivan Schreter
  • Patent number: 10719432
    Abstract: Systems and methods for performing automated software testing on user interface elements are disclosed. For instance, a first element of an application can be identified. A signature can be generated for the first element. The signature for the first element can include one or more attributes descriptive of the first element. After an update of the application, a candidate element signature can be generated for one or more candidate elements in the updated application. The signature for the first element can be compared to each candidate element signature to determine whether the first element matches each candidate element, thereby enabling the first element to be located after the update of the application.
    Type: Grant
    Filed: October 22, 2019
    Date of Patent: July 21, 2020
    Assignee: Softesis Inc.
    Inventors: Ivan Konyshev, Dmytro Shamatrin, Pavlo Grebeniuk
  • Patent number: 10713237
    Abstract: According to an aspect, a method for correcting an invalid script in a web application includes determining an invalid reference in an invalid script. A storage location is determined in a database corresponding to the invalid reference based on a data relationship mapping, wherein the data relationship mapping indicates the correspondence between the reference and a storage location in the database. An up-to-date value at the storage location is queried and he queried up-to-date value is determined to be the correct value of the invalid reference.
    Type: Grant
    Filed: June 15, 2017
    Date of Patent: July 14, 2020
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Yi Kong, Zi Yan Tu, Xi Ning Wang, Zhen Yu Xing, Qi Zhang
  • Patent number: 10705837
    Abstract: A method and apparatus are disclosed for finding overlong source code segments (e.g., methods) by evaluating input source code segments for a plurality of predetermined code metric values in order to identify candidate source code segments (e.g., non-autogenerated methods) which do not meet a first code metric value and to assess each candidate source code segment against a second code metric value to identify different sets of candidate source code segments (e.g., test methods and normal methods) so that each set of candidate source code segments may be assessed against a tailored set of code length thresholds to identify any overlong source code segment having a code length which meets or exceeds at least two of the tailored set of code length thresholds.
    Type: Grant
    Filed: September 12, 2017
    Date of Patent: July 7, 2020
    Assignee: DevFactory Innovations FZ-LLC
    Inventor: Aditya T. Kadam
  • Patent number: 10705795
    Abstract: A device may receive information associated with first and second bug reports to be classified as duplicate or non-duplicate bug reports. The device may identify first and second descriptions associated with the first and second bug reports, respectively. The first and second descriptions may be different descriptions having a shared description type. The device may identify a neural network for encoding the first and second descriptions, based on the shared description type. The device may encode the first description into a first vector using the neural network, and may encode the second description into a second vector using the neural network. The device may classify the first and second bug reports as duplicate or non-duplicate bug reports based on the first vector and the second vector. The device may perform an action based on classifying the first and second bug reports as duplicate or non-duplicate bug reports.
    Type: Grant
    Filed: December 18, 2017
    Date of Patent: July 7, 2020
    Assignee: Accenture Global Solutions Limited
    Inventors: Sanjay Podder, Jayati Deshmukh, Annervaz K M, Shubhashis Sengupta, Neville Dubash
  • Patent number: 10691521
    Abstract: Methods and devices for identifying accessibility issues for assistive technology operating on a computer device. The methods and devices may include automatically detecting at least one accessibility error for the assistive technology operating on the computer device. The methods and devices may include identifying application information for one or more applications associated with the at least one accessibility error and identifying element information where the at least one accessibility error occurred. The methods and devices may include generating error data for the at least one accessibility error with the application information and the element information. The methods and devices may include transmitting the error data.
    Type: Grant
    Filed: February 15, 2018
    Date of Patent: June 23, 2020
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Heather Marie Eichholz, Somya Sharma, Kent Spencer Barker, Anguel Spassov Dimitrov
  • Patent number: 10691585
    Abstract: A system includes a memory system having computer readable instructions and one or more processors for executing the computer readable instructions. The computer readable instructions include identifying input characteristic subsets for a system under test based on an input schema, generating discrimination test cases including a combination of inputs for the system under test based on the input characteristic subsets, and performing a pruning operation to reduce a number of the discrimination test cases based on identifying a superset of input characteristics that includes at least one of the input characteristic subsets having a discrimination score above a threshold value.
    Type: Grant
    Filed: November 30, 2018
    Date of Patent: June 23, 2020
    Assignee: THE UNIVERSITY OF MASSACHUSETTS
    Inventors: Alexandra Meliou, Yuriy Brun
  • Patent number: 10684943
    Abstract: A mapping is created between test steps from existing test cases and code snippets from existing automated test scripts. The code snippets are clustered into categories. The test steps are refined to generate training word segments. A new manual test case to automate is received. New test steps from the new manual test case are refined to generate new word segments. Probabilities are calculated for the categories, each probability indicating a likelihood that a new test step belongs in a particular category, and being based on a training word segment associated with the particular category, and a new word segment derived from the new test step. The new test step is mapped to a code snippet from a category having the highest probability. The probability calculation and code snippet mapping is repeated for each other new test step.
    Type: Grant
    Filed: August 28, 2018
    Date of Patent: June 16, 2020
    Assignee: EMC IP Holding Company LLC
    Inventors: Peng Fei, Zhongyi Zhou
  • Patent number: 10686682
    Abstract: A computer system for classifying one or more servers by server type in a networked computing system to institute server-type based monitoring and or maintenance of the networked computing system. The computer system includes a processor, a memory, a data receiver, a server signature generator, and a server-type tagging service. The data receiver collects server performance data for a first server over a time interval. The server signature generator determines a signature of the first server based on the collected server performance data. The server-type tagging service compares the signature of the first server to a signature of a second server of known server type, determines a similarity of the signature of the first server to the signature of the second server, and, based on the similarity, classifies the first server as being of the same server type as the second server.
    Type: Grant
    Filed: December 22, 2017
    Date of Patent: June 16, 2020
    Assignee: BMC Software, Inc.
    Inventors: Nitin Navare, Sridhar Sodem, Mark Rivington
  • Patent number: 10678678
    Abstract: Methods, systems, and computer-readable media for ordered test execution based on code coverage are disclosed. A suite of tests are executed on a first version of program code to generate data indicative of code coverage of respective tests with respect to the program code. A mapping of the tests to the program code is determined based at least in part on the data indicative of code coverage and is stored. The mapping comprises data indicative of one or more portions of the program code exercised by respective tests from the suite. Based at least in part on the mapping of the tests to the program code and on data indicative of one or more modified or new portions of a second version of the program code, a subset of the tests is determined that are likely to be exercised by the second version of the program code.
    Type: Grant
    Filed: March 12, 2018
    Date of Patent: June 9, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Kathleen Joanna Tsoukalas, Carlos Alejandro Arguelles, Sichao Shi
  • Patent number: 10678683
    Abstract: The invention relates to a computer-implemented system and method for service level testing and regression. The method may comprise the steps of automatically intercepting service requests from users; storing the service requests in a test database; generating a set of service request test cases from the service requests, wherein the test cases represent substantially all forms of service requests but eliminate redundant service requests, e.g., those that are different only due to input data; executing service testing using all of the test cases; and generating a report of results from the service testing. The step of executing service testing may comprise testing of an earlier code version to generate a baseline response and testing a current code version to generate a target response. The step of generating a report may comprise generating a regression test report that includes the baseline response and the target response for the test cases.
    Type: Grant
    Filed: March 7, 2018
    Date of Patent: June 9, 2020
    Assignee: JPMorgan Chase Bank, N.A.
    Inventors: Vipul Ranjan, Srinivasa R. Podugu, Biren A. Desai, Sunanda Dhingra, Ravi K. Gelli, Ashwini Jambagi, Sheril Joseph, Agim Perolli, Ulku Rowe
  • Patent number: 10671041
    Abstract: Systems are provided for a “loadable module” architecture for industrial controllers in which new control program modules which provide updated functions or features may be loaded to extend or modify the underlying operating system and/or other services without updating the firmware and without disrupting or otherwise compromising the ability of the industrial controller to maintain continuous control over the controlled process. Control program modules and libraries may be delivered to the industrial controller in object code format and an embedded linker in the industrial controller may be used to efficiently create fully linked and executable files locally. Loadable libraries may be provided to the industrial controller during runtime to extend functionality and/or provide desired fixes. As a result, a system is provided that is more efficient and that enables significant flexibility in adding new capabilities.
    Type: Grant
    Filed: March 26, 2018
    Date of Patent: June 2, 2020
    Assignee: Rockwell Automation Technologies, Inc.
    Inventors: Charles M. Rischar, Ladislav Bumbalek, Filip Macurek, Michael Viste, Petr Pitrinec
  • Patent number: 10664243
    Abstract: A method begins by generating application system state transitions from inputted requirements and parameters. For a current implementation of generating application code, the method continues by entering a loop. The loop begins by generating a current intermediate result based on a previous implementation and in accordance with current application code development factors. The loop continues by generating at least one test case based on the one or more of the application system state transitions. The loop continues by testing the current intermediate result in accordance with the at least one test case. When the testing is unfavorable, the loop continues by modifying one or more of: the one or more of the plurality of application system state transitions, the one or more of the parameters, and the one or more implementation tools. The loop then continues by repeating the loop using the modified current application code development factors.
    Type: Grant
    Filed: September 20, 2017
    Date of Patent: May 26, 2020
    Assignee: UniqueSoft, LLC
    Inventor: Thomas J. Weigert
  • Patent number: 10657030
    Abstract: A computer-implemented method, computer program product, and system is provided for testing software. In an implementation, a method may include executing at least one test group during testing of a software application in a multi-platform testing environment. The method may also include detecting an error in the software application based upon, at least in part, execution of the at least one test group. The method may further include resolving the error during execution of the at least one test group in the multi-platform testing environment.
    Type: Grant
    Filed: March 22, 2018
    Date of Patent: May 19, 2020
    Assignee: International Business Machines Corporation
    Inventors: Hubert Hwang, Rosalba Lucero, Hassan A. Shazly, Douglas A. Van Dyken
  • Patent number: 10652037
    Abstract: Systems, methods, and software are disclosed herein for operating a notification service for notifying affected users of modifications made to features in a software application. The notification service maintains a database comprising a list of the features in the software application and a list of users associated with each of the features. The notification service detects at least a modification to a feature in the software application that requires affected users to be notified. In response to detecting the modification to the feature, the notification service queries the database based at least on an identify of the feature associated with the modification to identify the affected users. Notifications are then generated and communicated to the affected users indicative of at least the modification to the feature in the software application.
    Type: Grant
    Filed: December 1, 2017
    Date of Patent: May 12, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Jimmy Yu Hin Kan, Michal Miriam Swafford, Dennis Borisovitch Zverev, Abhinav Garg, Rong Wu
  • Patent number: 10649743
    Abstract: The present disclosure relates to an electronic application developing method. The method comprises providing a development platform with a plurality of cross-industry application templates. Users can design applications and plan business processes via the development platform efficiently without building any infrastructure or writing any programming code.
    Type: Grant
    Filed: January 4, 2017
    Date of Patent: May 12, 2020
    Inventor: Chen-Chung Yeh
  • Patent number: 10642721
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for an automated testing script generation system are disclosed. In one aspect, a method includes the actions of receiving a context file, a test scenario, and a selected automation tool selected through a user interface, the context file including an object map comprising objects that correlate to respective components of a display page, the test scenario describing a test case for the application involving an intended interaction with a component on the display page, correlating the intended interaction with the component with the corresponding object in the object map, processing the intended interaction and the corresponding object through an Artificial Intelligence (AI) model, determining a script template based, applying the script template to generate an automated testing script for the selected automating tool, and executing the automated testing script to test the function of the display page.
    Type: Grant
    Filed: January 10, 2018
    Date of Patent: May 5, 2020
    Assignee: Accenture Global Solutions Limited
    Inventors: Girish Kulkarni, Sivasankar Ramalingam, Chinmaya Ranjan Jena
  • Patent number: 10635566
    Abstract: In one embodiment, an integrated development environment (IDE) is maintained on a computing device for managing software code for one or more software programs. At the IDE on the computing device, one or more code changes to the software code are determined between a given version of the software code and a subsequent version of the software code, and then a performance impact of each of the one or more code changes is determined. The IDE (or IDE plugin) prepares user-understandable indications of the performance impact of the one or more code changes, and displays the user-understandable indications of the performance impact in a graphical user interface (GUI) when a respective code change is displayed in the GUI.
    Type: Grant
    Filed: July 31, 2017
    Date of Patent: April 28, 2020
    Assignee: Cisco Technology, Inc.
    Inventors: Satish Talluri, Suraj Puvvada, Buchi Reddy Busi Reddy, Prudhvi Kumar Chaganti
  • Patent number: 10628392
    Abstract: In one aspect, a method includes identifying a request to generate a collection for collecting a set of content items for a user, determining a set of rules associated with the collection, the set of rules comprising one or more of one or more collection update rules or one or more collection maintenance rules, determining access rights with respect to the collection and generating the collection according to the set of rules, and providing access to the collection according to the access rights in response to the request. Other aspects can be embodied in corresponding systems and apparatus, including computer program products.
    Type: Grant
    Filed: January 27, 2015
    Date of Patent: April 21, 2020
    Assignee: GOOGLE LLC
    Inventors: Tomasz Charytoniuk, Dmitry Shapiro
  • Patent number: 10628140
    Abstract: A block-diagram acquisition unit acquires a block diagram that defines by connection among a plurality of blocks, a data processing procedure to be reflected in a program code. An inconsistency inspection unit inspects whether there is an inconsistency in the data processing procedure defined in the block diagram by tracing the connection among blocks in the block diagram.
    Type: Grant
    Filed: November 17, 2016
    Date of Patent: April 21, 2020
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventors: Takeshi Ueda, Nobuhiro Kobayashi
  • Patent number: 10621372
    Abstract: Systems and methods are provided for generating database access objects. Metadata associated with a database table is retrieved. The metadata includes a table name, column names, foreign key information, and/or primary key information. Objects are generated. Each object is associated with a corresponding row in the database table and includes fields associated with a corresponding column in the database table. A database access object is generated based on the metadata. The database access object includes relational database code to access data associated with the objects. The database access object is modified. Data associated with an object is accessed based on the modified database access object.
    Type: Grant
    Filed: April 10, 2013
    Date of Patent: April 14, 2020
    Assignee: salesforce.com, inc.
    Inventors: Oleksandr Khimich, Craig Howland, Pawan Nachnani, Fang Wong, Lei Ming
  • Patent number: 10613856
    Abstract: A processor-implemented method for generating a test suite within a time requirement is provided. The processor-implemented method includes executing a rule selection operation to determine candidate test cases utilizing attributes corresponding to each of the candidate test cases to produce selected test cases. The processor-implemented method includes determining whether an estimated testing execution time of the selected test cases is equal to or less than the time requirement. The processor-implemented method includes generating the test suite based on the selected test cases when the estimated testing execution time is equal to or less than the time requirement.
    Type: Grant
    Filed: August 24, 2017
    Date of Patent: April 7, 2020
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Wei-Hsiang Hsiung, Jeff H C Kuo, Chien Pang Lee, John K C Lee
  • Patent number: 10614432
    Abstract: A transaction is centrally controlled over multiple communication channels as a sequence of discrete processing units some of which are distributed. In an embodiment, the transaction's processing progression can be shared of the communication channels and paused on one communication channel and resumed on a different communication channel.
    Type: Grant
    Filed: January 29, 2016
    Date of Patent: April 7, 2020
    Assignee: NCR Corporation
    Inventors: Andrew David Monaghan, Mervin Amos, Jeffrey Stephen Cooper, Andrew Short
  • Patent number: 10613966
    Abstract: Embodiments of the present disclosure relates to a method and a system for controlling automation of testing applications. In an embodiment, automation test scripts read from automation test framework are processed to determine a unique key reference value and map with a plurality of automation test scripts stored in a master test repository. Based on the mapping, manual step information comprising at least a step description and expected result of the mapping automation test script is derived and updated in the master test repository for future references. Thus, the method and the system enables reusing of available manual step information for automation test scripts to generate manual steps thereby, minimizing time and cost involved in creating manual steps for automation of testing applications.
    Type: Grant
    Filed: March 24, 2017
    Date of Patent: April 7, 2020
    Assignee: Wipro Limited
    Inventors: Vishal Nagpal, Jeevan Kumar S, Dayananda Chowdanakuppe Shivalingaiah, Linish Hariharan
  • Patent number: 10613857
    Abstract: A processor-implemented method for generating a test suite within a time requirement is provided. The processor-implemented method includes executing a rule selection operation to determine candidate test cases utilizing attributes corresponding to each of the candidate test cases to produce selected test cases. The processor-implemented method includes determining whether an estimated testing execution time of the selected test cases is equal to or less than the time requirement. The processor-implemented method includes generating the test suite based on the selected test cases when the estimated testing execution time is equal to or less than the time requirement.
    Type: Grant
    Filed: November 17, 2017
    Date of Patent: April 7, 2020
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Wei-Hsiang Hsiung, Jeff H C Kuo, Chien Pang Lee, John K C Lee
  • Patent number: 10613852
    Abstract: A system receives one or more messages including information related to one or more issues associated with a software application installed on a user device. In response to receiving the message, a processor in the system identifies a user context associated with the user device, wherein the user context comprises usage information related to the software application. The processor further analyzes the received information and the user context associated with the user device to determine one or more errors associated with the software application. One or more software updates that are available and associated with the one or more errors are determined. The system automatically installs one or more of the determined software updates on the user device. Embodiments of the present invention further include a method and computer program product for managing and installing one or more software updates in substantially the same manner as is described above.
    Type: Grant
    Filed: April 2, 2019
    Date of Patent: April 7, 2020
    Assignee: International Business Machines Corporation
    Inventors: Kapish Kumar, Gaurav Mehrotra, Rulesh Rebello, Praveen R. Sogalad
  • Patent number: 10606892
    Abstract: In partitioning a graph database, a plurality of vertices of the graph database is assigned to a plurality of nodes. The vertices of the graph database are connected by edges that indicate relationships between the vertices. A vertex of the graph database is designated as a super-vertex that is split into a truncated vertex and at least one vertex representative.
    Type: Grant
    Filed: July 19, 2016
    Date of Patent: March 31, 2020
    Assignee: DataStax, Inc.
    Inventor: Matthias Broecheler
  • Patent number: 10607015
    Abstract: Disclosed embodiments relate to systems and methods for automatically detecting and addressing security risks in code segments. Techniques include accessing a plurality of code segments developed for execution in a network environment, automatically identifying a first code segment from the plurality of code segments for analysis, automatically performing a first code-level security risk assessment for the first code segment, and determining a first security risk level for the first code segment based on the application programming interface risk level. The first code-level security risk assessment may be performed based on at least one of an application programming interface risk level, an embedded credentials risk level, and a target resource risk level. Further techniques may include determining a second security risk level for a modified version of the first code segment; and enabling a comparison between the first security risk level and the second security risk level.
    Type: Grant
    Filed: May 16, 2019
    Date of Patent: March 31, 2020
    Assignee: CYBERARK SOFTWARE LTD.
    Inventors: Asaf Hecht, Hadas Elkabir