Testing Or Debugging Patents (Class 717/124)
  • Patent number: 10387475
    Abstract: A system to collect and store in a special data structure arranged for rapid searching massive amounts of data. Performance metric data is one example. The performance metric data is recorded in time-series measurements, converted into unicode, and arranged into a special data structure having one directory for every day which stores all the metric data collected that day. The performance metric data is collected by one or more probes running on machines about which data is being collected. The performance metric data is compressed prior to transmission to a server over any data path. The data structure at the server where analysis is done has a subdirectory for every resource type. Each subdirectory contains text files of performance metric data values measured for attributes in a group of attributes to which said text file is dedicated. Each attribute has its own section and the performance metric data values are recorded in time series as unicode hex numbers as a comma delimited list.
    Type: Grant
    Filed: June 15, 2016
    Date of Patent: August 20, 2019
    Assignee: Cumulus Systems Inc.
    Inventors: Ajit Bhave, Arun Ramachandran, Sai Krishnam Raju Nadimpali, Sandeep Bele
  • Patent number: 10387687
    Abstract: A method of trust provisioning a device, including: receiving, by a hardware security module (HSM), a list of instructions configured to produce trust provisioning information; performing, by the HSM, a constraint check on the list of instructions including performing a symbolic execution of the list of instructions; receiving confidential inputs; executing, by the HSM, the list of instructions on the confidential inputs when the list of instructions passes the constraint check; outputting, by the HSM, trust provisioning information.
    Type: Grant
    Filed: April 7, 2017
    Date of Patent: August 20, 2019
    Assignee: NXP B.V.
    Inventors: Florian Boehl, Clemens Orthacker, Klaus Martin Potzmader, Andreas Daniel Sinnhofer, Christian Steger
  • Patent number: 10387297
    Abstract: A system, method, and computer program product are provided for end-to-end test management of a software testing project. In operation, a plurality of test architectures associated with at least one software testing project are configured. Further, a plurality of test environments are generated from the plurality of test architectures. Additionally, the plurality of test environments are published to a Web Server associated with a test management system. Moreover, information associated with the plurality of test environments is displayed.
    Type: Grant
    Filed: June 6, 2017
    Date of Patent: August 20, 2019
    Assignee: AMDOCS DEVELOPMENT LIMITED
    Inventors: Sharon Elgarat, Shay Cohen, Rafi Massarwa
  • Patent number: 10372513
    Abstract: A computing device includes at least one processor and a machine-readable storage medium storing instructions. The instructions may be executable by the hardware processor to, in response to a detection of an application event during execution of an application, read a plurality of entries included in a call stack at a time of the application event. The instructions are also executable to determine a classification identifier for the application event using the plurality of entries included in the call stack, and store information about the application event in a database entry associated with the classification identifier.
    Type: Grant
    Filed: April 30, 2015
    Date of Patent: August 6, 2019
    Assignee: ENTIT SOFTWARE LLC
    Inventors: Amichai Nitsan, Haim Shuvali, Hana Giat
  • Patent number: 10372588
    Abstract: A method and associated system for providing debug information associated with computer software executing in a production container. The production container is replicated as a debug container. The computer software is executed in the production container and the debug container. Executing the computer software includes replicating requests sent to the computer software executing in the production container to the computer software executing in the debug container. Requests from the computer software executing in the production container are stored together with any responses to the stored requests. Debug information generated by the computer software executing in the debug container is stored.
    Type: Grant
    Filed: July 8, 2016
    Date of Patent: August 6, 2019
    Assignee: International Business Machines Corporation
    Inventors: Jack S. Baines, Kirstine F. L. Clapperton, David J. Crighton, Rosanna M. Lickorish, Martin R. Naish
  • Patent number: 10372438
    Abstract: A system receives one or more messages including information related to one or more issues associated with a software application installed on a user device. In response to receiving the message, a processor in the system identifies a user context associated with the user device, wherein the user context comprises usage information related to the software application. The processor further analyzes the received information and the user context associated with the user device to determine one or more errors associated with the software application. One or more software updates that are available and associated with the one or more errors are determined. The system automatically installs one or more of the determined software updates on the user device. Embodiments of the present invention further include a method and computer program product for managing and installing one or more software updates in substantially the same manner as is described above.
    Type: Grant
    Filed: November 17, 2017
    Date of Patent: August 6, 2019
    Assignee: International Business Machines Corporation
    Inventors: Kapish Kumar, Gaurav Mehrotra, Rulesh Rebello, Praveen R. Sogalad
  • Patent number: 10372120
    Abstract: According to some embodiments, a system and method are provided to receive a first plurality of data from a machine associated with a first time period. A normal operation of the machine is automatically determined based on the first plurality of data. A second plurality of data may be received from the machine associated with a second time period. An anomaly in the second plurality of data is determined.
    Type: Grant
    Filed: October 6, 2016
    Date of Patent: August 6, 2019
    Assignee: General Electric Company
    Inventors: Sundeep R Patil, Ansh Kapil, Alexander Sagel, Lutter Michael, Oliver Baptista, Martin Kleinsteuber
  • Patent number: 10360137
    Abstract: Embodiments include methods, and adaptive testing systems, and computer program products for performing adaptive testing using one or more system resources of a computer system dynamically determined from a platform on which a test program is executing. Aspects include: test program sending a resource query based on certain criteria to a resource query module to inquire one or more available system resources of computer system, the resource query module using certain operating system commands of computer system to determine appropriate system resources available for use on the computer system, the computer system returning the appropriate system resources determined on the computer system to the resource query module of the test program, the test program deciding one or more system resources that best meet a need of the test program, and the test program performing the adaptive testing on the computer system based on the one or more system resources decided.
    Type: Grant
    Filed: June 28, 2016
    Date of Patent: July 23, 2019
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Heather M. Bosko, Deborah A. Furman, Bradley M. Messer, Anthony T. Sofia
  • Patent number: 10346748
    Abstract: Solution of a problem of determining values of a set of N problem variables x, makes use of a quantum processor that has a limited number of hardware elements for representing quantum bits and/or limitations on coupling between quantum bits. A method includes accepting a specification of the problem that includes a specification of a set of terms where each term corresponds to a product of at least three variables and is associated with a non-zero coefficient. A set of ancilla variables, each ancilla variable corresponding to a pair of problem variables, is determined by applying an optimization procedure to the specification of the set of the terms. The accepted problem specification is then transformed according to the determined ancilla variables to form a modified problem specification for use in configuring the quantum processor and solution of problem.
    Type: Grant
    Filed: July 25, 2014
    Date of Patent: July 9, 2019
    Assignee: PRESIDENT AND FELLOWS OF HARVARD COLLEGE
    Inventors: Alan Aspuru-Guzik, Ryan Babbush, Bryan O'Gorman
  • Patent number: 10346057
    Abstract: A technique allocates storage from a plurality of storage pools of a data storage assembly to host storage. The technique involves receiving an allocation request and, in response to the allocation request, performing a set of probability-based allocation attempt operations that attempts to allocate a storage portion from one of the plurality of storage pools to the host storage. Each storage pool of the plurality of storage pools provides multiple storage portions of physical storage to store host data. The technique further involves, based on a result of the set of probability-based allocation attempt operations, provisioning the host storage with a storage portion from a particular pool of the plurality of storage pools to satisfy the allocation request.
    Type: Grant
    Filed: December 30, 2016
    Date of Patent: July 9, 2019
    Assignee: EMC IP Holding Company LLC
    Inventors: Owen Martin, Mark Moreau
  • Patent number: 10324831
    Abstract: Described are techniques for testing software. The techniques may include identifying, at a first point in time, first code that has been modified, identifying, using first mapping information, a testing set of one or more test cases wherein the first mapping information identifies each test case of the testing set as a test case used to test the first code, running the testing set, generating coverage information in accordance with executing; analyzing the coverage information, generating second mapping information in accordance with said analyzing, and updating the first mapping information in accordance with the second mapping information.
    Type: Grant
    Filed: August 12, 2016
    Date of Patent: June 18, 2019
    Assignee: EMC IP Holding Company LLC
    Inventors: Zhipeng Zhang, Shouyuan Cheng, Binbin Deng, Bo Wu, Binhua Lu, Scott D. Von Rhee
  • Patent number: 10324659
    Abstract: A method, a computing system and a computer program product are provided. A first process of multiple processes sets access rights regarding a shared memory buffer from a shared memory to read/write, the shared memory buffer having been allocated and provided to the first process by a second process of the multiple processes. The first process sets access rights regarding a supplemental memory area of the shared memory buffer to no access, the supplemental memory area being before a usable buffer portion of the shared memory buffer, after the usable buffer portion of the shared memory buffer, or both before and after the usable buffer portion of the shared memory buffer. The first process stops executing when the first process attempts to access any portion of the supplemental memory area.
    Type: Grant
    Filed: May 24, 2017
    Date of Patent: June 18, 2019
    Assignee: International Business Machines Corporation
    Inventors: Yi Guo, Shaorong Li, Mingquan Rao, Youcheng Yang
  • Patent number: 10324820
    Abstract: Providing specialization for a static program analysis procedure by executing an automated agent to monitor a code authoring process for a program under examination that includes a plurality of respective lexical scopes. The agent monitors a corresponding amount of coding time, or a corresponding number of edits, for each of the plurality of respective lexical scopes. A mapping associates each of the plurality of respective lexical scopes with a first quantitative measure of the corresponding amount of time, or a second quantitative measure of the corresponding number of edits, that were used to code each of the plurality of respective lexical scopes. The static analysis procedure is specialized by applying a more refined, detailed, precise, or granular analysis to a first lexical scope that is mapped to a greater amount of time or a greater number of edits than a second lexical scope.
    Type: Grant
    Filed: September 21, 2016
    Date of Patent: June 18, 2019
    Assignee: International Business Machines Corporation
    Inventors: Marco Pistoia, Omer Tripp
  • Patent number: 10324905
    Abstract: A particular node of a journal-based multi-node distributed storage system requests the addition of an acceptability verification request entry to the journal, indicating a proposed state change of the system. The particular node examines contents of entries added to the journal after the acceptability verification request entry. After determining that a targeted set of acceptability verification response entries have been added to the journal, indicating that the potential state change meets acceptance criteria at respective other nodes of the system, the particular node requests an addition of a committed transaction entry to the journal, indicating an approval of the proposed state change.
    Type: Grant
    Filed: August 21, 2015
    Date of Patent: June 18, 2019
    Assignee: Amazon Technologies, Inc.
    Inventors: Andrew Wayne Ross, Artem Danilov, Timothy Daniel Cole, Tate Andrew Certain, Christopher Richard Jacques De Kadt, John Michael Morkel, Allan Henry Vermeulen
  • Patent number: 10318765
    Abstract: A system and method for securing a hypervisor and operating systems that execute on a computing device. An encrypted hypervisor is uploaded to a hardware chip. Prior to being executed, the hypervisor is decrypted using a secure security processor and stored in an on-chip memory. When a processor on the hardware chip executes the hypervisor, at least one on-chip component continuously authenticates the hypervisor during execution. A hypervisor configures a processor with access rights associated with an operating system, where the access rights determine access of the operating system to an at least one resource. A transaction filter then uses the access rights associated with the operating system to monitor the access of the operating system to the at least one resource in real-time as the operating system executes on a processor.
    Type: Grant
    Filed: October 31, 2014
    Date of Patent: June 11, 2019
    Assignee: Avago Technologies International Sales Pte. Limited
    Inventors: Stephane Rodgers, Shashank Shekhar, Flaviu Dorin Turean
  • Patent number: 10310821
    Abstract: The subject technology provides for determining that a machine learning model in a first format includes sufficient data to conform to a particular model specification in a second format, the second format corresponding to an object oriented programming language. The subject technology transforms the machine learning model into a transformed machine learning model that is compatible with the particular model specification. The subject technology generates a code interface and code for the transformed machine learning model, the code interface including code statements in the object oriented programming language, the code statements corresponding to an object representing the transformed machine learning model. Further, the subject technology provides the generated code interface and the code for display in an integrated development environment (IDE), the IDE enabling modifying of the generated code interface and the code.
    Type: Grant
    Filed: September 29, 2017
    Date of Patent: June 4, 2019
    Assignee: APPLE INC.
    Inventors: Alexander B. Brown, Michael R. Siracusa, Gaurav Kapoor, Elizabeth Ottens, Christopher M. Hanson, Zachary A. Nation, Vrushali Mundhe, Srikrishna Sridhar
  • Patent number: 10303587
    Abstract: The present disclosure relates to systems and methods to generate a test suite for regression testing. The method may comprise comparing a set of current code blocks with a set of historical code blocks to identify a set of modified code blocks from the set of historical code blocks associated with a software application. Further, the set of modified code blocks may be analysed to determine type of modification associated with each modified code block. Further, the method may comprise determining a set of impacted code blocks from the set of modified code blocks based on analysis of the type of modification associated with each modified code block. Further, the method may comprise identifying and prioritizing a subset of test cases from a set of test cases based on analysis of the set of impacted code blocks, thereby generating a regression test suite for regression testing of the current build.
    Type: Grant
    Filed: July 20, 2018
    Date of Patent: May 28, 2019
    Assignee: HCL TECHNOLOGIES LIMITED
    Inventors: Hareendran M, Rajesh Babu Suraparaju
  • Patent number: 10303583
    Abstract: A method and system for performing a unit test in a self-contained environment. The system may include using an object relationship mapping file to generate data objects that can be used for code for a unit test without having to refer to a database to perform a unit test. The data objects may further provide for simultaneous unit tests and a self-contained environment to perform the unit tests to improve the quality and resources required to perform such unit tests. The system may perform the unit tests independent of access to a database.
    Type: Grant
    Filed: June 18, 2015
    Date of Patent: May 28, 2019
    Assignee: Halliburton Energy Services, Inc.
    Inventor: Philip Steven Teitel
  • Patent number: 10303584
    Abstract: A method for message-processing adapted to a server and a device under test is disclosed. The device provides a plurality of messages and the server receives the plurality of messages through a first interface. In the method, receive a plurality of first predetermined triggering conditions. Each first predetermined triggering condition has a first character string. Then, read the plurality of messages sequentially. Then, determine whether at least one of the plurality of first predetermined triggering conditions is enabled. Check whether the plurality of messages contains the first character string of the enabled one of the plurality of first predetermined triggering conditions sequentially. Then, form a first filtering group having contents comprising part of the plurality of messages, wherein said part of the plurality of messages has the first character string of the enabled one of the plurality of first triggering conditions. Display the contents of the first filtering group.
    Type: Grant
    Filed: May 16, 2017
    Date of Patent: May 28, 2019
    Assignee: AMTRAN TECHNOLOGY CO., LTD.
    Inventor: Ke-Fan Chang
  • Patent number: 10296446
    Abstract: In an approach to reducing regression test duration, one or more computer processors receive a first code change. The one or more computer processors retrieve one or more historic code changes relevant to the first code change. The one or more computer processors determine whether one or more failed test cases are relevant to the one or more historic code changes, where the one or more relevant failed test cases and the one or more historic code changes are stored in a table of test history. In response to determining the one or more historic code changes are relevant to one or more failed test cases, the one or more computer processors retrieve the one or more relevant failed test cases from the table of test history.
    Type: Grant
    Filed: November 18, 2015
    Date of Patent: May 21, 2019
    Assignee: International Business Machines Corporation
    Inventors: Adam K. D'Andrea, Jenna R. Elliott, Fahad A. Khan, Raymond C. Kwong, Chad J. McIntyre, Sina Sadeghian Sadeghabad
  • Patent number: 10296241
    Abstract: When user configuration data recorded in a recording medium is written into a PLC, the PLC determines, in accordance with a combination table stored in the recording medium, if a combination of the user configuration data and firmware already stored in the PLC is suitable. In addition, when firmware recorded in the recording medium is written into the PLC, the PLC determines, in accordance with the combination table stored in the recording medium, if a combination of the firmware and user configuration data already stored in the PLC is suitable.
    Type: Grant
    Filed: January 15, 2015
    Date of Patent: May 21, 2019
    Assignee: OMRON Corporation
    Inventors: Takehiko Hioka, Yutaka Abe, Shinsuke Kawanoue
  • Patent number: 10289630
    Abstract: A development platform system is disclosed that provides a development platform configured to create new and modified web-based applications. The development platform may be configured to search for and select a design layout template from available design layout templates stored on a database library. The development platform may further be configured to search for and select a data visualization template from available data visualization templates stored on a database library. The development platform may further be configured to generate a data visualization modification interface and accept a client device customization input to modify attributes of a data visualization. Templates that are modified by the development platform may be stored for subsequent look-up on a database library according to metadata describing attributes of the templates.
    Type: Grant
    Filed: June 27, 2017
    Date of Patent: May 14, 2019
    Assignee: Accenture Global Solutions Limited
    Inventors: Jeffrey Catania, Tiffany Dharma, Aaron Pang, Teresa Sheausan Tung
  • Patent number: 10289706
    Abstract: Repairing corrupt database references. Identifying a corrupt reference within a database, whereby the corrupt reference includes a reference with a broken connection between one or more data objects within the database and the corrupt reference is associated with one or more reference corruption types. Recording reference information for the corrupt reference, whereby the reference information includes a location of the corrupt reference within the database and one or more identification numbers of the one or more data objects associated with the corrupt reference. Determining a repair procedure based on the one or more reference corruption types associated with the corrupt reference. Generating one or more lines of computer code associated with the repair procedure and based on the recorded reference information. Executing the one or more lines, whereby the one or more lines are executed in a database manager.
    Type: Grant
    Filed: June 3, 2015
    Date of Patent: May 14, 2019
    Assignee: International Business Machines Corporation
    Inventors: Luca Contessa, Jeffrey N. Hagelberg
  • Patent number: 10289472
    Abstract: Embodiments of the present disclosure disclose a resource leak detection method, apparatus, and system that includes obtaining a target resource called when target code of a program runs, where the target code is partial code in program code, determining a first storage resource amount occupied by the target resource, determining whether the first storage resource amount occupied by the target resource satisfies a first preset condition, and if the first storage resource amount occupied by the target resource satisfies the first preset condition, determining a storage location of the target code as a resource leak location. In the embodiments of the present disclosure, the target code of the program can be tracked, and further, by means of detection, the storage location of the target code can be determined as the resource leak location.
    Type: Grant
    Filed: February 24, 2017
    Date of Patent: May 14, 2019
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Jinghui Li, Jianqing Yuan, Xuewen Gong, Youzhan Yin
  • Patent number: 10284451
    Abstract: A server manages a script and a task, the script being a command via a web page provided by a network device, and the task designating a timing of execution of the script. In a case where the server detects a change in a configuration of the web page provided by the network device, the server controls execution of the script of the task according to the detected change. In a case where the detected change indicates that a web page element to be an operation target by the script of the managed task has been deleted, the server stops the execution of the script.
    Type: Grant
    Filed: May 19, 2015
    Date of Patent: May 7, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventor: Takeshi Shiihara
  • Patent number: 10282279
    Abstract: The system and method for diagnosing information technology systems in multiple virtual parallel universes described herein may create virtualized parallel universes that represent a problematic information technology system. The virtualized parallel universes may then be diagnosed to identify potential solutions to a problem experienced in the problematic information technology system (i.e., the parallel universes may be diagnosed without disrupting the live problematic system). For example, the problematic information technology system may be cloned in response to a diagnostic request associated therewith to create various virtualized parallel universes representing the problematic information technology system. The parallel universes may then conduct various problem resolution steps to identify a potential solution to the problem, which may then be applied to the problematic information technology system to resolve the problem associated therewith.
    Type: Grant
    Filed: October 6, 2016
    Date of Patent: May 7, 2019
    Assignee: CA, INC.
    Inventors: Alvin Black, Debra J. Danielson, Jack Zito
  • Patent number: 10282559
    Abstract: In various embodiments, a Data Model Adaptive Execution System may be configured to take one or more suitable actions to remediate an identified risk in view of one or more regulations (e.g., one or more legal regulations, one or more binding corporate rules, etc.). For example, in order to ensure compliance with one or more standards related to the collection and/or storage of personal data, an entity may be required to modify one or more aspects of a way in which the entity collects, stores, and/or otherwise processes personal data (e.g., in response to a change in a legal or other requirement). In order to identify whether a particular change or other risk trigger requires remediation, the system may be configured to assess a relevance of the risk posed by the risk and identify one or more processing activities or data assets that may be affected by the risk.
    Type: Grant
    Filed: October 13, 2018
    Date of Patent: May 7, 2019
    Assignee: OneTrust, LLC
    Inventors: Kabir A. Barday, Mihir S. Karanjkar, Steven W. Finch, Ken A. Browne, Nathan W. Heard, Aakash H. Patel, Jason L. Sabourin, Richard L. Daniel, Dylan D. Patton-Kuhl, Kevin Jones, Jonathan Blake Brannon
  • Patent number: 10282692
    Abstract: In various embodiments, a system may be configured to substantially automatically determine whether to take one or more actions in response to one or more identified risk triggers (e.g., data breaches, regulation change, etc.). The system may, for example: (1) compare the potential risk trigger to one or more previous risks triggers experienced by the particular entity at a previous time; (2) identify a similar previous risk trigger (e.g., one or more previous risk triggers related to a similar change in regulation, breach of data, type of issue identified, etc.); (3) determine the relevance of the current risk trigger based at least in part on a determined relevance of the previous risk trigger; and (4) determine whether to take one or more actions to the current risk trigger based at least in part on one or more determined actions to take in response to the previous, similar risk trigger.
    Type: Grant
    Filed: October 13, 2018
    Date of Patent: May 7, 2019
    Assignee: OneTrust, LLC
    Inventors: Kabir A. Barday, Mihir S. Karanjkar, Steven W. Finch, Ken A. Browne, Nathan W. Heard, Aakash H. Patel, Jason L. Sabourin, Richard L. Daniel, Dylan D. Patton-Kuhl, Kevin Jones, Jonathan Blake Brannon
  • Patent number: 10275266
    Abstract: Various embodiments of systems and methods for language acceptance testing (LAT) for an application are described herein. The method includes executing the application in a base language based upon a test script. While executing the application, metadata of the application is automatically extracted and one or more screenshots of the one or more UIs of the application is automatically captured in the base language. Based upon the extracted metadata and the test script, the application is re-executed in a foreign language supported by the application. One or more screenshots of the same one or more UIs of the application is captured in the foreign language. A list for each captured UI is generated including visual and/or non-visual text(s) of an UI, in the base language and corresponding foreign language. The captured screenshots and the generated lists are stored in a database for language testing.
    Type: Grant
    Filed: December 1, 2017
    Date of Patent: April 30, 2019
    Assignee: SAP SE
    Inventors: Bhavani Bhavineni, Gokulkumar Selvaraj, Knut Stargardt
  • Patent number: 10269167
    Abstract: Systems, methods, and computer readable media to encode and execute an indirect command buffer are described. A processor creates an indirect command buffer that is configured to be encoded into by a graphics processor at a later point in time. The processor encodes, within a command buffer, a produce command that references the indirect command buffer, where the produce command triggers execution on the graphics processor a first operation that encodes a set of commands within the data structure. The processor also encodes, within the command buffer, a consume command that triggers execution on the graphics processor a second operation that executes the set of commands encoded within the data structure. After encoding the command buffer, a processor commits the command buffer for execution on the graphics processor.
    Type: Grant
    Filed: May 21, 2018
    Date of Patent: April 23, 2019
    Assignee: Apple Inc.
    Inventors: Michael Imbrogno, Michal Valient
  • Patent number: 10268565
    Abstract: Techniques are disclosed relating to generating and validating a container for an application. A container for an application may an executable package that include the source code for the application along with the runtime information, system tools, system libraries, and settings for the application. A container validation procedure is determined for the container using a plurality of container validation routines. The container validation routines may reflect the role various validation entities have in validating the container and approving it for deployment. If the container successfully passes the container validation procedure, the container may be deployed on a computer system.
    Type: Grant
    Filed: April 14, 2017
    Date of Patent: April 23, 2019
    Assignee: CA, Inc.
    Inventors: Ankur Agarwal, Prabhu Inbarajan, Hyunji Kim, Natasha Festa, Yuval Dagai
  • Patent number: 10261893
    Abstract: The disclosed methods and systems for coordinating deployment and regression testing across data centers and system clusters in multiple service clouds include accessing test suites via a versioning platform that maintains a metadata notation of an applicable-version to which a version of a test suite applies. They include receiving a request-to-test to run a selected test suite against a selected system; making a machine-to-machine query about the selected system and receiving back a response that specifies a version-to-be-tested; automatically selecting from the versioning platform a test suite version with the applicable-version that supports the version-to-be-tested consistent with the metadata notation of the applicable-version of the selected test suite; and reporting results of running the selected test suite.
    Type: Grant
    Filed: December 5, 2016
    Date of Patent: April 16, 2019
    Assignee: salesforce.com, inc.
    Inventors: Randall S. Forbes, Brian D. McGreer, Jason David Borneman
  • Patent number: 10255169
    Abstract: A method to test a software application based on grouping application features based on categories of the human mind and human senses. Methods and systems for testing an application including generating test scenarios to test an application, the method comprising: extracting a plurality of features associated with the application; determining a match for each of the plurality of features with at least one of a plurality of predefined application features using a list of predefined application features mapped with a plurality of groups representing human senses such as sight, hearing, touch, and balance; creating a data structure having nodes arranged in layers based on the match determined for each of the plurality of features with at least one of the plurality of groups; and generating a plurality of test scenarios for the application based on the data structure based on a combinatorial analysis at each of the plurality of nodes of the data structure.
    Type: Grant
    Filed: November 18, 2016
    Date of Patent: April 9, 2019
    Assignee: Wipro Limited
    Inventor: Uday Shreepad Tandi
  • Patent number: 10241904
    Abstract: The factorization of test components when performing component-level regression testing in iterative builds of a computing system that consists of many working components. Performance metrics for test components are maintained across multiple builds of the computing program. To perform factorization, multiple factorings of a test component are identified and evaluated until a suitable improvement in the maintained performance metric for each corresponding test component is achieved (e.g., via simulation). This may be performed, across multiple of the test components. This process may be iterated through such that the set of test components being factored and evaluated in a subsequent iteration may in fact be a test component created by factorization in a prior iteration. The net result is that the factorization achieves improvement in performance metrics of the test components.
    Type: Grant
    Filed: April 10, 2017
    Date of Patent: March 26, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Suresh Thummalapenta, Jacek Andrzej Czerwonka, Shuvendu K. Lahiri, Nikolaj Skallerud Bjorner, August Shi
  • Patent number: 10235260
    Abstract: Disclosed herein are a machine architecture implementing a staging automation process, including features such as multiple IR transmitters and composite video inputs for automated high volume quality testing. Diagnostic display outputs from a unit under test are input to OCR and video quality algorithms to validate that the units under test are ready for a functional test process at the next stage.
    Type: Grant
    Filed: July 26, 2016
    Date of Patent: March 19, 2019
    Assignee: Contec, LLC
    Inventors: Rajeev Tiwari, Rafael Villanueva
  • Patent number: 10235280
    Abstract: Methods and apparatuses are described for automated script creation and source code generation for testing mobile devices. A server computing device generates a test script user interface for creating test scripts. The test script user interface comprises a first section for displaying a first plurality of test steps, a second section for displaying one or more properties of a programmatic method, a third section for displaying source code of the programmatic method, and a fourth section for displaying a screen representation of a mobile device application under test. The server computing device generates the first plurality of test steps in an ordered sequence, and automatically generates source code of the programmatic method for each of the first plurality of test steps. The server computing device creates a test script using the automatically-generated source code and executes the test script against a mobile device application on a mobile device.
    Type: Grant
    Filed: April 10, 2017
    Date of Patent: March 19, 2019
    Assignee: FMR LLC
    Inventors: Tom Dougherty, John Michael Amadeo, Mustufa Kalyanwalla, Naveen Arasu, Keith Kondrat
  • Patent number: 10235281
    Abstract: A method, computer program product, and computer system for editing code, by a computing device, via an integrated development environment. The code is determined to be syntactically valid. While editing the code, a subset of automated tests associated with the code is executed in response to determining that the code is syntactically valid. It is determined whether at least one automated test error is detected. The at least one automated test error is reported.
    Type: Grant
    Filed: July 25, 2018
    Date of Patent: March 19, 2019
    Assignee: International Business Machines Corporation
    Inventors: Matthew G. Marum, Samuel G. Padgett, Steven K. Speicher, Michael J. Tabb
  • Patent number: 10229031
    Abstract: Various embodiments provide an ability to present content associated with an inline function via a code debugging tool. In some embodiments, the code debugging tool can be configured to enable manipulation of commands associated with the inline function. Alternately or additionally, one or more calls to the inline function can be manipulated independently from each other within the debugging tool.
    Type: Grant
    Filed: July 15, 2011
    Date of Patent: March 12, 2019
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC.
    Inventor: Jen-Lung Chiu
  • Patent number: 10225156
    Abstract: Some examples described herein relate to testing of a cloud service component on a cloud platform. A simulation tool may be configured on the cloud platform. The simulation tool may be used to test the cloud service component upon inclusion of said cloud service component in a cloud service topology created on the cloud platform.
    Type: Grant
    Filed: August 26, 2014
    Date of Patent: March 5, 2019
    Assignee: Hewlett Packard Enterprise Development LP
    Inventor: Alex Dominic Savio
  • Patent number: 10216614
    Abstract: Disclosed are various embodiments for sampling in a distributed code tracing system. A sampling service receives a segment of a code trace corresponding to a request submitted to a particular application of a plurality of applications hosted in a computing environment. The code trace documents at least one call to at least one component service of the particular application to respond to the request. The sampling service determines whether to forward the segment to a trace processing system or to discard the segment based at least in part on at least one sampling parameter.
    Type: Grant
    Filed: December 14, 2016
    Date of Patent: February 26, 2019
    Assignee: Amazon Technologies, Inc.
    Inventors: Anssi Alaranta, Rohit Banga, James Bowman, Sandra McMullen, Jeffrey Hoffman
  • Patent number: 10203947
    Abstract: The disclosure includes a system and method for providing a wireless software update for a connected vehicle. The connected vehicle includes a processor, an engine, a battery, a non-transitory memory storing a vehicle application and a wireless antenna that is powered by the battery and operable to receive a monitor module from a wireless network while the battery is not being charged. The processor is communicatively coupled to the battery, the wireless antenna and the non-transitory memory. The monitor module is written in an aspect language and includes a software patch for the vehicle application. The wireless antenna receives the monitor module from the wireless network while leaving a sufficient charge in the battery to enable the battery to start the engine. The processor installs the monitor module in the vehicle application stored in the non-transitory memory. Installation of the monitor module provides the software patch for the vehicle application.
    Type: Grant
    Filed: August 3, 2016
    Date of Patent: February 12, 2019
    Inventors: Shinichi Shiraishi, Grigore Rosu, Philip Daian, Akihito Iwai, Yuki Mae
  • Patent number: 10198784
    Abstract: The techniques and systems described herein are directed to capturing commands in a multi-engine graphics processing unit (GPU). Captured commands can be played back by a developer to optimize software, hardware, and drivers. To accurately capture commands and memory associated with the commands during execution, dependencies between command buffer segments associated with the various GPU engines may be determined and used to divide a command buffer segment into atomic elements (which may also be referred to as seglets). Command buffer segments are analyzed to identify synchronization commands, which may represent a point in a command buffer segment that relies on an operation to be completed in another command buffer segment. The command buffer segment can be recursively divided into seglets based on the synchronization commands. The resulting seglets represent command segments that, upon execution, operate without synchronization interference from other command buffer segments.
    Type: Grant
    Filed: July 29, 2016
    Date of Patent: February 5, 2019
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Brian Bo Rasmussen, Cole Brooking, Ivan Nevraev
  • Patent number: 10191785
    Abstract: Systems and methods for managing user data across multiple apps are disclosed. An example method includes, determining that an installation of a first app on a user device is completed; identifying a second app in which a user has been authenticated and has been installed on the user device; obtaining a second set of user information associated with the user from the second app; and configuring a user account of the user in the first app using the second set of user information. In some implementations, identifying the second app is executed in response to determining that the installation of the first app on the user device is completed. In some other implementations, identifying the second app is executed in response to a user selection of the first app after the installation.
    Type: Grant
    Filed: June 30, 2016
    Date of Patent: January 29, 2019
    Assignee: PAYPAL, INC.
    Inventors: Vijeyta Aggarwal, Kevin Ward, Larry Wang
  • Patent number: 10175960
    Abstract: A method for user interface (UI) automation area coverage is presented. The method extracts document information from a unit test class, the unit test class being code used to test a user interface (UI). The method searches for a keyword within the extracted document information to find a keyword match. The method receives a weight factor from a user the weight factor giving more importance to certain keywords over the other keywords. The method weights specified keywords based on a weight factor, the weight factor increasing or decreasing an importance to the specified keywords. The method assigns a weight score to each keyword match based on the number of keyword matches and the weight factor. Furthermore the method generates a user interface report, the UI report comprising the weight score.
    Type: Grant
    Filed: November 13, 2015
    Date of Patent: January 8, 2019
    Assignee: International Business Machines Corporation
    Inventors: Kwan Yin Andrew Chau, Smitha Lal, Stephen Pham
  • Patent number: 10169221
    Abstract: The current document is directed to methods and systems for testing web sites. In certain implementations of the methods and systems, a testing service collects customer page-access and conversion information on behalf of a web site. The testing service is straightforwardly accessed and configured, through a web-site-based user interface, and is virtually incorporated into the web site by simple HTML-file modifications. A more efficient web-site-testing system nonuniformly distributes web-site accesses among web-page variants in order to more quickly and computationally efficiently determine a most effective web-page variant among a set of tested web-page variants. In certain implementations, nonuniform distribution of web-site accesses among web-page variants is facilitated by a Bayesian-inference method.
    Type: Grant
    Filed: February 14, 2017
    Date of Patent: January 1, 2019
    Assignee: ACCELERATE GROUP LIMITED
    Inventors: Ethan Dereszynski, Peter Crossley, Spencer Wood, Dean C. Kimball
  • Patent number: 10162849
    Abstract: A system, method, and computer program product are provided for automatic database validation associated with a software test. In use, an indication that a user is beginning a software test that utilizes one or more databases is received. A first configuration snapshot of the one or more databases is recorded in response to receiving the indication that the user is beginning the software test, prior to the user beginning the software test. Additionally, an indication that the user has finished the software test is received. A second configuration snapshot of the one or more databases is recorded in response to receiving the indication that the user has finished the software test. The first configuration snapshot of the one or more databases is automatically compared to the second configuration snapshot of the one or more databases.
    Type: Grant
    Filed: October 26, 2015
    Date of Patent: December 25, 2018
    Assignees: AMDOCS DEVELOPMENT LIMITED, AMDOCS SOFTWARE SYSTEMS LIMITED
    Inventors: Sharon Elgarat, Yuval Alon, Assaf Ben David
  • Patent number: 10157069
    Abstract: A device to execute an application design plugin associated with a user interface. The device may analyze, using the application design plugin, a set of historical applications to identify one or more dependencies included in the set of historical applications. The device may provide, to a storage device, historical application metadata relating to the one or more dependencies. The device may receive, via the user interface, a request to generate an application design. The device may update the user interface with design information that includes design feature metadata identifying the one or more dependencies. The device may determine that the application design is ready for validation. The device may validate the application design based on determining that the application design is ready for validation.
    Type: Grant
    Filed: April 24, 2017
    Date of Patent: December 18, 2018
    Assignee: Accenture Global Solutions Limited
    Inventor: Shivakumar Rudrappa Goniwada
  • Patent number: 10152308
    Abstract: A test interface generator accesses metadata defining a user interface display. The test interface generator generates a strongly typed application programming interface (API) for the user interface display, during compile time, based on the metadata defining the user interface display. A static type checker performs a static type check of each API during compilation of the application. A test system programmatically interacts with the user interface display through the strongly typed API.
    Type: Grant
    Filed: May 1, 2015
    Date of Patent: December 11, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Alexandru Prodan, Jesse S. Bangs, Leo A. Dignan, David S. Froslie, Simon K. Ejsing
  • Patent number: 10146677
    Abstract: A set of test cases is executed on a base code to produce a baseline result and on a changed code to produce a new result. From the baseline result and the new result, a first subset of tests cases is determined that are failing with the changed code but were not failing with the base code. A set of code blocks is determined in the changed code that includes those code blocks that are referenced by the first subset of test cases. A second subset is formed from the first subset by disregarding an unchanged code block that has remained unchanged from the base code to the changed code. A remaining code block is shortlisted for investigating based on a ranking of the remaining code block, which uses a number of test cases in the first subset of test cases that reference the remaining code block.
    Type: Grant
    Filed: April 26, 2018
    Date of Patent: December 4, 2018
    Assignee: INTERNATIONAL BUSINESS MAHCINES CORPORATION
    Inventors: Xiayang Li, CongPeng Ma, Vatsla Nagpaul, Mark T. H. Taylor
  • Patent number: 10133656
    Abstract: This disclosure relates to systems and methods for generating covering arrays. By processing parameters and corresponding values pertaining to an application under test (AUT), the system generates a first set of arrays, wherein elements in the first set are unique from each other. A second set of arrays is generated by identifying two or more arrays from the first set. Each array in the second set may include pairwise interacting elements that are unique to each other. A third set of arrays is formed by interchanging pairwise interacting elements across the second set of arrays. Unique pairwise interacting elements are interchanged across set of arrays to eliminate from duplicating pairwise interacting elements. Combining two or more arrays from the third set of arrays results in an optimized covering array, which is then used for generating optimized test designs for at least one AUT.
    Type: Grant
    Filed: February 6, 2017
    Date of Patent: November 20, 2018
    Assignee: Tata Consultancy Services Limited
    Inventor: Sukumar Sundaram