Derived From Analysis (e.g., Of A Specification Or By Stimulation) Patents (Class 714/33)
  • Patent number: 11144693
    Abstract: A method includes generating on a host machine a validated verification test scenario comprising a graph defining a scheduled performance order of a plurality of actions to be performed on a DUT and a corresponding verification environment; obtaining a subset of one or more actions to be added to the validated scenario while maintaining the plurality of actions of the validated scenario and the scheduled performance order, forming an amended verification test scenario; and applying a runtime solver in a target language of the DUT and the corresponding verification environment on the amended verification test scenario to generate a test in a target code and to apply the test on the DUT and the corresponding verification environment wherein inclusion of any of said one or more actions or an order of performance of said one or more actions of the subset in the test is determined at runtime.
    Type: Grant
    Filed: November 27, 2019
    Date of Patent: October 12, 2021
    Assignee: Cadence Design Systems, Inc.
    Inventor: Meir Ovadia
  • Patent number: 11138089
    Abstract: A method, computer program product, and a computer system are disclosed for processing information in a processor that in one or more embodiments includes generating workload information of a performance base test; determining characteristics of the workload information; determining one or more constraints that can cause behavioral changes to a design of the processor; combining the determined characteristics and the determined one or more constraints to generate one or more example constraints; testing the one or more example constraints in one or more example performance tests; and generating one or more performance benchmarks for the performance base test and the one or more example performance tests.
    Type: Grant
    Filed: December 19, 2018
    Date of Patent: October 5, 2021
    Assignee: International Business Machines Corporation
    Inventors: Shricharan Srivatsan, Vivek Britto, Aishwarya Dhandapani, Tharunachalam Pindicura, John A. Schumann, Brian W. Thompto
  • Patent number: 11080141
    Abstract: A simulation model recovery method, system, and computer program product include initiating a simulation model, during an operation of a model, periodically writing a solution space of the model to a checkpoint restart file, during an operation of the model, periodically writing diagnostic information on model progression to a log file, detecting a failure of the model, based on the log of the model, determining a time of the failure, based on the model outputs and restart files, determining a period of a numerical instability preceding the failure, selecting a checkpoint of the model preceding the period of the numerical instability, based on the numerical instability and diagnostic information in log files, modifying a configuration of the model, and restarting the model based on the selected checkpoint and the modified configuration.
    Type: Grant
    Filed: January 22, 2019
    Date of Patent: August 3, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Fearghal O'donncha, Ernesto Arandia, Eli Michael Dow, Frank Liu, Campbell D Watson
  • Patent number: 11080446
    Abstract: A hybrid electronic system including an emulator side including a processor and a first clock, a simulated side including one or more models to simulate one or more prototypes and a second clock, a first interface to the emulator side, and a second interface to the simulated side is disclosed. The processor is configured to determine using the first interface a first amount of time corresponding to an amount of time advanced on the emulator side by the first clock. The processor is configured to determine using the second interface a second amount of time corresponding to an amount of time advanced on the simulated side by the second clock, and set a value of a clock frequency of the second clock based on an initial value of the clock frequency of the second clock and a ratio of the first amount of time to the second amount of time.
    Type: Grant
    Filed: March 18, 2020
    Date of Patent: August 3, 2021
    Assignee: Synopsys, Inc.
    Inventors: Cedric Babled, Sylvain Bayon De Noyer
  • Patent number: 11055205
    Abstract: Methods, apparatus, and processor-readable storage media for regression testing using automation technologies are provided herein. An example computer-implemented method includes generating application programming interfaces related to regression testing; obtaining user input, via at least one user interface, pertaining to at least one regression testing test case; selecting at least one of the application programming interfaces based at least in part on the user input; generating at least one regression testing automation tool using the at least one selected application programming interface and at least a portion of one or more software testing automation technologies; and performing one or more automated actions utilizing the at least one generated regression testing automation tool.
    Type: Grant
    Filed: March 16, 2020
    Date of Patent: July 6, 2021
    Assignee: EMC IP Holding Company LLC
    Inventors: Surendra Chauhan, Udit Tyagi
  • Patent number: 11036623
    Abstract: A test apparatus for characterizing a device under test includes a test case generator, a test unit, a data storage unit, and a data analysis unit. The test case generator is configured to randomly generate a plurality of test cases, which include values of one or more input variables of a set of input variables. The test unit is configured to perform the plurality of test cases on the device under test. The data storage unit may store sets of test data, which are associated to the test cases and include values of input variables of a respective test case and corresponding values of output variables of the device under test related to the respective test case. The data analysis unit may further analyze the test data and is further configured to determine dependencies within a subset of variables of the test data to characterize the device under test.
    Type: Grant
    Filed: August 16, 2019
    Date of Patent: June 15, 2021
    Assignee: Advantest Corporation
    Inventor: Jochen Rivoir
  • Patent number: 11036439
    Abstract: A new snapshot of a storage volume is created by instructing computing nodes to suppress write requests. Once pending write requests from the computing nodes are completed, storage nodes create a new snapshot for the storage volume by allocating a new segment to the new snapshot and finalizes and performs garbage collection with respect to segments allocated to the previous snapshot. An orchestration layer implements a bundled application that is provisioned with virtualized storage and computation resources. A snapshot of the bundled application may be created and used to rollback or clone the application. Clones snapshots of storage volumes may be gradually populated with data from prior snapshots to reduce loading on a primary snapshot. Chaos testing of the bundled application may be performed and storage volumes may be created, expanded, and/or moved based on usage of the bundled application.
    Type: Grant
    Filed: October 22, 2018
    Date of Patent: June 15, 2021
    Assignee: ROBIN SYSTEMS, INC.
    Inventors: Ravikumar Alluboyina, Ashok Mishra, Abir Bhattacharyya
  • Patent number: 11016759
    Abstract: Described herein is a computer implemented method. The method comprises receiving, by an issue tracking system, a deployment update from a deployment system which includes deployment information in respect of one or more issues maintained by the issue tracking system. The method further comprises associating one or more issues maintained by the issue tracking system with deployment information by identifying the one or more issues to which the deployment information in the deployment update relates, extracting the deployment information from the deployment update, and associating the deployment information with each of the identified issues.
    Type: Grant
    Filed: March 29, 2019
    Date of Patent: May 25, 2021
    Assignees: ATLASSIAN PTY LTD., ATLASSIAN INC.
    Inventors: Taylor Pechacek, Rodrigo Berto, Oliver Burn, James Navin, Boris Gvozdev, Christian Rolf, Daniel Kerris, Dmitry Pak, Gustavo Maciel, Konstantine Abakumov, Karina Moraes Da Silva, Rafal Myslek, Bruce Templeton
  • Patent number: 11010278
    Abstract: A data analysis system processes data generated by instrumented software. The data analysis system receives data streams generated by instances of instrumented software executing on systems. The data analysis system also receives metadata describing data streams. The data analysis system receives an expression based on the metadata. The data analysis system receives data of data streams for each time interval and computes the result of the expression based on the received data values. The data analysis system repeats these steps for each time interval. The data analysis system may quantize data values of data streams for each time interval by generating an aggregate value for the time interval based on data received for each data stream for that time interval. The data analysis system evaluates the expression using the quantized data for the time interval.
    Type: Grant
    Filed: August 16, 2019
    Date of Patent: May 18, 2021
    Assignee: Splunk Inc.
    Inventors: Phillip Liu, Arijit Mukherji, Rajesh Raman, Kris Grandy, Jack Lindamood
  • Patent number: 11003153
    Abstract: Embodiments include apparatuses, methods, and systems for computer assisted or autonomous driving. An apparatus may include a storage and a safety operation controller disposed in a computer assisted or autonomous driving vehicle. The storage may store a safety operation configuration and a list of safety operations to be performed on one or more device components. The safety operation configuration and the list of safety operations may be provided by a first party. The safety operation configuration may be used to configure selected ones of the list of safety operations by a second party different from the first party to obtain configured safety operations to be performed on the one or more device components. The safety operation controller may perform the configured safety operations on the one or more device components. Other embodiments may also be described and claimed.
    Type: Grant
    Filed: November 17, 2017
    Date of Patent: May 11, 2021
    Assignee: Intel Corporation
    Inventors: Tamir Damian Munafo, Alexander Brill
  • Patent number: 11003570
    Abstract: Performing a mirror test for localization testing includes executing a mirror test, the mirror test includes an execution of actions on target controls on a master device and mimicking the actions on the target controls on a number of slave devices for localization testing, identifying the target controls on the number of slave devices to mimic the execution of the actions on the target controls of the master device, capturing at least one screenshot of the mirror test, and displaying the at least one screenshot to a user.
    Type: Grant
    Filed: April 30, 2014
    Date of Patent: May 11, 2021
    Assignee: Micro Focus LLC
    Inventors: Yi-Qun Ren, Hai-Ying Liu, Zhi-Yuan Jing
  • Patent number: 10997344
    Abstract: The purpose of the present invention is to decrease the time required to create fault injection test data when performing an ECU simulation test. An ECU simulation device according to the present invention is provided with a database in which fault modes are defined for each type of circuit element, reads out, from the database, fault modes for each circuit element provided in an ECU, and generates a test pattern for each of the fault modes.
    Type: Grant
    Filed: June 14, 2017
    Date of Patent: May 4, 2021
    Assignee: HITACHI AUTOMOTIVE SYSTEMS, LTD.
    Inventor: Yoshinobu Fukano
  • Patent number: 10990472
    Abstract: Methods, systems, and devices for spare substitution in a memory system are described. A controller may, as part of a background operation, assign a spare bit to replace a bit of a code word and save an indication of the spare bit assignment in a memory array. The code word may include a set of bits that each correspond to a respective Minimum Substitution Region (MSR) within a memory medium that retains the code word. An MSR corresponding to the bit to be replaced may include a quantity of erroneous bits relative to a threshold. The controller may, during a read operation, identify the spare bit in a first portion of the code word, determine the bit to be replaced based on accessing the memory array, and replace the bit with the spare bit concurrently with receiving a second portion of the code word.
    Type: Grant
    Filed: July 19, 2019
    Date of Patent: April 27, 2021
    Assignee: Micron Technology, Inc.
    Inventor: Joseph Thomas Pawlowski
  • Patent number: 10983981
    Abstract: A distributed key-value database management system may provide transactions having a high degree of conformance to ACID properties. A data element may be maintained as a versioned list, where each entry may comprise a timestamp and a value indicative of a corresponding version of the data element. The timestamp may be based at least in part on a vended time value. Timestamps may be monotonically increasing and unique across all entries in a distributed system. Conflicting updates to a data element may be detected directly, prior to the completion of involved transactions.
    Type: Grant
    Filed: December 3, 2014
    Date of Patent: April 20, 2021
    Assignee: Amazon Technologies, Inc.
    Inventors: Vaibhav Sharma, Nitin Kumar Gupta, Marvin Michael Theimer, Shen Pan, Léon Thrane, Zachary Thomas Crowell
  • Patent number: 10970197
    Abstract: Systems, methods, and computer-readable media are described for performing revision control for a System Under Test (SUT) such as a body of source code. Prior to committing code changes, a collection of breakpoints associated with the portion(s) of source code being changed are determined. Stored fingerprints corresponding to regression test cases are evaluated to identify a set of stored fingerprints that are cumulatively indicative of the collection of breakpoints. Attributes respectively stored in association with the set of stored fingerprints are determined and a corresponding group of regression test cases are determined. The code changes are committed responsive to successful execution of the selected group of regression test cases.
    Type: Grant
    Filed: June 13, 2019
    Date of Patent: April 6, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Andrew Hicks, Dale E. Blue, Ryan Thomas Rawlins, Steven Partlow
  • Patent number: 10963366
    Abstract: Systems, methods, and computer-readable media are described for generating fingerprints for regression tests that identify code paths taken during execution of the regression tests. Breakpoint values are assigned to breakpoints encountered during execution of a regression test and a fingerprint is generated based on the assigned breakpoint values and a code path taken during execution of the regression test. Various breakpoint value assignment/fingerprint generation algorithms are described herein that generate a fingerprint from which a corresponding code path taken can be reconstructed including which breakpoints are encountered, the number of times each such breakpoint is encountered, and the order in which the breakpoints are encountered.
    Type: Grant
    Filed: June 13, 2019
    Date of Patent: March 30, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Andrew Hicks, Dale E. Blue, Ryan Rawlins, Steven Partlow
  • Patent number: 10950421
    Abstract: Systems and methods for identifying a location of a fault in an RF transmission system includes characterizing the RF transmission system and selecting one of the stage in the RF transmission system as an initial selected stage. An output of the initial selected stage can be measured in the characterized RF transmission system. The measured output of the initial selected stage is propagated through a baseline RF model and a point of deflection is identified in a resulting RF model of the RF transmission system.
    Type: Grant
    Filed: April 21, 2014
    Date of Patent: March 16, 2021
    Assignee: Lam Research Corporation
    Inventor: John C. Valcore, Jr.
  • Patent number: 10949590
    Abstract: Methods and systems for verifying that logic for implementing a pipelined process in hardware correctly moves data through the pipelined process. The method includes: (a) monitoring data input to the pipelined process to determine when watched data has been input to the pipelined process; (b) in response to determining the watched data has been input to the pipelined process counting a number of progressing clock cycles for the watched data; and (c) evaluating an assertion written in an assertion based language, the assertion establishing that when the watched data is output from the pipelined process the counted number of progressing clock cycles for the watched data should be equal to one of one or more predetermined values.
    Type: Grant
    Filed: April 30, 2019
    Date of Patent: March 16, 2021
    Assignee: Imagination Technologies Limited
    Inventors: Ashish Darbari, Sam Elliott
  • Patent number: 10936774
    Abstract: Integrated circuit failures caused by metastability related to assertion of asynchronous resets frequently escape detection before fabrication, causing design respins and severe economic loss. The numerous reset signals, flip-flops and complex logical interactions inherent in an integrated circuit cause an analysis for reset-metastability failures to be extremely noisy, reporting an unmanageable number of false failures and making early removal of failures impractical. Said noisy reporting arises because many flip-flops where reset-metastability manifests do not necessarily cause overall failure. An effective analysis of reset-metastability failures must identify all potential failures, but also must only report true failure potential. The present invention maximizes noise reduction by applying special conditions to identify flip-flops manifesting reset-metastability without causing integrated circuit failure, which can thereby be deemed safe.
    Type: Grant
    Filed: February 14, 2019
    Date of Patent: March 2, 2021
    Assignee: Real Intent, Inc.
    Inventors: Oren Katzir, Sanjeev Mahajan, Prakash Narain, Vishnu Vimjam
  • Patent number: 10936474
    Abstract: A simulation of software test program executing upon a primary model of a portion of a data processing apparatus is performed to identify uncovered (undetected) failures. A formal method analysis is then performed upon a combination of the primary model and a fault-simulating model simulating the uncovered failures in order to identify software stimuli that can render the uncovered failures detectable. The identified software stimuli are then added to the software test program to increase the failure coverage. The process is performed iteratively until a desired level of failure coverage is achieved.
    Type: Grant
    Filed: February 27, 2018
    Date of Patent: March 2, 2021
    Assignee: Arm Limited
    Inventor: Spyros Lyberis
  • Patent number: 10936476
    Abstract: Embodiments described herein are directed to computer-implemented methods, systems, and computer program products for regression testing. New techniques for software regression testing are provided in which the regression test scenarios are directly synchronized with the user's system and environment. This can be referred to as a customized-regression-test process. A non-limiting example of a computer-implemented method includes receiving a history log having application data for an application during normal use and generating a regression test scenario for a new version of the application based on a pattern of use of the application. The method further includes determining whether one or more existing regression test scenarios stored in a test scenario data store match the generated regression test scenario and executing a regression test on the new version of the application using the regression test scenario.
    Type: Grant
    Filed: March 28, 2019
    Date of Patent: March 2, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventor: Cresyi Padilla-Ruberte
  • Patent number: 10880173
    Abstract: The described technology is generally directed towards automated acceptance testing of network functions so that only certified network functions are deployed in a wireless network. When a network function attempts to register in a network, e.g., with a network function repository, the registration attempt triggers a workflow that obtains a result of automated testing of the network function. The automated testing operation can be based on a test suite selected according to the network function type and the network slice in which the network function is to be deployed. Only upon determining that the network function passed the automated testing operation is the network function registered (by the network function repository) for operation in the wireless network.
    Type: Grant
    Filed: December 3, 2018
    Date of Patent: December 29, 2020
    Assignee: AT&T INTELLECTUAL PROPERTY I, L.P.
    Inventors: Vikram Seenappa, Joseph Dahan, Srikanth Tirumala, Michal Cwian, Dana Coburn, Henry Deccio, Henry Romero, Pratik Gandhi
  • Patent number: 10817409
    Abstract: A system, method and computer-readable medium for testing a service-based application identifies a set of use cases for the service-based application. Each use case in the set is mapped to a test case to generate a first set of test cases. Each of the test cases is refined to generate an updated set of test cases and the updated set of test cases is executed.
    Type: Grant
    Filed: January 4, 2019
    Date of Patent: October 27, 2020
    Assignee: AT&T Intellectual Property I, L.P.
    Inventors: Xiangwei Zeng, Teh-Hsin Wu, Zhenzhen Wang
  • Patent number: 10805329
    Abstract: An industrial asset may be associated with a plurality of monitoring nodes, each monitoring node generating a series of monitoring node values over time representing current operation of the industrial asset. An abnormality detection computer may determine that at least one abnormal monitoring node is currently being attacked or experiencing a fault. A virtual sensing estimator may continuously execute an adaptive learning process to create or update virtual sensor models for the monitoring nodes. Responsive to an indication that a monitoring node is currently being attacked or experiencing a fault, the virtual sensing estimator may be dynamically reconfigured to estimate a series of virtual node values for the abnormal monitoring node or nodes based on information from normal monitoring nodes and appropriate virtual sensor models. The series of monitoring node values from the abnormal monitoring node or nodes may then be replaced with the virtual node values.
    Type: Grant
    Filed: May 11, 2018
    Date of Patent: October 13, 2020
    Assignee: GENERAL ELECTRIC COMPANY
    Inventors: Masoud Abbaszadeh, Lalit Keshav Mestha
  • Patent number: 10768956
    Abstract: A dynamic cloud stack testing system comprises a cloud network with cloud components and a cloud stack server coupled to the network. The server includes an interface, a memory, a cloud stack configuration engine, and a cloud stack testing engine. The interface receives a cloud stack request from a user device that includes functionality parameters. The memory stores historic cloud stack combinations. The cloud stack configuration engine identifies cloud components associated with the functionality parameters and determines a cloud stack configuration that incorporates them. The cloud stack testing engine determines a cloud stack configuration test. The cloud stack testing engine executes the test, and stores results and the associated cloud stack configuration in the memory.
    Type: Grant
    Filed: September 20, 2019
    Date of Patent: September 8, 2020
    Assignee: Bank of America Corporation
    Inventors: Sandeep Kumar Chauhan, Sasidhar Purushothaman
  • Patent number: 10705943
    Abstract: A library model addition engine adds library models to a library knowledge base by defining a template for a library configuration file that conveys information about each library model, custom inputs and code snippets to facilitate library comparison operations, and education content for the library model, where the library configuration file template may be automatically filled by populating selected data fields in the template with information identifying the library model, scraping documentation pages to extract test cases, and then scraping test case code to extract the test case input parameters for input to an input/output matching engine to evaluate a repository of code snippets and identify a set of functionally similar code snippets for inclusion one or more data fields in the template.
    Type: Grant
    Filed: September 8, 2017
    Date of Patent: July 7, 2020
    Assignee: DevFactory Innovations FZ-LLC
    Inventor: Tushar Makkar
  • Patent number: 10664385
    Abstract: Techniques for debugging of a collection of instructions executed by a computing system including a set of actors are described herein. A first sub-set of actors from the set of actors to be monitored for debugging and one or more error condition associated with the collection of instructions may be identified. A set of indications including indications of messages processed by the actors, indications of associated actor states prior to processing of the messages, and indications of associated actor states subsequent to processing of the messages may be received from the sub-set of actors. It may then be determined that a first actor of the sub-set of actors has satisfied the error condition. Based at least in part on the set of indications, one or more messages associated with satisfaction of the error condition may then be identified, for example for re-processing and debugging.
    Type: Grant
    Filed: January 13, 2017
    Date of Patent: May 26, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Adam Julio Villalobos, Martin Paul Zolnieryk, Andrew Kyle McWilliams, Brian James Schuster
  • Patent number: 10649888
    Abstract: Disclosed herein are methods, systems, and processes to generate and perform parallelizable data-driven single instruction multiple data (SIMD) tests. A base abstract class that defines shared testing parameters for tests to be performed on an application is designated. Inheriting classes of the base abstract class are defined and a data source key is derived from the inhering classes. A test data source is accessed to perform the tests on the application and a result of tests is generated based on the data source key.
    Type: Grant
    Filed: January 31, 2018
    Date of Patent: May 12, 2020
    Assignee: Dell Products L.P.
    Inventor: Mykhailo Makarov
  • Patent number: 10642716
    Abstract: According to an aspect of an embodiment, operations may include determining a plurality of event correspondences. Each event correspondence may indicate a correspondence between a respective change of a plurality of changes made to first source code of a first software program and a respective event type that occurs with respect to the first software program. The plurality of event correspondences may be determined by performing two or more event type inference operations of a plurality of event type inference operations. The plurality of event type inference operations may include determining a fault introduction event, determining a fault correction event, determining a defect introduction event, determining a defect correction event, and determining a platform migration event.
    Type: Grant
    Filed: February 7, 2019
    Date of Patent: May 5, 2020
    Assignee: FUJITSU LIMITED
    Inventors: Hiroaki Yoshida, Mukul R. Prasad
  • Patent number: 10642726
    Abstract: A method and apparatus are provided for enhancing operable testing functionality for program code by mutating a code segment in a received program code to generate a mutated code segment, by monitoring execution of a test suite against the mutated code segment to detect a surviving mutation, and by evaluating the surviving mutation against the test suite to identify a first test case to blame for the surviving mutation by analyzing a coverage of the plurality of test cases in the test suite for the surviving mutation to identify one or more test cases from the test suite which cover the surviving mutation and then select the first test case which meets one or more predetermined selection criteria.
    Type: Grant
    Filed: August 31, 2018
    Date of Patent: May 5, 2020
    Assignee: DEVFACTORY FZ-LLC
    Inventor: Abhishek
  • Patent number: 10628542
    Abstract: An apparatus, including: a deterministic monitored device; an interconnect to communicatively couple the monitored device to a support circuit; a super queue to queue transactions between the monitored device and the support circuit, the super queue including an operational segment and a shadow segment; a debug data structure; and a system management agent to monitor transactions in the operational segment, log corresponding transaction identifiers in the shadow segment, and write debug data to the debug data structure, wherein the debug data are at least partly based on the corresponding transaction identifiers.
    Type: Grant
    Filed: July 1, 2017
    Date of Patent: April 21, 2020
    Assignee: Intel Corporation
    Inventors: Tsvika Kurts, Alexander Gendler, Larisa Novakovsky, Anwar Azaarura Zaa'Rura, Afik Sela, Genadi Kazakevich, Alexandra Shainshein, Ariel Sabba
  • Patent number: 10630972
    Abstract: Embodiments disclose systems and methods for testing and determining outages of communication systems. A server can receive signal-reception-related information from set-top boxes (STBs) in a particular geographical region, where a STB: receives signals having a predefined pattern, generates a comparison of the predefined pattern to reference patterns stored on the STB, generates the signal-reception-related information based on the comparison, and sends the signal-reception-related information. The server can determine an outage status for the particular geographical region based on the signal-reception-related information. The server can generate an output based on the outage status. The output is configured to provide information related to the outage status of the particular geographical region and information for possible responses related to the outage status. The server can send the output.
    Type: Grant
    Filed: April 9, 2019
    Date of Patent: April 21, 2020
    Assignee: The DIRECTV Group, Inc.
    Inventors: Kian-Vine Chin, Woei-Shyang Yee, Wesley W. Huie, Gerard V. Talatinian, Christopher Yang, Heesoon E. Kim, Robert S. Greenwade
  • Patent number: 10554514
    Abstract: Exemplary methods, apparatuses, and systems include receiving time series data for each of a plurality of performance metrics. The time series data is sorted into buckets based upon an amount of variation of time series data values for each performance metric. The time series data in each bucket is divided into first and second clusters of time series data points. The bucket having the greatest distance between clusters is used to determine a performance metric having a greatest distance between clusters. The performance metric having the greatest distance between clusters is reported as a potential root cause of a performance issue.
    Type: Grant
    Filed: October 26, 2016
    Date of Patent: February 4, 2020
    Assignee: VMware, Inc.
    Inventors: Chien-Chia Chen, Lenin Singaravelu, Ruijin Zhou, Xiaobo Huang
  • Patent number: 10474651
    Abstract: Analysis of system information includes retrieving selected snapshots comprising the system information to be analyzed. Further, one or more operations can be performed on the system information to extract resultant information. The resultant information can be provided over a graphical user interface to a user.
    Type: Grant
    Filed: July 31, 2014
    Date of Patent: November 12, 2019
    Assignee: Hewlett-Packard Development Company, L.P.
    Inventors: Wei-Shan Yang, Guoping Peng, Irwan Halim
  • Patent number: 10437949
    Abstract: Simulating a circuit design can include detecting, using a processor, an assignment for a signal of a circuit design during a delta cycle of a simulation of the circuit design and comparing, using the processor, a range of the assignment for the signal with a range of an existing event for the signal for the delta cycle. In response to determining that the range of the assignment for the signal and the range of the existing event meet a condition, the existing event is updated, using the processor, resulting in a merged event. The merged event is scheduled for execution for the delta cycle using the processor.
    Type: Grant
    Filed: August 14, 2017
    Date of Patent: October 8, 2019
    Assignee: XILINX, INC.
    Inventors: Valeria Mihalache, Kumar Deepak, Saikat Bandyopadhyay
  • Patent number: 10437705
    Abstract: A data analysis system processes data generated by instrumented software. The data analysis system receives data streams generated by instances of instrumented software executing on systems. The data analysis system also receives metadata describing data streams. The data analysis system receives an expression based on the metadata. The data analysis system receives data of data streams for each time interval and computes the result of the expression based on the received data values. The data analysis system repeats these steps for each time interval. The data analysis system may quantize data values of data streams for each time interval by generating an aggregate value for the time interval based on data received for each data stream for that time interval. The data analysis system evaluates the expression using the quantized data for the time interval.
    Type: Grant
    Filed: December 18, 2017
    Date of Patent: October 8, 2019
    Assignee: SignalFx, Inc.
    Inventors: Phillip Liu, Arijit Mukherji, Rajesh Raman, Kris Grandy, Jack Lindamood
  • Patent number: 10409568
    Abstract: An instrumentation analysis system processes data streams by executing instructions specified using a data stream language program. The data stream language allows users to specify a search condition using a find block for identifying the set of data streams processed by the data stream language program. The set of identified data streams may change dynamically. The data stream language allows users to group data streams into sets of data streams based on distinct values of one or more metadata attributes associated with the input data streams. The data stream language allows users to specify a threshold block for determining whether data values of input data streams are outside boundaries specified using low/high thresholds. The elements of the set of data streams input to the threshold block can dynamically change. The low/high threshold values can be specified as data streams and can dynamically change.
    Type: Grant
    Filed: December 18, 2017
    Date of Patent: September 10, 2019
    Assignee: SignalFx, Inc.
    Inventors: Rajesh Raman, Arijit Mukherji, Kris Grandy, Phillip Liu
  • Patent number: 10394696
    Abstract: A device receives test parameters associated with testing an application that utilizes source data, and causes source containers, for the source data, to be temporarily created in a cloud computing environment, based on the test parameters. The device provides the source data to the source containers in the cloud computing environment, and causes other containers, for the application, to be temporarily created in the cloud computing environment, based on the test parameters. The device creates a file for testing the application with the source containers and the other containers, based on the test parameters, and causes the application to be executed with the source containers and the other containers, based on the file. The device receives results associated with executing the application with the source containers and the other containers.
    Type: Grant
    Filed: February 28, 2019
    Date of Patent: August 27, 2019
    Assignee: Capital One Services, LLC
    Inventors: Raveender Kommera, Anoop Kunjuramanpillai, Karthik Gunapati, Sahithya Javvaji, Leonardo Gomide, Daniel Tresnak, Anilkumar Baddula, Nathan Gloier
  • Patent number: 10394693
    Abstract: A data analysis system processes data generated by instrumented software. The data analysis system receives data streams generated by instances of instrumented software executing on systems. The data analysis system also receives metadata describing data streams. The data analysis system receives an expression based on the metadata. The data analysis system receives data of data streams for each time interval and computes the result of the expression based on the received data values. The data analysis system repeats these steps for each time interval. The data analysis system may quantize data values of data streams for each time interval by generating an aggregate value for the time interval based on data received for each data stream for that time interval. The data analysis system evaluates the expression using the quantized data for the time interval.
    Type: Grant
    Filed: October 31, 2017
    Date of Patent: August 27, 2019
    Assignee: SignalFx, Inc.
    Inventors: Phillip Liu, Arijit Mukherji, Rajesh Raman, Kris Grandy, Jack Lindamood
  • Patent number: 10387289
    Abstract: A data analysis system processes data generated by instrumented software. The data analysis system receives data streams generated by instances of instrumented software executing on systems. The data analysis system also receives metadata describing data streams. The data analysis system receives an expression based on the metadata. The data analysis system receives data of data streams for each time interval and computes the result of the expression based on the received data values. The data analysis system repeats these steps for each time interval. The data analysis system may quantize data values of data streams for each time interval by generating an aggregate value for the time interval based on data received for each data stream for that time interval. The data analysis system evaluates the expression using the quantized data for the time interval.
    Type: Grant
    Filed: December 18, 2017
    Date of Patent: August 20, 2019
    Assignee: SignalFx, Inc.
    Inventors: Phillip Liu, Arijit Mukherji, Rajesh Raman, Kris Grandy, Jack Lindamood
  • Patent number: 10346573
    Abstract: An improved method, system, and computer program product to perform post-layout simulation of an electronic design is provided. According to one approach, a circuit design is divided into multiple partitions for simulation. Simulation is then performed using the established partitions and results are obtained for the different partitions. When any layout editing occurs, identification can be made of any partitions that have been affected by the editing. The affected partitions are re-processed for simulation. The unaffected partitions do not necessarily need to be reprocessed.
    Type: Grant
    Filed: September 30, 2015
    Date of Patent: July 9, 2019
    Assignee: Cadence Design Systems, Inc.
    Inventors: Karun Sharma, Roland Ruehl, Arnold Ginetti, Srihari Sampath
  • Patent number: 10339033
    Abstract: The disclosure provides a method for detection of an uninitialized variable. The method includes running a first function, wherein the first function comprises a local variable and a first flag associated with the local variable for indicating an initialization state of the local variable; calling a second function from the first function, with the local variable as a parameter of the second function, wherein the second function comprises a second flag associated with the parameter for indicating an initialization state of the parameter; and updating the first flag based at least on the second flag returned from the second function.
    Type: Grant
    Filed: December 4, 2017
    Date of Patent: July 2, 2019
    Assignee: International Business Machines Corporation
    Inventors: Xiao Feng Guan, JiuFu Guo, Yu Xuan Zhang, Yuheng Zhang
  • Patent number: 10324827
    Abstract: The present disclosure relates to a method and device for automatically generating test data for testing software applications. In one embodiment, a plurality of test cases associated with test scenarios is determined by analyzing requirements of the software applications. The plurality of test cases is then processed to generate a plurality of test data scripts that are further executed on a first data source to obtain the test data. If it is determined that the execution of the plurality of test cases fail, then the plurality of test data scripts is executed on a second data source to obtain the test data. The first data source is then updated with the test data obtained for future test data requirements. Thus, the technology enables automatic generation of test data obtained from external data sources and thereby improving the testing efficiency and quality of the applications being tested.
    Type: Grant
    Filed: February 9, 2017
    Date of Patent: June 18, 2019
    Assignee: Wipro Limited
    Inventors: Gopalan Sathiya Narayanan, Arunav Rath
  • Patent number: 10325044
    Abstract: Methods and systems for verifying that logic for implementing a pipelined process in hardware correctly moves data through the pipelined process. The method includes: (a) monitoring data input to the pipelined process to determine when watched data has been input to the pipelined process; (b) in response to determining the watched data has been input to the pipelined process counting a number of progressing clock cycles for the watched data; and (c) evaluating an assertion written in an assertion based language, the assertion establishing that when the watched data is output from the pipelined process the counted number of progressing clock cycles for the watched data should be equal to one of one or more predetermined values.
    Type: Grant
    Filed: May 2, 2016
    Date of Patent: June 18, 2019
    Assignee: Imagination Technologies Limited
    Inventors: Ashish Darbari, Sam Elliott
  • Patent number: 10324815
    Abstract: Error checking for a computer processor design under test. In multiple processing threads, and in accordance with a hardware model of a computer processor design under test, the instructions of multiple instruction sequences corresponding to the processing threads are processed, thereby resulting in an order in which the instructions are processed in accordance with the hardware model, and producing an actual result for each of the instructions. An expected result is determined for any of the instructions in accordance with a reference model of the computer processor design under test and in accordance with the order in which the instructions were processed in accordance with the hardware model. Any of the instructions whose expected result and actual result differ are identified.
    Type: Grant
    Filed: February 14, 2017
    Date of Patent: June 18, 2019
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Erez Barak, Oz D. Hershkovitz, Gilad Merran, Eyal Naor
  • Patent number: 10318406
    Abstract: Verifying architectural compliance of a processor core using processor-sparing functions. A simulation of a model for a register-transfer level design of the processor core is performed. A first state of the model is dumped, when no error exists. An error is injected in the model. A second state of the model is dumped, after the injected error is detected in the simulation. Upon dumping the second state, the model is reset and initialized with the first state. State information of the second state is loaded in the reset and initialized model.
    Type: Grant
    Filed: February 23, 2017
    Date of Patent: June 11, 2019
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Ophir Erez, Bodo Hoppe, Divya K. Joshi, Gerrit Koch, Parminder Singh
  • Patent number: 10311516
    Abstract: A transaction evaluation system may include a configurable and/or scalable transaction rate input model which models historical and/or recent transaction input rate patterns of a transaction processing system for a specified time period with configurable and/or scalable transactional amplitude for use in evaluating performance of the transaction processing system. The system may operate to inject particular volumes of transactions into the transaction processing system at specific times and/or periods of time.
    Type: Grant
    Filed: June 10, 2015
    Date of Patent: June 4, 2019
    Assignee: Chicago Mercantile Exchange Inc.
    Inventor: Amir Onallah
  • Patent number: 10302702
    Abstract: For monitoring diagnostic rules of a power system, an exemplary method is disclosed and includes collecting operational diagnostic data from a first primary device; identifying a change of a diagnostic indicator based on the operational diagnostic data; adapting a diagnostic rule to the identified change, wherein the diagnostic rule is applicable to the diagnostic data for determining a diagnostic warning which indicates a diagnostic state of a primary device; and providing a diagnostic warning of a second primary device by applying the adapted diagnostic rule to operational diagnostic data collected for the second primary device.
    Type: Grant
    Filed: August 1, 2014
    Date of Patent: May 28, 2019
    Assignee: ABB Research Ltd
    Inventors: Kai Hencken, Daniel Schrag, Peter Krippner, Carlo Gemme, Marco Egman, Jarkko Makela
  • Patent number: 10250471
    Abstract: An analysis apparatus compares first code describing a plurality of first components with second code describing a plurality of second components, to extract difference components. The analysis apparatus sends a plurality of requests to an execution apparatus on which the plurality of second components are deployed, obtains first log information indicating the execution state of each difference component, and specifies relevant requests related to the execution of the difference components. The analysis apparatus sends the specified relevant requests to the execution apparatus and obtains second log information indicating the execution state of each of the plurality of second components. The analysis apparatus generates path information about second components executed in response to each relevant request among the plurality of second components, on the basis of the second log information.
    Type: Grant
    Filed: August 12, 2016
    Date of Patent: April 2, 2019
    Assignee: FUJITSU LIMITED
    Inventors: Yuuji Hotta, Takeshi Yasuie, Toshihiro Shimizu, Atsuji Sekiguchi
  • Patent number: 10235276
    Abstract: The disclosure provides a method for detection of an uninitialized variable. The method includes running a first function, wherein the first function comprises a local variable and a first flag associated with the local variable for indicating an initialization state of the local variable; calling a second function from the first function, with the local variable as a parameter of the second function, wherein the second function comprises a second flag associated with the parameter for indicating an initialization state of the parameter; and updating the first flag based at least on the second flag returned from the second function.
    Type: Grant
    Filed: October 5, 2016
    Date of Patent: March 19, 2019
    Assignee: International Business Machines Corporation
    Inventors: Xiao Feng Guan, JiuFu Guo, Yu Xuan Zhang, Yuheng Zhang