Derived From Analysis (e.g., Of A Specification Or By Stimulation) Patents (Class 714/33)
  • Patent number: 11509676
    Abstract: In an embodiment, an asset may utilize one or more scanning techniques to detect a first set of software components that is not being natively tracked by an operating system of the asset, the one or more scanning techniques comprising one or more of an evaluation of metadata associated with one or more running processes of the asset, and an evaluation of file system information that characterizes the first set of software components. The asset may further store an indication of the first set of software components detected in accordance with the one or more scanning techniques, and may optionally report the indication to an external entity (e.g., a vulnerability management system).
    Type: Grant
    Filed: January 22, 2020
    Date of Patent: November 22, 2022
    Assignee: TENABLE, INC.
    Inventors: Tony Huffman, Nicholas Miles
  • Patent number: 11500563
    Abstract: Embodiments of the present disclosure relate to a memory system and an operating method thereof. According to the embodiments of the present disclosure, the memory system may, when setting a firmware as a target firmware, generate a plurality of test commands to test the target firmware, test the target firmware by processing the plurality of test commands, and randomly generate logical block address (LBA) values corresponding to each of the plurality of test commands based on a seed value corresponding to each of the plurality of test commands.
    Type: Grant
    Filed: January 18, 2021
    Date of Patent: November 15, 2022
    Assignee: SK hynix Inc.
    Inventor: In Jong Jang
  • Patent number: 11500018
    Abstract: Circuits, methods, and systems are provided which facilitate testing of asynchronous circuits having one or more global or local feedback loops. A circuit includes a data path and a scan path. The data path has an input configured to receive a data input signal, and a first output. The scan path includes a first multiplexer having a first input configured to receive the data input signal, a latch coupled to an output of the first multiplexer, a scan isolator coupled to an output of the latch, and a second multiplexer having a first input coupled to the first output of the data path and a second input coupled to an output of the scan isolator. The second multiplexer is configured to output a data output signal.
    Type: Grant
    Filed: June 25, 2021
    Date of Patent: November 15, 2022
    Assignees: Taiwan Semiconductor Manufacturing Co., Ltd., National Taiwan University
    Inventors: Ting-Yu Shen, Chien-Mo Li
  • Patent number: 11494181
    Abstract: A library model addition engine adds library models to a library knowledge base by defining a template for a library configuration file that conveys information about each library model, custom inputs and code snippets to facilitate library comparison operations, and education content for the library model. The library configuration file template may be automatically filled with extracted data using an iterative sequence of operations to retrieve, scrape, or extract data to automatically populate data fields in a library configuration file template for validation processing to ensure that the file is in the correct format and satisfies the constraints provided by the library recommendation engine.
    Type: Grant
    Filed: May 4, 2020
    Date of Patent: November 8, 2022
    Assignee: DevFactory Innovations FZ-LLC
    Inventor: Tushar Makkar
  • Patent number: 11475193
    Abstract: Methods and systems for verifying that logic for implementing a pipelined process in hardware correctly moves data through the pipelined process. The method includes: (a) monitoring data input to the pipelined process to determine when watched data has been input to the pipelined process; (b) in response to determining the watched data has been input to the pipelined process counting a number of progressing clock cycles for the watched data; and (c) evaluating an assertion written in an assertion based language, the assertion establishing that when the watched data is output from the pipelined process the counted number of progressing clock cycles for the watched data should be equal to one of one or more predetermined values.
    Type: Grant
    Filed: February 4, 2021
    Date of Patent: October 18, 2022
    Assignee: Imagination Technologies Limited
    Inventors: Ashish Darbari, Sam Elliott
  • Patent number: 11474930
    Abstract: Example methods and systems for software bug reproduction. One example method may comprise obtaining log information associated with multiple transactions processed by a control-plane node to configure a set of data-plane nodes and transform an initial network state to a first network state; and configuring a replay environment that is initialized to the initial network state, and includes a mock control-plane node and a set of mock data-plane nodes. The method may also comprise, based on the log information, replaying the multiple transactions using the mock control-plane node to configure the set of mock data-plane nodes and transform the replay environment from the initial network state to a second network state. Based on a comparison between the first network state and the second network state, a determination may be made as to whether a software bug is successfully reproduced in the replay environment.
    Type: Grant
    Filed: December 19, 2019
    Date of Patent: October 18, 2022
    Assignee: VMWARE, INC.
    Inventors: Wei Guo, Deepika Rajendra Kalani, Yuanjun Yao, Mihir Patil, Aravinda Kidambi Srinivasan, Yang Ping
  • Patent number: 11461894
    Abstract: An information processing apparatus comprises: acquiring a first image including at least a part of an inspection device and a second image including at least a part of a subject; estimating a position of the inspection device based on the first image; estimating position and orientation information for the subject based on the second image; identifying an inspection region of the subject from results of estimating; and receiving a finalization instruction to finalize an inspection result to be recorded or output to an external apparatus based on sequentially acquired inspection results of the subject, and a finalization instruction to finalize inspection region information to be recorded or output to the external apparatus in association with the inspection result, wherein the finalization instruction for the inspection region information is received before the finalization instruction for the inspection result.
    Type: Grant
    Filed: August 18, 2020
    Date of Patent: October 4, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventor: Jun Odagiri
  • Patent number: 11449838
    Abstract: Vehicular maintenance is predicted using real time telematics data and historical maintenance data. Different statistical models are used, and an intersecting set of results is generated. Environmental weather may also be used to further refine predictions.
    Type: Grant
    Filed: May 18, 2020
    Date of Patent: September 20, 2022
    Assignee: AT&T INTELLECTUAL PROPERTY I, L.P.
    Inventors: Anoop Viswanath, Abhay Dabholkar, Brad Ford, Mengling Hettinger, Kevin Reese, Carl Sorrells, Christopher Tsai, Alfonso Jones
  • Patent number: 11442105
    Abstract: Disaggregated distributed measurement analysis systems provide a test and measurement automation platform that uses solution workflow metadata to create automation test suites as solutions to be deployed in an automation engine of a test and measurement automation platform. The automation platform provides tools and techniques to develop measurements and deploy solutions in an automation engine without requiring the system to restart. The system enables, by the test and measurement automation platform, a user to develop measurements for the solutions and deploy and execute each of the solutions in the automation engine of the test and measurement automation platform without requiring the solution to compile.
    Type: Grant
    Filed: January 10, 2020
    Date of Patent: September 13, 2022
    Assignee: Tektronix, Inc.
    Inventors: Sriram Mandyam Krishnakumar, Mahesha Guttahalli Lakshmipathy, Satish Kumar Makanahalli Ramaiah, Vishnu Vardhan Kandan, Rovin Jolly Pulikken
  • Patent number: 11429382
    Abstract: Regression test case identification for automated regression testing includes identifying program code file(s) in which changes made to program code of an application are contained, selecting application feature(s) of the application as candidate(s) on which to perform automated regression testing, which selecting includes accessing mappings indicating features implemented by the identified program code files and identifying those features as the selected application feature(s), based on the selected application feature(s), selecting regression test cases to be included in the automated regression testing, and commencing execution of the automated regression testing using the selected regression test cases.
    Type: Grant
    Filed: August 10, 2021
    Date of Patent: August 30, 2022
    Assignee: Kyndryl, Inc.
    Inventors: Abdul Kareem A Lakkundi, Rajesh Ganji, Abdul Karimulla Shakhadari Mohammed, Ashutosh Janoria
  • Patent number: 11422917
    Abstract: Software application dependency trees can be generated and used for white-box testing. In some examples, a method may involve receiving a request to generate a dependency tree for a first software application associated with a computing device. The method may also include identifying a set of software applications also associated with the computing device, each of which the first software application is determined to be dependent upon based on information included in a specification for the first software application. The method may also include receiving, by the computing device with respect to the set of software applications, a corresponding set of dependency trees. The method may further include incorporating each of the dependency trees in the set of dependency trees into the dependency tree for the first software application via a respective incorporation point, and returning the dependency tree for the first software application in response to the request.
    Type: Grant
    Filed: July 26, 2019
    Date of Patent: August 23, 2022
    Assignee: RED HAT, INC.
    Inventors: Nir Magnezi, Arie Bregman
  • Patent number: 11392469
    Abstract: The disclosed embodiments provide a system for testing machine learning workflows. During operation, the system obtains a configuration for a staging test of a machine learning model, wherein the configuration includes a model name for the machine learning model, a duration of the staging test, and a use case associated with the machine learning model. Next, the system selects a staging test host for the staging test. The system then deploys the staging test on the staging test host in a staging environment, wherein the deployed staging test executes the machine learning model based on live traffic received from a production environment. After the staging test has completed, the system outputs a set of metrics representing a system impact of the machine learning model on the staging test host.
    Type: Grant
    Filed: June 20, 2019
    Date of Patent: July 19, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Ali Sadiq Mohamed, Manish Swaminathan, Shunlin Liang, Prateek Sachdev, Vivek Desai, Adam R. Peck, Sunny Sanjiv Ketkar
  • Patent number: 11354223
    Abstract: A test script is divided into tests having a sequential order within the test script. An analysis tree of the tests can be generated. Each unique path through the analysis tree includes a subset of the tests as sequentially ordered within the test script. A maximally parallel subset of the unique paths that covers all the tests and according to which the tests are successfully executable is identified. Each test appears in only one unique path of the maximally parallel subset.
    Type: Grant
    Filed: March 4, 2020
    Date of Patent: June 7, 2022
    Assignee: MICRO FOCUS LLC
    Inventors: Jun-Chen Peng, Xiang Gao, Kai Long, Ruixiang Chen, Lingli Wu
  • Patent number: 11243821
    Abstract: It is possible to make data for manufacturing devices available in a standard format using an adapter that would automatically interrogate the device and use the information gained from the machine to generate a data translation file. The data translation file could subsequently be used by an agent to interpret a data stream provided by the adapter for the manufacturing device.
    Type: Grant
    Filed: April 8, 2020
    Date of Patent: February 8, 2022
    Assignee: TechSolve, Inc.
    Inventors: Rob Longfellow, Brian Campbell
  • Patent number: 11218370
    Abstract: A method including: identifying a set of dependent virtualised network functions included in a first virtual network, the set including at least a virtualised network function to be updated; creating a second virtual network including clones of virtual machines implementing the dependent virtualised network functions of the set; interconnecting, in the second virtual network, clones of the dependent virtualised network functions, identically to an interconnection in the first network of dependent virtualised network functions; identifying an input data packet of the dependent virtualised network functions, duplicating the packet and sending the duplicated packet to the second network; applying a patch to the clone of the virtualised network function to be updated in the second network; triggering an alert when a performance value of a dependent virtualised network function of the first virtual network differs from a performance value on the clone of the virtualised network function in the second network.
    Type: Grant
    Filed: October 24, 2018
    Date of Patent: January 4, 2022
    Assignee: ORANGE
    Inventors: Paul Chaignon, Kahina Lazri
  • Patent number: 11188440
    Abstract: A computer-implemented method according to one embodiment includes simulating, for a predetermined time period, output of a first task that periodically runs within a system to create a simulated output, comparing the simulated output to actual output of the first task for the predetermined time period, and generating an alert in response to determining that the simulated output does not match the actual output for the predetermined time period.
    Type: Grant
    Filed: September 27, 2018
    Date of Patent: November 30, 2021
    Assignee: International Business Machines Corporation
    Inventors: Max Vigderovich, Yan Lindvor, Dan Ravid, Nadav Parag, Assaf Goren
  • Patent number: 11169905
    Abstract: The present invention generally relates to system test, and more specifically, related to online system test. In an aspect, a computer-implemented method for online system test is provided. In this method, a test rule for testing the online system is obtained. And a test result from a real user action of the online system based on the test rule will be retrieved. And a test report is generated at least based on the test result from the real user action.
    Type: Grant
    Filed: October 30, 2018
    Date of Patent: November 9, 2021
    Assignee: International Business Machines Corporation
    Inventors: Lin Cai, Yi Ming Yin, Di Ling Chen, Li Wu, Xue Gang Ding
  • Patent number: 11144693
    Abstract: A method includes generating on a host machine a validated verification test scenario comprising a graph defining a scheduled performance order of a plurality of actions to be performed on a DUT and a corresponding verification environment; obtaining a subset of one or more actions to be added to the validated scenario while maintaining the plurality of actions of the validated scenario and the scheduled performance order, forming an amended verification test scenario; and applying a runtime solver in a target language of the DUT and the corresponding verification environment on the amended verification test scenario to generate a test in a target code and to apply the test on the DUT and the corresponding verification environment wherein inclusion of any of said one or more actions or an order of performance of said one or more actions of the subset in the test is determined at runtime.
    Type: Grant
    Filed: November 27, 2019
    Date of Patent: October 12, 2021
    Assignee: Cadence Design Systems, Inc.
    Inventor: Meir Ovadia
  • Patent number: 11138089
    Abstract: A method, computer program product, and a computer system are disclosed for processing information in a processor that in one or more embodiments includes generating workload information of a performance base test; determining characteristics of the workload information; determining one or more constraints that can cause behavioral changes to a design of the processor; combining the determined characteristics and the determined one or more constraints to generate one or more example constraints; testing the one or more example constraints in one or more example performance tests; and generating one or more performance benchmarks for the performance base test and the one or more example performance tests.
    Type: Grant
    Filed: December 19, 2018
    Date of Patent: October 5, 2021
    Assignee: International Business Machines Corporation
    Inventors: Shricharan Srivatsan, Vivek Britto, Aishwarya Dhandapani, Tharunachalam Pindicura, John A. Schumann, Brian W. Thompto
  • Patent number: 11080141
    Abstract: A simulation model recovery method, system, and computer program product include initiating a simulation model, during an operation of a model, periodically writing a solution space of the model to a checkpoint restart file, during an operation of the model, periodically writing diagnostic information on model progression to a log file, detecting a failure of the model, based on the log of the model, determining a time of the failure, based on the model outputs and restart files, determining a period of a numerical instability preceding the failure, selecting a checkpoint of the model preceding the period of the numerical instability, based on the numerical instability and diagnostic information in log files, modifying a configuration of the model, and restarting the model based on the selected checkpoint and the modified configuration.
    Type: Grant
    Filed: January 22, 2019
    Date of Patent: August 3, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Fearghal O'donncha, Ernesto Arandia, Eli Michael Dow, Frank Liu, Campbell D Watson
  • Patent number: 11080446
    Abstract: A hybrid electronic system including an emulator side including a processor and a first clock, a simulated side including one or more models to simulate one or more prototypes and a second clock, a first interface to the emulator side, and a second interface to the simulated side is disclosed. The processor is configured to determine using the first interface a first amount of time corresponding to an amount of time advanced on the emulator side by the first clock. The processor is configured to determine using the second interface a second amount of time corresponding to an amount of time advanced on the simulated side by the second clock, and set a value of a clock frequency of the second clock based on an initial value of the clock frequency of the second clock and a ratio of the first amount of time to the second amount of time.
    Type: Grant
    Filed: March 18, 2020
    Date of Patent: August 3, 2021
    Assignee: Synopsys, Inc.
    Inventors: Cedric Babled, Sylvain Bayon De Noyer
  • Patent number: 11055205
    Abstract: Methods, apparatus, and processor-readable storage media for regression testing using automation technologies are provided herein. An example computer-implemented method includes generating application programming interfaces related to regression testing; obtaining user input, via at least one user interface, pertaining to at least one regression testing test case; selecting at least one of the application programming interfaces based at least in part on the user input; generating at least one regression testing automation tool using the at least one selected application programming interface and at least a portion of one or more software testing automation technologies; and performing one or more automated actions utilizing the at least one generated regression testing automation tool.
    Type: Grant
    Filed: March 16, 2020
    Date of Patent: July 6, 2021
    Assignee: EMC IP Holding Company LLC
    Inventors: Surendra Chauhan, Udit Tyagi
  • Patent number: 11036439
    Abstract: A new snapshot of a storage volume is created by instructing computing nodes to suppress write requests. Once pending write requests from the computing nodes are completed, storage nodes create a new snapshot for the storage volume by allocating a new segment to the new snapshot and finalizes and performs garbage collection with respect to segments allocated to the previous snapshot. An orchestration layer implements a bundled application that is provisioned with virtualized storage and computation resources. A snapshot of the bundled application may be created and used to rollback or clone the application. Clones snapshots of storage volumes may be gradually populated with data from prior snapshots to reduce loading on a primary snapshot. Chaos testing of the bundled application may be performed and storage volumes may be created, expanded, and/or moved based on usage of the bundled application.
    Type: Grant
    Filed: October 22, 2018
    Date of Patent: June 15, 2021
    Assignee: ROBIN SYSTEMS, INC.
    Inventors: Ravikumar Alluboyina, Ashok Mishra, Abir Bhattacharyya
  • Patent number: 11036623
    Abstract: A test apparatus for characterizing a device under test includes a test case generator, a test unit, a data storage unit, and a data analysis unit. The test case generator is configured to randomly generate a plurality of test cases, which include values of one or more input variables of a set of input variables. The test unit is configured to perform the plurality of test cases on the device under test. The data storage unit may store sets of test data, which are associated to the test cases and include values of input variables of a respective test case and corresponding values of output variables of the device under test related to the respective test case. The data analysis unit may further analyze the test data and is further configured to determine dependencies within a subset of variables of the test data to characterize the device under test.
    Type: Grant
    Filed: August 16, 2019
    Date of Patent: June 15, 2021
    Assignee: Advantest Corporation
    Inventor: Jochen Rivoir
  • Patent number: 11016759
    Abstract: Described herein is a computer implemented method. The method comprises receiving, by an issue tracking system, a deployment update from a deployment system which includes deployment information in respect of one or more issues maintained by the issue tracking system. The method further comprises associating one or more issues maintained by the issue tracking system with deployment information by identifying the one or more issues to which the deployment information in the deployment update relates, extracting the deployment information from the deployment update, and associating the deployment information with each of the identified issues.
    Type: Grant
    Filed: March 29, 2019
    Date of Patent: May 25, 2021
    Assignees: ATLASSIAN PTY LTD., ATLASSIAN INC.
    Inventors: Taylor Pechacek, Rodrigo Berto, Oliver Burn, James Navin, Boris Gvozdev, Christian Rolf, Daniel Kerris, Dmitry Pak, Gustavo Maciel, Konstantine Abakumov, Karina Moraes Da Silva, Rafal Myslek, Bruce Templeton
  • Patent number: 11010278
    Abstract: A data analysis system processes data generated by instrumented software. The data analysis system receives data streams generated by instances of instrumented software executing on systems. The data analysis system also receives metadata describing data streams. The data analysis system receives an expression based on the metadata. The data analysis system receives data of data streams for each time interval and computes the result of the expression based on the received data values. The data analysis system repeats these steps for each time interval. The data analysis system may quantize data values of data streams for each time interval by generating an aggregate value for the time interval based on data received for each data stream for that time interval. The data analysis system evaluates the expression using the quantized data for the time interval.
    Type: Grant
    Filed: August 16, 2019
    Date of Patent: May 18, 2021
    Assignee: Splunk Inc.
    Inventors: Phillip Liu, Arijit Mukherji, Rajesh Raman, Kris Grandy, Jack Lindamood
  • Patent number: 11003570
    Abstract: Performing a mirror test for localization testing includes executing a mirror test, the mirror test includes an execution of actions on target controls on a master device and mimicking the actions on the target controls on a number of slave devices for localization testing, identifying the target controls on the number of slave devices to mimic the execution of the actions on the target controls of the master device, capturing at least one screenshot of the mirror test, and displaying the at least one screenshot to a user.
    Type: Grant
    Filed: April 30, 2014
    Date of Patent: May 11, 2021
    Assignee: Micro Focus LLC
    Inventors: Yi-Qun Ren, Hai-Ying Liu, Zhi-Yuan Jing
  • Patent number: 11003153
    Abstract: Embodiments include apparatuses, methods, and systems for computer assisted or autonomous driving. An apparatus may include a storage and a safety operation controller disposed in a computer assisted or autonomous driving vehicle. The storage may store a safety operation configuration and a list of safety operations to be performed on one or more device components. The safety operation configuration and the list of safety operations may be provided by a first party. The safety operation configuration may be used to configure selected ones of the list of safety operations by a second party different from the first party to obtain configured safety operations to be performed on the one or more device components. The safety operation controller may perform the configured safety operations on the one or more device components. Other embodiments may also be described and claimed.
    Type: Grant
    Filed: November 17, 2017
    Date of Patent: May 11, 2021
    Assignee: Intel Corporation
    Inventors: Tamir Damian Munafo, Alexander Brill
  • Patent number: 10997344
    Abstract: The purpose of the present invention is to decrease the time required to create fault injection test data when performing an ECU simulation test. An ECU simulation device according to the present invention is provided with a database in which fault modes are defined for each type of circuit element, reads out, from the database, fault modes for each circuit element provided in an ECU, and generates a test pattern for each of the fault modes.
    Type: Grant
    Filed: June 14, 2017
    Date of Patent: May 4, 2021
    Assignee: HITACHI AUTOMOTIVE SYSTEMS, LTD.
    Inventor: Yoshinobu Fukano
  • Patent number: 10990472
    Abstract: Methods, systems, and devices for spare substitution in a memory system are described. A controller may, as part of a background operation, assign a spare bit to replace a bit of a code word and save an indication of the spare bit assignment in a memory array. The code word may include a set of bits that each correspond to a respective Minimum Substitution Region (MSR) within a memory medium that retains the code word. An MSR corresponding to the bit to be replaced may include a quantity of erroneous bits relative to a threshold. The controller may, during a read operation, identify the spare bit in a first portion of the code word, determine the bit to be replaced based on accessing the memory array, and replace the bit with the spare bit concurrently with receiving a second portion of the code word.
    Type: Grant
    Filed: July 19, 2019
    Date of Patent: April 27, 2021
    Assignee: Micron Technology, Inc.
    Inventor: Joseph Thomas Pawlowski
  • Patent number: 10983981
    Abstract: A distributed key-value database management system may provide transactions having a high degree of conformance to ACID properties. A data element may be maintained as a versioned list, where each entry may comprise a timestamp and a value indicative of a corresponding version of the data element. The timestamp may be based at least in part on a vended time value. Timestamps may be monotonically increasing and unique across all entries in a distributed system. Conflicting updates to a data element may be detected directly, prior to the completion of involved transactions.
    Type: Grant
    Filed: December 3, 2014
    Date of Patent: April 20, 2021
    Assignee: Amazon Technologies, Inc.
    Inventors: Vaibhav Sharma, Nitin Kumar Gupta, Marvin Michael Theimer, Shen Pan, Léon Thrane, Zachary Thomas Crowell
  • Patent number: 10970197
    Abstract: Systems, methods, and computer-readable media are described for performing revision control for a System Under Test (SUT) such as a body of source code. Prior to committing code changes, a collection of breakpoints associated with the portion(s) of source code being changed are determined. Stored fingerprints corresponding to regression test cases are evaluated to identify a set of stored fingerprints that are cumulatively indicative of the collection of breakpoints. Attributes respectively stored in association with the set of stored fingerprints are determined and a corresponding group of regression test cases are determined. The code changes are committed responsive to successful execution of the selected group of regression test cases.
    Type: Grant
    Filed: June 13, 2019
    Date of Patent: April 6, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Andrew Hicks, Dale E. Blue, Ryan Thomas Rawlins, Steven Partlow
  • Patent number: 10963366
    Abstract: Systems, methods, and computer-readable media are described for generating fingerprints for regression tests that identify code paths taken during execution of the regression tests. Breakpoint values are assigned to breakpoints encountered during execution of a regression test and a fingerprint is generated based on the assigned breakpoint values and a code path taken during execution of the regression test. Various breakpoint value assignment/fingerprint generation algorithms are described herein that generate a fingerprint from which a corresponding code path taken can be reconstructed including which breakpoints are encountered, the number of times each such breakpoint is encountered, and the order in which the breakpoints are encountered.
    Type: Grant
    Filed: June 13, 2019
    Date of Patent: March 30, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Andrew Hicks, Dale E. Blue, Ryan Rawlins, Steven Partlow
  • Patent number: 10950421
    Abstract: Systems and methods for identifying a location of a fault in an RF transmission system includes characterizing the RF transmission system and selecting one of the stage in the RF transmission system as an initial selected stage. An output of the initial selected stage can be measured in the characterized RF transmission system. The measured output of the initial selected stage is propagated through a baseline RF model and a point of deflection is identified in a resulting RF model of the RF transmission system.
    Type: Grant
    Filed: April 21, 2014
    Date of Patent: March 16, 2021
    Assignee: Lam Research Corporation
    Inventor: John C. Valcore, Jr.
  • Patent number: 10949590
    Abstract: Methods and systems for verifying that logic for implementing a pipelined process in hardware correctly moves data through the pipelined process. The method includes: (a) monitoring data input to the pipelined process to determine when watched data has been input to the pipelined process; (b) in response to determining the watched data has been input to the pipelined process counting a number of progressing clock cycles for the watched data; and (c) evaluating an assertion written in an assertion based language, the assertion establishing that when the watched data is output from the pipelined process the counted number of progressing clock cycles for the watched data should be equal to one of one or more predetermined values.
    Type: Grant
    Filed: April 30, 2019
    Date of Patent: March 16, 2021
    Assignee: Imagination Technologies Limited
    Inventors: Ashish Darbari, Sam Elliott
  • Patent number: 10936774
    Abstract: Integrated circuit failures caused by metastability related to assertion of asynchronous resets frequently escape detection before fabrication, causing design respins and severe economic loss. The numerous reset signals, flip-flops and complex logical interactions inherent in an integrated circuit cause an analysis for reset-metastability failures to be extremely noisy, reporting an unmanageable number of false failures and making early removal of failures impractical. Said noisy reporting arises because many flip-flops where reset-metastability manifests do not necessarily cause overall failure. An effective analysis of reset-metastability failures must identify all potential failures, but also must only report true failure potential. The present invention maximizes noise reduction by applying special conditions to identify flip-flops manifesting reset-metastability without causing integrated circuit failure, which can thereby be deemed safe.
    Type: Grant
    Filed: February 14, 2019
    Date of Patent: March 2, 2021
    Assignee: Real Intent, Inc.
    Inventors: Oren Katzir, Sanjeev Mahajan, Prakash Narain, Vishnu Vimjam
  • Patent number: 10936476
    Abstract: Embodiments described herein are directed to computer-implemented methods, systems, and computer program products for regression testing. New techniques for software regression testing are provided in which the regression test scenarios are directly synchronized with the user's system and environment. This can be referred to as a customized-regression-test process. A non-limiting example of a computer-implemented method includes receiving a history log having application data for an application during normal use and generating a regression test scenario for a new version of the application based on a pattern of use of the application. The method further includes determining whether one or more existing regression test scenarios stored in a test scenario data store match the generated regression test scenario and executing a regression test on the new version of the application using the regression test scenario.
    Type: Grant
    Filed: March 28, 2019
    Date of Patent: March 2, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventor: Cresyi Padilla-Ruberte
  • Patent number: 10936474
    Abstract: A simulation of software test program executing upon a primary model of a portion of a data processing apparatus is performed to identify uncovered (undetected) failures. A formal method analysis is then performed upon a combination of the primary model and a fault-simulating model simulating the uncovered failures in order to identify software stimuli that can render the uncovered failures detectable. The identified software stimuli are then added to the software test program to increase the failure coverage. The process is performed iteratively until a desired level of failure coverage is achieved.
    Type: Grant
    Filed: February 27, 2018
    Date of Patent: March 2, 2021
    Assignee: Arm Limited
    Inventor: Spyros Lyberis
  • Patent number: 10880173
    Abstract: The described technology is generally directed towards automated acceptance testing of network functions so that only certified network functions are deployed in a wireless network. When a network function attempts to register in a network, e.g., with a network function repository, the registration attempt triggers a workflow that obtains a result of automated testing of the network function. The automated testing operation can be based on a test suite selected according to the network function type and the network slice in which the network function is to be deployed. Only upon determining that the network function passed the automated testing operation is the network function registered (by the network function repository) for operation in the wireless network.
    Type: Grant
    Filed: December 3, 2018
    Date of Patent: December 29, 2020
    Assignee: AT&T INTELLECTUAL PROPERTY I, L.P.
    Inventors: Vikram Seenappa, Joseph Dahan, Srikanth Tirumala, Michal Cwian, Dana Coburn, Henry Deccio, Henry Romero, Pratik Gandhi
  • Patent number: 10817409
    Abstract: A system, method and computer-readable medium for testing a service-based application identifies a set of use cases for the service-based application. Each use case in the set is mapped to a test case to generate a first set of test cases. Each of the test cases is refined to generate an updated set of test cases and the updated set of test cases is executed.
    Type: Grant
    Filed: January 4, 2019
    Date of Patent: October 27, 2020
    Assignee: AT&T Intellectual Property I, L.P.
    Inventors: Xiangwei Zeng, Teh-Hsin Wu, Zhenzhen Wang
  • Patent number: 10805329
    Abstract: An industrial asset may be associated with a plurality of monitoring nodes, each monitoring node generating a series of monitoring node values over time representing current operation of the industrial asset. An abnormality detection computer may determine that at least one abnormal monitoring node is currently being attacked or experiencing a fault. A virtual sensing estimator may continuously execute an adaptive learning process to create or update virtual sensor models for the monitoring nodes. Responsive to an indication that a monitoring node is currently being attacked or experiencing a fault, the virtual sensing estimator may be dynamically reconfigured to estimate a series of virtual node values for the abnormal monitoring node or nodes based on information from normal monitoring nodes and appropriate virtual sensor models. The series of monitoring node values from the abnormal monitoring node or nodes may then be replaced with the virtual node values.
    Type: Grant
    Filed: May 11, 2018
    Date of Patent: October 13, 2020
    Assignee: GENERAL ELECTRIC COMPANY
    Inventors: Masoud Abbaszadeh, Lalit Keshav Mestha
  • Patent number: 10768956
    Abstract: A dynamic cloud stack testing system comprises a cloud network with cloud components and a cloud stack server coupled to the network. The server includes an interface, a memory, a cloud stack configuration engine, and a cloud stack testing engine. The interface receives a cloud stack request from a user device that includes functionality parameters. The memory stores historic cloud stack combinations. The cloud stack configuration engine identifies cloud components associated with the functionality parameters and determines a cloud stack configuration that incorporates them. The cloud stack testing engine determines a cloud stack configuration test. The cloud stack testing engine executes the test, and stores results and the associated cloud stack configuration in the memory.
    Type: Grant
    Filed: September 20, 2019
    Date of Patent: September 8, 2020
    Assignee: Bank of America Corporation
    Inventors: Sandeep Kumar Chauhan, Sasidhar Purushothaman
  • Patent number: 10705943
    Abstract: A library model addition engine adds library models to a library knowledge base by defining a template for a library configuration file that conveys information about each library model, custom inputs and code snippets to facilitate library comparison operations, and education content for the library model, where the library configuration file template may be automatically filled by populating selected data fields in the template with information identifying the library model, scraping documentation pages to extract test cases, and then scraping test case code to extract the test case input parameters for input to an input/output matching engine to evaluate a repository of code snippets and identify a set of functionally similar code snippets for inclusion one or more data fields in the template.
    Type: Grant
    Filed: September 8, 2017
    Date of Patent: July 7, 2020
    Assignee: DevFactory Innovations FZ-LLC
    Inventor: Tushar Makkar
  • Patent number: 10664385
    Abstract: Techniques for debugging of a collection of instructions executed by a computing system including a set of actors are described herein. A first sub-set of actors from the set of actors to be monitored for debugging and one or more error condition associated with the collection of instructions may be identified. A set of indications including indications of messages processed by the actors, indications of associated actor states prior to processing of the messages, and indications of associated actor states subsequent to processing of the messages may be received from the sub-set of actors. It may then be determined that a first actor of the sub-set of actors has satisfied the error condition. Based at least in part on the set of indications, one or more messages associated with satisfaction of the error condition may then be identified, for example for re-processing and debugging.
    Type: Grant
    Filed: January 13, 2017
    Date of Patent: May 26, 2020
    Assignee: Amazon Technologies, Inc.
    Inventors: Adam Julio Villalobos, Martin Paul Zolnieryk, Andrew Kyle McWilliams, Brian James Schuster
  • Patent number: 10649888
    Abstract: Disclosed herein are methods, systems, and processes to generate and perform parallelizable data-driven single instruction multiple data (SIMD) tests. A base abstract class that defines shared testing parameters for tests to be performed on an application is designated. Inheriting classes of the base abstract class are defined and a data source key is derived from the inhering classes. A test data source is accessed to perform the tests on the application and a result of tests is generated based on the data source key.
    Type: Grant
    Filed: January 31, 2018
    Date of Patent: May 12, 2020
    Assignee: Dell Products L.P.
    Inventor: Mykhailo Makarov
  • Patent number: 10642726
    Abstract: A method and apparatus are provided for enhancing operable testing functionality for program code by mutating a code segment in a received program code to generate a mutated code segment, by monitoring execution of a test suite against the mutated code segment to detect a surviving mutation, and by evaluating the surviving mutation against the test suite to identify a first test case to blame for the surviving mutation by analyzing a coverage of the plurality of test cases in the test suite for the surviving mutation to identify one or more test cases from the test suite which cover the surviving mutation and then select the first test case which meets one or more predetermined selection criteria.
    Type: Grant
    Filed: August 31, 2018
    Date of Patent: May 5, 2020
    Assignee: DEVFACTORY FZ-LLC
    Inventor: Abhishek
  • Patent number: 10642716
    Abstract: According to an aspect of an embodiment, operations may include determining a plurality of event correspondences. Each event correspondence may indicate a correspondence between a respective change of a plurality of changes made to first source code of a first software program and a respective event type that occurs with respect to the first software program. The plurality of event correspondences may be determined by performing two or more event type inference operations of a plurality of event type inference operations. The plurality of event type inference operations may include determining a fault introduction event, determining a fault correction event, determining a defect introduction event, determining a defect correction event, and determining a platform migration event.
    Type: Grant
    Filed: February 7, 2019
    Date of Patent: May 5, 2020
    Assignee: FUJITSU LIMITED
    Inventors: Hiroaki Yoshida, Mukul R. Prasad
  • Patent number: 10628542
    Abstract: An apparatus, including: a deterministic monitored device; an interconnect to communicatively couple the monitored device to a support circuit; a super queue to queue transactions between the monitored device and the support circuit, the super queue including an operational segment and a shadow segment; a debug data structure; and a system management agent to monitor transactions in the operational segment, log corresponding transaction identifiers in the shadow segment, and write debug data to the debug data structure, wherein the debug data are at least partly based on the corresponding transaction identifiers.
    Type: Grant
    Filed: July 1, 2017
    Date of Patent: April 21, 2020
    Assignee: Intel Corporation
    Inventors: Tsvika Kurts, Alexander Gendler, Larisa Novakovsky, Anwar Azaarura Zaa'Rura, Afik Sela, Genadi Kazakevich, Alexandra Shainshein, Ariel Sabba
  • Patent number: 10630972
    Abstract: Embodiments disclose systems and methods for testing and determining outages of communication systems. A server can receive signal-reception-related information from set-top boxes (STBs) in a particular geographical region, where a STB: receives signals having a predefined pattern, generates a comparison of the predefined pattern to reference patterns stored on the STB, generates the signal-reception-related information based on the comparison, and sends the signal-reception-related information. The server can determine an outage status for the particular geographical region based on the signal-reception-related information. The server can generate an output based on the outage status. The output is configured to provide information related to the outage status of the particular geographical region and information for possible responses related to the outage status. The server can send the output.
    Type: Grant
    Filed: April 9, 2019
    Date of Patent: April 21, 2020
    Assignee: The DIRECTV Group, Inc.
    Inventors: Kian-Vine Chin, Woei-Shyang Yee, Wesley W. Huie, Gerard V. Talatinian, Christopher Yang, Heesoon E. Kim, Robert S. Greenwade
  • Patent number: 10554514
    Abstract: Exemplary methods, apparatuses, and systems include receiving time series data for each of a plurality of performance metrics. The time series data is sorted into buckets based upon an amount of variation of time series data values for each performance metric. The time series data in each bucket is divided into first and second clusters of time series data points. The bucket having the greatest distance between clusters is used to determine a performance metric having a greatest distance between clusters. The performance metric having the greatest distance between clusters is reported as a potential root cause of a performance issue.
    Type: Grant
    Filed: October 26, 2016
    Date of Patent: February 4, 2020
    Assignee: VMware, Inc.
    Inventors: Chien-Chia Chen, Lenin Singaravelu, Ruijin Zhou, Xiaobo Huang