Patents Examined by Sehwan Kim
  • Patent number: 11574164
    Abstract: Cooperative neural networks may be implemented by providing an input to a first neural network including a plurality of first parameters, and updating at least one first parameter based on an output from a recurrent neural network provided with the input, the recurrent neural network including a plurality of second parameters.
    Type: Grant
    Filed: March 20, 2017
    Date of Patent: February 7, 2023
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventor: Sakyasingha Dasgupta
  • Patent number: 11568203
    Abstract: Estimating Remaining Useful Life (RUL) from multi-sensor time series data is difficult through manual inspection. Current machine learning and data analytics methods, for RUL estimation require large number of failed instances for training, which are rarely available in practice, and these methods cannot use information from currently operational censored instances since their failure time is unknown. Embodiments of the present disclosure provide systems and methods for estimating RUL using time series data by implementing an LSTM-RNN based ordinal regression technique, wherein during training RUL value of failed instance(s) is encoded into a vector which is given as a target to the model. Unlike a failed instance, the exact RUL for a censored instance is unknown. For using the censored instances, target vectors are generated and the objective function is modified for training wherein the trained LSTM-RNN based ordinal regression is applied on an input test time series for RUL estimation.
    Type: Grant
    Filed: March 13, 2019
    Date of Patent: January 31, 2023
    Assignee: Tata Consultancy Services Limited
    Inventors: Pankaj Malhotra, Vishnu Tv, Lovekesh Vig, Gautam Shroff
  • Patent number: 11521069
    Abstract: Embodiments employ an inference method for neural networks that enforces deterministic constraints on outputs without performing post-processing or expensive discrete search over the feasible space. Instead, for each input, the continuous weights are nudged until the network's unconstrained inference procedure generates an output that satisfies the constraints. This is achieved by expressing the hard constraints as an optimization problem over the continuous weights and employing backpropagation to change the weights of the network. Embodiments optimize over the energy of the violating outputs; since the weights directly determine the output through the energy, embodiments are able to manipulate the unconstrained inference procedure to produce outputs that conform to global constraints.
    Type: Grant
    Filed: March 6, 2017
    Date of Patent: December 6, 2022
    Assignee: Oracle International Corporation
    Inventors: Michael Wick, Jean-Baptiste Tristan, Jay Yoon Lee
  • Patent number: 11521052
    Abstract: Hardware and neural architecture co-search may be performed by operations including obtaining a specification of a function and a plurality of hardware design parameters. The hardware design parameters include a memory capacity, a number of computational resources, a communication bandwidth, and a template configuration for performing neural architecture inference. The operations further include determining, for each neural architecture among a plurality of neural architectures, an overall latency of performance of inference of the neural architecture by an accelerator within the hardware design parameters. Each neural architecture having been trained to perform the function with an accuracy. The operations further include selecting, from among the plurality of neural architectures, a neural architecture based on the overall latency and the accuracy.
    Type: Grant
    Filed: June 30, 2021
    Date of Patent: December 6, 2022
    Assignee: EDGECORTIX PTE. LTD.
    Inventors: Sakyasingha Dasgupta, Weiwen Jiang, Yiyu Shi
  • Patent number: 11501181
    Abstract: An embodiment of the invention provides a method to determine relationships between entities where an interface receives a first data set representing observations of a first entity and observations of a second entity, and a second data set representing a relationship between the first entity and the second entity. An entity analytics engine applies a first candidate rule to the first data set to generate a first candidate relationship between the first entity and the second entity. A processor determines whether according to a criterion the first candidate relationship matches the relationship represented in the second data set. The entity analytics engine replaces the first candidate rule with a second candidate rule by when the first candidate relationship does not match the relationship represented in the second data set.
    Type: Grant
    Filed: February 9, 2017
    Date of Patent: November 15, 2022
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventor: Kirk J. Krauss
  • Patent number: 11488028
    Abstract: A method is provided, including: processing interactions by a plurality of users with a plurality of content items, the content items being provided over a network in response to user requests received over the network, wherein each content item is associated with one or more entities; for each user, determining a user entity set that includes entities associated with content items with which the user interacted; embedding the users and the entities in a vector space, wherein the embedding is configured to place a given user, and the entities of the given user's user entity set, in proximity to each other in the vector space; for each user, performing a proximity search in the vector space to identify a set of nearest entities to the user in the vector space; for each user, generating a user profile using the identified set of nearest entities to the user.
    Type: Grant
    Filed: March 31, 2017
    Date of Patent: November 1, 2022
    Assignee: YAHOO ASSETS LLC
    Inventors: Akshay Soni, Yashar Mehdad, Troy Chevalier
  • Patent number: 11449731
    Abstract: Provided are a computer program product, a learning apparatus and a learning method. The method includes calculating a first propagation value that is propagated from a propagation source node to a propagation destination node in a neural network including nodes, based on node values of the propagation source node at time points and a weight corresponding to passage of time points based on a first attenuation coefficient. The method also includes updating the first attenuation coefficient by using a first update parameter, that is based on a first propagation value, and an error of the node value of the propagation destination node.
    Type: Grant
    Filed: January 16, 2020
    Date of Patent: September 20, 2022
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventor: Takayuki Osogami
  • Patent number: 11429854
    Abstract: A method for training a computerized mechanical device, comprising: receiving data documenting actions of an actuator performing a task in a plurality of iterations; calculating using the data a neural network dataset and used for performing the task; gathering in a plurality of reward iterations a plurality of scores given by an instructor to a plurality of states, each comprising at least one sensor value, while a robotic actuator performs the task according to the neural network; calculating using the plurality of scores a reward dataset used for computing a reward function; updating at least some of the neural network's plurality of parameters by receiving in each of a plurality of policy iterations a reward value computed by applying the reward function to another state comprising at least one sensor value, while the robotic actuator performs the task according to the neural network; and outputting the updated neural network.
    Type: Grant
    Filed: December 4, 2017
    Date of Patent: August 30, 2022
    Assignee: Technion Research & Development Foundation Limited
    Inventors: Ran El-Yaniv, Bar Hilleli
  • Patent number: 11379746
    Abstract: A method of processing image data in a connectionist network comprises a plurality of units, wherein the method implements a multi-channel unit forming a respective one of the plurality of units, and wherein the method comprises: receiving, at the data input, a plurality of input picture elements representing an image acquired by means of a multi-channel image sensor, wherein the plurality of input picture elements comprise a first and at least a second portion of input picture elements, wherein the first portion of input picture elements represents a first channel of the image sensor and the second portion of input picture elements represents a second channel of the image sensor; processing of the first and at least second portion of input picture elements separately from each other; and outputting, at the data output, the processed first and second portions of input picture elements.
    Type: Grant
    Filed: November 28, 2018
    Date of Patent: July 5, 2022
    Assignee: Aptiv Technologies Limited
    Inventors: Farzin G. Rajabizadeh, Narges Milani, Daniel Schugk, Lutz Roese-Koerner, Yu Su, Dennis Mueller
  • Patent number: 11341414
    Abstract: An apparatus includes processor(s) to: receive a request for a data catalog; in response to the request specifying a structural feature, analyze metadata of multiple data sets for an indication of including it, and to retrieve an indicated degree of certainty of detecting it for data sets including it; in response to the request specifying a contextual aspect, analyze context data of the multiple data sets for an indication of being subject to it, and to retrieve an indicated degree of certainty concerning it for data sets subject to it; selectively include each data set in the data catalog based on the request specifying a structural feature and/or a contextual aspect, and whether each data set meets what is specified; for each data set in the data catalog, generate a score indicative of the likelihood of meeting what is specified; and transmit the data catalog to the requesting device.
    Type: Grant
    Filed: February 2, 2021
    Date of Patent: May 24, 2022
    Assignee: SAS INSTITUTE INC.
    Inventors: Nancy Anne Rausch, Roger Jay Barney, John P. Trawinski
  • Patent number: 11244236
    Abstract: An embodiment of the invention provides a method for determining relationships between physical entities, where one or more of the physical entities is associated with static feature(s) and changeable feature(s). An entity analytics engine determines that a first physical entity and a second physical entity may be in a relationship with a third physical entity based on a first rule and a first set of observations. The first rule is applicable to one or more static features of the first physical entity, the second physical entity, and the third physical entity. The first rule provides that the first physical entity and the second physical entity may be in a relationship with the third physical entity when the third physical entity includes one or more static features that are within a threshold degree of similarity to static features of the first physical entity and the second physical entity.
    Type: Grant
    Filed: March 31, 2017
    Date of Patent: February 8, 2022
    Assignee: International Business Machines Corporation
    Inventor: Kirk J. Krauss
  • Patent number: 11227208
    Abstract: Described herein is a technology that facilitates the production of and the use of automated datagens for event-based. A datagen (i.e., data-generator or data generation system) is a component, module, or subsystem of computer systems that searches, monitors, and analyzes machine data. A datagen produces events that are further processed in various ways for subsequent use (such as searching, monitoring, and analysis).
    Type: Grant
    Filed: July 29, 2016
    Date of Patent: January 18, 2022
    Assignee: Splunk Inc.
    Inventors: Adam Oliner, Zidong Yang, Sinduja Sreshta
  • Patent number: 11210577
    Abstract: A neuromorphic device includes a pre-synaptic neuron, a synapse electrically coupled to the pre-synaptic neuron through a row line, and a post-synaptic neuron electrically coupled to the synapse through a column line. The post-synaptic neuron includes an integrator, a comparator, and an error corrector including an error detector and a correction signal generator. The comparator and the error corrector receive an output of the integrator.
    Type: Grant
    Filed: March 17, 2017
    Date of Patent: December 28, 2021
    Assignee: SK hynix Inc.
    Inventor: Hyung-Dong Lee
  • Patent number: 11205129
    Abstract: Implementations of the present specification disclose methods, devices, and apparatuses for determining a feature interpretation of a predicted label value of a user generated by a GBDT model. In one aspect, the method includes separately obtaining, from each of a predetermined quantity of decision trees ranked among top decision trees, a leaf node and a score of the leaf node; determining a respective prediction path of each leaf node; obtaining, for each parent node on each prediction path, a split feature and a score of the parent node; determining, for each child node on each prediction path, a feature corresponding to the child node and a local increment of the feature on the child node; obtaining a collection of features respectively corresponding to the child nodes; and obtaining a respective measure of relevance between the feature corresponding to the at least one child node and the predicted label value.
    Type: Grant
    Filed: June 1, 2020
    Date of Patent: December 21, 2021
    Assignee: Advanced New Technologies Co., Ltd.
    Inventors: Wenjing Fang, Jun Zhou, Licui Gao
  • Patent number: 11188819
    Abstract: Disclosed aspects relate to entity model establishment using an infinite mixture topic modeling (IMTM) technique. A set of event data which corresponds to a set of events may be detected. Using the IMTM technique, the set of event data which corresponds to the set of events may be analyzed. Based on analyzing the set of event data using the IMTM technique, a set of entity models for the set of events may be determined. Based on the set of entity models for the set of events, a subset of the set of entity models for the set of events may be established.
    Type: Grant
    Filed: May 10, 2017
    Date of Patent: November 30, 2021
    Assignee: International Business Machines Corporation
    Inventors: Yu Gu, Dingcheng Li, Kai Liu, Su Liu
  • Patent number: 11170303
    Abstract: Systems and methods for quantifying temporal indeterminacy of timelines are provided. Systems and methods can rely on solving temporal constraint problems to extract timelines and can calculate the temporal relation loss during timeline transformation and then identify the temporal indeterminate sections of extracted timelines from both timelines and temporal graphs to measure the total temporal information loss.
    Type: Grant
    Filed: January 28, 2021
    Date of Patent: November 9, 2021
    Assignee: THE FLORIDA INTERNATIONAL UNIVERSITY BOARD OF TRUSTEES
    Inventors: Mustafa Ocal, Mark Finlayson
  • Patent number: 11157800
    Abstract: A configurable spiking neural network based accelerator system is provided. The accelerator system may be executed on an expansion card which may be a printed circuit board. The system includes one or more application specific integrated circuits comprising at least one spiking neural processing unit and a programmable logic device mounted on the printed circuit board. The spiking neural processing unit includes digital neuron circuits and digital, dynamic synaptic circuits. The programmable logic device is compatible with a local system bus. The spiking neural processing units contain digital circuits comprises a Spiking Neural Network that handles all of the neural processing. The Spiking Neural Network requires no software programming, but can be configured to perform a specific task via the Signal Coupling device and software executing on the host computer.
    Type: Grant
    Filed: July 24, 2016
    Date of Patent: October 26, 2021
    Assignee: BRAINCHIP, INC.
    Inventors: Peter A J Van Der Made, Anil Shamrao Mankar
  • Patent number: 11157795
    Abstract: Graph partitioning and placement for multi-chip neurosynaptic networks. According to various embodiments, a neural network description is read. The neural network description describes a plurality of neurons. The plurality of neurons has a mapping from an input domain of the neural network. The plurality of neurons is labeled based on the mapping from the input domain. The plurality of neurons is grouped into a plurality of groups according to the labeling. Each of the plurality of groups is continuous within the input domain. Each of the plurality of groups is assigned to at least one neurosynaptic core.
    Type: Grant
    Filed: March 13, 2017
    Date of Patent: October 26, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Arnon Amir, Pallab Datta, Myron D. Flickner, Dharmendra S. Modha, Tapan K. Nayak
  • Patent number: 11151441
    Abstract: Embodiments of the present invention provide an artificial neural network system for improved machine learning, feature pattern extraction and output labeling. The system comprises a first spiking neural network and a second spiking neural network. The first spiking neural network is configured to spontaneously learn complex, temporally overlapping features arising in an input pattern stream. Competitive learning is implemented as Spike Timing Dependent Plasticity with lateral inhibition in the first spiking neural network. The second spiking neural network is connected with the first spiking neural network through dynamic synapses, and is trained to interpret and label the output data of the first spiking neural network. Additionally, the output of the second spiking neural network is transmitted to a computing device, such as a CPU for post processing.
    Type: Grant
    Filed: February 8, 2017
    Date of Patent: October 19, 2021
    Assignee: BRAINCHIP, INC.
    Inventor: Peter A J van der Made
  • Patent number: 11138168
    Abstract: A machine learning computing system for predicting a probability of success of an identified computing device error condition may include at least a first data repository storing a plurality of historic data records corresponding to one or more computing device error conditions and a second data repository storing a plurality of solutions to each of the computing device error conditions stored in the first data repository. A server is configured to receive a computing device error message from at least one computing center device and analyze the computing device error message to identify an associated error condition category. The server identifies at least two solutions to an associated error condition and predict a probability of success for each of the at least two solutions. The server then initiates at least one solution that has a greatest probability of success and updates the second data repository.
    Type: Grant
    Filed: March 31, 2017
    Date of Patent: October 5, 2021
    Assignee: Bank of America Corporation
    Inventors: Sasidhar Purushothaman, Amit Mishra