Patents Examined by Li B. Zhen
  • Patent number: 11580373
    Abstract: Computations in Artificial neural networks (ANNs) are accomplished using simple processing units, called neurons, with data embodied by the connections between neurons, called synapses, and by the strength of these connections, the synaptic weights. Crossbar arrays may be used to represent one layer of the ANN with Non-Volatile Memory (NVM) elements at each crosspoint, where the conductance of the NVM elements may be used to encode the synaptic weights, and a highly parallel current summation on the array achieves a weighted sum operation that is representative of the values of the output neurons. A method is outlined to transfer such neuron values from the outputs of one array to the inputs of a second array with no need for global clock synchronization, irrespective of the distances between the arrays, and to use such values at the next array, and/or to convert such values into digital bits at the next array.
    Type: Grant
    Filed: January 20, 2017
    Date of Patent: February 14, 2023
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Geoffrey W Burr, Pritish Narayanan
  • Patent number: 11574550
    Abstract: A computer-implemented method for learning a policy for selection of an associative topic, which can be used in a dialog system, is described. The method includes obtaining a policy base that indicates a topic transition from a source topic to a destination topic and a short-term reward for the topic transition, by analyzing data from a corpus. The short-term reward may be defined as probability of associating a positive response. The method also includes calculating an expected long-term reward for the topic transition using the short-term reward for the topic transition with taking into account a discounted reward for a subsequent topic transition. The method further includes generating a policy using the policy base and the expected long-term reward for the topic transition. The policy indicates selection of the destination topic for the source topic as an associative topic for a current topic.
    Type: Grant
    Filed: November 1, 2017
    Date of Patent: February 7, 2023
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Hiroshi Kanayama, Akira Koseki, Toshiro Takase
  • Patent number: 11568197
    Abstract: Embodiments of the present disclosure provide methods, systems, apparatuses, and computer program products for generating, training, and utilizing a digital signal processor (DSP) to evaluate graph data that may include irregular grid graph data. An example DSP that may be generated, trained, and used may include a set of hidden layers, wherein each hidden layer of the set of hidden layers comprises a set of heterogeneous kernels (HKs), and wherein each HK of the set of HKs includes a corresponding set of filters selected from the constructed set of filters and associated with one or more initial Laplacian operators and corresponding initial filter parameters.
    Type: Grant
    Filed: August 2, 2018
    Date of Patent: January 31, 2023
    Assignee: OPTUM SERVICES (IRELAND) LIMITED
    Inventors: Dong Fang, Peter Cogan
  • Patent number: 11567930
    Abstract: Methods and systems are disclosed for data retrieval, from databases to clients, in an environment requiring runtime authorization. In response to a request for T data records, a learning module provides a prediction R of a suitable number of data records to retrieve from a database. Following retrieval of R records or record identifiers, authorization is sought from an authorization service, resulting in A of the records being authorized. The A authorized records are returned to the requesting client, and, if more records are needed, T is decremented and the cycle is repeated. A performance notification is provided to the learning module for training, with respect to providing values of prediction R. The performance notification can be based on a measure of authorization service performance, the number A of authorized records, latency, communication or resource costs, a measure of resource congestion, or other parameters. Variants are disclosed.
    Type: Grant
    Filed: April 25, 2017
    Date of Patent: January 31, 2023
    Assignee: SAP SE
    Inventors: Apoorv Bhargava, Madathiveetil Bipin, Markus Schmidt-Karaca, Ismail Basha, Gonda Marcusse, Vishnu Kare, Praveen Kumar, Neenu Vincent
  • Patent number: 11537895
    Abstract: Systems and methods for training a multitask network is disclosed. In one aspect, training the multitask network includes determining a gradient norm of a single-task loss adjusted by a task weight for each task, with respect to network weights of the multitask network, and a relative training rate for the task based on the single-task loss for the task. Subsequently, a gradient loss function, comprising a difference between (1) the determined gradient norm for each task and (2) a corresponding target gradient norm, can be determined. An updated task weight for the task can be determined and used in the next iteration of training the multitask network, using a gradient of the gradient loss function with respect to the task weight for the task.
    Type: Grant
    Filed: October 24, 2018
    Date of Patent: December 27, 2022
    Assignee: Magic Leap, Inc.
    Inventors: Zhao Chen, Vijay Badrinarayanan, Andrew Rabinovich
  • Patent number: 11537888
    Abstract: Devices and methods for learning and/or predicting the self-reported pain improvement levels of osteoarthritis (OA) patients are provided. A device or apparatus can include a processor and a machine-readable medium in operable communication with the processor and having stored thereon an algorithm and a unique set of features. The algorithm and set of features can enable building one or more models that learn the self-reported pain improvement levels of OA patients.
    Type: Grant
    Filed: May 15, 2020
    Date of Patent: December 27, 2022
    Assignee: THE FLORIDA INTERNATIONAL UNIVERSITY BOARD OF TRUSTEES
    Inventors: Deya Banisakher, Naphtali Rishe, Mark Finlayson
  • Patent number: 11531880
    Abstract: A memory-based CNN, includes an input module, a convolution layer circuit module, a pooling layer circuit module, an activation function module, a fully connected layer circuit module, a softmax function module and an output module, convolution kernel values or synapse weights are stored in the NOR FLASH units; the input module converts an input signal into a voltage signal required by the convolutional neural network; the convolutional layer circuit module convolves the voltage signal corresponding to the input signal with the convolution kernel values, and transmits the result to the activation function module; the activation function module activates the signal; the pooling layer circuit module performs a pooling operation on the activated signal; the fully connected layer circuit module multiplies the pooled signal with the synapse weights to achieve classification; the softmax function module normalizes the classification result into probability values as an output of the entire network.
    Type: Grant
    Filed: June 7, 2018
    Date of Patent: December 20, 2022
    Assignee: HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventors: Yi Li, Wenqian Pan, Xiangshui Miao
  • Patent number: 11526722
    Abstract: Facilitation of an explanation about an object to be analyzed is realized with high accuracy and with efficiency. A data analysis apparatus is disclosed which uses a first neural network configured with an input layer, an output layer, and two or more intermediate layers provided between the input layer and the output layer. Each performs a calculation by giving data from a layer of a previous stage and a first learning parameter to a first activation function and outputs a calculation result to a layer of a subsequent stage. The data analysis apparatus includes a conversion section; a reallocation section; and an importance calculation section.
    Type: Grant
    Filed: August 30, 2018
    Date of Patent: December 13, 2022
    Assignee: HITACHI, LTD.
    Inventors: Takuma Shibahara, Mayumi Suzuki, Ken Naono
  • Patent number: 11526744
    Abstract: Methods, apparatuses, and embodiments related to a technique for monitoring construction of a structure. In an example, a robot with a sensor, such as a LIDAR device, enters a building and obtains sensor readings of the building. The sensor data is analyzed and components related to the building are identified. The components are mapped to corresponding components of an architect's three dimensional design of the building, and the installation of the components is checked for accuracy. When a discrepancy above a certain threshold is detected, an error is flagged and project managers are notified. Construction progress updates do not give credit for completed construction that includes an error, resulting in improved accuracy progress updates and corresponding improved accuracy for project schedule and cost estimates.
    Type: Grant
    Filed: May 31, 2017
    Date of Patent: December 13, 2022
    Assignee: Doxel, Inc.
    Inventors: Saurabh Ladha, Robin Singh
  • Patent number: 11521120
    Abstract: An inspection apparatus of the present disclosure includes: a machine learning device that performs machine learning on a basis of state data acquired from an inspection target and label data indicating an inspection result related to the inspection target to generate a learning model; a learning model evaluation index calculation unit that calculates a learning model evaluation index related to the learning model generated by the machine learning device as an evaluation index to be used to evaluate the learning model; an inspection index acquisition unit that acquires an inspection index to be used in the inspection; and a learning model selection unit that displays the learning model evaluation index and the inspection index so as to be comparable with each other regarding the learning model generated by the machine learning device, receives selection of the learning model by an operator, and outputs a result of the selection.
    Type: Grant
    Filed: September 11, 2019
    Date of Patent: December 6, 2022
    Assignee: FANUC CORPORATION
    Inventors: Keisuke Watanabe, Yasuhiro Shibasaki
  • Patent number: 11521106
    Abstract: This disclosure relates to learning with transformed data such as determining multiple training samples from multiple data samples. Each of the multiple data samples comprises one or more feature values and a label that classifies that data sample. A processor determines each of the multiple training samples by randomly selecting a subset of the multiple data samples, and combining the feature values of the data samples of the subset based on the label of each of the data samples of the subset. Since the training samples are combinations of randomly chosen data samples, the training samples can be provided to third parties without disclosing the actual training data. This is an advantage over existing methods in cases where the data is confidential and should therefore not be shared with a learner of a classifier, for example.
    Type: Grant
    Filed: October 23, 2015
    Date of Patent: December 6, 2022
    Assignee: National ICT Australia Limited
    Inventors: Richard Nock, Giorgio Patrini, Tiberio Caetano
  • Patent number: 11514465
    Abstract: Methods and apparatus to perform multi-level hierarchical demographic classification are disclosed.
    Type: Grant
    Filed: March 2, 2017
    Date of Patent: November 29, 2022
    Assignee: The Nielsen Company (US), LLC
    Inventors: Jiabo Li, Devin T. Jones, Kevin Charles Lyons
  • Patent number: 11507797
    Abstract: An information processing apparatus having an input device for receiving data, an operation unit for constituting a convolutional neural network for processing data, a storage area for storing data to be used by the operation unit and an output device for outputting a result of the processing. The convolutional neural network is provided with a first intermediate layer for performing a first processing including a first inner product operation and a second intermediate layer for performing a second processing including a second inner product operation, and is configured so that the bit width of first filter data for the first inner product operation and the bit width of second filter data for the second inner product operation are different from each other.
    Type: Grant
    Filed: January 26, 2018
    Date of Patent: November 22, 2022
    Assignee: Hitachi, Ltd.
    Inventors: Toru Motoya, Goichi Ono, Hidehiro Toyoda
  • Patent number: 11501197
    Abstract: Methods and systems for quantum computing based sample analysis include computing cross-correlations of two images using a quantum processing system, and computing less noisy image based of two or more images using a quantum processing system. Specifically, the disclosure includes methods and systems for utilizing a quantum computing system to compute and store cross correlation values for two sets of data, which was previously believed to be physically impossible. Additionally, the disclosure also includes methods and systems for utilizing a quantum computing system to generate less noisy data sets using a quantum expectation maximization maximum likelihood (EMML). Specifically, the disclosed systems and methods allow for the generation of less noisy data sets by utilizing the special traits of quantum computers, the systems and methods disclosed herein represent a drastic improvement in efficiency over current systems and methods that rely on traditional computing systems.
    Type: Grant
    Filed: August 15, 2019
    Date of Patent: November 15, 2022
    Assignee: FEI Company
    Inventors: Valentina Caprara Vivoli, Yuchen Deng, Erik Michiel Franken
  • Patent number: 11494667
    Abstract: Example aspects of the present disclosure are directed to systems and methods that enable improved adversarial training of machine-learned models. An adversarial training system can generate improved adversarial training examples by optimizing or otherwise tuning one or hyperparameters that guide the process of generating of the adversarial examples. The adversarial training system can determine, solicit, or otherwise obtain a realism score for an adversarial example generated by the system. The realism score can indicate whether the adversarial example appears realistic. The adversarial training system can adjust or otherwise tune the hyperparameters to produce improved adversarial examples (e.g., adversarial examples that are still high-quality and effective while also appearing more realistic). Through creation and use of such improved adversarial examples, a machine-learned model can be trained to be more robust against (e.g.
    Type: Grant
    Filed: January 18, 2018
    Date of Patent: November 8, 2022
    Assignee: GOOGLE LLC
    Inventors: Victor Carbune, Thomas Deselaers
  • Patent number: 11475269
    Abstract: Systems and methods of implementing a more efficient and less resource-intensive CNN are disclosed herein. In particular, applications of CNN in the analog domain using Sampled Analog Technology (SAT) methods are disclosed. Using a CNN design with SAT results in lower power usage and faster operation as compared to a CNN design with digital logic and memory. The lower power usage of a CNN design with SAT can allow for sensor devices that also detect features at very low power for isolated operation.
    Type: Grant
    Filed: December 14, 2016
    Date of Patent: October 18, 2022
    Assignee: Analog Devices, Inc.
    Inventors: Eric G. Nestler, Mitra M. Osqui, Jeffrey G. Bernstein
  • Patent number: 11475290
    Abstract: The present disclosure provides systems and methods that use machine learning to improve whole-structure relevance of hierarchical informational displays. In particular, the present disclosure provides systems and methods that employ a supervised, discriminative machine learning approach to jointly optimize the ranking of items and their display attributes. One example system includes a machine-learned display selection model that has been trained to jointly select a plurality of items and one or more attributes for each item for inclusion in an informational display. For example, the machine-learned display selection model can optimize a nested submodular objective function to jointly select the items and attributes.
    Type: Grant
    Filed: December 30, 2016
    Date of Patent: October 18, 2022
    Assignee: GOOGLE LLC
    Inventors: Jeffrey Jon Dalton, Karthik Raman, Tobias Schnabel, Evgeniy Gabrilovich
  • Patent number: 11443233
    Abstract: A classification apparatus includes: an encoding module that includes an element classification part that extracts a feature of input data and outputs classification information based on an element classification model stored in a first storage unit; an integration module that includes an element estimation part that receives the classification information and converts the classification information to a collation vector based on an element estimation model stored in a second storage unit; and a determination module that includes a determination part that determines a group to which the collation vector belongs by collating the collation vector with a representative vector of an individual group stored as a semantic model in a third storage unit and outputs a group ID of the group as a classification result.
    Type: Grant
    Filed: February 20, 2018
    Date of Patent: September 13, 2022
    Assignee: NEC CORPORATION
    Inventors: Kosuke Nishihara, Norihiko Taya
  • Patent number: 11443226
    Abstract: A computer-implemented method applies labels to unlabeled public data for use by a global model. One or more processors train one or more local machine learning models with local private data to create one or more trained models. Processor(s) generate a label for each of the local private data using the one or more trained models, where each label describes the local private data, and then apply the label to unlabeled public data to create labeled public data. One or more processors then input the labeled public data into a global model that uses the public data.
    Type: Grant
    Filed: May 17, 2017
    Date of Patent: September 13, 2022
    Assignee: International Business Machines Corporation
    Inventors: Stephen M. Chu, Min Gong, Guo Qiang Hu, Dong Sheng Li, Liang Wu, Jun Chi Yan
  • Patent number: 11442748
    Abstract: Systems and methods for ordering software applications in a computing environment. The methods involve: presenting user-selectable icons for launching a plurality of software applications in a graphical user interface in accordance with a first order; performing a machine-learning algorithm to determine a weighting value for each software application of the plurality of software applications based on information specifying at least one aspect of a software launch request and at least one aspect of a first user's current circumstance; determining a second order in which the user-selectable icons should be presented in the graphical user interface based on the weighting values determined for the software applications; and dynamically modifying the graphical user interface to present the user-selectable icons in the second order which is different from the first order.
    Type: Grant
    Filed: April 26, 2017
    Date of Patent: September 13, 2022
    Assignee: CITRIX SYSTEMS, INC.
    Inventors: Edward J. Swindell, Duncan Gabriel, Henry J. Ashman