Neural Network Patents (Class 706/15)
  • Patent number: 11836604
    Abstract: A method for programming an activation function is provided. The method includes generating segment data for segmenting the activation function; segmenting the activation function into a plurality of segments using the segment data; and approximating at least one segment of the plurality of segments as a programmable segment. An apparatus for performing the method may include a programmable activation function generator configured to generate segment data for segmenting an activation function; segment the activation function into a plurality of segments using the generated segment data; and approximate at least one segment of the plurality of segments as a programmable segment. By using segment data, various non-linear activation functions, particularly newly proposed or known activation functions with some modifications, can be programmed to be processable in hardware.
    Type: Grant
    Filed: May 23, 2022
    Date of Patent: December 5, 2023
    Assignee: DEEPX CO., LTD.
    Inventors: Lok Won Kim, Ho Seung Kim, Hyung Jin Chun
  • Patent number: 11836746
    Abstract: A diagnostic system for model governance is presented. The diagnostic system includes an auto-encoder to monitor model suitability for both supervised and unsupervised models. When applied to unsupervised models, the diagnostic system can provide a reliable indication on model degradation and recommendation on model rebuild. When applied to supervised models, the diagnostic system can determine the most appropriate model for the client based on a reconstruction error of a trained auto-encoder for each associated model. An auto-encoder can determine outliers among subpopulations of consumers, as well as support model go-live inspections.
    Type: Grant
    Filed: December 2, 2014
    Date of Patent: December 5, 2023
    Assignee: FAIR ISAAC CORPORATION
    Inventors: Jun Zhang, Scott Michael Zoldi
  • Patent number: 11829873
    Abstract: Disclosed herein is technology for performing predictive modeling to identify inputs for a manufacturing process. An example method may include receiving expected output data for a manufacturing process, wherein the expected output data defines an attribute of an output of the manufacturing process; accessing a plurality of machine learning models that model the manufacturing process; determining, using a first machine learning model, input data for the manufacturing process based on the expected output data for the manufacturing process, wherein the input data comprises a value for a first input and a value for a second input; combining the input data determined using the first machine learning model with input data determined using the second machine learning model to produce a set of inputs for the manufacturing process, wherein the set of inputs comprises candidate values for the first input and candidate values for the second input.
    Type: Grant
    Filed: May 21, 2020
    Date of Patent: November 28, 2023
    Assignee: Applied Materials, Inc.
    Inventors: Sidharth Bhatia, Dermot Cantwell, Serghei Malkov, Jie Feng
  • Patent number: 11829075
    Abstract: A processing apparatus includes a driver configured to drive a controlled object, and a controller configured to control the driver by generating a command value to the driver based on a control error. The controller includes a first compensator configured to generate a first command value based on the control error, a second compensator configured to generate a second command value based on the control error, and an adder configured to obtain the command value by adding the first command value and the second command value. The second compensator includes a neural network for which a parameter value is decided by learning, and input parameters input to the neural network include at least one of a driving condition of the driver and an environment condition in a periphery of the controlled object in addition to the control error.
    Type: Grant
    Filed: June 23, 2022
    Date of Patent: November 28, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Satoru Itoh
  • Patent number: 11823052
    Abstract: Certain aspects of the present disclosure are directed to methods and apparatus for configuring a multiply-accumulate (MAC) block in an artificial neural network. A method generally includes receiving, at a neural processing unit comprising one or more logic elements, at least one input associated with a use-case of the neural processing unit; obtaining a set of weights associated with the at least one input; selecting a precision for the set of weights; modifying the set of weights based on the selected precision; and generating an output based, at least in part, on the at least one input, the modified set of weights, and an activation function.
    Type: Grant
    Filed: October 11, 2019
    Date of Patent: November 21, 2023
    Assignee: QUALCOMM INCORPORATED
    Inventors: Giby Samson, Srivatsan Chellappa, Ramaprasath Vilangudipitchai, Seung Hyuk Kang
  • Patent number: 11822887
    Abstract: Systems and methods for natural language processing are described. One or more embodiments of the disclosure provide an entity matching apparatus trained using machine learning techniques to determine whether a query name corresponds to a candidate name based on a similarity score. In some examples, the query name and the candidate name are encoded using a character encoder to produce a regularized input sequence and a regularized candidate sequence, respectively. The regularized input sequence and the regularized candidate sequence are formed from a regularized character set having fewer characters than a natural language character set.
    Type: Grant
    Filed: March 12, 2021
    Date of Patent: November 21, 2023
    Assignee: ADOBE, INC.
    Inventors: Lidan Wang, Franck Dernoncourt
  • Patent number: 11823217
    Abstract: A segmentation system utilizes a supervised learning method and a clustering analysis to identify clusters, thereby segmenting a population into groups, where the clusters are associated with various conversion potentials that indicate the probability of an event. The segmentation system employs the supervised learning method to train a model on training data comprising historical conversion data and features associated with members of the group. A subset of features is selected from a ranked order that is determined using weights generated by the supervised learning. A clustering analysis is performed for a population with respect to the subset to generate clusters. A superior cluster is identified based on it having a conversion potential greater than a conversion potential of another cluster. In a marketing context, the system can be employed to identify a superior cluster of users that have a higher conversion potential in response to an advertisement campaign.
    Type: Grant
    Filed: November 1, 2019
    Date of Patent: November 21, 2023
    Assignee: Adobe Inc.
    Inventors: Rushil Mahajan, Kumar Mrityunjay Singh
  • Patent number: 11822049
    Abstract: [Object] To provide a lightning threat information-providing apparatus, a lightning threat information-providing method, and a program that are capable of providing a user with accurate information regarding a lightning threat.
    Type: Grant
    Filed: August 9, 2018
    Date of Patent: November 21, 2023
    Assignee: Japan Aerospace Exploration Agency
    Inventors: Eiichi Yoshikawa, Tomoo Ushio
  • Patent number: 11816045
    Abstract: A computer-implemented method includes receiving, by a computing device, input activations and determining, by a controller of the computing device, whether each of the input activations has either a zero value or a non-zero value. The method further includes storing, in a memory bank of the computing device, at least one of the input activations. Storing the at least one input activation includes generating an index comprising one or more memory address locations that have input activation values that are non-zero values. The method still further includes providing, by the controller and from the memory bank, at least one input activation onto a data bus that is accessible by one or more units of a computational array. The activations are provided, at least in part, from a memory address location associated with the index.
    Type: Grant
    Filed: August 24, 2021
    Date of Patent: November 14, 2023
    Assignee: Google LLC
    Inventors: Dong Hyuk Woo, Ravi Narayanaswami
  • Patent number: 11818147
    Abstract: Systems, methods and computer program products for improving security of artificial intelligence systems. The system comprising processors for monitoring one or more transactions received by a machine learning decision model to determine a first score associated with a first transaction. The first transaction may be identified as likely adversarial, in response to the first score being lower than a certain score threshold and the first transaction having a low occurrence likelihood. A second score may be generated in association with the first transaction based on one or more adversarial latent features associated with the first transaction. At least one adversarial latent feature may be detected as being exploited by the first transaction, in response to determining that the second score falls above the certain score threshold. Accordingly, an abnormal volume of activations of adversarial latent features spanning across a plurality of transactions scored may be detected and blocked.
    Type: Grant
    Filed: November 23, 2020
    Date of Patent: November 14, 2023
    Assignee: Fair Isaac Corporation
    Inventors: Scott Michael Zoldi, Shafi Ur Rahman
  • Patent number: 11809521
    Abstract: A method for modularizing high dimensional neural networks into neural networks of lower input dimensions. The method is suited to generating full-DOF robot grasping actions based on images of parts to be picked. In one example, a first network encodes grasp positional dimensions and a second network encodes rotational dimensions. The first network is trained to predict a position at which a grasp quality is maximized for any value of the grasp rotations. The second network is trained to identify the maximum grasp quality while searching only at the position from the first network. Thus, the two networks collectively identify an optimal grasp, while each network's searching space is reduced. Many grasp positions and rotations can be evaluated in a search quantity of the sum of the evaluated positions and rotations, rather than the product. Dimensions may be separated in any suitable fashion, including three neural networks in some applications.
    Type: Grant
    Filed: June 8, 2021
    Date of Patent: November 7, 2023
    Assignee: FANUC CORPORATION
    Inventor: Yongxiang Fan
  • Patent number: 11810174
    Abstract: Items within an index may be converted from classic geometry and embedded into a hyperbolic space. The hyperboloids within the hyperbolic space provide higher precision classifications of items within the index relative to their hierarchical structure. A received search query may also be converted to hyperbolic space and mapped as a query hyperboloid against an answer space that includes hyperboloids for items within the index. Distances or overlaps between the hyperboloids may be determined in order to generate a set of search results.
    Type: Grant
    Filed: March 31, 2021
    Date of Patent: November 7, 2023
    Assignee: Amazon Technologies, Inc.
    Inventors: Sumeet Katariya, Nikhil S. Rao, Chandan K. Reddy, Karthik Subbian, Nurendra Choudhary
  • Patent number: 11803738
    Abstract: Hardware for implementing a Deep Neural Network (DNN) having a convolution layer, the hardware comprising a plurality of convolution engines each configured to perform convolution operations by applying filters to data windows, each filter comprising a set of weights for combination with respective data values of a data window; and one or more weight buffers accessible to each of the plurality of convolution engines over an interconnect, each weight buffer being configured to provide weights of one or more filters to any of the plurality of convolution engines; wherein each of the convolution engines comprises control logic configured to request weights of a filter from the weight buffers using an identifier of that filter.
    Type: Grant
    Filed: October 26, 2021
    Date of Patent: October 31, 2023
    Assignee: Imagination Technologies Limited
    Inventor: Christopher Martin
  • Patent number: 11798675
    Abstract: Methods, systems, apparatus, including computer programs encoded on computer storage media for generating psychiatric treatment recommendations. In one aspect, the method includes actions of receiving, by a server and from a first user device, one or more data structures that collectively include fields structuring data that represents (i) current patient symptoms and (ii) current patient diagnoses, generating, by the server, rendering data structure that includes fields structuring data that represents rendering data that, when rendered on a display device, presents a patient dashboard based on the data that is received from the mobile device, and providing, by the server, the rendering data structure to a second user device that is different than the first user device, wherein the second user device is configured to render the rendering data structured by the fields of the rendering data structure to output the patient dashboard on the display of the second user device.
    Type: Grant
    Filed: May 29, 2019
    Date of Patent: October 24, 2023
    Assignee: OTSUKA AMERICA PHARMACEUTICAL, INC.
    Inventors: Roland Larkin, Srikanth Gottipati, Reza Moghadam, Carolyn Tyler, Gregory Ho
  • Patent number: 11794759
    Abstract: The present technology is effective to cause at least one processor to instruct an autonomous vehicle to navigate a specific course and to record diagnostic measurements while navigating the specific course, receive the diagnostic measurements from the autonomous vehicle, and analyze the diagnostic measurements from the autonomous vehicle in a context provided by a collection of diagnostic measurement data collected from a fleet of similar autonomous vehicles navigating the specific course.
    Type: Grant
    Filed: March 26, 2020
    Date of Patent: October 24, 2023
    Assignee: GM Cruise Holdings LLC
    Inventors: Erik Nielsen, Chase Kaufman
  • Patent number: 11790212
    Abstract: Quantization-aware neural architecture search (“QNAS”) can be utilized to learn optimal hyperparameters for configuring an artificial neural network (“ANN”) that quantizes activation values and/or weights. The hyperparameters can include model topology parameters, quantization parameters, and hardware architecture parameters. Model topology parameters specify the structure and connectivity of an ANN. Quantization parameters can define a quantization configuration for an ANN such as, for example, a bit width for a mantissa for storing activation values or weights generated by the layers of an ANN. The activation values and weights can be represented using a quantized-precision floating-point format, such as a block floating-point format (“BFP”) having a mantissa that has fewer bits than a mantissa in a normal-precision floating-point representation and a shared exponent.
    Type: Grant
    Filed: March 18, 2019
    Date of Patent: October 17, 2023
    Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
    Inventors: Kalin Ovtcharov, Eric S. Chung, Vahideh Akhlaghi, Ritchie Zhao
  • Patent number: 11790135
    Abstract: A computer-implemented method for providing a simulation model of an electric rotating machine is disclosed. The simulation model is defined by parameter values. Input data is obtained. The input data is collectable using the electric rotating machine when the electric rotating machine is not connected to an operating voltage and being characteristic of the electric rotating machine. The parameter values are determined from the input data using a trained function and the parameter values determined are provided.
    Type: Grant
    Filed: April 21, 2021
    Date of Patent: October 17, 2023
    Assignee: Siemens Aktiengesellschaft
    Inventor: Christian Deeg
  • Patent number: 11783037
    Abstract: Disclosed are a defense method and a model of deep learning model aiming at adversarial attacks in the technical field of image recognition, which makes full use of the internal relationship between the adversarial samples and the initial samples, and transforms the adversarial samples into common samples by constructing a filter layer in front of the input layer of the deep learning model; the parameters of the filter layer are trained by using the adversarial attack samples, so as to improve the ability of the model to resist adversarial attack; then the trained filter layer is combined with the learning model after the adversarial training, and a deep learning model with strong robustness and high classification accuracy is obtained, which ensures that the recognition ability of the initial sample is not reduced while resisting the adversarial attacks.
    Type: Grant
    Filed: May 15, 2023
    Date of Patent: October 10, 2023
    Assignee: Quanzhou Equipment Manufacturing Research Institute
    Inventors: Jielong Guo, Xian Wei, Xuan Tang, Hui Yu, Dongheng Shao, Jianfeng Zhang, Jie Li, Yanhui Huang
  • Patent number: 11776292
    Abstract: An object identification method includes: generating a tracking sample and an adversarial sample; training a teacher model according to the tracking sample; and initializing a student model according to the teacher model. The student model adjusts a plurality of parameters according to the teacher model and the adversarial sample, in response to the vector difference between the output result of the student model and the output result of the teacher model being lower than the learning threshold, the student model is deemed to have completed training, and the student model is extracted as an object identification model.
    Type: Grant
    Filed: March 15, 2021
    Date of Patent: October 3, 2023
    Assignee: WISTRON CORP
    Inventor: Kuo-Lun Huang
  • Patent number: 11775655
    Abstract: An artificial intelligence (AI) platform to support optimization of container builds and virtual machine mounts in a distributed computing environment. A provisioning file is subject to natural language processing (NLP) and a corresponding vector representation of the file is created and subject to evaluation by a set of artificial neural networks (ANN). A first ANN assesses the representation of the file with respect to compliance and operability, and the second ANN selectively assesses the representation of the file with respect to provisioning efficiency. The provisioning file is selectively process based on the provisioning efficiency, with the processing directed at provisioning a container build or mounting a VM.
    Type: Grant
    Filed: May 11, 2021
    Date of Patent: October 3, 2023
    Assignee: International Business Machines Corporation
    Inventors: Abhishek Malvankar, John M. Ganci, Jr., Carlos A. Fonseca, Charles E. Beller
  • Patent number: 11775801
    Abstract: A neural processor. In some embodiments, the processor includes a first tile, a second tile, a memory, and a bus. The bus may be connected to the memory, the first tile, and the second tile. The first tile may include: a first weight register, a second weight register, an activations buffer, a first multiplier, and a second multiplier. The activations buffer may be configured to include: a first queue connected to the first multiplier and a second queue connected to the second multiplier. The first queue may include a first register and a second register adjacent to the first register, the first register being an output register of the first queue. The first tile may be configured: in a first state: to multiply, in the first multiplier, a first weight by an activation from the output register of the first queue, and in a second state: to multiply, in the first multiplier, the first weight by an activation from the second register of the first queue.
    Type: Grant
    Filed: August 27, 2019
    Date of Patent: October 3, 2023
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Ilia Ovsiannikov, Ali Shafiee Ardestani, Joseph H. Hassoun, Lei Wang, Sehwan Lee, JoonHo Song, Jun-Woo Jang, Yibing Michelle Wang, Yuecheng Li
  • Patent number: 11769036
    Abstract: An apparatus for optimizing a computational network is configure to receive an input at a first processing component. The first processing component may include at least a first programmable processing component and a second programmable processing component. The first programmable processing component is configured to compute a first nonlinear function and the second programmable processing component is configured to compute a second nonlinear function which is different than the second nonlinear function. The computational network which may be a recurrent neural network such as a long short-term memory may be operated to generate an inference based at least in part on outputs of the first programmable processing component and the second programmable processing component.
    Type: Grant
    Filed: April 18, 2018
    Date of Patent: September 26, 2023
    Assignee: QUALCOMM Incorporated
    Inventors: Rosario Cammarota, Michael Goldfarb, Manu Rastogi, Sarang Ozarde
  • Patent number: 11769059
    Abstract: Systems and methods for distributed training of deep learning models are disclosed. An example local device to train deep learning models includes a reference generator to label input data received at the local device to generate training data, a trainer to train a local deep learning model and to transmit the local deep learning model to a server that is to receive a plurality of local deep learning models from a plurality of local devices, the server to determine a set of weights for a global deep learning model, and an updater to update the local deep learning model based on the set of weights received from the server.
    Type: Grant
    Filed: December 21, 2022
    Date of Patent: September 26, 2023
    Assignee: Movidius Limited
    Inventor: David Moloney
  • Patent number: 11769576
    Abstract: Embodiments of a method and system for improving care determination for care providers in relation to a condition of a user associated with a mobile device can include: collecting a log of use dataset associated with user digital communication behavior at the mobile device; collecting a mobility supplementary dataset corresponding to a mobility-related sensor of the mobile device; determining a medical status analysis for a condition of the user based on at least one of the log of use dataset and the mobility supplementary dataset, the medical status analysis including at least one of a diagnosis and a therapeutic intervention associated with the condition; and promoting the at least one of the diagnosis and the therapeutic intervention to a care provider.
    Type: Grant
    Filed: March 24, 2020
    Date of Patent: September 26, 2023
    Assignee: OrangeDot, Inc.
    Inventors: Sai Moturu, Anmol Madan
  • Patent number: 11763133
    Abstract: Systems and methods relating to machine learning. An edge device runs a new data point on a first neural network and determines activations on the layers within that neural network. The first neural network is a fully trained network based on a second neural network on a server. The activation data for the various layers in the first neural network are, starting with the output layer, sequentially transmitted to the server. The server continuously receives this activation data and continuously compares it with previously encountered activation data for the second neural network. If the received activation data is within an expected range, then the edge device is instructed to stop sending activation data. Otherwise, the server continues to receive the activation data for the other layers until the new data point is received by the server or the activation data is within the expected range of previously encountered activation data.
    Type: Grant
    Filed: August 30, 2019
    Date of Patent: September 19, 2023
    Assignee: SERVICENOW CANADA INC.
    Inventor: Philippe Beaudoin
  • Patent number: 11763142
    Abstract: Methods and systems, including computer programs encoded on a computer storage medium. In one aspect, a method includes the actions of receiving a request to perform convolutional computations for a neural network on a hardware circuit having a matrix computation unit, the request specifying the convolutional computation to be performed on a feature tensor and a filter and padding applied to the feature tensor prior to performing the convolutional computation; and generating instructions that when executed by the hardware circuit cause the hardware circuit to perform operations comprising: transferring feature tensor data from a main memory of the hardware circuit to a scratchpad memory of the hardware circuit; and repeatedly performing the following operations: identifying a current subset of the feature tensor; and determining whether a memory view into the scratchpad memory for the current subset is consistent with a memory view of the current subset in the main memory.
    Type: Grant
    Filed: September 2, 2022
    Date of Patent: September 19, 2023
    Assignee: Google LLC
    Inventors: David Alexander Majnemer, Blake Alan Hechtman, Bjarke Hammersholt Roune
  • Patent number: 11763155
    Abstract: A system comprising an electronic device that includes a processor is described. During operation, the processor acquires a full version of a neural network, the neural network including internal elements for processing instances of input image data having a set of color channels. The processor then generates, from the neural network, a set of sub-networks, each sub-network being a separate copy of the neural network with the internal elements for processing at least one of the color channels in instances of input image data removed, so that each sub-network is configured for processing a different set of one or more color channels in instances of input image data. The processor next provides the sub-networks for processing instances of input image data—and may itself use the sub-networks for processing instances of input image data.
    Type: Grant
    Filed: August 12, 2019
    Date of Patent: September 19, 2023
    Assignee: Advanced Micro Devices, Inc.
    Inventors: Sudhanva Gurumurthi, Abhinav Vishnu
  • Patent number: 11763545
    Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for efficiently, quickly, and flexibly generating and providing pixel-wise classification predictions utilizing early exit heads of a multi-exit pixel-level prediction neural network. For example, the disclosed systems utilize a multi-exit pixel-level prediction neural network to generate classification predictions for a digital image on the pixel level. The multi-exit pixel-level prediction neural network includes a specialized architecture with early exit heads having unique encoder-decoder architectures for generating pixel-wise classification predictions at different early exit stages. In some embodiments, the disclosed systems implement a spatial confidence-adaptive scheme to mask certain predicted pixels to prevent further processing of the masked pixels and thereby reduce computation.
    Type: Grant
    Filed: March 26, 2021
    Date of Patent: September 19, 2023
    Assignee: Adobe Inc.
    Inventors: Evan Shelhamer, Zhuang Liu
  • Patent number: 11757491
    Abstract: In accordance with a first aspect, a communication device is provided, comprising: a transmitter configured to transmit one or more radio frequency signal pulses to an external communication device; a receiver configured to receive one or more response signals in response to the radio frequency signal pulses transmitted by the transmitter; a signal analyzer configured to detect one or more characteristics of the response signals, to compare the detected characteristics with predefined reference characteristics and to generate an output indicative of a result of comparing the detected characteristics with the predefined reference characteristics; a processing unit configured to determine at least one category to which the external communication device belongs based on the output generated by the signal analyzer. In accordance with a second aspect, a corresponding method of operating a communication device is conceived. In accordance with a third aspect, a corresponding computer program is provided.
    Type: Grant
    Filed: January 6, 2022
    Date of Patent: September 12, 2023
    Assignee: NXP B.V.
    Inventors: Markus Wobak, Johannes Stahl, Ulrich Andreas Muehlmann
  • Patent number: 11755884
    Abstract: A system having multiple devices that can host different versions of an artificial neural network (ANN). In the system, changes to local versions of the ANN can be combined with a master version of the ANN. In the system, a first device can include memory that can store the master version, a second device can include memory that can store a local version of the ANN, and there can be many devices that store local versions of the ANN. The second device (or any other device of the system hosting a local version) can include a processor that can train the local version, and a transceiver that can transmit changes to the local version generated from the training. The first device can include a transceiver that can receive the changes to a local version, and a processing device that can combine the received changes with the master version.
    Type: Grant
    Filed: August 20, 2019
    Date of Patent: September 12, 2023
    Assignee: Micron Technology, Inc.
    Inventors: Sean Stephen Eilert, Shivasankar Gunasekaran, Ameen D. Akel, Kenneth Marion Curewitz, Hongyu Wang
  • Patent number: 11748292
    Abstract: Various embodiments disclosed herein provides method and system for low latency FPGA based system for inference such as recommendation models. Conventional models for inference have high latency and low throughput in decision making models/processes. The disclosed method and system exploits parallelism in processing of XGB models and hence enables minimum possible latency and maximum possible throughput. Additionally, the disclosed system uses a trained model that is (re)trained using only those features which the model had used during training, remaining features are discarded during retraining of the model. The use of such selected set of features thus leads to reduction in the size of digital circuit significantly for the hardware implementation, thereby greatly enhancing the system performance.
    Type: Grant
    Filed: October 1, 2021
    Date of Patent: September 5, 2023
    Assignee: TATA CONSULTANCY SERVICES LIMITED
    Inventors: Piyush Manavar, Manoj Nambiar
  • Patent number: 11741348
    Abstract: Provided are a neural network circuit device, a neural network, a neural network processing method, and a neural network execution program, each of which does not require a bias. A binarized neural network circuit includes: an input part configured to allow input of an input node which allows input of input values x1-xn (xi) (binary), and input of weights w1-wn (wi) (binary); an XNOR gate circuit configured to receive the input values x1-xn and the weights w1-wn and to take XNOR logic; a sum circuit configured to sum XNOR logical values; a batch normalization circuit configured to correct a variance due to binarization, by extending a range of normalization and shifting a center thereof; and an activating function circuit configured to convert a signal B obtained by batch-normalizing a signal Y generated by taking the sum, by means of an activating function f sgn(B).
    Type: Grant
    Filed: September 18, 2018
    Date of Patent: August 29, 2023
    Assignee: Tokyo Institute of Technology
    Inventor: Hiroki Nakahara
  • Patent number: 11741352
    Abstract: A resistive processing unit (RPU) that includes a pair of transistors connected in series providing an update function for a weight of a training methodology to the RPU, and a read transistor for reading the weight of the training methodology. In some embodiments, the resistive processing unit (RPU) further includes a capacitor connecting a gate of the read transistor to the air of transistors providing the update function for the resistive processing unit (RPU). The capacitor stores said weight of training methodology for the RPU.
    Type: Grant
    Filed: August 22, 2016
    Date of Patent: August 29, 2023
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Tayfun Gokmen, Seyoung Kim, Dennis M. Newns, Yurii A. Vlasov
  • Patent number: 11734554
    Abstract: This application discloses a pooling processing method, applied to a pooling processing system of a convolutional neural network.
    Type: Grant
    Filed: October 19, 2022
    Date of Patent: August 22, 2023
    Assignee: Tencent Technology (Shenzhen) Company Limited
    Inventors: Xiaoyu Yu, Yuwei Wang, Bo Zhang, Lixin Zhang
  • Patent number: 11734706
    Abstract: Systems and methods are described for providing user offers based on efficient iterative recommendation structures. In various aspects, a server invokes a bi-directional look-up interface via a lookup request, where the bi-directional look-up interface is exposed via an electronic recommendation structure. The lookup request causes the bi-directional look-up interface to return a bi-directional recommendation value. The bi-directional recommendation value indicates a likelihood of a first user selecting a first offer or a second offer. The bi-directional recommendation value is transmitted via a computer network to a client device associated with the first user upon a determination that the likelihood meets or exceeds a recommendation threshold. The client device is operative to display at least one of the first offer or the second offer.
    Type: Grant
    Filed: August 25, 2021
    Date of Patent: August 22, 2023
    Assignee: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
    Inventors: Taylor Griffin Smith, Jason Matthew White, Joseph David Albright, Tim G. Sanidas
  • Patent number: 11727277
    Abstract: A method for automatically generating an artificial neural network that encompasses modules and connections that link those modules, successive modules and/or connections being added to a current starting network. Modules and/or connections that are to be added are selected randomly from a predefinable plurality of possible modules and connections that can be added. A plurality of possible refinements of the current starting network respectively are generated by adding to the starting network modules and/or connections that are to be added. One of the refinements from the plurality of possible refinements is then selected in order to serve as a current starting network in a subsequent execution of the method.
    Type: Grant
    Filed: October 24, 2018
    Date of Patent: August 15, 2023
    Assignee: ROBERT BOSCH GMBH
    Inventors: Frank Hutter, Jan Hendrik Metzen, Thomas Elsken
  • Patent number: 11727256
    Abstract: A hardware accelerator that is efficient at performing computations related to a neural network. In one embodiment, the hardware accelerator includes a first data buffer that receives input data of a layer in the neural network and shift the input data slice by slice downstream. The hardware accelerator includes a second data buffer that receives kernel data of the layer in the neural network and shift the kernel data slice by slice downstream. The hardware accelerator includes a first input shift register that receives an input data slice from the first data buffer. The first input shift register may correspond to a two-dimensional shift register configured to shift values in the input data slice in x and y directions. The hardware accelerator includes a second input shift register that receives a kernel data slice from the second data buffer. A multiplication block performs convolution of the input and kernel data.
    Type: Grant
    Filed: August 27, 2021
    Date of Patent: August 15, 2023
    Assignee: AIP SEMI, INC.
    Inventors: Henry Verheyen, Jianjun Wen
  • Patent number: 11709121
    Abstract: A particle measurement system and method of operation thereof are described. The system and method render a characteristic for a set of particles measured while passing through a measurement volume. The system includes a source that generates a particle-laden field containing the set of particles. The system further includes a sensor that generates a raw particle data corresponding to the set particles passing through the measurement volume of the particle measurement system, where the raw particle data comprises a set of raw particle records and each of one of the raw particle records includes a particle data content. A preconditioning stage carries out a preconditioning operation on the particle data content of the set of raw particle records to render a conditioned input data. A machine learning stage processes the conditioned input data to render an output characteristic parameter value for the set of particles.
    Type: Grant
    Filed: November 17, 2020
    Date of Patent: July 25, 2023
    Assignee: Spraying Systems Co.
    Inventors: Chad Sipperley, Rudolf J. Schick
  • Patent number: 11710216
    Abstract: The subject disclosure relates to solutions for reducing or eliminating motion sickness experienced by a vehicle occupant/passenger. In some aspects, a process of the disclosed technology includes steps for collecting motion data associated with a vehicle using one or more environmental sensors, tracking eye movements of a user within a cabin of the vehicle, processing the motion data and the eye movements to identify a motion event, and generating a motion compensation signal based on the motion event. Systems and machine-readable media are also provided.
    Type: Grant
    Filed: July 14, 2020
    Date of Patent: July 25, 2023
    Assignee: GM Cruise Holdings LLC
    Inventors: Nestor Grace, Diego Plascencia-Vega, Dogan Gidon
  • Patent number: 11699077
    Abstract: Provided is multi-layer neural network technique that includes: calculating, from an input and using a first one or more layers of a plurality of layers of a neural network, a first intermediate output; reducing a size of one or more dimensions of the first intermediate output; calculating, from the first intermediate output and using a second one or more layers of the neural network, a second intermediate output (the second one or more layers including one or more ultra-low precision layers); reducing a size of one or more dimensions of the second intermediate output; combining a plurality of reduced intermediate outputs (including the reduced first intermediate output and the reduced second intermediate output) to derive a combined intermediate output; and calculating, using the combined intermediate output and one or more higher-precision layers of the plurality of layers, a neural network output.
    Type: Grant
    Filed: June 21, 2021
    Date of Patent: July 11, 2023
    Assignee: Plumerai Limited
    Inventors: Koen Giliam Helwegen, Thomas Reint Bannink, Timon David De Bruin, Lukas Sebastian Geiger, Adam Connor Slavin Hillier, Jelmer Lucas Arnoldus Neeven, Leendert Pieter Overweel
  • Patent number: 11693373
    Abstract: Systems and methods for learning based control in accordance with embodiments of the invention are illustrated. One embodiment includes a method for training an adaptive controller. The method includes steps for receiving a set of training data that includes several training samples, wherein each training sample includes a state and a true uncertain effect value. The method includes steps for computing an uncertain effect value based on the state, computing a set of one or more losses based on the true uncertain effect value and the computed uncertain effect value, and updating the adaptive controller based on the computed set of losses.
    Type: Grant
    Filed: December 10, 2019
    Date of Patent: July 4, 2023
    Assignee: California Institute of Technology
    Inventors: Guanya Shi, Xichen Shi, Michael O'Connell, Animashree Anandkumar, Yisong Yue, Soon-Jo Chung
  • Patent number: 11695758
    Abstract: A method for a multi-factor authentication, the method receives results of an initial authentication of a user. Responsive to confirming the initial authentication, an image of a secondary set of authentication options is presented. An option selection is received from the user, wherein the selection is determined by tracking eye movement of the user over the image that includes the set of second factor authentication options. User facial activity is tracked corresponding to the selection made from the secondary set of authentication options. The monitored facial activity is compared to a pre-established authentication condition to determine whether a match exists with the selected secondary set of authentication options, and responsive to facial activity monitored matching the authentication condition pre-established by the user and corresponding to the selection made from the secondary set of authentication options, authentication of the user is confirmed.
    Type: Grant
    Filed: February 24, 2020
    Date of Patent: July 4, 2023
    Assignee: International Business Machines Corporation
    Inventors: Doga Tav, Ron Williams, Hyman David Chantz
  • Patent number: 11687761
    Abstract: Systems and methods for performing improper input data detection are described. In one example, a system comprises: hardware circuits configured to receive input data and to perform computations of a neural network based on the input data to generate computation outputs; and an improper input detection circuit configured to: determine a relationship between the computation outputs of the hardware circuits and reference outputs; determine that the input data are improper based on the relationship; and perform an action based on determining that the input data are improper.
    Type: Grant
    Filed: December 11, 2018
    Date of Patent: June 27, 2023
    Assignee: Amazon Technologies, Inc.
    Inventors: Randy Renfu Huang, Richard John Heaton, Andrea Olgiati, Ron Diamant
  • Patent number: 11676295
    Abstract: Disclosed herein are methods and system for training artificial intelligence models configured to execute image segmentation techniques. The methods and system describe a server that receives a first image including a set of pixels depicting multiple objects. The server also receives a second image having a second set of pixels depicting the same set of objects. The server then analyzes the pixels from the first and second images. When a difference between at least one visual attribute of a pixel within the second image and a corresponding pixel within the first image satisfies a predetermined threshold, it will be encoded as spikes to send to the model, the model will be trained using supervised STDP rule by revising weights associated with the nodes within the AI model where the node corresponds to the pixels within the first and/or the second image.
    Type: Grant
    Filed: March 16, 2022
    Date of Patent: June 13, 2023
    Assignee: VARIAN MEDICAL SYSTEMS, INC.
    Inventor: Wenlong Yang
  • Patent number: 11669725
    Abstract: Using a buffer sized according to the size of the filters of a convolutional neural network (CNN), a processor may use a read pointer to generate a two-dimensional virtual matrix of inputs. The number of inputs in each row in the two-dimensional virtual matrix of inputs may match the one-dimensional filter size of the cubic filters. The processor may collapse each of the cubic filters to one-dimensional linear arrays and generate a two-dimensional filter matrix from the one-dimensional linear arrays. The convolution computations for a corresponding layer of the CNN therefore reduce to a single matrix multiplication without any memory movement operations. When the buffer is refreshed using a new input frame, the processor may increment the initial read address of each read pointer by one and increment the final read address by one, circling back to the corresponding initial read address.
    Type: Grant
    Filed: June 6, 2019
    Date of Patent: June 6, 2023
    Assignee: Cadence Design Systems, Inc.
    Inventors: Ananda Sarangaram Tharma Ranga Raja, Prasad Nikam, N D Divyakumar, Himanshu Singhal, Vijay Pawar, Sachin P. Ghanekar
  • Patent number: 11671317
    Abstract: A computer-implemented method for placement of a plurality of application objects of an application within a network architecture is disclosed. The method includes generating during runtime of the application, an application topology model for the application, based on application metrics for the plurality of application objects. A resource topology model of a plurality of network nodes within the network architecture is generated based on resource metrics for the network nodes. A recommendation is generated for migrating an application object of the plurality of application objects to a network node of the plurality of network nodes using the application topology model and the resource topology model, the recommendation identifying the application object and the network node. The application object is migrated to the network node identified by the recommendation.
    Type: Grant
    Filed: April 24, 2020
    Date of Patent: June 6, 2023
    Assignee: Huawei Cloud Computing Technologies Co., Ltd.
    Inventors: Donghui Zhuo, Quinton Hoole, Isaac Ackerman, Sungwook Moon, Haibin Xie, Olesya Melnichenko
  • Patent number: 11663480
    Abstract: An autonomic function executing in an artificial intelligence environment determines that a fused model responsive to a new problem space has below a threshold level of accuracy in the new problem space. A spliced layer in the fused model is autonomically cloned, the spliced layer having been extracted from a second model and inserted at a location in the fused model. The cloned layer is autonomically inserted at a second location in the fused model. An automatically constructed vector transformation transforms an output vector of a previous layer in an immediately previous location in the model relative to the second location. The cloned layer is automatically fused in the fused model using the transformed output vector as input to the cloned layer, forming a deep fused model that has a revised accuracy that is higher than the accuracy relative to an ontology of the new problem space.
    Type: Grant
    Filed: November 15, 2019
    Date of Patent: May 30, 2023
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Aaron K. Baughman, Michael Behrendt, Shikhar Kwatra, Craig M. Trim
  • Patent number: 11662696
    Abstract: Disclosed herein is an automatic control artificial intelligence device including a collection unit configured to acquire an output value according to control of a control system; and an artificial intelligence unit operably coupled to the collection unit and configured to: communicate with the collection unit; set at least one of one or more base lines and a reward based on a gap between the one or more base lines and the output value, according to a plurality of operation goals of the control system; and update a control function for providing a control value to the control system by performing reinforcement learning based on the gap between the one or more base lines and the output value.
    Type: Grant
    Filed: June 27, 2019
    Date of Patent: May 30, 2023
    Assignee: LG ELECTRONICS INC.
    Inventor: Bongsang Kim
  • Patent number: 11657264
    Abstract: Media content is received for streaming to a user device. A neural network is trained based on a first portion of the media content. Weights of the neural network are updated to overfit the first portion of the media content to provide a first overfitted neural network. The neural network or the first overfitted neural network is trained based on a second portion of the media content. Weights of the neural network or the first overfitted neural network are updated to overfit the second portion of the media content to provide a second overfitted neural network. The first portion and the second portion of the media content are sent with associations to the first overfitted neural network and the second overfitted to the user equipment.
    Type: Grant
    Filed: April 9, 2018
    Date of Patent: May 23, 2023
    Assignee: Nokia Technologies Oy
    Inventors: Francesco Cricri, Caglar Aytekin, Emre Baris Aksu, Miika Sakari Tupala, Xingyang Ni
  • Patent number: 11653843
    Abstract: An electronic device includes a sensor configured to acquire a subject's pulse wave, a blood pressure measurement portion configured to measure the subject's blood pressure level, and a controller configured to estimate a state of glucose metabolism or lipid metabolism of the subject on the basis of an index based on the subject's pulse wave acquired by the sensor and the subject's blood pressure level measured by the blood pressure measurement portion.
    Type: Grant
    Filed: June 13, 2017
    Date of Patent: May 23, 2023
    Assignee: KYOCERA Corporation
    Inventor: Hiromi Ajima