Search Patents
  • Patent number: 10713754
    Abstract: Remote distribution of multiple neural network models to various client devices over a network can be implemented by identifying a native neural network and remotely converting the native neural network to a target neural network based on a given client device operating environment. The native neural network can be configured for execution using efficient parameters, and the target neural network can use less efficient but more precise parameters.
    Type: Grant
    Filed: February 28, 2018
    Date of Patent: July 14, 2020
    Assignee: Snap Inc.
    Inventors: Guohui Wang, Sumant Milind Hanumante, Ning Xu, Yuncheng Li
  • Patent number: 11315219
    Abstract: Remote distribution of multiple neural network models to various client devices over a network can be implemented by identifying a native neural network and remotely converting the native neural network to a target neural network based on a given client device operating environment. The native neural network can be configured for execution using efficient parameters, and the target neural network can use less efficient but more precise parameters.
    Type: Grant
    Filed: May 29, 2020
    Date of Patent: April 26, 2022
    Assignee: Snap Inc.
    Inventors: Guohui Wang, Sumant Milind Hanumante, Ning Xu, Yuncheng Li
  • Patent number: 11847760
    Abstract: Remote distribution of multiple neural network models to various client devices over a network can be implemented by identifying a native neural network and remotely converting the native neural network to a target neural network based on a given client device operating environment. The native neural network can be configured for execution using efficient parameters, and the target neural network can use less efficient but more precise parameters.
    Type: Grant
    Filed: April 6, 2022
    Date of Patent: December 19, 2023
    Assignee: Snap Inc.
    Inventors: Guohui Wang, Sumant Milind Hanumante, Ning Xu, Yuncheng Li
  • Patent number: 10832123
    Abstract: The present invention relates to artificial neural networks, for example, deep neural networks. In particular, the present invention relates to a compression method for deep neural networks with proper use of mask and the device thereof. More specifically, the present invention relates to how to compress dense neural networks into sparse neural networks while maintaining or even improving the accuracy of the neural networks after compression.
    Type: Grant
    Filed: December 26, 2016
    Date of Patent: November 10, 2020
    Assignee: XILINX TECHNOLOGY BEIJING LIMITED
    Inventors: Shijie Sun, Song Han, Xin Li, Yi Shan
  • Patent number: 10452976
    Abstract: A neural network recognition method includes obtaining a first neural network that includes layers and a second neural network that includes a layer connected to the first neural network, actuating a processor to compute a first feature map from input data based on a layer of the first neural network, compute a second feature map from the input data based on the layer connected to the first neural network in the second neural network, and generate a recognition result based on the first neural network from an intermediate feature map computed by applying an element-wise operation to the first feature map and the second feature map.
    Type: Grant
    Filed: March 20, 2017
    Date of Patent: October 22, 2019
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Byungin Yoo, Youngsung Kim, Youngjun Kwak, Chang Kyu Choi
  • Patent number: 11593614
    Abstract: A neural network system is configured to receive an input image and to generate a classification output for the input image. The neural network system includes: a separable convolution subnetwork comprising a plurality of separable convolutional neural network layers arranged in a stack one after the other, in which each separable convolutional neural network layer is configured to: separately apply both a depthwise convolution and a pointwise convolution during processing of an input to the separable convolutional neural network layer to generate a layer output.
    Type: Grant
    Filed: October 6, 2017
    Date of Patent: February 28, 2023
    Assignee: Google LLC
    Inventors: Francois Chollet, Andrew Gerald Howard
  • Patent number: 5742702
    Abstract: A neural network is used to recognize characters from a character set. Based upon the character recognized, a smaller neural network is used for verification of the character recognized. The smaller neural network is trained to recognize only a single character of the set and provides a "yes" or "no" type verification of correct identification of the character.
    Type: Grant
    Filed: August 9, 1996
    Date of Patent: April 21, 1998
    Assignees: Sony Corporation, Sony Electronics Inc.
    Inventor: Toru Oki
  • Patent number: 5617490
    Abstract: A camera system has a neural network for calibration of image distortion. The neural network learns the conversion from image coordinates with distortion to image coordinates with substantially reduced distortion, whereby the neural network provides image coordinates having substantially reduced distortion. In a learning process of the neural network, a relatively simple camera model is used to provide an instruction signal to the neural network according to sample data provided from the real camera.
    Type: Grant
    Filed: June 27, 1994
    Date of Patent: April 1, 1997
    Assignee: Sanyo Electric Co., Ltd.
    Inventors: Masao Kume, Takeo Kanade
  • Patent number: 5467427
    Abstract: Hopfield and BAM neural network training or learning rules allowing memorization of a greater number of patterns. Successive over-relaxation is used in the learning rules based on the training patterns and the output vectors. Neural networks trained in this manner can better serve as the neural networks in a variety of pattern recognition and element correlation systems.
    Type: Grant
    Filed: June 6, 1994
    Date of Patent: November 14, 1995
    Assignee: Iowa State University Research Foundation
    Inventors: Suraj C. Kothari, Heekuck Oh
  • Patent number: 5495542
    Abstract: Use is made of a neural network in order to restore a binary image to an original multi-level image, by way of example. Using the neural network makes it possible to raise the accuracy of restoration and the speed of processing.
    Type: Grant
    Filed: September 7, 1994
    Date of Patent: February 27, 1996
    Assignee: Canon Kabushiki Kaisha
    Inventors: Yukari Shimomura, Susumu Sugiura, Takeshi Kobayashi
  • Patent number: 9454714
    Abstract: Systems and methods for sequence transcription with neural networks are provided. More particularly, a neural network can be implemented to map a plurality of training images received by the neural network into a probabilistic model of sequences comprising P(S|X) by maximizing log P(S|X) on the plurality of training images. X represents an input image and S represents an output sequence of characters for the input image. The trained neural network can process a received image containing characters associated with building numbers. The trained neural network can generate a predicted sequence of characters by processing the received image.
    Type: Grant
    Filed: December 31, 2014
    Date of Patent: September 27, 2016
    Assignee: Google Inc.
    Inventors: Julian Ibarz, Yaroslav Bulatov, Ian Goodfellow
  • Publication number: 20100211537
    Abstract: Efficiently simulating an Amari dynamics of a neural field (a), the Amari dynamics being specified by the equation (1) where a(x,t) is the state of the neural field (a), represented in a spatial domain (SR) using coordinates x,t, i(x,i) is a function stating the input to the neural field at time t, f[.] is a bounded monotonic transfer function having values between 0 and 1, F(x) is an interaction kernel, s specifies the time scale on which the neural field (a) changes and h is a constant specifying the global excitation or inhibition of the neural field (a). A method for simulating an Amari dynamics of a neural field (a), comprising the step of simulating an application of the transfer function (f) to the neural field (a). According to the invention, the step of simulating an application of the transfer function (f) comprises smoothing the neural field (a) by applying a smoothing operator (S).
    Type: Application
    Filed: November 28, 2008
    Publication date: August 19, 2010
    Applicant: HONDA RESEARCH INSTITUTE EUROPE GMBH
    Inventor: Alexander Gepperth
  • Patent number: 8965112
    Abstract: Systems and methods for sequence transcription with neural networks are provided. More particularly, a neural network can be implemented to map a plurality of training images received by the neural network into a probabilistic model of sequences comprising P(S|X) by maximizing log P(S|X) on the plurality of training images. X represents an input image and S represents an output sequence of characters for the input image. The trained neural network can process a received image containing characters associated with building numbers. The trained neural network can generate a predicted sequence of characters by processing the received image.
    Type: Grant
    Filed: December 17, 2013
    Date of Patent: February 24, 2015
    Assignee: Google Inc.
    Inventors: Julian Ibarz, Yaroslav Bulatov, Ian Goodfellow
  • Patent number: 11449709
    Abstract: A neural network is trained to focus on a domain of interest. For example, in a pre-training phase, the neural network in trained using synthetic training data, which is configured to omit or limit content less relevant to the domain of interest, by updating parameters of the neural network to improve the accuracy of predictions. In a subsequent training phase, the pre-trained neural network is trained using real-world training data by updating only a first subset of the parameters associated with feature extraction, while a second subset of the parameters more associated with policies remains fixed.
    Type: Grant
    Filed: May 14, 2020
    Date of Patent: September 20, 2022
    Assignee: NVIDIA Corporation
    Inventor: Bernhard Firner
  • Patent number: 11763466
    Abstract: A system comprising an encoder neural network, a scene structure decoder neural network, and a motion decoder neural network. The encoder neural network is configured to: receive a first image and a second image; and process the first image and the second image to generate an encoded representation of the first image and the second image. The scene structure decoder neural network is configured to process the encoded representation to generate a structure output characterizing a structure of a scene depicted in the first image. The motion decoder neural network configured to process the encoded representation to generate a motion output characterizing motion between the first image and the second image.
    Type: Grant
    Filed: December 23, 2020
    Date of Patent: September 19, 2023
    Assignee: Google LLC
    Inventors: Cordelia Luise Schmid, Sudheendra Vijayanarasimhan, Susanna Maria Ricco, Bryan Andrew Seybold, Rahul Sukthankar, Aikaterini Fragkiadaki
  • Patent number: 5553159
    Abstract: In a radiation image processing method utilizing a neural network, an image signal representing a radiation image is fed into a neural network, image processing is carried out on the image signal by the neural network, and an output representing the results of the image processing is obtained from the neural network. Image processing, with respect to the whole region of the radiation image, is carried out on the image signal by a first group of neurons of an intermediate layer of the neural network. Image processing, with respect to parts of the region of the radiation image, is carried out on the image signal by a second group of neurons of the intermediate layer of the neural network. Regardless of set values of initial conditions, the output of the neural network becomes converged to a global minimum corresponding to the stored information, and the results of operation obtained from the neural network are not trapped at a local minimum.
    Type: Grant
    Filed: April 10, 1992
    Date of Patent: September 3, 1996
    Assignee: Fuji Photo Film Co., Ltd.
    Inventor: Hideya Takeo
  • Patent number: 11841458
    Abstract: A neural network is trained to focus on a domain of interest. For example, in a pre-training phase, the neural network in trained using synthetic training data, which is configured to omit or limit content less relevant to the domain of interest, by updating parameters of the neural network to improve the accuracy of predictions. In a subsequent training phase, the pre-trained neural network is trained using real-world training data by updating only a first subset of the parameters associated with feature extraction, while a second subset of the parameters more associated with policies remains fixed.
    Type: Grant
    Filed: September 19, 2022
    Date of Patent: December 12, 2023
    Assignee: NVIDIA Corporation
    Inventor: Bernhard Firner
  • Publication number: 20150036920
    Abstract: The present invention relates to a convolutional-neural-network-based classifier, a classifying method by using a convolutional-neural-network-based classifier and a method for training the convolutional-neural-network-based classifier. The convolutional-neural-network-based classifier comprises: a plurality of feature map layers, at least one feature map in at least one of the plurality of feature map layers being divided into a plurality of regions; and a plurality of convolutional templates corresponding to the plurality of regions respectively, each of the convolutional templates being used for obtaining a response value of a neuron in the corresponding region.
    Type: Application
    Filed: July 31, 2014
    Publication date: February 5, 2015
    Applicant: FUJITSU LIMITED
    Inventors: Chunpeng WU, Wei Fan, Yuan He, Jun Sun
  • Patent number: 5475768
    Abstract: Pattern recognition, for instance optical character recognition, is achieved by training a neural network, scanning an image, segmenting the image to detect a pattern, preprocessing the detected pattern, and applying the preprocessed detected pattern to the trained neural network. The preprocessing includes determining a centroid of the pattern and centrally positioning the centroid in a frame containing the pattern. The training of the neural network includes randomly displacing template patterns within frames before applying the template patterns to the neural network.
    Type: Grant
    Filed: April 29, 1993
    Date of Patent: December 12, 1995
    Assignee: Canon Inc.
    Inventors: Thanh A. Diep, Hadar I. Avi-Itzhak, Harry T. Garland
  • Patent number: 5825907
    Abstract: A system for automatically classification of human fingerprints. An unidentified fingerprint is processed to produce a direction map. The direction map is processed to generate a course direction map. The coarse direction map is input to a locally connected, highly constrained feed-forward neural network. The neural network has a highly structured architecture well-suited to exploit the rotational symmetries and asymmetries of human fingerprints. The neural network classifies the unidentified fingerprint into one of five classifications: Whorl, Double Loop, Left Loop, Right Arch and Arch.
    Type: Grant
    Filed: July 11, 1997
    Date of Patent: October 20, 1998
    Assignee: Lucent Technologies Inc.
    Inventor: Anthony Peter Russo