Learning Method Patents (Class 706/25)
-
Patent number: 10650045Abstract: An apparatus includes a processor to: train a first neural network of a chain to generate first configuration data including first trained parameters, wherein the chain performs an analytical function generating a set of output values from a set of input values, each neural network has inputs to receive the set of input values and outputs to output a portion of the set of output values, and the neural networks are ordered from the first at the head to a last neural network at the tail, and are interconnected so that each neural network additionally receives the outputs of a preceding neural network; train, using the first configuration data, a next neural network in the chain ordering to generate next configuration data including next trained parameters; and use at least the first and next configuration data and data indicating the interconnections to instantiate the chain to perform the analytical function.Type: GrantFiled: August 30, 2019Date of Patent: May 12, 2020Assignee: SAS INSTITUTE INC.Inventors: Henry Gabriel Victor Bequet, Jacques Rioux, John Alejandro Izquierdo, Huina Chen, Juan Du
-
Patent number: 10635975Abstract: A disclosed machine learning method includes: calculating a first output error between a label and an output in a case where dropout in which values are replaced with 0 is executed for a last layer of a first channel among plural channels in a parallel neural network; calculating a second output error between the label and an output in a case where the dropout is not executed for the last layer of the first channel; and identifying at least one channel from the plural channels based on a difference between the first output error and the second output error to update parameters of the identified channel.Type: GrantFiled: December 19, 2016Date of Patent: April 28, 2020Assignee: FUJITSU LIMITEDInventor: Yuhei Umeda
-
Patent number: 10635944Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training an object representation neural network. One of the methods includes obtaining training sets of images, each training set comprising: (i) a before image of a before scene of the environment, (ii) an after image of an after scene of the environment after the robot has removed a particular object, and (iii) an object image of the particular object, and training the object representation neural network on the batch of training data, comprising determining an update to the object representation parameters that encourages the vector embedding of the particular object in each training set to be closer to a difference between (i) the vector embedding of the after scene in the training set and (ii) the vector embedding of the before scene in the training set.Type: GrantFiled: June 17, 2019Date of Patent: April 28, 2020Assignee: Google LLCInventors: Eric Victor Jang, Sergey Vladimir Levine, Coline Manon Devin
-
Patent number: 10628710Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing images or features of images using an image classification system that includes a batch normalization layer. One of the systems includes a convolutional neural network configured to receive an input comprising an image or image features of the image and to generate a network output that includes respective scores for each object category in a set of object categories, the score for each object category representing a likelihood that that the image contains an image of an object belonging to the category, and the convolutional neural network comprising: a plurality of neural network layers, the plurality of neural network layers comprising a first convolutional neural network layer and a second neural network layer; and a batch normalization layer between the first convolutional neural network layer and the second neural network layer.Type: GrantFiled: December 19, 2018Date of Patent: April 21, 2020Assignee: Google LLCInventors: Sergey Ioffe, Corinna Cortes
-
Patent number: 10628262Abstract: A first static server configured to perform at least one first node process and a second static server configured to perform at least one second node process may be instantiated. A conglomerate server may periodically analyze the at least one first node process and the at least one second node process to identify a network process state based on the at least one first node process and the at least one second node process. The conglomerate server may store the network process state in a memory. A failure may be detected in the first static server. In response to the detecting, the first static server may be reinstantiated. The reinstantiating may comprise restarting the at least one first node process according to the network process state from the memory.Type: GrantFiled: October 24, 2018Date of Patent: April 21, 2020Assignee: Capital One Services, LLCInventors: Austin Walters, Jeremy Goodsitt, Fardin Abdi Taghi Abad
-
Patent number: 10628731Abstract: Systems and methods are provided for automatically scoring a constructed response. The constructed response is processed to generate a plurality of numerical vectors that is representative of the constructed response. A model is applied to the plurality of numerical vectors. The model includes an input layer configured to receive the plurality of numerical vectors, the input layer being connected to a following layer of the model via a first plurality of connections. Each of the connections has a first weight. An intermediate layer of nodes is configured to receive inputs from an immediately-preceding layer of the model via a second plurality of connections, each of the connections having a second weight. An output layer is connected to the intermediate layer via a third plurality of connections, each of the connections having a third weight. The output layer is configured to generate a score for the constructed response.Type: GrantFiled: June 27, 2019Date of Patent: April 21, 2020Assignee: Educational Testing ServiceInventors: Derrick Higgins, Lei Chen, Michael Heilman, Klaus Zechner, Nitin Madnani
-
Patent number: 10621491Abstract: There is described a method for dynamically computing a patient dynamic risk score indicative of an adverse event occurring on a given day. The method comprises obtaining clinical documentation data, socio-demographic data, answers to remote patient monitoring questionnaires, and vital signs data. The method further comprises using, in a feedforward artificial neural network, the clinical documentation data, the socio-demographic data, the answers to remote patient monitoring questionnaires and the vital signs data to compute the patient dynamic risk score indicative of a risk indicative of the adverse event occurring on a given day.Type: GrantFiled: June 7, 2016Date of Patent: April 14, 2020Assignee: ALAYA CARE INC.Inventor: Jonathan Vallée
-
Patent number: 10614354Abstract: A method for implementing a convolutional neural network (CNN) accelerator on a target includes utilizing one or more processing elements to implement a standard convolution layer. A configuration of the CNN accelerator is modified to change a data flow between components on the CNN accelerator. The one or more processing elements is utilized to implement a fully connected layer in response to the change in the data flow.Type: GrantFiled: February 6, 2016Date of Patent: April 7, 2020Assignee: Altera CorporationInventors: Utku Aydonat, Gordon Raymond Chiu, Andrew Chaang Ling
-
Patent number: 10614358Abstract: Disclosed are various embodiments of memristive networks comprising a number of nodes. Memristive nanofibers are used to form conductive and memristive paths in the networks. Each memristive nanofiber may couple one or more nodes to one or more other nodes. In one case, a memristive network includes a first node, a second node, and a memristive fiber that couples the first node to the neural node. The memristive fiber comprises a conductive core and a memristive shell, where the conductive core forms a conductive path between the first node and the second node and the memristive shell forms a memristive path between the first node and the second node.Type: GrantFiled: January 4, 2019Date of Patent: April 7, 2020Assignee: University of Florida Research Foundation, Inc.Inventors: Juan Claudio Nino, Jack Kendall
-
Patent number: 10614148Abstract: A reconfigurable convolution engine for performing a convolution operation on an image is disclosed. A data receiving module receives image data. A determination module determines a kernel size based on the image data, clock speed associated to the convolution engine and available on-chip resources. A generation module generates a plurality of instances based on the kernel size. A configuration module configures an adder engine comprising a plurality of adders configured to operate in a pipelined structure and in parallel with the plurality of instances. An execution module executes the convolution operation on each of the plurality of instances and the adder engine. A filtering module filters an output of the convolution operation by using a filter function configured to operate on a predefined threshold function.Type: GrantFiled: September 19, 2018Date of Patent: April 7, 2020Assignee: HCL TECHNOLOGIES LIMITEDInventors: Prasanna Venkatesh Balasubramaniyan, Sainarayanan Gopalakrishnan, Gunamani Rajagopal
-
Patent number: 10607668Abstract: The present application discloses a data processing method and apparatus. A specific embodiment of the method includes: preprocessing received to-be-processed input data; obtaining a storage address of configuration parameters of the to-be-processed input data based on a result of the preprocessing and a result obtained by linearly fitting an activation function, the configuration parameters being preset according to curve characteristics of the activation function; acquiring the configuration parameters of the to-be-processed input data according to the storage address; and processing the result of the preprocessing of the to-be-processed input data based on the configuration parameters of the to-be-processed input data and a preset circuit structure, to obtain a processing result.Type: GrantFiled: September 30, 2016Date of Patent: March 31, 2020Assignee: Beijing Baidu Netcom Science and Technology Co., Ltd.Inventors: Jian Ouyang, Wei Qi, Yong Wang
-
Patent number: 10603014Abstract: An ultrasonic diagnostic apparatus includes a Doppler processing circuitry, an image generating circuitry, and a control circuitry. The Doppler processing circuitry calculates a correlation matrix using a first data string that is a set of reflected wave data generated based on reflected waves that are generated by transmitting ultrasonic waves without making time intervals of transmission pulses uniform on an identical scan line. The Doppler processing circuitry calculates a filter coefficient based on a result of principal component analysis using the correlation matrix. The Doppler processing circuitry extracts a second data string that is included in the first data string, and that is a set of reflected wave data originated from reflected waves of the ultrasonic waves that are reflected on a moving object present on the identical scan line, using the filter coefficient. The Doppler processing circuitry estimates moving object information of the moving object based on the extracted second data string.Type: GrantFiled: June 5, 2015Date of Patent: March 31, 2020Assignee: Canon Medical Systems CorporationInventor: Takeshi Sato
-
Patent number: 10592786Abstract: Methods and systems for generating an annotated dataset for training a deep tracking neural network, and training of the neural network using the annotated dataset. For each object in each frame of a dataset, one or more likelihood functions are calculated to correlate feature score of the object with respective feature scores each associated with one or more previously assigned target identifiers (IDs) in a selected range of frames. A target ID is assigned to the object by assigning a previously assigned target ID associated with a calculated highest likelihood or assigning a new target ID. Track management is performed according to a predefined track management scheme to assign a track type to the object. This is performed for all objects in all frames of the dataset. The resulting annotated dataset contains target IDs and track types assigned to all objects in all frames.Type: GrantFiled: August 14, 2017Date of Patent: March 17, 2020Assignee: HUAWEI TECHNOLOGIES CO., LTD.Inventor: Ehsan Taghavi
-
Patent number: 10586150Abstract: Described is a system for decoding spiking reservoirs even when the spiking reservoir has continuous synaptic plasticity. The system uses a set of training patterns to train a neural network having a spiking reservoir comprised of spiking neurons. A test pattern duration d is estimated for a set of test patterns P, and each test pattern is presented to the spiking reservoir for a duration of d/P seconds. Output spikes from the spiking reservoir are generated via readout neurons. The output spikes are measured and the measurements are used to compute firing rate codes, each firing rate code corresponding to a test pattern in the set of test patterns P. The firing rate codes are used to decode performance of the neural network by computing a discriminability index (DI) to discriminate between test patterns in the set of test patterns P.Type: GrantFiled: March 18, 2016Date of Patent: March 10, 2020Assignee: HTL Laboratories, LLCInventors: Youngkwan Cho, Narayan Srinivasa
-
Patent number: 10565498Abstract: A data set whose records include respective pairs of entity descriptors with at least some text and a representation of a relationship such as similarity between the entities of the pair is obtained. Using the data set, a neural network model is trained to generate relationship indicators for pairs of entity descriptors. In an extensible token model of the neural network model, a text token of a first attribute of a particular entity descriptor is represented by a plurality of features including a first feature which was added to the token model as a result of a programmatic request. A particular relationship indicator corresponding to a source entity descriptor and a target entity descriptor is generated using the trained neural network model.Type: GrantFiled: February 28, 2017Date of Patent: February 18, 2020Assignee: Amazon Technologies, Inc.Inventor: Dmitry Vladimir Zhiyanov
-
Patent number: 10558935Abstract: Technologies are generally described for methods and systems effective to determine a weight benefit associated with application of weights to training data in a machine learning environment. In an example, a device may determine a first function based on the training data, where the training data includes training inputs and training labels. The device may determine a second function based on weighted training data, which is based on application of weights to the training data. The device may determine a third function based on target data, where the target data is generated based on a target function. The target data may include target labels different from the training labels. The device may determine a fourth function based on weighted target data, which is a result of application of weights to the target data. The device may determine the weight benefit based on the first, second, third, and fourth functions.Type: GrantFiled: August 5, 2014Date of Patent: February 11, 2020Assignee: California Institute of TechnologyInventors: Yaser Said Abu-Mostafa, Carlos Roberto Gonzalez
-
Patent number: 10558885Abstract: A determination method for determining the structure of a convolutional neural network includes acquiring N filters having the weights trained using a training image group as the initial values, where N is a natural number greater than or equal to 1, and increasing the number of the filters from N to M, where M is a natural number greater than or equal to 2 and is greater than N, by adding a filter obtained by performing a transformation used in image processing fields on at least one of the N filters.Type: GrantFiled: April 12, 2017Date of Patent: February 11, 2020Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.Inventors: Min Young Kim, Luca Rigazio, Sotaro Tsukizawa, Kazuki Kozuka
-
Patent number: 10552732Abstract: A multi-layer artificial neural network having at least one high-speed communication interface and N computational layers is provided. N is an integer larger than 1. The N computational layers are serially connected via the at least one high-speed communication interface. Each of the N computational layers respectively includes a computation circuit and a local memory. The local memory is configured to store input data and learnable parameters for the computation circuit. The computation circuit in the ith computational layer provides its computation results, via the at least one high-speed communication interface, to the local memory in the (i+1)th computational layer as the input data for the computation circuit in the (i+1)th computational layer, wherein i is an integer index ranging from 1 to (N?1).Type: GrantFiled: August 22, 2016Date of Patent: February 4, 2020Assignee: Kneron Inc.Inventors: Yilei Li, Yuan Du, Chun-Chen Liu, Li Du
-
Patent number: 10552731Abstract: Described is a neuromorphic system implemented in hardware that implements neuron membrane potential update based on the leaky integrate and fire (LIF) model. The system further models synapse weights update based on the spike time-dependent plasticity (STDP) model. The system includes an artificial neural network in which the update scheme of neuron membrane potential and synapse weight are effectively defined and implemented.Type: GrantFiled: December 28, 2015Date of Patent: February 4, 2020Assignee: International Business Machines CorporationInventors: Takeo Yasuda, Kohji Hosokawa, Yutaka Nakamura, Junka Okazawa, Masatoshi Ishii
-
Patent number: 10546211Abstract: A method is described that includes executing a convolutional neural network layer on an image processor having an array of execution lanes and a two-dimensional shift register. The two-dimensional shift register provides local respective register space for the execution lanes. The executing of the convolutional neural network includes loading a plane of image data of a three-dimensional block of image data into the two-dimensional shift register.Type: GrantFiled: July 1, 2016Date of Patent: January 28, 2020Assignee: Google LLCInventors: Ofer Shacham, David Patterson, William R. Mark, Albert Meixner, Daniel Frederic Finchelstein, Jason Rupert Redgrave
-
Patent number: 10535001Abstract: A method for training a deep learning algorithm using N-dimensional data sets may be provided. Each data set comprises a plurality of N?1-dimensional data sets. The method comprises selecting a batch size and assembling an equally sized training batch. The samples are selected to be evenly distributed within said respective N-dimensional data sets. The method comprises also starting from a predetermined offset number, wherein the number of samples is equal to the selected batch size number, and feeding said training batches of N?1-dimensional samples into a deep learning algorithm for the training. Upon the training resulting in a learning rate that is below a predetermined level, selecting a different offset number for at least one of said N-dimensional data sets, and going back to the step of assembling. Upon the training resulting in a learning rate that is equal or higher than said predetermined level, the method stops.Type: GrantFiled: November 6, 2017Date of Patent: January 14, 2020Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Umit Cakmak, Lukasz G. Cmielowski, Marek Oszajec, Wojciech Sobala
-
Patent number: 10534994Abstract: The present disclosure relates to a computer-implemented method for analyzing one or more hyper-parameters for a multi-layer computational structure. The method may include accessing, using at least one processor, input data for recognition. The input data may include at least one of an image, a pattern, a speech input, a natural language input, a video input, and a complex data set. The method may further include processing the input data using one or more layers of the multi-layer computational structure and performing matrix factorization of the one or more layers. The method may also include analyzing one or more hyper-parameters for the one or more layers based upon, at least in part, the matrix factorization of the one or more layers.Type: GrantFiled: November 11, 2015Date of Patent: January 14, 2020Assignee: Cadence Design Systems, Inc.Inventors: Piyush Kaul, Samer Lutfi Hijazi, Raul Alejandro Casas, Rishi Kumar, Xuehong Mao, Christopher Rowen
-
Patent number: 10529339Abstract: According to a first aspect of the present disclosure, a method for facilitating detection of one or more time series patterns is conceived, comprising building one or more artificial neural networks, wherein, for at least one time series pattern to be detected, a specific one of said artificial neural networks is built, the specific one of said artificial neural networks being configured to produce a decision output and a reliability output, wherein the reliability output is indicative of the reliability of the decision output. According to a second aspect of the present disclosure, a corresponding computer program is provided. According to a third aspect of the present disclosure, a corresponding system for facilitating the detection of one or more time series patterns is provided.Type: GrantFiled: February 28, 2018Date of Patent: January 7, 2020Assignee: NXP B.V.Inventor: Adrien Daniel
-
Patent number: 10521714Abstract: Embodiments of the invention provide a neural core circuit comprising a synaptic interconnect network including plural electronic synapses for interconnecting one or more source electronic neurons with one or more target electronic neurons. The interconnect network further includes multiple axon paths and multiple dendrite paths. Each synapse is at a cross-point junction of the interconnect network between a dendrite path and an axon path. The core circuit further comprises a routing module maintaining routing information. The routing module routes output from a source electronic neuron to one or more selected axon paths. Each synapse provides a configurable level of signal conduction from an axon path of a source electronic neuron to a dendrite path of a target electronic neuron.Type: GrantFiled: January 21, 2016Date of Patent: December 31, 2019Assignee: International Business Machines CorporationInventors: Steven K. Esser, Dharmendra S. Modha
-
Patent number: 10521526Abstract: Exemplary systems, apparatus, and methods for evaluating and predicting athletic performance are described. Systems may include a receiver that gathers non-deterministic data on one or more aspects of athletic performance, a deterministic model of the athletic performance, a hybrid processor that creates a conditional probabilistic model from these elements, and a display presenting the evaluated or predicted performance. The system may include sensors affixed to an athlete or their equipment to convey position, acceleration, heart rate, respiration, biomechanical attributes, and detached sensors to record video, audio, and other ambient conditions. Apparatus may include a hybridization processor that communicates the output of conditional probabilistic models directly to athletes, coaches, and trainers using sound, light, or haptic signals, or to spectators using audiovisual enhancements to broadcasts.Type: GrantFiled: November 20, 2017Date of Patent: December 31, 2019Assignee: NFL PLAYERS, INC.Inventors: Peter D. Haaland, Sean C. Sansiveri, Anthony J. Falcone
-
Patent number: 10515313Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a plurality of different types of predictive models using training data, wherein each of the predictive models implements a different machine learning technique. One or more weights are obtained wherein each weight is associated with an answer category in the plurality of examples. A weighted accuracy is calculated for each of the predictive models using the one or more weights.Type: GrantFiled: October 29, 2014Date of Patent: December 24, 2019Assignee: Google LLCInventors: Robert Kaplow, Wei-Hao Lin, Gideon S. Mann, Travis H. K. Green, Gang Fu, Robbie A. Haertel
-
Patent number: 10509996Abstract: The present disclosure is drawn to the reduction of parameters in fully connected layers of neural networks. For a layer whose output is defined by y=Wx, where y is the output vector, x is the input vector, and W is a matrix of connection parameters, vectors uij and vij are defined and submatrices Wi,j are computed as the outer product of uij and vij, so that Wi,j=vij?uij, and W is obtained by appending submatrices Wi,j.Type: GrantFiled: September 7, 2016Date of Patent: December 17, 2019Assignee: Huawei Technologies Co., Ltd.Inventors: Barnaby Dalton, Serdar Sozubek, Manuel Saldana, Vanessa Courville
-
Patent number: 10507179Abstract: The present invention relates to improved formulations of Levosimendan for pharmaceutical use, and particularly for intravenous administration as infusion or injection and of infusion concentrates. The present invention therefore relates to pharmaceutical compositions comprising Levosimendan, in which Levosimendan is present in a solubilized form. The formulations have therapeutically and commercial useful concentrations of Levosimendan. The solutions of the invention have enhanced ability at physiological pH (pH 7.4) and are particular useful as infusion or injection solutions or infusion concentrates. The composition according to the present invention can also be spray-dried or lyophilized to obtain a dried powder which is very stable and which powder forms the original solution after reconstitution in water or an aqueous solvent. Levosimendan or (?)-[[4-(1,4,5,6-tetrahydro-4-methyl-6-oxo-3-pyridazi-nyl)phenyl]hydrazono]propanedinitrile is useful in the treatment of congestive heart failure.Type: GrantFiled: November 4, 2016Date of Patent: December 17, 2019Assignee: CARINOPHARM GMBHInventor: Andrea Weiland
-
Patent number: 10489706Abstract: Embodiments are directed to a computer implemented method of implementing a network having pathways. The method includes communicating among a plurality of units through the pathways. The method further includes identifying informative looping signals in loops formed from a plurality of network pathways that connect a first one of the plurality of units to a second one of the plurality of units. The method further includes applying spike-timing dependent plasticity (STDP) dependent inhibitory gating to the plurality of network pathways. The method further includes phase shifting open gates and close gates in the loop by applying STDP functions to open gate outputs and closed gates outputs. The method further includes making a rate and a direction of the phase shift dependent on a modulatory signal, wherein the modulatory signal is based at least in part on a change in the STDP-dependent inhibitory gating.Type: GrantFiled: June 22, 2015Date of Patent: November 26, 2019Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventor: James R. Kozloski
-
Patent number: 10489482Abstract: Methods for solving systems of linear equations via utilization of a vector matrix multiplication accelerator are provided. In one aspect, a method includes receiving, from a controller and by the vector matrix multiplication accelerator, an augmented coefficient matrix. The method also comprises implementing Gaussian Elimination using the vector matrix multiplication accelerator by: monitoring, by a register in at least one swap operation, a row order of the augmented coefficient matrix when a first row is swapped with a second row of the augmented coefficient matrix, delivering, by the controller in at least one multiply operation, an analog voltage to a desired row of the augmented coefficient matrix to produce a multiplication result vector, and adding, in at least one add operation, the first row to another desired row of the augmented coefficient matrix to produce an add result vector. Systems and circuits are also provided.Type: GrantFiled: June 1, 2018Date of Patent: November 26, 2019Assignee: HEWLETT PACKARD ENTERPRISE DEVELOPMENT LPInventors: Catherine Graves, John Paul Strachan
-
Patent number: 10489705Abstract: Embodiments are directed to a computer network having pathways. The network includes a plurality of units configured to communicate through the pathways. The network is configured to identify informative looping signals in loops formed from a plurality of network pathways that connect a first one of the plurality of units to a second one of the plurality of units. The network is further configured to apply spike-timing dependent plasticity (STDP) dependent inhibitory gating to the plurality of network pathways. The network is further configured to phase shift open gates and close gates in the loop by applying STDP functions to open gate outputs and closed gates outputs. The network is further configured to make a rate and a direction of the phase shift dependent on a modulatory signal, wherein the modulatory signal is based at least in part on a change in the STDP inhibitory gating.Type: GrantFiled: January 30, 2015Date of Patent: November 26, 2019Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventor: James R. Kozloski
-
Patent number: 10484611Abstract: A video tracking system includes a user interface configured to facilitate tracking of a target between video cameras. The user interface includes user controls configured to assist a user in selecting video cameras as the target moves between fields of view of the video cameras. These user controls are automatically associated with specific cameras based on a camera topology relative to a point of view of a camera whose video data is currently being viewed. The video tracking system further includes systems and methods of synchronizing video data generated using the video cameras and of automatically generating a stitched video sequence based on the user selection of video cameras. The target may be tracked in real-time or in previously recorded video and may be track forward or backwards in time.Type: GrantFiled: December 1, 2016Date of Patent: November 19, 2019Assignee: Sensormatic Electronics, LLCInventors: Hu Chin, Ken Prayoon Cheng
-
Patent number: 10481212Abstract: A secondary battery status estimation device includes a sensor unit configured to detect a terminal voltage of a secondary battery, and an internal resistance calculator configured to calculate a direct current internal resistance of the secondary battery based on the terminal voltage and the charge-discharge current detected by the sensor unit. The internal resistance calculator calculates a direct current internal resistance based on the terminal voltage and the charge-discharge current detected by the sensor unit, in a stable period that is before starting a driving source for driving a vehicle and in which the terminal voltage and the charge-discharge current of the secondary battery fall within a predetermined fluctuation range, and in a high-current output period in which electric power for starting the driving source is output from the secondary battery and the terminal voltage of the secondary battery is brought to substantially minimum.Type: GrantFiled: September 13, 2017Date of Patent: November 19, 2019Assignee: Panasonic Intellectual Property Management Co., Ltd.Inventors: Takuma Iida, Takeshi Chiba, Shunsuke Nitta, Kazuhiro Sugie, Hiroyuki Jimbo
-
Patent number: 10467528Abstract: Techniques herein train a multilayer perceptron, sparsify edges of a graph such as the perceptron, and store edges and vertices of the graph. Each edge has weight. A computer sparsifies perceptron edges. The computer performs a forward-backward pass on the perceptron to calculate a sparse Hessian matrix. Based on that Hessian, the computer performs quasi-Newton perceptron optimization. The computer repeats this until convergence. The computer stores edges in an array and vertices in another array. Each edge has weight and input and output indices. Each vertex has input and output indices. The computer inserts each edge into an input linked list based on its weight. Each link of the input linked list has the next input index of an edge. The computer inserts each edge into an output linked list based on its weight. Each link of the output linked list comprises the next output index of an edge.Type: GrantFiled: August 11, 2015Date of Patent: November 5, 2019Assignee: Oracle International CorporationInventors: Dmitry Golovashkin, Uladzislau Sharanhovich, Vaishnavi Sashikanth
-
Patent number: 10452977Abstract: A lightened neural network, method, and apparatus, and recognition method and apparatus implementing the same. A neural network includes a plurality of layers each comprising neurons and plural synapses connecting neurons included in neighboring layers. Synaptic weights with values greater than zero and less than a preset value of a variable a, which is greater than zero, may be at least partially set to zero. Synaptic weights with values greater than a preset value of a variable b, which is greater than zero, may be at least partially set to the preset value of the variable b.Type: GrantFiled: July 20, 2017Date of Patent: October 22, 2019Assignee: Samsung Electronics Co., Ltd.Inventors: Changyong Son, Jinwoo Son, Byungin Yoo, Chang Kyu Choi, Jae-Joon Han
-
Patent number: 10452971Abstract: A method is provided for implementing a deep neural network on a server component that includes a host component including a CPU and a hardware acceleration component coupled to the host component. The deep neural network includes a plurality of layers. The method includes partitioning the deep neural network into a first segment and a second segment, the first segment including a first subset of the plurality of layers, the second segment including a second subset of the plurality of layers, configuring the host component to implement the first segment, and configuring the hardware acceleration component to implement the second segment.Type: GrantFiled: June 29, 2015Date of Patent: October 22, 2019Assignee: Microsoft Technology Licensing, LLCInventors: Eric Chung, Karin Strauss, Kalin Ovtcharov, Joo-Young Kim, Olatunji Ruwase
-
Patent number: 10445642Abstract: The present invention relates to unsupervised, supervised and reinforced learning via spiking computation. The neural network comprises a plurality of neural modules. Each neural module comprises multiple digital neurons such that each neuron in a neural module has a corresponding neuron in another neural module. An interconnection network comprising a plurality of edges interconnects the plurality of neural modules. Each edge interconnects a first neural module to a second neural module, and each edge comprises a weighted synaptic connection between every neuron in the first neural module and a corresponding neuron in the second neural module.Type: GrantFiled: May 23, 2016Date of Patent: October 15, 2019Assignee: International Business Machines CorporationInventor: Dharmendra S. Modha
-
Patent number: 10447727Abstract: Disclosed embodiments relate to systems and methods for predictable detection in a computing network. Techniques include identifying an activity associated with an identity in the computer network; accessing hierarchical-chained progression states representing timelines defining one or more process flows for operations in the computer network between beginning states and corresponding predictable result states to be controlled; identifying a hierarchical-chained progression state corresponding to the identified activity; automatically predicting a likelihood that the at least one activity will reach the predictable result state corresponding to the identified hierarchical-chained progression state; and implementing a control action for the activity, the identity, or a resource to which the identity is seeking to communicate.Type: GrantFiled: February 27, 2019Date of Patent: October 15, 2019Assignee: CyberArk Software Ltd.Inventor: Asaf Hecht
-
Patent number: 10431287Abstract: According to one embodiment, a semiconductor memory device includes a memory cell including a transistor formed of an oxide semiconductor, an insulation film, and a control electrode, and a capacitance element configured to store a charge, the memory cell being configured to store a coupling weight of a neuron model by a charge amount accumulated in the capacitance element; and a control circuit configured to output a signal as a sum of a product between input data of the memory cell and the coupling weight.Type: GrantFiled: September 15, 2017Date of Patent: October 1, 2019Assignee: Toshiba Memory CorporationInventors: Chika Tanaka, Keiji Ikeda
-
Patent number: 10425373Abstract: Embodiments describe systems and methods for prioritizing messages for conversion from text to speech. A message manager can execute on a device. The message manager can identify a plurality of messages accessible via the device and can determine, for each message of the plurality of messages, a conversion score based on one or more parameters of each message. The conversion score can indicate a priority of each message to convert from text to speech. The message manager can identify a message of the plurality of messages for transmission to a text-to-speech converter for converting the message from text to speech. The message manager can also receive, from the text-to-speech converter, speech data of the message to play via an audio output of the device.Type: GrantFiled: July 19, 2017Date of Patent: September 24, 2019Assignee: CITRIX SYSTEMS, INC.Inventors: Thierry Duchastel, Marcos Alejandro Di Pietro
-
Patent number: 10417562Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing inputs using a neural network system that includes a batch normalization layer. One of the methods includes receiving a respective first layer output for each training example in the batch; computing a plurality of normalization statistics for the batch from the first layer outputs; normalizing each component of each first layer output using the normalization statistics to generate a respective normalized layer output for each training example in the batch; generating a respective batch normalization layer output for each of the training examples from the normalized layer outputs; and providing the batch normalization layer output as an input to the second neural network layer.Type: GrantFiled: January 28, 2016Date of Patent: September 17, 2019Assignee: Google LLCInventors: Sergey Ioffe, Corinna Cortes
-
Patent number: 10410111Abstract: A computer system includes a memory storing a data structure representing a neural network. The data structure includes a plurality of fields including values representing topology of the neural network. The computer system also includes one or more processors configured to perform neural network classification by operations including generating a vector representing at least a portion of the neural network based on the data structure. The operations also include providing the vector as input to a trained classifier to generate a classification result associated with at least the portion of the neural network, where the classification result is indicative of expected performance or reliability of the neural network. The operations also include generating an output indicative of the classification result.Type: GrantFiled: October 25, 2017Date of Patent: September 10, 2019Assignee: SparkCognition, Inc.Inventor: Syed Mohammad Amir Husain
-
Patent number: 10387769Abstract: A recurrent neural network including an input layer, a hidden layer, and an output layer, wherein the hidden layer includes hybrid memory cell units, each of the hybrid memory cell units including a first memory cells of a first type, the first memory cells being configured to remember a first cell state value fed back to each of gates to determine a degree to which each of the gates is open or closed, and configured to continue to update the first cell state value, and a second memory cells of a second type, each second memory cell of the second memory cells including a first time gate configured to control a second cell state value of the second memory cell based on phase signals of an oscillatory frequency, and a second time gate configured to control an output value of the second memory cell based on the phase signals, and each second memory cell of the second memory cells being configured to remember the second cell state value.Type: GrantFiled: August 10, 2017Date of Patent: August 20, 2019Assignees: SAMSUNG ELECTRONICS CO., LTD., UNIVERSITAET ZUERICHInventors: Daniel Neil, Shih-Chii Liu, Michael Pfeiffer
-
Patent number: 10380481Abstract: An output buffer holds N words arranged as N/J mutually exclusive output buffer word groups (OBWG) of J words each of the N words. N processing units (PU) are arranged as N/J mutually exclusive PU groups. Each PU group has an associated OBWG. Each PU includes an accumulator and an arithmetic unit that performs operations on inputs, which include the accumulator output, to generate a first result for accumulation into the accumulator. Activation function units selectively perform an activation function on the accumulator outputs to generate results for provision to the N output buffer words. For each PU group, four of the J PUs and at least one of the activation function units compute an input gate, a forget gate, an output gate and a candidate state of a Long Short Term Memory (LSTM) cell, respectively, for writing to respective first, second, third and fourth words of the associated OBWG.Type: GrantFiled: April 5, 2016Date of Patent: August 13, 2019Assignee: VIA ALLIANCE SEMICONDUCTOR CO., LTD.Inventors: G. Glenn Henry, Terry Parks, Kyle T. O'Brien
-
Patent number: 10369459Abstract: In one embodiment, a neuromorphic robot includes a curved outer housing that forms a continuous curved outer surface, a plurality of trackball touch sensors provided on and extending across the continuous curved outer surface in an array, each trackball sensor being configured to detect a direction and velocity a sweeping stroke of a user, and a plurality of lights, one light being collocated with each trackball touch sensor and being configured to illuminate when its collocated trackball touch sensor is stroked by the user, wherein the robot is configured to interpret the sweeping stroke of the user sensed with the plurality of trackball touch sensors and to provide immediate visual feedback to the user at the locations of the touched trackball touch sensors.Type: GrantFiled: May 21, 2018Date of Patent: August 6, 2019Assignee: The Regents of the University of CaliforniaInventors: Liam David Bucci, Ting-Shuo Chou, Jeffrey Lawrence Krichmar
-
Patent number: 10367694Abstract: A method and system for tracking an IT infrastructure is provided. The method includes modeling an IT infrastructure as a collection of hardware components, software components, and networking components. An observer agent is deployed on each of the components. The observer agent performs a measurement process with respect to each of the components and a mapping process is performed with respect to the measurement process. An aggregation module is deployed and an aggregation process is performed with respect to results of the mapping process. In response, a two dimensional moving graph indicating results of the aggregation process is generated and displayed.Type: GrantFiled: May 12, 2014Date of Patent: July 30, 2019Assignee: International Business Machines CorporationInventors: Vikas Agarwal, Kuntal Dey, Alwyn R. Lobo, Sougata Mukherjea, Venkatraman Ramakrishna, Meghna Singh
-
Patent number: 10360470Abstract: Method and systems of replacing operations of depthwise separable filters with first and second replacement convolutional layers are disclosed. Depthwise separable filters contains a combination of a depthwise convolutional layer followed by a pointwise convolutional layer with input of P feature maps and output of Q feature maps. The first replacement convolutional layer contains P×P of 3×3 filter kernels formed by placing each of the P×1 of 3×3 filter kernels of the depthwise convolutional layer on respective P diagonal locations, and zero-value 3×3 filter kernels zero-value 3×3 filter kernels in all off-diagonal locations. The second replacement convolutional layer contains Q×P of 3×3 filter kernels formed by placing Q×P of 1×1 filter coefficients of the pointwise convolutional layer in center position of the respective Q×P of 3×3 filter kernels, and numerical value zero in eight perimeter positions.Type: GrantFiled: March 2, 2018Date of Patent: July 23, 2019Assignee: Gyrfalcon Technology Inc.Inventors: Lin Yang, Patrick Z. Dong, Jason Z. Dong, Baohua Sun
-
Patent number: 10360971Abstract: Techniques are disclosed for artificial neural network functionality within dynamic random-access memory. A plurality of dynamic random-access cells is accessed within a memory block. Data within the plurality of dynamic random-access cells is sensed using a plurality of sense amplifiers associated with the plurality of dynamic random-access cells. A plurality of select lines coupled to the plurality of sense amplifiers is activated to facilitate the sensing of the data within the plurality of dynamic random-access cells, wherein the activating is a function of inputs to a layer within a neural network, and wherein a bit within the plurality of dynamic random-access cells is sensed by a first sense amplifier and a second sense amplifier within the plurality of sense amplifiers. Resulting data is provided based on the activating wherein the resulting data is a function of weights within the neural network.Type: GrantFiled: April 24, 2018Date of Patent: July 23, 2019Assignee: Green Mountain Semiconductor, Inc.Inventors: Wolfgang Hokenmaier, Jacob Bucci, Ryan Jurasek
-
Patent number: 10360732Abstract: Techniques related to a system, article, and method of determining object positions for image processing using wireless network angle of transmission.Type: GrantFiled: March 23, 2017Date of Patent: July 23, 2019Assignee: Intel CorporationInventors: Prasanna Krishnaswamy, Himanshu Bhalla, Chetan Verma
-
Patent number: 10354187Abstract: A method for confidentiality classification of files includes vectorizing a file to reduce the file to a single structured representation; and analyzing the single structured representation with a machine learning engine that generates a confidentiality classification for the file based on previous training. A system for confidentiality classification of files includes a file vectorization engine to vectorize a file to reduce the file to a single structured representation; and a machine learning engine to receive the single structured representation of the file and generate a confidentiality classification for the file based on previous training.Type: GrantFiled: January 17, 2013Date of Patent: July 16, 2019Assignee: HEWLETT PACKARD ENTERPRISE DEVELOPMENT LPInventors: Kas Kasravi, James C. Cooper