Neural Network Patents (Class 706/15)
- Approximation (Class 706/17)
- Association (Class 706/18)
- Constraint optimization problem solving (Class 706/19)
- Classification or recognition (Class 706/20)
- Prediction (Class 706/21)
- Signal processing (e.g., filter) (Class 706/22)
- Control (Class 706/23)
- Beamforming (e.g., target location, radar) (Class 706/24)
-
Patent number: 11836604Abstract: A method for programming an activation function is provided. The method includes generating segment data for segmenting the activation function; segmenting the activation function into a plurality of segments using the segment data; and approximating at least one segment of the plurality of segments as a programmable segment. An apparatus for performing the method may include a programmable activation function generator configured to generate segment data for segmenting an activation function; segment the activation function into a plurality of segments using the generated segment data; and approximate at least one segment of the plurality of segments as a programmable segment. By using segment data, various non-linear activation functions, particularly newly proposed or known activation functions with some modifications, can be programmed to be processable in hardware.Type: GrantFiled: May 23, 2022Date of Patent: December 5, 2023Assignee: DEEPX CO., LTD.Inventors: Lok Won Kim, Ho Seung Kim, Hyung Jin Chun
-
Patent number: 11836746Abstract: A diagnostic system for model governance is presented. The diagnostic system includes an auto-encoder to monitor model suitability for both supervised and unsupervised models. When applied to unsupervised models, the diagnostic system can provide a reliable indication on model degradation and recommendation on model rebuild. When applied to supervised models, the diagnostic system can determine the most appropriate model for the client based on a reconstruction error of a trained auto-encoder for each associated model. An auto-encoder can determine outliers among subpopulations of consumers, as well as support model go-live inspections.Type: GrantFiled: December 2, 2014Date of Patent: December 5, 2023Assignee: FAIR ISAAC CORPORATIONInventors: Jun Zhang, Scott Michael Zoldi
-
Patent number: 11829873Abstract: Disclosed herein is technology for performing predictive modeling to identify inputs for a manufacturing process. An example method may include receiving expected output data for a manufacturing process, wherein the expected output data defines an attribute of an output of the manufacturing process; accessing a plurality of machine learning models that model the manufacturing process; determining, using a first machine learning model, input data for the manufacturing process based on the expected output data for the manufacturing process, wherein the input data comprises a value for a first input and a value for a second input; combining the input data determined using the first machine learning model with input data determined using the second machine learning model to produce a set of inputs for the manufacturing process, wherein the set of inputs comprises candidate values for the first input and candidate values for the second input.Type: GrantFiled: May 21, 2020Date of Patent: November 28, 2023Assignee: Applied Materials, Inc.Inventors: Sidharth Bhatia, Dermot Cantwell, Serghei Malkov, Jie Feng
-
Patent number: 11829075Abstract: A processing apparatus includes a driver configured to drive a controlled object, and a controller configured to control the driver by generating a command value to the driver based on a control error. The controller includes a first compensator configured to generate a first command value based on the control error, a second compensator configured to generate a second command value based on the control error, and an adder configured to obtain the command value by adding the first command value and the second command value. The second compensator includes a neural network for which a parameter value is decided by learning, and input parameters input to the neural network include at least one of a driving condition of the driver and an environment condition in a periphery of the controlled object in addition to the control error.Type: GrantFiled: June 23, 2022Date of Patent: November 28, 2023Assignee: CANON KABUSHIKI KAISHAInventor: Satoru Itoh
-
Patent number: 11823052Abstract: Certain aspects of the present disclosure are directed to methods and apparatus for configuring a multiply-accumulate (MAC) block in an artificial neural network. A method generally includes receiving, at a neural processing unit comprising one or more logic elements, at least one input associated with a use-case of the neural processing unit; obtaining a set of weights associated with the at least one input; selecting a precision for the set of weights; modifying the set of weights based on the selected precision; and generating an output based, at least in part, on the at least one input, the modified set of weights, and an activation function.Type: GrantFiled: October 11, 2019Date of Patent: November 21, 2023Assignee: QUALCOMM INCORPORATEDInventors: Giby Samson, Srivatsan Chellappa, Ramaprasath Vilangudipitchai, Seung Hyuk Kang
-
Patent number: 11822887Abstract: Systems and methods for natural language processing are described. One or more embodiments of the disclosure provide an entity matching apparatus trained using machine learning techniques to determine whether a query name corresponds to a candidate name based on a similarity score. In some examples, the query name and the candidate name are encoded using a character encoder to produce a regularized input sequence and a regularized candidate sequence, respectively. The regularized input sequence and the regularized candidate sequence are formed from a regularized character set having fewer characters than a natural language character set.Type: GrantFiled: March 12, 2021Date of Patent: November 21, 2023Assignee: ADOBE, INC.Inventors: Lidan Wang, Franck Dernoncourt
-
Patent number: 11823217Abstract: A segmentation system utilizes a supervised learning method and a clustering analysis to identify clusters, thereby segmenting a population into groups, where the clusters are associated with various conversion potentials that indicate the probability of an event. The segmentation system employs the supervised learning method to train a model on training data comprising historical conversion data and features associated with members of the group. A subset of features is selected from a ranked order that is determined using weights generated by the supervised learning. A clustering analysis is performed for a population with respect to the subset to generate clusters. A superior cluster is identified based on it having a conversion potential greater than a conversion potential of another cluster. In a marketing context, the system can be employed to identify a superior cluster of users that have a higher conversion potential in response to an advertisement campaign.Type: GrantFiled: November 1, 2019Date of Patent: November 21, 2023Assignee: Adobe Inc.Inventors: Rushil Mahajan, Kumar Mrityunjay Singh
-
Patent number: 11822049Abstract: [Object] To provide a lightning threat information-providing apparatus, a lightning threat information-providing method, and a program that are capable of providing a user with accurate information regarding a lightning threat.Type: GrantFiled: August 9, 2018Date of Patent: November 21, 2023Assignee: Japan Aerospace Exploration AgencyInventors: Eiichi Yoshikawa, Tomoo Ushio
-
Patent number: 11816045Abstract: A computer-implemented method includes receiving, by a computing device, input activations and determining, by a controller of the computing device, whether each of the input activations has either a zero value or a non-zero value. The method further includes storing, in a memory bank of the computing device, at least one of the input activations. Storing the at least one input activation includes generating an index comprising one or more memory address locations that have input activation values that are non-zero values. The method still further includes providing, by the controller and from the memory bank, at least one input activation onto a data bus that is accessible by one or more units of a computational array. The activations are provided, at least in part, from a memory address location associated with the index.Type: GrantFiled: August 24, 2021Date of Patent: November 14, 2023Assignee: Google LLCInventors: Dong Hyuk Woo, Ravi Narayanaswami
-
Patent number: 11818147Abstract: Systems, methods and computer program products for improving security of artificial intelligence systems. The system comprising processors for monitoring one or more transactions received by a machine learning decision model to determine a first score associated with a first transaction. The first transaction may be identified as likely adversarial, in response to the first score being lower than a certain score threshold and the first transaction having a low occurrence likelihood. A second score may be generated in association with the first transaction based on one or more adversarial latent features associated with the first transaction. At least one adversarial latent feature may be detected as being exploited by the first transaction, in response to determining that the second score falls above the certain score threshold. Accordingly, an abnormal volume of activations of adversarial latent features spanning across a plurality of transactions scored may be detected and blocked.Type: GrantFiled: November 23, 2020Date of Patent: November 14, 2023Assignee: Fair Isaac CorporationInventors: Scott Michael Zoldi, Shafi Ur Rahman
-
Patent number: 11809521Abstract: A method for modularizing high dimensional neural networks into neural networks of lower input dimensions. The method is suited to generating full-DOF robot grasping actions based on images of parts to be picked. In one example, a first network encodes grasp positional dimensions and a second network encodes rotational dimensions. The first network is trained to predict a position at which a grasp quality is maximized for any value of the grasp rotations. The second network is trained to identify the maximum grasp quality while searching only at the position from the first network. Thus, the two networks collectively identify an optimal grasp, while each network's searching space is reduced. Many grasp positions and rotations can be evaluated in a search quantity of the sum of the evaluated positions and rotations, rather than the product. Dimensions may be separated in any suitable fashion, including three neural networks in some applications.Type: GrantFiled: June 8, 2021Date of Patent: November 7, 2023Assignee: FANUC CORPORATIONInventor: Yongxiang Fan
-
Patent number: 11810174Abstract: Items within an index may be converted from classic geometry and embedded into a hyperbolic space. The hyperboloids within the hyperbolic space provide higher precision classifications of items within the index relative to their hierarchical structure. A received search query may also be converted to hyperbolic space and mapped as a query hyperboloid against an answer space that includes hyperboloids for items within the index. Distances or overlaps between the hyperboloids may be determined in order to generate a set of search results.Type: GrantFiled: March 31, 2021Date of Patent: November 7, 2023Assignee: Amazon Technologies, Inc.Inventors: Sumeet Katariya, Nikhil S. Rao, Chandan K. Reddy, Karthik Subbian, Nurendra Choudhary
-
Patent number: 11803738Abstract: Hardware for implementing a Deep Neural Network (DNN) having a convolution layer, the hardware comprising a plurality of convolution engines each configured to perform convolution operations by applying filters to data windows, each filter comprising a set of weights for combination with respective data values of a data window; and one or more weight buffers accessible to each of the plurality of convolution engines over an interconnect, each weight buffer being configured to provide weights of one or more filters to any of the plurality of convolution engines; wherein each of the convolution engines comprises control logic configured to request weights of a filter from the weight buffers using an identifier of that filter.Type: GrantFiled: October 26, 2021Date of Patent: October 31, 2023Assignee: Imagination Technologies LimitedInventor: Christopher Martin
-
Patent number: 11798675Abstract: Methods, systems, apparatus, including computer programs encoded on computer storage media for generating psychiatric treatment recommendations. In one aspect, the method includes actions of receiving, by a server and from a first user device, one or more data structures that collectively include fields structuring data that represents (i) current patient symptoms and (ii) current patient diagnoses, generating, by the server, rendering data structure that includes fields structuring data that represents rendering data that, when rendered on a display device, presents a patient dashboard based on the data that is received from the mobile device, and providing, by the server, the rendering data structure to a second user device that is different than the first user device, wherein the second user device is configured to render the rendering data structured by the fields of the rendering data structure to output the patient dashboard on the display of the second user device.Type: GrantFiled: May 29, 2019Date of Patent: October 24, 2023Assignee: OTSUKA AMERICA PHARMACEUTICAL, INC.Inventors: Roland Larkin, Srikanth Gottipati, Reza Moghadam, Carolyn Tyler, Gregory Ho
-
Patent number: 11794759Abstract: The present technology is effective to cause at least one processor to instruct an autonomous vehicle to navigate a specific course and to record diagnostic measurements while navigating the specific course, receive the diagnostic measurements from the autonomous vehicle, and analyze the diagnostic measurements from the autonomous vehicle in a context provided by a collection of diagnostic measurement data collected from a fleet of similar autonomous vehicles navigating the specific course.Type: GrantFiled: March 26, 2020Date of Patent: October 24, 2023Assignee: GM Cruise Holdings LLCInventors: Erik Nielsen, Chase Kaufman
-
Patent number: 11790212Abstract: Quantization-aware neural architecture search (“QNAS”) can be utilized to learn optimal hyperparameters for configuring an artificial neural network (“ANN”) that quantizes activation values and/or weights. The hyperparameters can include model topology parameters, quantization parameters, and hardware architecture parameters. Model topology parameters specify the structure and connectivity of an ANN. Quantization parameters can define a quantization configuration for an ANN such as, for example, a bit width for a mantissa for storing activation values or weights generated by the layers of an ANN. The activation values and weights can be represented using a quantized-precision floating-point format, such as a block floating-point format (“BFP”) having a mantissa that has fewer bits than a mantissa in a normal-precision floating-point representation and a shared exponent.Type: GrantFiled: March 18, 2019Date of Patent: October 17, 2023Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Kalin Ovtcharov, Eric S. Chung, Vahideh Akhlaghi, Ritchie Zhao
-
Patent number: 11790135Abstract: A computer-implemented method for providing a simulation model of an electric rotating machine is disclosed. The simulation model is defined by parameter values. Input data is obtained. The input data is collectable using the electric rotating machine when the electric rotating machine is not connected to an operating voltage and being characteristic of the electric rotating machine. The parameter values are determined from the input data using a trained function and the parameter values determined are provided.Type: GrantFiled: April 21, 2021Date of Patent: October 17, 2023Assignee: Siemens AktiengesellschaftInventor: Christian Deeg
-
Patent number: 11783037Abstract: Disclosed are a defense method and a model of deep learning model aiming at adversarial attacks in the technical field of image recognition, which makes full use of the internal relationship between the adversarial samples and the initial samples, and transforms the adversarial samples into common samples by constructing a filter layer in front of the input layer of the deep learning model; the parameters of the filter layer are trained by using the adversarial attack samples, so as to improve the ability of the model to resist adversarial attack; then the trained filter layer is combined with the learning model after the adversarial training, and a deep learning model with strong robustness and high classification accuracy is obtained, which ensures that the recognition ability of the initial sample is not reduced while resisting the adversarial attacks.Type: GrantFiled: May 15, 2023Date of Patent: October 10, 2023Assignee: Quanzhou Equipment Manufacturing Research InstituteInventors: Jielong Guo, Xian Wei, Xuan Tang, Hui Yu, Dongheng Shao, Jianfeng Zhang, Jie Li, Yanhui Huang
-
Patent number: 11776292Abstract: An object identification method includes: generating a tracking sample and an adversarial sample; training a teacher model according to the tracking sample; and initializing a student model according to the teacher model. The student model adjusts a plurality of parameters according to the teacher model and the adversarial sample, in response to the vector difference between the output result of the student model and the output result of the teacher model being lower than the learning threshold, the student model is deemed to have completed training, and the student model is extracted as an object identification model.Type: GrantFiled: March 15, 2021Date of Patent: October 3, 2023Assignee: WISTRON CORPInventor: Kuo-Lun Huang
-
Patent number: 11775655Abstract: An artificial intelligence (AI) platform to support optimization of container builds and virtual machine mounts in a distributed computing environment. A provisioning file is subject to natural language processing (NLP) and a corresponding vector representation of the file is created and subject to evaluation by a set of artificial neural networks (ANN). A first ANN assesses the representation of the file with respect to compliance and operability, and the second ANN selectively assesses the representation of the file with respect to provisioning efficiency. The provisioning file is selectively process based on the provisioning efficiency, with the processing directed at provisioning a container build or mounting a VM.Type: GrantFiled: May 11, 2021Date of Patent: October 3, 2023Assignee: International Business Machines CorporationInventors: Abhishek Malvankar, John M. Ganci, Jr., Carlos A. Fonseca, Charles E. Beller
-
Patent number: 11775801Abstract: A neural processor. In some embodiments, the processor includes a first tile, a second tile, a memory, and a bus. The bus may be connected to the memory, the first tile, and the second tile. The first tile may include: a first weight register, a second weight register, an activations buffer, a first multiplier, and a second multiplier. The activations buffer may be configured to include: a first queue connected to the first multiplier and a second queue connected to the second multiplier. The first queue may include a first register and a second register adjacent to the first register, the first register being an output register of the first queue. The first tile may be configured: in a first state: to multiply, in the first multiplier, a first weight by an activation from the output register of the first queue, and in a second state: to multiply, in the first multiplier, the first weight by an activation from the second register of the first queue.Type: GrantFiled: August 27, 2019Date of Patent: October 3, 2023Assignee: Samsung Electronics Co., Ltd.Inventors: Ilia Ovsiannikov, Ali Shafiee Ardestani, Joseph H. Hassoun, Lei Wang, Sehwan Lee, JoonHo Song, Jun-Woo Jang, Yibing Michelle Wang, Yuecheng Li
-
Patent number: 11769036Abstract: An apparatus for optimizing a computational network is configure to receive an input at a first processing component. The first processing component may include at least a first programmable processing component and a second programmable processing component. The first programmable processing component is configured to compute a first nonlinear function and the second programmable processing component is configured to compute a second nonlinear function which is different than the second nonlinear function. The computational network which may be a recurrent neural network such as a long short-term memory may be operated to generate an inference based at least in part on outputs of the first programmable processing component and the second programmable processing component.Type: GrantFiled: April 18, 2018Date of Patent: September 26, 2023Assignee: QUALCOMM IncorporatedInventors: Rosario Cammarota, Michael Goldfarb, Manu Rastogi, Sarang Ozarde
-
Patent number: 11769059Abstract: Systems and methods for distributed training of deep learning models are disclosed. An example local device to train deep learning models includes a reference generator to label input data received at the local device to generate training data, a trainer to train a local deep learning model and to transmit the local deep learning model to a server that is to receive a plurality of local deep learning models from a plurality of local devices, the server to determine a set of weights for a global deep learning model, and an updater to update the local deep learning model based on the set of weights received from the server.Type: GrantFiled: December 21, 2022Date of Patent: September 26, 2023Assignee: Movidius LimitedInventor: David Moloney
-
Patent number: 11769576Abstract: Embodiments of a method and system for improving care determination for care providers in relation to a condition of a user associated with a mobile device can include: collecting a log of use dataset associated with user digital communication behavior at the mobile device; collecting a mobility supplementary dataset corresponding to a mobility-related sensor of the mobile device; determining a medical status analysis for a condition of the user based on at least one of the log of use dataset and the mobility supplementary dataset, the medical status analysis including at least one of a diagnosis and a therapeutic intervention associated with the condition; and promoting the at least one of the diagnosis and the therapeutic intervention to a care provider.Type: GrantFiled: March 24, 2020Date of Patent: September 26, 2023Assignee: OrangeDot, Inc.Inventors: Sai Moturu, Anmol Madan
-
Patent number: 11763133Abstract: Systems and methods relating to machine learning. An edge device runs a new data point on a first neural network and determines activations on the layers within that neural network. The first neural network is a fully trained network based on a second neural network on a server. The activation data for the various layers in the first neural network are, starting with the output layer, sequentially transmitted to the server. The server continuously receives this activation data and continuously compares it with previously encountered activation data for the second neural network. If the received activation data is within an expected range, then the edge device is instructed to stop sending activation data. Otherwise, the server continues to receive the activation data for the other layers until the new data point is received by the server or the activation data is within the expected range of previously encountered activation data.Type: GrantFiled: August 30, 2019Date of Patent: September 19, 2023Assignee: SERVICENOW CANADA INC.Inventor: Philippe Beaudoin
-
Patent number: 11763142Abstract: Methods and systems, including computer programs encoded on a computer storage medium. In one aspect, a method includes the actions of receiving a request to perform convolutional computations for a neural network on a hardware circuit having a matrix computation unit, the request specifying the convolutional computation to be performed on a feature tensor and a filter and padding applied to the feature tensor prior to performing the convolutional computation; and generating instructions that when executed by the hardware circuit cause the hardware circuit to perform operations comprising: transferring feature tensor data from a main memory of the hardware circuit to a scratchpad memory of the hardware circuit; and repeatedly performing the following operations: identifying a current subset of the feature tensor; and determining whether a memory view into the scratchpad memory for the current subset is consistent with a memory view of the current subset in the main memory.Type: GrantFiled: September 2, 2022Date of Patent: September 19, 2023Assignee: Google LLCInventors: David Alexander Majnemer, Blake Alan Hechtman, Bjarke Hammersholt Roune
-
Patent number: 11763155Abstract: A system comprising an electronic device that includes a processor is described. During operation, the processor acquires a full version of a neural network, the neural network including internal elements for processing instances of input image data having a set of color channels. The processor then generates, from the neural network, a set of sub-networks, each sub-network being a separate copy of the neural network with the internal elements for processing at least one of the color channels in instances of input image data removed, so that each sub-network is configured for processing a different set of one or more color channels in instances of input image data. The processor next provides the sub-networks for processing instances of input image data—and may itself use the sub-networks for processing instances of input image data.Type: GrantFiled: August 12, 2019Date of Patent: September 19, 2023Assignee: Advanced Micro Devices, Inc.Inventors: Sudhanva Gurumurthi, Abhinav Vishnu
-
Patent number: 11763545Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for efficiently, quickly, and flexibly generating and providing pixel-wise classification predictions utilizing early exit heads of a multi-exit pixel-level prediction neural network. For example, the disclosed systems utilize a multi-exit pixel-level prediction neural network to generate classification predictions for a digital image on the pixel level. The multi-exit pixel-level prediction neural network includes a specialized architecture with early exit heads having unique encoder-decoder architectures for generating pixel-wise classification predictions at different early exit stages. In some embodiments, the disclosed systems implement a spatial confidence-adaptive scheme to mask certain predicted pixels to prevent further processing of the masked pixels and thereby reduce computation.Type: GrantFiled: March 26, 2021Date of Patent: September 19, 2023Assignee: Adobe Inc.Inventors: Evan Shelhamer, Zhuang Liu
-
Patent number: 11757491Abstract: In accordance with a first aspect, a communication device is provided, comprising: a transmitter configured to transmit one or more radio frequency signal pulses to an external communication device; a receiver configured to receive one or more response signals in response to the radio frequency signal pulses transmitted by the transmitter; a signal analyzer configured to detect one or more characteristics of the response signals, to compare the detected characteristics with predefined reference characteristics and to generate an output indicative of a result of comparing the detected characteristics with the predefined reference characteristics; a processing unit configured to determine at least one category to which the external communication device belongs based on the output generated by the signal analyzer. In accordance with a second aspect, a corresponding method of operating a communication device is conceived. In accordance with a third aspect, a corresponding computer program is provided.Type: GrantFiled: January 6, 2022Date of Patent: September 12, 2023Assignee: NXP B.V.Inventors: Markus Wobak, Johannes Stahl, Ulrich Andreas Muehlmann
-
Patent number: 11755884Abstract: A system having multiple devices that can host different versions of an artificial neural network (ANN). In the system, changes to local versions of the ANN can be combined with a master version of the ANN. In the system, a first device can include memory that can store the master version, a second device can include memory that can store a local version of the ANN, and there can be many devices that store local versions of the ANN. The second device (or any other device of the system hosting a local version) can include a processor that can train the local version, and a transceiver that can transmit changes to the local version generated from the training. The first device can include a transceiver that can receive the changes to a local version, and a processing device that can combine the received changes with the master version.Type: GrantFiled: August 20, 2019Date of Patent: September 12, 2023Assignee: Micron Technology, Inc.Inventors: Sean Stephen Eilert, Shivasankar Gunasekaran, Ameen D. Akel, Kenneth Marion Curewitz, Hongyu Wang
-
Patent number: 11748292Abstract: Various embodiments disclosed herein provides method and system for low latency FPGA based system for inference such as recommendation models. Conventional models for inference have high latency and low throughput in decision making models/processes. The disclosed method and system exploits parallelism in processing of XGB models and hence enables minimum possible latency and maximum possible throughput. Additionally, the disclosed system uses a trained model that is (re)trained using only those features which the model had used during training, remaining features are discarded during retraining of the model. The use of such selected set of features thus leads to reduction in the size of digital circuit significantly for the hardware implementation, thereby greatly enhancing the system performance.Type: GrantFiled: October 1, 2021Date of Patent: September 5, 2023Assignee: TATA CONSULTANCY SERVICES LIMITEDInventors: Piyush Manavar, Manoj Nambiar
-
Patent number: 11741348Abstract: Provided are a neural network circuit device, a neural network, a neural network processing method, and a neural network execution program, each of which does not require a bias. A binarized neural network circuit includes: an input part configured to allow input of an input node which allows input of input values x1-xn (xi) (binary), and input of weights w1-wn (wi) (binary); an XNOR gate circuit configured to receive the input values x1-xn and the weights w1-wn and to take XNOR logic; a sum circuit configured to sum XNOR logical values; a batch normalization circuit configured to correct a variance due to binarization, by extending a range of normalization and shifting a center thereof; and an activating function circuit configured to convert a signal B obtained by batch-normalizing a signal Y generated by taking the sum, by means of an activating function f sgn(B).Type: GrantFiled: September 18, 2018Date of Patent: August 29, 2023Assignee: Tokyo Institute of TechnologyInventor: Hiroki Nakahara
-
Patent number: 11741352Abstract: A resistive processing unit (RPU) that includes a pair of transistors connected in series providing an update function for a weight of a training methodology to the RPU, and a read transistor for reading the weight of the training methodology. In some embodiments, the resistive processing unit (RPU) further includes a capacitor connecting a gate of the read transistor to the air of transistors providing the update function for the resistive processing unit (RPU). The capacitor stores said weight of training methodology for the RPU.Type: GrantFiled: August 22, 2016Date of Patent: August 29, 2023Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Tayfun Gokmen, Seyoung Kim, Dennis M. Newns, Yurii A. Vlasov
-
Patent number: 11734554Abstract: This application discloses a pooling processing method, applied to a pooling processing system of a convolutional neural network.Type: GrantFiled: October 19, 2022Date of Patent: August 22, 2023Assignee: Tencent Technology (Shenzhen) Company LimitedInventors: Xiaoyu Yu, Yuwei Wang, Bo Zhang, Lixin Zhang
-
Systems and methods for providing user offers based on efficient iterative recommendation structures
Patent number: 11734706Abstract: Systems and methods are described for providing user offers based on efficient iterative recommendation structures. In various aspects, a server invokes a bi-directional look-up interface via a lookup request, where the bi-directional look-up interface is exposed via an electronic recommendation structure. The lookup request causes the bi-directional look-up interface to return a bi-directional recommendation value. The bi-directional recommendation value indicates a likelihood of a first user selecting a first offer or a second offer. The bi-directional recommendation value is transmitted via a computer network to a client device associated with the first user upon a determination that the likelihood meets or exceeds a recommendation threshold. The client device is operative to display at least one of the first offer or the second offer.Type: GrantFiled: August 25, 2021Date of Patent: August 22, 2023Assignee: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANYInventors: Taylor Griffin Smith, Jason Matthew White, Joseph David Albright, Tim G. Sanidas -
Patent number: 11727277Abstract: A method for automatically generating an artificial neural network that encompasses modules and connections that link those modules, successive modules and/or connections being added to a current starting network. Modules and/or connections that are to be added are selected randomly from a predefinable plurality of possible modules and connections that can be added. A plurality of possible refinements of the current starting network respectively are generated by adding to the starting network modules and/or connections that are to be added. One of the refinements from the plurality of possible refinements is then selected in order to serve as a current starting network in a subsequent execution of the method.Type: GrantFiled: October 24, 2018Date of Patent: August 15, 2023Assignee: ROBERT BOSCH GMBHInventors: Frank Hutter, Jan Hendrik Metzen, Thomas Elsken
-
Patent number: 11727256Abstract: A hardware accelerator that is efficient at performing computations related to a neural network. In one embodiment, the hardware accelerator includes a first data buffer that receives input data of a layer in the neural network and shift the input data slice by slice downstream. The hardware accelerator includes a second data buffer that receives kernel data of the layer in the neural network and shift the kernel data slice by slice downstream. The hardware accelerator includes a first input shift register that receives an input data slice from the first data buffer. The first input shift register may correspond to a two-dimensional shift register configured to shift values in the input data slice in x and y directions. The hardware accelerator includes a second input shift register that receives a kernel data slice from the second data buffer. A multiplication block performs convolution of the input and kernel data.Type: GrantFiled: August 27, 2021Date of Patent: August 15, 2023Assignee: AIP SEMI, INC.Inventors: Henry Verheyen, Jianjun Wen
-
Patent number: 11709121Abstract: A particle measurement system and method of operation thereof are described. The system and method render a characteristic for a set of particles measured while passing through a measurement volume. The system includes a source that generates a particle-laden field containing the set of particles. The system further includes a sensor that generates a raw particle data corresponding to the set particles passing through the measurement volume of the particle measurement system, where the raw particle data comprises a set of raw particle records and each of one of the raw particle records includes a particle data content. A preconditioning stage carries out a preconditioning operation on the particle data content of the set of raw particle records to render a conditioned input data. A machine learning stage processes the conditioned input data to render an output characteristic parameter value for the set of particles.Type: GrantFiled: November 17, 2020Date of Patent: July 25, 2023Assignee: Spraying Systems Co.Inventors: Chad Sipperley, Rudolf J. Schick
-
Patent number: 11710216Abstract: The subject disclosure relates to solutions for reducing or eliminating motion sickness experienced by a vehicle occupant/passenger. In some aspects, a process of the disclosed technology includes steps for collecting motion data associated with a vehicle using one or more environmental sensors, tracking eye movements of a user within a cabin of the vehicle, processing the motion data and the eye movements to identify a motion event, and generating a motion compensation signal based on the motion event. Systems and machine-readable media are also provided.Type: GrantFiled: July 14, 2020Date of Patent: July 25, 2023Assignee: GM Cruise Holdings LLCInventors: Nestor Grace, Diego Plascencia-Vega, Dogan Gidon
-
Patent number: 11699077Abstract: Provided is multi-layer neural network technique that includes: calculating, from an input and using a first one or more layers of a plurality of layers of a neural network, a first intermediate output; reducing a size of one or more dimensions of the first intermediate output; calculating, from the first intermediate output and using a second one or more layers of the neural network, a second intermediate output (the second one or more layers including one or more ultra-low precision layers); reducing a size of one or more dimensions of the second intermediate output; combining a plurality of reduced intermediate outputs (including the reduced first intermediate output and the reduced second intermediate output) to derive a combined intermediate output; and calculating, using the combined intermediate output and one or more higher-precision layers of the plurality of layers, a neural network output.Type: GrantFiled: June 21, 2021Date of Patent: July 11, 2023Assignee: Plumerai LimitedInventors: Koen Giliam Helwegen, Thomas Reint Bannink, Timon David De Bruin, Lukas Sebastian Geiger, Adam Connor Slavin Hillier, Jelmer Lucas Arnoldus Neeven, Leendert Pieter Overweel
-
Patent number: 11693373Abstract: Systems and methods for learning based control in accordance with embodiments of the invention are illustrated. One embodiment includes a method for training an adaptive controller. The method includes steps for receiving a set of training data that includes several training samples, wherein each training sample includes a state and a true uncertain effect value. The method includes steps for computing an uncertain effect value based on the state, computing a set of one or more losses based on the true uncertain effect value and the computed uncertain effect value, and updating the adaptive controller based on the computed set of losses.Type: GrantFiled: December 10, 2019Date of Patent: July 4, 2023Assignee: California Institute of TechnologyInventors: Guanya Shi, Xichen Shi, Michael O'Connell, Animashree Anandkumar, Yisong Yue, Soon-Jo Chung
-
Patent number: 11695758Abstract: A method for a multi-factor authentication, the method receives results of an initial authentication of a user. Responsive to confirming the initial authentication, an image of a secondary set of authentication options is presented. An option selection is received from the user, wherein the selection is determined by tracking eye movement of the user over the image that includes the set of second factor authentication options. User facial activity is tracked corresponding to the selection made from the secondary set of authentication options. The monitored facial activity is compared to a pre-established authentication condition to determine whether a match exists with the selected secondary set of authentication options, and responsive to facial activity monitored matching the authentication condition pre-established by the user and corresponding to the selection made from the secondary set of authentication options, authentication of the user is confirmed.Type: GrantFiled: February 24, 2020Date of Patent: July 4, 2023Assignee: International Business Machines CorporationInventors: Doga Tav, Ron Williams, Hyman David Chantz
-
Patent number: 11687761Abstract: Systems and methods for performing improper input data detection are described. In one example, a system comprises: hardware circuits configured to receive input data and to perform computations of a neural network based on the input data to generate computation outputs; and an improper input detection circuit configured to: determine a relationship between the computation outputs of the hardware circuits and reference outputs; determine that the input data are improper based on the relationship; and perform an action based on determining that the input data are improper.Type: GrantFiled: December 11, 2018Date of Patent: June 27, 2023Assignee: Amazon Technologies, Inc.Inventors: Randy Renfu Huang, Richard John Heaton, Andrea Olgiati, Ron Diamant
-
Patent number: 11676295Abstract: Disclosed herein are methods and system for training artificial intelligence models configured to execute image segmentation techniques. The methods and system describe a server that receives a first image including a set of pixels depicting multiple objects. The server also receives a second image having a second set of pixels depicting the same set of objects. The server then analyzes the pixels from the first and second images. When a difference between at least one visual attribute of a pixel within the second image and a corresponding pixel within the first image satisfies a predetermined threshold, it will be encoded as spikes to send to the model, the model will be trained using supervised STDP rule by revising weights associated with the nodes within the AI model where the node corresponds to the pixels within the first and/or the second image.Type: GrantFiled: March 16, 2022Date of Patent: June 13, 2023Assignee: VARIAN MEDICAL SYSTEMS, INC.Inventor: Wenlong Yang
-
Patent number: 11669725Abstract: Using a buffer sized according to the size of the filters of a convolutional neural network (CNN), a processor may use a read pointer to generate a two-dimensional virtual matrix of inputs. The number of inputs in each row in the two-dimensional virtual matrix of inputs may match the one-dimensional filter size of the cubic filters. The processor may collapse each of the cubic filters to one-dimensional linear arrays and generate a two-dimensional filter matrix from the one-dimensional linear arrays. The convolution computations for a corresponding layer of the CNN therefore reduce to a single matrix multiplication without any memory movement operations. When the buffer is refreshed using a new input frame, the processor may increment the initial read address of each read pointer by one and increment the final read address by one, circling back to the corresponding initial read address.Type: GrantFiled: June 6, 2019Date of Patent: June 6, 2023Assignee: Cadence Design Systems, Inc.Inventors: Ananda Sarangaram Tharma Ranga Raja, Prasad Nikam, N D Divyakumar, Himanshu Singhal, Vijay Pawar, Sachin P. Ghanekar
-
Patent number: 11671317Abstract: A computer-implemented method for placement of a plurality of application objects of an application within a network architecture is disclosed. The method includes generating during runtime of the application, an application topology model for the application, based on application metrics for the plurality of application objects. A resource topology model of a plurality of network nodes within the network architecture is generated based on resource metrics for the network nodes. A recommendation is generated for migrating an application object of the plurality of application objects to a network node of the plurality of network nodes using the application topology model and the resource topology model, the recommendation identifying the application object and the network node. The application object is migrated to the network node identified by the recommendation.Type: GrantFiled: April 24, 2020Date of Patent: June 6, 2023Assignee: Huawei Cloud Computing Technologies Co., Ltd.Inventors: Donghui Zhuo, Quinton Hoole, Isaac Ackerman, Sungwook Moon, Haibin Xie, Olesya Melnichenko
-
Patent number: 11663480Abstract: An autonomic function executing in an artificial intelligence environment determines that a fused model responsive to a new problem space has below a threshold level of accuracy in the new problem space. A spliced layer in the fused model is autonomically cloned, the spliced layer having been extracted from a second model and inserted at a location in the fused model. The cloned layer is autonomically inserted at a second location in the fused model. An automatically constructed vector transformation transforms an output vector of a previous layer in an immediately previous location in the model relative to the second location. The cloned layer is automatically fused in the fused model using the transformed output vector as input to the cloned layer, forming a deep fused model that has a revised accuracy that is higher than the accuracy relative to an ontology of the new problem space.Type: GrantFiled: November 15, 2019Date of Patent: May 30, 2023Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Aaron K. Baughman, Michael Behrendt, Shikhar Kwatra, Craig M. Trim
-
Patent number: 11662696Abstract: Disclosed herein is an automatic control artificial intelligence device including a collection unit configured to acquire an output value according to control of a control system; and an artificial intelligence unit operably coupled to the collection unit and configured to: communicate with the collection unit; set at least one of one or more base lines and a reward based on a gap between the one or more base lines and the output value, according to a plurality of operation goals of the control system; and update a control function for providing a control value to the control system by performing reinforcement learning based on the gap between the one or more base lines and the output value.Type: GrantFiled: June 27, 2019Date of Patent: May 30, 2023Assignee: LG ELECTRONICS INC.Inventor: Bongsang Kim
-
Patent number: 11657264Abstract: Media content is received for streaming to a user device. A neural network is trained based on a first portion of the media content. Weights of the neural network are updated to overfit the first portion of the media content to provide a first overfitted neural network. The neural network or the first overfitted neural network is trained based on a second portion of the media content. Weights of the neural network or the first overfitted neural network are updated to overfit the second portion of the media content to provide a second overfitted neural network. The first portion and the second portion of the media content are sent with associations to the first overfitted neural network and the second overfitted to the user equipment.Type: GrantFiled: April 9, 2018Date of Patent: May 23, 2023Assignee: Nokia Technologies OyInventors: Francesco Cricri, Caglar Aytekin, Emre Baris Aksu, Miika Sakari Tupala, Xingyang Ni
-
Patent number: 11653843Abstract: An electronic device includes a sensor configured to acquire a subject's pulse wave, a blood pressure measurement portion configured to measure the subject's blood pressure level, and a controller configured to estimate a state of glucose metabolism or lipid metabolism of the subject on the basis of an index based on the subject's pulse wave acquired by the sensor and the subject's blood pressure level measured by the blood pressure measurement portion.Type: GrantFiled: June 13, 2017Date of Patent: May 23, 2023Assignee: KYOCERA CorporationInventor: Hiromi Ajima