Patents Examined by Vincent Gonzales
-
Patent number: 11797820Abstract: Techniques are provided for reinforcement learning software agents enhanced by external data. A reinforcement learning model supporting the software agent may be trained based on information obtained from one or more knowledge stores, such as online forums. The trained reinforcement learning model may be tested in an environment with limited connectivity to an external environment to meet performance criteria. The reinforcement learning software agent may be deployed with the tested and trained reinforcement learning model within an environment to autonomously perform actions to process requests.Type: GrantFiled: December 5, 2019Date of Patent: October 24, 2023Assignee: International Business Machines CorporationInventors: Tathagata Chakraborti, Kartik Talamadupula, Kshitij Fadnis, Biplav Srivastava, Murray S. Campbell
-
Patent number: 11790214Abstract: A system includes a neural network that includes a Mixture of Experts (MoE) subnetwork between a first neural network layer and a second neural network layer. The MoE subnetwork includes multiple expert neural networks. Each expert neural network is configured to process a first layer output generated by the first neural network layer to generate a respective expert output. The MoE subnetwork further includes a gating subsystem that selects, based on the first layer output, one or more of the expert neural networks and determine a respective weight for each selected expert neural network, provides the first layer output as input to each of the selected expert neural networks, combines the expert outputs generated by the selected expert neural networks in accordance with the weights for the selected expert neural networks to generate an MoE output, and provides the MoE output as input to the second neural network layer.Type: GrantFiled: May 20, 2020Date of Patent: October 17, 2023Assignee: Google LLCInventors: Noam M. Shazeer, Azalia Mirhoseini, Krzysztof Stanislaw Maziarz
-
Patent number: 11790233Abstract: The specification describes methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating a larger neural network from a smaller neural network. One of the described methods includes obtaining data specifying an original neural network and generating a larger neural network from the original neural network. The larger neural network has a larger neural network structure than the original neural network structure. The values of the parameters of the original neural network units and the additional neural network units are initialized so that the larger neural network generates the same outputs from the same inputs as the original neural network, and the larger neural network is trained to determine trained values of the parameters of the original neural network units and the additional neural network units from the initialized values.Type: GrantFiled: June 29, 2020Date of Patent: October 17, 2023Assignee: Google LLCInventors: Ian Goodfellow, Tianqi Chen, Jonathon Shlens
-
Patent number: 11783174Abstract: Embodiments of the present disclosure relate to splitting input data into smaller units for loading into a data buffer and neural engines in a neural processor circuit for performing neural network operations. The input data of a large size is split into slices and each slice is again split into tiles. The tile is uploaded from an external source to a data buffer inside the neural processor circuit but outside the neural engines. Each tile is again split into work units sized for storing in an input buffer circuit inside each neural engine. The input data stored in the data buffer and the input buffer circuit is reused by the neural engines to reduce re-fetching of input data. Operations of splitting the input data are performed at various components of the neural processor circuit under the management of rasterizers provided in these components.Type: GrantFiled: May 4, 2018Date of Patent: October 10, 2023Assignee: Apple Inc.Inventor: Christopher L. Mills
-
Patent number: 11783227Abstract: A method, apparatus, device and readable medium for transfer learning in machine learning are provided. The method includes: constructing a target model according to the number of classes to be achieved by a target task and a duly-trained source model; obtaining a value of a regularized loss function of the corresponding target model and a value of a cross-entropy loss function of the target model, based on sets of training data in a training dataset of the target task; according to the value of the regularized loss function and the value of the cross-entropy loss function corresponding to each set of training data, updating parameters in the target model by a gradient descent method to implement the training of the target model. The above technical solution avoids excessive constraints on parameters in the prior art, thereby refraining from damaging the training effect of the source model on the target task.Type: GrantFiled: August 20, 2020Date of Patent: October 10, 2023Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.Inventors: Xingjian Li, Haoyi Xiong, Jun Huan
-
Patent number: 11783205Abstract: Data is received that defines a rule mining run including a scope of a search and at least one data source to be searched. In response, the at least one data source is polled to obtain rules responsive to the rule mining run. Each rule can specify one or more actions to take as part of a computer-implemented process when certain conditions are met. A list of rules (i.e., a proposed subset of the obtained rules) can then be generated using at least one machine learning model. The generated list of rule can then be displayed in a graphical user interface. Related apparatus, systems, techniques and articles are also described.Type: GrantFiled: December 17, 2019Date of Patent: October 10, 2023Assignee: SAP SEInventors: Kefeng Wang, Andreas Seifried, Birgitta Bruegel, Kieran Turley, Dimitrij Raev
-
Patent number: 11775871Abstract: Techniques for optimizing a machine learning model. The techniques can include: obtaining one or more embedding vectors based on a prediction of a machine learning model; mapping the embedding vectors from a higher dimensional space to a 2D/3D space to generate one or more high density points in the 2D/3D space; clustering the high-density points by running a clustering algorithm multiple times, each time with a different set of parameters to generate one or more clusters; applying a purity metric to each cluster to generate a normalized purity score of each cluster; identifying one or more clusters with a normalized purity score lower than a threshold; and optimizing the identifying one or more clusters.Type: GrantFiled: December 8, 2022Date of Patent: October 3, 2023Assignee: ARIZE AI, INC.Inventors: Jason Lopatecki, Aparna Dhinakaran, Francisco Castillo Carrasco, Michael Schiff, Nathaniel Mar
-
Patent number: 11763204Abstract: Disclosed in the embodiments of the present invention are a method and an apparatus for training an item coding model. The method comprises: acquiring an initial item coding model and a training sample set; using sample user information of training samples in the training sample set as the input for the initial item coding model to obtain the probability of sample item coding information corresponding to the inputted sample user information; adjusting the structural parameters of the initial item coding model to train an item coding model, the item coding model being used for characterizing the correspondence between inputted sample user information and sample item coding information and the correspondence between sample item information and sample item coding information. The present embodiment can use the trained item coding model to implement item recommendation and can use the item coding information as an index to increase retrieval efficiency.Type: GrantFiled: July 29, 2022Date of Patent: September 19, 2023Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.Inventors: Weihao Gao, Xiangjun Fan, Jiankai Sun, Wenzhi Xiao, Chong Wang, Xiaobing Liu
-
Patent number: 11755938Abstract: Methods and systems for determining event probabilities and anomalous events are provided. In one implementation, a method includes: receiving source data, where the source data is configured as a plurality of events with associated timestamps; searching the source data, where the searching provides a search result including N events from the plurality of events, where N is an integer greater than one, where each event of the N events includes a plurality of field values, where at least one event of the N events can include one or more categorical field values and one or more numerical field values; and for an event of the N events, determining a probability of occurrence for each field value of the plurality of field values; and using probabilities determined for the plurality of field values, determining a probability of occurrence for the event.Type: GrantFiled: January 29, 2020Date of Patent: September 12, 2023Assignee: Splunk Inc.Inventors: Nghi Nguyen, Jacob Leverich, Adam Oliner
-
Patent number: 11748684Abstract: Various examples of methods and systems are provided for improved predictive analytics. In one example, a method of managing operation of an asset or group of assets of interest includes comparing a generated prediction with one or more prediction range associated with a risk profile assigned to an operational outcome of interest, presenting a notification to an operator in response to the comparison, and incorporating operator-generated input as updated source data for the generation of subsequent predictions. The operator-generated input can comprise an operator-defined selection such as, e.g., acceptance of the notification, or rejection of the notification. The operator-generated input can provide real time or near real time information based upon context-specific knowledge that the operator holds that is substantially independent of historical source data.Type: GrantFiled: March 2, 2018Date of Patent: September 5, 2023Assignee: Raytheon Technologies Corp.Inventors: Robert Glenn Morris, II, Mario Montag, Philippe Georges Ivan Marie Thys
-
Patent number: 11741347Abstract: A non-volatile memory device includes a memory cell array to which an arithmetic internal data is written; and an arithmetic circuitry configured to receive an arithmetic input data and the arithmetic internal data for an arithmetic operation of a neural network with the arithmetic internal data and the arithmetic input data in response to an arithmetic command, perform the arithmetic operation using the arithmetic internal data and the arithmetic input data to generate an arithmetic result data, and output the arithmetic result data of the arithmetic operation of the neural network.Type: GrantFiled: July 10, 2019Date of Patent: August 29, 2023Inventor: Joon-soo Kwon
-
Patent number: 11734589Abstract: A virtual assistant negotiation method is provided, which includes the following steps: transmitting an event information by a first electronic device corresponding to an initiator; receiving a plurality of candidate projects generated by second electronic devices corresponding to a plurality of participants according to the event information by the first electronic devices; selecting a portion of the candidate projects to serve as recommended projects by the first electronic device of the host; and making a decision according to the opinions, for the recommended projects, corresponding to the main participant among the participants by the first electronic device.Type: GrantFiled: September 19, 2019Date of Patent: August 22, 2023Assignee: INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTEInventors: Chi-Ta Yang, Pei-Shu Huang, Te-Yu Liu
-
Patent number: 11720814Abstract: A recognition method includes retrieving an input including data of a first window size. The method further includes classifying the input based on comparison of warping distance of the input with a pruning threshold.Type: GrantFiled: December 27, 2018Date of Patent: August 8, 2023Assignee: SAMSUNG ELECTRONICS CO., LTD.Inventors: Yilin Shen, Yue Deng, Hongxia Jin
-
Patent number: 11710033Abstract: Machine learning models, semantic networks, adaptive systems, artificial neural networks, convolutional neural networks, and other forms of knowledge processing systems are disclosed. An ensemble machine learning system is coupled to a graph module storing a graph structure, wherein a collection of entities and the relationships between those entities forms nodes and connection arcs between the various nodes. A hotfile module and hotfile propagation engine coordinate with the graph module or may be subsumed within the graph module, and implement the various hot file functionality generated by the machine learning systems.Type: GrantFiled: June 12, 2018Date of Patent: July 25, 2023Assignee: Bank of America CorporationInventors: Ronnie J. Morris, Dana M. Pusey-Conlin, Lorraine C. Edkin, Scott A. Sims, Joel Filliben, Margaret A. Payne, Craig Douglas Widmann, Eren Kursun
-
Patent number: 11699083Abstract: Systems and methods are provided relating to a complex adaptive command guided swarm system including an operator section comprising a first command and control section and a plurality of networked swarm of semi-autonomously agent controlled system of systems platforms (SAASoSPs). The first command and control section includes a user interface, computer system, network interface, and plurality of command and control systems executed or running on the computer system. The networked SAASoSPs each include a second command and control section, wherein the second command and control section utilizes artificial intelligence (AI) configured with a combination of both symbolic and probabilistic machine learning for various functions including pattern recognition and new pattern identification.Type: GrantFiled: June 10, 2019Date of Patent: July 11, 2023Assignee: The United States of America, as Represented by the Secretary of the NavyInventor: Robert Bruce Cruise
-
Patent number: 11694208Abstract: Provided are a system and methodology for iteratively measuring data, as between multiple sets thereof, that accounts for underlying data generation sources and bases. Doing so, via normalization of the data, enables uniformity of interpretation and presentation of the data no matter the machine learning model that produced the data.Type: GrantFiled: December 5, 2022Date of Patent: July 4, 2023Assignee: Socure, Inc.Inventors: Pablo Ysrrael Abreu, Omar Gutierrez, Ali Haddad, Stanislav Palatnik, Lukas Dylan Osborne
-
Patent number: 11669727Abstract: Provided are an information processing device and the like that facilitate designing a neural network capable of extracting higher-order features. An information processing device includes: an extraction unit that extracts a plurality of subgraphs from a graph including a plurality of nodes and a plurality of edges; a calculation unit that calculates a distance between the plurality of subgraphs extracted; and a design unit that designs a neural network, based on the distance calculated, in that at least a part of the graph is set to an input.Type: GrantFiled: January 17, 2018Date of Patent: June 6, 2023Assignee: NEC CORPORATIONInventor: Daichi Kimura
-
Patent number: 11663527Abstract: Techniques for determining embedding drift score in a machine learning model. The techniques can include: obtaining one or more first embedding vectors based on at least one first prediction of a machine learning model; filtering the first embedding vectors based on a slice of the first prediction; determining a first average vector by averaging each dimension of the filtered first embedding vectors; obtaining one or more second embedding vectors on at least one second prediction of the machine learning model; filtering the second embedding vectors based on a slice of the second prediction; generating a second average vector by averaging each dimension of the filtered second embedding vectors; and determining an embedding drift score based on a distance measure of the first average vector and the second average vector.Type: GrantFiled: March 24, 2022Date of Patent: May 30, 2023Assignee: ARIZE AI, INC.Inventors: Jason Lopatecki, Francisco Castillo Carrasco, Aparna Dhinakaran, Michael Schiff
-
Patent number: 11657235Abstract: Methods, computer program products, and systems are presented. The methods include, for instance: inputs of emotion time series data of a user and environmental factor data from one or more data collection device for a user assistance service. A baseline emotion time series is generated and an environmental factor that is likely to have affected changes in state of emotion on a subject is identified by regression analysis. An emotion time series model for the identified environmental factor is produced and prediction of a path to attain a target state of emotion at a certain time in the future is made. Recommendation to achieve the target state of emotion is produced based on the predicted path.Type: GrantFiled: August 28, 2019Date of Patent: May 23, 2023Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Kelley Anders, Jeremy R. Fox, Jonathan Dunne, Liam S. Harpur
-
Patent number: 11651289Abstract: A method of implementing a task complexity learning system, including: learning a model for predicting the value of a continuous task variable y based upon an input variable x; learning an encoder that encodes a continuous task variable y into an encoded task value; calculating a loss function based upon the predicted value of y output by the model and the encoded task value output by the encoder; calculating a distortion function based upon the input continuous task variable y and the encoded task value, wherein learning the model and learning the encoder includes minimizing an objective function based upon the loss function and the distortion function for a set of input training data including x, y pairs.Type: GrantFiled: August 5, 2019Date of Patent: May 16, 2023Assignee: Koninklijke Philips N.V.Inventors: Bryan Conroy, Junzi Dong, Minnan Xu