Patents by Inventor Bryan McCann
Bryan McCann has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11966446Abstract: The present application generally relates to search engines, and more specifically to systems and methods for a search tool for code snippets. Embodiment described herein provide a customized code search system that generates code search results from customized data sources, extract code snippets from the code search results, and presents the code snippets via a user interface. In one embodiment, the search system adopts a machine learning module to generate and highlight search results from different data sources that include code examples, e.g., in a programming language. To improve search efficiency, in response to a code search query, the search system may extract code snippets from search results from relevant sources in a user interface element, such as user selectable panels.Type: GrantFiled: June 6, 2023Date of Patent: April 23, 2024Assignee: SuSea, IncInventors: Richard Socher, Bryan McCann
-
Patent number: 11948665Abstract: The present disclosure provides systems and methods for controllable protein generation. According to some embodiments, the systems and methods leverage neural network models and techniques that have been developed for other fields, in particular, natural language processing (NLP). In some embodiments, the systems and methods use or employ models implemented with transformer architectures developed for language modeling and apply the same to generative modeling for protein engineering.Type: GrantFiled: August 24, 2020Date of Patent: April 2, 2024Assignee: Salesforce, Inc.Inventors: Ali Madani, Bryan McCann, Nikhil Naik
-
Patent number: 11934781Abstract: Embodiments described herein provide a flexible controllable summarization system that allows users to control the generation of summaries without manually editing or writing the summary, e.g., without the user actually adding or deleting certain information under various granularity. Specifically, the summarization system performs controllable summarization through keywords manipulation. A neural network model is learned to generate summaries conditioned on both the keywords and source document so that at test time a user can interact with the neural network model through a keyword interface, potentially enabling multi-factor control.Type: GrantFiled: December 17, 2020Date of Patent: March 19, 2024Assignee: Salesforce, Inc.Inventors: Junxian He, Wojciech Kryscinski, Bryan McCann
-
Patent number: 11934952Abstract: Embodiments described herein provide natural language processing (NLP) systems and methods that utilize energy-based models (EBMs) to compute an exponentially-weighted energy-like term in the loss function to train an NLP classifier. Specifically, noise contrastive estimation (NCE) procedures are applied together with the EBM-based loss objectives for training the NLPs.Type: GrantFiled: December 16, 2020Date of Patent: March 19, 2024Assignee: Salesforce, Inc.Inventors: Tianxing He, Ehsan Hosseini-Asl, Bryan McCann, Caiming Xiong
-
Patent number: 11922303Abstract: Embodiments described herein provides a training mechanism that transfers the knowledge from a trained BERT model into a much smaller model to approximate the behavior of BERT. Specifically, the BERT model may be treated as a teacher model, and a much smaller student model may be trained using the same inputs to the teacher model and the output from the teacher model. In this way, the student model can be trained within a much shorter time than the BERT teacher model, but with comparable performance with BERT.Type: GrantFiled: May 18, 2020Date of Patent: March 5, 2024Assignee: Salesforce, Inc.Inventors: Wenhao Liu, Ka Chun Au, Shashank Harinath, Bryan McCann, Govardana Sachithanandam Ramachandran, Alexis Roos, Caiming Xiong
-
Publication number: 20240020538Abstract: Embodiments described herein provide systems and methods for a customized generative AI platform that provides users with a tool to generate various formats of responses to user inputs that incorporate results from searches performed by the generative AI platform. The system may use a neural network to utilize input data and contextual information to identify potential search queries, gather relevant data, sort information, generate text-based responses to user inputs, and present response and search results via user-engageable elements.Type: ApplicationFiled: July 18, 2023Publication date: January 18, 2024Inventors: Richard Socher, Bryan McCann
-
Publication number: 20230394095Abstract: The present application generally relates to search engines, and more specifically to systems and methods for a search tool for code snippets. Embodiment described herein provide a customized code search system that generates code search results from customized data sources, extract code snippets from the code search results, and presents the code snippets via a user interface. In one embodiment, the search system adopts a machine learning module to generate and highlight search results from different data sources that include code examples, e.g., in a programming language. To improve search efficiency, in response to a code search query, the search system may extract code snippets from search results from relevant sources in a user interface element, such as user selectable panels.Type: ApplicationFiled: June 6, 2023Publication date: December 7, 2023Inventors: Richard Socher, Bryan McCann
-
Patent number: 11829727Abstract: Approaches for cross-lingual regularization for multilingual generalization include a method for training a natural language processing (NLP) deep learning module. The method includes accessing a first dataset having a first training data entry, the first training data entry including one or more natural language input text strings in a first language; translating at least one of the one or more natural language input text strings of the first training data entry from the first language to a second language; creating a second training data entry by starting with the first training data entry and substituting the at least one of the natural language input text strings in the first language with the translation of the at least one of the natural language input text strings in the second language; adding the second training data entry to a second dataset; and training the deep learning module using the second dataset.Type: GrantFiled: April 23, 2021Date of Patent: November 28, 2023Assignee: salesforce.com, inc.Inventors: Jasdeep Singh, Nitish Shirish Keskar, Bryan McCann
-
Patent number: 11769013Abstract: A multi-tenant system performs custom configuration of a tenant-specific chatbot to process and act upon natural language requests. The multi-tenant system configures the tenant-specific chatbots without requiring tenant-specific training. The multi-tenant system providing a user interface for configuring a tenant-specific set of permitted actions. The multi-tenant system determines a set of example phrases for each of the selected permitted actions. The multi-tenant system receives a natural language request from a user and identifies the action that the user wants to perform. The multi-tenant system uses a neural network to compare the natural language request with example phrases to identify an example phrase that matches the natural language request. The multi-tenant system performs the action corresponding to the matching example phrase.Type: GrantFiled: November 11, 2019Date of Patent: September 26, 2023Assignee: Salesforce, Inc.Inventors: Michael Machado, James Douglas Harrison, Caiming Xiong, Xinyi Yang, Thomas Archie Cook, Roojuta Lalani, Jean-Marc Soumet, Karl Ryszard Skucha, Juan Rodriguez, Manju Vijayakumar, Vishal Motwani, Tian Xie, Bryan McCann, Nitish Shirish Keskar, Zhihao Zou, Chitra Gulabrani, Minal Khodani, Adarsha Badarinath, Rohiniben Thakar, Srikanth Kollu, Kevin Schoen, Qiong Liu, Amit Hetawal, Kevin Zhang, Kevin Zhang, Johnson Liu, Rafael Amsili
-
Publication number: 20230244733Abstract: Embodiments described herein provide systems and methods for a customized search platform that provides users control and transparency in their searches. The system may use a ranker and parser to utilize input data and contextual information to identify search applications, sort the search applications, and present search results via user-engageable elements. The system may also use input from a user to personalize and update search results based on a user's interaction with user-engageable elements.Type: ApplicationFiled: April 6, 2023Publication date: August 3, 2023Inventors: Bryan McCann, Swetha Mandava, Nathaniel Roth, Richard Socher
-
Patent number: 11657233Abstract: Systems and methods for unifying question answering and text classification via span extraction include a preprocessor for preparing a source text and an auxiliary text based on a task type of a natural language processing task, an encoder for receiving the source text and the auxiliary text from the preprocessor and generating an encoded representation of a combination of the source text and the auxiliary text, and a span-extractive decoder for receiving the encoded representation and identifying a span of text within the source text that is a result of the NLP task. The task type is one of entailment, classification, or regression. In some embodiments, the source text includes one or more of text received as input when the task type is entailment, a list of classifications when the task type is entailment or classification, or a list of similarity options when the task type is regression.Type: GrantFiled: February 16, 2022Date of Patent: May 23, 2023Assignee: salesforce.com, inc.Inventors: Nitish Shirish Keskar, Bryan McCann, Richard Socher, Caiming Xiong
-
Publication number: 20230141023Abstract: Embodiments described herein provide systems and methods for a customized search platform that provides users control and transparency in their searches. The system may use a ranker and parser to utilize input data and contextual information to identify search applications, sort the search applications, and present search results via user-engageable elements. The system may also use input from a user to personalize and update search results based on a user's interaction with user-engageable elements.Type: ApplicationFiled: November 4, 2022Publication date: May 11, 2023Inventors: Bryan McCann, Swetha Mandava, Nathaniel Roth, Richard Socher
-
Patent number: 11615249Abstract: Approaches for multitask learning as question answering include an input layer for encoding a context and a question, a self-attention based transformer including an encoder and a decoder, a first bi-directional long-term short-term memory (biLSTM) for further encoding an output of the encoder, a long-term short-term memory (LSTM) for generating a context-adjusted hidden state from the output of the decoder and a hidden state, an attention network for generating first attention weights based on an output of the first biLSTM and an output of the LSTM, a vocabulary layer for generating a distribution over a vocabulary, a context layer for generating a distribution over the context, and a switch for generating a weighting between the distributions over the vocabulary and the context, generating a composite distribution based on the weighting, and selecting a word of an answer using the composite distribution.Type: GrantFiled: August 18, 2020Date of Patent: March 28, 2023Assignee: salesforce.com, inc.Inventors: Bryan McCann, Nitish Shirish Keskar, Caiming Xiong, Richard Socher
-
Patent number: 11600194Abstract: Approaches for natural language processing include a multi-layer encoder for encoding words from a context and words from a question in parallel, a multi-layer decoder for decoding the encoded context and the encoded question, a pointer generator for generating distributions over the words from the context, the words from the question, and words in a vocabulary based on an output from the decoder, and a switch. The switch generates a weighting of the distributions over the words from the context, the words from the question, and the words in the vocabulary, generates a composite distribution based on the weighting of the distribution over the first words from the context, the distribution over the second words from the question, and the distribution over the words in the vocabulary, and selects words for inclusion in an answer using the composite distribution.Type: GrantFiled: June 12, 2018Date of Patent: March 7, 2023Assignee: Salesforce.com, Inc.Inventors: Bryan McCann, Nitish Shirish Keskar, Caiming Xiong, Richard Socher
-
Patent number: 11501076Abstract: Approaches for multitask learning as question answering include a method for training that includes receiving a plurality of training samples including training samples from a plurality of task types, presenting the training samples to a neural model to generate an answer, determining an error between the generated answer and the natural language ground truth answer for each training sample presented, and adjusting parameters of the neural model based on the error. Each of the training samples includes a natural language context, question, and ground truth answer. An order in which the training samples are presented to the neural model includes initially selecting the training samples according to a first training strategy and switching to selecting the training samples according to a second training strategy. In some embodiments the first training strategy is a sequential training strategy and the second training strategy is a joint training strategy.Type: GrantFiled: May 8, 2018Date of Patent: November 15, 2022Assignee: SALESFORCE.COM, INC.Inventors: Nitish Shirish Keskar, Bryan McCann, Caiming Xiong, Richard Socher
-
Patent number: 11436481Abstract: A method for natural language processing includes receiving, by one or more processors, an unstructured text input. An entity classifier is used to identify entities in the unstructured text input. The identifying the entities includes generating, using a plurality of sub-classifiers of a hierarchical neural network classifier of the entity classifier, a plurality of lower-level entity identifications associated with the unstructured text input. The identifying the entities further includes generating, using a combiner of the hierarchical neural network classifier, a plurality of higher-level entity identifications associated with the unstructured text input based on the plurality of lower-level entity identifications. Identified entities are provided based on the plurality of higher-level entity identifications.Type: GrantFiled: September 18, 2018Date of Patent: September 6, 2022Assignee: SALESFORCE.COM, INC.Inventors: Govardana Sachithanandam Ramachandran, Michael Machado, Shashank Harinath, Linwei Zhu, Yufan Xue, Abhishek Sharma, Jean-Marc Soumet, Bryan McCann
-
Patent number: 11409945Abstract: A system is provided for natural language processing. In some embodiments, the system includes an encoder for generating context-specific word vectors for at least one input sequence of words. The encoder is pre-trained using training data for performing a first natural language processing task. A neural network performs a second natural language processing task on the at least one input sequence of words using the context-specific word vectors. The first natural language process task is different from the second natural language processing task and the neural network is separately trained from the encoder. In some embodiments, the first natural processing task can be machine translation, and the second natural processing task can be one of sentiment analysis, question classification, entailment classification, and question answering.Type: GrantFiled: September 21, 2020Date of Patent: August 9, 2022Assignee: SALESFORCE.COM, INC.Inventors: Bryan McCann, Caiming Xiong, Richard Socher
-
Patent number: 11366969Abstract: According to some embodiments, systems and methods are provided to develop or provide common sense auto-generated explanations (CAGE) for the reasoning used by an artificial intelligence, neural network, or deep learning model to make a prediction. In some embodiments, the systems and methods use supervised fine-tuning on a language model (LM) to generate such explanations. These explanations may then be used for downstream classification.Type: GrantFiled: April 24, 2019Date of Patent: June 21, 2022Assignee: salesforce.com, inc.Inventors: Nazneen Rajani, Bryan McCann
-
Patent number: 11354565Abstract: The technology disclosed proposes using a combination of computationally cheap, less-accurate bag of words (BoW) model and computationally expensive, more-accurate long short-term memory (LSTM) model to perform natural processing tasks such as sentiment analysis. The use of cheap, less-accurate BoW model is referred to herein as “skimming”. The use of expensive, more-accurate LSTM model is referred to herein as “reading”. The technology disclosed presents a probability-based guider (PBG). PBG combines the use of BoW model and the LSTM model. PBG uses a probability thresholding strategy to determine, based on the results of the BoW model, whether to invoke the LSTM model for reliably classifying a sentence as positive or negative. The technology disclosed also presents a deep neural network-based decision network (DDN) that is trained to learn the relationship between the BoW model and the LSTM model and to invoke only one of the two models.Type: GrantFiled: December 22, 2017Date of Patent: June 7, 2022Assignee: salesforce.com, inc.Inventors: Alexander Rosenberg Johansen, Bryan McCann, James Bradbury, Richard Socher
-
Publication number: 20220171943Abstract: Systems and methods for unifying question answering and text classification via span extraction include a preprocessor for preparing a source text and an auxiliary text based on a task type of a natural language processing task, an encoder for receiving the source text and the auxiliary text from the preprocessor and generating an encoded representation of a combination of the source text and the auxiliary text, and a span-extractive decoder for receiving the encoded representation and identifying a span of text within the source text that is a result of the NLP task. The task type is one of entailment, classification, or regression. In some embodiments, the source text includes one or more of text received as input when the task type is entailment, a list of classifications when the task type is entailment or classification, or a list of similarity options when the task type is regression.Type: ApplicationFiled: February 16, 2022Publication date: June 2, 2022Inventors: Nitish Shirish Keskar, Bryan McCann, Richard Socher, Caiming Xiong