Patents by Inventor Avik Ray
Avik Ray has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11875231Abstract: An electronic device for complex task machine learning includes at least one memory and at least one processor coupled to the at least one memory. The at least one processor is configured to receive an unknown command for performing a task and generate a prompt regarding the unknown command. The at least one processor is also configured to receive one or more instructions in response to the prompt, where each of the one or more instructions provides information on performing at least a portion of the task. The at least one processor is further configured to determine at least one action for each one of the one or more instructions. In addition, the at least one processor is configured to create a complex action for performing the task based on the at least one action for each one of the one or more instructions.Type: GrantFiled: October 23, 2019Date of Patent: January 16, 2024Assignee: Samsung Electronics Co., Ltd.Inventors: Avik Ray, Yilin Shen, Hongxia Jin
-
Patent number: 11854528Abstract: An apparatus for detecting unsupported utterances in natural language understanding, includes a memory storing instructions, and at least one processor configured to execute the instructions to classify a feature that is extracted from an input utterance of a user, as one of in-domain and out-of-domain (OOD) for a response to the input utterance, obtain an OOD score of the extracted feature, and identify whether the feature is classified as OOD. The at least one processor is further configured to executed the instructions to, based on the feature being identified to be classified as in-domain, identify whether the obtained OOD score is greater than a predefined threshold, and based on the OOD score being identified to be greater than the predefined threshold, re-classify the feature as OOD.Type: GrantFiled: August 13, 2021Date of Patent: December 26, 2023Assignee: SAMSUNG ELECTRONICS CO., LTD.Inventors: Yen-Chang Hsu, Yilin Shen, Avik Ray, Hongxia Jin
-
Patent number: 11790895Abstract: An electronic device for natural language understanding includes at least one memory and at least one processor coupled to the at least one memory. The at least one processor is configured to process an utterance using a trained model. The at least one processor is also configured to replace a first portion of the utterance with a first token, where the first token represents a semantic role of the first portion of the utterance based on a slot vocabulary. The at least one processor is further configured to determine a slot value in the utterance based on the first token. In addition, the at least one processor is configured to perform a task corresponding to the utterance based on the determined slot value.Type: GrantFiled: October 23, 2019Date of Patent: October 17, 2023Assignee: Samsung Electronics Co., Ltd.Inventors: Avik Ray, Hongxia Jin
-
Patent number: 11775815Abstract: An electronic device including a deep memory model includes at least one memory and at least one processor coupled to the at least one memory. The at least one processor is configured to receive input data to the deep memory model. The at least one processor is also configured to extract a history state of an external memory coupled to the deep memory model based on the input data. The at least one processor is further configured to update the history state of the external memory based on the input data. In addition, the at least one processor is configured to output a prediction based on the extracted history state of the external memory.Type: GrantFiled: August 8, 2019Date of Patent: October 3, 2023Assignee: Samsung Electronics Co., Ltd.Inventors: Yilin Shen, Yue Deng, Avik Ray, Hongxia Jin
-
Publication number: 20220375457Abstract: A method includes identifying multiple tokens contained in an input utterance. The method also includes generating slot labels for at least some of the tokens contained in the input utterance using a trained machine learning model. The method further includes determining at least one action to be performed in response to the input utterance based on at least one of the slot labels. The trained machine learning model is trained to use attention distributions generated such that (i) the attention distributions associated with tokens having dissimilar slot labels are forced to be different and (ii) the attention distribution associated with each token is forced to not focus primarily on that token itself.Type: ApplicationFiled: January 10, 2022Publication date: November 24, 2022Inventors: Avik Ray, Yilin Shen, Hongxia Jin
-
Patent number: 11501753Abstract: A method includes receiving, from an electronic device, information defining a user utterance associated with a skill to be performed, where the skill is not recognized by a natural language understanding (NLU) engine. The method also includes receiving, from the electronic device, information defining one or more actions for performing the skill. The method further includes identifying, using at least one processor, one or more known skills having one or more slots that map to at least one word or phrase in the user utterance. The method also includes creating, using the at least one processor, a plurality of additional utterances based on the one or more mapped slots. In addition, the method includes training, using the at least one processor, the NLU engine using the plurality of additional utterances.Type: GrantFiled: December 27, 2019Date of Patent: November 15, 2022Assignee: Samsung Electronics Co., Ltd.Inventors: Yilin Shen, Avik Ray, Hongxia Jin
-
Publication number: 20220199070Abstract: An apparatus for detecting unsupported utterances in natural language understanding, includes a memory storing instructions, and at least one processor configured to execute the instructions to classify a feature that is extracted from an input utterance of a user, as one of in-domain and out-of-domain (OOD) for a response to the input utterance, obtain an OOD score of the extracted feature, and identify whether the feature is classified as OOD. The at least one processor is further configured to executed the instructions to, based on the feature being identified to be classified as in-domain, identify whether the obtained OOD score is greater than a predefined threshold, and based on the OOD score being identified to be greater than the predefined threshold, re-classify the feature as OOD.Type: ApplicationFiled: August 13, 2021Publication date: June 23, 2022Applicant: SAMSUNG ELECTRONICS CO., LTD.Inventors: Yen-Chang Hsu, Yilin Shen, Avik Ray, Hongxia JIN
-
Patent number: 11314940Abstract: A method includes determining, by an electronic device, a skill from a first natural language (NL) input. Upon successful determination of the skill, the first NL input is transmitted to a custom skill parser for determination of a skill intent. The custom skill parser is trained based on data including at least a custom training data set. Upon unsuccessful determination of the skill, the first NL input is transmitted to a generic parser for determination of a general intent of the first NL input.Type: GrantFiled: May 22, 2018Date of Patent: April 26, 2022Assignee: SAMSUNG ELECTRONICS CO., LTD.Inventors: Avik Ray, Yilin Shen, Hongxia Jin
-
Patent number: 11275896Abstract: A method includes determining, by an electronic device, a skill from a first natural language (NL) input. Upon successful determination of the skill, the first NL input is transmitted to a custom skill parser for determination of a skill intent. The custom skill parser is trained based on data including at least a custom training data set. Upon unsuccessful determination of the skill, the first NL input is transmitted to a generic parser for determination of a general intent of the first NL input.Type: GrantFiled: May 22, 2018Date of Patent: March 15, 2022Assignee: SAMSUNG ELECTRONICS CO., LTD.Inventors: Avik Ray, Yilin Shen, Hongxia Jin
-
Patent number: 11182565Abstract: A method includes retrieving, at an electronic device, a first natural language (NL) input. An intent of the first NL input is undetermined by both a generic parser and a personal parser. A paraphrase of the first NL input is retrieved at the electronic device. An intent of the paraphrase of the first NL input is determined using at least one of: the generic parser, the personal parser, or a combination thereof. A new personal intent for the first NL input is generated based on the determined intent. The personal parser is trained using existing personal intents and the new personal intent.Type: GrantFiled: February 23, 2018Date of Patent: November 23, 2021Assignee: Samsung Electronics Co., Ltd.Inventors: Avik Ray, Yilin Shen, Hongxia Jin
-
Patent number: 11036926Abstract: A system receives a phrase that includes at least one tagged object and generates instantiated phrases by instantiations of each tagged object in the phrase. The system generates lists of natural language phrases by corresponding paraphrases of each of the instantiated phrases. The system generates ordered lists of natural language phrases by ordering natural language phrases in each list of natural language phrases based on occurrences of each natural language phrase. The system generates annotated natural language phrases by using each tagged object in the phrase to annotate the ordered lists of natural language phrases or an enhanced set of natural language phrases that is based on the ordered lists of natural language phrases.Type: GrantFiled: December 31, 2018Date of Patent: June 15, 2021Assignee: Samsung Electronics Co., Ltd.Inventors: Yilin Shen, Avik Ray, Hongxia Jin
-
Patent number: 10929606Abstract: A method for intelligent assistance includes identifying one or more insertion points within an input comprising text for providing additional information. A follow-up expression that includes at least a portion of the input and the additional information at the one or more insertion points is generated for clarifying or supplementing meaning of the input.Type: GrantFiled: February 23, 2018Date of Patent: February 23, 2021Assignee: Samsung Electronics Co., Ltd.Inventors: Justin C. Martineau, Avik Ray, Hongxia Jin
-
Publication number: 20200410395Abstract: An electronic device for complex task machine learning includes at least one memory and at least one processor coupled to the at least one memory. The at least one processor is configured to receive an unknown command for performing a task and generate a prompt regarding the unknown command. The at least one processor is also configured to receive one or more instructions in response to the prompt, where each of the one or more instructions provides information on performing at least a portion of the task. The at least one processor is further configured to determine at least one action for each one of the one or more instructions. In addition, the at least one processor is configured to create a complex action for performing the task based on the at least one action for each one of the one or more instructions.Type: ApplicationFiled: October 23, 2019Publication date: December 31, 2020Inventors: Avik Ray, Yilin Shen, Hongxia Jin
-
Publication number: 20200410986Abstract: A method includes receiving, from an electronic device, information defining a user utterance associated with a skill to be performed, where the skill is not recognized by a natural language understanding (NLU) engine. The method also includes receiving, from the electronic device, information defining one or more actions for performing the skill. The method further includes identifying, using at least one processor, one or more known skills having one or more slots that map to at least one word or phrase in the user utterance. The method also includes creating, using the at least one processor, a plurality of additional utterances based on the one or more mapped slots. In addition, the method includes training, using the at least one processor, the NLU engine using the plurality of additional utterances.Type: ApplicationFiled: December 27, 2019Publication date: December 31, 2020Inventors: Yilin Shen, Avik Ray, Hongxia Jin
-
Publication number: 20200410989Abstract: An electronic device for natural language understanding includes at least one memory and at least one processor coupled to the at least one memory. The at least one processor is configured to process an utterance using a trained model. The at least one processor is also configured to replace a first portion of the utterance with a first token, where the first token represents a semantic role of the first portion of the utterance based on a slot vocabulary. The at least one processor is further configured to determine a slot value in the utterance based on the first token. In addition, the at least one processor is configured to perform a task corresponding to the utterance based on the determined slot value.Type: ApplicationFiled: October 23, 2019Publication date: December 31, 2020Inventors: Avik Ray, Hongxia Jin
-
Publication number: 20200050934Abstract: An electronic device including a deep memory model includes at least one memory and at least one processor coupled to the at least one memory. The at least one processor is configured to receive input data to the deep memory model. The at least one processor is also configured to extract a history state of an external memory coupled to the deep memory model based on the input data. The at least one processor is further configured to update the history state of the external memory based on the input data. In addition, the at least one processor is configured to output a prediction based on the extracted history state of the external memory.Type: ApplicationFiled: August 8, 2019Publication date: February 13, 2020Inventors: Yilin Shen, Yue Deng, Avik Ray, Hongxia Jin
-
Publication number: 20190361978Abstract: A method includes determining, by an electronic device, a skill from a first natural language (NL) input. Upon successful determination of the skill, the first NL input is transmitted to a custom skill parser for determination of a skill intent. The custom skill parser is trained based on data including at least a custom training data set. Upon unsuccessful determination of the skill, the first NL input is transmitted to a generic parser for determination of a general intent of the first NL input.Type: ApplicationFiled: May 22, 2018Publication date: November 28, 2019Inventors: Avik Ray, Yilin Shen, Hongxia Jin
-
Publication number: 20190354578Abstract: A system receives a phrase that includes at least one tagged object and generates instantiated phrases by instantiations of each tagged object in the phrase. The system generates lists of natural language phrases by corresponding paraphrases of each of the instantiated phrases. The system generates ordered lists of natural language phrases by ordering natural language phrases in each list of natural language phrases based on occurrences of each natural language phrase. The system generates annotated natural language phrases by using each tagged object in the phrase to annotate the ordered lists of natural language phrases or an enhanced set of natural language phrases that is based on the ordered lists of natural language phrases.Type: ApplicationFiled: December 31, 2018Publication date: November 21, 2019Applicant: Samsung Electronics Co., Ltd.Inventors: Yilin Shen, Avik Ray, Hongxia Jin
-
Publication number: 20190266237Abstract: A method includes retrieving, at an electronic device, a first natural language (NL) input. An intent of the first NL input is undetermined by both a generic parser and a personal parser. A paraphrase of the first NL input is retrieved at the electronic device. An intent of the paraphrase of the first NL input is determined using at least one of: the generic parser, the personal parser, or a combination thereof. A new personal intent for the first NL input is generated based on the determined intent. The personal parser is trained using existing personal intents and the new personal intent.Type: ApplicationFiled: February 23, 2018Publication date: August 29, 2019Inventors: Avik Ray, Yilin Shen, Hongxia Jin
-
Publication number: 20190205383Abstract: A method for intelligent assistance includes identifying one or more insertion points within an input comprising text for providing additional information. A follow-up expression that includes at least a portion of the input and the additional information at the one or more insertion points is generated for clarifying or supplementing meaning of the input.Type: ApplicationFiled: February 23, 2018Publication date: July 4, 2019Inventors: Justin C. Martineau, Avik Ray, Hongxia Jin