Patents by Inventor Jinsong Yu
Jinsong Yu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11908181Abstract: In one embodiment, a method includes receiving a user query inputted on a head-mounted device from the head-mounted device, wherein the user query corresponds to multiple dialog-intents, executing multiple tasks corresponding to the multiple dialog-intents, generating a multi-perspective response by a stitching model based on two or more of execution results of the multiple tasks, wherein the stitching model combines the two or more of the execution results based on natural language processing, and wherein the multi-perspective response comprises a natural-language response combining the two or more execution results, and sending instructions to the head-mounted device for presenting the multi-perspective response on the head-mounted device.Type: GrantFiled: February 3, 2023Date of Patent: February 20, 2024Assignee: Meta Platforms, Inc.Inventors: Emmanouil Koukoumidis, Michael Robert Hanson, Rajen Subba, Heidi Young, Rushin Shah, Jinsong Yu, Benoit F. Dumoulin, Jeremy Gillmor Kahn, Chandrasekhar Iyer
-
Patent number: 11842522Abstract: In one embodiment, a method includes receiving a user query inputted on a head-mounted device from the head-mounted device, wherein the user query corresponds to multiple dialog-intents, executing multiple tasks corresponding to the multiple dialog-intents, generating a multi-perspective response by a stitching model based on two or more of execution results of the multiple tasks, wherein the stitching model combines the two or more of the execution results based on natural language processing, and wherein the multi-perspective response comprises a natural-language response combining the two or more execution results, and sending instructions to the head-mounted device for presenting the multi-perspective response on the head-mounted device.Type: GrantFiled: February 3, 2023Date of Patent: December 12, 2023Assignee: Meta Platforms, Inc.Inventors: Emmanouil Koukoumidis, Michael Robert Hanson, Rajen Subba, Heidi Young, Rushin Shah, Jinsong Yu, Benoit F. Dumoulin, Jeremy Gillmor Kahn, Chandrasekhar Iyer
-
Publication number: 20230245654Abstract: In one embodiment, a system includes an automatic speech recognition (ASR) module, a natural-language understanding (NLU) module, a dialog manager, one or more agents, an arbitrator, a delivery system, one or more processors, and a non-transitory memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to receive a user input, process the user input using the ASR module, the NLU module, the dialog manager, one or more of the agents, the arbitrator, and the delivery system, and provide a response to the user input.Type: ApplicationFiled: January 20, 2023Publication date: August 3, 2023Inventors: Akshat Shrivastava, Shrey Desai, Anchit Gupta, Ali Elkahky, Aleksandr Livshits, Alexander Kolmykov-Zotov, Ahmed Aly, Jinsong Yu, Manali Anand Naik, Shuhui Yang, Baiyang Liu, Surya Teja Appini, Tarun Vir Singh, Hang Su, Jiedan Zhu, Fuchun Peng, Shoubhik Bhattacharya, Kshitiz Malik, Shreyan Bakshi, Akash Bharadwaj, Harish Srinivas, Xiao Yang, Zhuangqun Huang, Gil Keren, Duc Hoang Le, Ahmed Kamal Atwa Mohamed, Zhe Liu, Pranab Mohanty
-
Patent number: 11715289Abstract: In one embodiment, a method includes receiving a user query associated with dialog-intents at a client system, executing tasks corresponding to the dialog-intents, generating a multi-perspective response by a stitching model based on two or more of execution results of the tasks, wherein the multi-perspective response comprises a natural-language response combining the two or more execution results, and presenting the multi-perspective response at the client system.Type: GrantFiled: December 6, 2021Date of Patent: August 1, 2023Assignee: Meta Platforms, Inc.Inventors: Emmanouil Koukoumidis, Michael Robert Hanson, Rajen Subba, Heidi Young, Rushin Shah, Jinsong Yu, Benoit F. Dumoulin, Jeremy Gillmor Kahn, Chandrasekhar Iyer
-
Publication number: 20230186618Abstract: In one embodiment, a method includes receiving a user query inputted on a head-mounted device from the head-mounted device, wherein the user query corresponds to multiple dialog-intents, executing multiple tasks corresponding to the multiple dialog-intents, generating a multi-perspective response by a stitching model based on two or more of execution results of the multiple tasks, wherein the stitching model combines the two or more of the execution results based on natural language processing, and wherein the multi-perspective response comprises a natural-language response combining the two or more execution results, and sending instructions to the head-mounted device for presenting the multi-perspective response on the head-mounted device.Type: ApplicationFiled: February 3, 2023Publication date: June 15, 2023Inventors: Emmanouil Koukoumidis, Michael Robert Hanson, Rajen Subba, Heidi Young, Rushin Shah, Jinsong Yu, Benoit F. Dumoulin, Jeremy Gillmor Kahn, Chandrasekhar Iyer
-
Publication number: 20220374460Abstract: In one embodiment, a method includes receiving a user input from a first user at the first client system, determining that the user input is a sharing request to share content, determining multiple second users the sharing request is directed to, determining, for each second user, modalities associated with the respective second user based on the content, a user profile associated with the respective second user, and modalities supported by a second client system the respective second user is currently engaged with, the respective second user being associated with two or more second client systems, and sending, to one or more second client systems currently associated with the second users, instructions for accessing the content based on the determined modalities for each second user.Type: ApplicationFiled: July 21, 2022Publication date: November 24, 2022Inventors: Jinsong Yu, Zhengping Zuo, Guowei Shieh, Fuchun Peng
-
Publication number: 20220327289Abstract: In one embodiment, a method includes receiving, at a client system via a client-side assistant process, a first audio input from a first user. The method includes generating multiple transcriptions corresponding to the first audio input based on multiple client-side automatic speech recognition (ASR) engines. Each ASR engine is associated with a respective domain out of multiple domains. The method includes determining, for each transcription, a combination of one or more tasks and one or more entities to be associated with the transcription. The method includes selecting one or more combinations of tasks and entities from the multiple combinations to be associated with the first audio input based on a determined selection strategy. The method includes presenting, via the client-side assistant process, a response to the first audio input based on the selected combinations.Type: ApplicationFiled: June 16, 2022Publication date: October 13, 2022Inventors: Fuchun Peng, Jihang Li, Jinsong Yu
-
Patent number: 11429649Abstract: In one embodiment, a method includes receiving a sharing request to share content generated during a current dialog session from a client system associated with a first user, identifying one or more content objects associated with the sharing request based on a natural-language understanding module, wherein the one or more content objects were previously generated during the current dialog session, determining one or more second users the sharing request is directed to based on a user profile associated with first user, and sending instructions for accessing one or more of the identified content objects to one or more client systems associated with the one or more second users.Type: GrantFiled: June 18, 2018Date of Patent: August 30, 2022Assignee: Meta Platforms, Inc.Inventors: Jinsong Yu, Zhengping Zuo, Guowei Shieh, Fuchun Peng
-
Patent number: 11403466Abstract: In one embodiment, a method includes receiving, from a client system associated with a first user, a first audio input. The method includes generating multiple transcriptions corresponding to the first audio input based on multiple automatic speech recognition (ASR) engines. Each ASR engine is associated with a respective domain out of multiple domains. The method includes determining, for each transcription, a combination of one or more intents and one or more slots to be associated with the transcription. The method includes selecting, by a meta-speech engine, one or more combinations of intents and slots from the multiple combinations to be associated with the first user input. The method includes generating a response to the first audio input based on the selected combinations and sending, to the client system, instructions for presenting the response to the first audio input.Type: GrantFiled: January 13, 2020Date of Patent: August 2, 2022Assignee: Facebook Technologies, LLC.Inventors: Fuchun Peng, Jihang Li, Jinsong Yu
-
Patent number: 11366971Abstract: In one embodiment, a method includes receiving, from a client system associated with a first user, a first audio input. The method includes generating multiple transcriptions corresponding to the first audio input based on multiple automatic speech recognition (ASR) engines. Each ASR engine is associated with a respective domain out of multiple domains. The method includes determining, for each transcription, a combination of one or more intents and one or more slots to be associated with the transcription. The method includes selecting, by a meta-speech engine, one or more combinations of intents and slots from the multiple combinations to be associated with the first user input. The method includes generating a response to the first audio input based on the selected combinations and sending, to the client system, instructions for presenting the response to the first audio input.Type: GrantFiled: January 13, 2020Date of Patent: June 21, 2022Assignee: Facebook Technologies, LLC.Inventors: Fuchun Peng, Jihang Li, Jinsong Yu
-
Publication number: 20220129556Abstract: In one embodiment, a system includes an automatic speech recognition (ASR) module, a natural-language understanding (NLU) module, a dialog manager, one or more agents, an arbitrator, a delivery system, one or more processors, and a non-transitory memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to receive a user input, process the user input using the ASR module, the NLU module, the dialog manager, one or more of the agents, the arbitrator, and the delivery system, and provide a response to the user input.Type: ApplicationFiled: October 27, 2021Publication date: April 28, 2022Inventors: Zhiyu Chen, Honglei Liu, Hu Xu, Seungwhan Moon, Hao Zhou, Bing Liu, Zihang Meng, Amy Lawson Bearman, Ahmed Magdy Hamed Mohamed, Eric Robert Northup, Jihang Li, Jinsong Yu, Jeremy Gillmor Kahn, Lloyd Hilaiel, Justin Denney, Christophe Chaland
-
Patent number: 11308169Abstract: In one embodiment, a method includes receiving a user query from a client system associated with a first user, determining a plurality of dialog-intents, each being associated with a particular agent of a plurality of agents, executing a plurality of tasks corresponding to the user query via the plurality of agents corresponding to the plurality of dialog-intents, receiving a plurality of execution results corresponding to the plurality of tasks from the plurality of agents, respectively, selecting two or more of the plurality of execution results for combination, generating a multi-perspective response based on the selected execution results by a stitching model, wherein the multi-perspective response comprises a natural-language response combining the selected execution results, and sending instructions for presenting the multi-perspective response to the first user to the client system in response to the user query.Type: GrantFiled: October 31, 2018Date of Patent: April 19, 2022Assignee: Meta Platforms, Inc.Inventors: Emmanouil Koukoumidis, Michael Robert Hanson, Rajen Subba, Heidi Young, Rushin Shah, Jinsong Yu, Benoit F. Dumoulin, Jeremy Gillmor Kahn, Chandrasekhar Iyer
-
Publication number: 20220092131Abstract: In one embodiment, a method includes receiving a user query associated with dialog-intents at a client system, executing tasks corresponding to the dialog-intents, generating a multi-perspective response by a stitching model based on two or more of execution results of the tasks, wherein the multi-perspective response comprises a natural-language response combining the two or more execution results, and presenting the multi-perspective response at the client system.Type: ApplicationFiled: December 6, 2021Publication date: March 24, 2022Inventors: Emmanouil Koukoumidis, Michael Robert Hanson, Rajen Subba, Heidi Young, Rushin Shah, Jinsong Yu, Benoit F. Dumoulin, Jeremy Gillmor Kahn, Chandrasekhar Iyer
-
Patent number: 11263276Abstract: In one embodiment, a method includes receiving a user query from a client system associated with a first user, determining a plurality of dialog-intents, each being associated with a particular agent of a plurality of agents, executing a plurality of tasks corresponding to the user query via the plurality of agents corresponding to the plurality of dialog-intents, receiving a plurality of execution results corresponding to the plurality of tasks from the plurality of agents, respectively, selecting two or more of the plurality of execution results for combination, generating a multi-perspective response based on the selected execution results by a stitching model, wherein the multi-perspective response comprises a natural-language response combining the selected execution results, and sending instructions for presenting the multi-perspective response to the first user to the client system in response to the user query.Type: GrantFiled: October 31, 2018Date of Patent: March 1, 2022Assignee: Meta Platforms, Inc.Inventors: Emmanouil Koukoumidis, Michael Robert Hanson, Rajen Subba, Heidi Young, Rushin Shah, Jinsong Yu, Benoit F. Dumoulin, Jeremy Gillmor Kahn, Chandrasekhar Iyer
-
Patent number: 11115410Abstract: In one embodiment, a method includes receiving a first audio input from a user requesting access to information or a service, sending a request for the information or service to an authentication server, where the request includes first authentication information based on the first audio input and further includes a user identifier associated with the user, receiving a second audio input from a client system of the user, where the second audio input includes a first authentication code to be compared to a second authentication code generated by the authentication server, sending second authentication information based on the second audio input and the user identifier to the authentication server for verification, receiving, from the authentication server, an indication of whether the user is successfully authenticated based on the second authentication information, and providing, to the user, access to the information or service when the user is successfully authenticated.Type: GrantFiled: November 6, 2018Date of Patent: September 7, 2021Assignee: Facebook, Inc.Inventors: Michael Robert Hanson, Lloyd Hilaiel, Jinsong Yu, Heidi Young, Gary Eugene Baalman, Rachel Jordan Engel
-
Publication number: 20210118440Abstract: In one embodiment, a method includes receiving, from a client system associated with a first user, a first audio input. The method includes generating multiple transcriptions corresponding to the first audio input based on multiple automatic speech recognition (ASR) engines. Each ASR engine is associated with a respective domain out of multiple domains. The method includes determining, for each transcription, a combination of one or more intents and one or more slots to be associated with the transcription. The method includes selecting, by a meta-speech engine, one or more combinations of intents and slots from the multiple combinations to be associated with the first user input. The method includes generating a response to the first audio input based on the selected combinations and sending, to the client system, instructions for presenting the response to the first audio input.Type: ApplicationFiled: January 13, 2020Publication date: April 22, 2021Inventors: Fuchun Peng, Jihang Li, Jinsong Yu
-
Publication number: 20190325042Abstract: In one embodiment, a method includes receiving a sharing request to share content generated during a current dialog session from a client system associated with a first user, identifying one or more content objects associated with the sharing request based on a natural-language understanding module, wherein the one or more content objects were previously generated during the current dialog session, determining one or more second users the sharing request is directed to based on a user profile associated with first user, and sending instructions for accessing one or more of the identified content objects to one or more client systems associated with tPhe one or more second users.Type: ApplicationFiled: June 18, 2018Publication date: October 24, 2019Inventors: Jinsong Yu, Zhengping Zuo, Guowei Shieh, Fuchun Peng
-
Patent number: 9811319Abstract: Automatically generating code used with device drivers for interfacing with hardware. The method includes receiving a machine readable description of a hardware device, including at least one of hardware registers or shared memory structures of the hardware device. The method further includes determining an operating system with which the hardware device is to be used. The method further includes processing the machine readable description on a code generation tool to automatically generate code for a hardware driver for the hardware device specific to the determined operating system.Type: GrantFiled: January 4, 2013Date of Patent: November 7, 2017Assignee: Microsoft Technology Licensing, LLCInventors: Yaron Weinsberg, Jinsong Yu, Maxim Grabarnik, Davide Massarenti
-
Patent number: 9802751Abstract: An attachment mechanism for a container includes a housing with a locking element extending therefrom. At least one opening extends through the locking element to selectively receive a portion of the container. A resilient member is disposed within the locking element.Type: GrantFiled: February 13, 2015Date of Patent: October 31, 2017Assignee: S. C. Johnson & Son, Inc.Inventors: Scott W. Demarest, Donald J. Schumacher, Christine D. Beilstein, Dirk K. Nickel, Jinsong Yu, Gang Liu, Xiaogang Tan, Yuanheng Liu
-
Patent number: 9772826Abstract: Build-time resolution and type-enforcing of corresponding references in different code that references the same value. In response to detecting a directive within the code itself that a first reference in first code is to be correlated with a second reference in second code, and in response to detection that the types of the references are the same, a code generation tool generates correlation code that is interpretable to a compiler as allowing a value of a type of the first reference of a compiled-form of the first code to be passed as the same value of the same type of the second reference of a compiled-form of the second code. The first code, the second code, and the generated correlation code may then be compiled. If compilation is successful, this means that the first and second references are already properly resolved as referring to the same value and type-enforced.Type: GrantFiled: October 4, 2013Date of Patent: September 26, 2017Assignee: Microsoft Technology Licensing, LLCInventors: Wen-Ke Chen, Jinsong Yu, Alexander P. Riemann