Patents by Inventor Jinsong Yu

Jinsong Yu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11908181
    Abstract: In one embodiment, a method includes receiving a user query inputted on a head-mounted device from the head-mounted device, wherein the user query corresponds to multiple dialog-intents, executing multiple tasks corresponding to the multiple dialog-intents, generating a multi-perspective response by a stitching model based on two or more of execution results of the multiple tasks, wherein the stitching model combines the two or more of the execution results based on natural language processing, and wherein the multi-perspective response comprises a natural-language response combining the two or more execution results, and sending instructions to the head-mounted device for presenting the multi-perspective response on the head-mounted device.
    Type: Grant
    Filed: February 3, 2023
    Date of Patent: February 20, 2024
    Assignee: Meta Platforms, Inc.
    Inventors: Emmanouil Koukoumidis, Michael Robert Hanson, Rajen Subba, Heidi Young, Rushin Shah, Jinsong Yu, Benoit F. Dumoulin, Jeremy Gillmor Kahn, Chandrasekhar Iyer
  • Patent number: 11842522
    Abstract: In one embodiment, a method includes receiving a user query inputted on a head-mounted device from the head-mounted device, wherein the user query corresponds to multiple dialog-intents, executing multiple tasks corresponding to the multiple dialog-intents, generating a multi-perspective response by a stitching model based on two or more of execution results of the multiple tasks, wherein the stitching model combines the two or more of the execution results based on natural language processing, and wherein the multi-perspective response comprises a natural-language response combining the two or more execution results, and sending instructions to the head-mounted device for presenting the multi-perspective response on the head-mounted device.
    Type: Grant
    Filed: February 3, 2023
    Date of Patent: December 12, 2023
    Assignee: Meta Platforms, Inc.
    Inventors: Emmanouil Koukoumidis, Michael Robert Hanson, Rajen Subba, Heidi Young, Rushin Shah, Jinsong Yu, Benoit F. Dumoulin, Jeremy Gillmor Kahn, Chandrasekhar Iyer
  • Publication number: 20230245654
    Abstract: In one embodiment, a system includes an automatic speech recognition (ASR) module, a natural-language understanding (NLU) module, a dialog manager, one or more agents, an arbitrator, a delivery system, one or more processors, and a non-transitory memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to receive a user input, process the user input using the ASR module, the NLU module, the dialog manager, one or more of the agents, the arbitrator, and the delivery system, and provide a response to the user input.
    Type: Application
    Filed: January 20, 2023
    Publication date: August 3, 2023
    Inventors: Akshat Shrivastava, Shrey Desai, Anchit Gupta, Ali Elkahky, Aleksandr Livshits, Alexander Kolmykov-Zotov, Ahmed Aly, Jinsong Yu, Manali Anand Naik, Shuhui Yang, Baiyang Liu, Surya Teja Appini, Tarun Vir Singh, Hang Su, Jiedan Zhu, Fuchun Peng, Shoubhik Bhattacharya, Kshitiz Malik, Shreyan Bakshi, Akash Bharadwaj, Harish Srinivas, Xiao Yang, Zhuangqun Huang, Gil Keren, Duc Hoang Le, Ahmed Kamal Atwa Mohamed, Zhe Liu, Pranab Mohanty
  • Patent number: 11715289
    Abstract: In one embodiment, a method includes receiving a user query associated with dialog-intents at a client system, executing tasks corresponding to the dialog-intents, generating a multi-perspective response by a stitching model based on two or more of execution results of the tasks, wherein the multi-perspective response comprises a natural-language response combining the two or more execution results, and presenting the multi-perspective response at the client system.
    Type: Grant
    Filed: December 6, 2021
    Date of Patent: August 1, 2023
    Assignee: Meta Platforms, Inc.
    Inventors: Emmanouil Koukoumidis, Michael Robert Hanson, Rajen Subba, Heidi Young, Rushin Shah, Jinsong Yu, Benoit F. Dumoulin, Jeremy Gillmor Kahn, Chandrasekhar Iyer
  • Publication number: 20230186618
    Abstract: In one embodiment, a method includes receiving a user query inputted on a head-mounted device from the head-mounted device, wherein the user query corresponds to multiple dialog-intents, executing multiple tasks corresponding to the multiple dialog-intents, generating a multi-perspective response by a stitching model based on two or more of execution results of the multiple tasks, wherein the stitching model combines the two or more of the execution results based on natural language processing, and wherein the multi-perspective response comprises a natural-language response combining the two or more execution results, and sending instructions to the head-mounted device for presenting the multi-perspective response on the head-mounted device.
    Type: Application
    Filed: February 3, 2023
    Publication date: June 15, 2023
    Inventors: Emmanouil Koukoumidis, Michael Robert Hanson, Rajen Subba, Heidi Young, Rushin Shah, Jinsong Yu, Benoit F. Dumoulin, Jeremy Gillmor Kahn, Chandrasekhar Iyer
  • Publication number: 20220374460
    Abstract: In one embodiment, a method includes receiving a user input from a first user at the first client system, determining that the user input is a sharing request to share content, determining multiple second users the sharing request is directed to, determining, for each second user, modalities associated with the respective second user based on the content, a user profile associated with the respective second user, and modalities supported by a second client system the respective second user is currently engaged with, the respective second user being associated with two or more second client systems, and sending, to one or more second client systems currently associated with the second users, instructions for accessing the content based on the determined modalities for each second user.
    Type: Application
    Filed: July 21, 2022
    Publication date: November 24, 2022
    Inventors: Jinsong Yu, Zhengping Zuo, Guowei Shieh, Fuchun Peng
  • Publication number: 20220327289
    Abstract: In one embodiment, a method includes receiving, at a client system via a client-side assistant process, a first audio input from a first user. The method includes generating multiple transcriptions corresponding to the first audio input based on multiple client-side automatic speech recognition (ASR) engines. Each ASR engine is associated with a respective domain out of multiple domains. The method includes determining, for each transcription, a combination of one or more tasks and one or more entities to be associated with the transcription. The method includes selecting one or more combinations of tasks and entities from the multiple combinations to be associated with the first audio input based on a determined selection strategy. The method includes presenting, via the client-side assistant process, a response to the first audio input based on the selected combinations.
    Type: Application
    Filed: June 16, 2022
    Publication date: October 13, 2022
    Inventors: Fuchun Peng, Jihang Li, Jinsong Yu
  • Patent number: 11429649
    Abstract: In one embodiment, a method includes receiving a sharing request to share content generated during a current dialog session from a client system associated with a first user, identifying one or more content objects associated with the sharing request based on a natural-language understanding module, wherein the one or more content objects were previously generated during the current dialog session, determining one or more second users the sharing request is directed to based on a user profile associated with first user, and sending instructions for accessing one or more of the identified content objects to one or more client systems associated with the one or more second users.
    Type: Grant
    Filed: June 18, 2018
    Date of Patent: August 30, 2022
    Assignee: Meta Platforms, Inc.
    Inventors: Jinsong Yu, Zhengping Zuo, Guowei Shieh, Fuchun Peng
  • Patent number: 11403466
    Abstract: In one embodiment, a method includes receiving, from a client system associated with a first user, a first audio input. The method includes generating multiple transcriptions corresponding to the first audio input based on multiple automatic speech recognition (ASR) engines. Each ASR engine is associated with a respective domain out of multiple domains. The method includes determining, for each transcription, a combination of one or more intents and one or more slots to be associated with the transcription. The method includes selecting, by a meta-speech engine, one or more combinations of intents and slots from the multiple combinations to be associated with the first user input. The method includes generating a response to the first audio input based on the selected combinations and sending, to the client system, instructions for presenting the response to the first audio input.
    Type: Grant
    Filed: January 13, 2020
    Date of Patent: August 2, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Fuchun Peng, Jihang Li, Jinsong Yu
  • Patent number: 11366971
    Abstract: In one embodiment, a method includes receiving, from a client system associated with a first user, a first audio input. The method includes generating multiple transcriptions corresponding to the first audio input based on multiple automatic speech recognition (ASR) engines. Each ASR engine is associated with a respective domain out of multiple domains. The method includes determining, for each transcription, a combination of one or more intents and one or more slots to be associated with the transcription. The method includes selecting, by a meta-speech engine, one or more combinations of intents and slots from the multiple combinations to be associated with the first user input. The method includes generating a response to the first audio input based on the selected combinations and sending, to the client system, instructions for presenting the response to the first audio input.
    Type: Grant
    Filed: January 13, 2020
    Date of Patent: June 21, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Fuchun Peng, Jihang Li, Jinsong Yu
  • Publication number: 20220129556
    Abstract: In one embodiment, a system includes an automatic speech recognition (ASR) module, a natural-language understanding (NLU) module, a dialog manager, one or more agents, an arbitrator, a delivery system, one or more processors, and a non-transitory memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to receive a user input, process the user input using the ASR module, the NLU module, the dialog manager, one or more of the agents, the arbitrator, and the delivery system, and provide a response to the user input.
    Type: Application
    Filed: October 27, 2021
    Publication date: April 28, 2022
    Inventors: Zhiyu Chen, Honglei Liu, Hu Xu, Seungwhan Moon, Hao Zhou, Bing Liu, Zihang Meng, Amy Lawson Bearman, Ahmed Magdy Hamed Mohamed, Eric Robert Northup, Jihang Li, Jinsong Yu, Jeremy Gillmor Kahn, Lloyd Hilaiel, Justin Denney, Christophe Chaland
  • Patent number: 11308169
    Abstract: In one embodiment, a method includes receiving a user query from a client system associated with a first user, determining a plurality of dialog-intents, each being associated with a particular agent of a plurality of agents, executing a plurality of tasks corresponding to the user query via the plurality of agents corresponding to the plurality of dialog-intents, receiving a plurality of execution results corresponding to the plurality of tasks from the plurality of agents, respectively, selecting two or more of the plurality of execution results for combination, generating a multi-perspective response based on the selected execution results by a stitching model, wherein the multi-perspective response comprises a natural-language response combining the selected execution results, and sending instructions for presenting the multi-perspective response to the first user to the client system in response to the user query.
    Type: Grant
    Filed: October 31, 2018
    Date of Patent: April 19, 2022
    Assignee: Meta Platforms, Inc.
    Inventors: Emmanouil Koukoumidis, Michael Robert Hanson, Rajen Subba, Heidi Young, Rushin Shah, Jinsong Yu, Benoit F. Dumoulin, Jeremy Gillmor Kahn, Chandrasekhar Iyer
  • Publication number: 20220092131
    Abstract: In one embodiment, a method includes receiving a user query associated with dialog-intents at a client system, executing tasks corresponding to the dialog-intents, generating a multi-perspective response by a stitching model based on two or more of execution results of the tasks, wherein the multi-perspective response comprises a natural-language response combining the two or more execution results, and presenting the multi-perspective response at the client system.
    Type: Application
    Filed: December 6, 2021
    Publication date: March 24, 2022
    Inventors: Emmanouil Koukoumidis, Michael Robert Hanson, Rajen Subba, Heidi Young, Rushin Shah, Jinsong Yu, Benoit F. Dumoulin, Jeremy Gillmor Kahn, Chandrasekhar Iyer
  • Patent number: 11263276
    Abstract: In one embodiment, a method includes receiving a user query from a client system associated with a first user, determining a plurality of dialog-intents, each being associated with a particular agent of a plurality of agents, executing a plurality of tasks corresponding to the user query via the plurality of agents corresponding to the plurality of dialog-intents, receiving a plurality of execution results corresponding to the plurality of tasks from the plurality of agents, respectively, selecting two or more of the plurality of execution results for combination, generating a multi-perspective response based on the selected execution results by a stitching model, wherein the multi-perspective response comprises a natural-language response combining the selected execution results, and sending instructions for presenting the multi-perspective response to the first user to the client system in response to the user query.
    Type: Grant
    Filed: October 31, 2018
    Date of Patent: March 1, 2022
    Assignee: Meta Platforms, Inc.
    Inventors: Emmanouil Koukoumidis, Michael Robert Hanson, Rajen Subba, Heidi Young, Rushin Shah, Jinsong Yu, Benoit F. Dumoulin, Jeremy Gillmor Kahn, Chandrasekhar Iyer
  • Patent number: 11115410
    Abstract: In one embodiment, a method includes receiving a first audio input from a user requesting access to information or a service, sending a request for the information or service to an authentication server, where the request includes first authentication information based on the first audio input and further includes a user identifier associated with the user, receiving a second audio input from a client system of the user, where the second audio input includes a first authentication code to be compared to a second authentication code generated by the authentication server, sending second authentication information based on the second audio input and the user identifier to the authentication server for verification, receiving, from the authentication server, an indication of whether the user is successfully authenticated based on the second authentication information, and providing, to the user, access to the information or service when the user is successfully authenticated.
    Type: Grant
    Filed: November 6, 2018
    Date of Patent: September 7, 2021
    Assignee: Facebook, Inc.
    Inventors: Michael Robert Hanson, Lloyd Hilaiel, Jinsong Yu, Heidi Young, Gary Eugene Baalman, Rachel Jordan Engel
  • Publication number: 20210118440
    Abstract: In one embodiment, a method includes receiving, from a client system associated with a first user, a first audio input. The method includes generating multiple transcriptions corresponding to the first audio input based on multiple automatic speech recognition (ASR) engines. Each ASR engine is associated with a respective domain out of multiple domains. The method includes determining, for each transcription, a combination of one or more intents and one or more slots to be associated with the transcription. The method includes selecting, by a meta-speech engine, one or more combinations of intents and slots from the multiple combinations to be associated with the first user input. The method includes generating a response to the first audio input based on the selected combinations and sending, to the client system, instructions for presenting the response to the first audio input.
    Type: Application
    Filed: January 13, 2020
    Publication date: April 22, 2021
    Inventors: Fuchun Peng, Jihang Li, Jinsong Yu
  • Publication number: 20190325042
    Abstract: In one embodiment, a method includes receiving a sharing request to share content generated during a current dialog session from a client system associated with a first user, identifying one or more content objects associated with the sharing request based on a natural-language understanding module, wherein the one or more content objects were previously generated during the current dialog session, determining one or more second users the sharing request is directed to based on a user profile associated with first user, and sending instructions for accessing one or more of the identified content objects to one or more client systems associated with tPhe one or more second users.
    Type: Application
    Filed: June 18, 2018
    Publication date: October 24, 2019
    Inventors: Jinsong Yu, Zhengping Zuo, Guowei Shieh, Fuchun Peng
  • Patent number: 9811319
    Abstract: Automatically generating code used with device drivers for interfacing with hardware. The method includes receiving a machine readable description of a hardware device, including at least one of hardware registers or shared memory structures of the hardware device. The method further includes determining an operating system with which the hardware device is to be used. The method further includes processing the machine readable description on a code generation tool to automatically generate code for a hardware driver for the hardware device specific to the determined operating system.
    Type: Grant
    Filed: January 4, 2013
    Date of Patent: November 7, 2017
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Yaron Weinsberg, Jinsong Yu, Maxim Grabarnik, Davide Massarenti
  • Patent number: 9802751
    Abstract: An attachment mechanism for a container includes a housing with a locking element extending therefrom. At least one opening extends through the locking element to selectively receive a portion of the container. A resilient member is disposed within the locking element.
    Type: Grant
    Filed: February 13, 2015
    Date of Patent: October 31, 2017
    Assignee: S. C. Johnson & Son, Inc.
    Inventors: Scott W. Demarest, Donald J. Schumacher, Christine D. Beilstein, Dirk K. Nickel, Jinsong Yu, Gang Liu, Xiaogang Tan, Yuanheng Liu
  • Patent number: 9772826
    Abstract: Build-time resolution and type-enforcing of corresponding references in different code that references the same value. In response to detecting a directive within the code itself that a first reference in first code is to be correlated with a second reference in second code, and in response to detection that the types of the references are the same, a code generation tool generates correlation code that is interpretable to a compiler as allowing a value of a type of the first reference of a compiled-form of the first code to be passed as the same value of the same type of the second reference of a compiled-form of the second code. The first code, the second code, and the generated correlation code may then be compiled. If compilation is successful, this means that the first and second references are already properly resolved as referring to the same value and type-enforced.
    Type: Grant
    Filed: October 4, 2013
    Date of Patent: September 26, 2017
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Wen-Ke Chen, Jinsong Yu, Alexander P. Riemann