Patents by Inventor Tzu-Chan Chuang

Tzu-Chan Chuang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20250078484
    Abstract: Implementations relate to generating and using multimodal embeddings. In various implementations, first modality data may be obtained and encoded into first modality embedding(s) using a trained first modality encoder that is stored in memory of edge-based client device(s). Second modality data may be obtained and encoded into second modality embedding(s) using a trained second modality encoder that is also stored in the memory of the edge-based client device(s). The first and second modality embeddings may be processed using an edge-based multimodal LLM that is also stored locally in memory of the edge-based client device(s) to generate a multimodal contextual embedding, which may be provided to a remote server that hosts a central LLM, e.g., in conjunction with a natural language input provided by the user. Information generated using the central LLM, responsive to the natural language input, may be received from the remote server.
    Type: Application
    Filed: September 5, 2023
    Publication date: March 6, 2025
    Inventors: Tuan Nguyen, Sergei Volnov, Yunfan Ye, Alexey Galata, William A. Truong, Tzu-Chan Chuang, Liang-yu Chen, Qiong Huang, Krunal Shah, Sai Aditya Chitturu, Sana Mithani
  • Publication number: 20250005293
    Abstract: Implementations relate to leveraging large language model(s) (LLMs) and vision language model(s) (VLMs) to facilitate human-to-computer dialogs. In various implementations, one or more digital images may be processed using one or more VLMs to generate VLM output indicative of a state of an environment. An LLM prompt may be assembled based on the VLM output and a natural language input. The LLM prompt may be processed using one or more LLMs to generate content that is responsive to the natural language input. The content that is responsive to the natural language input may subsequently be rendered at one or more output devices.
    Type: Application
    Filed: June 30, 2023
    Publication date: January 2, 2025
    Inventors: Tuan Nguyen, Sergei Volnov, William A. Truong, Yunfan Ye, Sana Mithani, Neel Joshi, Alexey Galata, Tzu-Chan Chuang, Liang-yu Chen, Qiong Huang, Krunal Shah, Sai Aditya Chitturu
  • Publication number: 20240347062
    Abstract: Hot word free adaptation, of function(s) of an automated assistant, responsive to determining, based on gaze measure(s) and/or active speech measure(s), that a user is engaging with the automated assistant. Implementations relate to techniques for mitigating false positive occurrences of and/or false negative occurrences, of hot word free adaptation, through utilization of a permissive parameter set in some situation(s) and a restrictive parameter set in other situation(s). For example, utilizing the restrictive parameter set when it is determined that a user is engaged in conversation with additional user(s). The permissive parameter set includes permissive parameter(s) that are more permissive than counterpart(s) in the restrictive parameter set.
    Type: Application
    Filed: June 24, 2024
    Publication date: October 17, 2024
    Inventors: Tuan Nguyen, Gabriel Leblanc, Qiong Huang, Alexey Galata, Tzu-Chan Chuang, William A. Truong, Yixing Cai, Yuan Yuan
  • Patent number: 12020704
    Abstract: Hot word free adaptation, of function(s) of an automated assistant, responsive to determining, based on gaze measure(s) and/or active speech measure(s), that a user is engaging with the automated assistant. Implementations relate to techniques for mitigating false positive occurrences of and/or false negative occurrences, of hot word free adaptation, through utilization of a permissive parameter set in some situation(s) and a restrictive parameter set in other situation(s). For example, utilizing the restrictive parameter set when it is determined that a user is engaged in conversation with additional user(s). The permissive parameter set includes permissive parameter(s) that are more permissive than counterpart(s) in the restrictive parameter set.
    Type: Grant
    Filed: January 19, 2022
    Date of Patent: June 25, 2024
    Assignee: GOOGLE LLC
    Inventors: Tuan Nguyen, Gabriel Leblanc, Qiong Huang, Alexey Galata, Tzu-Chan Chuang, William A. Truong, Yixing Cai, Yuan Yuan
  • Publication number: 20230230587
    Abstract: Hot word free adaptation, of function(s) of an automated assistant, responsive to determining, based on gaze measure(s) and/or active speech measure(s), that a user is engaging with the automated assistant. Implementations relate to techniques for mitigating false positive occurrences of and/or false negative occurrences, of hot word free adaptation, through utilization of a permissive parameter set in some situation(s) and a restrictive parameter set in other situation(s). For example, utilizing the restrictive parameter set when it is determined that a user is engaged in conversation with additional user(s). The permissive parameter set includes permissive parameter(s) that are more permissive than counterpart(s) in the restrictive parameter set.
    Type: Application
    Filed: January 19, 2022
    Publication date: July 20, 2023
    Inventors: Tuan Nguyen, Gabriel Leblanc, Qiong Huang, Alexey Galata, Tzu-Chan Chuang, William A. Truong, Yixing Cai, Yuan Yuan
  • Publication number: 20230230583
    Abstract: Hot word free adaptation, of one or more function(s) of an automated assistant, responsive to determining, based on gaze measure(s) and/or active speech measure(s), that a user is engaging with the automated assistant. Implementations relate to various techniques for mitigating false positive occurrences of and/or false negative occurrences, of hot word free adaptation, through utilization of personalized parameter(s) for at least some user(s) of an assistant device. The personalized parameter(s) are utilized in determining whether condition(s) are satisfied, where those condition(s), if satisfied, indicate that the user is engaging in hot word free interaction with the automated assistant and result in adaptation of function(s) of the automated assistant.
    Type: Application
    Filed: January 19, 2022
    Publication date: July 20, 2023
    Inventors: Tuan Nguyen, Gabriel Leblanc, Tzu-Chan Chuang, Qiong Huang, William A. Truong, Yixing Cai, Alexey Galata, Yuan Yuan