Patents by Inventor Lily Shuting ZHANG

Lily Shuting ZHANG has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240347059
    Abstract: This relates to an intelligent automated assistant in a video communication session environment. An example method includes, during a video communication session between at least two user devices, and at a first user device: receiving a first user voice input; in accordance with a determination that the first user voice input represents a communal digital assistant request, transmitting a request to provide context information associated with the first user voice input to the first user device; receiving context information associated with the first user voice input; obtaining a first digital assistant response based at least on a portion of the context information received from the second user device and at least a portion of context information associated with the first user voice input that is stored on the first user device; providing the first digital assistant response to the second user device; and outputting the first digital assistant response.
    Type: Application
    Filed: June 10, 2024
    Publication date: October 17, 2024
    Inventors: Niranjan MANJUNATH, Willem MATTELAER, Jessica PECK, Lily Shuting ZHANG
  • Patent number: 12033636
    Abstract: This relates to an intelligent automated assistant in a video communication environment. An example includes, during a video communication session between at least two devices, receiving a voice input at one device, generating and transmitting to a server a textual representation of the voice input, receiving from the server a shared transcription including both the textual representation of the voice input and one or more additional textual representations generated by another device, and determining and presenting one or more candidate tasks based on the shared transcription.
    Type: Grant
    Filed: August 9, 2023
    Date of Patent: July 9, 2024
    Assignee: Apple Inc.
    Inventors: Niranjan Manjunath, Willem Mattelaer, Jessica Peck, Lily Shuting Zhang
  • Patent number: 11837232
    Abstract: This relates to an intelligent automated assistant in a video communication session environment. An example method includes, during a video communication session between at least two user devices, and at a first user device: receiving a first user voice input; in accordance with a determination that the first user voice input represents a communal digital assistant request, transmitting a request to provide context information associated with the first user voice input to the first user device; receiving context information associated with the first user voice input; obtaining a first digital assistant response based at least on a portion of the context information received from the second user device and at least a portion of context information associated with the first user voice input that is stored on the first user device; providing the first digital assistant response to the second user device; and outputting the first digital assistant response.
    Type: Grant
    Filed: February 28, 2023
    Date of Patent: December 5, 2023
    Assignee: Apple Inc.
    Inventors: Niranjan Manjunath, Willem Mattelaer, Jessica Peck, Lily Shuting Zhang
  • Publication number: 20230386464
    Abstract: Embodiments provide a context-aware digital assistant at multiple user devices participating in a video communication session by using context information from a first user device to determine a digital assistant response at a second user device. In this manner, users participating in the video communication session may interact with the digital assistant during the video communication session as if the digital assistant is another participant in the video communication session. Embodiments further describe automatically determining candidate digital assistant tasks based on a shared transcription of user voice inputs received at user devices participating in a video communication session. In this manner, a digital assistant of a user device participating in a video communication session may proactively determine one or more tasks that a user of the user device may want the digital assistant to perform based on conversations held during the video communication session.
    Type: Application
    Filed: August 9, 2023
    Publication date: November 30, 2023
    Inventors: Niranjan MANJUNATH, Willem MATTELAER, Jessica PECK, Lily Shuting ZHANG
  • Patent number: 11769497
    Abstract: Embodiments provide a context-aware digital assistant at multiple user devices participating in a video communication session by using context information from a first user device to determine a digital assistant response at a second user device. In this manner, users participating in the video communication session may interact with the digital assistant during the video communication session as if the digital assistant is another participant in the video communication session. Embodiments further describe automatically determining candidate digital assistant tasks based on a shared transcription of user voice inputs received at user devices participating in a video communication session. In this manner, a digital assistant of a user device participating in a video communication session may proactively determine one or more tasks that a user of the user device may want the digital assistant to perform based on conversations held during the video communication session.
    Type: Grant
    Filed: January 26, 2021
    Date of Patent: September 26, 2023
    Assignee: Apple Inc.
    Inventors: Niranjan Manjunath, Willem Mattelaer, Jessica Peck, Lily Shuting Zhang
  • Publication number: 20230215435
    Abstract: This relates to an intelligent automated assistant in a video communication session environment. An example method includes, during a video communication session between at least two user devices, and at a first user device: receiving a first user voice input; in accordance with a determination that the first user voice input represents a communal digital assistant request, transmitting a request to provide context information associated with the first user voice input to the first user device; receiving context information associated with the first user voice input; obtaining a first digital assistant response based at least on a portion of the context information received from the second user device and at least a portion of context information associated with the first user voice input that is stored on the first user device; providing the first digital assistant response to the second user device; and outputting the first digital assistant response.
    Type: Application
    Filed: February 28, 2023
    Publication date: July 6, 2023
    Inventors: Niranjan MANJUNATH, Willem MATTELAER, Jessica PECK, Lily Shuting ZHANG
  • Publication number: 20210249009
    Abstract: This relates to an intelligent automated assistant in a video communication session environment. An example method includes, during a video communication session between at least two user devices, and at a first user device of the at least two user devices: receiving a first user input; obtaining a first digital assistant response based on the first user input; providing, to a second user device of the at least two user devices, the first digital assistant response and context information associated with the first user input; outputting the first digital assistant response; receiving a second digital assistant response and context information associated with a second user input, wherein the second user input is received at the second user device, and wherein the second digital assistant response is determined based on the second user input and the context information associated with the first user input; and outputting the second digital assistant response.
    Type: Application
    Filed: January 26, 2021
    Publication date: August 12, 2021
    Inventors: Niranjan MANJUNATH, Willem MATTELAER, Jessica PECK, Lily Shuting ZHANG