Patents by Inventor Jonathan H. RUSSELL
Jonathan H. RUSSELL has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240064370Abstract: Systems and processes are disclosed for controlling television user interactions using a virtual assistant. In an example process, a virtual assistant can interact with a television set-top box to control content shown on a television display. Speech input for the virtual assistant can be received from a device with a microphone. The speech input can comprise a query associated with content shown on the television display. A user intent of the query can be determined based on one or more of the content shown on the television display and a viewing history of media content. A result of the query can be caused to be displayed based on the determined user intent.Type: ApplicationFiled: October 30, 2023Publication date: February 22, 2024Inventors: Marcel VAN OS, Rohit DASARI, Patrick M. LISTER, Lia T. NAPOLITANO, Jonathan H. RUSSELL, Harry J. SADDLER
-
Patent number: 11838579Abstract: Systems and processes are disclosed for controlling television user interactions using a virtual assistant. In an example process, a virtual assistant can interact with a television set-top box to control content shown on a television display. Speech input for the virtual assistant can be received from a device with a microphone. The speech input can comprise a query associated with content shown on the television display. A user intent of the query can be determined based on one or more of the content shown on the television display and a viewing history of media content. A result of the query can be caused to be displayed based on the determined user intent.Type: GrantFiled: October 25, 2022Date of Patent: December 5, 2023Assignee: Apple Inc.Inventors: Marcel Van Os, Harry J. Saddler, Lia T. Napolitano, Jonathan H. Russell, Patrick M. Lister, Rohit Dasari
-
Publication number: 20230368791Abstract: Systems and processes for application integration with a digital assistant are provided. In accordance with one example, a method includes, at an electronic device having one or more processors and memory, receiving a natural-language user input; identifying, with the one or more processors, an intent object of a set of intent objects and a parameter associated with the intent, where the intent object and the parameter are derived from the natural-language user input. The method further includes identifying a software application associated with the intent object of the set of intent objects; and providing the intent object and the parameter to the software application.Type: ApplicationFiled: July 26, 2023Publication date: November 16, 2023Inventors: Robert A. WALKER, II, Brandon J. NEWENDORP, Rohit DASARI, Richard D. GIULI, Thomas R. GRUBER, Carey E. RADEBAUGH, Ashish GARG, Vineet KHOSLA, Jonathan H. RUSSELL, Corey PETERSON
-
Patent number: 11809483Abstract: Systems and processes are disclosed for operating a digital assistant in a media environment. In an example process, a primary set of media items can be displayed. An audio input containing a media-related request can be received. A primary user intent corresponding to the media-related request can be determined. In accordance with a determination that the primary user intent comprises a user intent to narrow the primary media search query, a second primary media search query corresponding to the primary user intent can be generated. The second primary media search query can be based on the media-related request and the primary media search query. The second primary media search query can be performed to obtain a second primary set of media items. Display of the primary set of media items can be replaced with display of the second primary set of media items.Type: GrantFiled: March 5, 2021Date of Patent: November 7, 2023Assignee: Apple Inc.Inventors: Ryan M. Orr, Raumi N. Sidki, Patrick M. Lister, Jonathan H. Russell
-
Patent number: 11749275Abstract: Systems and processes for application integration with a digital assistant are provided. In accordance with one example, a method includes, at an electronic device having one or more processors and memory, receiving a natural-language user input; identifying, with the one or more processors, an intent object of a set of intent objects and a parameter associated with the intent, where the intent object and the parameter are derived from the natural-language user input. The method further includes identifying a software application associated with the intent object of the set of intent objects; and providing the intent object and the parameter to the software application.Type: GrantFiled: October 8, 2021Date of Patent: September 5, 2023Assignee: Apple Inc.Inventors: Robert A. Walker, II, Brandon J. Newendorp, Rohit Dasari, Richard D. Giuli, Thomas R. Gruber, Carey E. Radebaugh, Ashish Garg, Vineet Khosla, Jonathan H. Russell, Corey Peterson
-
Publication number: 20230066552Abstract: Systems and processes are disclosed for controlling television user interactions using a virtual assistant. In an example process, a virtual assistant can interact with a television set-top box to control content shown on a television display. Speech input for the virtual assistant can be received from a device with a microphone. The speech input can comprise a query associated with content shown on the television display. A user intent of the query can be determined based on one or more of the content shown on the television display and a viewing history of media content. A result of the query can be caused to be displayed based on the determined user intent.Type: ApplicationFiled: October 25, 2022Publication date: March 2, 2023Inventors: Marcel VAN OS, Harry J. SADDLER, Lia T. NAPOLITANO, Jonathan H. RUSSELL, Patrick M. LISTER, Rohit DASARI
-
Publication number: 20230058929Abstract: An example process includes while an electronic device is engaged in a communication session with external device(s): receiving, from a first user of the electronic device, input to invoke a first digital assistant; receiving, from the first user, a natural language input corresponding to a task; in accordance with invoking the first digital assistant, generating, by the first digital assistant, a prompt for further user input about the task; transmitting, to the external device(s), the prompt for further user input about the task; after transmitting the prompt for further user input, receiving, from an external device of the external device(s), a response to the prompt for further user input; initiating, by the first digital assistant, based on the response and information corresponding to the first user stored on the electronic device, the task; and transmitting, to the external device(s), an output indicative of the initiated task.Type: ApplicationFiled: July 18, 2022Publication date: February 23, 2023Inventors: Rae L. LASKO, German W. BAUER, Felicia W. EDWARDS, Niranjan MANJUNATH, Jonathan H. RUSSELL, Lynn I. STREJA, Keith C. STRICKLING, Garrett L. WEINBERG
-
Publication number: 20230042836Abstract: The present disclosure relates to resolving natural language ambiguities with respect to a simulated reality setting. In an exemplary embodiment, a simulated reality setting having one or more virtual objects is displayed. A stream of gaze events is generated from the simulated reality setting and a stream of gaze data. A speech input is received within a time period and a domain is determined based on a text representation of the speech input. Based on the time period and a plurality of event times for the stream of gaze events, one or more gaze events are identified from the stream of gaze events. The identified one or more gaze events is used to determine a parameter value for an unresolved parameter of the domain. A set of tasks representing a user intent for the speech input is determined based on the parameter value and the set of tasks is performed.Type: ApplicationFiled: October 19, 2022Publication date: February 9, 2023Inventors: Niranjan MANJUNATH, Scott M. ANDRUS, Xinyuan HUANG, William W. LUCIW, Jonathan H. RUSSELL
-
Patent number: 11516537Abstract: Systems and processes are disclosed for controlling television user interactions using a virtual assistant. In an example process, a virtual assistant can interact with a television set-top box to control content shown on a television display. Speech input for the virtual assistant can be received from a device with a microphone. The speech input can comprise a query associated with content shown on the television display. A user intent of the query can be determined based on one or more of the content shown on the television display and a viewing history of media content. A result of the query can be caused to be displayed based on the determined user intent.Type: GrantFiled: December 17, 2020Date of Patent: November 29, 2022Assignee: Apple Inc.Inventors: Marcel Van Os, Harry J. Saddler, Lia T. Napolitano, Jonathan H. Russell, Patrick M. Lister, Rohit Dasari
-
Patent number: 11507183Abstract: The present disclosure relates to resolving natural language ambiguities with respect to a simulated reality setting. In an exemplary embodiment, a simulated reality setting having one or more virtual objects is displayed. A stream of gaze events is generated from the simulated reality setting and a stream of gaze data. A speech input is received within a time period and a domain is determined based on a text representation of the speech input. Based on the time period and a plurality of event times for the stream of gaze events, one or more gaze events are identified from the stream of gaze events. The identified one or more gaze events is used to determine a parameter value for an unresolved parameter of the domain. A set of tasks representing a user intent for the speech input is determined based on the parameter value and the set of tasks is performed.Type: GrantFiled: September 16, 2020Date of Patent: November 22, 2022Assignee: Apple Inc.Inventors: Niranjan Manjunath, Scott M. Andrus, Xinyuan Huang, William W. Luciw, Jonathan H. Russell
-
Publication number: 20220028387Abstract: Systems and processes for application integration with a digital assistant are provided. In accordance with one example, a method includes, at an electronic device having one or more processors and memory, receiving a natural-language user input; identifying, with the one or more processors, an intent object of a set of intent objects and a parameter associated with the intent, where the intent object and the parameter are derived from the natural-language user input. The method further includes identifying a software application associated with the intent object of the set of intent objects; and providing the intent object and the parameter to the software application.Type: ApplicationFiled: October 8, 2021Publication date: January 27, 2022Inventors: Robert A. WALKER, II, Brandon J. NEWENDORP, Rohit DASARI, Richard D. GIULI, Thomas R. GRUBER, Carey E. RADEBAUGH, Ashish GARG, Vineet KHOSLA, Jonathan H. RUSSELL, Corey PETERSON
-
Patent number: 11152002Abstract: Systems and processes for application integration with a digital assistant are provided. In accordance with one example, a method includes, at an electronic device having one or more processors and memory, receiving a natural-language user input; identifying, with the one or more processors, an intent object of a set of intent objects and a parameter associated with the intent, where the intent object and the parameter are derived from the natural-language user input. The method further includes identifying a software application associated with the intent object of the set of intent objects; and providing the intent object and the parameter to the software application.Type: GrantFiled: January 8, 2020Date of Patent: October 19, 2021Assignee: Apple Inc.Inventors: Robert A. Walker, II, Brandon J. Newendorp, Rohit Dasari, Richard D. Giuli, Thomas R. Gruber, Carey E. Radebaugh, Ashish Garg, Vineet Khosla, Jonathan H. Russell, Corey Peterson
-
Publication number: 20210191968Abstract: Systems and processes are disclosed for operating a digital assistant in a media environment. In an example process, a primary set of media items can be displayed. An audio input containing a media-related request can be received. A primary user intent corresponding to the media-related request can be determined. In accordance with a determination that the primary user intent comprises a user intent to narrow the primary media search query, a second primary media search query corresponding to the primary user intent can be generated. The second primary media search query can be based on the media-related request and the primary media search query. The second primary media search query can be performed to obtain a second primary set of media items. Display of the primary set of media items can be replaced with display of the second primary set of media items.Type: ApplicationFiled: March 5, 2021Publication date: June 24, 2021Inventors: Ryan M. ORR, Raumi N. SIDKI, Patrick M. LISTER, Jonathan H. RUSSELL
-
Publication number: 20210105528Abstract: Systems and processes are disclosed for controlling television user interactions using a virtual assistant. In an example process, a virtual assistant can interact with a television set-top box to control content shown on a television display. Speech input for the virtual assistant can be received from a device with a microphone. The speech input can comprise a query associated with content shown on the television display. A user intent of the query can be determined based on one or more of the content shown on the television display and a viewing history of media content. A result of the query can be caused to be displayed based on the determined user intent.Type: ApplicationFiled: December 17, 2020Publication date: April 8, 2021Inventors: Marcel VAN OS, Harry J. SADDLER, Lia T. NAPOLITANO, Jonathan H. RUSSELL, Patrick M. LISTER, Rohit DASARI
-
Publication number: 20210089124Abstract: The present disclosure relates to resolving natural language ambiguities with respect to a simulated reality setting. In an exemplary embodiment, a simulated reality setting having one or more virtual objects is displayed. A stream of gaze events is generated from the simulated reality setting and a stream of gaze data. A speech input is received within a time period and a domain is determined based on a text representation of the speech input. Based on the time period and a plurality of event times for the stream of gaze events, one or more gaze events are identified from the stream of gaze events. The identified one or more gaze events is used to determine a parameter value for an unresolved parameter of the domain. A set of tasks representing a user intent for the speech input is determined based on the parameter value and the set of tasks is performed.Type: ApplicationFiled: September 16, 2020Publication date: March 25, 2021Inventors: Niranjan MANJUNATH, Scott M. ANDRUS, Xinyuan HUANG, William W. LUCIW, Jonathan H. RUSSELL
-
Patent number: 10956486Abstract: Systems and processes are disclosed for operating a digital assistant in a media environment. In an example process, a primary set of media items can be displayed. An audio input containing a media-related request can be received. A primary user intent corresponding to the media-related request can be determined. In accordance with a determination that the primary user intent comprises a user intent to narrow the primary media search query, a second primary media search query corresponding to the primary user intent can be generated. The second primary media search query can be based on the media-related request and the primary media search query. The second primary media search query can be performed to obtain a second primary set of media items. Display of the primary set of media items can be replaced with display of the second primary set of media items.Type: GrantFiled: July 30, 2019Date of Patent: March 23, 2021Assignee: Apple Inc.Inventors: Ryan M. Orr, Raumi N. Sidki, Patrick M. Lister, Jonathan H. Russell
-
Patent number: 10904611Abstract: Systems and processes are disclosed for controlling television user interactions using a virtual assistant. In an example process, a virtual assistant can interact with a television set-top box to control content shown on a television display. Speech input for the virtual assistant can be received from a device with a microphone. The speech input can comprise a query associated with content shown on the television display. A user intent of the query can be determined based on one or more of the content shown on the television display and a viewing history of media content. A result of the query can be caused to be displayed based on the determined user intent.Type: GrantFiled: April 24, 2017Date of Patent: January 26, 2021Assignee: Apple Inc.Inventors: Marcel Van Os, Harry J. Saddler, Lia T. Napolitano, Jonathan H. Russell, Patrick M. Lister, Rohit Dasari
-
Patent number: 10740384Abstract: Systems and processes are disclosed for operating a digital assistant in a media environment. In an example process, a primary set of media items can be displayed. An audio input containing a media-related request can be received. A primary user intent corresponding to the media-related request can be determined. In accordance with a determination that the primary user intent comprises a user intent to narrow the primary media search query, a second primary media search query corresponding to the primary user intent can be generated. The second primary media search query can be based on the media-related request and the primary media search query. The second primary media search query can be performed to obtain a second primary set of media items. Display of the primary set of media items can be replaced with display of the second primary set of media items.Type: GrantFiled: December 8, 2015Date of Patent: August 11, 2020Assignee: Apple Inc.Inventors: Ryan M. Orr, Raumi N. Sidki, Patrick M. Lister, Jonathan H. Russell
-
Publication number: 20200143812Abstract: Systems and processes for application integration with a digital assistant are provided. In accordance with one example, a method includes, at an electronic device having one or more processors and memory, receiving a natural-language user input; identifying, with the one or more processors, an intent object of a set of intent objects and a parameter associated with the intent, where the intent object and the parameter are derived from the natural-language user input. The method further includes identifying a software application associated with the intent object of the set of intent objects; and providing the intent object and the parameter to the software application.Type: ApplicationFiled: January 8, 2020Publication date: May 7, 2020Inventors: Robert A. WALKER, II, Brandon J. NEWENDORP, Rohit DASARI, Richard D. GIULI, Thomas R. GRUBER, Carey E. RADEBAUGH, Ashish GARG, Vineet KHOSLA, Jonathan H. RUSSELL, Corey PETERSON
-
Patent number: 10580409Abstract: Systems and processes for application integration with a digital assistant are provided. In accordance with one example, a method includes, at an electronic device having one or more processors and memory, receiving a natural-language user input; identifying, with the one or more processors, an intent object of a set of intent objects and a parameter associated with the intent, where the intent object and the parameter are derived from the natural-language user input. The method further includes identifying a software application associated with the intent object of the set of intent objects; and providing the intent object and the parameter to the software application.Type: GrantFiled: December 3, 2018Date of Patent: March 3, 2020Assignee: Apple Inc.Inventors: Robert A. Walker, II, Brandon J. Newendorp, Rohit Dasari, Richard D. Giuli, Thomas R. Gruber, Carey E. Radebaugh, Ashish Garg, Vineet Khosla, Jonathan H. Russell, Corey Peterson