Patents by Inventor James Edward Stewart

James Edward Stewart has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220300753
    Abstract: A method for recognizing persons in video streams includes obtaining a live video stream, detecting a first person in the live video stream, determining from analysis of the live video stream first information that identifies an attribute of the first person, determining based on at least some of the first information that the first person is not identifiable to the computing system, storing at least some of the first information, receiving a user classification of the first person as being a stranger, and deleting the stored first information.
    Type: Application
    Filed: June 7, 2022
    Publication date: September 22, 2022
    Applicant: Google LLC
    Inventors: Akshay R. Bapat, George Alban Heitz, III, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
  • Publication number: 20220247978
    Abstract: A method of presenting appropriate actions for responding to a visitor to a smart home environment via an electronic greeting system of the smart home environment, including detecting a visitor of the smart home environment; obtaining context information from the smart home environment regarding the visitor; based on the context information, identifying a plurality of appropriate actions available to a user of a client device for interacting with the visitor via the electronic greeting system; and causing the identified actions to be presented to the user of the client device.
    Type: Application
    Filed: April 19, 2022
    Publication date: August 4, 2022
    Applicant: Google LLC
    Inventors: Jason Evans Goulden, Rengarajan Aravamudhan, Hae Rim Jeong, Michael Dixon, James Edward Stewart, Sayed Yusef Shafi, Sahana Mysore, Seungho Yang, Yu-An Lien, Christopher Charles Burns, Rajeev Conrad Nongpiur, Jeffrey Boyd
  • Publication number: 20220245396
    Abstract: The various implementations described herein include systems and methods for recognizing persons in video streams. In one aspect, a method includes: (1) obtaining a live video stream; (2) detecting person(s) in the stream; and (3) determining, from analysis of the live video stream, personally identifiable information of the detected person(s); (4) determining, based on the personally identifiable information, that the first person is not known to the computing system; (5) in accordance with the determination that the first person is not known: (a) storing the personally identifiable information; and (b) requesting a user to classify the first person; and (6) in accordance with (i) a determination that a predetermined amount of time has elapsed since the request was transmitted and a response was not received, or (ii) a determination that a response was received classifying the first person as a stranger, deleting the stored personally identifiable information.
    Type: Application
    Filed: February 18, 2022
    Publication date: August 4, 2022
    Applicant: Google LLC
    Inventors: Akshay R. Bapat, George Alban Heitz, III, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
  • Publication number: 20220237948
    Abstract: A method of detecting and responding to a visitor to a smart home environment via an electronic greeting system of the smart home environment, including determining that a visitor is approaching an entryway of the smart home environment; initiating a facial recognition operation while the visitor is approaching the entryway; initiating an observation window in response to the determination that a visitor is approaching the entryway; obtaining context information from one or more sensors of the smart home environment during the observation window; and at the end of the time window, initiating a response to the detected approach of the visitor based on the context information and/or an outcome of the facial recognition operation.
    Type: Application
    Filed: February 18, 2022
    Publication date: July 28, 2022
    Applicant: Google LLC
    Inventors: Jason Evans Goulden, Rengarajan Aravamudhan, Hae Rim Jeong, Michael Dixon, James Edward Stewart, Sayed Yusef Shafi, Sahana Mysore, Seungho Yang, Yu-An Lien, Christopher Charles Burns, Rajeev Nongpiur, Jeffrey Boyd
  • Patent number: 11386285
    Abstract: A method for recognizing persons in video streams includes obtaining a live video stream, detecting a first person in the live video stream, determining from analysis of the live video stream first information that identifies an attribute of the first person, determining based on at least some of the first information that the first person is not identifiable to the computing system, storing at least some of the first information, receiving a user classification of the first person as being a stranger, and deleting the stored first information.
    Type: Grant
    Filed: May 29, 2020
    Date of Patent: July 12, 2022
    Assignee: Google LLC
    Inventors: Akshay R. Bapat, George Alban Heitz, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
  • Publication number: 20220215664
    Abstract: A method at a server system includes: receiving a video stream from a remote video camera, wherein the video stream comprises a plurality of video frames; selecting a plurality of non-contiguous frames from the video stream, the plurality of non-contiguous frames being associated with a predetermined time interval; encoding the plurality of non-contiguous frames as a compressed video segment associated with the time interval; receiving a request from an application running on a client device to review video from the remote video camera for the time interval; and in response to the request, transmitting the video segment to the client device for viewing in the application.
    Type: Application
    Filed: January 28, 2022
    Publication date: July 7, 2022
    Applicant: Google LLC
    Inventors: Christopher Charles Burns, George Alban Heitz, III, James Edward Stewart, Cameron Hill, Seungho Yang, Joe Delone Venters, William Alex Finlayson, Carsten Hinz, Timothy Samuel Psiaki, Nathan Scott Klee, Gregory Rourk Nelson, Kevin James Avery, Lawrence W. Neal, Martin Davidsson
  • Patent number: 11356643
    Abstract: A method of presenting appropriate actions for responding to a visitor to a smart home environment via an electronic greeting system of the smart home environment, including detecting a visitor of the smart home environment; obtaining context information from the smart home environment regarding the visitor; based on the context information, identifying a plurality of appropriate actions available to a user of a client device for interacting with the visitor via the electronic greeting system; and causing the identified actions to be presented to the user of the client device.
    Type: Grant
    Filed: August 12, 2021
    Date of Patent: June 7, 2022
    Assignee: Google LLC
    Inventors: Jason Evans Goulden, Rengarajan Aravamudhan, Hae Rim Jeong, Michael Dixon, James Edward Stewart, Sayed Yusef Shafi, Sahana Mysore, Seungho Yang, Yu-An Lien, Christopher Charles Burns, Rajeev Conrad Nongpiur, Jeffrey Boyd
  • Publication number: 20220075489
    Abstract: A method at an electronic device with a display includes: displaying a user interface having a first region and a second region; receiving, and displaying in the first region of the user interface, a live video stream of a physical environment captured by a remote video camera; displaying, in the second region, a timeline corresponding to a timespan for a first portion of a duration during which the live video stream may have been recorded; in response to receiving a user interaction to move the timespan to a second portion of the duration, transitioning the displayed timeline to a new timeline that corresponds to the timespan for the second portion, and while transitioning, displaying, in the first region, a subset of video frames representing the first and/or second portion of the duration.
    Type: Application
    Filed: June 14, 2021
    Publication date: March 10, 2022
    Inventors: Christopher Charles Burns, George Alban Heitz III, James Edward Stewart, Cameron Hill, Seungho Yang, Joe Delone Venters, William Alex Finlayson, Carsten Hinz, Timothy Samuel Psiaki, Nathan Scott Klee, Gregory Rourk Nelson, Kevin James Avery, Lawrence W. Neal, Martin Davidsson
  • Patent number: 11256951
    Abstract: The various implementations described herein include systems and methods for recognizing persons in video streams. In one aspect, a method includes: obtaining images collected by video cameras in a smart home environment, each image including a detected person; for each image, obtaining first information that identifies an attribute of the detected person, the first information generated from analysis of the image; grouping the images into a first group of a plurality of groups based on the first information, each group of the plurality of groups representing a unique person; receiving a request to remove a first image from the first group; removing the first image from the first group; and disassociating the first information from the first group.
    Type: Grant
    Filed: March 23, 2020
    Date of Patent: February 22, 2022
    Assignee: Google LLC
    Inventors: Akshay R. Bapat, George Alban Heitz, III, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
  • Patent number: 11256908
    Abstract: A method of detecting and responding to a visitor to a smart home environment via an electronic greeting system of the smart home environment, including determining that a visitor is approaching an entryway of the smart home environment; initiating a facial recognition operation while the visitor is approaching the entryway; initiating an observation window in response to the determination that a visitor is approaching the entryway; obtaining context information from one or more sensors of the smart home environment during the observation window; and at the end of the time window, initiating a response to the detected approach of the visitor based on the context information and/or an outcome of the facial recognition operation.
    Type: Grant
    Filed: May 26, 2020
    Date of Patent: February 22, 2022
    Assignee: Google LLC
    Inventors: Jason Evans Goulden, Rengarajan Aravamudhan, Hae Rim Jeong, Michael Dixon, James Edward Stewart, Sayed Yusef Shafi, Sahana Mysore, Seungho Yang, Yu-An Lien, Christopher Charles Burns, Rajeev Nongpiur, Jeffrey Boyd
  • Patent number: 11238290
    Abstract: A method at a server system includes: receiving a video stream from a remote video camera, wherein the video stream comprises a plurality of video frames; selecting a plurality of non-contiguous frames from the video stream, the plurality of non-contiguous frames being associated with a predetermined time interval; encoding the plurality of non-contiguous frames as a compressed video segment associated with the time interval; receiving a request from an application running on a client device to review video from the remote video camera for the time interval; and in response to the request, transmitting the video segment to the client device for viewing in the application.
    Type: Grant
    Filed: October 26, 2016
    Date of Patent: February 1, 2022
    Assignee: Google LLC
    Inventors: Christopher Charles Burns, George Alban Heitz, III, James Edward Stewart, Cameron Hill, Seungho Yang, Joe Delone Venters, William Alex Finlayson, Carsten Hinz, Timothy Samuel Psiaki, Nathan Scott Klee, Gregory Rourk Nelson, Kevin James Avery, Lawrence W. Neal, Martin Davidsson
  • Publication number: 20210377493
    Abstract: A method of presenting appropriate actions for responding to a visitor to a smart home environment via an electronic greeting system of the smart home environment, including detecting a visitor of the smart home environment; obtaining context information from the smart home environment regarding the visitor; based on the context information, identifying a plurality of appropriate actions available to a user of a client device for interacting with the visitor via the electronic greeting system; and causing the identified actions to be presented to the user of the client device.
    Type: Application
    Filed: August 12, 2021
    Publication date: December 2, 2021
    Inventors: Jason Evans Goulden, Rengarajan Aravamudhan, Hae Rim Jeong, Michael Dixon, James Edward Stewart, Sayed Yusef Shafi, Sahana Mysore, Seungho Yang, Yu-An Lien, Christopher Charles Burns, Rajeev Conrad Nongpiur, Jeffrey Boyd
  • Patent number: 11134227
    Abstract: A method of presenting appropriate actions for responding to a visitor to a smart home environment via an electronic greeting system of the smart home environment, including detecting a visitor of the smart home environment; obtaining context information from the smart home environment regarding the visitor; based on the context information, identifying a plurality of appropriate actions available to a user of a client device for interacting with the visitor via the electronic greeting system; and causing the identified actions to be presented to the user of the client device.
    Type: Grant
    Filed: November 10, 2017
    Date of Patent: September 28, 2021
    Assignee: Google LLC
    Inventors: Jason Evans Goulden, Rengarajan Aravamudhan, Hae Rim Jeong, Michael Dixon, James Edward Stewart, Sayed Yusef Shafi, Sahana Mysore, Seungho Yang, Yu-An Lien, Christopher Charles Burns, Rajeev Nongpiur, Jeffrey Boyd
  • Publication number: 20210216787
    Abstract: A method includes obtaining from an image sensor of a video camera a primary real-time video stream comprising images of a field of view of the video camera; identifying from the primary video stream one or more regions of interest in the field of view of the video camera; while obtaining the primary video stream, creating a first video sub-stream comprising a first plurality of images for a first one of the one or more identified regions of interest, wherein: images of the first plurality of images include image data for portions of the field of the video camera that include the first identified region of interest, and the images of the first plurality of images have fields of view that are smaller than the field of view of the video camera; and providing the first video sub-stream for display at a client device.
    Type: Application
    Filed: March 29, 2021
    Publication date: July 15, 2021
    Applicant: Google LLC
    Inventors: Joost van Hoof, Navneet Dalal, James Edward Stewart, Ting Yu, Maxime Veron, George Alban Heitz, III
  • Patent number: 11036361
    Abstract: A method at an electronic device with a display includes: displaying a user interface having a first region and a second region; receiving, and displaying in the first region of the user interface, a live video stream of a physical environment captured by a remote video camera; displaying, in the second region, a timeline corresponding to a timespan for a first portion of a duration during which the live video stream may have been recorded; in response to receiving a user interaction to move the timespan to a second portion of the duration, transitioning the displayed timeline to a new timeline that corresponds to the timespan for the second portion, and while transitioning, displaying, in the first region, a subset of video frames representing the first and/or second portion of the duration.
    Type: Grant
    Filed: August 8, 2019
    Date of Patent: June 15, 2021
    Assignee: Google LLC
    Inventors: Christopher Charles Burns, George Alban Heitz, III, James Edward Stewart, Cameron Hill, Seungho Yang, Joe Delone Venters, William Alex Finlayson, Carsten Hinz, Timothy Samuel Psiaki, Nathan Scott Klee, Gregory Rourk Nelson, Kevin James Avery, Lawrence W. Neal, Martin Davidsson
  • Patent number: 10871890
    Abstract: A method, in an application executing on a client device, includes: displaying a camera event history provided by a remote server system, where the camera event history is presented as a chronologically-ordered set of event identifiers, each event identifier corresponding to a respective event for which a remote camera has captured an associated video; receiving a user selection of a displayed event identifier; and in response to receiving the user selection of the displayed event identifier: expanding the selected event identifier into a video player window, the video player window consuming a portion of the displayed camera event history; and playing, in the video player window, the captured video; and in response to terminating playback of the captured video or user de-selection of the displayed event identifier, collapsing the video player window into the selected event identifier thereby stopping the playing of the captured video.
    Type: Grant
    Filed: February 4, 2020
    Date of Patent: December 22, 2020
    Assignee: GOOGLE LLC
    Inventors: Melissa McLean, Michael Mizono, Lauren Von Dehsen, Joe Delone Venters, Tracy Kuwatani, Zachery Kennedy, James Edward Stewart
  • Publication number: 20200293818
    Abstract: A method for recognizing persons in video streams includes obtaining a live video stream, detecting a first person in the live video stream, determining from analysis of the live video stream first information that identifies an attribute of the first person, determining based on at least some of the first information that the first person is not identifiable to the computing system, storing at least some of the first information, receiving a user classification of the first person as being a stranger, and deleting the stored first information.
    Type: Application
    Filed: May 29, 2020
    Publication date: September 17, 2020
    Inventors: Akshay R. Bapat, George Alban Heitz, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
  • Publication number: 20200285841
    Abstract: A method of detecting and responding to a visitor to a smart home environment via an electronic greeting system of the smart home environment, including determining that a visitor is approaching an entryway of the smart home environment; initiating a facial recognition operation while the visitor is approaching the entryway; initiating an observation window in response to the determination that a visitor is approaching the entryway; obtaining context information from one or more sensors of the smart home environment during the observation window; and at the end of the time window, initiating a response to the detected approach of the visitor based on the context information and/or an outcome of the facial recognition operation.
    Type: Application
    Filed: May 26, 2020
    Publication date: September 10, 2020
    Inventors: Jason Evans Goulden, RENGARAJAN ARAVAMUDHAN, Haerim Jeong, Michael Dixon, James Edward Stewart, Sayed Yusef Shafi, Sahana Mysore, Seungho Yang, Yu-An Lien, Christopher Charles Burns, Rajeev Nongpiur, Jeffrey Boyd
  • Patent number: D902233
    Type: Grant
    Filed: January 31, 2019
    Date of Patent: November 17, 2020
    Assignee: GOOGLE LLC
    Inventors: James Edward Stewart, Seungho Yang, Joe Venters, Carsten Hinz
  • Patent number: D920354
    Type: Grant
    Filed: January 31, 2019
    Date of Patent: May 25, 2021
    Assignee: GOOGLE LLC
    Inventors: James Edward Stewart, Seungho Yang, Joe Delone Venters, Carsten Hinz