Patents by Inventor James Edward Stewart

James Edward Stewart has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20210377493
    Abstract: A method of presenting appropriate actions for responding to a visitor to a smart home environment via an electronic greeting system of the smart home environment, including detecting a visitor of the smart home environment; obtaining context information from the smart home environment regarding the visitor; based on the context information, identifying a plurality of appropriate actions available to a user of a client device for interacting with the visitor via the electronic greeting system; and causing the identified actions to be presented to the user of the client device.
    Type: Application
    Filed: August 12, 2021
    Publication date: December 2, 2021
    Inventors: Jason Evans Goulden, Rengarajan Aravamudhan, Hae Rim Jeong, Michael Dixon, James Edward Stewart, Sayed Yusef Shafi, Sahana Mysore, Seungho Yang, Yu-An Lien, Christopher Charles Burns, Rajeev Conrad Nongpiur, Jeffrey Boyd
  • Patent number: 11134227
    Abstract: A method of presenting appropriate actions for responding to a visitor to a smart home environment via an electronic greeting system of the smart home environment, including detecting a visitor of the smart home environment; obtaining context information from the smart home environment regarding the visitor; based on the context information, identifying a plurality of appropriate actions available to a user of a client device for interacting with the visitor via the electronic greeting system; and causing the identified actions to be presented to the user of the client device.
    Type: Grant
    Filed: November 10, 2017
    Date of Patent: September 28, 2021
    Assignee: Google LLC
    Inventors: Jason Evans Goulden, Rengarajan Aravamudhan, Hae Rim Jeong, Michael Dixon, James Edward Stewart, Sayed Yusef Shafi, Sahana Mysore, Seungho Yang, Yu-An Lien, Christopher Charles Burns, Rajeev Nongpiur, Jeffrey Boyd
  • Publication number: 20210216787
    Abstract: A method includes obtaining from an image sensor of a video camera a primary real-time video stream comprising images of a field of view of the video camera; identifying from the primary video stream one or more regions of interest in the field of view of the video camera; while obtaining the primary video stream, creating a first video sub-stream comprising a first plurality of images for a first one of the one or more identified regions of interest, wherein: images of the first plurality of images include image data for portions of the field of the video camera that include the first identified region of interest, and the images of the first plurality of images have fields of view that are smaller than the field of view of the video camera; and providing the first video sub-stream for display at a client device.
    Type: Application
    Filed: March 29, 2021
    Publication date: July 15, 2021
    Applicant: Google LLC
    Inventors: Joost van Hoof, Navneet Dalal, James Edward Stewart, Ting Yu, Maxime Veron, George Alban Heitz, III
  • Patent number: 11036361
    Abstract: A method at an electronic device with a display includes: displaying a user interface having a first region and a second region; receiving, and displaying in the first region of the user interface, a live video stream of a physical environment captured by a remote video camera; displaying, in the second region, a timeline corresponding to a timespan for a first portion of a duration during which the live video stream may have been recorded; in response to receiving a user interaction to move the timespan to a second portion of the duration, transitioning the displayed timeline to a new timeline that corresponds to the timespan for the second portion, and while transitioning, displaying, in the first region, a subset of video frames representing the first and/or second portion of the duration.
    Type: Grant
    Filed: August 8, 2019
    Date of Patent: June 15, 2021
    Assignee: Google LLC
    Inventors: Christopher Charles Burns, George Alban Heitz, III, James Edward Stewart, Cameron Hill, Seungho Yang, Joe Delone Venters, William Alex Finlayson, Carsten Hinz, Timothy Samuel Psiaki, Nathan Scott Klee, Gregory Rourk Nelson, Kevin James Avery, Lawrence W. Neal, Martin Davidsson
  • Patent number: 10871890
    Abstract: A method, in an application executing on a client device, includes: displaying a camera event history provided by a remote server system, where the camera event history is presented as a chronologically-ordered set of event identifiers, each event identifier corresponding to a respective event for which a remote camera has captured an associated video; receiving a user selection of a displayed event identifier; and in response to receiving the user selection of the displayed event identifier: expanding the selected event identifier into a video player window, the video player window consuming a portion of the displayed camera event history; and playing, in the video player window, the captured video; and in response to terminating playback of the captured video or user de-selection of the displayed event identifier, collapsing the video player window into the selected event identifier thereby stopping the playing of the captured video.
    Type: Grant
    Filed: February 4, 2020
    Date of Patent: December 22, 2020
    Assignee: GOOGLE LLC
    Inventors: Melissa McLean, Michael Mizono, Lauren Von Dehsen, Joe Delone Venters, Tracy Kuwatani, Zachery Kennedy, James Edward Stewart
  • Publication number: 20200293818
    Abstract: A method for recognizing persons in video streams includes obtaining a live video stream, detecting a first person in the live video stream, determining from analysis of the live video stream first information that identifies an attribute of the first person, determining based on at least some of the first information that the first person is not identifiable to the computing system, storing at least some of the first information, receiving a user classification of the first person as being a stranger, and deleting the stored first information.
    Type: Application
    Filed: May 29, 2020
    Publication date: September 17, 2020
    Inventors: Akshay R. Bapat, George Alban Heitz, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
  • Publication number: 20200285841
    Abstract: A method of detecting and responding to a visitor to a smart home environment via an electronic greeting system of the smart home environment, including determining that a visitor is approaching an entryway of the smart home environment; initiating a facial recognition operation while the visitor is approaching the entryway; initiating an observation window in response to the determination that a visitor is approaching the entryway; obtaining context information from one or more sensors of the smart home environment during the observation window; and at the end of the time window, initiating a response to the detected approach of the visitor based on the context information and/or an outcome of the facial recognition operation.
    Type: Application
    Filed: May 26, 2020
    Publication date: September 10, 2020
    Inventors: Jason Evans Goulden, RENGARAJAN ARAVAMUDHAN, Haerim Jeong, Michael Dixon, James Edward Stewart, Sayed Yusef Shafi, Sahana Mysore, Seungho Yang, Yu-An Lien, Christopher Charles Burns, Rajeev Nongpiur, Jeffrey Boyd
  • Publication number: 20200226416
    Abstract: The various implementations described herein include systems and methods for recognizing persons in video streams. In one aspect, a method includes: obtaining images collected by video cameras in a smart home environment, each image including a detected person; for each image, obtaining first information that identifies an attribute of the detected person, the first information generated from analysis of the image; grouping the images into a first group of a plurality of groups based on the first information, each group of the plurality of groups representing a unique person; receiving a request to remove a first image from the first group; removing the first image from the first group; and disassociating the first information from the first group.
    Type: Application
    Filed: March 23, 2020
    Publication date: July 16, 2020
    Inventors: Akshay R. Bapat, George Alban Heitz, III, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
  • Publication number: 20200211347
    Abstract: A method at a computing system includes obtaining video of an environment including a plurality of objects; defining a zone including a portion of the environment; subsequent to the defining, detecting a motion event captured in the video occurring at least partially within the zone, wherein the motion event is associated with a first object of the plurality of objects; identifying an object type of the first object; and based on the object type of the first object, causing a notification of the motion event to be issued or not issued.
    Type: Application
    Filed: March 10, 2020
    Publication date: July 2, 2020
    Inventors: James Edward Stewart, George Alban Heitz, III, Joe Delone Venters, Seungho Yang, Mehul Nariyawala, Cameron Hill, Yohannes Berhanu Kifle, Sayed Yusef Shafi, Sahana Mysore
  • Publication number: 20200201529
    Abstract: A method, in an application executing on a client device, includes: displaying a camera event history provided by a remote server system, where the camera event history is presented as a chronologically-ordered set of event identifiers, each event identifier corresponding to a respective event for which a remote camera has captured an associated video; receiving a user selection of a displayed event identifier; and in response to receiving the user selection of the displayed event identifier: expanding the selected event identifier into a video player window, the video player window consuming a portion of the displayed camera event history; and playing, in the video player window, the captured video; and in response to terminating playback of the captured video or user de-selection of the displayed event identifier, collapsing the video player window into the selected event identifier thereby stopping the playing of the captured video.
    Type: Application
    Filed: February 4, 2020
    Publication date: June 25, 2020
    Inventors: Melissa McLean, MICHAEL MIZONO, LAUREN VON DEHSEN, JOE DELONE VENTERS, TRACY KUWATANI, ZACHERY KENNEDY, JAMES EDWARD STEWART
  • Patent number: 10685257
    Abstract: The various implementations described herein include systems and methods for recognizing persons in video streams. In one aspect, a method includes: (1) obtaining a live video stream; (2) detecting person(s) in the stream; and (3) determining, from analysis of the live video stream, first information of the detected person(s); (4) determining, based on the first information, that the first person is not known to the computing system; (5) in accordance with the determination that the first person is not known: (a) storing the first information; and (b) requesting a user to classify the first person; and (6) in accordance with a determination that a response was received classifying the first person as a stranger, deleting the stored first information.
    Type: Grant
    Filed: September 9, 2019
    Date of Patent: June 16, 2020
    Assignee: GOOGLE LLC
    Inventors: Akshay R. Bapat, George Alban Heitz, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
  • Patent number: 10664688
    Abstract: A method of detecting and responding to a visitor to a smart home environment via an electronic greeting system of the smart home environment, including determining that a visitor is approaching an entryway of the smart home environment; initiating a facial recognition operation while the visitor is approaching the entryway; initiating an observation window in response to the determination that a visitor is approaching the entryway; obtaining context information from one or more sensors of the smart home environment during the observation window; and at the end of the time window, initiating a response to the detected approach of the visitor based on the context information and/or an outcome of the facial recognition operation.
    Type: Grant
    Filed: November 10, 2017
    Date of Patent: May 26, 2020
    Assignee: GOOGLE LLC
    Inventors: Jason Evans Goulden, Rengarajan Aravamudhan, Haerim Jeong, Michael Dixon, James Edward Stewart, Sayed Yusef Shafi, Sahana Mysore, Seungho Yang, Yu-An Lien, Christopher Charles Burns, Rajeev Nongpiur, Jeffrey Boyd
  • Patent number: 10621838
    Abstract: Various arrangements for video clip distribution for a smart home environment are presented. A video stream of the smart home environment may be received. A cloud-based storage system may be used to store the video stream. One or more event analysis processes can be performed on the stored video stream to identify an occurrence of a type of event. Event metadata may be stored by the cloud-based storage system that identifies the types of events that have occurred. An external analysis system may send a clip request. In response, the cloud-based storage system may retrieve a video clip from the video stream corresponding to a time period indicated in the clip request. The cloud-based storage system may also identify event metadata corresponds to the clip request. The cloud-based storage system may transmit to the external analysis system via the Internet, the video clip and the event metadata.
    Type: Grant
    Filed: December 15, 2017
    Date of Patent: April 14, 2020
    Assignee: Google LLC
    Inventors: Nitin Viswanathan, James Edward Stewart
  • Patent number: 10599950
    Abstract: The various implementations described herein include systems and methods for recognizing persons in video streams. In one aspect, a method includes: (1) obtaining images collected by video cameras in a smart home environment, each image including a detected person; (2) for each image, obtaining personally identifiable information of the detected person, the personally identifiable information generated from analysis of the image; (3) grouping the images into a first group of a plurality of groups based on the personally identifiable information, each group of the plurality of groups representing a unique person; (4) receiving from a user a request to remove a first image from the first group; and (5) in response to the request: (a) removing the first image from the first group; and (b) disassociating the corresponding personally identifiable information from the first group.
    Type: Grant
    Filed: August 14, 2017
    Date of Patent: March 24, 2020
    Assignee: GOOGLE LLC
    Inventors: Akshay R. Bapat, George Alban Heitz, III, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
  • Patent number: 10586433
    Abstract: A method at a computing system includes: obtaining video of an environment including a plurality of objects, wherein the video has a field of view; identifying one or more objects of the plurality of objects within the field of view; defining a zone of interest associated with a first object of the one or more objects, including identifying the zone of interest as one of an alerting zone or a suppression zone; subsequent to the defining, detecting one or more motion events captured in the video occurring at least partially within the zone of interest; when the zone of interest is an alerting zone, causing one or more notifications of the one or more motion events to be issued; and when the zone is a suppression zone, suppressing notifications of the one or more motion events.
    Type: Grant
    Filed: February 13, 2017
    Date of Patent: March 10, 2020
    Assignee: GOOGLE LLC
    Inventors: James Edward Stewart, George Alban Heitz, III, Joe Delone Venters, Seungho Yang, Mehul Nariyawala, Cameron Hill, Yohannes Berhanu Kifle, Sayed Yusef Shafi, Sahana Mysore
  • Patent number: 10552020
    Abstract: A method, in an application executing on a client device, includes: displaying a camera event history provided by a remote server system, where the camera event history is presented as a chronologically-ordered set of event identifiers, each event identifier corresponding to a respective event for which a remote camera has captured an associated video; receiving a user selection of a displayed event identifier; and in response to receiving the user selection of the displayed event identifier: expanding the selected event identifier into a video player window, the video player window consuming a portion of the displayed camera event history; and playing, in the video player window, the captured video; and in response to terminating playback of the captured video or user de-selection of the displayed event identifier, collapsing the video player window into the selected event identifier thereby stopping the playing of the captured video.
    Type: Grant
    Filed: June 6, 2016
    Date of Patent: February 4, 2020
    Assignee: GOOGLE LLC
    Inventors: Melissa McLean, Michael Mizono, Lauren Von Dehsen, Joe Delone Venters, Tracy Kuwatani, Zachery Kennedy, James Edward Stewart
  • Publication number: 20200005079
    Abstract: The various implementations described herein include systems and methods for recognizing persons in video streams. In one aspect, a method includes: (1) obtaining a live video stream; (2) detecting person(s) in the stream; and (3) determining, from analysis of the live video stream, first information of the detected person(s); (4) determining, based on the first information, that the first person is not known to the computing system; (5) in accordance with the determination that the first person is not known: (a) storing the first information; and (b) requesting a user to classify the first person; and (6) in accordance with a determination that a response was received classifying the first person as a stranger, deleting the stored first information.
    Type: Application
    Filed: September 9, 2019
    Publication date: January 2, 2020
    Inventors: Akshay R. Bapat, George Alban Heitz, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
  • Publication number: 20190361577
    Abstract: A method at an electronic device with a display includes: displaying a user interface having a first region and a second region; receiving, and displaying in the first region of the user interface, a live video stream of a physical environment captured by a remote video camera; displaying, in the second region, a timeline corresponding to a timespan for a first portion of a duration during which the live video stream may have been recorded; in response to receiving a user interaction to move the timespan to a second portion of the duration, transitioning the displayed timeline to a new timeline that corresponds to the timespan for the second portion, and while transitioning, displaying, in the first region, a subset of video frames representing the first and/or second portion of the duration.
    Type: Application
    Filed: August 8, 2019
    Publication date: November 28, 2019
    Inventors: Christopher Charles Burns, George Alban Heitz, III, James Edward Stewart, Cameron Hill, Seungho Yang, Joe Delone Venters, William Alex Finlayson, Carsten Hinz, Timothy Samuel Psiaki, Nathan Scott Klee, Gregory Rourk Nelson, Kevin James Avery, Lawrence W. Neal, Martin Davidsson
  • Patent number: D902233
    Type: Grant
    Filed: January 31, 2019
    Date of Patent: November 17, 2020
    Assignee: GOOGLE LLC
    Inventors: James Edward Stewart, Seungho Yang, Joe Venters, Carsten Hinz
  • Patent number: D920354
    Type: Grant
    Filed: January 31, 2019
    Date of Patent: May 25, 2021
    Assignee: GOOGLE LLC
    Inventors: James Edward Stewart, Seungho Yang, Joe Delone Venters, Carsten Hinz