Patents by Inventor James Edward Stewart
James Edward Stewart has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20210377493Abstract: A method of presenting appropriate actions for responding to a visitor to a smart home environment via an electronic greeting system of the smart home environment, including detecting a visitor of the smart home environment; obtaining context information from the smart home environment regarding the visitor; based on the context information, identifying a plurality of appropriate actions available to a user of a client device for interacting with the visitor via the electronic greeting system; and causing the identified actions to be presented to the user of the client device.Type: ApplicationFiled: August 12, 2021Publication date: December 2, 2021Inventors: Jason Evans Goulden, Rengarajan Aravamudhan, Hae Rim Jeong, Michael Dixon, James Edward Stewart, Sayed Yusef Shafi, Sahana Mysore, Seungho Yang, Yu-An Lien, Christopher Charles Burns, Rajeev Conrad Nongpiur, Jeffrey Boyd
-
Patent number: 11134227Abstract: A method of presenting appropriate actions for responding to a visitor to a smart home environment via an electronic greeting system of the smart home environment, including detecting a visitor of the smart home environment; obtaining context information from the smart home environment regarding the visitor; based on the context information, identifying a plurality of appropriate actions available to a user of a client device for interacting with the visitor via the electronic greeting system; and causing the identified actions to be presented to the user of the client device.Type: GrantFiled: November 10, 2017Date of Patent: September 28, 2021Assignee: Google LLCInventors: Jason Evans Goulden, Rengarajan Aravamudhan, Hae Rim Jeong, Michael Dixon, James Edward Stewart, Sayed Yusef Shafi, Sahana Mysore, Seungho Yang, Yu-An Lien, Christopher Charles Burns, Rajeev Nongpiur, Jeffrey Boyd
-
Publication number: 20210216787Abstract: A method includes obtaining from an image sensor of a video camera a primary real-time video stream comprising images of a field of view of the video camera; identifying from the primary video stream one or more regions of interest in the field of view of the video camera; while obtaining the primary video stream, creating a first video sub-stream comprising a first plurality of images for a first one of the one or more identified regions of interest, wherein: images of the first plurality of images include image data for portions of the field of the video camera that include the first identified region of interest, and the images of the first plurality of images have fields of view that are smaller than the field of view of the video camera; and providing the first video sub-stream for display at a client device.Type: ApplicationFiled: March 29, 2021Publication date: July 15, 2021Applicant: Google LLCInventors: Joost van Hoof, Navneet Dalal, James Edward Stewart, Ting Yu, Maxime Veron, George Alban Heitz, III
-
Patent number: 11036361Abstract: A method at an electronic device with a display includes: displaying a user interface having a first region and a second region; receiving, and displaying in the first region of the user interface, a live video stream of a physical environment captured by a remote video camera; displaying, in the second region, a timeline corresponding to a timespan for a first portion of a duration during which the live video stream may have been recorded; in response to receiving a user interaction to move the timespan to a second portion of the duration, transitioning the displayed timeline to a new timeline that corresponds to the timespan for the second portion, and while transitioning, displaying, in the first region, a subset of video frames representing the first and/or second portion of the duration.Type: GrantFiled: August 8, 2019Date of Patent: June 15, 2021Assignee: Google LLCInventors: Christopher Charles Burns, George Alban Heitz, III, James Edward Stewart, Cameron Hill, Seungho Yang, Joe Delone Venters, William Alex Finlayson, Carsten Hinz, Timothy Samuel Psiaki, Nathan Scott Klee, Gregory Rourk Nelson, Kevin James Avery, Lawrence W. Neal, Martin Davidsson
-
Patent number: 10871890Abstract: A method, in an application executing on a client device, includes: displaying a camera event history provided by a remote server system, where the camera event history is presented as a chronologically-ordered set of event identifiers, each event identifier corresponding to a respective event for which a remote camera has captured an associated video; receiving a user selection of a displayed event identifier; and in response to receiving the user selection of the displayed event identifier: expanding the selected event identifier into a video player window, the video player window consuming a portion of the displayed camera event history; and playing, in the video player window, the captured video; and in response to terminating playback of the captured video or user de-selection of the displayed event identifier, collapsing the video player window into the selected event identifier thereby stopping the playing of the captured video.Type: GrantFiled: February 4, 2020Date of Patent: December 22, 2020Assignee: GOOGLE LLCInventors: Melissa McLean, Michael Mizono, Lauren Von Dehsen, Joe Delone Venters, Tracy Kuwatani, Zachery Kennedy, James Edward Stewart
-
Publication number: 20200293818Abstract: A method for recognizing persons in video streams includes obtaining a live video stream, detecting a first person in the live video stream, determining from analysis of the live video stream first information that identifies an attribute of the first person, determining based on at least some of the first information that the first person is not identifiable to the computing system, storing at least some of the first information, receiving a user classification of the first person as being a stranger, and deleting the stored first information.Type: ApplicationFiled: May 29, 2020Publication date: September 17, 2020Inventors: Akshay R. Bapat, George Alban Heitz, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
-
Publication number: 20200285841Abstract: A method of detecting and responding to a visitor to a smart home environment via an electronic greeting system of the smart home environment, including determining that a visitor is approaching an entryway of the smart home environment; initiating a facial recognition operation while the visitor is approaching the entryway; initiating an observation window in response to the determination that a visitor is approaching the entryway; obtaining context information from one or more sensors of the smart home environment during the observation window; and at the end of the time window, initiating a response to the detected approach of the visitor based on the context information and/or an outcome of the facial recognition operation.Type: ApplicationFiled: May 26, 2020Publication date: September 10, 2020Inventors: Jason Evans Goulden, RENGARAJAN ARAVAMUDHAN, Haerim Jeong, Michael Dixon, James Edward Stewart, Sayed Yusef Shafi, Sahana Mysore, Seungho Yang, Yu-An Lien, Christopher Charles Burns, Rajeev Nongpiur, Jeffrey Boyd
-
Publication number: 20200226416Abstract: The various implementations described herein include systems and methods for recognizing persons in video streams. In one aspect, a method includes: obtaining images collected by video cameras in a smart home environment, each image including a detected person; for each image, obtaining first information that identifies an attribute of the detected person, the first information generated from analysis of the image; grouping the images into a first group of a plurality of groups based on the first information, each group of the plurality of groups representing a unique person; receiving a request to remove a first image from the first group; removing the first image from the first group; and disassociating the first information from the first group.Type: ApplicationFiled: March 23, 2020Publication date: July 16, 2020Inventors: Akshay R. Bapat, George Alban Heitz, III, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
-
Publication number: 20200211347Abstract: A method at a computing system includes obtaining video of an environment including a plurality of objects; defining a zone including a portion of the environment; subsequent to the defining, detecting a motion event captured in the video occurring at least partially within the zone, wherein the motion event is associated with a first object of the plurality of objects; identifying an object type of the first object; and based on the object type of the first object, causing a notification of the motion event to be issued or not issued.Type: ApplicationFiled: March 10, 2020Publication date: July 2, 2020Inventors: James Edward Stewart, George Alban Heitz, III, Joe Delone Venters, Seungho Yang, Mehul Nariyawala, Cameron Hill, Yohannes Berhanu Kifle, Sayed Yusef Shafi, Sahana Mysore
-
Publication number: 20200201529Abstract: A method, in an application executing on a client device, includes: displaying a camera event history provided by a remote server system, where the camera event history is presented as a chronologically-ordered set of event identifiers, each event identifier corresponding to a respective event for which a remote camera has captured an associated video; receiving a user selection of a displayed event identifier; and in response to receiving the user selection of the displayed event identifier: expanding the selected event identifier into a video player window, the video player window consuming a portion of the displayed camera event history; and playing, in the video player window, the captured video; and in response to terminating playback of the captured video or user de-selection of the displayed event identifier, collapsing the video player window into the selected event identifier thereby stopping the playing of the captured video.Type: ApplicationFiled: February 4, 2020Publication date: June 25, 2020Inventors: Melissa McLean, MICHAEL MIZONO, LAUREN VON DEHSEN, JOE DELONE VENTERS, TRACY KUWATANI, ZACHERY KENNEDY, JAMES EDWARD STEWART
-
Patent number: 10685257Abstract: The various implementations described herein include systems and methods for recognizing persons in video streams. In one aspect, a method includes: (1) obtaining a live video stream; (2) detecting person(s) in the stream; and (3) determining, from analysis of the live video stream, first information of the detected person(s); (4) determining, based on the first information, that the first person is not known to the computing system; (5) in accordance with the determination that the first person is not known: (a) storing the first information; and (b) requesting a user to classify the first person; and (6) in accordance with a determination that a response was received classifying the first person as a stranger, deleting the stored first information.Type: GrantFiled: September 9, 2019Date of Patent: June 16, 2020Assignee: GOOGLE LLCInventors: Akshay R. Bapat, George Alban Heitz, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
-
Patent number: 10664688Abstract: A method of detecting and responding to a visitor to a smart home environment via an electronic greeting system of the smart home environment, including determining that a visitor is approaching an entryway of the smart home environment; initiating a facial recognition operation while the visitor is approaching the entryway; initiating an observation window in response to the determination that a visitor is approaching the entryway; obtaining context information from one or more sensors of the smart home environment during the observation window; and at the end of the time window, initiating a response to the detected approach of the visitor based on the context information and/or an outcome of the facial recognition operation.Type: GrantFiled: November 10, 2017Date of Patent: May 26, 2020Assignee: GOOGLE LLCInventors: Jason Evans Goulden, Rengarajan Aravamudhan, Haerim Jeong, Michael Dixon, James Edward Stewart, Sayed Yusef Shafi, Sahana Mysore, Seungho Yang, Yu-An Lien, Christopher Charles Burns, Rajeev Nongpiur, Jeffrey Boyd
-
Patent number: 10621838Abstract: Various arrangements for video clip distribution for a smart home environment are presented. A video stream of the smart home environment may be received. A cloud-based storage system may be used to store the video stream. One or more event analysis processes can be performed on the stored video stream to identify an occurrence of a type of event. Event metadata may be stored by the cloud-based storage system that identifies the types of events that have occurred. An external analysis system may send a clip request. In response, the cloud-based storage system may retrieve a video clip from the video stream corresponding to a time period indicated in the clip request. The cloud-based storage system may also identify event metadata corresponds to the clip request. The cloud-based storage system may transmit to the external analysis system via the Internet, the video clip and the event metadata.Type: GrantFiled: December 15, 2017Date of Patent: April 14, 2020Assignee: Google LLCInventors: Nitin Viswanathan, James Edward Stewart
-
Patent number: 10599950Abstract: The various implementations described herein include systems and methods for recognizing persons in video streams. In one aspect, a method includes: (1) obtaining images collected by video cameras in a smart home environment, each image including a detected person; (2) for each image, obtaining personally identifiable information of the detected person, the personally identifiable information generated from analysis of the image; (3) grouping the images into a first group of a plurality of groups based on the personally identifiable information, each group of the plurality of groups representing a unique person; (4) receiving from a user a request to remove a first image from the first group; and (5) in response to the request: (a) removing the first image from the first group; and (b) disassociating the corresponding personally identifiable information from the first group.Type: GrantFiled: August 14, 2017Date of Patent: March 24, 2020Assignee: GOOGLE LLCInventors: Akshay R. Bapat, George Alban Heitz, III, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
-
Patent number: 10586433Abstract: A method at a computing system includes: obtaining video of an environment including a plurality of objects, wherein the video has a field of view; identifying one or more objects of the plurality of objects within the field of view; defining a zone of interest associated with a first object of the one or more objects, including identifying the zone of interest as one of an alerting zone or a suppression zone; subsequent to the defining, detecting one or more motion events captured in the video occurring at least partially within the zone of interest; when the zone of interest is an alerting zone, causing one or more notifications of the one or more motion events to be issued; and when the zone is a suppression zone, suppressing notifications of the one or more motion events.Type: GrantFiled: February 13, 2017Date of Patent: March 10, 2020Assignee: GOOGLE LLCInventors: James Edward Stewart, George Alban Heitz, III, Joe Delone Venters, Seungho Yang, Mehul Nariyawala, Cameron Hill, Yohannes Berhanu Kifle, Sayed Yusef Shafi, Sahana Mysore
-
Patent number: 10552020Abstract: A method, in an application executing on a client device, includes: displaying a camera event history provided by a remote server system, where the camera event history is presented as a chronologically-ordered set of event identifiers, each event identifier corresponding to a respective event for which a remote camera has captured an associated video; receiving a user selection of a displayed event identifier; and in response to receiving the user selection of the displayed event identifier: expanding the selected event identifier into a video player window, the video player window consuming a portion of the displayed camera event history; and playing, in the video player window, the captured video; and in response to terminating playback of the captured video or user de-selection of the displayed event identifier, collapsing the video player window into the selected event identifier thereby stopping the playing of the captured video.Type: GrantFiled: June 6, 2016Date of Patent: February 4, 2020Assignee: GOOGLE LLCInventors: Melissa McLean, Michael Mizono, Lauren Von Dehsen, Joe Delone Venters, Tracy Kuwatani, Zachery Kennedy, James Edward Stewart
-
Publication number: 20200005079Abstract: The various implementations described herein include systems and methods for recognizing persons in video streams. In one aspect, a method includes: (1) obtaining a live video stream; (2) detecting person(s) in the stream; and (3) determining, from analysis of the live video stream, first information of the detected person(s); (4) determining, based on the first information, that the first person is not known to the computing system; (5) in accordance with the determination that the first person is not known: (a) storing the first information; and (b) requesting a user to classify the first person; and (6) in accordance with a determination that a response was received classifying the first person as a stranger, deleting the stored first information.Type: ApplicationFiled: September 9, 2019Publication date: January 2, 2020Inventors: Akshay R. Bapat, George Alban Heitz, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
-
Publication number: 20190361577Abstract: A method at an electronic device with a display includes: displaying a user interface having a first region and a second region; receiving, and displaying in the first region of the user interface, a live video stream of a physical environment captured by a remote video camera; displaying, in the second region, a timeline corresponding to a timespan for a first portion of a duration during which the live video stream may have been recorded; in response to receiving a user interaction to move the timespan to a second portion of the duration, transitioning the displayed timeline to a new timeline that corresponds to the timespan for the second portion, and while transitioning, displaying, in the first region, a subset of video frames representing the first and/or second portion of the duration.Type: ApplicationFiled: August 8, 2019Publication date: November 28, 2019Inventors: Christopher Charles Burns, George Alban Heitz, III, James Edward Stewart, Cameron Hill, Seungho Yang, Joe Delone Venters, William Alex Finlayson, Carsten Hinz, Timothy Samuel Psiaki, Nathan Scott Klee, Gregory Rourk Nelson, Kevin James Avery, Lawrence W. Neal, Martin Davidsson
-
Patent number: D902233Type: GrantFiled: January 31, 2019Date of Patent: November 17, 2020Assignee: GOOGLE LLCInventors: James Edward Stewart, Seungho Yang, Joe Venters, Carsten Hinz
-
Patent number: D920354Type: GrantFiled: January 31, 2019Date of Patent: May 25, 2021Assignee: GOOGLE LLCInventors: James Edward Stewart, Seungho Yang, Joe Delone Venters, Carsten Hinz