Patents by Inventor George Alban Heitz, III

George Alban Heitz, III has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11609684
    Abstract: A method at an electronic device with a display includes: displaying a user interface having a first region and a second region; receiving, and displaying in the first region of the user interface, a live video stream of a physical environment captured by a remote video camera; displaying, in the second region, a timeline corresponding to a timespan for a first portion of a duration during which the live video stream may have been recorded; in response to receiving a user interaction to move the timespan to a second portion of the duration, transitioning the displayed timeline to a new timeline that corresponds to the timespan for the second portion, and while transitioning, displaying, in the first region, a subset of video frames representing the first and/or second portion of the duration.
    Type: Grant
    Filed: June 14, 2021
    Date of Patent: March 21, 2023
    Assignee: Google LLC
    Inventors: Christopher Charles Burns, George Alban Heitz, III, James Edward Stewart, Cameron Hill, Seungho Yang, Joe Delone Venters, William Alex Finlayson, Carsten Hinz, Timothy Samuel Psiaki, Nathan Scott Klee, Gregory Rourk Nelson, Kevin James Avery, Lawrence W. Neal, Martin Davidsson
  • Patent number: 11587320
    Abstract: A computing system obtains a video feed. For a frame of the video feed, the computing system analyzes the frame to determine whether the frame includes a potential instance of an event. In accordance with a determination that the frame includes the potential instance of an event, the computing system determines for the event an event category from a plurality of predefined event categories. It stores an indication of the event category. It determines whether the event category matches a predefined notification filter definition. In accordance with a determination that the event category matches the predefined notification filter definition, the computing system issues an alert notification to a user client device. In accordance with a determination that the event category does not match the predefined notification filter definition, the computing system refrains from issuing the alert notification.
    Type: Grant
    Filed: May 18, 2020
    Date of Patent: February 21, 2023
    Assignee: Google LLC
    Inventors: Rizwan Ahmed Chaudhry, Navneet Dalal, Jonathan Z. Ben-Meshulam, George Alban Heitz, III
  • Patent number: 11570354
    Abstract: A display assistant device comprises a display, a camera, a speaker, microphones, a processor and memory. The memory stores programs comprising instructions that, when executed by the processor, enable a plurality of modes of the display assistant device. The modes include a monitoring mode and an assistant mode. In the monitoring mode, the device is configured to perform a remote monitoring function in which first video captured by the camera is streamed to a remote server system for monitoring uses. The monitoring uses include transmission of the first video to remote client devices authorized to access the first video. In the assistant mode, the device is configured to perform a second plurality of functions that excludes the monitoring function and includes a video communication function in which second video captured by the camera is transmitted to second devices participating in a video communication with a first user of the device.
    Type: Grant
    Filed: April 26, 2019
    Date of Patent: January 31, 2023
    Assignee: Google LLC
    Inventors: Michael Yang Liu, Jeffrey Ching Wang, Mohamed Mohy-Eldeen Abdelgany, John Jordan Nold, George Alban Heitz, III, Siddarth Raghunathan, Shayan Sayadi, Scott Mullins
  • Patent number: 11483451
    Abstract: A method is performed at a system that comprises one or more video cameras and a remote server system. The method includes obtaining, via a video camera of the one or more video cameras, a continuous stream of video data for a scene. The video data stream comprises color video data in accordance with a determination that the scene has illumination above an illumination threshold and comprises infrared (IR) video data in accordance with a determination that the scene does not have illumination above the illumination threshold. The method includes colorizing the IR video data based on a subset of the color video data. The method further includes presenting the colorized video data to a user in real time.
    Type: Grant
    Filed: November 19, 2019
    Date of Patent: October 25, 2022
    Assignee: Google LLC
    Inventors: George Alban Heitz, III, Rizwan Ahmed Chaudhry, Ankit Mohan, Joshua Fromm
  • Publication number: 20220300753
    Abstract: A method for recognizing persons in video streams includes obtaining a live video stream, detecting a first person in the live video stream, determining from analysis of the live video stream first information that identifies an attribute of the first person, determining based on at least some of the first information that the first person is not identifiable to the computing system, storing at least some of the first information, receiving a user classification of the first person as being a stranger, and deleting the stored first information.
    Type: Application
    Filed: June 7, 2022
    Publication date: September 22, 2022
    Applicant: Google LLC
    Inventors: Akshay R. Bapat, George Alban Heitz, III, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
  • Publication number: 20220245396
    Abstract: The various implementations described herein include systems and methods for recognizing persons in video streams. In one aspect, a method includes: (1) obtaining a live video stream; (2) detecting person(s) in the stream; and (3) determining, from analysis of the live video stream, personally identifiable information of the detected person(s); (4) determining, based on the personally identifiable information, that the first person is not known to the computing system; (5) in accordance with the determination that the first person is not known: (a) storing the personally identifiable information; and (b) requesting a user to classify the first person; and (6) in accordance with (i) a determination that a predetermined amount of time has elapsed since the request was transmitted and a response was not received, or (ii) a determination that a response was received classifying the first person as a stranger, deleting the stored personally identifiable information.
    Type: Application
    Filed: February 18, 2022
    Publication date: August 4, 2022
    Applicant: Google LLC
    Inventors: Akshay R. Bapat, George Alban Heitz, III, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
  • Publication number: 20220215664
    Abstract: A method at a server system includes: receiving a video stream from a remote video camera, wherein the video stream comprises a plurality of video frames; selecting a plurality of non-contiguous frames from the video stream, the plurality of non-contiguous frames being associated with a predetermined time interval; encoding the plurality of non-contiguous frames as a compressed video segment associated with the time interval; receiving a request from an application running on a client device to review video from the remote video camera for the time interval; and in response to the request, transmitting the video segment to the client device for viewing in the application.
    Type: Application
    Filed: January 28, 2022
    Publication date: July 7, 2022
    Applicant: Google LLC
    Inventors: Christopher Charles Burns, George Alban Heitz, III, James Edward Stewart, Cameron Hill, Seungho Yang, Joe Delone Venters, William Alex Finlayson, Carsten Hinz, Timothy Samuel Psiaki, Nathan Scott Klee, Gregory Rourk Nelson, Kevin James Avery, Lawrence W. Neal, Martin Davidsson
  • Publication number: 20220075489
    Abstract: A method at an electronic device with a display includes: displaying a user interface having a first region and a second region; receiving, and displaying in the first region of the user interface, a live video stream of a physical environment captured by a remote video camera; displaying, in the second region, a timeline corresponding to a timespan for a first portion of a duration during which the live video stream may have been recorded; in response to receiving a user interaction to move the timespan to a second portion of the duration, transitioning the displayed timeline to a new timeline that corresponds to the timespan for the second portion, and while transitioning, displaying, in the first region, a subset of video frames representing the first and/or second portion of the duration.
    Type: Application
    Filed: June 14, 2021
    Publication date: March 10, 2022
    Inventors: Christopher Charles Burns, George Alban Heitz III, James Edward Stewart, Cameron Hill, Seungho Yang, Joe Delone Venters, William Alex Finlayson, Carsten Hinz, Timothy Samuel Psiaki, Nathan Scott Klee, Gregory Rourk Nelson, Kevin James Avery, Lawrence W. Neal, Martin Davidsson
  • Patent number: 11256951
    Abstract: The various implementations described herein include systems and methods for recognizing persons in video streams. In one aspect, a method includes: obtaining images collected by video cameras in a smart home environment, each image including a detected person; for each image, obtaining first information that identifies an attribute of the detected person, the first information generated from analysis of the image; grouping the images into a first group of a plurality of groups based on the first information, each group of the plurality of groups representing a unique person; receiving a request to remove a first image from the first group; removing the first image from the first group; and disassociating the first information from the first group.
    Type: Grant
    Filed: March 23, 2020
    Date of Patent: February 22, 2022
    Assignee: Google LLC
    Inventors: Akshay R. Bapat, George Alban Heitz, III, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
  • Patent number: 11238290
    Abstract: A method at a server system includes: receiving a video stream from a remote video camera, wherein the video stream comprises a plurality of video frames; selecting a plurality of non-contiguous frames from the video stream, the plurality of non-contiguous frames being associated with a predetermined time interval; encoding the plurality of non-contiguous frames as a compressed video segment associated with the time interval; receiving a request from an application running on a client device to review video from the remote video camera for the time interval; and in response to the request, transmitting the video segment to the client device for viewing in the application.
    Type: Grant
    Filed: October 26, 2016
    Date of Patent: February 1, 2022
    Assignee: Google LLC
    Inventors: Christopher Charles Burns, George Alban Heitz, III, James Edward Stewart, Cameron Hill, Seungho Yang, Joe Delone Venters, William Alex Finlayson, Carsten Hinz, Timothy Samuel Psiaki, Nathan Scott Klee, Gregory Rourk Nelson, Kevin James Avery, Lawrence W. Neal, Martin Davidsson
  • Publication number: 20210400167
    Abstract: A method is performed at a system that comprises one or more video cameras and a remote server system. The method includes obtaining, via a video camera of the one or more video cameras, a continuous stream of video data for a scene. The video data stream comprises color video data in accordance with a determination that the scene has illumination above an illumination threshold and comprises infrared (IR) video data in accordance with a determination that the scene does not have illumination above the illumination threshold. The method includes colorizing the IR video data based on a subset of the color video data. The method further includes presenting the colorized video data to a user in real time.
    Type: Application
    Filed: November 19, 2019
    Publication date: December 23, 2021
    Inventors: George Alban Heitz III, Rizwan Ahmed Chaudhry, Ankit Mohan, Joshua Fromm
  • Publication number: 20210329165
    Abstract: A display assistant device comprises a display, a camera, a speaker, microphones, a processor and memory. The memory stores programs comprising instructions that, when executed by the processor, enable a plurality of modes of the display assistant device. The modes include a monitoring mode and an assistant mode. In the monitoring mode, the device is configured to perform a remote monitoring function in which first video captured by the camera is streamed to a remote server system for monitoring uses. The monitoring uses include transmission of the first video to remote client devices authorized to access the first video. In the assistant mode, the device is configured to perform a second plurality of functions that excludes the monitoring function and includes a video communication function in which second video captured by the camera is transmitted to second devices participating in a video communication with a first user of the device.
    Type: Application
    Filed: April 26, 2019
    Publication date: October 21, 2021
    Inventors: Michael Yang Liu, Jeffrey Ching Wang, Mohamed Mohy-Eldeen Abdelgany, John Jordan Nold, George Alban Heitz, III, Siddarth Raghunathan, Shayan Sayadi, Scott Mullins
  • Publication number: 20210216787
    Abstract: A method includes obtaining from an image sensor of a video camera a primary real-time video stream comprising images of a field of view of the video camera; identifying from the primary video stream one or more regions of interest in the field of view of the video camera; while obtaining the primary video stream, creating a first video sub-stream comprising a first plurality of images for a first one of the one or more identified regions of interest, wherein: images of the first plurality of images include image data for portions of the field of the video camera that include the first identified region of interest, and the images of the first plurality of images have fields of view that are smaller than the field of view of the video camera; and providing the first video sub-stream for display at a client device.
    Type: Application
    Filed: March 29, 2021
    Publication date: July 15, 2021
    Applicant: Google LLC
    Inventors: Joost van Hoof, Navneet Dalal, James Edward Stewart, Ting Yu, Maxime Veron, George Alban Heitz, III
  • Patent number: 11036361
    Abstract: A method at an electronic device with a display includes: displaying a user interface having a first region and a second region; receiving, and displaying in the first region of the user interface, a live video stream of a physical environment captured by a remote video camera; displaying, in the second region, a timeline corresponding to a timespan for a first portion of a duration during which the live video stream may have been recorded; in response to receiving a user interaction to move the timespan to a second portion of the duration, transitioning the displayed timeline to a new timeline that corresponds to the timespan for the second portion, and while transitioning, displaying, in the first region, a subset of video frames representing the first and/or second portion of the duration.
    Type: Grant
    Filed: August 8, 2019
    Date of Patent: June 15, 2021
    Assignee: Google LLC
    Inventors: Christopher Charles Burns, George Alban Heitz, III, James Edward Stewart, Cameron Hill, Seungho Yang, Joe Delone Venters, William Alex Finlayson, Carsten Hinz, Timothy Samuel Psiaki, Nathan Scott Klee, Gregory Rourk Nelson, Kevin James Avery, Lawrence W. Neal, Martin Davidsson
  • Patent number: 10957171
    Abstract: A computing system obtains a first category for a first motion event. The system sends a first alert indicative of the first category to a user. After sending the first alert, it obtains a second category for a second motion event. In accordance with a determination that the second category is the same as the first category, the system determines whether a third motion event of the first category has been detected in a preceding predetermined amount of time before the second motion event. If the third motion event has not been detected in the preceding predetermined amount of time before the second motion event, the system sends a second alert associated with the second motion event indicative of the first category to the user. If the third motion event has been detected in the preceding predetermined amount of time before the second motion event, the system forgoes sending the second alert.
    Type: Grant
    Filed: July 11, 2016
    Date of Patent: March 23, 2021
    Assignee: GOOGLE LLC
    Inventors: George Alban Heitz, III, Mehul Nariyawala, Akshay R. Bapat
  • Publication number: 20200380265
    Abstract: A computing system obtains a video feed. For a frame of the video feed, the computing system analyzes the frame to determine whether the frame includes a potential instance of an event. In accordance with a determination that the frame includes the potential instance of an event, the computing system determines for the event an event category from a plurality of predefined event categories. It stores an indication of the event category. It determines whether the event category matches a predefined notification filter definition. In accordance with a determination that the event category matches the predefined notification filter definition, the computing system issues an alert notification to a user client device. In accordance with a determination that the event category does not match the predefined notification filter definition, the computing system refrains from issuing the alert notification.
    Type: Application
    Filed: May 18, 2020
    Publication date: December 3, 2020
    Inventors: Rizwan Ahmed Chaudhry, Navneet Dalal, Jonathan Z. Ben-Meshulam, George Alban Heitz, III
  • Publication number: 20200226416
    Abstract: The various implementations described herein include systems and methods for recognizing persons in video streams. In one aspect, a method includes: obtaining images collected by video cameras in a smart home environment, each image including a detected person; for each image, obtaining first information that identifies an attribute of the detected person, the first information generated from analysis of the image; grouping the images into a first group of a plurality of groups based on the first information, each group of the plurality of groups representing a unique person; receiving a request to remove a first image from the first group; removing the first image from the first group; and disassociating the first information from the first group.
    Type: Application
    Filed: March 23, 2020
    Publication date: July 16, 2020
    Inventors: Akshay R. Bapat, George Alban Heitz, III, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
  • Publication number: 20200211347
    Abstract: A method at a computing system includes obtaining video of an environment including a plurality of objects; defining a zone including a portion of the environment; subsequent to the defining, detecting a motion event captured in the video occurring at least partially within the zone, wherein the motion event is associated with a first object of the plurality of objects; identifying an object type of the first object; and based on the object type of the first object, causing a notification of the motion event to be issued or not issued.
    Type: Application
    Filed: March 10, 2020
    Publication date: July 2, 2020
    Inventors: James Edward Stewart, George Alban Heitz, III, Joe Delone Venters, Seungho Yang, Mehul Nariyawala, Cameron Hill, Yohannes Berhanu Kifle, Sayed Yusef Shafi, Sahana Mysore
  • Patent number: 10657382
    Abstract: The various embodiments described herein include methods, devices, and systems for providing event alerts. In one aspect, a method includes obtaining a video feed. A frame of the video feed is analyzed at a first resolution to determine whether the frame includes a potential instance of a person. In accordance with the determination that the image includes the potential instance, a region is denoted around the potential instance. The region is analyzed at a second resolution, greater than the first resolution. In accordance with a determination that the region includes the instance of the person. a determination that the frame includes the person is made. An indication of the determination is stored for use in subsequent alert notification processing.
    Type: Grant
    Filed: July 2, 2019
    Date of Patent: May 19, 2020
    Assignee: GOOGLE LLC
    Inventors: Rizwan Ahmed Chaudhry, Navneet Dalal, Jonathan Z. Ben-Meshulam, George Alban Heitz, III
  • Patent number: 10599950
    Abstract: The various implementations described herein include systems and methods for recognizing persons in video streams. In one aspect, a method includes: (1) obtaining images collected by video cameras in a smart home environment, each image including a detected person; (2) for each image, obtaining personally identifiable information of the detected person, the personally identifiable information generated from analysis of the image; (3) grouping the images into a first group of a plurality of groups based on the personally identifiable information, each group of the plurality of groups representing a unique person; (4) receiving from a user a request to remove a first image from the first group; and (5) in response to the request: (a) removing the first image from the first group; and (b) disassociating the corresponding personally identifiable information from the first group.
    Type: Grant
    Filed: August 14, 2017
    Date of Patent: March 24, 2020
    Assignee: GOOGLE LLC
    Inventors: Akshay R. Bapat, George Alban Heitz, III, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov