Patents by Inventor George Alban Heitz, III
George Alban Heitz, III has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11947780Abstract: A method at an electronic device with a display includes: displaying a user interface having a first region and a second region; receiving, and displaying in the first region of the user interface, a live video stream of a physical environment captured by a remote video camera; displaying, in the second region, a timeline corresponding to a timespan for a first portion of a duration during which the live video stream may have been recorded; in response to receiving a user interaction to move the timespan to a second portion of the duration, transitioning the displayed timeline to a new timeline that corresponds to the timespan for the second portion, and while transitioning, displaying, in the first region, a subset of video frames representing the first and/or second portion of the duration.Type: GrantFiled: March 15, 2023Date of Patent: April 2, 2024Assignee: Google LLCInventors: Christopher Charles Burns, George Alban Heitz, III, James Edward Stewart, Cameron Hill, Seungho Yang, Joe Delone Venters, William Alex Finlayson, Carsten Hinz, Timothy Samuel Psiaki, Nathan Scott Klee, Gregory Rourk Nelson, Kevin James Avery, Lawrence W. Neal, Martin Davidsson
-
Publication number: 20230418908Abstract: A method for recognizing persons in video streams includes obtaining a live video stream, detecting a first person in the live video stream, determining from analysis of the live video stream first information that identifies an attribute of the first person, determining based on at least some of the first information that the first person is not identifiable to the computing system, storing at least some of the first information, receiving a user classification of the first person as being a stranger, and deleting the stored first information.Type: ApplicationFiled: September 7, 2023Publication date: December 28, 2023Applicant: Google LLCInventors: Akshay R. Bapat, George Alban Heitz, III, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
-
Patent number: 11783010Abstract: A method for recognizing persons in video streams includes obtaining a live video stream, detecting a first person in the live video stream, determining from analysis of the live video stream first information that identifies an attribute of the first person, determining based on at least some of the first information that the first person is not identifiable to the computing system, storing at least some of the first information, receiving a user classification of the first person as being a stranger, and deleting the stored first information.Type: GrantFiled: June 7, 2022Date of Patent: October 10, 2023Assignee: Google LLCInventors: Akshay R. Bapat, George Alban Heitz, III, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
-
Publication number: 20230214092Abstract: A method at an electronic device with a display includes: displaying a user interface having a first region and a second region; receiving, and displaying in the first region of the user interface, a live video stream of a physical environment captured by a remote video camera; displaying, in the second region, a timeline corresponding to a timespan for a first portion of a duration during which the live video stream may have been recorded; in response to receiving a user interaction to move the timespan to a second portion of the duration, transitioning the displayed timeline to a new timeline that corresponds to the timespan for the second portion, and while transitioning, displaying, in the first region, a subset of video frames representing the first and/or second portion of the duration.Type: ApplicationFiled: March 15, 2023Publication date: July 6, 2023Applicant: Google LLCInventors: Christopher Charles Burns, George Alban Heitz, III, James Edward Stewart, Cameron Hill, Seungho Yang, Joe Delone Venters, William Alex Finlayson, Carsten Hinz, Timothy Samuel Psiaki, Nathan Scott Klee, Gregory Rourk Nelson, Kevin James Avery, Lawrence W. Neal, Martin Davidsson
-
Publication number: 20230209017Abstract: The various embodiments described herein include methods, devices, and systems for providing event alerts. In one aspect, a method includes obtaining a video feed. A frame of the video feed is analyzed at a first resolution to determine whether the frame includes a potential instance of a person. In accordance with the determination that the image includes the potential instance, a region is denoted around the potential instance. The region is analyzed at a second resolution, greater than the first resolution. In accordance with a determination that the region includes the instance of the person. a determination that the frame includes the person is made. An indication of the determination is stored for use in subsequent alert notification processing.Type: ApplicationFiled: February 17, 2023Publication date: June 29, 2023Applicant: Google LLCInventors: Rizwan Ahmed Chaudhry, Navneet Dalal, Jonathan Z. Ben-Meshulam, George Alban Heitz, III
-
Publication number: 20230179855Abstract: A display assistant device comprises a display, a camera, a speaker, microphones, a processor and memory. The memory stores programs comprising instructions that, when executed by the processor, enable a plurality of modes of the display assistant device. The modes include a monitoring mode and an assistant mode. In the monitoring mode, the device is configured to perform a remote monitoring function in which first video captured by the camera is streamed to a remote server system for monitoring uses. The monitoring uses include transmission of the first video to remote client devices authorized to access the first video. In the assistant mode, the device is configured to perform a second plurality of functions that excludes the monitoring function and includes a video communication function in which second video captured by the camera is transmitted to second devices participating in a video communication with a first user of the device.Type: ApplicationFiled: January 30, 2023Publication date: June 8, 2023Applicant: Google LLCInventors: Michael Yang Liu, Jeffrey Ching Wang, Mohamed Mohy-Eldeen Abdelgany, John Jordan Nold, George Alban Heitz, III, Siddarth Raghunathan, Shayan Sayadi, Scott Mullins
-
Patent number: 11609684Abstract: A method at an electronic device with a display includes: displaying a user interface having a first region and a second region; receiving, and displaying in the first region of the user interface, a live video stream of a physical environment captured by a remote video camera; displaying, in the second region, a timeline corresponding to a timespan for a first portion of a duration during which the live video stream may have been recorded; in response to receiving a user interaction to move the timespan to a second portion of the duration, transitioning the displayed timeline to a new timeline that corresponds to the timespan for the second portion, and while transitioning, displaying, in the first region, a subset of video frames representing the first and/or second portion of the duration.Type: GrantFiled: June 14, 2021Date of Patent: March 21, 2023Assignee: Google LLCInventors: Christopher Charles Burns, George Alban Heitz, III, James Edward Stewart, Cameron Hill, Seungho Yang, Joe Delone Venters, William Alex Finlayson, Carsten Hinz, Timothy Samuel Psiaki, Nathan Scott Klee, Gregory Rourk Nelson, Kevin James Avery, Lawrence W. Neal, Martin Davidsson
-
Patent number: 11587320Abstract: A computing system obtains a video feed. For a frame of the video feed, the computing system analyzes the frame to determine whether the frame includes a potential instance of an event. In accordance with a determination that the frame includes the potential instance of an event, the computing system determines for the event an event category from a plurality of predefined event categories. It stores an indication of the event category. It determines whether the event category matches a predefined notification filter definition. In accordance with a determination that the event category matches the predefined notification filter definition, the computing system issues an alert notification to a user client device. In accordance with a determination that the event category does not match the predefined notification filter definition, the computing system refrains from issuing the alert notification.Type: GrantFiled: May 18, 2020Date of Patent: February 21, 2023Assignee: Google LLCInventors: Rizwan Ahmed Chaudhry, Navneet Dalal, Jonathan Z. Ben-Meshulam, George Alban Heitz, III
-
Patent number: 11570354Abstract: A display assistant device comprises a display, a camera, a speaker, microphones, a processor and memory. The memory stores programs comprising instructions that, when executed by the processor, enable a plurality of modes of the display assistant device. The modes include a monitoring mode and an assistant mode. In the monitoring mode, the device is configured to perform a remote monitoring function in which first video captured by the camera is streamed to a remote server system for monitoring uses. The monitoring uses include transmission of the first video to remote client devices authorized to access the first video. In the assistant mode, the device is configured to perform a second plurality of functions that excludes the monitoring function and includes a video communication function in which second video captured by the camera is transmitted to second devices participating in a video communication with a first user of the device.Type: GrantFiled: April 26, 2019Date of Patent: January 31, 2023Assignee: Google LLCInventors: Michael Yang Liu, Jeffrey Ching Wang, Mohamed Mohy-Eldeen Abdelgany, John Jordan Nold, George Alban Heitz, III, Siddarth Raghunathan, Shayan Sayadi, Scott Mullins
-
Patent number: 11483451Abstract: A method is performed at a system that comprises one or more video cameras and a remote server system. The method includes obtaining, via a video camera of the one or more video cameras, a continuous stream of video data for a scene. The video data stream comprises color video data in accordance with a determination that the scene has illumination above an illumination threshold and comprises infrared (IR) video data in accordance with a determination that the scene does not have illumination above the illumination threshold. The method includes colorizing the IR video data based on a subset of the color video data. The method further includes presenting the colorized video data to a user in real time.Type: GrantFiled: November 19, 2019Date of Patent: October 25, 2022Assignee: Google LLCInventors: George Alban Heitz, III, Rizwan Ahmed Chaudhry, Ankit Mohan, Joshua Fromm
-
Publication number: 20220300753Abstract: A method for recognizing persons in video streams includes obtaining a live video stream, detecting a first person in the live video stream, determining from analysis of the live video stream first information that identifies an attribute of the first person, determining based on at least some of the first information that the first person is not identifiable to the computing system, storing at least some of the first information, receiving a user classification of the first person as being a stranger, and deleting the stored first information.Type: ApplicationFiled: June 7, 2022Publication date: September 22, 2022Applicant: Google LLCInventors: Akshay R. Bapat, George Alban Heitz, III, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
-
Publication number: 20220245396Abstract: The various implementations described herein include systems and methods for recognizing persons in video streams. In one aspect, a method includes: (1) obtaining a live video stream; (2) detecting person(s) in the stream; and (3) determining, from analysis of the live video stream, personally identifiable information of the detected person(s); (4) determining, based on the personally identifiable information, that the first person is not known to the computing system; (5) in accordance with the determination that the first person is not known: (a) storing the personally identifiable information; and (b) requesting a user to classify the first person; and (6) in accordance with (i) a determination that a predetermined amount of time has elapsed since the request was transmitted and a response was not received, or (ii) a determination that a response was received classifying the first person as a stranger, deleting the stored personally identifiable information.Type: ApplicationFiled: February 18, 2022Publication date: August 4, 2022Applicant: Google LLCInventors: Akshay R. Bapat, George Alban Heitz, III, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
-
Publication number: 20220215664Abstract: A method at a server system includes: receiving a video stream from a remote video camera, wherein the video stream comprises a plurality of video frames; selecting a plurality of non-contiguous frames from the video stream, the plurality of non-contiguous frames being associated with a predetermined time interval; encoding the plurality of non-contiguous frames as a compressed video segment associated with the time interval; receiving a request from an application running on a client device to review video from the remote video camera for the time interval; and in response to the request, transmitting the video segment to the client device for viewing in the application.Type: ApplicationFiled: January 28, 2022Publication date: July 7, 2022Applicant: Google LLCInventors: Christopher Charles Burns, George Alban Heitz, III, James Edward Stewart, Cameron Hill, Seungho Yang, Joe Delone Venters, William Alex Finlayson, Carsten Hinz, Timothy Samuel Psiaki, Nathan Scott Klee, Gregory Rourk Nelson, Kevin James Avery, Lawrence W. Neal, Martin Davidsson
-
Publication number: 20220075489Abstract: A method at an electronic device with a display includes: displaying a user interface having a first region and a second region; receiving, and displaying in the first region of the user interface, a live video stream of a physical environment captured by a remote video camera; displaying, in the second region, a timeline corresponding to a timespan for a first portion of a duration during which the live video stream may have been recorded; in response to receiving a user interaction to move the timespan to a second portion of the duration, transitioning the displayed timeline to a new timeline that corresponds to the timespan for the second portion, and while transitioning, displaying, in the first region, a subset of video frames representing the first and/or second portion of the duration.Type: ApplicationFiled: June 14, 2021Publication date: March 10, 2022Inventors: Christopher Charles Burns, George Alban Heitz III, James Edward Stewart, Cameron Hill, Seungho Yang, Joe Delone Venters, William Alex Finlayson, Carsten Hinz, Timothy Samuel Psiaki, Nathan Scott Klee, Gregory Rourk Nelson, Kevin James Avery, Lawrence W. Neal, Martin Davidsson
-
Patent number: 11256951Abstract: The various implementations described herein include systems and methods for recognizing persons in video streams. In one aspect, a method includes: obtaining images collected by video cameras in a smart home environment, each image including a detected person; for each image, obtaining first information that identifies an attribute of the detected person, the first information generated from analysis of the image; grouping the images into a first group of a plurality of groups based on the first information, each group of the plurality of groups representing a unique person; receiving a request to remove a first image from the first group; removing the first image from the first group; and disassociating the first information from the first group.Type: GrantFiled: March 23, 2020Date of Patent: February 22, 2022Assignee: Google LLCInventors: Akshay R. Bapat, George Alban Heitz, III, Rizwan Ahmed Chaudhry, Navneet Dalal, James Edward Stewart, Jennifer Bush, Joe Delone Venters, Kara Gates, Timothy Butler, Yohannes Kifle, Anton Bastov
-
Patent number: 11238290Abstract: A method at a server system includes: receiving a video stream from a remote video camera, wherein the video stream comprises a plurality of video frames; selecting a plurality of non-contiguous frames from the video stream, the plurality of non-contiguous frames being associated with a predetermined time interval; encoding the plurality of non-contiguous frames as a compressed video segment associated with the time interval; receiving a request from an application running on a client device to review video from the remote video camera for the time interval; and in response to the request, transmitting the video segment to the client device for viewing in the application.Type: GrantFiled: October 26, 2016Date of Patent: February 1, 2022Assignee: Google LLCInventors: Christopher Charles Burns, George Alban Heitz, III, James Edward Stewart, Cameron Hill, Seungho Yang, Joe Delone Venters, William Alex Finlayson, Carsten Hinz, Timothy Samuel Psiaki, Nathan Scott Klee, Gregory Rourk Nelson, Kevin James Avery, Lawrence W. Neal, Martin Davidsson
-
Publication number: 20210400167Abstract: A method is performed at a system that comprises one or more video cameras and a remote server system. The method includes obtaining, via a video camera of the one or more video cameras, a continuous stream of video data for a scene. The video data stream comprises color video data in accordance with a determination that the scene has illumination above an illumination threshold and comprises infrared (IR) video data in accordance with a determination that the scene does not have illumination above the illumination threshold. The method includes colorizing the IR video data based on a subset of the color video data. The method further includes presenting the colorized video data to a user in real time.Type: ApplicationFiled: November 19, 2019Publication date: December 23, 2021Inventors: George Alban Heitz III, Rizwan Ahmed Chaudhry, Ankit Mohan, Joshua Fromm
-
Publication number: 20210329165Abstract: A display assistant device comprises a display, a camera, a speaker, microphones, a processor and memory. The memory stores programs comprising instructions that, when executed by the processor, enable a plurality of modes of the display assistant device. The modes include a monitoring mode and an assistant mode. In the monitoring mode, the device is configured to perform a remote monitoring function in which first video captured by the camera is streamed to a remote server system for monitoring uses. The monitoring uses include transmission of the first video to remote client devices authorized to access the first video. In the assistant mode, the device is configured to perform a second plurality of functions that excludes the monitoring function and includes a video communication function in which second video captured by the camera is transmitted to second devices participating in a video communication with a first user of the device.Type: ApplicationFiled: April 26, 2019Publication date: October 21, 2021Inventors: Michael Yang Liu, Jeffrey Ching Wang, Mohamed Mohy-Eldeen Abdelgany, John Jordan Nold, George Alban Heitz, III, Siddarth Raghunathan, Shayan Sayadi, Scott Mullins
-
Publication number: 20210216787Abstract: A method includes obtaining from an image sensor of a video camera a primary real-time video stream comprising images of a field of view of the video camera; identifying from the primary video stream one or more regions of interest in the field of view of the video camera; while obtaining the primary video stream, creating a first video sub-stream comprising a first plurality of images for a first one of the one or more identified regions of interest, wherein: images of the first plurality of images include image data for portions of the field of the video camera that include the first identified region of interest, and the images of the first plurality of images have fields of view that are smaller than the field of view of the video camera; and providing the first video sub-stream for display at a client device.Type: ApplicationFiled: March 29, 2021Publication date: July 15, 2021Applicant: Google LLCInventors: Joost van Hoof, Navneet Dalal, James Edward Stewart, Ting Yu, Maxime Veron, George Alban Heitz, III
-
Patent number: 11036361Abstract: A method at an electronic device with a display includes: displaying a user interface having a first region and a second region; receiving, and displaying in the first region of the user interface, a live video stream of a physical environment captured by a remote video camera; displaying, in the second region, a timeline corresponding to a timespan for a first portion of a duration during which the live video stream may have been recorded; in response to receiving a user interaction to move the timespan to a second portion of the duration, transitioning the displayed timeline to a new timeline that corresponds to the timespan for the second portion, and while transitioning, displaying, in the first region, a subset of video frames representing the first and/or second portion of the duration.Type: GrantFiled: August 8, 2019Date of Patent: June 15, 2021Assignee: Google LLCInventors: Christopher Charles Burns, George Alban Heitz, III, James Edward Stewart, Cameron Hill, Seungho Yang, Joe Delone Venters, William Alex Finlayson, Carsten Hinz, Timothy Samuel Psiaki, Nathan Scott Klee, Gregory Rourk Nelson, Kevin James Avery, Lawrence W. Neal, Martin Davidsson