Patents by Inventor Chi Yeung Jonathan Ng
Chi Yeung Jonathan Ng has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11948574Abstract: Remote automated assistant component(s) generate client device notification(s) based on a received IoT state change notification that indicates a change in at least one state associated with at least one IoT device. The generated client device notification(s) can each indicate the change in state associated with the at least one IoT device, and can optionally indicate the at least one IoT device. Further, the remote automated assistant component(s) can identify candidate assistant client devices that are associated with the at least one IoT device, and determine whether each of the one or more of the candidate assistant client device(s) should render a corresponding client device notification.Type: GrantFiled: December 21, 2022Date of Patent: April 2, 2024Assignee: GOOGLE LLCInventors: David Roy Schairer, Sumer Mohammed, Mark Spates, IV, Prem Kumar, Chi Yeung Jonathan Ng, Di Zhu, Steven Clark
-
Publication number: 20230362434Abstract: Various arrangements are detailed herein related to managing video recording. A system can include a network-enabled video camera that captures a video stream of a location and streams the video stream to a cloud-based home assistant integration platform. The system can include a home assistant device comprising a microphone and wireless network interface, the home assistant device configured to receive, via the microphone, a spoken command that requests video, captured by the network-enabled video camera, be recorded. The cloud-based home assistant integration platform may be configured to analyze the video stream captured using the network-enabled video camera to determine an identity of the user. The platform may be further configured to store a portion of the video stream linked to a user account of the user based on the spoken command and the identity of the user.Type: ApplicationFiled: July 12, 2023Publication date: November 9, 2023Applicant: Google LLCInventors: Jessica Yuan, James Stewart, Rajeev Nongpiur, Patrick Lister, Chi Yeung Jonathan Ng
-
Patent number: 11736760Abstract: Methods, devices, systems, and means for video integration with a home assistant device are described herein. The home assistant device interacts with a person in a video stream by capturing, using a network-enabled outdoor video camera, a video stream of an outdoor location of a premises at which the person is present and analyzing the person appearing in the captured video stream to determine an identity of the person. Based on determining the identity of the person, the home assistant device announces a presence of the person that is outdoors and outputs instructions to the person.Type: GrantFiled: March 28, 2022Date of Patent: August 22, 2023Assignee: Google LLCInventors: Jessica Yuan, James Stewart, Rajeev Nongpiur, Patrick Lister, Chi Yeung Jonathan Ng
-
Publication number: 20230237996Abstract: Remote automated assistant component(s) generate client device notification(s) based on a received IoT state change notification that indicates a change in at least one state associated with at least one IoT device. The generated client device notification(s) can each indicate the change in state associated with the at least one IoT device, and can optionally indicate the at least one IoT device. Further, the remote automated assistant component(s) can identify candidate assistant client devices that are associated with the at least one IoT device, and determine whether each of the one or more of the candidate assistant client device(s) should render a corresponding client device notification.Type: ApplicationFiled: December 21, 2022Publication date: July 27, 2023Inventors: David Roy Schairer, Sumer Mohammed, Mark Spates, IV, Prem Kumar, Chi Yeung Jonathan Ng, Di Zhu, Steven Clark
-
Publication number: 20230059370Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for predicting gaze and awareness using a neural network model. One of the methods includes obtaining sensor data (i) that is captured by one or more sensors of an autonomous vehicle and (ii) that characterizes an agent that is in a vicinity of the autonomous vehicle in an environment at a current time point. The sensor data is processed using a gaze prediction neural network to generate a gaze prediction that predicts a gaze of the agent at the current time point. The gaze prediction neural network includes an embedding subnetwork that is configured to process the sensor data to generate an embedding characterizing the agent, and a gaze subnetwork that is configured to process the embedding to generate the gaze prediction.Type: ApplicationFiled: August 12, 2022Publication date: February 23, 2023Inventors: Junhua Mao, Xinwei Shi, Anne Hobbs Dorsey, Rui Yan, Chi Yeung Jonathan Ng
-
Patent number: 11538477Abstract: Remote automated assistant component(s) generate client device notification(s) based on a received IoT state change notification that indicates a change in at least one state associated with at least one IoT device. The generated client device notification(s) can each indicate the change in state associated with the at least one IoT device, and can optionally indicate the at least one IoT device. Further, the remote automated assistant component(s) can identify candidate assistant client devices that are associated with the at least one IoT device, and determine whether each of the one or more of the candidate assistant client device(s) should render a corresponding client device notification.Type: GrantFiled: December 3, 2020Date of Patent: December 27, 2022Assignee: GOOGLE LLCInventors: David Roy Schairer, Sumer Mohammed, Mark Spates, IV, Prem Kumar, Chi Yeung Jonathan Ng, Di Zhu, Steven Clark
-
Publication number: 20220343763Abstract: Aspects of the disclosure provide for the identification of parkable areas. In one instance, observations of parked vehicles may be identified from logged data. The observations may be used to determine whether a sub-portion of an edge of a roadgraph corresponds to a parkable area. In some examples, the edge may define a drivable area in the roadgraph. In addition, map information is generated based on the determination of whether the sub-portion of the edge corresponds to the parkable area.Type: ApplicationFiled: April 21, 2021Publication date: October 27, 2022Inventors: Chi Yeung Jonathan Ng, Anthony Ronald Grue, Qichi Yang, Kevin Poulet, Zijian Guo, David Harrison Silver
-
Publication number: 20220217439Abstract: Various arrangements are detailed herein related to managing video recording. A system can include a network-enabled video camera that captures a video stream of a location and streams the video stream to a cloud-based home assistant integration platform. The system can include a home assistant device comprising a microphone and wireless network interface, the home assistant device configured to receive, via the microphone, a spoken command that requests video, captured by the network-enabled video camera, be recorded. The cloud-based home assistant integration platform may be configured to analyze the video stream captured using the network-enabled video camera to determine an identity of the user. The platform may be further configured to store a portion of the video stream linked to a user account of the user based on the spoken command and the identity of the user.Type: ApplicationFiled: March 28, 2022Publication date: July 7, 2022Applicant: Google LLCInventors: Jessica Yuan, James Stewart, Rajeev Nongpiur, Patrick Lister, Chi Yeung Jonathan Ng
-
Patent number: 11303955Abstract: Various arrangements are detailed herein related to managing video recording. A system can include a network-enabled video camera that captures a video stream of a location and streams the video stream to a cloud-based home assistant integration platform. The system can include a home assistant device comprising a microphone and wireless network interface, the home assistant device configured to receive, via the microphone, a spoken command that requests video, captured by the network-enabled video camera, be recorded. The cloud-based home assistant integration platform may be configured to analyze the video stream captured using the network-enabled video camera to determine an identity of the user. The platform may be further configured to store a portion of the video stream linked to a user account of the user based on the spoken command and the identity of the user.Type: GrantFiled: May 19, 2020Date of Patent: April 12, 2022Assignee: Google LLCInventors: Jessica Yuan, James Stewart, Rajeev Nongpiur, Patrick Lister, Chi Yeung Jonathan Ng
-
Publication number: 20210090566Abstract: Remote automated assistant component(s) generate client device notification(s) based on a received IoT state change notification that indicates a change in at least one state associated with at least one IoT device. The generated client device notification(s) can each indicate the change in state associated with the at least one IoT device, and can optionally indicate the at least one IoT device. Further, the remote automated assistant component(s) can identify candidate assistant client devices that are associated with the at least one IoT device, and determine whether each of the one or more of the candidate assistant client device(s) should render a corresponding client device notification.Type: ApplicationFiled: December 3, 2020Publication date: March 25, 2021Inventors: David Roy Schairer, Sumer Mohammed, Mark Spates, IV, Prem Kumar, Chi Yeung Jonathan Ng, Di Zhu, Steven Clark
-
Patent number: 10885917Abstract: Remote automated assistant component(s) generate client device notification(s) based on a received IoT state change notification that indicates a change in at least one state associated with at least one IoT device. The generated client device notification(s) can each indicate the change in state associated with the at least one IoT device, and can optionally indicate the at least one IoT device. Further, the remote automated assistant component(s) can identify candidate assistant client devices that are associated with the at least one IoT device, and determine whether each of the one or more of the candidate assistant client device(s) should render a corresponding client device notification.Type: GrantFiled: March 13, 2019Date of Patent: January 5, 2021Assignee: GOOGLE LLCInventors: David Roy Schairer, Sumer Mohammed, Mark Spates, IV, Prem Kumar, Chi Yeung Jonathan Ng, Di Zhu, Steven Clark
-
Publication number: 20200280763Abstract: Various arrangements are detailed herein related to managing video recording. A system can include a network-enabled video camera that captures a video stream of a location and streams the video stream to a cloud-based home assistant integration platform. The system can include a home assistant device comprising a microphone and wireless network interface, the home assistant device configured to receive, via the microphone, a spoken command that requests video, captured by the network-enabled video camera, be recorded. The cloud-based home assistant integration platform may be configured to analyze the video stream captured using the network-enabled video camera to determine an identity of the user. The platform may be further configured to store a portion of the video stream linked to a user account of the user based on the spoken command and the identity of the user.Type: ApplicationFiled: May 19, 2020Publication date: September 3, 2020Applicant: Google LLCInventors: Jessica Yuan, James Stewart, Rajeev Nongpiur, Patrick Lister, Chi Yeung Jonathan Ng
-
Publication number: 20200211546Abstract: Remote automated assistant component(s) generate client device notification(s) based on a received IoT state change notification that indicates a change in at least one state associated with at least one IoT device. The generated client device notification(s) can each indicate the change in state associated with the at least one IoT device, and can optionally indicate the at least one IoT device. Further, the remote automated assistant component(s) can identify candidate assistant client devices that are associated with the at least one IoT device, and determine whether each of the one or more of the candidate assistant client device(s) should render a corresponding client device notification.Type: ApplicationFiled: March 13, 2019Publication date: July 2, 2020Inventors: David Roy Schairer, Sumer Mohammed, Mark Spates, IV, Prem Kumar, Chi Yeung Jonathan Ng, Di Zhu, Steven Clark
-
Patent number: 10687109Abstract: Various arrangements are detailed herein related to modifying a shopping list using a home assistant device and an integrated video service. A network-enabled video camera may be used to capture a video stream of a location at which a user is present. A home assistant device may receive a spoken command that requests an item be added to a shopping list. The video stream captured using the network-enabled video camera may be analyzed to determine an identity of the user. A shopping list to modify may be determined based on the identity of the user. The determined shopping list may then be modified to indicate the item requested in the spoken command.Type: GrantFiled: December 21, 2018Date of Patent: June 16, 2020Assignee: Google LLCInventors: Jessica Yuan, James Stewart, Rajeev Nongpiur, Patrick Lister, Chi Yeung Jonathan Ng
-
Publication number: 20190124393Abstract: Various arrangements are detailed herein related to modifying a shopping list using a home assistant device and an integrated video service. A network-enabled video camera may be used to capture a video stream of a location at which a user is present. A home assistant device may receive a spoken command that requests an item be added to a shopping list. The video stream captured using the network-enabled video camera may be analyzed to determine an identity of the user. A shopping list to modify may be determined based on the identity of the user. The determined shopping list may then be modified to indicate the item requested in the spoken command.Type: ApplicationFiled: December 21, 2018Publication date: April 25, 2019Applicant: Google LLCInventors: Jessica Yuan, James Stewart, Rajeev Nongpiur, Patrick Lister, Chi Yeung Jonathan Ng
-
Patent number: 10200746Abstract: Various arrangements are detailed herein related to managing scheduled events using a home assistant and an integrated video service. Using a network-enabled video camera, a video stream of a location may be captured. The video stream captured may be used to determine an identity of a user present at the location. In response to identifying the identity of the user, access to a cloud-based calendar account for the user may be determined to be authorized. The cloud-based calendar account linked with the user may be accessed. A next calendar event mapped to the cloud-based calendar account that is scheduled to occur within a threshold time duration may be determined. A description linked with the next calendar event may be accessed. A network-enabled smart home assistant device may be used to synthesize speech to announce details related to the next event.Type: GrantFiled: July 19, 2017Date of Patent: February 5, 2019Assignee: Google LLCInventors: Jessica Yuan, James Stewart, Rajeev Nongpiur, Patrick Lister, Chi Yeung Jonathan Ng
-
Publication number: 20190028759Abstract: Various arrangements are detailed herein related to managing scheduled events using a home assistant and an integrated video service. Using a network-enabled video camera, a video stream of a location may be captured. The video stream captured may be used to determine an identity of a user present at the location. In response to identifying the identity of the user, access to a cloud-based calendar account for the user may be determined to be authorized. The cloud-based calendar account linked with the user may be accessed. A next calendar event mapped to the cloud-based calendar account that is scheduled to occur within a threshold time duration may be determined. A description linked with the next calendar event may be accessed. A network-enabled smart home assistant device may be used to synthesize speech to announce details related to the next event.Type: ApplicationFiled: July 19, 2017Publication date: January 24, 2019Applicant: Google Inc.Inventors: Jessica Yuan, James Stewart, Rajeev Nongpiur, Patrick Lister, Chi Yeung Jonathan Ng