Patents by Inventor Yunchao Gong
Yunchao Gong has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240153273Abstract: A method for monitoring protected regions of a camera view includes receiving, at a processor of a video camera system, a video stream including a series of video frames depicting at least one scene. A background model is identified based on a predefined representation of at least one region of interest associated with the scene. Each of the video frames is compared to the background model, to define an associated binary mask. A persistent change in the at least one region of interest is detected, based on the binary masks, the persistent change having an associated duration that exceeds a predefined threshold. In response to detecting the persistent change, a change notification message including a video file is generated. The method also includes causing display of the change notification message via a user interface and/or causing transmission of the change notification message to a remote compute device.Type: ApplicationFiled: November 3, 2022Publication date: May 9, 2024Inventors: Rishabh GOYAL, Song CAO, John PERUZZI, Yunchao GONG
-
Patent number: 11978267Abstract: A method and related system operations include obtaining a video stream with an image sensor of a camera device, detecting a plurality of target objects by executing a neural network model based on the video stream with a vision processor unit of the camera device. The method also includes generating a plurality of bounding boxes, determining a plurality of character sequences by, for each respective bounding box of the plurality of bounding boxes, performing a set of optical character recognition (OCR) operations to determine a respective character sequence of the plurality of character sequences. The method also includes updating a plurality of tracklets to indicate the plurality of bounding boxes and storing the plurality of tracklets in association with the plurality of character sequences in a memory of the camera device.Type: GrantFiled: February 13, 2023Date of Patent: May 7, 2024Assignee: Verkada Inc.Inventors: Mayank Gupta, Suraj Arun Vathsa, Song Cao, Yi Xu, Yuanyuan Chen, Yunchao Gong
-
Patent number: 11948373Abstract: Automatic license plate recognition occurs when a light sensor that continually captures video detects motion as a vehicle is driven through a gate. The light sensor detects the vehicle and license plate in the video stream captured by the light sensor. An algorithm associated with the video stream of the light sensor is trained to detect license plates. The light sensor starts executing the recognition algorithm when it detects motion. Recognition of characters in the license plate is based upon an aggregation of several captured video frames in which a license plate is detected.Type: GrantFiled: December 12, 2022Date of Patent: April 2, 2024Assignee: Verkada Inc.Inventors: Yi Xu, Yunchao Gong, Suraj Arun Vathsa, Mayank Gupta, Naresh Nagabushan
-
Patent number: 11900688Abstract: A computer vision processor of a camera generates hyperzooms for persons or vehicles from image frames captured by the camera. The hyperzooms include a first hyperzoom associated with the persons or vehicles. The computer vision processor tracks traffic patterns of the persons or vehicles while obviating network usage by the camera by predicting positions of the persons or vehicles using a Kalman Filter from the first hyperzoom. The persons or vehicles are detected in the second hyperzoom. The positions of the persons or vehicles are updated based on detecting the persons or vehicles in the second hyperzoom. The first hyperzoom is removed from the camera. Tracks of the persons or vehicles are generated based on the updated positions. The second hyperzoom is removed from the camera. Track metadata is generated from the tracks for storing in a key-value database located on a non-transitory computer-readable storage medium of the camera.Type: GrantFiled: January 17, 2023Date of Patent: February 13, 2024Assignee: Verkada Inc.Inventors: Yi Xu, Mayank Gupta, Xia Yang, Yuanyuan Chen, Zixiao (Shawn) Wang, Qiang (Kevin) Fu, Yunchao Gong, Naresh Nagabushan
-
Publication number: 20230394850Abstract: A method and related system operations includes, determining, for each respective frame of a frame sequence, a respective bounding box that surrounds a respective sub-image of the respective frame, determining a respective string and respective confidence values associated with the respective string based on the respective sub-image, updating the tracklet to comprise the respective bounding box based on the respective string and at least one string generated by the object recognition model for a previous frame, and updating a voting table by adding the respective confidence values to the voting table. The method also includes generating an aggregated string based on the voting table by, for a set of positions of the aggregated string, determining a character associated with a maximum confidence value indicated by the voting table and associating the aggregated string with the tracklet in a data structure.Type: ApplicationFiled: August 22, 2023Publication date: December 7, 2023Inventors: Mayank GUPTA, Suraj Arun VATHSA, Song CAO, Yi XU, Yuanyuan CHEN, Yunchao GONG
-
Patent number: 11836185Abstract: A computing system receives, from a client device, image data describing an image captured by an optical sensor of the client device. The computing system compares the image to a set of reference images that include associated metadata describing a real-world feature depicted by the respective reference image. The computing system determines, based on the comparison, a subset of reference images that are similar to the image, and then determines, based on associated metadata of the subset of reference images, that the image captured by the optical sensor of the client device depicts a first real-world feature. The computing system selects a subset of media overlays related to the first real-world feature based on metadata associated with each media overlay that describes the respective media overlay. The computing system transmits the subset of media overlays to the client device.Type: GrantFiled: July 21, 2021Date of Patent: December 5, 2023Assignee: Snap Inc.Inventors: Kirk Ouimet, Yunchao Gong
-
Publication number: 20230367808Abstract: A computer vision processor of a camera extracts attributes of persons or vehicles from hyperzooms generated from image frames. The hyperzooms represent traffic patterns. The extracting is performed using a feature extractor of an on-camera convolutional neural network (CNN) including an inverted residual structure. The attributes include at least colors of clothing of the persons or colors of the vehicles. Mobile semantic segmentation models of the CNN are generated using the hyperzooms and the attributes. Attribute analytics are generated by executing the mobile semantic segmentation models while obviating network usage by the camera. The attribute analytics are stored in a key-value database located on a memory card of the camera. A query is received from the server instance specifying one or more of the attributes. The attribute analytics are filtered using the one or more of the attributes to obtain a portion of the traffic patterns.Type: ApplicationFiled: July 5, 2023Publication date: November 16, 2023Inventors: Yi XU, Mayank GUPTA, Xia YANG, Yuanyuan CHEN, Zixiao (Shawn) WANG, Qiang (Kevin) FU, Yunchao GONG, Naresh NAGABUSHAN
-
Publication number: 20230368332Abstract: The technical problem of removing an object depicted in a selected region of an image to create a natural-looking edited image is addressed by providing systems, methods, and computer-readable storage media to perform automatic image inpainting. The method includes replacing the selected region using a color mask. A color mask can be generated using a mean color of pixels from a portion of the image that is distinct from and outside of the selected region.Type: ApplicationFiled: May 12, 2023Publication date: November 16, 2023Inventors: Kun Duan, Yunchao Gong, Nan Hu
-
Publication number: 20230343114Abstract: A method and related system operations include obtaining a video stream with an image sensor of a camera device, detecting a plurality of target objects by executing a neural network model based on the video stream with a vision processor unit of the camera device. The method also includes generating a plurality of bounding boxes, determining a plurality of character sequences by, for each respective bounding box of the plurality of bounding boxes, performing a set of optical character recognition (OCR) operations to determine a respective character sequence of the plurality of character sequences. The method also includes updating a plurality of tracklets to indicate the plurality of bounding boxes and storing the plurality of tracklets in association with the plurality of character sequences in a memory of the camera device.Type: ApplicationFiled: February 13, 2023Publication date: October 26, 2023Inventors: Mayank GUPTA, Suraj Arun VATHSA, Song CAO, Yi XU, Yuanyuan CHEN, Yunchao GONG
-
Publication number: 20230343113Abstract: Automatic license plate recognition occurs when a light sensor that continually captures video detects motion as a vehicle is driven through a gate. The light sensor detects the vehicle and license plate in the video stream captured by the light sensor. An algorithm associated with the video stream of the light sensor is trained to detect license plates. The light sensor starts executing the recognition algorithm when it detects motion. Recognition of characters in the license plate is based upon an aggregation of several captured video frames in which a license plate is detected.Type: ApplicationFiled: December 12, 2022Publication date: October 26, 2023Inventors: Yi XU, Yunchao GONG, Suraj Arun VATHSA, Mayank GUPTA, Naresh NAGABUSHAN
-
Publication number: 20230327848Abstract: A method includes obtaining a plurality of representative vectors associated with face-related data. The method includes determining an encryption key based on a parameter stored in a record, generating an encrypted vector set by, for each respective vector of the plurality of representative vectors, encrypting the respective vector with a homomorphic encryption operation based on the encryption key, where the encrypted vector set includes a first encrypted vector that is linked to a subset of the face-related data associated with the first plurality of face vectors. The method further includes obtaining an encrypted face search vector using the encryption key to perform homomorphic encryption. The method further includes selecting a first encrypted vector based on the encrypted face search vector and retrieving the subset of the face-related data based on the first encrypted vector.Type: ApplicationFiled: September 30, 2022Publication date: October 12, 2023Inventors: Kiumars SOLTANI, Yuewei WANG, Kabir CHHABRA, Jose M. GIRON NANNE, Yunchao GONG
-
Publication number: 20230305689Abstract: Disclosed are systems, methods, and computer-readable storage media to perform an interactive image recolorization process. The method includes receiving user input including a stroke drawn on an image presented on a client device. The stroke comprises a user-specified color. The method further includes determining a region of interest in the image. The method further includes recolorizing the region of interest on the image based on the user-specified color and causing presentation of a result of the recolorization on the client device.Type: ApplicationFiled: June 2, 2023Publication date: September 28, 2023Inventors: Kun Duan, Yunchao Gong, Nan Hu
-
Publication number: 20230298359Abstract: A computer vision processor of a camera generates hyperzooms for persons or vehicles from image frames captured by the camera. The hyperzooms include a first hyperzoom associated with the persons or vehicles. The computer vision processor tracks traffic patterns of the persons or vehicles while obviating network usage by the camera by predicting positions of the persons or vehicles using a Kalman Filter from the first hyperzoom. The persons or vehicles are detected in the second hyperzoom. The positions of the persons or vehicles are updated based on detecting the persons or vehicles in the second hyperzoom. The first hyperzoom is removed from the camera. Tracks of the persons or vehicles are generated based on the updated positions. The second hyperzoom is removed from the camera. Track metadata is generated from the tracks for storing in a key-value database located on a non-transitory computer-readable storage medium of the camera.Type: ApplicationFiled: January 17, 2023Publication date: September 21, 2023Inventors: Yi XU, Mayank GUPTA, Xia YANG, Yuanyuan CHEN, Zixiao (Shawn) WANG, Qiang (Kevin) FU, Yunchao GONG, Naresh NAGABUSHAN
-
Patent number: 11734343Abstract: A computer vision processor of a camera extracts attributes of persons or vehicles from hyperzooms generated from image frames. The hyperzooms represent traffic patterns. The extracting is performed using a feature extractor of an on-camera convolutional neural network (CNN) including an inverted residual structure. The attributes include at least colors of clothing of the persons or colors of the vehicles. Mobile semantic segmentation models of the CNN are generated using the hyperzooms and the attributes. Attribute analytics are generated by executing the mobile semantic segmentation models while obviating network usage by the camera. The attribute analytics are stored in a key-value database located on a memory card of the camera. A query is received from the server instance specifying one or more of the attributes. The attribute analytics are filtered using the one or more of the attributes to obtain a portion of the traffic patterns.Type: GrantFiled: January 17, 2023Date of Patent: August 22, 2023Assignee: Verkada Inc.Inventors: Yi Xu, Mayank Gupta, Xia Yang, Yuanyuan Chen, Zixiao (Shawn) Wang, Qiang (Kevin) Fu, Yunchao Gong, Naresh Nagabushan
-
Patent number: 11687220Abstract: Disclosed are systems, methods, and computer-readable storage media to perform an interactive image recolorization process. The method includes receiving user input including a stroke drawn on an image presented on a client device. The stroke comprises a user-specified color. The method further includes determining a region of interest in the image. The method further includes recolorizing the region of interest on the image based on the user-specified color and causing presentation of a result of the recolorization on the client device.Type: GrantFiled: August 4, 2021Date of Patent: June 27, 2023Assignee: Snap Inc.Inventors: Kun Duan, Yunchao Gong, Nan Hu
-
Patent number: 11682105Abstract: The technical problem of removing an object depicted in a selected region of an image to create a natural-looking edited image is addressed by providing systems, methods, and computer-readable storage media to perform automatic image inpainting. The method includes replacing the selected region using a color mask. A color mask can be generated using a mean color of pixels from a portion of the image that is distinct from and outside of the selected region.Type: GrantFiled: August 12, 2021Date of Patent: June 20, 2023Assignee: SNAP INC.Inventors: Kun Duan, Yunchao Gong, Nan Hu
-
Patent number: 11676418Abstract: A method includes generating a first representative vector based on a first vectors, wherein the first representative vector is associated with the first vectors in a collection of representative vectors, and the first vectors comprises a set of vector values within a latent space. The method further includes generating a second representative vector based on a second vectors, wherein the second representative vector is associated with the second vectors in the collection of representative vectors. The method further includes determining a latent space distance based on the first and second vectors. The method further includes determining whether the latent space distance satisfies a threshold. In response to a determination that the latent space distance satisfies the threshold, the method further includes associating a combined representative vector with the first vectors and the second vectors and removing the first and second representative vectors from the collection of representative vectors.Type: GrantFiled: November 18, 2022Date of Patent: June 13, 2023Assignee: Verkada Inc.Inventors: Kiumars Soltani, Yuewei Wang, Kabir Chhabra, Jose M. Giron Nanne, Yunchao Gong
-
Patent number: 11594043Abstract: A computer vision processor of a camera generates hyperzooms for persons or vehicles from image frames captured by the camera. The hyperzooms include a first hyperzoom associated with the persons or vehicles. The computer vision processor tracks traffic patterns of the persons or vehicles while obviating network usage by the camera by predicting positions of the persons or vehicles using a Kalman Filter from the first hyperzoom. The persons or vehicles are detected in the second hyperzoom. The positions of the persons or vehicles are updated based on detecting the persons or vehicles in the second hyperzoom. The first hyperzoom is removed from the camera. Tracks of the persons or vehicles are generated based on the updated positions. The second hyperzoom is removed from the camera. Track metadata is generated from the tracks for storing in a key-value database located on a non-transitory computer-readable storage medium of the camera.Type: GrantFiled: March 21, 2022Date of Patent: February 28, 2023Assignee: Verkada Inc.Inventors: Yi Xu, Mayank Gupta, Xia Yang, Yuanyuan Chen, Zixiao (Shawn) Wang, Qiang (Kevin) Fu, Yunchao Gong, Naresh Nagabushan
-
Patent number: 11586667Abstract: A computer vision processor of a camera extracts attributes of persons or vehicles from hyperzooms generated from image frames. The hyperzooms represent traffic patterns. The extracting is performed using a feature extractor of an on-camera convolutional neural network (CNN) including an inverted residual structure. The attributes include at least colors of clothing of the persons or colors of the vehicles. Mobile semantic segmentation models of the CNN are generated using the hyperzooms and the attributes. Attribute analytics are generated by executing the mobile semantic segmentation models while obviating network usage by the camera. The attribute analytics are stored in a key-value database located on a memory card of the camera. A query is received from the server instance specifying one or more of the attributes. The attribute analytics are filtered using the one or more of the attributes to obtain a portion of the traffic patterns.Type: GrantFiled: July 20, 2022Date of Patent: February 21, 2023Assignee: Verkada Inc.Inventors: Yi Xu, Mayank Gupta, Xia Yang, Yuanyuan Chen, Zixiao (Shawn) Wang, Qiang (Kevin) Fu, Yunchao Gong, Naresh Nagabushan
-
Patent number: 11557133Abstract: Automatic license plate recognition occurs when a light sensor that continually captures video detects motion as a vehicle is driven through a gate. The light sensor detects the vehicle and license plate in the video stream captured by the light sensor. An algorithm associated with the video stream of the light sensor is trained to detect license plates. The light sensor starts executing the recognition algorithm when it detects motion. Recognition of characters in the license plate is based upon an aggregation of several captured video frames in which a license plate is detected.Type: GrantFiled: July 22, 2022Date of Patent: January 17, 2023Assignee: Verkada Inc.Inventors: Yi Xu, Yunchao Gong, Suraj Arun Vathsa, Mayank Gupta, Naresh Nagabushan