Patents by Inventor Yunchao Gong
Yunchao Gong has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11496288Abstract: A method includes obtaining a plurality of representative vectors associated with face-related data. The method includes determining an encryption key based on a parameter stored in a record, generating an encrypted vector set by, for each respective vector of the plurality of representative vectors, encrypting the respective vector with a homomorphic encryption operation based on the encryption key, where the encrypted vector set includes a first encrypted vector that is linked to a subset of the face-related data associated with the first plurality of face vectors. The method further includes obtaining an encrypted face search vector using the encryption key to perform homomorphic encryption. The method further includes selecting a first encrypted vector based on the encrypted face search vector and retrieving the subset of the face-related data based on the first encrypted vector.Type: GrantFiled: April 8, 2022Date of Patent: November 8, 2022Assignee: Verkada Inc.Inventors: Kiumars Soltani, Yuewei Wang, Kabir Chhabra, Jose M. Giron Nanne, Yunchao Gong
-
Patent number: 11429664Abstract: A computer vision processor of a camera extracts attributes of persons or vehicles from hyperzooms generated from image frames. The hyperzooms represent traffic patterns. The extracting is performed using a feature extractor of an on-camera convolutional neural network (CNN) including an inverted residual structure. The attributes include at least colors of clothing of the persons or colors of the vehicles. Mobile semantic segmentation models of the CNN are generated using the hyperzooms and the attributes. Attribute analytics are generated by executing the mobile semantic segmentation models while obviating network usage by the camera. The attribute analytics are stored in a key-value database located on a memory card of the camera. A query is received from the server instance specifying one or more of the attributes. The attribute analytics are filtered using the one or more of the attributes to obtain a portion of the traffic patterns.Type: GrantFiled: March 21, 2022Date of Patent: August 30, 2022Assignee: Verkada Inc.Inventors: Yi Xu, Mayank Gupta, Xia Yang, Yuanyuan Chen, Zixiao (Shawn) Wang, Qiang (Kevin) Fu, Yunchao Gong, Naresh Nagabushan
-
Patent number: 11397517Abstract: Among other things, embodiments of the present disclosure improve the functionality of electronic messaging and imaging software and systems by enabling users to generate customized media overlays that can be shared with other users. For example, media overlays can be generated by the system and displayed in conjunction with media content (e.g., images and/or video) generated by an image-capturing device (e.g., a digital camera). In some embodiments, existing media overlays may be used by users to create derivative media overlays. The system may track usage of media overlays and any derivatives created based thereon, and allow users to control the distribution and use of their overlays in future derivatives. In some embodiments, for example, a user can modify an overlay they created and cause the modification to propagate to all derivative overlays based on the user's overlay.Type: GrantFiled: July 23, 2020Date of Patent: July 26, 2022Assignee: Snap Inc.Inventors: Newar Husam Al Majid, Sheldon Chang, Yunchao Gong, Kirk Ouimet, Haibo Zhao
-
Publication number: 20220019343Abstract: Disclosed are systems, methods, and computer-readable storage media to perform an interactive image recolorization process. The method includes receiving user input including a stroke drawn on an image presented on a client device. The stroke comprises a user-specified color. The method further includes determining a region of interest in the image. The method further includes recolorizing the region of interest on the image based on the user-specified color and causing presentation of a result of the recolorization on the client device.Type: ApplicationFiled: August 4, 2021Publication date: January 20, 2022Inventors: Kun Duan, Yunchao Gong, Nan Hu
-
Publication number: 20210374905Abstract: The technical problem of removing an object depicted in a selected region of an image to create a natural-looking edited image is addressed by providing systems, methods, and computer-readable storage media to perform automatic image inpainting. The method includes replacing the selected region using a color mask. A color mask can be generated using a mean color of pixels from a portion of the image that is distinct from and outside of the selected region.Type: ApplicationFiled: August 12, 2021Publication date: December 2, 2021Inventors: Kun Duan, Yunchao Gong, Nan Hu
-
Publication number: 20210350131Abstract: A computing system receives, from a client device, image data describing an image captured by an optical sensor of the client device. The computing system compares the image to a set of reference images that include associated metadata describing a real-world feature depicted by the respective reference image. The computing system determines, based on the comparison, a subset of reference images that are similar to the image, and then determines, based on associated metadata of the subset of reference images, that the image captured by the optical sensor of the client device depicts a first real-world feature. The computing system selects a subset of media overlays related to the first real-world feature based on metadata associated with each media overlay that describes the respective media overlay. The computing system transmits the subset of media overlays to the client device.Type: ApplicationFiled: July 21, 2021Publication date: November 11, 2021Inventors: Kirk Ouimet, Yunchao Gong
-
Publication number: 20210306289Abstract: Among other things, embodiments of the present disclosure improve the functionality of electronic messaging and imaging software and systems by determining topics of electronic communications between users and generating customized media content items based on such topics. The media content can be generated for a variety of topics and shared with other users. For example, media content (e.g., images or video) can be generated and displayed on a user's computing device, as well as transmitted to other users via electronic communications, such as short message service (SMS) or multimedia service (MMS) texts and mails.Type: ApplicationFiled: March 5, 2021Publication date: September 30, 2021Inventors: Yunchao Gong, Kirk Ouimet
-
Publication number: 20210279817Abstract: Systems, methods, and non-transitory computer-readable media can receive a compressed convolutional neural network (CNN). A media content item to be processed can be acquired. The compressed CNN to can be utilized to apply a media processing technique to the media content item to produce information about the media content item. It can be determined, based on at least some of the information about the media content item, whether to transmit at least a portion of the media content item to one or more remote servers for additional media processing.Type: ApplicationFiled: February 8, 2021Publication date: September 9, 2021Inventors: Yunchao Gong, Liu Liu, Lubomir Dimitrov Bourdev, Robert D. Fergus, Ming Yang
-
Patent number: 11106343Abstract: Disclosed are systems, methods, and computer-readable storage media to perform an interactive image recolorization process. The method includes receiving user input including a stroke drawn on an image presented on a client device. The stroke comprises a user-specified color. The method further includes determining a region of interest in the image. The method further includes recolorizing the region of interest on the image based on the user-specified color and causing presentation of a result of the recolorization on the client device.Type: GrantFiled: October 21, 2019Date of Patent: August 31, 2021Assignee: Snap Inc.Inventors: Kun Duan, Yunchao Gong, Nan Hu
-
Patent number: 11107185Abstract: Disclosed are systems, methods, and computer-readable storage media to perform automatic image inpainting using local patch statistics. The method includes receiving a user input identifying a user-selected region of an image and determining a local region for the user-selected region. The local region includes a portion of the image outside of the user-selected region and that surrounds the user-selected region. The method may further include identifying patch matches within the local region, and inpainting the user-selected region using some of the patch matches identified within the local region.Type: GrantFiled: March 25, 2020Date of Patent: August 31, 2021Assignee: Snap Inc.Inventors: Kun Duan, Yunchao Gong, Nan Hu
-
Patent number: 11100326Abstract: A computing system receives, from a client device, image data describing an image captured by an optical sensor of the client device. The computing system compares the image to a set of reference images that include associated metadata describing a real-world feature depicted by the respective reference image. The computing system determines, based on the comparison, a subset of reference images that are similar to the image, and then determines, based on associated metadata of the subset of reference images, that the image captured by the optical sensor of the client device depicts a first real-world feature. The computing system selects a subset of media overlays related to the first real-world feature based on metadata associated with each media overlay that describes the respective media overlay. The computing system transmits the subset of media overlays to the client device.Type: GrantFiled: October 15, 2019Date of Patent: August 24, 2021Assignee: Snap Inc.Inventors: Kirk Ouimet, Yunchao Gong
-
Patent number: 11003692Abstract: Systems, methods, and non-transitory computer-readable media can obtain a first batch of content items to be clustered. A set of clusters can be generated by clustering respective binary hash codes for each content item in the first batch, wherein content items included in a cluster are visually similar to one another. A next batch of content items to be clustered can be obtained. One or more respective binary hash codes for the content items in the next batch can be assigned to a cluster in the set of clusters.Type: GrantFiled: December 28, 2015Date of Patent: May 11, 2021Assignee: Facebook, Inc.Inventors: Yunchao Gong, Marcin Pawlowski, Fei Yang, Lubomir Bourdev, Louis Dominic Brandy, Robert D. Fergus
-
Patent number: 10951562Abstract: Among other things, embodiments of the present disclosure improve the functionality of electronic messaging and imaging software and systems by determining topics of electronic communications between users and generating customized media content items based on such topics. The media content can be generated for a variety of topics and shared with other users. For example, media content (e.g., images or video can be generated and displayed on a user's computing device, as well as transmitted to other users via electronic communications, such as short message service (SMS) or multimedia service (MMS) texts and emails.Type: GrantFiled: January 18, 2017Date of Patent: March 16, 2021Assignee: Snap. Inc.Inventors: Yunchao Gong, Kirk Ouimet
-
Publication number: 20200356241Abstract: Among other things, embodiments of the present disclosure improve the functionality of electronic messaging and imaging software and systems by enabling users to generate customized media overlays that can be shared with other users. For example, media overlays can be generated by the system and displayed in conjunction with media content (e.g., images and/or video) generated by an image-capturing device (e.g., a digital camera). In some embodiments, existing media overlays may be used by users to create derivative media overlays. The system may track usage of media overlays and any derivatives created based thereon, and allow users to control the distribution and use of their overlays in future derivatives. In some embodiments, for example, a user can modify an overlay they created and cause the modification to propagate to all derivative overlays based on the user's overlay.Type: ApplicationFiled: July 23, 2020Publication date: November 12, 2020Inventors: Newar Husam Al Majid, Sheldon Chang, Yunchao Gong, Kirk Ouimet, Haibo Zhao
-
Patent number: 10754525Abstract: Among other things, embodiments of the present disclosure improve the functionality of electronic messaging and imaging software and systems by enabling users to generate customized media overlays that can be shared with other users. For example, media overlays can be generated by the system and displayed in conjunction with media content (e.g., images and/or video) generated by an image-capturing device (e.g., a digital camera). In some embodiments, existing media overlays may be used by users to create derivative media overlays. The system may track usage of media overlays and any derivatives created based thereon, and allow users to control the distribution and use of their overlays in future derivatives. In some embodiments, for example, a user can modify an overlay they created and cause the modification to propagate to all derivative overlays based on the user's overlay.Type: GrantFiled: February 19, 2018Date of Patent: August 25, 2020Assignee: Snap Inc.Inventors: Newar Husam Al Majid, Sheldon Chang, Yunchao Gong, Kirk Ouimet, Haibo Zhao
-
Publication number: 20200226714Abstract: Disclosed are systems, methods, and computer-readable storage media to perform automatic image inpainting using local patch statistics. The method includes receiving a user input identifying a user-selected region of an image and determining a local region for the user-selected region. The local region includes a portion of the image outside of the user-selected region and that surrounds the user-selected region. The method may further include identifying patch matches within the local region, and inpainting the user-selected region using some of the patch matches identified within the local region.Type: ApplicationFiled: March 25, 2020Publication date: July 16, 2020Inventors: Kun Duan, Yunchao Gong, Nan Hu
-
Patent number: 10636119Abstract: Disclosed are systems, methods, and computer-readable storage media to object replacement in an image. The method includes receiving a user input identifying an object depicted in an image. The method further includes removing the object from the image by replacing a first region of the image with one or more patch matches identified from a second region of the image. Each of the one or more patch matches comprises two identical image patches. The second region includes a portion of the image that is outside of the first region and that surrounds the first region. The replacing of the first region with the one or more patch matches identified from the second region yields a modified image without the object.Type: GrantFiled: April 17, 2019Date of Patent: April 28, 2020Assignee: Snap Inc.Inventors: Kun Duan, Yunchao Gong, Nan Hu
-
Patent number: 10509553Abstract: Disclosed are systems, methods, and computer-readable storage media to perform an interactive image recolorization process. The method includes receiving user input including a single stroke drawn on an image presented on a client device. The method further includes determining a region of interest in the image based on the user input. The method further includes recolorizing the region of interest on the image and causing presentation of a result of the recolorization on the client device.Type: GrantFiled: November 29, 2018Date of Patent: December 17, 2019Assignee: Snap Inc.Inventors: Kun Duan, Yunchao Gong, Nan Hu
-
Patent number: 10482327Abstract: A computing system receives, from a client device, image data describing an image captured by an optical sensor of the client device. The computing system compares the image to a set of reference images that include associated metadata describing a real-world feature depicted by the respective reference image. The computing system determines, based on the comparison, a subset of reference images that are similar to the image, and then determines, based on associated metadata of the subset of reference images, that the image captured by the optical sensor of the client device depicts a first real-world feature. The computing system selects a subset of media overlays related to the first real-world feature based on metadata associated with each media overlay that describes the respective media overlay. The computing system transmits the subset of media overlays to the client device.Type: GrantFiled: November 2, 2017Date of Patent: November 19, 2019Assignee: Snap Inc.Inventors: Kirk Ouimet, Yunchao Gong
-
Patent number: 10304162Abstract: Disclosed are systems, methods, and computer-readable storage media to perform automatic image inpainting using local patch statistics. The method includes receiving a user input identifying a user-selected region of an image and determining a local region for the user-selected region. The local region includes a portion of the image outside of the user-selected region and that surrounds the user-selected region. The method may further include identifying patch matches within the local region, and inpainting the user-selected region using some of the patch matches identified within the local region.Type: GrantFiled: September 5, 2018Date of Patent: May 28, 2019Assignee: Snap Inc.Inventors: Kun Duan, Yunchao Gong, Nan Hu