Patents by Inventor Peizhao Zhang
Peizhao Zhang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11748615Abstract: Computer implemented systems are described that implement a differentiable neural architecture search (DNAS) engine executing on one or more processors. The DNAS engine is configured with a stochastic super net defining a layer-wise search space having a plurality of candidate layers, each of the candidate layers specifying one or more operators for a neural network architecture. Further, the DNAS engine is configured to process training data to train weights for the operators in the stochastic super net based on a loss function representing a latency of the respective operator on a target platform, and to select a set of candidate neural network architectures from the trained stochastic super net. The DNAS engine may, for example, be configured to train the stochastic super net by traversing the layer-wise search space using gradient-based optimization of network architecture distribution.Type: GrantFiled: December 5, 2019Date of Patent: September 5, 2023Assignee: META PLATFORMS, INC.Inventors: Bichen Wu, Peizhao Zhang, Peter Vajda, Xiaoliang Dai, Yanghan Wang, Yuandong Tian
-
Publication number: 20230222669Abstract: A method includes generating first and second series of segmentation masks for a first and second series of images in a video, respectively. The first series of segmentation masks are generated by using a machine-learning model to (1) generate a first segmentation mask based on a first image in the first series of images and a predetermined fixed segmentation mask, and (2) generate a second segmentation mask based on a second image in the first series of images and the first segmentation mask. The second series of segmentation masks are generated by using the machine-learning model to (1) generate a third segmentation mask based on a third image in the second series of images and the predetermined fixed segmentation mask, and (2) generate a fourth segmentation mask based on a fourth image in the second series of images and the third segmentation mask.Type: ApplicationFiled: January 10, 2023Publication date: July 13, 2023Inventors: Wenliang Zhao, Peizhao Zhang, Georgy Marrero, Siddharth Sandip Shah, Hyungjun Kim
-
Publication number: 20220156981Abstract: In one embodiment, a first device may receive, from a second device, a reference landmark map identifying locations of facial features of a user of the second device depicted in a reference image and a feature map, generated based on the reference image, representing an identity of the user. The first device may receive, from the second device, a current compressed landmark map based on a current image of the user and decompress the current compressed landmark map to generate a current landmark map. The first device may update the feature map based on a motion field generated using the reference landmark map and the current landmark map. The first device may generate scaling factors based on a normalization facial mask of pre-determined facial features of the user. The first device may generate an output image of the user by decoding the updated feature map using the scaling factors.Type: ApplicationFiled: April 6, 2021Publication date: May 19, 2022Inventors: Maxime Mohamad Oquab, Pierre Stock, Oran Gafni, Daniel Raynald David Haziza, Tao Xu, Peizhao Zhang, Onur Çelebi, Patrick Labatut, Thibault Michel Max Peyronel, Camille Couprie
-
Patent number: 10796452Abstract: In one embodiment, a system accesses a probability model associated with an image depicting a body. The probability model includes probability values associated with regions of the image and each probability value represents a probability of the associated region of the image containing a particular body part. The system selects a subset (e.g., 3) of the probability values based on a comparison of the probability values. For each selected probability value, the system identifies surrounding probability values surrounding the selected probability value and computes a probabilistic maximum based on the selected probability value and the surrounding probability values. Each probabilistic maximum is associated with a location within the regions associated with the selected probability value and the surrounding probability values.Type: GrantFiled: December 31, 2018Date of Patent: October 6, 2020Assignee: Facebook, Inc.Inventors: Peter Vajda, Peizhao Zhang, Matthieu Tony Uyttendaele, Yanghan Wang
-
Patent number: 10733431Abstract: In one embodiment, a system may access first, second, and third probability models that are respectively associated with predetermined first and second body parts and a predetermined segment connecting the first and second body parts. Each model includes probability values associated with regions in an image, with each value representing the probability of the associated region containing the associated body part or segment. The system may select a first and second region based on the first probability model and a third region based on the second probability model. Based on the third probability model, the system may compute a first probability score for regions connecting the first and third regions and a second probability score for regions connecting the second and third regions. Based on the first and second probability scores, the system may select the first region to indicate where the predetermined first body part appears in the image.Type: GrantFiled: December 31, 2018Date of Patent: August 4, 2020Assignee: Facebook, Inc.Inventors: Peizhao Zhang, Peter Vajda, Kevin Matzen, Ross Girshick
-
Patent number: 10692243Abstract: In one embodiment, a system may access an image and generate a feature map for the image using a neural network. The system may identify regions of interest in the feature map. Regional feature maps may be generated for the regions of interest, respectively. Each of the regional feature maps has a first, a second, and a third dimension. The system may generate a first combined regional feature map by combining the regional feature maps. The combined regional feature map has a first, a second, and a third dimension. The system may generate a second combined regional feature map by processing the first combined regional feature map using one or more convolutional layers. The system may generate, for each of the regions of interest, information associated with an object instance based on a portion of the second combined regional feature map associated with that region of interest.Type: GrantFiled: May 4, 2018Date of Patent: June 23, 2020Assignee: Facebook, Inc.Inventors: Peter Vajda, Peizhao Zhang, Fei Yang, Yanghan Wang
-
Patent number: 10650072Abstract: One general aspect includes a method, including: capturing an image of an object having a multi-part identifier displayed thereon, the multi-part identifier including a first portion and a second portion, the first portion including graphical content and the second portion including human-recognizable textual content. The method also includes based on the captured image, identifying a domain associated with the graphical content. The method also includes based on the captured image, identifying a sub-part of the domain associated with the textual content. The method also includes identifying a digital destination based on the identified domain and the identified sub-part. The method also includes performing an action based on the digital destination. Other embodiments of this aspect include corresponding computer systems, apparatus, and computer programs recorded on one or more computer storage devices, each configured to perform the actions of the methods.Type: GrantFiled: October 30, 2017Date of Patent: May 12, 2020Assignee: FACEBOOK, INC.Inventors: Maria Loveva, Matthew William Canton, Peizhao Zhang, Shihang Wei, Shen Wang, Peter Vajda, Han Wang
-
Patent number: 10586350Abstract: In one embodiment, a system accesses pose probability models for predetermined parts of a body depicted in an image. Each of the pose probability models is configured for determining a probability of the associated predetermined body part being at a location in the image. The system determines a candidate pose that is defined by a set of coordinates representing candidate locations of the predetermined body parts. The system further determines a first probability score for the candidate pose based on the pose probability models and the set of coordinates of the candidate pose. A pose representation is generated for the candidate pose using a transformation model and the candidate pose. The system determines a second probability score for the pose representation based on a pose-representation probability model. The system selects the candidate pose to represent a pose of the body based on at least the first and second probability scores.Type: GrantFiled: May 4, 2018Date of Patent: March 10, 2020Assignee: Facebook, Inc.Inventors: Peter Vajda, Peizhao Zhang, Fei Yang, Yanghan Wang
-
Patent number: 10565729Abstract: In one embodiment, a method includes a system accessing an image and generating a feature map using a first neural network. The system identifies a plurality of regions of interest in the feature map. A plurality of regional feature maps may be generated for the plurality of regions of interest, respectively. Using a second neural network, the system may detect at least one regional feature map in the plurality of regional feature maps that corresponds to a person depicted in the image, and generate a target region definition associated with a location of the person using the regional feature map. Based on the target region definition associated with the location of the person, a target regional feature map may be generated by sampling the feature map for the image. The system may process the target regional feature map to generate a keypoint mask and an instance segmentation mask.Type: GrantFiled: May 4, 2018Date of Patent: February 18, 2020Assignee: Facebook, Inc.Inventors: Peter Vajda, Peizhao Zhang, Fei Yang, Yanghan Wang
-
Publication number: 20190171870Abstract: In one embodiment, a method includes a system accessing an image and generating a feature map using a first neural network. The system identifies a plurality of regions of interest in the feature map. A plurality of regional feature maps may be generated for the plurality of regions of interest, respectively. Using a second neural network, the system may detect at least one regional feature map in the plurality of regional feature maps that corresponds to a person depicted in the image, and generate a target region definition associated with a location of the person using the regional feature map. Based on the target region definition associated with the location of the person, a target regional feature map may be generated by sampling the feature map for the image. The system may process the target regional feature map to generate a keypoint mask and an instance segmentation mask.Type: ApplicationFiled: May 4, 2018Publication date: June 6, 2019Inventors: Peter Vajda, Peizhao Zhang, Fei Yang, Yanghan Wang
-
Publication number: 20190172223Abstract: In one embodiment, a system accesses pose probability models for predetermined parts of a body depicted in an image. Each of the pose probability models is configured for determining a probability of the associated predetermined body part being at a location in the image. The system determines a candidate pose that is defined by a set of coordinates representing candidate locations of the predetermined body parts. The system further determines a first probability score for the candidate pose based on the pose probability models and the set of coordinates of the candidate pose. A pose representation is generated for the candidate pose using a transformation model and the candidate pose. The system determines a second probability score for the pose representation based on a pose-representation probability model. The system selects the candidate pose to represent a pose of the body based on at least the first and second probability scores.Type: ApplicationFiled: May 4, 2018Publication date: June 6, 2019Inventors: Peter Vajda, Peizhao Zhang, Fei Yang, Yanghan Wang
-
Publication number: 20190172224Abstract: In one embodiment, a system accesses a probability model associated with an image depicting a body. The probability model includes probability values associated with regions of the image and each probability value represents a probability of the associated region of the image containing a particular body part. The system selects a subset (e.g., 3) of the probability values based on a comparison of the probability values. For each selected probability value, the system identifies surrounding probability values surrounding the selected probability value and computes a probabilistic maximum based on the selected probability value and the surrounding probability values. Each probabilistic maximum is associated with a location within the regions associated with the selected probability value and the surrounding probability values.Type: ApplicationFiled: December 31, 2018Publication date: June 6, 2019Inventors: Peter Vajda, Peizhao Zhang, Matthieu Tony Uyttendaele, Yanghan Wang
-
Publication number: 20190171903Abstract: In one embodiment, a system may access an image and generate a feature map for the image using a neural network. The system may identify regions of interest in the feature map. Regional feature maps may be generated for the regions of interest, respectively. Each of the regional feature maps has a first, a second, and a third dimension. The system may generate a first combined regional feature map by combining the regional feature maps. The combined regional feature map has a first, a second, and a third dimension. The system may generate a second combined regional feature map by processing the first combined regional feature map using one or more convolutional layers. The system may generate, for each of the regions of interest, information associated with an object instance based on a portion of the second combined regional feature map associated with that region of interest.Type: ApplicationFiled: May 4, 2018Publication date: June 6, 2019Inventors: Peter Vajda, Peizhao Zhang, Fei Yang, Yanghan Wang
-
Publication number: 20190171871Abstract: In one embodiment, a system may access first, second, and third probability models that are respectively associated with predetermined first and second body parts and a predetermined segment connecting the first and second body parts. Each model includes probability values associated with regions in an image, with each value representing the probability of the associated region containing the associated body part or segment. The system may select a first and second region based on the first probability model and a third region based on the second probability model. Based on the third probability model, the system may compute a first probability score for regions connecting the first and third regions and a second probability score for regions connecting the second and third regions. Based on the first and second probability scores, the system may select the first region to indicate where the predetermined first body part appears in the image.Type: ApplicationFiled: December 31, 2018Publication date: June 6, 2019Inventors: Peizhao Zhang, Peter Vajda, Kevin Matzen, Ross Girshick
-
Publication number: 20190130043Abstract: One general aspect includes a method, including: capturing an image of an object having a multi-part identifier displayed thereon, the multi-part identifier including a first portion and a second portion, the first portion including graphical content and the second portion including human-recognizable textual content. The method also includes based on the captured image, identifying a domain associated with the graphical content. The method also includes based on the captured image, identifying a sub-part of the domain associated with the textual content. The method also includes identifying a digital destination based on the identified domain and the identified sub-part. The method also includes performing an action based on the digital destination. Other embodiments of this aspect include corresponding computer systems, apparatus, and computer programs recorded on one or more computer storage devices, each configured to perform the actions of the methods.Type: ApplicationFiled: October 30, 2017Publication date: May 2, 2019Inventors: Maria Ioveva, Matthew William Canton, Peizhao Zhang, Shihang Wei, Shen Wang, Peter Vajda, Han Wang