Patents by Inventor Balamanohar Paluri

Balamanohar Paluri has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 9928423
    Abstract: Local models learned from anomaly detection are used to rank detected anomalies. The local model patterns are defined from image feature values extracted from an image field of video image data with respect to different predefined spatial and temporal local units, wherein anomaly results are determined by fitting extracted image features to the local model patterns. Image features values extracted from the image field local units associated with anomaly results are normalized, and image feature values extracted from the image field local units are clustered. Weights for anomaly results are learned as a function of the relations of the normalized extracted image feature values to the clustered image feature values. The normalized values are multiplied by the learned weights to generate ranking values to rank the anomalies.
    Type: Grant
    Filed: September 4, 2015
    Date of Patent: March 27, 2018
    Assignee: International Business Machines Corporation
    Inventors: Ankur Datta, Balamanohar Paluri, Sharathchandra U. Pankanti, Yun Zhai
  • Patent number: 9892423
    Abstract: Systems, methods, and non-transitory computer readable media configured to receive an advertisement including an image. A fraud assessment value for the advertisement can be determined. An image assessment value for the image can be determined. The fraud assessment value and a threshold value for fraud assessment can be compared. The image assessment value and a threshold value for image assessment can be compared. Fraud associated with the advertisement can be determined based on comparison of the fraud assessment value and the threshold value for fraud assessment and comparison of the image assessment value and the threshold value for image assessment.
    Type: Grant
    Filed: March 24, 2015
    Date of Patent: February 13, 2018
    Assignee: Facebook, Inc.
    Inventors: Vivek Kaul, Tara Brittany Stewart, Utkarsh Lath, Michael Francis Zolli, Balamanohar Paluri, Nikhil Johri
  • Patent number: 9858484
    Abstract: Systems, methods, and non-transitory computer-readable media can acquire video content for which video feature descriptors are to be determined. The video content can be processed based at least in part on a convolutional neural network including a set of two-dimensional convolutional layers and a set of three-dimensional convolutional layers. One or more outputs can be generated from the convolutional neural network. A plurality of video feature descriptors for the video content can be determined based at least in part on the one or more outputs from the convolutional neural network.
    Type: Grant
    Filed: December 30, 2014
    Date of Patent: January 2, 2018
    Assignee: Facebook, Inc.
    Inventors: Du Le Hong Tran, Balamanohar Paluri, Lubomir Bourdev, Robert D. Fergus, Sumit Chopra
  • Publication number: 20170308747
    Abstract: Systems, methods, and non-transitory computer-readable media can calculate raw scores for a plurality of media items based on a classifier model and a target concept. The plurality of media items are ranked based on the raw scores. A review set of the plurality of media items is determined, the review set comprising a subset of the plurality of media items. Each of the media items of the review set is associated with a content depiction determination. A normalized score formula is calculated based on the raw scores and the content depiction determinations for the media items of the review set.
    Type: Application
    Filed: July 7, 2017
    Publication date: October 26, 2017
    Inventors: Nikhil Johri, Balamanohar Paluri, Lubomir Bourdev
  • Publication number: 20170300784
    Abstract: Systems, methods, and non-transitory computer-readable media can identify a set of regions corresponding to a geographical area. A collection of training images can be acquired. Each training image in the collection can be associated with one or more respective recognized objects and with a respective region in the set of regions. Histogram metrics for a plurality of object categories within each region in the set of regions can be determined based at least in part on the collection of training images. A neural network can be developed based at least in part on the histogram metrics for the plurality of object categories within each region in the set of regions and on the collection of training images.
    Type: Application
    Filed: June 30, 2017
    Publication date: October 19, 2017
    Inventors: Kevin Dechau Tang, Lubomir Bourdev, Balamanohar Paluri, Robert D. Fergus
  • Patent number: 9767357
    Abstract: Systems, methods, and non-transitory computer-readable media can calculate raw scores for a plurality of media items based on a classifier model and a target concept. The plurality of media items are ranked based on the raw scores. A review set of the plurality of media items is determined, the review set comprising a subset of the plurality of media items. Each of the media items of the review set is associated with a content depiction determination. A normalized score formula is calculated based on the raw scores and the content depiction determinations for the media items of the review set.
    Type: Grant
    Filed: December 29, 2015
    Date of Patent: September 19, 2017
    Assignee: Facebook, Inc
    Inventors: Nikhil Johri, Balamanohar Paluri, Lubomir Bourdev
  • Patent number: 9754351
    Abstract: Systems, methods, and non-transitory computer-readable media can obtain a set of video frames at a first resolution. Process the set of video frames using a convolutional neural network to output one or more signals, the convolutional neural network including (i) a set of two-dimensional convolutional layers and (ii) a set of three-dimensional convolutional layers, wherein the processing causes the set of video frames to be reduced to a second resolution. Process the one or more signals using a set of three-dimensional de-convolutional layers of the convolutional neural network. Obtain one or more outputs corresponding to the set of video frames from the convolutional neural network.
    Type: Grant
    Filed: December 29, 2015
    Date of Patent: September 5, 2017
    Assignee: Facebook, Inc.
    Inventors: Balamanohar Paluri, Du Le Hong Tran, Lubomir Bourdev, Robert D. Fergus
  • Publication number: 20170242997
    Abstract: Systems, methods, and non-transitory computer-readable media can detect an operation that causes a challenge response process to be initiated. An image category associated with a recognized category label can be identified. At least one image associated with the image category can be displayed during the challenge response process. The operation can be executed when the challenge response process, based on the at least one image, is successfully completed.
    Type: Application
    Filed: May 9, 2017
    Publication date: August 24, 2017
    Inventors: Nikhil Johri, Trevor M. Pottinger, Balamanohar Paluri
  • Patent number: 9734320
    Abstract: Systems, methods, and non-transitory computer-readable media can detect an operation that causes a challenge response process to be initiated. An image category associated with a recognized category label can be identified. At least one image associated with the image category can be displayed during the challenge response process. The operation can be executed when the challenge response process, based on the at least one image, is successfully completed.
    Type: Grant
    Filed: February 13, 2015
    Date of Patent: August 15, 2017
    Assignee: Facebook, Inc.
    Inventors: Nikhil Johri, Trevor M. Pottinger, Balamanohar Paluri
  • Patent number: 9727803
    Abstract: Systems, methods, and non-transitory computer-readable media can identify a set of regions corresponding to a geographical area. A collection of training images can be acquired. Each training image in the collection can be associated with one or more respective recognized objects and with a respective region in the set of regions. Histogram metrics for a plurality of object categories within each region in the set of regions can be determined based at least in part on the collection of training images. A neural network can be developed based at least in part on the histogram metrics for the plurality of object categories within each region in the set of regions and on the collection of training images.
    Type: Grant
    Filed: August 4, 2016
    Date of Patent: August 8, 2017
    Assignee: Facebook, Inc.
    Inventors: Kevin Dechau Tang, Lubomir Bourdev, Balamanohar Paluri, Robert D. Fergus
  • Patent number: 9704029
    Abstract: Systems, methods, and non-transitory computer-readable media can receive a first image including a representation of a first user. A second image including a representation of a second user can be received. A first set of poselets associated with the first user can be detected in the first image. A second set of poselets associated with the second user can be detected in the second image. The first image including the first set of poselets can be inputted into a first instance of a neural network to generate a first multi-dimensional vector. The second image including the second set of poselets can be inputted into a second instance of the neural network to generate a second multi-dimensional vector. A first distance metric between the first multi-dimensional vector and the second multi-dimensional vector can be determined.
    Type: Grant
    Filed: October 3, 2016
    Date of Patent: July 11, 2017
    Assignee: Facebook, Inc.
    Inventors: Lubomir Bourdev, Ning Zhang, Balamanohar Paluri, Yaniv Taigman, Robert D. Fergus
  • Publication number: 20170186176
    Abstract: Systems, methods, and non-transitory computer-readable media can obtain a first video frame and a second video frame. The first video frame can be processed using a convolutional neural network to output a first set of feature maps. The second video frame can be processed using the convolutional neural network to output a second set of feature maps. The first set of feature maps and the second set of feature maps can be processed using a spatial matching layer of the convolutional neural network to determine an optical flow for at least one pixel.
    Type: Application
    Filed: December 28, 2015
    Publication date: June 29, 2017
    Inventor: Balamanohar Paluri
  • Publication number: 20170185838
    Abstract: Systems, methods, and non-transitory computer-readable media can calculate raw scores for a plurality of media items based on a classifier model and a target concept. The plurality of media items are ranked based on the raw scores. A review set of the plurality of media items is determined, the review set comprising a subset of the plurality of media items. Each of the media items of the review set is associated with a content depiction determination. A normalized score formula is calculated based on the raw scores and the content depiction determinations for the media items of the review set.
    Type: Application
    Filed: December 29, 2015
    Publication date: June 29, 2017
    Inventors: Nikhil Johri, Balamanohar Paluri, Lubomir Bourdev
  • Publication number: 20170132758
    Abstract: Systems, methods, and non-transitory computer-readable media can obtain a set of video frames at a first resolution. Process the set of video frames using a convolutional neural network to output one or more signals, the convolutional neural network including (i) a set of two-dimensional convolutional layers and (ii) a set of three-dimensional convolutional layers, wherein the processing causes the set of video frames to be reduced to a second resolution. Process the one or more signals using a set of three-dimensional de-convolutional layers of the convolutional neural network. Obtain one or more outputs corresponding to the set of video frames from the convolutional neural network.
    Type: Application
    Filed: December 29, 2015
    Publication date: May 11, 2017
    Inventors: Balamanohar Paluri, Du Le Hong Tran, Lubomir Bourdev, Robert D. Fergus
  • Publication number: 20170098067
    Abstract: Systems, methods, and non-transitory computer-readable media can determine at least one operation that causes a challenge-response test to be activated for authenticating a user. A first set of content items that each have a threshold similarity to a query content item can be determined. A second set of content items that each have a threshold dissimilarity to the query content item can be determined. The challenge-response test can be provided for display to the user. The challenge-response test presents a group of content items including the first set of content items and the second set of content items.
    Type: Application
    Filed: October 1, 2015
    Publication date: April 6, 2017
    Inventors: Balamanohar Paluri, Nikhil Johri
  • Publication number: 20170046613
    Abstract: Systems, methods, and non-transitory computer-readable media can obtain a content item to be evaluated by a set of cascaded convolutional neural networks, the set of cascaded convolutional neural networks including at least a first convolutional neural network (CNN) and a second CNN. The content item can be provided to the first CNN as input, wherein an output of the first CNN includes data describing at least one region of interest in the content item and at least one first concept corresponding to the region of interest. The output of the first CNN can be provided to the second CNN as input, wherein an output of the second CNN includes data describing at least one second concept corresponding to the region of interest, the second concept being more accurate than the first concept.
    Type: Application
    Filed: April 5, 2016
    Publication date: February 16, 2017
    Inventors: Balamanohar Paluri, Lubomir Bourdev, Ronan Stéfan Collobert, Chen Sun
  • Publication number: 20170024611
    Abstract: Systems, methods, and non-transitory computer-readable media can receive a first image including a representation of a first user. A second image including a representation of a second user can be received. A first set of poselets associated with the first user can be detected in the first image. A second set of poselets associated with the second user can be detected in the second image. The first image including the first set of poselets can be inputted into a first instance of a neural network to generate a first multi-dimensional vector. The second image including the second set of poselets can be inputted into a second instance of the neural network to generate a second multi-dimensional vector. A first distance metric between the first multi-dimensional vector and the second multi-dimensional vector can be determined.
    Type: Application
    Filed: October 3, 2016
    Publication date: January 26, 2017
    Inventors: Lubomir Bourdev, Ning Zhang, Balamanohar Paluri, Yaniv Taigman, Robert D. Fergus
  • Patent number: 9514390
    Abstract: Systems, methods, and non-transitory computer-readable media can receive a first image including a representation of a first user. A second image including a representation of a second user can be received. A first set of poselets associated with the first user can be detected in the first image. A second set of poselets associated with the second user can be detected in the second image. The first image including the first set of poselets can be inputted into a first instance of a neural network to generate a first multi-dimensional vector. The second image including the second set of poselets can be inputted into a second instance of the neural network to generate a second multi-dimensional vector. A first distance metric between the first multi-dimensional vector and the second multi-dimensional vector can be determined.
    Type: Grant
    Filed: December 17, 2014
    Date of Patent: December 6, 2016
    Assignee: Facebook, Inc.
    Inventors: Lubomir Bourdev, Ning Zhang, Balamanohar Paluri, Yaniv Taigman, Robert D. Fergus
  • Publication number: 20160342865
    Abstract: Systems, methods, and non-transitory computer-readable media can identify a set of regions corresponding to a geographical area. A collection of training images can be acquired. Each training image in the collection can be associated with one or more respective recognized objects and with a respective region in the set of regions. Histogram metrics for a plurality of object categories within each region in the set of regions can be determined based at least in part on the collection of training images. A neural network can be developed based at least in part on the histogram metrics for the plurality of object categories within each region in the set of regions and on the collection of training images.
    Type: Application
    Filed: August 4, 2016
    Publication date: November 24, 2016
    Inventors: Kevin Dechau Tang, Lubomir Bourdev, Balamanohar Paluri, Robert D. Fergus
  • Patent number: 9495619
    Abstract: Systems, methods, and non-transitory computer-readable media can identify a set of regions corresponding to a geographical area. A collection of training images can be acquired. Each training image in the collection can be associated with one or more respective recognized objects and with a respective region in the set of regions. Histogram metrics for a plurality of object categories within each region in the set of regions can be determined based at least in part on the collection of training images. A neural network can be developed based at least in part on the histogram metrics for the plurality of object categories within each region in the set of regions and on the collection of training images.
    Type: Grant
    Filed: December 30, 2014
    Date of Patent: November 15, 2016
    Assignee: Facebook, Inc.
    Inventors: Kevin Dechau Tang, Lubomir Bourdev, Balamanohar Paluri, Robert D. Fergus