Patents by Inventor Sharathchandra U. Pankanti

Sharathchandra U. Pankanti has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11301944
    Abstract: A computer-implemented method modifies physical classroom resources in a classroom. One or more processors identify and quantify physical classroom resources in the classroom based on sensor readings received from sensors in a classroom. The processor(s) determine physical classroom resource constraints that impede learning by students in the classroom based on the sensor readings from the sensors in the classroom. The processor(s) detect one or more of the physical classroom resource constraints in the physical classroom resources identified by the sensor readings, and then adjust the one or more physical classroom resources based on the one or more detected physical classroom resource constraints.
    Type: Grant
    Filed: April 13, 2017
    Date of Patent: April 12, 2022
    Assignee: International Business Machines Corporation
    Inventors: Shelby S. Darnell, Sharathchandra U. Pankanti, Nalini K. Ratha, Komminist Weldemariam
  • Patent number: 11282249
    Abstract: A method and system of stitching a plurality of image views of a scene, including grouping matched points of interest in a plurality of groups, and determining a similarity transformation with smallest rotation angle for each grouping of the matched points. The method further includes generating virtual matching points on non-overlapping area of the plurality of image views and generating virtual matching points on overlapping area for each of the plurality of image views.
    Type: Grant
    Filed: January 20, 2020
    Date of Patent: March 22, 2022
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Chung-Ching Lin, Sharathchandra U. Pankanti, Karthikeyan Natesan Ramamurthy, Aleksandr Y. Aravkin, John R. Smith
  • Patent number: 11172225
    Abstract: A computer-implemented method for finding objects in a collection of images or video, the method comprising: assessing a similarity between two subgraphs; detecting the objects in the collection; assessing a relationship between the objects; finding attributes of the objects; constructing a collection graph for the collection where each of the objects is the vertices and nodes of the collection graph and their relationships with other objects and attributes are edges of the collection graphs; recursively identifying coherent subgraphs and turning the coherent subgraphs into new meta-nodes of the collection graph; identification of the stable graph reducing the collection graph into zero or more distinct stories; assigning a similarity score for each pair of the stories based on a similarity between the corresponding stories; linking the stories into inlier stories based on the similarity score being greater than a first pre-determined threshold level.
    Type: Grant
    Filed: February 26, 2019
    Date of Patent: November 9, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Chung-Ching Lin, Sharathchandra U. Pankanti, John R. Smith
  • Patent number: 10956778
    Abstract: A system, method and program product for implementing image recognition. A system is disclosed that includes a training system for generating a multi-feature multi-matcher fusion (MMF) predictor for scoring pairs of images, the training system having: a neural network configurable to extract a set of feature spaces at different resolutions based on a training dataset; and an optimizer that processes the training dataset, extracted feature spaces and a set of matcher functions to generate the MMF predictor having a series of weighted feature/matcher components; and a prediction system that utilizes the MMF predictor to generate a prediction score indicative of a match for a pair of images.
    Type: Grant
    Filed: March 5, 2019
    Date of Patent: March 23, 2021
    Assignee: International Business Machines Corporation
    Inventors: Nalini K. Ratha, Gaurav Goswami, Sharathchandra U. Pankanti
  • Patent number: 10878281
    Abstract: A face clustering system for video face clustering in a video sequence, the system including an inherent supervision summarization device configured to collect group-level supervision and instance level supervision within a same chunklet based on a user input of face images for a person, a discriminative projection learning device configured to embed group constraints of the group-level supervision into a transformed space, and configured to generate an embedding space from the original image feature space, and a clustering device, in the embedding space, configured to execute pair-wise based clustering to cluster the video images into different clusters with the instance level supervision collected by the inherent supervision summarization device.
    Type: Grant
    Filed: September 30, 2019
    Date of Patent: December 29, 2020
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Yu Cheng, Sharathchandra U. Pankanti, Nalini K. Ratha
  • Publication number: 20200285914
    Abstract: A system, method and program product for implementing image recognition. A system is disclosed that includes a training system for generating a multi-feature multi-matcher fusion (MMF) predictor for scoring pairs of images, the training system having: a neural network configurable to extract a set of feature spaces at different resolutions based on a training dataset; and an optimizer that processes the training dataset, extracted feature spaces and a set of matcher functions to generate the MMF predictor having a series of weighted feature/matcher components; and a prediction system that utilizes the MMF predictor to generate a prediction score indicative of a match for a pair of images.
    Type: Application
    Filed: March 5, 2019
    Publication date: September 10, 2020
    Inventors: Nalini K. Ratha, Gaurav Goswami, Sharathchandra U. Pankanti
  • Publication number: 20200202599
    Abstract: A method and system of stitching a plurality of image views of a scene, including grouping matched points of interest in a plurality of groups, and determining a similarity transformation with smallest rotation angle for each grouping of the matched points. The method further includes generating virtual matching points on non-overlapping area of the plurality of image views and generating virtual matching points on overlapping area for each of the plurality of image views.
    Type: Application
    Filed: January 20, 2020
    Publication date: June 25, 2020
    Inventors: Chung-Ching LIN, Sharathchandra U. Pankanti, Karthikeyan Natesan Ramamurthy, Aleksandr Y. Aravkin, John R. Smith
  • Patent number: 10614316
    Abstract: Aspects determining anomalous events, wherein processors determine a trajectory of tracked movement of an object through an image field of a camera partitioned into a matrix grid of different local units. The aspects generate anomaly confidence decision values for image features extracted from video data of the tracked movement of the object as a function of fitting extracted image features to normal patterns of local motion pattern models defined by dominant distributions of extracted image features. The aspects further extract trajectory features from the video data relative to the trajectory of the tracked movement of the object, and generate global anomaly confidence decision values for the object trajectory as a function of fitting the extracted trajectory features to a normal learned motion trajectory model. The aspects determine anomalous events as a function of the generated global anomaly confidence decision value and the anomaly confidence decision values.
    Type: Grant
    Filed: December 7, 2017
    Date of Patent: April 7, 2020
    Assignee: International Business Machines Corporation
    Inventors: Ankur Datta, Balamanohar Paluri, Sharathchandra U. Pankanti, Yun Zhai
  • Patent number: 10607089
    Abstract: An approach for re-identifying an object in a test image is presented. Similarity measures between the test image and training images captured by a first camera are determined. The similarity measures are based on Bhattacharyya distances between feature representations of an estimated background region of the test image and feature representations of background regions of the training images. A transformed test image based on the Bhattacharyya distances has a brightness that is different from the test image's brightness and matches a brightness of training images captured by a second camera. An appearance of the transformed test image resembles an appearance of a capture of the test image by the second camera. Another image included in test images captured by the second camera is identified as being closest in appearance to the transformed test image and another object in the identified other image is a re-identification of the object.
    Type: Grant
    Filed: November 26, 2018
    Date of Patent: March 31, 2020
    Assignee: International Business Machines Corporation
    Inventors: Lisa M. Brown, Ankur Datta, Rogerio S. Feris, Sharathchandra U. Pankanti
  • Patent number: 10572976
    Abstract: A system and method to enhance observation resolution using continuous learning include obtaining a first image of a surface area from a first satellite, and obtaining a second image of the surface area from a second satellite. The first image has a lower spatial resolution than the second image, and temporal resolution of the first images obtained by the first satellite is higher than temporal resolution of the second images obtained by the second satellite. The method also includes determining a convolution matrix A or training a neural network, obtaining additional one or more of the first images prior to obtaining an additional one of the second images, and generating a new image from each of the one or more of the first images using the convolution matrix A or the neural network. The new image has a higher spatial resolution than the one or more of the first images.
    Type: Grant
    Filed: October 18, 2017
    Date of Patent: February 25, 2020
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Conrad M. Albrecht, Hendrik F. Hamann, Siyuan Lu, Sharathchandra U. Pankanti
  • Publication number: 20200057915
    Abstract: A face clustering system for video face clustering in a video sequence, the system including an inherent supervision summarization device configured to collect group-level supervision and instance level supervision within a same chunklet based on a user input of face images for a person, a discriminative projection learning device configured to embed group constraints of the group-level supervision into a transformed space, and configured to generate an embedding space from the original image feature space, and a clustering device, in the embedding space, configured to execute pair-wise based clustering to cluster the video images into different clusters with the instance level supervision collected by the inherent supervision summarization device.
    Type: Application
    Filed: September 30, 2019
    Publication date: February 20, 2020
    Inventors: Yu Cheng, Sharathchandra U. Pankanti, Nalini K. Ratha
  • Patent number: 10553005
    Abstract: A method and system of stitching a plurality of image views of a scene, including grouping matched points of interest in a plurality of groups, and determining a similarity transformation with smallest rotation angle for each grouping of the matched points. The method further includes generating virtual matching points on non-overlapping area of the plurality of image views and generating virtual matching points on overlapping area for each of the plurality of image views.
    Type: Grant
    Filed: February 10, 2017
    Date of Patent: February 4, 2020
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Chung-Ching Lin, Sharathchandra U. Pankanti, Karthikeyan Natesan Ramamurthy, Aleksandr Y. Aravkin, John R. Smith
  • Patent number: 10540569
    Abstract: A face clustering system for video face clustering in a video sequence, the system including an inherent supervision summarization device configured to collect group-level supervision and instance level supervision within a same chunklet based on a user input of face images for a person, a discriminative projection learning device configured to embed group constraints of the group-level supervision into a transformed space, and configured to generate an embedding space from the original image feature space, and a clustering device, in the embedding space, configured to execute pair-wise based clustering to cluster the video images into different clusters with the instance level supervision collected by the inherent supervision summarization device.
    Type: Grant
    Filed: October 24, 2017
    Date of Patent: January 21, 2020
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Yu Cheng, Sharathchandra U. Pankanti, Nalini K. Ratha
  • Patent number: 10410091
    Abstract: A computer-implemented method includes receiving one or more training images depicting one or more training geographical regions. One or more environmental characteristic (EC) values are determined for the training images. The EC values include at least one EC value for each of the training images. One or more models are generated for mapping an EC value of an image to a determination of whether an artifact is present in a geographical region depicted by the image, based on the EC values and based on knowledge of which of the training images depict training geographical regions having artifacts present. A new image is received depicting a new geographical region. The models are applied to the new image. A probability that a new artifact is present in the new geographical region depicted in the new image is determined, based on the applying the models to the new image.
    Type: Grant
    Filed: August 10, 2017
    Date of Patent: September 10, 2019
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Conrad M. Albrecht, Marcus O. Freitag, Hendrik F. Hamann, Sharathchandra U. Pankanti
  • Publication number: 20190191182
    Abstract: A computer-implemented method for finding objects in a collection of images or video, the method comprising: assessing a similarity between two subgraphs; detecting the objects in the collection; assessing a relationship between the objects; finding attributes of the objects; constructing a collection graph for the collection where each of the objects is the vertices and nodes of the collection graph and their relationships with other objects and attributes are edges of the collection graphs; recursively identifying coherent subgraphs and turning the coherent subgraphs into new meta-nodes of the collection graph; identification of the stable graph reducing the collection graph into zero or more distinct stories; assigning a similarity score for each pair of the stories based on a similarity between the corresponding stories; linking the stories into inlier stories based on the similarity score being greater than a first pre-determined threshold level.
    Type: Application
    Filed: February 26, 2019
    Publication date: June 20, 2019
    Inventors: Chung-Ching LIN, Sharathchandra U. PANKANTI, John R. SMITH
  • Patent number: 10306267
    Abstract: A compression system for compressing a video received from an imaging device, the compression system including a transformation estimation device configured to estimate, based on pixel transformations between a first frame and a second frame of the video, a transformation matrix, an encoding device configured to encode the second frame as an increment with the first frame based on the transformation matrix generated by the transformation device, a compression device configured to compress the increments into compressed data, and a reconstruction device configured to reconstruct the first frame and the second frame using the transformation matrix generated by the transformation estimation device.
    Type: Grant
    Filed: August 31, 2015
    Date of Patent: May 28, 2019
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Chung-Ching Lin, Sharathchandra U. Pankanti, John R. Smith
  • Patent number: 10282636
    Abstract: A similarity detection system receiving a plurality of input entities, the system including a cohesive subgraph identification device configured to calculate, based on attributes of the plurality of input entities, a first parameter and a second parameter based on the first parameter, and further configured to identify a plurality of subgraphs from the second parameter and a subgraph correlation tracking and clustering device configured to determine a relationship between different subgraphs based on a similarity factor between the second parameter and the plurality of subgraphs.
    Type: Grant
    Filed: October 24, 2017
    Date of Patent: May 7, 2019
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Yu Cheng, Sharathchandra U. Pankanti, Nalini K. Ratha
  • Publication number: 20190114744
    Abstract: A system and method to enhance observation resolution using continuous learning include obtaining a first image of a surface area from a first satellite, and obtaining a second image of the surface area from a second satellite. The first image has a lower spatial resolution than the second image, and temporal resolution of the first images obtained by the first satellite is higher than temporal resolution of the second images obtained by the second satellite. The method also includes determining a convolution matrix A or training a neural network, obtaining additional one or more of the first images prior to obtaining an additional one of the second images, and generating a new image from each of the one or more of the first images using the convolution matrix A or the neural network. The new image has a higher spatial resolution than the one or more of the first images.
    Type: Application
    Filed: October 18, 2017
    Publication date: April 18, 2019
    Inventors: Conrad M. Albrecht, Hendrik F. Hamann, Siyuan Lu, Sharathchandra U. Pankanti
  • Patent number: 10255674
    Abstract: Embodiments include method, systems and computer program products for reducing surface reflectance, for example in a photograph. Aspects include receiving an image set containing a plurality of images of an object. Aspects also include determining geometric transformations for the images and constructing a panorama of the object from the images using the geometric transformations. Aspects also include replacing a portion in the panorama with a corresponding replacement portion from the image set.
    Type: Grant
    Filed: May 25, 2016
    Date of Patent: April 9, 2019
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Noel C. Codella, Chung-Ching Lin, Sharathchandra U. Pankanti, Nalini K. Ratha
  • Publication number: 20190095719
    Abstract: An approach for re-identifying an object in a test image is presented. Similarity measures between the test image and training images captured by a first camera are determined. The similarity measures are based on Bhattacharyya distances between feature representations of an estimated background region of the test image and feature representations of background regions of the training images. A transformed test image based on the Bhattacharyya distances has a brightness that is different from the test image's brightness and matches a brightness of training images captured by a second camera. An appearance of the transformed test image resembles an appearance of a capture of the test image by the second camera. Another image included in test images captured by the second camera is identified as being closest in appearance to the transformed test image and another object in the identified other image is a re-identification of the object.
    Type: Application
    Filed: November 26, 2018
    Publication date: March 28, 2019
    Inventors: Lisa M. Brown, Ankur Datta, Rogerio S. Feris, Sharathchandra U. Pankanti