Patents by Inventor Sivan Harary

Sivan Harary has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12579626
    Abstract: Method and apparatus for image processing. A plurality of positive text exemplars is processed to generate a set of normal features using a trained model. A plurality of negative text exemplars is processed to generate a set of anomaly features using the trained model. A query image depicting an object is received. A query image feature for the query image is generated using the trained model. An anomaly score for the query image is generated based at least in part on determining one or more distances between the query image feature and one or more normal features of the set of normal features, and determining one or more distances between the query image feature and one or more anomaly features of the set of anomaly features.
    Type: Grant
    Filed: June 27, 2023
    Date of Patent: March 17, 2026
    Assignee: International Business Machines Corporation
    Inventors: Sivan Harary, Assaf Arbelle, Eliyahu Schwartz
  • Patent number: 12561777
    Abstract: Detecting data anomalies by receiving a query image, determining a query image viewpoint according to a trained neural radiance field model, generating a 2D reference image according to the neural radiance field model, determining a difference between the query image and the reference image, and highlighting the difference in a presentation of the query image.
    Type: Grant
    Filed: May 4, 2023
    Date of Patent: February 24, 2026
    Assignee: International Business Machines Corporation
    Inventors: Eliyahu Schwartz, Leonid Karlinsky, Assaf Arbelle, Sivan Harary, Roi Herzig
  • Patent number: 12518197
    Abstract: A computing system, computer program product, and computer-implemented method for incremental learning without forgetting for a classification/detection model are provided. The method includes receiving, at a computing system, a classification/detection model including a base embedding space and corresponding base embedding vectors that are based on a base training dataset including base classes. The method also includes expanding the classification/detection model to account for a new training dataset including new classes by lifting the base embedding space to add an orthogonal subspace for the new classes, producing an expanded embedding space and corresponding expanded embedding vectors that are of a higher dimension than the base embedding vectors.
    Type: Grant
    Filed: December 28, 2020
    Date of Patent: January 6, 2026
    Assignee: International Business Machines Corporation
    Inventors: Sivan Harary, Leonid Karlinsky, Joseph Shtok
  • Patent number: 12456182
    Abstract: An example system includes a processor that can randomly mask tokens using different masks to generate different subsets of masked tokens. The processor can process the different sets of masked tokens via a pretrained masked auto-encoder (MAE) encoder to output intermediate representations. The processor can process the intermediate representations via a pretrained MAE decoder to output reconstructed images. The processor can further compare input image with the output reconstructed images to generate an anomaly score.
    Type: Grant
    Filed: March 16, 2023
    Date of Patent: October 28, 2025
    Assignee: International Business Machines Corporation
    Inventors: Eliyahu Schwartz, Leonid Karlinsky, Sivan Harary, Assaf Arbelle
  • Patent number: 12374146
    Abstract: An example system includes a processor to receive detected chart regions in a page of a document. The processor is to produce, via a graphical elements detector, predicted heatmaps and bounding boxes for graphical objects in the detected chart regions. The processor is also to apply chart type specific analysis algorithm to the predicted heatmaps and bounding boxes, to extract tabular chart data. The processor can then generate an output data file and a visualization based on the predicted heatmap and the extracted tabular chart data.
    Type: Grant
    Filed: March 21, 2022
    Date of Patent: July 29, 2025
    Assignee: International Business Machines Corporation
    Inventors: Joseph Shtok, Leonid Karlinsky, Sivan Harary, Ophir Azulai
  • Publication number: 20250005727
    Abstract: Method and apparatus for image processing. A plurality of positive text exemplars is processed to generate a set of normal features using a trained model. A plurality of negative text exemplars is processed to generate a set of anomaly features using the trained model. A query image depicting an object is received. A query image feature for the query image is generated using the trained model. An anomaly score for the query image is generated based at least in part on determining one or more distances between the query image feature and one or more normal features of the set of normal features, and determining one or more distances between the query image feature and one or more anomaly features of the set of anomaly features.
    Type: Application
    Filed: June 27, 2023
    Publication date: January 2, 2025
    Inventors: Sivan HARARY, Assaf ARBELLE, Eliyahu SCHWARTZ
  • Publication number: 20240370983
    Abstract: Detecting data anomalies by receiving a query image, determining a query image viewpoint according to a trained neural radiance field model, generating a 2D reference image according to the neural radiance field model, determining a difference between the query image and the reference image, and highlighting the difference in a presentation of the query image.
    Type: Application
    Filed: May 4, 2023
    Publication date: November 7, 2024
    Inventors: ELIYAHU SCHWARTZ, LEONID KARLINSKY, Assaf Arbelle, Sivan Harary, ROI HERZIG
  • Publication number: 20240311987
    Abstract: An example system includes a processor that can randomly mask tokens using different masks to generate different subsets of masked tokens. The processor can process the different sets of masked tokens via a pretrained masked auto-encoder (MAE) encoder to output intermediate representations. The processor can process the intermediate representations via a pretrained MAE decoder to output reconstructed images. The processor can further compare input image with the output reconstructed images to generate an anomaly score.
    Type: Application
    Filed: March 16, 2023
    Publication date: September 19, 2024
    Inventors: Eliyahu SCHWARTZ, Leonid KARLINSKY, Sivan HARARY, Assaf ARBELLE
  • Publication number: 20230306721
    Abstract: An example a system includes a processor to receive a model that is a neural network and a number of training images. The processor can train the model using a bridge transform that converts the training images into a set of transformed images within a bridge domain. The model is trained using a contrastive loss to generate representations based on the transformed images.
    Type: Application
    Filed: March 28, 2022
    Publication date: September 28, 2023
    Inventors: Leonid KARLINSKY, Sivan HARARY, Eliyahu SCHWARTZ, Assaf ARBELLE
  • Publication number: 20230298373
    Abstract: An example system includes a processor to receive detected chart regions in a page of a document. The processor is to produce, via a graphical elements detector, predicted heatmaps and bounding boxes for graphical objects in the detected chart regions. The processor is also to apply chart type specific analysis algorithm to the predicted heatmaps and bounding boxes, to extract tabular chart data. The processor can then generate an output data file and a visualization based on the predicted heatmap and the extracted tabular chart data.
    Type: Application
    Filed: March 21, 2022
    Publication date: September 21, 2023
    Inventors: Joseph SHTOK, Leonid KARLINSKY, Sivan HARARY, Ophir AZULAI
  • Publication number: 20220207410
    Abstract: A computing system, computer program product, and computer-implemented method for incremental learning without forgetting for a classification/detection model are provided. The method includes receiving, at a computing system, a classification/detection model including a base embedding space and corresponding base embedding vectors that are based on a base training dataset including base classes. The method also includes expanding the classification/detection model to account for a new training dataset including new classes by lifting the base embedding space to add an orthogonal subspace for the new classes, producing an expanded embedding space and corresponding expanded embedding vectors that are of a higher dimension than the base embedding vectors.
    Type: Application
    Filed: December 28, 2020
    Publication date: June 30, 2022
    Inventors: Sivan HARARY, Leonid KARLINSKY, Joseph SHTOK
  • Patent number: 10832096
    Abstract: A method can include learning a common embedding space and a set of parameters for each one of a plurality of sets of mixture models, wherein one mixture model is associated with one class of objects within a set of object categories. The method can also include adding new mixture models to the set of mixture models to support novel categories based on a set of example embedding vectors computed for each one of the novel categories. Additionally, the method includes detecting in images a plurality of boxes with associated labels and corresponding confidence scores, wherein the boxes correspond to image regions comprising objects of both known categories and the novel categories. Furthermore, the method includes, given a query image, executing an instruction based on the common embedding space and the set of mixture models, the instruction comprising identifying objects from both categories in the query image.
    Type: Grant
    Filed: January 7, 2019
    Date of Patent: November 10, 2020
    Assignee: International Business Machines Corporation
    Inventors: Leonid Karlinsky, Eliyahu Schwartz, Joseph Shtok, Mattias Marder, Sivan Harary
  • Patent number: 10796203
    Abstract: Embodiments of the present disclosure include training a model using a plurality of pairs of feature vectors related to a first class. Embodiments include providing a sample feature vector related to a second class as an input to the model. Embodiments include receiving at least one synthesized feature vector as an output from the model. Embodiments include training a classifier to recognize the second class using a training data set comprising the sample feature vector related to the second class and the at least one synthesized feature vector. Embodiments include providing a query feature vector as an input to the classifier. Embodiments include receiving output from the classifier that identifies the query feature vector as being related to the second class, wherein the output is used to perform an action.
    Type: Grant
    Filed: November 30, 2018
    Date of Patent: October 6, 2020
    Assignee: International Business Machines Corporation
    Inventors: Leonid Karlinsky, Mattias Marder, Eliyahu Schwartz, Joseph Shtok, Sivan Harary
  • Publication number: 20200218931
    Abstract: A method can include learning a common embedding space and a set of parameters for each one of a plurality of sets of mixture models, wherein one mixture model is associated with one class of objects within a set of object categories. The method can also include adding new mixture models to the set of mixture models to support novel categories based on a set of example embedding vectors computed for each one of the novel categories. Additionally, the method includes detecting in images a plurality of boxes with associated labels and corresponding confidence scores, wherein the boxes correspond to image regions comprising objects of both known categories and the novel categories. Furthermore, the method includes, given a query image, executing an instruction based on the common embedding space and the set of mixture models, the instruction comprising identifying objects from both categories in the query image.
    Type: Application
    Filed: January 7, 2019
    Publication date: July 9, 2020
    Inventors: Leonid Karlinsky, Eliyahu Schwartz, Joseph Shtok, Mattias Marder, Sivan Harary
  • Publication number: 20200175332
    Abstract: Embodiments of the present disclosure include training a model using a plurality of pairs of feature vectors related to a first class. Embodiments include providing a sample feature vector related to a second class as an input to the model. Embodiments include receiving at least one synthesized feature vector as an output from the model. Embodiments include training a classifier to recognize the second class using a training data set comprising the sample feature vector related to the second class and the at least one synthesized feature vector. Embodiments include providing a query feature vector as an input to the classifier. Embodiments include receiving output from the classifier that identifies the query feature vector as being related to the second class, wherein the output is used to perform an action.
    Type: Application
    Filed: November 30, 2018
    Publication date: June 4, 2020
    Inventors: Leonid Karlinsky, Mattias Marder, Eliyahu Schwartz, Joseph Shtok, Sivan Harary
  • Patent number: 10395143
    Abstract: There is provided a method of identifying objects in an image, comprising: extracting query descriptors from the image, comparing each query descriptor with training descriptors for identifying matching training descriptors, each training descriptor is associated with a reference object identifier and with relative location data (distance and direction from a center point of a reference object indicated by the reference object identifier), computing object-regions of the digital image by clustering the query descriptors having common center points defined by the matching training descriptors, each object-region approximately bounding one target object and associated with a center point and a scale relative to a reference object size, wherein the object-regions are computed independently of the identifier of the reference object associated with the object-regions, wherein members of each cluster point toward a common center point, and classifying the target object of each object-region according to the referen
    Type: Grant
    Filed: November 26, 2018
    Date of Patent: August 27, 2019
    Assignee: International Business Machines Corporation
    Inventors: Sivan Harary, Leonid Karlinsky, Mattias Marder, Joseph Shtok, Asaf Tzadok
  • Publication number: 20190108420
    Abstract: There is provided a method of identifying objects in an image, comprising: extracting query descriptors from the image, comparing each query descriptor with training descriptors for identifying matching training descriptors, each training descriptor is associated with a reference object identifier and with relative location data (distance and direction from a center point of a reference object indicated by the reference object identifier), computing object-regions of the digital image by clustering the query descriptors having common center points defined by the matching training descriptors, each object-region approximately bounding one target object and associated with a center point and a scale relative to a reference object size, wherein the object-regions are computed independently of the identifier of the reference object associated with the object-regions, wherein members of each cluster point toward a common center point, and classifying the target object of each object-region according to the referen
    Type: Application
    Filed: November 26, 2018
    Publication date: April 11, 2019
    Inventors: Sivan Harary, Leonid Karlinsky, Mattias Marder, Joseph Shtok, Asaf Tzadok
  • Patent number: 10229347
    Abstract: There is provided a method of identifying objects in an image, comprising: extracting query descriptors from the image, comparing each query descriptor with training descriptors for identifying matching training descriptors, each training descriptor is associated with a reference object identifier and with relative location data (distance and direction from a center point of a reference object indicated by the reference object identifier), computing object-regions of the digital image by clustering the query descriptors having common center points defined by the matching training descriptors, each object-region approximately bounding one target object and associated with a center point and a scale relative to a reference object size, wherein the object-regions are computed independently of the identifier of the reference object associated with the object-regions, wherein members of each cluster point toward a common center point, and classifying the target object of each object-region according to the referen
    Type: Grant
    Filed: May 14, 2017
    Date of Patent: March 12, 2019
    Assignee: International Business Machines Corporation
    Inventors: Sivan Harary, Leonid Karlinsky, Mattias Marder, Joseph Shtok, Asaf Tzadok
  • Publication number: 20180330198
    Abstract: There is provided a method of identifying objects in an image, comprising: extracting query descriptors from the image, comparing each query descriptor with training descriptors for identifying matching training descriptors, each training descriptor is associated with a reference object identifier and with relative location data (distance and direction from a center point of a reference object indicated by the reference object identifier), computing object-regions of the digital image by clustering the query descriptors having common center points defined by the matching training descriptors, each object-region approximately bounding one target object and associated with a center point and a scale relative to a reference object size, wherein the object-regions are computed independently of the identifier of the reference object associated with the object-regions, wherein members of each cluster point toward a common center point, and classifying the target object of each object-region according to the referen
    Type: Application
    Filed: May 14, 2017
    Publication date: November 15, 2018
    Inventors: SIVAN HARARY, LEONID KARLINSKY, MATTIAS MARDER, JOSEPH SHTOK, ASAF TZADOK
  • Publication number: 20180068180
    Abstract: A method comprising: training a price tag detector, comprising a gross feature detector and a classifier, to automatically detect a price tag in an image, by: a) training the gross feature detector using supervised learning with labeled images, and b) training the classifier using a two-phase hybrid learning process comprising: c) applying an initial supervised learning using the labeled images, yielding a semi-trained version of the classifier, and d) applying a subsequent unsupervised learning using unlabeled images, yielding a fully trained version of the classifier, wherein applying the unsupervised learning comprises: for each unlabeled image: i) detecting multiple price tag hypotheses using the gross feature detector, ii) classifying each price tag hypothesis using the semi-trained classifier, ii) rating each classification based contextual data extracted from the unlabeled image, iv) retraining the semi-trained classifier with the rated classifications, and repeating steps ii) through iv) until the rec
    Type: Application
    Filed: September 5, 2016
    Publication date: March 8, 2018
    Inventors: SIVAN HARARY, MATTIAS MARDER