Patents by Inventor Sivan Harary

Sivan Harary has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230306721
    Abstract: An example a system includes a processor to receive a model that is a neural network and a number of training images. The processor can train the model using a bridge transform that converts the training images into a set of transformed images within a bridge domain. The model is trained using a contrastive loss to generate representations based on the transformed images.
    Type: Application
    Filed: March 28, 2022
    Publication date: September 28, 2023
    Inventors: Leonid KARLINSKY, Sivan HARARY, Eliyahu SCHWARTZ, Assaf ARBELLE
  • Publication number: 20230298373
    Abstract: An example system includes a processor to receive detected chart regions in a page of a document. The processor is to produce, via a graphical elements detector, predicted heatmaps and bounding boxes for graphical objects in the detected chart regions. The processor is also to apply chart type specific analysis algorithm to the predicted heatmaps and bounding boxes, to extract tabular chart data. The processor can then generate an output data file and a visualization based on the predicted heatmap and the extracted tabular chart data.
    Type: Application
    Filed: March 21, 2022
    Publication date: September 21, 2023
    Inventors: Joseph SHTOK, Leonid KARLINSKY, Sivan HARARY, Ophir AZULAI
  • Publication number: 20220207410
    Abstract: A computing system, computer program product, and computer-implemented method for incremental learning without forgetting for a classification/detection model are provided. The method includes receiving, at a computing system, a classification/detection model including a base embedding space and corresponding base embedding vectors that are based on a base training dataset including base classes. The method also includes expanding the classification/detection model to account for a new training dataset including new classes by lifting the base embedding space to add an orthogonal subspace for the new classes, producing an expanded embedding space and corresponding expanded embedding vectors that are of a higher dimension than the base embedding vectors.
    Type: Application
    Filed: December 28, 2020
    Publication date: June 30, 2022
    Inventors: Sivan HARARY, Leonid KARLINSKY, Joseph SHTOK
  • Patent number: 10832096
    Abstract: A method can include learning a common embedding space and a set of parameters for each one of a plurality of sets of mixture models, wherein one mixture model is associated with one class of objects within a set of object categories. The method can also include adding new mixture models to the set of mixture models to support novel categories based on a set of example embedding vectors computed for each one of the novel categories. Additionally, the method includes detecting in images a plurality of boxes with associated labels and corresponding confidence scores, wherein the boxes correspond to image regions comprising objects of both known categories and the novel categories. Furthermore, the method includes, given a query image, executing an instruction based on the common embedding space and the set of mixture models, the instruction comprising identifying objects from both categories in the query image.
    Type: Grant
    Filed: January 7, 2019
    Date of Patent: November 10, 2020
    Assignee: International Business Machines Corporation
    Inventors: Leonid Karlinsky, Eliyahu Schwartz, Joseph Shtok, Mattias Marder, Sivan Harary
  • Patent number: 10796203
    Abstract: Embodiments of the present disclosure include training a model using a plurality of pairs of feature vectors related to a first class. Embodiments include providing a sample feature vector related to a second class as an input to the model. Embodiments include receiving at least one synthesized feature vector as an output from the model. Embodiments include training a classifier to recognize the second class using a training data set comprising the sample feature vector related to the second class and the at least one synthesized feature vector. Embodiments include providing a query feature vector as an input to the classifier. Embodiments include receiving output from the classifier that identifies the query feature vector as being related to the second class, wherein the output is used to perform an action.
    Type: Grant
    Filed: November 30, 2018
    Date of Patent: October 6, 2020
    Assignee: International Business Machines Corporation
    Inventors: Leonid Karlinsky, Mattias Marder, Eliyahu Schwartz, Joseph Shtok, Sivan Harary
  • Publication number: 20200218931
    Abstract: A method can include learning a common embedding space and a set of parameters for each one of a plurality of sets of mixture models, wherein one mixture model is associated with one class of objects within a set of object categories. The method can also include adding new mixture models to the set of mixture models to support novel categories based on a set of example embedding vectors computed for each one of the novel categories. Additionally, the method includes detecting in images a plurality of boxes with associated labels and corresponding confidence scores, wherein the boxes correspond to image regions comprising objects of both known categories and the novel categories. Furthermore, the method includes, given a query image, executing an instruction based on the common embedding space and the set of mixture models, the instruction comprising identifying objects from both categories in the query image.
    Type: Application
    Filed: January 7, 2019
    Publication date: July 9, 2020
    Inventors: Leonid Karlinsky, Eliyahu Schwartz, Joseph Shtok, Mattias Marder, Sivan Harary
  • Publication number: 20200175332
    Abstract: Embodiments of the present disclosure include training a model using a plurality of pairs of feature vectors related to a first class. Embodiments include providing a sample feature vector related to a second class as an input to the model. Embodiments include receiving at least one synthesized feature vector as an output from the model. Embodiments include training a classifier to recognize the second class using a training data set comprising the sample feature vector related to the second class and the at least one synthesized feature vector. Embodiments include providing a query feature vector as an input to the classifier. Embodiments include receiving output from the classifier that identifies the query feature vector as being related to the second class, wherein the output is used to perform an action.
    Type: Application
    Filed: November 30, 2018
    Publication date: June 4, 2020
    Inventors: Leonid Karlinsky, Mattias Marder, Eliyahu Schwartz, Joseph Shtok, Sivan Harary
  • Patent number: 10395143
    Abstract: There is provided a method of identifying objects in an image, comprising: extracting query descriptors from the image, comparing each query descriptor with training descriptors for identifying matching training descriptors, each training descriptor is associated with a reference object identifier and with relative location data (distance and direction from a center point of a reference object indicated by the reference object identifier), computing object-regions of the digital image by clustering the query descriptors having common center points defined by the matching training descriptors, each object-region approximately bounding one target object and associated with a center point and a scale relative to a reference object size, wherein the object-regions are computed independently of the identifier of the reference object associated with the object-regions, wherein members of each cluster point toward a common center point, and classifying the target object of each object-region according to the referen
    Type: Grant
    Filed: November 26, 2018
    Date of Patent: August 27, 2019
    Assignee: International Business Machines Corporation
    Inventors: Sivan Harary, Leonid Karlinsky, Mattias Marder, Joseph Shtok, Asaf Tzadok
  • Publication number: 20190108420
    Abstract: There is provided a method of identifying objects in an image, comprising: extracting query descriptors from the image, comparing each query descriptor with training descriptors for identifying matching training descriptors, each training descriptor is associated with a reference object identifier and with relative location data (distance and direction from a center point of a reference object indicated by the reference object identifier), computing object-regions of the digital image by clustering the query descriptors having common center points defined by the matching training descriptors, each object-region approximately bounding one target object and associated with a center point and a scale relative to a reference object size, wherein the object-regions are computed independently of the identifier of the reference object associated with the object-regions, wherein members of each cluster point toward a common center point, and classifying the target object of each object-region according to the referen
    Type: Application
    Filed: November 26, 2018
    Publication date: April 11, 2019
    Inventors: Sivan Harary, Leonid Karlinsky, Mattias Marder, Joseph Shtok, Asaf Tzadok
  • Patent number: 10229347
    Abstract: There is provided a method of identifying objects in an image, comprising: extracting query descriptors from the image, comparing each query descriptor with training descriptors for identifying matching training descriptors, each training descriptor is associated with a reference object identifier and with relative location data (distance and direction from a center point of a reference object indicated by the reference object identifier), computing object-regions of the digital image by clustering the query descriptors having common center points defined by the matching training descriptors, each object-region approximately bounding one target object and associated with a center point and a scale relative to a reference object size, wherein the object-regions are computed independently of the identifier of the reference object associated with the object-regions, wherein members of each cluster point toward a common center point, and classifying the target object of each object-region according to the referen
    Type: Grant
    Filed: May 14, 2017
    Date of Patent: March 12, 2019
    Assignee: International Business Machines Corporation
    Inventors: Sivan Harary, Leonid Karlinsky, Mattias Marder, Joseph Shtok, Asaf Tzadok
  • Publication number: 20180330198
    Abstract: There is provided a method of identifying objects in an image, comprising: extracting query descriptors from the image, comparing each query descriptor with training descriptors for identifying matching training descriptors, each training descriptor is associated with a reference object identifier and with relative location data (distance and direction from a center point of a reference object indicated by the reference object identifier), computing object-regions of the digital image by clustering the query descriptors having common center points defined by the matching training descriptors, each object-region approximately bounding one target object and associated with a center point and a scale relative to a reference object size, wherein the object-regions are computed independently of the identifier of the reference object associated with the object-regions, wherein members of each cluster point toward a common center point, and classifying the target object of each object-region according to the referen
    Type: Application
    Filed: May 14, 2017
    Publication date: November 15, 2018
    Inventors: SIVAN HARARY, LEONID KARLINSKY, MATTIAS MARDER, JOSEPH SHTOK, ASAF TZADOK
  • Publication number: 20180068180
    Abstract: A method comprising: training a price tag detector, comprising a gross feature detector and a classifier, to automatically detect a price tag in an image, by: a) training the gross feature detector using supervised learning with labeled images, and b) training the classifier using a two-phase hybrid learning process comprising: c) applying an initial supervised learning using the labeled images, yielding a semi-trained version of the classifier, and d) applying a subsequent unsupervised learning using unlabeled images, yielding a fully trained version of the classifier, wherein applying the unsupervised learning comprises: for each unlabeled image: i) detecting multiple price tag hypotheses using the gross feature detector, ii) classifying each price tag hypothesis using the semi-trained classifier, ii) rating each classification based contextual data extracted from the unlabeled image, iv) retraining the semi-trained classifier with the rated classifications, and repeating steps ii) through iv) until the rec
    Type: Application
    Filed: September 5, 2016
    Publication date: March 8, 2018
    Inventors: SIVAN HARARY, MATTIAS MARDER
  • Patent number: 9911033
    Abstract: A method comprising: training a price tag detector, comprising a gross feature detector and a classifier, to automatically detect a price tag in an image, by: a) training the gross feature detector using supervised learning with labeled images, and b) training the classifier using a two-phase hybrid learning process comprising: c) applying an initial supervised learning using the labeled images, yielding a semi-trained version of the classifier, and d) applying a subsequent unsupervised learning using unlabeled images, yielding a fully trained version of the classifier, wherein applying the unsupervised learning comprises: for each unlabeled image: i) detecting multiple price tag hypotheses using the gross feature detector, ii) classifying each price tag hypothesis using the semi-trained classifier, ii) rating each classification based contextual data extracted from the unlabeled image, iv) retraining the semi-trained classifier with the rated classifications, and repeating steps ii) through iv) until the rec
    Type: Grant
    Filed: September 5, 2016
    Date of Patent: March 6, 2018
    Assignee: International Business Machines Corporation
    Inventors: Sivan Harary, Mattias Marder
  • Publication number: 20170323149
    Abstract: A method, including receiving a two-dimensional (2D) image of a three-dimensional (3D) object recorded at a first angle of rotation of the object, and identifying, in the 2D image, a set of image descriptors, each of the image descriptors including an image keypoint and one or more image features. The set of image descriptors are compared against sets of template descriptors for respective previously captured 2D images, each of the template descriptors comprising a template keypoint and one or more template features. Using a threshold, a given set of template descriptors matching the set of image descriptors are identified, the given set of template descriptors corresponding to a given previously captured 2D image of the 3D object recorded at a second angle of rotation of the object. Any of the image descriptors not in the given set of the template descriptors are added to the given set of template descriptors.
    Type: Application
    Filed: May 5, 2016
    Publication date: November 9, 2017
    Inventors: Sivan Harary, Mattias Marder
  • Patent number: 9600298
    Abstract: Machines, systems and methods for recognizing visual change in a graphical user interface (GUI) environment, the method comprising determining position of an active GUI object in the GUI environment based on known attributes of the active GUI object; monitoring a focus area in the active GUI object to detect visual changes in attributes of the focus area, without regard to any visual changes outside the focus area; determining whether the active GUI object has moved or has been resized, in response to determining a visual change in the attributes of the focus area; and determining position of a new active GUI object in the GUI environment, in response to determining that the active GUI object has not been moved or has not been resized.
    Type: Grant
    Filed: April 29, 2013
    Date of Patent: March 21, 2017
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Amir Geva, Sivan Harary, Mattias Marder
  • Patent number: 9300828
    Abstract: A method comprising using at least one hardware processor for: applying an edge detection algorithm to an image of a document to receive a map of edges from which multiple optional contours of the document in the image are identified; splitting the multiple optional contours into line segments; sorting the line segments into equivalence classes of collinearity representing distinct line segments of the line segments, wherein each one of the classes of collinearity represents a distinct line segment of the distinct line segments; deriving a connectivity graph based on the equivalence classes of collinearity; identifying four vertex polygons in said connectivity graph; evaluating each one of the identified four vertex polygons according to one or more segmentation criterions; and segmenting the document in the image according to the most highly evaluated four vertex polygon of the four vertex polygons.
    Type: Grant
    Filed: November 2, 2015
    Date of Patent: March 29, 2016
    Assignee: International Business Machines Corporation
    Inventors: Sivan Harary, Noel S. Kropf, Mattias Marder, Charles F. Wiecha
  • Patent number: 9280831
    Abstract: A method comprising using at least one hardware processor for: applying an edge detection algorithm to an image of a document to receive a map of edges from which multiple optional contours of the document in the image are identified; splitting the multiple optional contours into line segments; sorting the line segments into equivalence classes of collinearity representing distinct line segments of the line segments, wherein each one of the classes of collinearity represents a distinct line segment of the distinct line segments; deriving a connectivity graph based on the equivalence classes of collinearity; identifying four vertex polygons in said connectivity graph; evaluating each one of the identified four vertex polygons according to one or more segmentation criterions; and segmenting the document in the image according to the most highly evaluated four vertex polygon of the four vertex polygons.
    Type: Grant
    Filed: October 23, 2014
    Date of Patent: March 8, 2016
    Assignee: International Business Machines Corporation
    Inventors: Sivan Harary, Noel S. Kropf, Mattias Marder, Charles F. Wiecha
  • Patent number: 9230005
    Abstract: Methods, system and computer program products for spatiotemporal encounters detection of a plurality of moving objects are disclosed. The method includes receiving a dataset of a plurality of objects moving in a domain, structuring the dataset in a data structure to detect a plurality of spatiotemporal encounters among the plurality of objects, outputting a list of the detected spatiotemporal encounters. The plurality of spatiotemporal encounters may be detected in a single sweep over the received dataset.
    Type: Grant
    Filed: December 30, 2012
    Date of Patent: January 5, 2016
    Assignee: International Business Machines Corporation
    Inventors: Peter Bak, Sivan Harary, Mattias Marder, Harold Jeffrey Ship, Avi Yaeli
  • Publication number: 20140325409
    Abstract: Machines, systems and methods for recognizing visual change in a graphical user interface (GUI) environment, the method comprising determining position of an active GUI object in the GUI environment based on known attributes of the active GUI object; monitoring a focus area in the active GUI object to detect visual changes in attributes of the focus area, without regard to any visual changes outside the focus area; determining whether the active GUI object has moved or has been resized, in response to determining a visual change in the attributes of the focus area; and determining position of a new active GUI object in the GUI environment, in response to determining that the active GUI object has not been moved or has not been resized.
    Type: Application
    Filed: April 29, 2013
    Publication date: October 30, 2014
    Applicant: International Business Machines Corporation
    Inventors: Amir Geva, Sivan Harary, Mattias Marder
  • Publication number: 20140188940
    Abstract: Methods, system and computer program products for spatiotemporal encounters detection of a plurality of moving objects are disclosed. The method includes receiving a dataset of a plurality of objects moving in a domain, structuring the dataset in a data structure to detect a plurality of spatiotemporal encounters among the plurality of objects, outputting a list of the detected spatiotemporal encounters. The plurality of spatiotemporal encounters may be detected in a single sweep over the received dataset.
    Type: Application
    Filed: December 30, 2012
    Publication date: July 3, 2014
    Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Peter Bak, Sivan Harary, Mattias Marder, Harold Jeffrey Ship, Avi Yaeli