Patents by Inventor Itzik Malkiel
Itzik Malkiel has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11875590Abstract: Examples provide a self-supervised language model for document-to-document similarity scoring and ranking long documents of arbitrary length in an absence of similarity labels. In a first stage of a two-staged hierarchical scoring, a sentence similarity matrix is created for each paragraph in the candidate document. A sentence similarity score is calculated based on the sentence similarity matrix. In the second stage, a paragraph similarity matrix is constructed based on aggregated sentence similarity scores associated with the first candidate document. A total similarity score for the document is calculated based on the normalize the paragraph similarity matrix for each candidate document in a collection of documents. The model is trained using a masked language model and intra-and-inter document sampling. The documents are ranked based on the similarity scores for the documents.Type: GrantFiled: December 19, 2022Date of Patent: January 16, 2024Assignee: Microsoft Technology Licensing, LLCInventors: Itzik Malkiel, Dvir Ginzburg, Noam Koenigstein, Oren Barkan, Nir Nice
-
Patent number: 11868723Abstract: The disclosure herein describes a system for interpreting text-based similarity between a seed item and a recommended item selected by a pre-trained language model from a plurality of candidate items based on semantic similarities between the seed item and the recommended item. The system analyzes similarity scores and contextual paragraph representations representing text-based descriptions of the seed item and recommended item to generate gradient maps and word scores representing the text-based descriptions. A model for interpreting text-based similarity utilizes the calculated gradients and word scores to match words from the seed item description with words in the recommended item description having similar semantic meaning. The word-pairs having the highest weight are identified by the system as the word-pairs having the greatest influence over the selection of the recommended item from the candidate items by the original pre-trained language model.Type: GrantFiled: March 30, 2021Date of Patent: January 9, 2024Assignee: Microsoft Technology Licensing, LLC.Inventors: Itzik Malkiel, Noam Koenigstein, Oren Barkan, Dvir Ginzburg, Nir Nice
-
Patent number: 11836175Abstract: Semantic search techniques via focused summarizations are described. For example, a search query is received for a text-based content item in a data set comprising a plurality of text-based content items. A first feature vector representative of the search query is obtained. A respective semantic similarity score is determined between the first feature vector and each of a plurality of second feature vectors. Each of the second feature vectors is representative of a machine-generated summarization of a respective text-based content item. The machine-generated summarization comprises a plurality of multi-word fragments that are selected from the respective text-based content item via a transformer-based machine learning model. A search result is provided responsive to the search query.Type: GrantFiled: June 29, 2022Date of Patent: December 5, 2023Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Itzik Malkiel, Noam Koenigstein, Oren Barkan, Jonathan Ephrath, Yonathan Weill, Nir Nice
-
Publication number: 20230376835Abstract: A comparison engine performs item similarity comparisons. A source item and one or more candidate items are input into a triplet-trained machine learning model trained using training data including triplets of anchor elements, positive elements, and negative elements. Each triplet corresponds to an item included in the training data. The anchor elements and the positive elements are included in the corresponding item. The negative element is included in a different item in the training data. A similarity score between the source item and each of the one or more candidate items is generated from the triplet-trained machine learning model.Type: ApplicationFiled: May 20, 2022Publication date: November 23, 2023Inventors: Itzik MALKIEL, Noam KOENIGSTEIN, Yonathan WEILL, Oren BARKAN, Jonathan EPHRATH, Nir NICE
-
Patent number: 11696700Abstract: K-space data obtained from a magnetic resonance imaging scan where motion was detected is split into two parts in accordance with the timing of the motion to produce first and second sets of k-space data corresponding to different poses. Sub-images are reconstructed from the k first and second sets of k-space data, which are used as inputs to a deep neural network which transforms them into a motion-corrected image.Type: GrantFiled: April 25, 2019Date of Patent: July 11, 2023Assignee: General Electric CompanyInventors: Michael Rotman, Rafael Shmuel Brada, Sangtae Ahn, Christopher Judson Hardy, Itzik Malkiel, Ron Wein
-
Publication number: 20230137692Abstract: A computing system scores importance of a number of tokens in an input token sequence to one or more prediction scores computed by a neural network model on the input token sequence. The neural network model includes multiple encoding layers. Self-attention matrices of the neural network model are received into an importance evaluator. The self-attention matrices are generated by the neural network model while computing the one or more prediction scores based on the input token sequence. Each self-attention matrix corresponds to one of the multiple encoding layers. The importance evaluator generates an importance score for one or more of the tokens in the input token sequence. Each importance score is based on a summation as a function of the self-attention matrices, the summation being computed across the tokens in the input token sequence, across the self-attention matrices, and across the multiple encoding layers in the neural network model.Type: ApplicationFiled: October 29, 2021Publication date: May 4, 2023Inventors: Oren BARKAN, Edan HAUON, Ori KATZ, Avi CACIULARU, Itzik MALKIEL, Omri ARMSTRONG, Amir HERTZ, Noam KOENIGSTEIN, Nir NICE
-
Publication number: 20230137718Abstract: A relational similarity determination engine receives as input a dataset including a set of entities and co-occurrence data that defines co-occurrence relations for pairs of the entities. The relational similarity determination engine also receives as input side information defining explicit relations between the entities. The relational similarity determination engine jointly models the co-occurrence relations and the explicit relations for the entities to compute a similarity metric for each different pair of entities within the dataset. Based on the computed similarity metrics, the relational similarity determination engine identifies a most similar replacement entity from the dataset for each of the entities within the dataset. For a select entity received as an input, the relational similarity determination engine outputs the identified most similar replacement entity.Type: ApplicationFiled: October 29, 2021Publication date: May 4, 2023Inventors: Oren BARKAN, Avi CACIULARU, Idan REJWAN, Yonathan WEILL, Noam KOENIGSTEIN, Ori KATZ, Itzik MALKIEL, Nir NICE
-
Publication number: 20230137744Abstract: A method of generating an aggregate saliency map using a convolutional neural network. Convolutional activation maps of the convolutional neural network model are received into a saliency map generator, the convolutional activation maps being generated by the neural network model while computing the one or more prediction scores based on unlabeled input data. Each convolutional activation map corresponds to one of the multiple encoding layers. The saliency map generator generates a layer-dependent saliency map for each encoding layer of the unlabeled input data, each layer-dependent saliency map being based on a summation of element-wise products of the convolutional activation maps and their corresponding gradients. The layer-dependent saliency maps are combined into the aggregate saliency map indicating the relative contributions of individual components of the unlabeled input data to the one or more prediction scores computed by the convolutional neural network model on the unlabeled input data.Type: ApplicationFiled: October 29, 2021Publication date: May 4, 2023Inventors: Oren BARKAN, Omri ARMSTRONG, Amir HERTZ, Avi CACIULARU, Ori KATZ, Itzik MALKIEL, Noam KOENIGSTEIN, Nir NICE
-
Publication number: 20230124168Abstract: Examples provide a self-supervised language model for document-to-document similarity scoring and ranking long documents of arbitrary length in an absence of similarity labels. In a first stage of a two-staged hierarchical scoring, a sentence similarity matrix is created for each paragraph in the candidate document. A sentence similarity score is calculated based on the sentence similarity matrix. In the second stage, a paragraph similarity matrix is constructed based on aggregated sentence similarity scores associated with the first candidate document. A total similarity score for the document is calculated based on the normalize the paragraph similarity matrix for each candidate document in a collection of documents. The model is trained using a masked language model and intra-and-inter document sampling. The documents are ranked based on the similarity scores for the documents.Type: ApplicationFiled: December 19, 2022Publication date: April 20, 2023Inventors: Itzik MALKIEL, Dvir GINZBURG, Noam KOENIGSTEIN, Oren BARKAN
-
Patent number: 11580764Abstract: Examples provide a self-supervised language model for document-to-document similarity scoring and ranking long documents of arbitrary length in an absence of similarity labels. In a first stage of a two-staged hierarchical scoring, a sentence similarity matrix is created for each paragraph in the candidate document. A sentence similarity score is calculated based on the sentence similarity matrix. In the second stage, a paragraph similarity matrix is constructed based on aggregated sentence similarity scores associated with the first candidate document. A total similarity score for the document is calculated based on the normalize the paragraph similarity matrix for each candidate document in a collection of documents. The model is trained using a masked language model and intra-and-inter document sampling. The documents are ranked based on the similarity scores for the documents.Type: GrantFiled: June 22, 2021Date of Patent: February 14, 2023Assignee: Microsoft Technology Licensing, LLC.Inventors: Itzik Malkiel, Dvir Ginzburg, Noam Koenigstein, Oren Barkan, Nir Nice
-
Publication number: 20220405504Abstract: Examples provide a self-supervised language model for document-to-document similarity scoring and ranking long documents of arbitrary length in an absence of similarity labels. In a first stage of a two-staged hierarchical scoring, a sentence similarity matrix is created for each paragraph in the candidate document. A sentence similarity score is calculated based on the sentence similarity matrix. In the second stage, a paragraph similarity matrix is constructed based on aggregated sentence similarity scores associated with the first candidate document. A total similarity score for the document is calculated based on the normalize the paragraph similarity matrix for each candidate document in a collection of documents. The model is trained using a masked language model and intra-and-inter document sampling. The documents are ranked based on the similarity scores for the documents.Type: ApplicationFiled: June 22, 2021Publication date: December 22, 2022Inventors: Itzik MALKIEL, Dvir GINZBURG, Noam KOENIGSTEIN, Oren BARKAN, Nir NICE
-
Publication number: 20220318504Abstract: The disclosure herein describes a system for interpreting text-based similarity between a seed item and a recommended item selected by a pre-trained language model from a plurality of candidate items based on semantic similarities between the seed item and the recommended item. The system analyzes similarity scores and contextual paragraph representations representing text-based descriptions of the seed item and recommended item to generate gradient maps and word scores representing the text-based descriptions. A model for interpreting text-based similarity utilizes the calculated gradients and word scores to match words from the seed item description with words in the recommended item description having similar semantic meaning. The word-pairs having the highest weight are identified by the system as the word-pairs having the greatest influence over the selection of the recommended item from the candidate items by the original pre-trained language model.Type: ApplicationFiled: March 30, 2021Publication date: October 6, 2022Inventors: Itzik MALKIEL, Noam KOENIGSTEIN, Oren BARKAN, Dvir GINZBURG, Nir NICE
-
Patent number: 11238521Abstract: The disclosure herein describes a recommendation system utilizing a specialized domain-specific language model for generating cold-start recommendations in an absence of user-specific data based on a user-selection of a seed item. A generalized language model is trained using a domain-specific corpus of training data, including title and description pairs associated with candidate items in a domain-specific catalog. The language model is trained to distinguish between real title-description pairs and fake title-description pairs. The trained language model analyzes the title and description of the seed item with the title and description of each candidate item in the catalog to create a hybrid set of scores. The set of scores includes similarity scores and classification scores for the seed item title with each candidate item description and title. The scores are utilized by the model to identify candidate items maximizing similarity with the seed item for cold-start recommendation to a user.Type: GrantFiled: February 12, 2020Date of Patent: February 1, 2022Assignee: Microsoft Technology Licensing, LLCInventors: Itzik Malkiel, Pavel Roit, Noam Koenigstein, Oren Barkan, Nir Nice
-
Patent number: 11175365Abstract: A method is provided that includes acquiring coil data from a magnetic resonance imaging device. The coil data includes undersampled k-space data. The method includes processing the coil data using an image reconstruction technique to generate an initial undersampled image. The method includes generating a reconstructed image based on the coil data, the initial undersampled image, and multiple iterative blocks of a residual deep-learning image reconstruction network. A first iterative block of the residual deep-learning image reconstruction network receives the initial undersampled image. Each of the multiple iterative blocks includes a data-consistency unit that preserves the fidelity of the coil data in a respective output of a respective iterative block utilizing zeroed data consistency. The initial undersampled image is added to an output of the last iterative block via a residual connection.Type: GrantFiled: October 2, 2018Date of Patent: November 16, 2021Assignee: GENERAL ELECTRIC COMPANYInventors: Christopher Judson Hardy, Itzik Malkiel
-
Patent number: 11042803Abstract: A method of reconstructing imaging data into a reconstructed image may include training a generative adversarial network (GAN) to reconstruct the imaging data. The GAN may include a generator and a discriminator. Training the GAN may include determining a combined loss by adaptively adjusting an adversarial loss based at least in part on a difference between the adversarial loss and a pixel-wise loss. Additionally, the combined loss may be a combination of the adversarial loss and the pixel-wise loss. Training the GAN may also include updating the generator based at least in part on the combined loss. The method may also include receiving, into the generator, the imaging data and reconstructing, via the generator, the imaging data into a reconstructed image.Type: GrantFiled: February 14, 2019Date of Patent: June 22, 2021Assignee: General Electric CompanyInventors: Itzik Malkiel, Christopher Judson Hardy
-
Publication number: 20210182935Abstract: The disclosure herein describes a recommendation system utilizing a specialized domain-specific language model for generating cold-start recommendations in an absence of user-specific data based on a user-selection of a seed item. A generalized language model is trained using a domain-specific corpus of training data, including title and description pairs associated with candidate items in a domain-specific catalog. The language model is trained to distinguish between real title-description pairs and fake title-description pairs. The trained language model analyzes the title and description of the seed item with the title and description of each candidate item in the catalog to create a hybrid set of scores. The set of scores includes similarity scores and classification scores for the seed item title with each candidate item description and title. The scores are utilized by the model to identify candidate items maximizing similarity with the seed item for cold-start recommendation to a user.Type: ApplicationFiled: February 12, 2020Publication date: June 17, 2021Inventors: Itzik MALKIEL, Pavel ROIT, Noam KOENIGSTEIN, Oren BARKAN, Nir NICE
-
Patent number: 10996306Abstract: A magnetic resonance imaging (MRI) system includes control and analysis circuitry having programming to acquire magnetic resonance (MR) data using coil elements of the MRI system, analyze the MR data, and reconstruct the MR data into MR sub-images. The system also includes a trained neural network associated with the control and analysis circuitry to transform the MR sub-images into a prediction relating to a presence and extent of motion corruption in the MR sub-images. The programming of the control and analysis circuitry includes instructions to control operations of the MRI system based at least in part on the prediction of the trained neural network.Type: GrantFiled: April 25, 2019Date of Patent: May 4, 2021Assignee: GENERAL ELECTRIC COMPANYInventors: Isabelle Heukensfeldt Jansen, Sangtae Ahn, Christopher Judson Hardy, Itzik Malkiel, Rafael Shmuel Brada, Ron Wein, Michael Rotman
-
Publication number: 20200337591Abstract: K-space data obtained from a magnetic resonance imaging scan where motion was detected is split into two parts in accordance with the timing of the motion to produce first and second sets of k-space data corresponding to different poses. Sub-images are reconstructed from the k first and second sets of k-space data, which are used as inputs to a deep neural network which transforms them into a motion-corrected image.Type: ApplicationFiled: April 25, 2019Publication date: October 29, 2020Inventors: Michael Rotman, Rafael Shmuel Brada, Sangtae Ahn, Christopher Judson Hardy, Itzik Malkiel, Ron Wein
-
Publication number: 20200337592Abstract: A system and method for detecting, timing, and adapting to patient motion during an MR scan includes using the inconsistencies between calculated images from different coil-array elements to detect the presence of patient motion and, together with the k-space scan-order information, determine the timing of the motion during the scan. Once the timing is known, various actions may be taken, including restarting the scan, reacquiring those portions of k-space acquired before the movement, or correcting for the motion using the existing data and reconstructing a motion-corrected image from the data.Type: ApplicationFiled: April 25, 2019Publication date: October 29, 2020Inventors: Rafael Shmuel Brada, Christopher Judson Hardy, Sangtae Ahn, Isabelle Heukensfeldt Jansen, Itzik Malkiel, Michael Rotman, Ron Wein
-
Publication number: 20200341100Abstract: A magnetic resonance imaging (MRI) system includes control and analysis circuitry having programming to acquire magnetic resonance (MR) data using coil elements of the MRI system, analyze the MR data, and reconstruct the MR data into MR sub-images. The system also includes a trained neural network associated with the control and analysis circuitry to transform the MR sub-images into a prediction relating to a presence and extent of motion corruption in the MR sub-images. The programming of the control and analysis circuitry includes instructions to control operations of the MRI system based at least in part on the prediction of the trained neural network.Type: ApplicationFiled: April 25, 2019Publication date: October 29, 2020Inventors: Isabelle Heukensfeldt Jansen, Sangtae Ahn, Christopher Judson Hardy, Itzik Malkiel, Rafael Shmuel Brada, Ron Wein, Michael Rotman