Patents by Inventor Geoffrey Gerson Zweig
Geoffrey Gerson Zweig has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11531863Abstract: Disclosed herein includes a system, a method, and a device for localizing and classifying content in a data set. A device can provide a sequence of portions of a data set to a neural network to generate a plurality of activations. Each activation of the plurality of activations can include at least one value from a layer of the neural network. The device can apply an attention vector to each activation of the plurality of activations to generate a sequence of values. A normalization function can be applied to the sequence of values to generate a sequence of attention scores according to the sequence of values. The device can identify or localize one or more portions in the sequence of portions of the data based in part on the sequence of attention scores.Type: GrantFiled: August 8, 2019Date of Patent: December 20, 2022Assignee: Meta Platforms Technologies, LLCInventors: Geoffrey Gerson Zweig, Prahal Arora, Gourab Kundu, Polina Kuznetsova
-
Patent number: 10867597Abstract: Technologies pertaining to slot filling are described herein. A deep neural network, a recurrent neural network, and/or a spatio-temporally deep neural network are configured to assign labels to words in a word sequence set forth in natural language. At least one label is a semantic label that is assigned to at least one word in the word sequence.Type: GrantFiled: September 2, 2013Date of Patent: December 15, 2020Assignee: Microsoft Technology Licensing, LLCInventors: Anoop Deoras, Kaisheng Yao, Xiaodong He, Li Deng, Geoffrey Gerson Zweig, Ruhi Sarikaya, Dong Yu, Mei-Yuh Hwang, Gregoire Mesnil
-
Patent number: 10579656Abstract: Various technologies described herein pertain to executing a mixed query to search a database retained in a data repository. The mixed query includes a regular expression, which is a pattern of elements, and a semantic constraint. The elements in the regular expression include a first wildcard, where the semantic constraint restricts a meaning of the first wildcard. Moreover, the elements in the regular expression include explicit lexical constraint(s) and/or disparate wildcard(s). For instance, semantic constraint(s) can restrict meaning(s) of the disparate wildcard(s). The mixed query is executed to retrieve results that match the pattern of the elements in the regular expression and satisfy the semantic constraint(s).Type: GrantFiled: April 13, 2017Date of Patent: March 3, 2020Assignee: Microsoft Technology Licensing, LLCInventors: Sumit Gulwani, Geoffrey Gerson Zweig
-
Publication number: 20170220673Abstract: Various technologies described herein pertain to executing a mixed query to search a database retained in a data repository. The mixed query includes a regular expression, which is a pattern of elements, and a semantic constraint. The elements in the regular expression include a first wildcard, where the semantic constraint restricts a meaning of the first wildcard. Moreover, the elements in the regular expression include explicit lexical constraint(s) and/or disparate wildcard(s). For instance, semantic constraint(s) can restrict meaning(s) of the disparate wildcard(s). The mixed query is executed to retrieve results that match the pattern of the elements in the regular expression and satisfy the semantic constraint(s).Type: ApplicationFiled: April 13, 2017Publication date: August 3, 2017Inventors: Sumit Gulwani, Geoffrey Gerson Zweig
-
Patent number: 9659082Abstract: Various technologies described herein pertain to executing a mixed query to search a database retained in a data repository. The mixed query includes a regular expression, which is a pattern of elements, and a semantic constraint. The elements in the regular expression include a first wildcard, where the semantic constraint restricts a meaning of the first wildcard. Moreover, the elements in the regular expression include explicit lexical constraint(s) and/or disparate wildcard(s). For instance, semantic constraint(s) can restrict meaning(s) of the disparate wildcard(s). The mixed query is executed to retrieve results that match the pattern of the elements in the regular expression and satisfy the semantic constraint(s).Type: GrantFiled: August 27, 2012Date of Patent: May 23, 2017Assignee: Microsoft Technology Licensing, LLCInventors: Sumit Gulwani, Geoffrey Gerson Zweig
-
Patent number: 9239828Abstract: Recurrent conditional random field (R-CRF) embodiments are described. In one embodiment, the R-CFR receives feature values corresponding to a sequence of words. Semantic labels for words in the sequence of words are then generated and each label is assigned to the appropriate one of the words in the sequence of words. The R-CRF used to accomplish these tasks includes a recurrent neural network (RNN) portion and a conditional random field (CRF) portion. The RNN portion receives feature values associated with a word in the sequence of words and outputs RNN activation layer activations data that is indicative of a semantic label. The CRF portion inputs the RNN activation layer activations data output from the RNN for one or more words in the sequence of words and outputs label data that is indicative of a separate semantic label that is to be assigned to each of the words.Type: GrantFiled: March 7, 2014Date of Patent: January 19, 2016Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Kaisheng Yao, Geoffrey Gerson Zweig, Dong Yu
-
Publication number: 20150161101Abstract: Recurrent conditional random field (R-CRF) embodiments are described. In one embodiment, the R-CFR receives feature values corresponding to a sequence of words. Semantic labels for words in the sequence of words are then generated and each label is assigned to the appropriate one of the words in the sequence of words. The R-CRF used to accomplish these tasks includes a recurrent neural network (RNN) portion and a conditional random field (CRF) portion. The RNN portion receives feature values associated with a word in the sequence of words and outputs RNN activation layer activations data that is indicative of a semantic label. The CRF portion inputs the RNN activation layer activations data output from the RNN for one or more words in the sequence of words and outputs label data that is indicative of a separate semantic label that is to be assigned to each of the words.Type: ApplicationFiled: March 7, 2014Publication date: June 11, 2015Applicant: Microsoft CorporationInventors: Kaisheng Yao, Geoffrey Gerson Zweig, Dong Yu
-
Publication number: 20150066496Abstract: Technologies pertaining to slot filling are described herein. A deep neural network, a recurrent neural network, and/or a spatio-temporally deep neural network are configured to assign labels to words in a word sequence set forth in natural language. At least one label is a semantic label that is assigned to at least one word in the word sequence.Type: ApplicationFiled: September 2, 2013Publication date: March 5, 2015Applicant: Microsoft CorporationInventors: Anoop Deoras, Kaisheng Yao, Xiaodong He, Li Deng, Geoffrey Gerson Zweig, Ruhi Sarikaya, Dong Yu, Mei-Yuh Hwang, Gregoire Mesnil
-
Publication number: 20140059078Abstract: Various technologies described herein pertain to executing a mixed query to search a database retained in a data repository. The mixed query includes a regular expression, which is a pattern of elements, and a semantic constraint. The elements in the regular expression include a first wildcard, where the semantic constraint restricts a meaning of the first wildcard. Moreover, the elements in the regular expression include explicit lexical constraint(s) and/or disparate wildcard(s). For instance, semantic constraint(s) can restrict meaning(s) of the disparate wildcard(s). The mixed query is executed to retrieve results that match the pattern of the elements in the regular expression and satisfy the semantic constraint(s).Type: ApplicationFiled: August 27, 2012Publication date: February 27, 2014Applicant: Microsoft CorporationInventors: Sumit Gulwani, Geoffrey Gerson Zweig
-
Patent number: 8401852Abstract: A computer-implemented speech recognition system described herein includes a receiver component that receives a plurality of detected units of an audio signal, wherein the audio signal comprises a speech utterance of an individual. A selector component selects a subset of the plurality of detected units that correspond to a particular time-span. A generator component generates at least one feature with respect to the particular time-span, wherein the at least one feature is one of an existence feature, an expectation feature, or an edit distance feature. Additionally, a statistical speech recognition model outputs at least one word that corresponds to the particular time-span based at least in part upon the at least one feature generated by the feature generator component.Type: GrantFiled: November 30, 2009Date of Patent: March 19, 2013Assignee: Microsoft CorporationInventors: Geoffrey Gerson Zweig, Patrick An-Phu Nguyen, James Garnet Droppo, III, Alejandro Acero
-
Publication number: 20110131046Abstract: A computer-implemented speech recognition system described herein includes a receiver component that receives a plurality of detected units of an audio signal, wherein the audio signal comprises a speech utterance of an individual. A selector component selects a subset of the plurality of detected units that correspond to a particular time-span. A generator component generates at least one feature with respect to the particular time-span, wherein the at least one feature is one of an existence feature, an expectation feature, or an edit distance feature. Additionally, a statistical speech recognition model outputs at least one word that corresponds to the particular time-span based at least in part upon the at least one feature generated by the feature generator component.Type: ApplicationFiled: November 30, 2009Publication date: June 2, 2011Applicant: Microsoft CorporationInventors: Geoffrey Gerson Zweig, Patrick An-Phu Nguyen, James Garnet Droppo, III, Alejandro Acero
-
Publication number: 20080298562Abstract: A voice interaction system is configured to analyze an utterance and identify inherent attributes that are indicative of a demographic characteristic of the system user that spoke the utterance. The system then selects and presents a personalized response to the user, the response being selected based at least in part on the identified demographic characteristic. In one embodiment, the demographic characteristic is one or more of the caller's age, gender, ethnicity, education level, emotional state, health status and geographic group. In another embodiment, the selection of the response is further based on consideration of corroborative caller data.Type: ApplicationFiled: June 4, 2007Publication date: December 4, 2008Applicant: Microsoft CorporationInventors: Yun-Cheng Ju, Alejandro Acero, Neal Alan Berstein, Geoffrey Gerson Zweig
-
Publication number: 20080262995Abstract: A method of communicating information about a product evaluation between a system having a data store and a wireless client device is discussed. The method includes receiving a signal representative of an audible indication from the client device via a wireless communication link identifying the product about which evaluation information is to be communicated. The method further includes comparing an indication of the signal to data in the data store in response to match the indication with a portion of the data and communicating evaluation information between the wireless client device and the system.Type: ApplicationFiled: April 19, 2007Publication date: October 23, 2008Applicant: Microsoft CorporationInventors: Geoffrey Gerson Zweig, Yun-Cheng Ju, Patrick Nguyen, Alejandro Acero