Patents by Inventor Krishnan Ramnath
Krishnan Ramnath has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12056435Abstract: Images stored in an information repository are prepared for browsing. For each image in the repository, text in the repository is mined to extract snippets of text about the image which are semantically relevant to the image, and for each of these snippets of text, keyterms are detected in the snippet of text which represent either concepts that are related to the image or entities that are related to the image, and the snippet of text and keyterms are associated with the image. Each keyterm that is associated with each image in the repository is hyperlinked to each other image in the repository that has this keyterm associated therewith. A graphical user interface allows a user to browse the images in the repository by using their associated snippets of text and hyperlinked keyterms.Type: GrantFiled: January 12, 2022Date of Patent: August 6, 2024Assignee: Microsoft Technology Licensing, LLCInventors: Simon John Baker, Anitha Kannan, Krishnan Ramnath
-
Patent number: 11741151Abstract: A mobile client device is localized based on a captured image by identifying where the client device is located from a set of known locations. The set of known locations is associated with a set of regions, where each region is associated with a set of key frames representing the important features of the region. Latent vectors and keypoints are calculated for each of the key frames and an image captured by the client device. The system compares the latent vectors of the captured image to the latent vectors associated with the regions to determine a subset of similar regions. The system compares the keypoints of the captured image to the keypoints associated with the regions in the subset to determine a best match. This determined location is considered the region of the client device and may be used with other localization information to maintain localization of the client device.Type: GrantFiled: December 22, 2022Date of Patent: August 29, 2023Assignee: Meta Platforms, Inc.Inventors: Krishnan Ramnath, Saurabh Mitra, Lakshmie Narayan Viswanathan
-
Patent number: 11556580Abstract: A mobile client device is localized based on a captured image by identifying where the client device is located from a set of known locations. The set of known locations is associated with a set of regions, where each region is associated with a set of key frames representing the important features of the region. Latent vectors and keypoints are calculated for each of the key frames and an image captured by the client device. The system compares the latent vectors of the captured image to the latent vectors associated with the regions to determine a subset of similar regions. The system compares the keypoints of the captured image to the keypoints associated with the regions in the subset to determine a best match. This determined location is considered the region of the client device and may be used with other localization information to maintain localization of the client device.Type: GrantFiled: February 20, 2020Date of Patent: January 17, 2023Assignee: Meta Platforms, Inc.Inventors: Krishnan Ramnath, Saurabh Mitra, Lakshmie Narayan Viswanathan
-
Patent number: 11430157Abstract: Disclosed herein are related to a device and a method of generating triggers to provide effects to an artificial reality based on features in an environment. In one aspect, a set of candidate triggers for applying effects to the artificial reality provided by the device is determined according to features in an environment. In one aspect, a subset of the set of candidate triggers is determined according to a predetermined policy. In one aspect, corresponding effects to apply to the artificial reality are generated by the device according to the subset of the set of candidate triggers.Type: GrantFiled: October 24, 2019Date of Patent: August 30, 2022Assignee: Meta Platforms Technologies, LLCInventors: Xiaoyang Gao, Rahul Prasad, Krishnan Ramnath
-
Publication number: 20220138404Abstract: Images stored in an information repository are prepared for browsing. For each image in the repository, text in the repository is mined to extract snippets of text about the image which are semantically relevant to the image, and for each of these snippets of text, keyterms are detected in the snippet of text which represent either concepts that are related to the image or entities that are related to the image, and the snippet of text and keyterms are associated with the image. Each keyterm that is associated with each image in the repository is hyperlinked to each other image in the repository that has this keyterm associated therewith. A graphical user interface allows a user to browse the images in the repository by using their associated snippets of text and hyperlinked keyterms.Type: ApplicationFiled: January 12, 2022Publication date: May 5, 2022Applicant: Microsoft Technology Licensing, LLCInventors: Simon John BAKER, Anitha KANNAN, Krishnan RAMNATH
-
Patent number: 11250203Abstract: Images stored in an information repository are prepared for browsing. For each image in the repository, text in the repository is mined to extract snippets of text about the image which are semantically relevant to the image, and for each of these snippets of text, keyterms are detected in the snippet of text which represent either concepts that are related to the image or entities that are related to the image, and the snippet of text and keyterms are associated with the image. Each keyterm that is associated with each image in the repository is hyperlinked to each other image in the repository that has this keyterm associated therewith. A graphical user interface allows a user to browse the images in the repository by using their associated snippets of text and hyperlinked keyterms.Type: GrantFiled: August 12, 2013Date of Patent: February 15, 2022Assignee: MICROSOFT TECHNOLOGY LICENSING, LLCInventors: Simon John Baker, Anitha Kannan, Krishnan Ramnath
-
Patent number: 10796185Abstract: In one embodiment, a method includes generating, by a device, first tracking data using a first tracking algorithm, based on first video frames associated with a scene. An augmented-reality (AR) effect may be displayed based on the first tracking data. The device may generate a first confidence score associated with the first tracking data and determine that the first confidence score is above a threshold. The device may generate, based on second video frames subsequent to the first video frames, second tracking data using the first tracking algorithm. The device may determine that an associated second confidence score is below a threshold. In response, the device may generate, based on third video frames subsequent to the second video frames, third tracking data using a second tracking algorithm different from the first. The device may then display the AR effect based on the third tracking data.Type: GrantFiled: November 3, 2017Date of Patent: October 6, 2020Assignee: Facebook, Inc.Inventors: Alvaro Collet Romea, Tullie Murrell, Hermes Germi Pique Corchs, Krishnan Ramnath, Thomas Ward Meyer, Jiao Li, Steven Kish
-
Publication number: 20200143238Abstract: In one embodiment, a method includes receiving deep-learning (DL)-feature representations and local-feature descriptors, wherein the DL-feature representations and the local-feature descriptors are extracted from an image that includes a first depiction of a real-world object; identifying a set of potentially matching DL-feature representations based on a comparison of the received DL-feature representations with stored DL-feature representations associated with a plurality of augmented-reality (AR) targets; determining, from a set of potentially matching AR targets associated with the set of potentially matching DL-feature representations, a matching AR target based on a comparison of the received one or more local-feature descriptors with stored local-feature descriptors associated with the set of potentially matching AR targets, wherein the stored local-feature descriptors are extracted from the set of potentially matching AR targets; and sending, to the client computing device, information configured to rType: ApplicationFiled: November 7, 2018Publication date: May 7, 2020Inventors: Krishnan Ramnath, Shanghsuan Tsai
-
Publication number: 20190138834Abstract: In one embodiment, a method includes generating, by a device, first tracking data using a first tracking algorithm, based on first video frames associated with a scene. An augmented-reality (AR) effect may be displayed based on the first tracking data. The device may generate a first confidence score associated with the first tracking data and determine that the first confidence score is above a threshold. The device may generate, based on second video frames subsequent to the first video frames, second tracking data using the first tracking algorithm. The device may determine that an associated second confidence score is below a threshold. In response, the device may generate, based on third video frames subsequent to the second video frames, third tracking data using a second tracking algorithm different from the first. The device may then display the AR effect based on the third tracking data.Type: ApplicationFiled: November 3, 2017Publication date: May 9, 2019Inventors: Alvaro Collet Romea, Tullie Murrell, Hermes Germi Pique Corchs, Krishnan Ramnath, Thomas Ward Meyer, Jiao Li, Steven Kish
-
Patent number: 9690977Abstract: The claimed subject matter provides for systems and/or methods for identification of instances of an object of interest in 2D images by creating a database of 3D curve models of each desired instance and comparing an image of an object of interest against such 3D curve models of instances. The present application describes identifying and verifying the make and model of a car from a possibly single image—after the models have been populated with training data of test images of many makes and models of cars. In one embodiment, an identification system may be constructed by generating a 3D curve model by back-projecting edge points onto a visual hull reconstruction from silhouettes of an instance. The system and methods employ chamfer distance and orientation distance provides reasonable verification performance, as well as an appearance model for the taillights of the car to increase the robustness of the system.Type: GrantFiled: July 8, 2015Date of Patent: June 27, 2017Inventors: Richard Szeliski, Edward Hsiao, Sudipta Sinha, Krishnan Ramnath, Charles Zitnick, Simon Baker
-
Publication number: 20160189414Abstract: The description relates to sentence autocaptioning of images. One example can include a set of information modules and a set of sentence generation modules. The set of information modules can include individual information modules configured to operate on an image or metadata associated with the image to produce image information. The set of sentence generation modules can include individual sentence generation modules configured to operate on the image information to produce a sentence caption for the image.Type: ApplicationFiled: March 7, 2016Publication date: June 30, 2016Applicant: Microsoft Technology Licensing, LLCInventors: Simon BAKER, Krishnan RAMNATH
-
Patent number: 9317531Abstract: The description relates to sentence autocaptioning of images. One example can include a set of information modules and a set of sentence generation modules. The set of information modules can include individual information modules configured to operate on an image or metadata associated with the image to produce image information. The set of sentence generation modules can include individual sentence generation modules configured to operate on the image information to produce a sentence caption for the image.Type: GrantFiled: October 18, 2012Date of Patent: April 19, 2016Assignee: Microsoft Technology Licensing, LLCInventors: Simon Baker, Krishnan Ramnath
-
Publication number: 20150310257Abstract: The claimed subject matter provides for systems and/or methods for identification of instances of an object of interest in 2D images by creating a database of 3D curve models of each desired instance and comparing an image of an object of interest against such 3D curve models of instances. The present application describes identifying and verifying the make and model of a car from a possibly single image—after the models have been populated with training data of test images of many makes and models of cars. In one embodiment, an identification system may be constructed by generating a 3D curve model by back-projecting edge points onto a visual hull reconstruction from silhouettes of an instance. The system and methods employ chamfer distance and orientation distance provides reasonable verification performance, as well as an appearance model for the taillights of the car to increase the robustness of the system.Type: ApplicationFiled: July 8, 2015Publication date: October 29, 2015Inventors: Richard Szeliski, Edward Hsiao, Sudipta Sinha, Krishnan Ramnath, Charles Zitnick, Simon Baker
-
Patent number: 9111349Abstract: The claimed subject matter provides for systems and/or methods for identification of instances of an object of interest in 2D images by creating a database of 3D curve models of each desired instance and comparing an image of an object of interest against such 3D curve models of instances. The present application describes identifying and verifying the make and model of a car from a possibly single image—after the models have been populated with training data of test images of many makes and models of cars. In one embodiment, an identification system may be constructed by generating a 3D curve model by back-projecting edge points onto a visual hull reconstruction from silhouettes of an instance. The system and methods employ chamfer distance and orientation distance provides reasonable verification performance, as well as an appearance model for the taillights of the car to increase the robustness of the system.Type: GrantFiled: December 16, 2011Date of Patent: August 18, 2015Assignee: Microsoft Technology Licensing, LLCInventors: Richard Stephan Szeliski, Edward Hsiao, Sudipta Narayan Sinha, Krishnan Ramnath, Charles Lawrence Zitnick, III, Simon John Baker
-
Publication number: 20150046781Abstract: Images stored in an information repository are prepared for browsing. For each image in the repository, text in the repository is mined to extract snippets of text about the image which are semantically relevant to the image, and for each of these snippets of text, keyterms are detected in the snippet of text which represent either concepts that are related to the image or entities that are related to the image, and the snippet of text and keyterms are associated with the image. Each keyterm that is associated with each image in the repository is hyperlinked to each other image in the repository that has this keyterm associated therewith. A graphical user interface allows a user to browse the images in the repository by using their associated snippets of text and hyperlinked keyterms.Type: ApplicationFiled: August 12, 2013Publication date: February 12, 2015Applicant: Microsoft CorporationInventors: Simon John Baker, Anitha Kannan, Krishnan Ramnath
-
Patent number: 8838432Abstract: An image in a web page may be annotated after deriving information about an image when the image may be displayed on multiple web pages. The web pages that show the image may be analyzed in light of each other to determine metadata about the image, then various additional content may be added to the image. The additional content may be hyperlinks to other webpages. The additional content may be displayed as annotations on top of the images and in other manners. Many embodiments may perform searching, analysis, and classification of images prior to the web page being served.Type: GrantFiled: February 6, 2012Date of Patent: September 16, 2014Assignee: Microsoft CorporationInventors: Simon John Baker, Juliet Anne Bernstein, Krishnan Ramnath, Anitha Kannan, Dahua Lin, Qifa Ke, Matthew Uyttendaele
-
Publication number: 20140114643Abstract: The description relates to sentence autocaptioning of images. One example can include a set of information modules and a set of sentence generation modules. The set of information modules can include individual information modules configured to operate on an image or metadata associated with the image to produce image information. The set of sentence generation modules can include individual sentence generation modules configured to operate on the image information to produce a sentence caption for the image.Type: ApplicationFiled: October 18, 2012Publication date: April 24, 2014Applicant: Microsoft CorporationInventors: Simon Baker, Krishnan Ramnath
-
Publication number: 20130204608Abstract: An image in a web page may be annotated after deriving information about an image when the image may be displayed on multiple web pages. The web pages that show the image may be analyzed in light of each other to determine metadata about the image, then various additional content may be added to the image. The additional content may be hyperlinks to other webpages. The additional content may be displayed as annotations on top of the images and in other manners. Many embodiments may perform searching, analysis, and classification of images prior to the web page being served.Type: ApplicationFiled: February 6, 2012Publication date: August 8, 2013Applicant: Microsoft CorporationInventors: Simon John BAKER, Juliet Anne BERNSTEIN, Krishnan RAMNATH, Anitha KANNAN, Dahua LIN, Qifa KE, Matthew UYTTENDAELE
-
Publication number: 20130156329Abstract: The claimed subject matter provides for systems and/or methods for identification of instances of an object of interest in 2D images by creating a database of 3D curve models of each desired instance and comparing an image of an object of interest against such 3D curve models of instances. The present application describes identifying and verifying the make and model of a car from a possibly single image—after the models have been populated with training data of test images of many makes and models of cars. In one embodiment, an identification system may be constructed by generating a 3D curve model by back-projecting edge points onto a visual hull reconstruction from silhouettes of an instance. The system and methods employ chamfer distance and orientation distance provides reasonable verification performance, as well as an appearance model for the taillights of the car to increase the robustness of the system.Type: ApplicationFiled: December 16, 2011Publication date: June 20, 2013Applicant: MICROSOFT CORPORATIONInventors: Richard Stephan Szeliski, Edward Hsiao, Sudipta Narayan Sinha, Krishnan Ramnath, Charles Lawrence Zitnick, III, Simon John Baker