Patents by Inventor Vignesh Jagadeesh
Vignesh Jagadeesh has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11308345Abstract: Various methods for utilizing a saliency heatmaps are described. The methods include obtaining image data corresponding to an image of a scene, obtaining a saliency heatmap for the image of the scene based on a saliency network, wherein the saliency heatmap indicates a likelihood of saliency for a corresponding portion of the scene, and manipulating the image data based on the saliency heatmap. In embodiments, the saliency heatmap may be produced using a trained machine learning model. The saliency heatmap may be used for various image processing tasks, such as determining which portion(s) of a scene to base an image capture device's autofocus, auto exposure, and/or white balance operations upon. According to some embodiments, one or more bounding boxes may be generated based on the saliency heatmap, e.g., using an optimization operation, which bounding box(es) may be used to assist or enhance the performance of various image processing tasks.Type: GrantFiled: April 14, 2020Date of Patent: April 19, 2022Assignee: Apple Inc.Inventors: Vignesh Jagadeesh, Yingjun Bai, Guillaume Tartavel, Gregory Guyomarc'h
-
Patent number: 11250041Abstract: A device implementing a system for expanded search includes a processor configured to identify plural words, and generate, for each word of the plural words, a word vector based on a proximity of the word relative to other words of the plural words, the word vector comprising plural dimensions. The processor is further configured to create a compressed word vector structure comprising clusters of subsets of the plural dimensions across the word vectors, each cluster including similar values of the respective dimensions, convert the word vectors to points on at least one plane, and partition the at least one plane into nested groupings of the points based on a threshold number of points per nested grouping. The processor is further configured to create a tree look-up structure of the nested groupings, and provide the compressed word vector structure and the tree look-up structure to a client device.Type: GrantFiled: September 28, 2018Date of Patent: February 15, 2022Assignee: Apple Inc.Inventors: Vivek Kumar Rangarajan Sridhar, Xingwen Xu, Vignesh Jagadeesh
-
Publication number: 20210406960Abstract: For an input image of a person, a set of object proposals are generated in the form of bounding boxes. A pose detector identifies coordinates in the image corresponding to locations on the person's body, such as the waist, head, hands, and feet of the person. A convolutional neural network receives the portions of the input image defined by the bounding boxes and generates a feature vector for each image portion. The feature vectors are input to one or more support vector machine classifiers, which generate an output representing a probability of a match with an item. The distance between the bounding box and a joint associated with the item is used to modify the probability. The modified probabilities for the support vector machine are then compared with a threshold and each other to identify the item.Type: ApplicationFiled: September 13, 2021Publication date: December 30, 2021Applicant: eBay Inc.Inventors: Kota Hara, Vignesh Jagadeesh, Robinson Piramuthu
-
Patent number: 11196943Abstract: Techniques are disclosed for editing captured media to overcome operational difficulties that may arise during capture operations. According to these techniques, content may be captured with a pair of cameras, a first camera having a wider field of view than a second camera. Object(s) may be detected from captured content from the wider field of view camera. The captured content may be processed from the wider field of view camera in a location of at least one detected object. Typically, operators may attempt to frame content using content from the narrower field of view camera. As a result, operators may be unaware that desired content is captured using a second, wider field of view camera. Results from the processed wider field of view data may be proposed to operators for review and, if desired, retention.Type: GrantFiled: October 15, 2019Date of Patent: December 7, 2021Assignee: Apple Inc.Inventors: Shuang Gao, Vasilios E. Anton, Robert A. Bailey, Emilie Kim, Vignesh Jagadeesh, Paul Schneider, Piotr Stanczyk, Arwen Bradley, Jason Klivington, Jacques Gasselin De Richebourg, Joe Triscari, Sébastien Beysserie, Yang Yang, Afshin Dehghan, Rudolph van der Merwe
-
Publication number: 20210358127Abstract: A first subset of pixels of an image may be labeled with an object identifier based on user interactions with the image. Pixel data representing the pixels of the image may be passed through an embedding neural network model to generate pixel embedding vectors. A prototype embedding vector associated with the object identifier may be generated based pixel embedding vectors corresponding to the first subset of pixels. For each pixel of a second subset of pixels of the image, a probability that the pixel should be labeled with the object identifier may be determined based on the prototype embedding vector and pixel embedding vectors corresponding to the second subset of pixels. Pixels of the second subset of pixels may be labeled with the object identifier based on the determined probabilities, and the pixels in the image may be segmented based on the pixels labeled with the object identifier.Type: ApplicationFiled: October 22, 2020Publication date: November 18, 2021Inventors: Vignesh JAGADEESH, Atila ORHON
-
Patent number: 11120478Abstract: For an input image of a person, a set of object proposals are generated in the form of bounding boxes. A pose detector identifies coordinates in the image corresponding to locations on the person's body, such as the waist, head, hands, and feet of the person. A convolutional neural network receives the portions of the input image defined by the bounding boxes and generates a feature vector for each image portion. The feature vectors are input to one or more support vector machine classifiers, which generate an output representing a probability of a match with an item. The distance between the bounding box and a joint associated with the item is used to modify the probability. The modified probabilities for the support vector machine are then compared with a threshold and each other to identify the item.Type: GrantFiled: December 8, 2015Date of Patent: September 14, 2021Assignee: eBay Inc.Inventors: Kota Hara, Vignesh Jagadeesh, Robinson Piramuthu
-
Publication number: 20210192078Abstract: Embodiments described herein provide for a non-transitory machine-readable medium storing instructions to cause one or more processors to receive, at a client device, a machine learning model from a server, detect a usage pattern for a content item, store an association between the content item and the detected usage pattern in local data, train the machine learning model using local data for the content item with the detected usage pattern to generate a trained machine learning model, generate an update for the machine learning model, privatize the update for the machine learning model, and transmit the privatized update for the machine learning model to the server.Type: ApplicationFiled: December 21, 2020Publication date: June 24, 2021Inventors: Stephen Cosman, Kalu Onuka Kalu, Marcelo Lotif Araujo, Michael Chatzidakis, Thi Hai Van Do, Alexis Hugo Louis Durocher, Guillaume Tartavel, Sowmya Gopalan, Vignesh Jagadeesh, Abhishek Bhowmick, John Duchi, Julien Freudiger, Gaurav Kapoor, Ryan M. Rogers
-
Publication number: 20210182333Abstract: A machine may be configured to execute a machine-learning process for identifying and understanding fine properties of various items of various types by using images and associated corresponding annotations, such as titles, captions, tags, keywords, or other textual information applied to these images. By use of a machine-learning process, the machine may perform property identification accurately and without human intervention. These item properties may be used as annotations for other images that have similar features. Accordingly, the machine may answer user-submitted questions, such as “What do rustic items look like?,” and items or images depicting items that are deemed to be rustic can be readily identified, classified, ranked, or any suitable combination thereof.Type: ApplicationFiled: November 30, 2020Publication date: June 17, 2021Inventors: Anurag Bhardwaj, Robinson Piramuthu, Vicente Ordonez-Roman, Vignesh Jagadeesh, Wei Di
-
Publication number: 20210166290Abstract: A machine is configured to determine fashion preferences of users and to provide item recommendations based on the fashion preferences. For example, the machine accesses an indication of a fashion style of a user. The fashion style is determined based on automatically captured data pertaining to the user. The machine identifies, based on the fashion style, one or more fashion items from an inventory of fashion items. The machine generates one or more selectable user interface elements for inclusion in a user interface. The one or more user interface elements correspond to the one or more fashion items. The machine causes generation and display of the user interface that includes the one or more selectable user interface elements. A selection of a selectable user interface element results in display of a combination of an image of a particular fashion item and an image of an item worn by the user.Type: ApplicationFiled: November 23, 2020Publication date: June 3, 2021Inventors: Wei Di, Vignesh Jagadeesh, Robinson Piramuthu, Elizabeth Churchill, Anurag Bhardwaj
-
Publication number: 20210073589Abstract: Training a network for image processing with temporal consistency includes obtaining un-annotated frames from a video feed. A pretrained network is applied to the first frame of first frame set comprising a plurality of frames to obtain a first prediction, wherein the pretrained network is pretrained for a first image processing task. A current version of the pretrained network is applied to each frame of the first frame set to obtain a first prediction. A content loss term is determined, based on the first prediction and a current prediction for the frame, based on the current network. A temporal consistency loss term is also determined based on a determined consistency of pixels within each frame of the first frame set. The pretrained network may be refined based on the content loss term and the temporal term to obtain a refined network.Type: ApplicationFiled: March 17, 2020Publication date: March 11, 2021Inventors: Atila Orhon, Marco Zuliani, Vignesh Jagadeesh
-
Patent number: 10885394Abstract: An image is passed through an image identifier to identify a coarse category for the image and a bounding box for a categorized object. A mask is used to identify the portion of the image that represents the object. Given the foreground mask, the convex hull of the mask is located and an aligned rectangle of minimum area that encloses the hull is fitted. The aligned bounding box is rotated and scaled, so that the foreground object is roughly moved to a standard orientation and size (referred to as calibrated). The calibrated image is used as an input to a fine-grained categorization module, which determines the fine category within the coarse category for the input image.Type: GrantFiled: March 28, 2019Date of Patent: January 5, 2021Assignee: eBay Inc.Inventors: Mohammadhadi Kiapour, Wei Di, Vignesh Jagadeesh, Robinson Piramuthu
-
Patent number: 10878481Abstract: A machine is configured to determine fashion preferences of users and to provide item recommendations based on the fashion preferences. For example, the machine accesses an indication of a fashion style of a user. The fashion style is determined based on automatically captured data pertaining to the user. The machine identifies, based on the fashion style, one or more fashion items from an inventory of fashion items. The machine generates one or more selectable user interface elements for inclusion in a user interface. The one or more user interface elements correspond to the one or more fashion items. The machine causes generation and display of the user interface that includes the one or more selectable user interface elements. A selection of a selectable user interface element results in display of a combination of an image of a particular fashion item and an image of an item worn by the user.Type: GrantFiled: June 15, 2018Date of Patent: December 29, 2020Assignee: eBay Inc.Inventors: Wei Di, Vignesh Jagadeesh, Robinson Piramuthu, Elizabeth Churchill, Anurag Bhardwaj
-
Publication number: 20200382725Abstract: Techniques are disclosed for editing captured media to overcome operational difficulties that may arise during capture operations. According to these techniques, content may be captured with a pair of cameras, a first camera having a wider field of view than a second camera. Object(s) may be detected from captured content from the wider field of view camera. The captured content may be processed from the wider field of view camera in a location of at least one detected object. Typically, operators may attempt to frame content using content from the narrower field of view camera. As a result, operators may be unaware that desired content is captured using a second, wider field of view camera. Results from the processed wider field of view data may be proposed to operators for review and, if desired, retention.Type: ApplicationFiled: October 15, 2019Publication date: December 3, 2020Inventors: Shuang GAO, Vasilios E. ANTON, Robert A. BAILEY, Emilie KIM, Vignesh JAGADEESH, Paul SCHNEIDER, Piotr STANCZYK, Arwen BRADLEY, Jason KLIVINGTON, Jacques GASSELIN DE RICHEBOURG, Joe TRISCARI, Sébastien BEYSSERIE, Yang YANG, Afshin DEHGHAN, Rudolph VAN DER MERWE
-
Publication number: 20200380289Abstract: Various methods for utilizing a saliency heatmaps are described. The methods include obtaining image data corresponding to an image of a scene, obtaining a saliency heatmap for the image of the scene based on a saliency network, wherein the saliency heatmap indicates a likelihood of saliency for a corresponding portion of the scene, and manipulating the image data based on the saliency heatmap. In embodiments, the saliency heatmap may be produced using a trained machine learning model. The saliency heatmap may be used for various image processing tasks, such as determining which portion(s) of a scene to base an image capture device's autofocus, auto exposure, and/or white balance operations upon. According to some embodiments, one or more bounding boxes may be generated based on the saliency heatmap, e.g., using an optimization operation, which bounding box(es) may be used to assist or enhance the performance of various image processing tasks.Type: ApplicationFiled: April 14, 2020Publication date: December 3, 2020Inventors: Vignesh Jagadeesh, Yingjun Bai, Guillaume Tartavel, Gregory Guyomarc'h
-
Patent number: 10853407Abstract: A machine may be configured to execute a machine-learning process for identifying and understanding fine properties of various items of various types by using images and associated corresponding annotations, such as titles, captions, tags, keywords, or other textual information applied to these images. By use of a machine-learning process, the machine may perform property identification accurately and without human intervention. These item properties may be used as annotations for other images that have similar features. Accordingly, the machine may answer user-submitted questions, such as “What do rustic items look like?,” and items or images depicting items that are deemed to be rustic can be readily identified, classified, ranked, or any suitable combination thereof.Type: GrantFiled: May 29, 2014Date of Patent: December 1, 2020Assignee: eBay, Inc.Inventors: Anurag Bhardwaj, Robinson Piramuthu, Vicente Ordonez-Roman, Vignesh Jagadeesh, Wei Di
-
Publication number: 20200372408Abstract: A method includes receiving input data at a trained machine learning model that includes a common part and task-specific parts, receiving an execution instruction that identifies one or more processing tasks to be performed, processing the input data using the common part of the trained machine learning model to generate intermediate data, and processing the intermediate data using one or more of the task-specific parts of the trained machine learning model based on the execution instruction to generate one or more outputs.Type: ApplicationFiled: May 19, 2020Publication date: November 26, 2020Inventors: Francesco Rossi, Vignesh Jagadeesh, Vinay Sharma, Marco Zuliani, Xiaojin Shi, Benjamin Poulain
-
Publication number: 20200356227Abstract: In some implementations, a computing device may generate a day view, month views, and year view that show cards specific to each view. The cards include images, videos, and/or other assets from a media library that reflect a corresponding time frame of the card on which the assets are displayed. A selected view is presented in a graphical user interface (GUI) for interaction with a user of the media library. Upon selection of an asset displayed to the GUI, the view is switched to show more assets from a time frame similar to the selected asset while maintaining a focus on the selected asset.Type: ApplicationFiled: September 4, 2019Publication date: November 12, 2020Applicant: Apple Inc.Inventors: Eric Circlaeys, Guillaume Vergnaud, Samantha E. Fierro, Kevin Aujoulet, Benedikt M. Hirmer, Alexandre N. Lopoukhine, Kevin Bessiere, Vignesh Jagadeesh, Rohan Chandra
-
Patent number: 10528618Abstract: A configured machine performs image matching and retrieval of natural images that may depict logos. The machine generates and uses color-localized spatial masks, which may be computationally less expensive than spatial verification techniques. Key points are detected within images that form a reference database of images. Local masks are defined by the machine around each key point based on the scale and orientation of the key point. To utilize color information presented in logo images, ordered color histograms may be extracted by the machine from locally masked regions of each image. A cascaded index may then be constructed for both visual descriptors and color histograms. For faster matching, the cascaded index maps the visual descriptors and color histograms to a list of relevant or similar images. This list may then be ranked to generate relevant matches for an input query image.Type: GrantFiled: July 3, 2017Date of Patent: January 7, 2020Assignee: PAYPAL, INC.Inventors: Wei Di, Vignesh Jagadeesh, Robinson Piramuthu, Rohit Pandey, Anurag Bhardwaj
-
Publication number: 20200004836Abstract: A device implementing a system for expanded search includes a processor configured to identify plural words, and generate, for each word of the plural words, a word vector based on a proximity of the word relative to other words of the plural words, the word vector comprising plural dimensions. The processor is further configured to create a compressed word vector structure comprising clusters of subsets of the plural dimensions across the word vectors, each cluster including similar values of the respective dimensions, convert the word vectors to points on at least one plane, and partition the at least one plane into nested groupings of the points based on a threshold number of points per nested grouping. The processor is further configured to create a tree look-up structure of the nested groupings, and provide the compressed word vector structure and the tree look-up structure to a client device.Type: ApplicationFiled: September 28, 2018Publication date: January 2, 2020Inventors: Vivek Kumar RANGARAJAN SRIDHAR, Xingwen XU, Vignesh JAGADEESH
-
Patent number: 10489692Abstract: An apparatus and method to facilitate providing recommendations are disclosed herein. A networked system receives a query image, and performs image processing to extract a color histogram of an item depicted in the query image. The networked system identifies a dominant color of the item, whereby the dominant color is a color that is present on a most spatial area of the item relative to any other color of the item. The color histogram of the item is compared with a color histogram of an image of each of a plurality of available items, or the dominate color of the item is compared with a dominate color of the image of each of a plurality of available items. Based on the comparing, the networked system identifies item recommendations of the available items that closely match the item depicted in the query image, and the item recommendations are presented.Type: GrantFiled: July 27, 2017Date of Patent: November 26, 2019Assignee: eBay Inc.Inventors: Anurag Bhardwaj, Wei Di, Vignesh Jagadeesh, Robinson Piramuthu, Neelakantan Sundaresan