Patents by Inventor Premkumar Natarajan

Premkumar Natarajan has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11978437
    Abstract: Devices and techniques are generally described for learning personalized concepts for natural language processing. In various examples, a first natural language input may be received. In some examples, a determination may be made that the first natural language input comprises non-actionable slot data. A dialog session may be initiated with the user. In some examples, first slot data that is indicated by the user during the dialog session may be determined. In various examples, data representing the first slot data may be stored in a database in association with the first natural language input.
    Type: Grant
    Filed: December 11, 2020
    Date of Patent: May 7, 2024
    Assignee: Amazon Technologies, Inc.
    Inventors: Govindarajan Sundaram Thattai, Qing Ping, Feiyang Niu, Joel Joseph Chengottusseriyil, Prashanth Rajagopal, Qiaozi Gao, Aishwarya Naresh Reganti, Gokhan Tur, Dilek Hakkani-Tur, Rohit Prasad, Premkumar Natarajan
  • Patent number: 11775617
    Abstract: Devices and techniques are generally described for class-agnostic object detection. In some examples, a first frame of image data comprising a first plurality of pixels may be received. First class-agnostic feature data representing the first plurality of pixels may be generated. A first object detection component may be used to determine that the first plurality of pixels corresponds to an arbitrary object represented in the first frame of image data based at least in part on the first class-agnostic feature data. Class-agnostic data indicating that the first plurality of pixels in the first frame of image data corresponds to the arbitrary object may be generated.
    Type: Grant
    Filed: March 15, 2021
    Date of Patent: October 3, 2023
    Assignee: AMAZON TECHNOLOGIES, INC.
    Inventors: Ayush Jaiswal, Yue Wu, Pradeep Natarajan, Premkumar Natarajan
  • Patent number: 11574637
    Abstract: Techniques for using a federated learning framework to update machine learning models for spoken language understanding (SLU) system are described. The system determines which labeled data is needed to update the models based on the models generating an undesired response to an input. The system identifies users to solicit labeled data from, and sends a request to a user device to speak an input. The device generates labeled data using the spoken input, and updates the on-device models using the spoken input and the labeled data. The updated model data is provided to the system to enable the system to update the system-level (global) models.
    Type: Grant
    Filed: September 8, 2020
    Date of Patent: February 7, 2023
    Assignee: Amazon Technologies, Inc.
    Inventors: Anoop Kumar, Anil K Ramakrishna, Sriram Venkatapathy, Rahul Gupta, Sankaranarayanan Ananthakrishnan, Premkumar Natarajan
  • Publication number: 20220093093
    Abstract: A system can operate a speech-controlled device in a mode where the speech-controlled device determines that an utterance is directed at the speech-controlled device using image data showing the user speaking the utterance. If the user is directing the user's gaze at the speech-controlled device while speaking, the system may determine the utterance is system directed and thus may perform further speech processing based on the utterance. If the user's gaze is directed elsewhere, the system may determine the utterance is not system directed (for example directed at another user) and thus the system may not perform further speech processing based on the utterance and may take other actions, for example discarding audio data of the utterance.
    Type: Application
    Filed: December 4, 2020
    Publication date: March 24, 2022
    Inventors: Prakash Krishnan, Arindam Mandal, Nikko Strom, Pradeep Natarajan, Ariya Rastrow, Shiv Naga Prasad Vitaladevuni, David Chi-Wai Tang, Aaron Challenner, Xu Zhang, Krishna Anisetty, Josey Diego Sandoval, Rohit Prasad, Premkumar Natarajan
  • Patent number: 10223598
    Abstract: In a method and system for generating vehicle image data, and to improve the generation of vehicle image data, 2D object information having at least 2D object data and object location data of one or more objects, perspective vehicle image data, and vehicle image location data for at least a portion of said vehicle image data are obtained. The object location data is compared with said vehicle image location data; and in case said object location data corresponds to said image location data, said 2D object data is correlated with said perspective vehicle image data using the object location data and the vehicle image location data to obtain a segmented vehicle image dataset.
    Type: Grant
    Filed: February 20, 2017
    Date of Patent: March 5, 2019
    Assignees: VOLKSWAGEN AKTIENGESELLSCHAFT, AUDI AG, DR. ING. H.C.F. PORSCHE AG
    Inventors: Somudro Gupta, Martin Hempel, Premkumar Natarajan, Muneeb Saleem
  • Patent number: 10152638
    Abstract: An in-vehicle system for identifying exit-only lanes and shared exit lanes on a roadway having a first camera for obtaining image data regarding lane markings on the roadway, a second camera for obtaining image data regarding exit signs, a lane marking detection module for detecting lane markings on the roadway, an exit sign detection module for detecting exit signs, and an exit sign analyzer for detecting arrows on the detected exit signs. The in-vehicle system categorizes detected lane markings as one of standard frequency dashed lane markings, high frequency dashed lane markings, and solid lane markings, and identifies an exit-only lane and a shared exit lane in response to the categorizations of the detected lane markings and characteristics of the detected arrows.
    Type: Grant
    Filed: June 20, 2018
    Date of Patent: December 11, 2018
    Assignees: Volkswagen AG, Audi AG
    Inventors: Kaushik Raghu, Mohammadhossein Daraei, Premkumar Natarajan, Norman Lopez
  • Publication number: 20180300559
    Abstract: An in-vehicle system for identifying exit-only lanes and shared exit lanes on a roadway having a first camera for obtaining image data regarding lane markings on the roadway, a second camera for obtaining image data regarding exit signs, a lane marking detection module for detecting lane markings on the roadway, an exit sign detection module for detecting exit signs, and an exit sign analyzer for detecting arrows on the detected exit signs. The in-vehicle system categorizes detected lane markings as one of standard frequency dashed lane markings, high frequency dashed lane markings, and solid lane markings, and identifies an exit-only lane and a shared exit lane in response to the categorizations of the detected lane markings and characteristics of the detected arrows.
    Type: Application
    Filed: June 20, 2018
    Publication date: October 18, 2018
    Inventors: Kaushik RAGHU, Mohammadhossein DARAEI, Premkumar NATARAJAN, Norman LOPEZ
  • Publication number: 20180239968
    Abstract: In a method and system for generating vehicle image data, and to improve the generation of vehicle image data, 2D object information having at least 2D object data and object location data of one or more objects, perspective vehicle image data, and vehicle image location data for at least a portion of said vehicle image data are obtained. The object location data is compared with said vehicle image location data; and in case said object location data corresponds to said image location data, said 2D object data is correlated with said perspective vehicle image data using the object location data and the vehicle image location data to obtain a segmented vehicle image dataset.
    Type: Application
    Filed: February 20, 2017
    Publication date: August 23, 2018
    Inventors: Somudro Gupta, Martin Hempel, Premkumar Natarajan, Muneeb Saleem
  • Patent number: 10025996
    Abstract: An in-vehicle system for identifying exit-only lanes and shared exit lanes on a roadway having a first camera for obtaining image data regarding lane markings on the roadway, a second camera for obtaining image data regarding exit signs, a lane marking detection module for detecting lane markings on the roadway, an exit sign detection module for detecting exit signs, and an exit sign analyzer for detecting arrows on the detected exit signs. The in-vehicle system categorizes detected lane markings as one of standard frequency dashed lane markings, high frequency dashed lane markings, and solid lane markings, and identifies an exit-only lane and a shared exit lane in response to the categorizations of the detected lane markings and characteristics of the detected arrows.
    Type: Grant
    Filed: December 22, 2014
    Date of Patent: July 17, 2018
    Assignees: Volkswagen AG, Audi AG
    Inventors: Kaushik Raghu, Mohammadhossein Daraei, Premkumar Natarajan, Norman Lopez
  • Patent number: 9701241
    Abstract: A system and method for early detection of turning intent and automatic actuation of a turn signal in a vehicle is provided. The system has an image recognition system and turn determination unit for identifying turn predictors and processing them to determine if a turn is about to happen. In response, a corresponding turn signal is automatically initiated for a predetermined period of time, and further vehicle systems can be updated.
    Type: Grant
    Filed: September 17, 2015
    Date of Patent: July 11, 2017
    Assignee: Volkswagen AG and Audi AG
    Inventors: Kaushik Raghu, Premkumar Natarajan
  • Publication number: 20170080853
    Abstract: A system and method for early detection of turning intent and automatic actuation of a turn signal in a vehicle is provided. The system has an image recognition system and turn determination unit for identifying turn predictors and processing them to determine if a turn is about to happen. In response, a corresponding turn signal is automatically initiated for a predetermined period of time, and further vehicle systems can be updated.
    Type: Application
    Filed: September 17, 2015
    Publication date: March 23, 2017
    Inventors: Kaushik RAGHU, Premkumar NATARAJAN
  • Patent number: 9470537
    Abstract: An in-vehicle system for determining whether a vehicle has moved off of a main roadway and into an exit lane. A navigation unit determines that an exit is approaching on a first side of the vehicle, and a camera obtains image data regarding lane markings and exit signs in response to a notification that the exit is approaching. An image processor identifies predetermined patterns among the lane markings, including V-shaped patterns or Y-shaped patterns. The system determines that the vehicle has moved into the exit lane in response to an identification of one of the predetermined patterns on a second side of the vehicle opposite the first side of the vehicle. The system may verify its determination based on recognition of an exit sign on the second side of the vehicle.
    Type: Grant
    Filed: October 22, 2014
    Date of Patent: October 18, 2016
    Assignees: Volkswagen AG, Audi AG
    Inventors: Kaushik Raghu, Premkumar Natarajan, Lorenz Laubinger
  • Publication number: 20160176341
    Abstract: An in-vehicle system for identifying exit-only lanes and shared exit lanes on a roadway having a first camera for obtaining image data regarding lane markings on the roadway, a second camera for obtaining image data regarding exit signs, a lane marking detection module for detecting lane markings on the roadway, an exit sign detection module for detecting exit signs, and an exit sign analyzer for detecting arrows on the detected exit signs. The in-vehicle system categorizes detected lane markings as one of standard frequency dashed lane markings, high frequency dashed lane markings, and solid lane markings, and identifies an exit-only lane and a shared exit lane in response to the categorizations of the detected lane markings and characteristics of the detected arrows.
    Type: Application
    Filed: December 22, 2014
    Publication date: June 23, 2016
    Inventors: Kaushik RAGHU, Mohammadhossein DARAEI, Premkumar NATARAJAN, Norman LOPEZ
  • Patent number: 9330332
    Abstract: An approach to computation of kernel descriptors is accelerated using precomputed tables. In one aspect, a fast algorithm for kernel descriptor computation that takes O(1) operations per pixel in each patch, based on pre-computed kernel values. This speeds up the kernel descriptor features under consideration, to levels that are comparable with D-SIFT and color SIFT, and two orders of magnitude faster than STIP and HoG3D. In some examples, kernel descriptors are applied to extract gradient, flow and texture based features for video analysis. In tests of the approach on a large database of internet videos used in the TRECVID MED 2011 evaluations, the flow based kernel descriptors are up to two orders of magnitude faster than STIP and HoG3D, and also produce significant performance improvements. Further, using features from multiple color planes produces small but consistent gains.
    Type: Grant
    Filed: October 4, 2013
    Date of Patent: May 3, 2016
    Assignee: Raytheon BBN Technologies Corp.
    Inventors: Pradeep Natarajan, Shuang Wu, Rohit Prasad, Premkumar Natarajan
  • Publication number: 20160116294
    Abstract: An in-vehicle system for determining whether a vehicle has moved off of a main roadway and into an exit lane. A navigation unit determines that an exit is approaching on a first side of the vehicle, and a camera obtains image data regarding lane markings and exit signs in response to a notification that the exit is approaching. An image processor identifies predetermined patterns among the lane markings, including V-shaped patterns or Y-shaped patterns. The system determines that the vehicle has moved into the exit lane in response to an identification of one of the predetermined patterns on a second side of the vehicle opposite the first side of the vehicle. The system may verify its determination based on recognition of an exit sign on the second side of the vehicle.
    Type: Application
    Filed: October 22, 2014
    Publication date: April 28, 2016
    Inventors: Kaushik RAGHU, Premkumar NATARAJAN, Lorenz LAUBINGER
  • Patent number: 9224207
    Abstract: An approach to segmentation or clustering of a set of elements combines separate procedures and uses training data for those procedures on labeled data. This approach is applied to elements being components of an image of text (e.g., printed or handwritten). In some examples, the elements are connected sets of pixels. In images of text, the clusters can correspond to individual lines. The approach provides improved clustering performance as compared to any one of the procedures taken alone.
    Type: Grant
    Filed: September 17, 2013
    Date of Patent: December 29, 2015
    Assignee: RAYTHEON BBN TECHNOLOGIES CORP.
    Inventors: Shiv N. Vitaladevuni, Rohit Prasad, Premkumar Natarajan
  • Patent number: 8953892
    Abstract: A computationally efficient approach to determining inner products between feature vectors is provided that eliminates or reduces the need for multiplication, and more specifically, provides an efficient and accurate basis selection for techniques such as Orthogonal Matching Pursuit.
    Type: Grant
    Filed: November 5, 2012
    Date of Patent: February 10, 2015
    Assignee: Raytheon BBN Technologies Corp.
    Inventors: Shiv N. Vitaladevuni, Pradeep Natarajan, Rohit Prasad, Premkumar Natarajan
  • Patent number: 8861872
    Abstract: Distributional information for a set of ? vectors is determined using a sparse basis selection approach to representing an input image or video. In some examples, this distributional information is used for a classification task.
    Type: Grant
    Filed: November 5, 2012
    Date of Patent: October 14, 2014
    Assignee: Raytheon BBN Technologies Corp.
    Inventors: Shiv N. Vitaladevuni, Pradeep Natarajan, Rohit Prasad, Premkumar Natarajan
  • Publication number: 20140126817
    Abstract: Distributional information for a set of ? vectors is determined using a sparse basis selection approach to representing an input image or video. In some examples, this distributional information is used for a classification task.
    Type: Application
    Filed: November 5, 2012
    Publication date: May 8, 2014
    Applicant: Raytheon BBN Technologies Corp.
    Inventors: Shiv N. Vitaladevuni, Pradeep Natarajan, Rohit Prasad, Premkumar Natarajan
  • Publication number: 20140126824
    Abstract: A computationally efficient approach to determining inner products between feature vectors is provided that eliminates or reduces the need for multiplication, and more specifically, provides an efficient and accurate basis selection for techniques such as Orthogonal Matching Pursuit.
    Type: Application
    Filed: November 5, 2012
    Publication date: May 8, 2014
    Applicant: Raytheon BBN Technologies Corp.
    Inventors: Shiv N. Vitaladevuni, Pradeep Natarajan, Rohit Prasad, Premkumar Natarajan