Patents by Inventor Doina Precup
Doina Precup has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240265264Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for controlling one or more computing devices to perform a task using a hierarchical agent. One of the methods includes receiving an observation characterizing a state of the one or more computing devices at the time step; selecting a gesture class for the time step using a high-level agent; processing a mid-level input using a mid-level agent neural network conditioned on the selected gesture class to generate a mid-level output that comprises parameters that define a gesture from the selected gesture class; processing a low-level input using a low-level agent neural network to generate a policy output that defines a sequence of one or more actions for interacting with the one or more computing devices; and performing the sequence of one or more actions to interact with the one or more computing devices.Type: ApplicationFiled: February 2, 2023Publication date: August 8, 2024Inventors: Gheorghe Tiberi Comanici, Amelia Marita Claudia Glaese, Anita Gergely, Zafarali Ahmed, Tyler Jackson, Doina Precup
-
Publication number: 20240031774Abstract: Device-free localization for smart indoor environments within an indoor area covered by wireless networks is detected using active off-the-shelf-devices would be beneficial in a wide range of applications. By exploiting existing wireless communication signals and machine learning techniques in order to automatically detect entrance into the area, and track the location of a moving subject within the sensing area a low cost robust long-term tracking system can be established. A machine learning component is established to minimize the need for user annotation and overcome temporal instabilities via a semi-supervised framework. After establishing a robust base learner mapping wireless signals to different physical locations from a small amount of labeled data; during its lifetime, the learner automatically re-trains when the uncertainty level rises significantly. Additionally, an automatic change-point detection process is employed setting a query for updating the outdated model and the decision boundaries.Type: ApplicationFiled: October 5, 2023Publication date: January 25, 2024Inventors: NEGAR GHOURCHIAN, MICHEL ALLEGUE MARTINEZ, DOINA PRECUP
-
Patent number: 11818629Abstract: Device-free localization for smart indoor environments within an indoor area covered by wireless networks is detected using active off-the-shelf-devices would be beneficial in a wide range of applications. By exploiting existing wireless communication signals and machine learning techniques in order to automatically detect entrance into the area, and track the location of a moving subject within the sensing area a low cost robust long-term tracking system can be established. A machine learning component is established to minimize the need for user annotation and overcome temporal instabilities via a semi-supervised framework. After establishing a robust base learner mapping wireless signals to different physical locations from a small amount of labeled data; during its lifetime, the learner automatically re-trains when the uncertainty level rises significantly. Additionally, an automatic change-point detection process is employed setting a query for updating the outdated model and the decision boundaries.Type: GrantFiled: October 29, 2021Date of Patent: November 14, 2023Assignee: Aerial TechnologiesInventors: Negar Ghourchian, Michel Allegue Martinez, Doina Precup
-
Publication number: 20220053295Abstract: Device-free localization for smart indoor environments within an indoor area covered by wireless networks is detected using active off-the-shelf-devices would be beneficial in a wide range of applications. By exploiting existing wireless communication signals and machine learning techniques in order to automatically detect entrance into the area, and track the location of a moving subject within the sensing area a low cost robust long-term tracking system can be established. A machine learning component is established to minimize the need for user annotation and overcome temporal instabilities via a semi-supervised framework. After establishing a robust base learner mapping wireless signals to different physical locations from a small amount of labeled data; during its lifetime, the learner automatically re-trains when the uncertainty level rises significantly. Additionally, an automatic change-point detection process is employed setting a query for updating the outdated model and the decision boundaries.Type: ApplicationFiled: October 29, 2021Publication date: February 17, 2022Inventors: NEGAR GHOURCHIAN, MICHEL ALLEGUE MARTINEZ, DOINA PRECUP
-
Patent number: 11212650Abstract: Device-free localization for smart indoor environments within an indoor area covered by wireless networks is detected using active off-the-shelf-devices would be beneficial in a wide range of applications. By exploiting existing wireless communication signals and machine learning techniques in order to automatically detect entrance into the area, and track the location of a moving subject within the sensing area a low cost robust long-term tracking system can be established. A machine learning component is established to minimize the need for user annotation and overcome temporal instabilities via a semi-supervised framework. After establishing a robust base learner mapping wireless signals to different physical locations from a small amount of labeled data; during its lifetime, the learner automatically re-trains when the uncertainty level rises significantly. Additionally, an automatic change-point detection process is employed setting a query for updating the outdated model and the decision boundaries.Type: GrantFiled: September 14, 2020Date of Patent: December 28, 2021Assignee: Aerial TechnologiesInventors: Negar Ghourchian, Michel Allegue Martinez, Doina Precup
-
Publication number: 20200413226Abstract: Device-free localization for smart indoor environments within an indoor area covered by wireless networks is detected using active off-the-shelf-devices would be beneficial in a wide range of applications. By exploiting existing wireless communication signals and machine learning techniques in order to automatically detect entrance into the area, and track the location of a moving subject within the sensing area a low cost robust long-term tracking system can be established. A machine learning component is established to minimize the need for user annotation and overcome temporal instabilities via a semi-supervised framework. After establishing a robust base learner mapping wireless signals to different physical locations from a small amount of labeled data; during its lifetime, the learner automatically re-trains when the uncertainty level rises significantly. Additionally, an automatic change-point detection process is employed setting a query for updating the outdated model and the decision boundaries.Type: ApplicationFiled: September 14, 2020Publication date: December 31, 2020Inventors: NEGAR GHOURCHIAN, MICHEL ALLEGUE MARTINEZ, DOINA PRECUP
-
Patent number: 10779127Abstract: Device-free localization for smart indoor environments within an indoor area covered by wireless networks is detected using active off-the-shelf-devices would be beneficial in a wide range of applications. By exploiting existing wireless communication signals and machine learning techniques in order to automatically detect entrance into the area, and track the location of a moving subject within the sensing area a low cost robust long-term tracking system can be established. A machine learning component is established to minimize the need for user annotation and overcome temporal instabilities via a semi-supervised framework. After establishing a robust base learner mapping wireless signals to different physical locations from a small amount of labeled data; during its lifetime, the learner automatically re-trains when the uncertainty level rises significantly. Additionally, an automatic change-point detection process is employed setting a query for updating the outdated model and the decision boundaries.Type: GrantFiled: November 21, 2017Date of Patent: September 15, 2020Assignee: Aerial TechnologiesInventors: Negar Ghourchian, Michel Allegue Martinez, Doina Precup
-
Publication number: 20190349715Abstract: Device-free localization for smart indoor environments within an indoor area covered by wireless networks is detected using active off-the-shelf-devices would be beneficial in a wide range of applications. By exploiting existing wireless communication signals and machine learning techniques in order to automatically detect entrance into the area, and track the location of a moving subject within the sensing area a low cost robust long-term tracking system can be established. A machine learning component is established to minimize the need for user annotation and overcome temporal instabilities via a semi-supervised framework. After establishing a robust base learner mapping wireless signals to different physical locations from a small amount of labeled data; during its lifetime, the learner automatically re-trains when the uncertainty level rises significantly. Additionally, an automatic change-point detection process is employed setting a query for updating the outdated model and the decision boundaries.Type: ApplicationFiled: November 21, 2017Publication date: November 14, 2019Inventors: NEGAR GHOURCHIAN, MICHEL ALLEGUE MARTINEZ, DOINA PRECUP
-
Patent number: 8935195Abstract: Portable wireless devices are ubiquitous in modern society and many of these have integral sensors such as accelerometers, microphones, and Global Positioning Systems (GPS) that can collect data. This creates potential for intelligent applications to recognize the user, or aspects of the user and take appropriate action. According to embodiments of the invention there are presented techniques for representing such time series data which reduce the memory and computational complexity of performing the analysis and classifying the results. The techniques exploit time-delay embedding is to reconstruct the state and dynamics of an unknown dynamical system, Geometric Template Matching to build nonparametric classifiers, and algorithms to address the problem of selecting segments of data from which to build the time-delay models for classification problems.Type: GrantFiled: May 11, 2011Date of Patent: January 13, 2015Assignee: The Royal Institution for the Advancement of Learning/McGill UniversityInventors: Doina Precup, Jordan Frank, Shie Mannor
-
Publication number: 20110282828Abstract: Portable wireless devices are ubiquitous in modern society and many of these have integral sensors such as accelerometers, microphones, and Global Positioning Systems (GPS) that can collect data. This creates potential for intelligent applications to recognize the user, or aspects of the user and take appropriate action. According to embodiments of the invention there are presented techniques for representing such time series data which reduce the memory and computational complexity of performing the analysis and classifying the results. The techniques exploit time-delay embedding is to reconstruct the state and dynamics of an unknown dynamical system, Geometric Template Matching to build nonparametric classifiers, and algorithms to address the problem of selecting segments of data from which to build the time-delay models for classification problems.Type: ApplicationFiled: May 11, 2011Publication date: November 17, 2011Applicant: The Royal Institution for the Advancement of Learning / McGill UniversityInventors: Doina Precup, Jordan Frank, Shie Mannor