Patents by Inventor Doina Precup

Doina Precup has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240265264
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for controlling one or more computing devices to perform a task using a hierarchical agent. One of the methods includes receiving an observation characterizing a state of the one or more computing devices at the time step; selecting a gesture class for the time step using a high-level agent; processing a mid-level input using a mid-level agent neural network conditioned on the selected gesture class to generate a mid-level output that comprises parameters that define a gesture from the selected gesture class; processing a low-level input using a low-level agent neural network to generate a policy output that defines a sequence of one or more actions for interacting with the one or more computing devices; and performing the sequence of one or more actions to interact with the one or more computing devices.
    Type: Application
    Filed: February 2, 2023
    Publication date: August 8, 2024
    Inventors: Gheorghe Tiberi Comanici, Amelia Marita Claudia Glaese, Anita Gergely, Zafarali Ahmed, Tyler Jackson, Doina Precup
  • Publication number: 20240031774
    Abstract: Device-free localization for smart indoor environments within an indoor area covered by wireless networks is detected using active off-the-shelf-devices would be beneficial in a wide range of applications. By exploiting existing wireless communication signals and machine learning techniques in order to automatically detect entrance into the area, and track the location of a moving subject within the sensing area a low cost robust long-term tracking system can be established. A machine learning component is established to minimize the need for user annotation and overcome temporal instabilities via a semi-supervised framework. After establishing a robust base learner mapping wireless signals to different physical locations from a small amount of labeled data; during its lifetime, the learner automatically re-trains when the uncertainty level rises significantly. Additionally, an automatic change-point detection process is employed setting a query for updating the outdated model and the decision boundaries.
    Type: Application
    Filed: October 5, 2023
    Publication date: January 25, 2024
    Inventors: NEGAR GHOURCHIAN, MICHEL ALLEGUE MARTINEZ, DOINA PRECUP
  • Patent number: 11818629
    Abstract: Device-free localization for smart indoor environments within an indoor area covered by wireless networks is detected using active off-the-shelf-devices would be beneficial in a wide range of applications. By exploiting existing wireless communication signals and machine learning techniques in order to automatically detect entrance into the area, and track the location of a moving subject within the sensing area a low cost robust long-term tracking system can be established. A machine learning component is established to minimize the need for user annotation and overcome temporal instabilities via a semi-supervised framework. After establishing a robust base learner mapping wireless signals to different physical locations from a small amount of labeled data; during its lifetime, the learner automatically re-trains when the uncertainty level rises significantly. Additionally, an automatic change-point detection process is employed setting a query for updating the outdated model and the decision boundaries.
    Type: Grant
    Filed: October 29, 2021
    Date of Patent: November 14, 2023
    Assignee: Aerial Technologies
    Inventors: Negar Ghourchian, Michel Allegue Martinez, Doina Precup
  • Publication number: 20220053295
    Abstract: Device-free localization for smart indoor environments within an indoor area covered by wireless networks is detected using active off-the-shelf-devices would be beneficial in a wide range of applications. By exploiting existing wireless communication signals and machine learning techniques in order to automatically detect entrance into the area, and track the location of a moving subject within the sensing area a low cost robust long-term tracking system can be established. A machine learning component is established to minimize the need for user annotation and overcome temporal instabilities via a semi-supervised framework. After establishing a robust base learner mapping wireless signals to different physical locations from a small amount of labeled data; during its lifetime, the learner automatically re-trains when the uncertainty level rises significantly. Additionally, an automatic change-point detection process is employed setting a query for updating the outdated model and the decision boundaries.
    Type: Application
    Filed: October 29, 2021
    Publication date: February 17, 2022
    Inventors: NEGAR GHOURCHIAN, MICHEL ALLEGUE MARTINEZ, DOINA PRECUP
  • Patent number: 11212650
    Abstract: Device-free localization for smart indoor environments within an indoor area covered by wireless networks is detected using active off-the-shelf-devices would be beneficial in a wide range of applications. By exploiting existing wireless communication signals and machine learning techniques in order to automatically detect entrance into the area, and track the location of a moving subject within the sensing area a low cost robust long-term tracking system can be established. A machine learning component is established to minimize the need for user annotation and overcome temporal instabilities via a semi-supervised framework. After establishing a robust base learner mapping wireless signals to different physical locations from a small amount of labeled data; during its lifetime, the learner automatically re-trains when the uncertainty level rises significantly. Additionally, an automatic change-point detection process is employed setting a query for updating the outdated model and the decision boundaries.
    Type: Grant
    Filed: September 14, 2020
    Date of Patent: December 28, 2021
    Assignee: Aerial Technologies
    Inventors: Negar Ghourchian, Michel Allegue Martinez, Doina Precup
  • Publication number: 20200413226
    Abstract: Device-free localization for smart indoor environments within an indoor area covered by wireless networks is detected using active off-the-shelf-devices would be beneficial in a wide range of applications. By exploiting existing wireless communication signals and machine learning techniques in order to automatically detect entrance into the area, and track the location of a moving subject within the sensing area a low cost robust long-term tracking system can be established. A machine learning component is established to minimize the need for user annotation and overcome temporal instabilities via a semi-supervised framework. After establishing a robust base learner mapping wireless signals to different physical locations from a small amount of labeled data; during its lifetime, the learner automatically re-trains when the uncertainty level rises significantly. Additionally, an automatic change-point detection process is employed setting a query for updating the outdated model and the decision boundaries.
    Type: Application
    Filed: September 14, 2020
    Publication date: December 31, 2020
    Inventors: NEGAR GHOURCHIAN, MICHEL ALLEGUE MARTINEZ, DOINA PRECUP
  • Patent number: 10779127
    Abstract: Device-free localization for smart indoor environments within an indoor area covered by wireless networks is detected using active off-the-shelf-devices would be beneficial in a wide range of applications. By exploiting existing wireless communication signals and machine learning techniques in order to automatically detect entrance into the area, and track the location of a moving subject within the sensing area a low cost robust long-term tracking system can be established. A machine learning component is established to minimize the need for user annotation and overcome temporal instabilities via a semi-supervised framework. After establishing a robust base learner mapping wireless signals to different physical locations from a small amount of labeled data; during its lifetime, the learner automatically re-trains when the uncertainty level rises significantly. Additionally, an automatic change-point detection process is employed setting a query for updating the outdated model and the decision boundaries.
    Type: Grant
    Filed: November 21, 2017
    Date of Patent: September 15, 2020
    Assignee: Aerial Technologies
    Inventors: Negar Ghourchian, Michel Allegue Martinez, Doina Precup
  • Publication number: 20190349715
    Abstract: Device-free localization for smart indoor environments within an indoor area covered by wireless networks is detected using active off-the-shelf-devices would be beneficial in a wide range of applications. By exploiting existing wireless communication signals and machine learning techniques in order to automatically detect entrance into the area, and track the location of a moving subject within the sensing area a low cost robust long-term tracking system can be established. A machine learning component is established to minimize the need for user annotation and overcome temporal instabilities via a semi-supervised framework. After establishing a robust base learner mapping wireless signals to different physical locations from a small amount of labeled data; during its lifetime, the learner automatically re-trains when the uncertainty level rises significantly. Additionally, an automatic change-point detection process is employed setting a query for updating the outdated model and the decision boundaries.
    Type: Application
    Filed: November 21, 2017
    Publication date: November 14, 2019
    Inventors: NEGAR GHOURCHIAN, MICHEL ALLEGUE MARTINEZ, DOINA PRECUP
  • Patent number: 8935195
    Abstract: Portable wireless devices are ubiquitous in modern society and many of these have integral sensors such as accelerometers, microphones, and Global Positioning Systems (GPS) that can collect data. This creates potential for intelligent applications to recognize the user, or aspects of the user and take appropriate action. According to embodiments of the invention there are presented techniques for representing such time series data which reduce the memory and computational complexity of performing the analysis and classifying the results. The techniques exploit time-delay embedding is to reconstruct the state and dynamics of an unknown dynamical system, Geometric Template Matching to build nonparametric classifiers, and algorithms to address the problem of selecting segments of data from which to build the time-delay models for classification problems.
    Type: Grant
    Filed: May 11, 2011
    Date of Patent: January 13, 2015
    Assignee: The Royal Institution for the Advancement of Learning/McGill University
    Inventors: Doina Precup, Jordan Frank, Shie Mannor
  • Publication number: 20110282828
    Abstract: Portable wireless devices are ubiquitous in modern society and many of these have integral sensors such as accelerometers, microphones, and Global Positioning Systems (GPS) that can collect data. This creates potential for intelligent applications to recognize the user, or aspects of the user and take appropriate action. According to embodiments of the invention there are presented techniques for representing such time series data which reduce the memory and computational complexity of performing the analysis and classifying the results. The techniques exploit time-delay embedding is to reconstruct the state and dynamics of an unknown dynamical system, Geometric Template Matching to build nonparametric classifiers, and algorithms to address the problem of selecting segments of data from which to build the time-delay models for classification problems.
    Type: Application
    Filed: May 11, 2011
    Publication date: November 17, 2011
    Applicant: The Royal Institution for the Advancement of Learning / McGill University
    Inventors: Doina Precup, Jordan Frank, Shie Mannor