Patents by Inventor Karl Berntorp

Karl Berntorp has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11977374
    Abstract: A system for controlling an operation of a machine for performing a task is disclosed. The system submits a sequence of control inputs to the machine and receives a feedback signal. The system further determines, at each control step, a current control input for controlling the machine based on the feedback signal including a current measurement of a current state of the system by applying a control policy transforming the current measurement into the current control input based on current values of control parameters in a set of control parameters of a feedback controller. Furthermore, the system may iteratively update a state of the feedback controller defined by the control parameters using a prediction model predicting values of the control parameters and a measurement model updating the predicted values to produce the current values of the control parameters that explain the sequence of measurements according to a performance objective.
    Type: Grant
    Filed: August 16, 2021
    Date of Patent: May 7, 2024
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Marcel Menner, Karl Berntorp, Stefano Di Cairano
  • Patent number: 11947022
    Abstract: A server jointly tracks states of multiple vehicles using measurements of satellite signals received at each vehicle and parameters of the probabilistic distribution of the state of each vehicle. The server fuse states and measurements into an augmented state of the multiple vehicles and an augmented measurement of the augmented state subject to augmented measurement noise defined by a non-diagonal covariance matrix with non-zero off-diagonal elements, each non-zero off-diagonal elements relating errors in the measurements of a pair of corresponding vehicles. The server executes a probabilistic filter updating the augmented state and fuses the state of at least some of the multiple vehicles with a corresponding portion of the updated augmented state.
    Type: Grant
    Filed: March 30, 2021
    Date of Patent: April 2, 2024
    Assignee: Mitsubishi Electric Research Laboratories, Inc
    Inventors: Karl Berntorp, Marcus Greiff, Stefano Di Cairano, Kyeong Jin Kim
  • Patent number: 11932262
    Abstract: Stochastic nonlinear model predictive control (SNMPC) allows to directly take uncertainty of the dynamics and/or of the system's environment into account, e.g., by including probabilistic chance constraints. However, SNMPC requires the approximate computation of the probability distributions for the state variables that are propagated through the nonlinear system dynamics. This invention proposes the use of Gaussian-assumed density filters (ADF) to perform high-accuracy propagation of mean and covariance information of the state variables through the nonlinear system dynamics, resulting in a tractable SNMPC approach with improved control performance. In addition, the use of a matrix factorization for the covariance matrix variables in the constrained optimal control problem (OCP) formulation guarantees positive definiteness of the full trajectory of covariance matrices in each iteration of any optimization algorithm.
    Type: Grant
    Filed: July 1, 2021
    Date of Patent: March 19, 2024
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Rien Quirynen, Karl Berntorp
  • Publication number: 20240077622
    Abstract: Embodiments of the present disclosure disclose a method and a system for tracking the position of the one or more moving objects. The method includes collecting GNSS measurement data of satellite signals transmitted from multiple satellites. The method further includes extracting values of a plurality of features from the GNSS measurement data. The method includes mapping the extracted values of the plurality of features to a source domain. The method includes classifying the mapped transformed plurality of features using a neural network. The neural network is trained over simulated data sampled from a source domain. The method includes identifying multipath measurements of the GNSS measurement data based on classification of the corresponding mapped transformed plurality of features. The method includes tracking the position of the one or more moving objects by processing identification of GNSS measurement data affected by multipath.
    Type: Application
    Filed: September 6, 2022
    Publication date: March 7, 2024
    Inventors: Kyeong-Jin Kim, Remy Zawislak, Karl Berntorp, Marcus Greiff, Stefano Di Cairano, Kieran Parsons, Philip Orlik
  • Publication number: 20240069508
    Abstract: The present disclosure provides a feedback controller and method for controlling an operation of a device at different control steps. The feedback controller comprises at least one processor, and the memory having instructions stored thereon that, when executed by the at least one processor, causes the feedback controller, for a control step, to collect a measurement indicative of a state of the device at the control step, and execute, recursively until a termination condition is met, a probabilistic solver parameterized on a control input to an actuator operating the device to produce a control input for the control step. The feedback controller is further configured to control the actuator operating the device based on the produced control input.
    Type: Application
    Filed: August 12, 2022
    Publication date: February 29, 2024
    Inventors: Marcel Menner, Stefano Di Cairano, Karl Berntorp, Ankush Chakrabarty
  • Patent number: 11914023
    Abstract: A tracking system for tracking an expanded state of an object is provided. The tracking system comprises at least one processor and a memory having instructions stored thereon that, when executed by the at least one processor, cause the tracking system to execute a probabilistic filter that iteratively tracks a belief on the expanded state of the object, wherein the belief is predicted using a motion model of the object and is further updated using a compound measurement model of the object. The compound measurement model includes multiple probabilistic distributions constrained to lie on a contour of the object with a predetermined relative geometrical mapping to the center of the object. Further, the tracking system tracks the expanded state of the object based on the updated belief on the expanded state.
    Type: Grant
    Filed: May 5, 2021
    Date of Patent: February 27, 2024
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Pu Wang, Gang Yao, Hassan Mansour, Karl Berntorp, Petros Boufounos, Philip Orlik
  • Patent number: 11885894
    Abstract: A system jointly estimates states of GNSS receivers moving in a region using measurements of a Global Navigation Satellite System (GNSS). The system clusters the GNSS receivers into different clusters subject to a constraint on an upper bound on each cluster and executes a set of probabilistic filters corresponding to the set of clusters to estimate the states of GNSS receivers in each cluster. Each probabilistic filter estimates the states of the GNSS receivers in a corresponding cluster by fusing the GNSS data collected from the GNSS receivers in the cluster to jointly reduce an estimation error of each of the GNSS receivers in the cluster. The DES updates the cluster assignments based on a measure of estimation error in the states of different GNSS receivers in different clusters.
    Type: Grant
    Filed: July 21, 2022
    Date of Patent: January 30, 2024
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Marcus Greiff, Karl Berntorp, Stefano Di Cairano
  • Patent number: 11879964
    Abstract: A system and a method for tracking an expanded state of an object including a kinematic state indicative of a position of the object and an extended state indicative of one or combination of a dimension and an orientation of the object is provided herein. The system comprises at least one sensor configured to probe a scene including a moving object with one or multiple signal transmissions to produce one or multiple measurements of the object per the transmission, and a processor configured to execute a probabilistic filter tracking a joint probability of the expanded state of the object estimated by a motion model of the object and a measurement model of the object, wherein the measurement model includes a center-truncated distribution having predetermined truncation intervals. The system further comprises an output interface configured to output the expanded state of the object.
    Type: Grant
    Filed: July 27, 2020
    Date of Patent: January 23, 2024
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Pu Wang, Karl Berntorp, Yuxuan Xia, Hassan Mansour, Petros Boufounos, Philip Orlik
  • Publication number: 20240004088
    Abstract: A system jointly estimates states of GNSS receivers moving in a region using measurements of a Global Navigation Satellite System (GNSS). The system clusters the GNSS receivers into different clusters subject to a constraint on an upper bound on each cluster and executes a set of probabilistic filters corresponding to the set of clusters to estimate the states of GNSS receivers in each cluster. Each probabilistic filter estimates the states of the GNSS receivers in a corresponding cluster by fusing the GNSS data collected from the GNSS receivers in the cluster to jointly reduce an estimation error of each of the GNSS receivers in the cluster. The DES updates the cluster assignments based on a measure of estimation error in the states of different GNSS receivers in different clusters.
    Type: Application
    Filed: July 21, 2022
    Publication date: January 4, 2024
    Inventors: Marcus Greiff, Karl Berntorp, Stefano Di Cairano
  • Publication number: 20240004085
    Abstract: The present disclosure discloses a system and a method for controlling a device using a compound probabilistic filter. The method comprises collecting a sequence of measurements indicative of the state of the device at different control steps. Further, the method comprises executing iteratively a compound probabilistic filter configured to track the state of the device at each of the different control steps using the sequence of measurements to produce a sequence of states of the device corresponding to the sequence of measurements. Furthermore, the method comprises controlling the device using the tracked state of the device.
    Type: Application
    Filed: October 13, 2022
    Publication date: January 4, 2024
    Inventors: Karl Berntorp, Marcus Greiff, Stefano Di Cairano
  • Publication number: 20230305136
    Abstract: The present disclosure provides a system and a method for detecting and tracking objects. The method includes permuting an order of frames in a sequence of radar image frames to produce multiple permuted sequences with different frames at a dominant position in a corresponding permuted sequence of radar image frames. Each permuted sequence of radar image frames is processed with a first neural network to produce temporally enhanced features for each of the frames in the sequence of radar image frames. Further a feature map is reconstructed from the temporally enhanced features of each of the frames in the sequence of radar image frames to produce a sequence of feature maps. The method further includes processing a list of feature vectors from each feature map with a second neural network to produce temporally enhanced heatmaps.
    Type: Application
    Filed: March 25, 2022
    Publication date: September 28, 2023
    Inventors: Pu Wang, Peizhao Li, Karl Berntorp
  • Publication number: 20230300774
    Abstract: A hybrid distributed estimation system (DES) jointly tracks states of a plurality of moving devices configured to transmit measurements indicative of a state of a moving device and an estimation of the state of the moving device derived from the measurements. The hybrid DES selects between the measurements and the estimations, and based on this selection activates different types of DESs configures to jointly track the states of the moving devices using different types of information. Next, the hybrid DES tracks the states using the activated DES allowing track the state by different DES at different instances of time.
    Type: Application
    Filed: March 18, 2022
    Publication date: September 21, 2023
    Inventors: Karl Berntorp, Marcus Greiff
  • Publication number: 20230288886
    Abstract: A probabilistic feedback controller for controlling an operation of a robotic system using a probabilistic filter subject to a structural constraint on an operation of the robotic system is configured to execute a probabilistic filter estimates a distribution of a current state of the robotic system given a previous state of the robotic system based on a motion model of the robotic system perturbed by stochastic process noise and a measurement model of the robotic system perturbed by stochastic measurement noise having an uncertainty modeled as a time-varying Gaussian process represented as a weighted combination of time-varying basis functions with weights defined by corresponding Gaussian distributions. The probabilistic filter recursively updates both the distribution of the current state of the robotic system and the Gaussian distributions of the weights of the basis functions selected to satisfy the structural constraint indicated by measurements of the state of a robotic system.
    Type: Application
    Filed: March 12, 2022
    Publication date: September 14, 2023
    Applicant: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Karl Berntorp, Marcel Menner
  • Patent number: 11753023
    Abstract: A control system controls a vehicle using a probabilistic motion planner and an adaptive predictive controller. The probabilistic motion planner produces a sequence of parametric probability distributions over a sequence of target states for the vehicle with parameters defining a first and higher order moments. The adaptive predictive controller optimizes a cost function over a prediction horizon to produce a sequence of control commands to one or multiple actuators of the vehicle. The cost function balances a cost of tracking of different state variables in the sequence of the target states defined by the first moments. The balancing is performed by weighting different state variables using one or multiple of the higher order moments of the probability distribution.
    Type: Grant
    Filed: January 19, 2020
    Date of Patent: September 12, 2023
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Rien Quirynen, Karl Berntorp, Stefano Di Cairano
  • Publication number: 20230264704
    Abstract: A vehicle includes an advanced driver-assistance system (ADAS) configured to intervene in an operation of the control system by complementing or overriding the driving input in response to detecting a driving condition dependent on a calibration parameter indicative of a preference of execution of the driving maneuver. The ADAS is calibrated based on a crowd-local distribution function of the calibration parameter indicative of a distribution of the preference of execution of the driving maneuver by other drivers of other vehicles at a specific location or a specific environment in response to detecting that the vehicle approaches the specific location or the specific environment.
    Type: Application
    Filed: February 22, 2022
    Publication date: August 24, 2023
    Applicant: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Marcel Menner, Stefano Di Cairano, Karl Berntorp, Ziyi Ma
  • Publication number: 20230269766
    Abstract: A computer-implemented method is provided for training a global machine learning model using a learning server and a set of vehicle agents connected to roadside units (RSUs). The method includes steps of selecting vehicle agents from a pool of the vehicle agents connected to the RSUs, associating the selected vehicle agents and the RSUs respectively based on distances from the selected vehicle agents to the RSUs configured to provide measurements of the distances to the learning server, and transmitting a global model, a selected agent set and deadline thresholds in each global training round to the RSUs configured to transmit the global model and training deadlines to the selected vehicle agents. The associated RSUs compute the training deadlines of the corresponding selected vehicle agents and the selected vehicle agents locally train the global model independently using the local datasets collected by the on-board sensors of the selected vehicle agents to generate locally trained models.
    Type: Application
    Filed: February 23, 2022
    Publication date: August 24, 2023
    Applicant: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Jianlin Guo, Ferdous Pervej, Kyeong-Jin Kim, Kieran Parsons, Philip Orlik, Stefano Di Cairano, Marcel Menner, Karl Berntorp
  • Patent number: 11698625
    Abstract: A stochastic model predictive controller (SMPC) estimates a current state of the system and a probability distribution of uncertainty of a parameter of dynamics of the system based on measurements of outputs of the system, and updates a control model of the system including a function of dynamics of the system modeling the uncertainty of the parameter with first and second order moments of the estimated probability distribution of uncertainty of the parameter. The SMPC determines a control input to control the system by optimizing the updated control model of the system at the current state over a prediction horizon and controls the system based on the control input to change the state of the system.
    Type: Grant
    Filed: December 10, 2020
    Date of Patent: July 11, 2023
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Karl Berntorp, Rien Quirynen, Sean Vaskov
  • Patent number: 11679759
    Abstract: A vehicle dynamics control system receives a feedback state signal including values of a roll rate and a roll angle of the motion of the vehicle and updates parameters of a model of roll dynamics of the vehicle by fitting the received values into the roll dynamics model. The roll dynamics model explains the evolution of the roll rate and the roll angle based on the parameters including a center of gravity (CoG) parameter modeling a location of a CoG of the vehicle, and a spring constant and a damping coefficient modeling suspension dynamics of the vehicle. The system determines a control command for controlling at least one actuator of the vehicle using a motion model including the updated CoG parameter and submits the control command to the vehicle controller to control the motion of the vehicle.
    Type: Grant
    Filed: January 27, 2021
    Date of Patent: June 20, 2023
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Karl Berntorp, Ankush Chakrabarty, Stefano Di Cairano
  • Patent number: 11644579
    Abstract: A probabilistic system for tracking a state of a vehicle using unsynchronized cooperation of information includes a probabilistic multi-head measurement model relating incoming measurements with the state of the vehicle. The first head of the model relates measurements of the satellite signals subject to measurement noise with a belief on the state of the vehicle, and a second head relates an estimation of the state of the vehicle subject to estimation noise with the belief on the state of the vehicle. A probabilistic filter of the system updates recursively the belief on the state of the vehicle based on the multi-head measurement model accepting one or a combination of the measurements of the satellite signals subject to the measurement noise and the estimation of the state of the vehicle subject to the estimation noise.
    Type: Grant
    Filed: March 30, 2021
    Date of Patent: May 9, 2023
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Karl Berntorp, Marcus Greiff, Stefano Di Cairano, Kyeong Jin Kim
  • Publication number: 20230135987
    Abstract: A tracking system for tracking an expanded state of an object is provided. The tracking system executes, for a predetermined time period, a probabilistic filter that iteratively tracks a belief on the expanded state of the object, wherein the belief is predicted using a motion model of the object and is further updated using a compound measurement model of the object. After the predetermined time period, the updated beliefs are smoothed to generate a state-decoupled online batch of training data. The compound measurement model includes multiple probabilistic distributions constrained to lie around a contour of the object with a predetermined relative geometrical mapping to the center of the object. The compound measurement model is updated using the online batch of training data. Further, the tracking system tracks the expanded state of the object based on the updated compound measurement model.
    Type: Application
    Filed: October 28, 2021
    Publication date: May 4, 2023
    Applicant: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Pu Wang, Gang Yao, Karl Berntorp, Hassan Mansour, Petros Boufounos, Philip Orlik