Patents Assigned to Mitsubishi Electric Research Laboratories
  • Patent number: 11810552
    Abstract: The present disclosure provides an artificial intelligence (AI) system for sequence-to-sequence modeling with attention adapted for streaming applications. The AI system comprises at least one processor; and memory having instructions stored thereon that, when executed by the processor, cause the AI system to process each input frame in a sequence of input frames through layers of a deep neural network (DNN) to produce a sequence of outputs. At least some of the layers of the DNN include a dual self-attention module having a dual non-causal and causal architecture attending to non-causal frames and causal frames. Further, the AI system renders the sequence of outputs.
    Type: Grant
    Filed: July 2, 2021
    Date of Patent: November 7, 2023
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Niko Moritz, Takaaki Hori, Jonathan Le Roux
  • Patent number: 11794350
    Abstract: A controller is provided for interactive classification and recognition of an object in a scene using tactile feedback. The controller includes an interface configured to transmit and receive the control, sensor signals from a robot arm, gripper signals from a gripper attached to the robot arm, tactile signals from sensors attached to the gripper and at least one vision sensor, a memory module to store robot control programs, and a classifier and recognition model, and a processor to generate control signals based on the control program and a grasp pose on the object, configured to control the robot arm to grasp the object with the gripper.
    Type: Grant
    Filed: October 22, 2020
    Date of Patent: October 24, 2023
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Radu Ioan Corcodel, Siddarth Jain, Jeroen van Baar
  • Patent number: 11798574
    Abstract: A speech separation device (12) of a speech separation system includes a feature amount extraction unit (121) configured to extract time-series data of a speech feature amount of mixed speech, a block division unit (122) configured to divide the time-series data of the speech feature amount into blocks having a certain time width, a speech separation neural network (1b) configured to create time-series data of a mask of each of a plurality of speakers from the time-series data of the speech feature amount divided into blocks, and a speech restoration unit (123) configured to restore the speech data of each of the plurality of speakers from the time-series data of the mask and the time-series data of the speech feature amount of the mixed speech.
    Type: Grant
    Filed: January 12, 2021
    Date of Patent: October 24, 2023
    Assignees: MITSUBISHI ELECTRIC CORPORATION, MITSUBISHI ELECTRIC RESEARCH LABORATORIES, INC.
    Inventors: Ryo Aihara, Toshiyuki Hanazawa, Yohei Okato, Gordon P Wichern, Jonathan Le Roux
  • Publication number: 20230330853
    Abstract: The present disclosure provides a system and a method for controlling a motion of a robot from a starting point to a target point within a bounded space with a floorplan including one or multiple obstacles. The method includes solving for an electric potential in a bounded virtual space formed by scaling the floorplan of the bounded space with the one or multiple obstacles and applying charge to at least one bound of the bounded virtual space while treating the scaled obstacles as metallic surfaces with a constant potential value, wherein the electric potential provides multiple equipotential curves within the bounded virtual space. The method further includes selecting an equipotential curve with a potential value different from a potential value of an obstacle equipotential curve, determining a motion path based on the selected equipotential curve, and controlling the motion of the robot based on the determined motion path.
    Type: Application
    Filed: April 14, 2022
    Publication date: October 19, 2023
    Applicant: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Chungwei Lin, Yebin Wang, Rien Quirynen, Devesh Jha, Bingnan Wang, William Vetterling, Siddarth Jain, Scott Bortoff
  • Patent number: 11787569
    Abstract: A system for optimizing a low-thrust trajectory of a spacecraft trajectory for orbital transfer includes an interface to receive data, a memory to store scheduled geostationary transfer orbit (GTO) data and scheduled geostationary Earth orbit (GEO) data and computer-executable programs, and a processor.
    Type: Grant
    Filed: March 12, 2019
    Date of Patent: October 17, 2023
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Piyush Grover, Uros Kalabic, Avishai Weiss
  • Patent number: 11790247
    Abstract: A computer-implemented method is provided. The computer-implemented includes a data-driven model and a robust closure model stored in a memory by using a processor for controlling a system. The computer-implemented method includes steps of acquiring sensor signals from at least one sensor of the system via an interface, computing a state of the system based on the sensor signals, determining a gain of the robust closure model based on the state of the system, reproducing a state of the system based on the determined gain, estimating a physics-based model of the system by combining the data-driven model and the robust closure model, and generating control commands by mapping the state of the system using the estimated physics-based model.
    Type: Grant
    Filed: May 20, 2021
    Date of Patent: October 17, 2023
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Mouhacine Benosman, Saleh Nabi
  • Patent number: 11790930
    Abstract: A system and method for reverberation reduction is disclosed. A first Deep Neural Network (DNN) produces a first estimate of a target direct-path signal from a mixture of acoustic signals that include the target direct-path signal and a reverberation of the target direct-path signal. A filter modeling a room impulse response (RIR) for the first estimate is estimated. The filter when applied to the first estimate of the target direct-path signal generates a result closest to a residual between the mixture of the acoustic signals and the first estimate of the target direct-path signal according to a distance function. A mixture with reduced reverberation of the target direct-path signal is obtained by removing the result of applying the filter to the first estimate of the target direct-path signal from the received mixture. A second DNN produces a second estimate of the target direct-path signal from the mixture with reduced reverberation.
    Type: Grant
    Filed: March 10, 2022
    Date of Patent: October 17, 2023
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Zhong-Qiu Wang, Gordon Wichern, Jonathan Le Roux
  • Patent number: 11789142
    Abstract: A radar image processing device is provided for generating a radar image from a region of interest (ROI). The radar image processing device receives transmitted radar pulses and radar echoes reflected from the ROI at different positions along a path of a moving radar platform and stores computer-executable programs including a range compressor, a graph modeling generator, a signal aligner, a radar imaging generator and a focused image generator.
    Type: Grant
    Filed: June 11, 2020
    Date of Patent: October 17, 2023
    Assignee: MITSUBISHI ELECTRIC RESEARCH LABORATORIES INC.
    Inventors: Dehong Liu, Siheng Chen, Petros Boufounos
  • Patent number: 11788755
    Abstract: A control system for controlling a heating ventilation and air conditioning (HVAC) system, uses a thermal comfort model (TCM), an airflow dynamics model (ADM) and an HVAC model connecting thermal states at air vents with states of actuators of the HVAC system, for determining a target thermal state at the air vents connecting the HVAC system to an environment, such that the target thermal state at the air vents results in a thermal state at the location of an occupant according to the ADM connecting uneven distribution of thermal states at different locations in the environment. Further, the control system determines and submits control commands to one or multiple actuators of the HVAC system producing the target thermal state at the air vents.
    Type: Grant
    Filed: October 4, 2019
    Date of Patent: October 17, 2023
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Saleh Nabi, Emil Laftchiev, Piyush Grover
  • Publication number: 20230324859
    Abstract: A controller uses a motion trajectory for controlling a motion of a device to perform a task subject to constraints. The controller evaluates a parametric function to output predicted values for a set of discrete variables in a mixed-integer convex programming (MICP) problem for performing the task defined by the parameters. The controller fixes a first subset of discrete variables in the MICP to the predicted values outputted by the trained parametric function and updates at least some of the predicted values of a remaining subset of discrete variables to values are uniquely defined by the fixed values for the first subset of discrete variables and the constraints. Hence, the controller transforms the MICP into a convex programming (CP) problem, solves the CP problem subject to the constraints to produce a feasible motion trajectory, and controls the device according to the motion trajectory.
    Type: Application
    Filed: May 10, 2022
    Publication date: October 12, 2023
    Applicant: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Rien Quirynen, Ankush Chakrabarty, Stefano Di Cairano, Abhishek Cauligi
  • Patent number: 11782402
    Abstract: A device for controlling an operation of a system performing a task is disclosed. The device submits a sequence of control inputs to the system thereby changing states of the system according to the task and receives a feedback signal. The device determines a current control input for controlling the system based on the feedback signal including a current measurement of a current state of the system by solving a polynomial optimization of a polynomial function with a reformulation derived by introducing additional variables reducing a degree of the polynomial function till a target degree subject to constraints on a structure of the additional variables. The device solves a mixed-integer optimization problem to find an optimal solution among all possible encodings of factorizations of the polynomial function that reduces the degree of the polynomial function till the target degree with a minimum number of additional variables.
    Type: Grant
    Filed: July 2, 2021
    Date of Patent: October 10, 2023
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Arvind Raghunathan, Carlos Nohra
  • Patent number: 11767035
    Abstract: A control system for parking a vehicle uses a directed graph representing a traffic network within parking space to determine a coarse path subsequently refined to control the vehicle according to refined path. The directed graph includes waypoints connected by edges, a waypoint defines a position and an orientation, while edge defines a collision free path for the vehicle. The coarse path is selected as a shortest route of waypoints connecting an initial waypoint on the directed graph closest to the initial state of the vehicle with a target waypoint on the directed graph closest to the target state of the vehicle. The refined path is a path on a tree constructed to reduce a deviation of a cost of a motion defined by a refined path connecting the initial node with the target node of the tree from a cost of the coarse path defining the route of waypoints.
    Type: Grant
    Filed: September 4, 2020
    Date of Patent: September 26, 2023
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Yebin Wang, Siyu Dai
  • Publication number: 20230294283
    Abstract: A manipulation controller is provided for reorienting an object by a manipulator of a robotic system. The manipulation controller includes an interface controller configured to acquire measurement data from sensors arranged on the robotic system, at least one processor, and a memory configured to store a computer-implemented method.
    Type: Application
    Filed: March 18, 2022
    Publication date: September 21, 2023
    Applicant: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Devesh Jha, Yuki Shirai, Arvind Raghunathan, Diego Romeres
  • Publication number: 20230291196
    Abstract: Disclosed a method and system for fault location and protection of Microgrids which are operated under islanded mode by being disconnected from distribution systems under large disturbance or disaster scenarios. The disclosed method is invented to meet the protection needs for disconnected ungrounded microgrids without appropriate protection systems that are usually installed only at distribution substations. Moreover, the disclosed protection method or scheme is targeted at inverter-dominated microgrids in which fault current limiters are installed to protect inverters introduced by the increasing penetration of inverter-based distributed generators (IBDGs).
    Type: Application
    Filed: March 9, 2022
    Publication date: September 14, 2023
    Applicant: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Hongbo Sun, Fangyuan Chang
  • Publication number: 20230288481
    Abstract: A computer-implemented method is provided for detecting broken bar faults of an induction motor during operations. The method includes steps of injecting a frequency modulation continuous wave (FMCW) voltage signal to the voltage source to power the motor, acquiring, in a time domain, a signal of a stator current powering the induction motor via an interface, performing Fourier Transform (FT) on the stator current and the injected FMCW signal to get spectra of the stator current and the injected signal, computing cross correlation between the spectrum of injected signal and the spectrum of stator current, extracting a fault signature at frequency f=±2(1?s)f0 in the cross-correlation function, and detecting a broken-bar fault in the induction motor if the fault signature magnitude is greater than a threshold.
    Type: Application
    Filed: March 13, 2022
    Publication date: September 14, 2023
    Applicant: Mitsubishi Electric Research Laboratories, Inc.
    Inventor: Dehong Liu
  • Publication number: 20230288886
    Abstract: A probabilistic feedback controller for controlling an operation of a robotic system using a probabilistic filter subject to a structural constraint on an operation of the robotic system is configured to execute a probabilistic filter estimates a distribution of a current state of the robotic system given a previous state of the robotic system based on a motion model of the robotic system perturbed by stochastic process noise and a measurement model of the robotic system perturbed by stochastic measurement noise having an uncertainty modeled as a time-varying Gaussian process represented as a weighted combination of time-varying basis functions with weights defined by corresponding Gaussian distributions. The probabilistic filter recursively updates both the distribution of the current state of the robotic system and the Gaussian distributions of the weights of the basis functions selected to satisfy the structural constraint indicated by measurements of the state of a robotic system.
    Type: Application
    Filed: March 12, 2022
    Publication date: September 14, 2023
    Applicant: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Karl Berntorp, Marcel Menner
  • Publication number: 20230291294
    Abstract: A motor assembly comprising a mover assembly and a stator. The mover assembly comprising a plurality of mover assembly units, each unit comprising: a non-ferromagnetic core with a profile of an outer surface having at least two flat sections lying on intersecting planes; at least two ferromagnetic laminated structures arranged on the at least two flat sections of the non-ferromagnetic core, each ferromagnetic laminated structure includes a stack of ferromagnetic plates, each plate is covered with a non-conductive coating. Each ferromagnetic laminated structure is arranged on a corresponding flat section of the at least two flat sections of the non-ferromagnetic core such that side of each ferromagnetic plate is adjacent to the non-ferromagnetic core thereby making the ferromagnetic plates of the at least two ferromagnetic laminated structures lie on intersecting planes.
    Type: Application
    Filed: March 8, 2022
    Publication date: September 14, 2023
    Applicants: Mitsubishi Electric Research Laboratories, Inc., Mitsubishi Electric Corporation
    Inventors: Bingnan Wang, Hongyu Wang, Yusuke Sakamoto
  • Patent number: 11756551
    Abstract: An audio processing system is provided. The audio processing system comprises an input interface configured to accept an audio signal. Further, the audio processing system comprises a memory configured to store a neural network trained to determine different types of attributes of multiple concurrent audio events of different origins, wherein the types of attributes include time-dependent and time-agnostic attributes of speech and non-speech audio events. Further, the audio processing system comprises a processor configured to process the audio signal with the neural network to produce metadata of the audio signal, the metadata including one or multiple attributes of one or multiple audio events in the audio signal.
    Type: Grant
    Filed: October 7, 2020
    Date of Patent: September 12, 2023
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Niko Moritz, Gordon Wichern, Takaaki Hori, Jonathan Le Roux
  • Patent number: 11757278
    Abstract: Disclosed a method and system for fault location and protection of Microgrids which are operated under islanded mode by being disconnected from distribution systems under large disturbance or disaster scenarios. The disclosed method is invented to meet the protection needs for disconnected ungrounded microgrids without appropriate protection systems that are usually installed only at distribution substations. Moreover, the disclosed protection method or scheme is targeted at inverter-dominated microgrids in which fault current limiters are installed to protect inverters introduced by the increasing penetration of inverter-based distributed generators (IBDGs).
    Type: Grant
    Filed: March 9, 2022
    Date of Patent: September 12, 2023
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Hongbo Sun, Fangyuan Chang
  • Patent number: 11753023
    Abstract: A control system controls a vehicle using a probabilistic motion planner and an adaptive predictive controller. The probabilistic motion planner produces a sequence of parametric probability distributions over a sequence of target states for the vehicle with parameters defining a first and higher order moments. The adaptive predictive controller optimizes a cost function over a prediction horizon to produce a sequence of control commands to one or multiple actuators of the vehicle. The cost function balances a cost of tracking of different state variables in the sequence of the target states defined by the first moments. The balancing is performed by weighting different state variables using one or multiple of the higher order moments of the probability distribution.
    Type: Grant
    Filed: January 19, 2020
    Date of Patent: September 12, 2023
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Rien Quirynen, Karl Berntorp, Stefano Di Cairano