Patents Assigned to Mitsubishi Electric Research Laboratories, Inc.
-
Publication number: 20240304205Abstract: A system and method for sound processing for performing multi-talker conversation analysis is provided. The sound processing system includes a deep neural network trained for processing audio segments of an audio mixture of the multi-talker conversation. The deep neural network includes a speaker-independent layer that produces a speaker-independent output, and a speaker-biased layer applied once independently to each of the audio segments for each multiple speakers of the audio mixture. The deep neural network also processes a time-invariant embedding by individually assigning each application of the speaker-biased layer to a corresponding speaker by inputting the corresponding time-invariant speaker embedding. The deep neural network thus produces data indicative of time-frequency activity regions of each speaker of the multiple speakers in the audio mixture from a combination of speaker-biased outputs.Type: ApplicationFiled: July 21, 2023Publication date: September 12, 2024Applicant: Mitsubishi Electric Research Laboratories, Inc.Inventors: Aswin Shanmugam Subramanian, Christoph Böddeker, Gordon Wichern, Jonathan Le Roux
-
Patent number: 12078972Abstract: A probabilistic feedback controller for controlling an operation of a robotic system using a probabilistic filter subject to a structural constraint on an operation of the robotic system is configured to execute a probabilistic filter estimates a distribution of a current state of the robotic system given a previous state of the robotic system based on a motion model of the robotic system perturbed by stochastic process noise and a measurement model of the robotic system perturbed by stochastic measurement noise having an uncertainty modeled as a time-varying Gaussian process represented as a weighted combination of time-varying basis functions with weights defined by corresponding Gaussian distributions. The probabilistic filter recursively updates both the distribution of the current state of the robotic system and the Gaussian distributions of the weights of the basis functions selected to satisfy the structural constraint indicated by measurements of the state of a robotic system.Type: GrantFiled: March 12, 2022Date of Patent: September 3, 2024Assignee: Mitsubishi Electric Research Laboratories, Inc.Inventors: Karl Berntorp, Marcel Menner
-
Patent number: 12077412Abstract: System and methods for controlling a movement of elevator cars of an elevator system. Determine, for each elevator car, an individual waiting time of accommodating each hall call. Determine, for each pair of hall calls assigned to each elevator car, a pairwise delay over the individual waiting time of each hall call in the pair caused by a joint assignment of the elevator car to accommodate the pair of the hall calls. Approximate a cumulative waiting time of an assignment of the elevator cars. Determine the assignment of the elevator cars using a branch and bound algorithm using spectral relaxations based on a generalized eigenvalue and spectral branching that assigns the plurality of hall calls to the elevator cars to minimize the approximated cumulative waiting time. Use a controller for controlling the movement of the elevator cars according to the assignment.Type: GrantFiled: July 10, 2019Date of Patent: September 3, 2024Assignee: Mitsubishi Electric Research Laboratories, Inc.Inventor: Arvind Raghunathan
-
Publication number: 20240288870Abstract: A method, a system and a computer program product are provided for applying a neural network including an action sequence decoder for generating an action sequence for a robot to perform a task. The neural network is applied to generate the action sequence based on recordings demonstrating humans performing tasks. In an example, the method comprises collecting a recording and a sequence of captions describing scenes in the recording; extracting feature data from the recording; encoding the extracted feature data to produce a sequence of encoded features; and applying the action sequence decoder to produce a sequence of actions for the robot based on the sequence of encoded features having a semantic meaning corresponding to a semantic meaning of the sequence of captions. The feature data includes features of a video signal, an audio signal, and/or text transcription capturing a performance of the task.Type: ApplicationFiled: September 27, 2023Publication date: August 29, 2024Applicant: Mitsubishi Electric Research Laboratories, Inc.Inventors: Chiori Hori, Jonathan Le Roux, Devesh Jha, Siddarth Jain, Radu Ioan Corcodel, Diego Romeres, Puyuang Peng, Xinyu Liu, David Harwath
-
Patent number: 12071323Abstract: Systems, methods and devices for real-time contactless elevator service operation of an elevator includes a trained neural network (TNN) model. The TNN model is trained using a training processor with augmented datasets as a synthetic training dataset, to later perform elevator identifier recognition. The augmented data sets are generated from synthetic text images, the synthetic text images are augmented with different geometrical parameters and visual parameters to a predetermined number of variations in appearance to a set of training elevator identifiers. A camera captures a user image. A text image portion from the user image is extracted using the TNN model, and detects an elevator identifier in the extracted text image portion using the extracted text image portion and the TNN model. The detected elevator identifier is displayed for user confirmation or user cancellation, and upon user confirmation, generates a control command based the detected elevator identifier associated with an elevator service.Type: GrantFiled: August 17, 2020Date of Patent: August 27, 2024Assignee: Mitsubishi Electric Research Laboratories, Inc.Inventors: Zafer Sahinoglu, Kuan-Chuan Peng, Alan Sullivan, William Yerazunis
-
Patent number: 12061985Abstract: A system for automated construction of an artificial neural network architecture is provided. The system includes a set of interfaces and data links configured to receive and send signals, wherein the signals include datasets of training data, validation data and testing data, wherein the signals include a set of random number factors in multi-dimensional signals X, wherein part of the random number factors are associated with task labels Y to identify, and nuisance variations S. The system further includes a set of memory banks to store a set of reconfigurable deep neural network (DNN) blocks, hyperparameters, trainable variables, intermediate neuron signals, and temporary computation values including forward-pass signals and backward-pass gradients.Type: GrantFiled: July 2, 2020Date of Patent: August 13, 2024Assignee: Mitsubishi Electric Research Laboratories, Inc.Inventors: Toshiaki Koike-Akino, Ye Wang, Andac Demir, Deniz Erdogmus
-
Patent number: 12059751Abstract: A system for generating a G-code for controlling an operation of a laser-cutting machine to cut parts from a sheet of material, upon receiving cutting data specifying a cutting order of parts and a cutting order of edges of each part, tests the parts for potential distortions and generates a G-code to avoid the potential distortion. For testing a current part, the system detects a potential distortion when the final edge of the current part is adjacent to an edge of a previously cut part scheduled for cutting before the current part according to the cutting order of parts. The system modifies the cutting order to select the modified cutting order for which the final edge is not adjacent to any edge of any previously cut part.Type: GrantFiled: March 27, 2020Date of Patent: August 13, 2024Assignee: Mitsubishi Electric Research Laboratories, Inc.Inventors: William Vetterling, Jay Thornton, Ankush Chakrabarty, Abraham Goldsmith
-
Patent number: 12061474Abstract: A controller for controlling a motion of at least one device subject to constraints on the motion, is disclosed. The controller comprises a processor and a memory, where the controller inputs parameters of the task including the state of the at least one device to a neural network trained to output an estimated motion trajectory for performing the task. Further, the controller extracts at least some of the integer values of a solution to a mixed-integer optimization problem for planning an execution of the task that results in the estimated motion trajectory. Further, the controller solves the mixed-integer optimization problem for the parameters of the task with corresponding integer values fixed to the extracted integer values to produce an optimized motion trajectory subject to the constraint and changes the state of the at least one device to track the optimized motion trajectory.Type: GrantFiled: August 20, 2021Date of Patent: August 13, 2024Assignee: Mitsubishi Electric Research Laboratories, Inc.Inventors: Stefano Di Cairano, Ankush Chakrabarty, Rien Quirynen, Mohit Srinivasan, Nobuyuki Yoshikawa, Toshisada Mariyama
-
Patent number: 12063620Abstract: A Bluetooth-enabled device is provided, the Bluetooth-enabled device being configured to control a radio frequency (RF) chain during a first period to receive at a single antenna selected from a plurality of antennas, a constant tone extension (CTE) signal of multiple frames transmitted by the Bluetooth-enabled transmitter over multiple frequencies. Further the RF chain is controlled during a second period to switch among the plurality of antennas to receive the CTE signal at each of the plurality of antennas. An initial time-of-flight (ToF) data of the CTE signal is determined from first samples of the CTE signal received during the first period. Further, the Bluetooth-enabled transmitter is localized with respect to a location of the Bluetooth-enabled device using a signal model connecting samples of the CTE signal with an unknown angle-of-arrival of the CTE signal received at specific times, an unknown ToF conditioned on the initial ToF data.Type: GrantFiled: February 25, 2022Date of Patent: August 13, 2024Assignee: Mitsubishi Electric Research Laboratories, Inc.Inventors: Pu Wang, Jianyuan Yu, Toshiaki Koike-Akino, Philip Orlik
-
Patent number: 12060085Abstract: The present disclosure provides a controller for controlling an ego vehicle in an uncertain environment. The controller is caused to acquire knowledge of the environment from measurements associated with sensors the ego. The measurements are based on a state of the ego vehicle and sensing instructions associated with controlling an operation of the sensors. The controller is further caused to estimate a state of the environment, including uncertainty of a state of the at least one moving object or obstacle in the environment. Further a sequence of control inputs is determined by solving a multivariable and a multistage stochastic constrained optimization of a model of the motion of the ego vehicle. The controller is then caused to control the ego vehicle and the sensors based on the sequence of control inputs and the sequence of sensing instructions.Type: GrantFiled: June 3, 2022Date of Patent: August 13, 2024Assignee: MITSUBISHI ELECTRIC RESEARCH LABORATORIES, INC.Inventors: Stefano Di Cairano, Angelo Domenico Bonzanini, Ali Mesbah
-
Patent number: 12056213Abstract: Embodiments disclose a method and system for a scene-aware audio-video representation of a scene. The scene-aware audio video representation corresponds to a graph of nodes connected by edges. A node in the graph is indicative of the video features of an object in the scene. An edge in the graph connecting two nodes indicates an interaction of the corresponding two objects in the scene. In the graph, at least one or more edges are associated with audio features of a sound generated by the interaction of the corresponding two objects. The graph of the audio-video representation of the scene may be used to perform a variety of different tasks. Examples of the tasks include one or a combination of an action recognition, an anomaly detection, a sound localization and enhancement, a noisy-background sound removal, and a system control.Type: GrantFiled: July 19, 2021Date of Patent: August 6, 2024Assignee: Mitsubishi Electric Research Laboratories, Inc.Inventors: Moitreya Chatterjee, Anoop Cherian, Jonathan Le Roux
-
Patent number: 12058721Abstract: A method for semi-persistent scheduling (SPS) based resource allocation in a private 5G network comprises receiving location data of a plurality of user equipment (UEs) in the private 5G network in a last subframe of respective current communication periods of the UEs and determining distance distribution of the UEs in a subsequent communication period of a candidate UE of the plurality of UEs, based on the respective location data of the UEs. The method further comprises determining signal to noise ratio expectation of the UEs for the subsequent communication period, solving an optimization problem optimizing an expectation of data to be carried by each of the one or more SPS channels in the subsequent communication period, to obtain scheduling result for each of the one or more SPS channels and generating resource allocation data for the candidate UE based on the scheduling result.Type: GrantFiled: January 27, 2022Date of Patent: August 6, 2024Assignee: Mitsubishi Electric Research Laboratories, Inc.Inventors: Kyeong Jin Kim, Hao Song, Jianlin Guo, Philip Orlik, Kieran Parsons
-
Patent number: 12057983Abstract: Data communications and storage systems require error control techniques and digital modulation schemes to be transferred efficiently and successfully. Constellation shaping based on probabilistic amplitude shaping (PAS) offers an energy-efficient transmission in particular for long shaping blocks. However, longer shaping blocks can cause burst errors and enhancement of bit error rates besides longer latency to complete distribution matcher and dematcher operations. Methods and systems are disclosed that provide a way to resolve the issues by introducing a dual concatenation of pre-shaping and post-shaping error correction codes to mitigate burst errors of shaping. This enables low-complexity, high-performance and parallel architecture with a balanced overhead of dual-concatenation codes for shaping systems.Type: GrantFiled: July 27, 2021Date of Patent: August 6, 2024Assignee: Mitsubishi Electric Research Laboratories, Inc.Inventors: Toshiaki Koike-Akino, Kieran Parsons, Pavel Skvortcov
-
Patent number: 12049007Abstract: A robotic system for manipulating an object with a robotic manipulator is provided. The robotic system is configured to collect a digital representation of a task for manipulating the object; solve a robust control problem to optimize a sequence of control forces to be applied by the robotic manipulator to change a state of the object, where an evolution of the state of the object is governed by a stochastic complementarity system modeling the task with a predefined probability. The robust control problem optimizes a cost function to generate the sequence of control forces performing the task subject to joint chance constraints including a first chance constraint on the state of the object being manipulated and a second chance constraint on stochastic complementarily constraints modeling manipulation of the object. The robotic system is further configured to control the manipulation of the object based on the sequence of control forces.Type: GrantFiled: March 1, 2022Date of Patent: July 30, 2024Assignee: Mitsubishi Electric Research Laboratories, Inc.Inventors: Devesh Jha, Arvind Raghunathan, Yuki Shirai, Diego Romeres
-
Patent number: 12038727Abstract: A system for performing a task according to a reference trajectory is provided. The system includes at least one actuator configured to change a state of the system according to a control input, and a memory configured to store a model of dynamics of the system including a known part of the dynamics of the system as a function of the state of the system and the control input to the system and an unknown part of the dynamics of the system as a function of the state of the system, wherein the unknown part of the dynamics of the system is represented by parameters of a probabilistic distribution including a first-order moment and a second-order moment of the probabilistic distribution. The system also includes a control system configured to recursively determine and submit the control input to the actuator to change the state of the system.Type: GrantFiled: March 29, 2021Date of Patent: July 16, 2024Assignee: Mitsubishi Electric Research Laboratories, Inc.Inventors: Mouhacine Benosman, Devesh Jha
-
Patent number: 12007760Abstract: A computer-implemented pre-processed time-delay autoencoder based anomaly detection method are provided for detecting anomalous states of machines arranged in a factory automation (FA) system or a manufacturing production line.Type: GrantFiled: September 2, 2021Date of Patent: June 11, 2024Assignee: Mitsubishi Electric Research Laboratories, Inc.Inventors: Jianlin Guo, Bryan Liu, Toshiaki Koike Akino, Ye Wang, Kyeong Jin Kim, Kieran Parsons, Philip Orlik
-
Patent number: 12005914Abstract: A vehicle includes an advanced driver-assistance system (ADAS) configured to intervene in an operation of the control system by complementing or overriding the driving input in response to detecting a driving condition dependent on a calibration parameter indicative of a preference of execution of the driving maneuver. The ADAS is calibrated based on a crowd-local distribution function of the calibration parameter indicative of a distribution of the preference of execution of the driving maneuver by other drivers of other vehicles at a specific location or a specific environment in response to detecting that the vehicle approaches the specific location or the specific environment.Type: GrantFiled: February 22, 2022Date of Patent: June 11, 2024Assignee: Mitsubishi Electric Research Laboratories, Inc.Inventors: Marcel Menner, Stefano Di Cairano, Karl Berntorp, Ziyi Ma
-
Patent number: 12010678Abstract: A method for communication between a communication device and a base station in a private 5G network where the communication device and the base station have a base period of transmission defined there between as a minimal scheduling period, comprises transmitting location data of the communication device in a last subframe of a current communication period of the communication device. The method further comprises receiving resource allocation data including a transmission period widening factor for one or more subsequent communication periods of the communication device and computing a semi-persistent scheduling (SPS) period as a subsequent communication period of the one or more subsequent communication periods, based on the transmission period widening factor and the base period of transmission. Uplink communication is performed in the one or more subsequent periods, based on the resource allocation data and the SPS period.Type: GrantFiled: January 27, 2022Date of Patent: June 11, 2024Assignee: Mitsubishi Electric Research Laboratories, Inc.Inventors: Kyeong Jin Kim, Hao Song, Jianlin Guo, Philip Orlik, Kieran Parsons
-
Publication number: 20240178776Abstract: An abnormality diagnosis device includes: a first interface to obtain a value of a driving current for driving a motor; and a processor to access a database including calculation data to be used to calculate a degree of abnormality of the motor, wherein the processor extracts a feature quantity for calculating the degree of abnormality from a current waveform specified by a value of the driving current, and calculates the degree of abnormality of the motor based on the extracted feature quantity and the calculation data.Type: ApplicationFiled: November 30, 2022Publication date: May 30, 2024Applicants: Mitsubishi Electric Corporation, MITSUBISHI ELECTRIC RESEARCH LABORATORIES, INC.Inventors: Hiroshi INOUE, Bingnan WANG, Lei ZHOU
-
Publication number: 20240170003Abstract: An audio processing system and method for processing audio is disclosed. The audio processing system collects an input audio signal indicative of degraded measurements of a target audio waveform. The input audio signal is restored with recursive restoration that recursively restores the input audio signal until a termination condition is met. A current iteration of the recursive restoration applies a restoration operator configured to restore a degraded audio signal conditioned on a current level of severity of degradation and degrades the degraded audio signal deterministically with a level of severity less than the current level of severity. A target signal estimate indicative of enhanced measurements of the audio waveform is generated as output.Type: ApplicationFiled: October 23, 2023Publication date: May 23, 2024Applicant: Mitsubishi Electric Research Laboratories, Inc.Inventors: Jonathan Le Roux, François G. Germain, Gordon Wichern, Hao Yen