Abstract: A method is provided for detecting a higher-level action from one or more trajectories of real states. The trajectories are based on an experts' action demonstration. The method trains predictors to predict future states. Each predictor has a different duration of the higher-level action to be detected. The method predicts, using the predictors, the future states using past ones of the real states in the one or more trajectories as inputs for the predictors. The method determines if a match exists between any of the future states relative to a real future state with a corresponding same duration from the one or more trajectories. The method outputs a pair that includes the matching one of the future states as a prediction input and the real future state with the corresponding same duration from the one or more trajectories as the higher-level action corresponding thereto, responsive to the match existing.

Abstract: A computer-implemented method is provided for modified Lexicographic Reinforcement Learning. The computer implemented method includes obtaining, by a hardware processor, a sequence of tasks. Each of the tasks corresponds to, and has a one-to-one correspondence with, a respective award from among set of rewards. The method further includes performing, by the hardware processor for each of the tasks, reinforcement learning and deep learning for both of (i) one or more policies and (ii) one or more value functions, with a plurality of sets of samples. A plurality of solutions in a form of the one or more policies and the one or more value functions are parametrized by a single neural network with a selector which selects an input of the single neural network from among the plurality of sets of samples.

Abstract: A method is provided for detecting a higher-level action from one or more trajectories of real states. The trajectories are based on an experts' action demonstration. The method trains predictors to predict future states. Each predictor has a different duration of the higher-level action to be detected. The method predicts, using the predictors, the future states using past ones of the real states in the one or more trajectories as inputs for the predictors. The method determines if a match exists between any of the future states relative to a real future state with a corresponding same duration from the one or more trajectories. The method outputs a pair that includes the matching one of the future states as a prediction input and the real future state with the corresponding same duration from the one or more trajectories as the higher-level action corresponding thereto, responsive to the match existing.

Abstract: A computer-implemented method is provided for multi-source sound localization. The method includes extracting, by a hardware processor, spectral features from respective pluralities of microphones comprised in each of two or more microphone arrays. The method further includes forming, by the hardware processor, respective sets of pairs of the spectral features from the respective pluralities of microphones within each of the two or more microphone arrays by rearranging and duplicating the spectral features from the respective pluralities of microphones included in each of the two or more microphone arrays. The method also includes inputting, by the hardware processor, the respective sets of pairs of the spectral features into a neural network to encode the spectral features into deep features and decode the deep features to output from the neural network at least one location representation of one or more sound sources.

Abstract: A computer-implemented method is provided for modified Lexicographic Reinforcement Learning. The computer implemented method includes obtaining, by a hardware processor, a sequence of tasks. Each of the tasks corresponds to, and has a one-to-one correspondence with, a respective award from among set of rewards. The method further includes performing, by the hardware processor for each of the tasks, reinforcement learning and deep learning for both of (i) one or more policies and (ii) one or more value functions, with a plurality of sets of samples. A plurality of solutions in a form of the one or more policies and the one or more value functions are parametrized by a single neural network with a selector which selects an input of the single neural network from among the plurality of sets of samples.