Abstract: Disclosed are techniques, and related systems, for developing and implementing a unified framework for quantifying risk in machine learning models, such as deep neural networks. The framework can be easy-to-use and flexible to apply to different types of machine learning models. The framework can be used to automatically assess different forms of risk in parallel, including but not limited to aleatoric uncertainty, epistemic uncertainty, and/or vacuitic uncertainty. To that end, the disclosed framework provides wrappers that compose different automatic risk assessment algorithms. The obtained risk estimates can be used, for example, for: providing a deeper insight into decision boundaries of neural networks; performing downstream tasks by integrating the risk estimates back into a learning lifecycle for the model to improve robustness and generalization; and/or improving safety by identifying potential model failures based on the risk values.

Abstract: System, methods, and other embodiments described herein relate to training a scene simulator for rendering 2D scenes using data from real and simulated agents. In one embodiment, a method includes acquiring trajectories and three-dimensional (3D) views for multiple agents from observations of real vehicles. The method also includes generating a 3D scene having the multiple agents using the 3D views and information from simulated agents. The method also includes training a scene simulator to render scene projections using the 3D scene. The method also includes outputting a 2D scene having simulated observations for a driving scene using the scene simulator.

Abstract: Systems and methods are provided for generating a statistical parameter representing a state of a surgical procedure from sensor data. Sensor data representing a time period. is received from a sensor. Numerical features representing the time period are generated from the sensor data. Each of a plurality of long short term memory units are updated according to the plurality of numerical features via a message passing process. The long short term memory units are connected to form a graph, with a first set of the long short term memory units representing a plurality of nodes of the graph and a second set of the long short term memory units representing a plurality of hyperedges of the graph. A statistical parameter representing a state of the surgical procedure for the time period is derived from an output of one of the long short term memory units and provided to a user.

Abstract: An autonomous, mobile robotic device (AMR) is configured with one or more UVC radiation sources, and operates to traverse a path while disinfecting an interior space. Each UVC radiation source is connected to the AMR by an articulating arm that is controlled to orient each source towards a feature or surface that is selected for disinfection during the time that the AMR is moving through the space. The location of each feature selected for disinfection can be mapped, and this map information, a current AMR location and pose can be used to generate signals that are used to control the articulating arm to orient each UVC lamp towards a feature that is selected for disinfection.

Abstract: In some aspects, a system comprises a computer hardware processor and a non-transitory computer-readable storage medium storing processor-executable instructions for receiving, from one or more sensors, sensor data relating to a robot; generating, using a statistical model, based on the sensor data, first control information for the robot to accomplish a task; transmitting, to the robot, the first control information for execution of the task; and receiving, from the robot, a result of execution of the task.

Abstract: Understanding the intent of human drivers and adapting to their driving styles is used to increased efficiency and safety of autonomous vehicles (AVs) by enabling them to behave in safe and predictable ways without requiring explicit inter-vehicle communication. A Social Value Orientation (SVO), which quantifies the degree of an agent's selfishness or altruism, is estimated by the AV for other vehicles to better predict how they will interact and cooperate with others. Interactions between agents are modeled as a best response game wherein each agent negotiates to maximize their own utility. A dynamic game solution uses the Nash equilibrium, yielding an online method of predicting multi-agent interactions given their SVOs. This approach allows autonomous vehicles to observe human drivers, estimate their SVOs, and generate an autonomous control policy in real time.

Abstract: An approach to autonomous navigation of a vehicle augments a static map of an environment with a clutter map characterizing a risk of encountering an object that is not represented in the static map of the environment. For example, the clutter map may be based on locations and velocities of those objects, and route planning may avoid planning a path through locations that have a high risk of occupancy, and therefore potential delay or collision.

Abstract: Systems and methods are provided for identifying a current phase of a surgical procedure. Sensor data representing a time period is received and a plurality of numerical features representing the time period are generated from the sensor data. A statistical parameter representing a plurality of stored values from a memory is generated at a sufficient statistics model. An output, representing a surgical phase associated with the time period is provided at a recurrent neural network from a set of inputs that includes the plurality of numerical features and the statistical parameter.

Abstract: Systems and methods described herein relate to estimating risk associated with a vehicular maneuver. One embodiment acquires a geometric representation of an intersection including a lane in which a vehicle is traveling and at least one other lane; discretizes the at least one other lane into a plurality of segments; determines a trajectory along which the vehicle will travel; estimates a probability density function for whether a road agent external to the vehicle is present in the respective segments; estimates a traffic-conflict probability of a traffic conflict in the respective segments conditioned on whether an external road agent is present; estimates a risk associated with the vehicle following the trajectory by integrating a product of the probability density function and the traffic-conflict probability over the at least one other lane and the plurality of segments; and controls operation of the vehicle based, at least in part, on the estimated risk.

Abstract: A method for configuring an electromechanical system to perform a first task includes accepting a specification of the first task, accepting first user input from an operator related to the first task, the first user input including a representation of user-referenced points, and forming control data for causing the system to perform the task based on the specification of the first task and the first user input.

Abstract: An artificial muscle system includes a collapsible skeleton, a flexible skin, and a muscle actuation mechanism. The collapsible skeleton is contained inside a volume defined, at least in part, by the flexible skin. The flexible skin and the collapsible skeleton are configured for the flexible skin to provide a pulling force on the collapsible skeleton when a pressure difference exists between the inside of the sealed volume and a surrounding environment to change at least one of the dimensions and thus geometry of the collapsible skeleton. The muscle actuation mechanism includes at least one of the following to deploy or contract the collapsible skeleton: (a) a fluid displacing, releasing, or capturing mechanism configured to increase or decrease fluid pressure inside the sealed volume; and (b) a heating or cooling element configured to change the temperature of fluid in the sealed volume.

Abstract: A method of generating an output trajectory of an ego vehicle is described. The method includes extracting high-level features from a bird-view image of a traffic environment of the ego vehicle. The method also includes generating, using an automaton generative network, an automaton including an automaton state distribution describing a behavior of the ego vehicle in the traffic environment according to the high-level features. The method further includes generating the output trajectory of the ego vehicle according to extracted bird-view features of the bird-view image and the automaton state distribution describing the behavior of the ego vehicle in the traffic environment.

Abstract: A system and method for patient positioning during radiotherapy. The system can include a patient support structure configured to receive a patient during a radiotherapy process using a radiotherapy source to deliver a therapy to the patient when positioned on the patient support structure, a patient positioning system configured to adjust a position of the patient support structure relative to the radiotherapy source, a flexible actuator configured to secure the patient to the patient support and adjust a position of the patient relative to the patient support, and an imaging system configured to acquire imaging data of the patient, the patient support, and the flexible actuator during the radiotherapy process.

Abstract: The present disclosure provides systems and methods to detect occluded objects using shadow information to anticipate moving obstacles that are occluded behind a corner or other obstacle. The system may perform a dynamic threshold analysis on enhanced images allowing the detection of even weakly visible shadows. The system may classify an image sequence as either “dynamic” or “static”, enabling an autonomous vehicle, or other moving platform, to react and respond to a moving, yet occluded object by slowing down or stopping.

Abstract: Systems and methods for predicting the trajectory of an object are disclosed herein. One embodiment receives sensor data that includes a location of the object in an environment of the object; accesses a location-specific latent map, the location-specific latent map having been learned together with a neural-network-based trajectory predictor during a training phase, wherein the neural-network-based trajectory predictor is deployed in a robot; inputs, to the neural-network-based trajectory predictor, the location of the object and the location-specific latent map, the location-specific latent map providing, to the neural-network-based trajectory predictor, a set of location-specific biases regarding the environment of the object; and outputs, from the neural-network-based trajectory predictor, a predicted trajectory of the object.

Abstract: In some aspects, a system comprises a computer hardware processor and a non-transitory computer-readable storage medium storing processor-executable instructions for receiving, from one or more sensors, sensor data relating to a robot; generating, using a statistical model, based on the sensor data, first control information for the robot to accomplish a task; transmitting, to the robot, the first control information for execution of the task; and receiving, from the robot, a result of execution of the task.

Abstract: An autonomous, mobile robotic device (AMR) is configured with one or more UVC radiation sources, and operates to traverse a path while disinfecting an interior space. Each UVC radiation source is connected to the AMR by an articulating arm that is controlled to orient each source towards a feature or surface that is selected for disinfection during the time that the AMR is moving through the space. The location of each feature selected for disinfection can be mapped, and this map information, a current AMR location and pose can be used to generate signals that are used to control the articulating arm to orient each UVC lamp towards a feature that is selected for disinfection.

Abstract: An autonomous, mobile robotic device (AMR) is configured with one or more UVC radiation sources, and operates to traverse a path while disinfecting an interior space. Each UVC radiation source is connected to the AMR by an articulating arm that is controlled to orient each source towards a feature or surface that is selected for disinfection during the time that the AMR is moving through the space. The location of each feature selected for disinfection can be mapped, and this map information, a current AMR location and pose can be used to generate signals that are used to control the articulating arm to orient each UVC lamp towards a feature that is selected for disinfection.

Abstract: An autonomous, mobile robotic device (AMR) is configured with one or more UVC radiation sources, and operates to traverse a path while disinfecting an interior space. Each UVC radiation source is connected to the AMR by an articulating arm that is controlled to orient each source towards a feature or surface that is selected for disinfection during the time that the AMR is moving through the space. The location of each feature selected for disinfection can be mapped, and this map information, a current AMR location and pose can be used to generate signals that are used to control the articulating arm to orient each UVC lamp towards a feature that is selected for disinfection.

Abstract: Origami robots, and associated systems, methods of treatment, and methods of manufacture are provided. A system includes an origami robot encapsulated for ingestion by a patient, such as in a biocompatible material that is dissolvable or meltable within the gastrointestinal tract. A method of treatment includes delivering an origami robot in a folded position into a gastrointestinal tract of a patient, causing the origami robot to unfold within the gastrointestinal tract, and directing the origami robot to a site requiring treatment in the gastrointestinal tract.