Abstract: A vehicle capability broadcaster may receive information indicating a condition in an environment where an AV may operate. The vehicle capability broadcaster determines a first vehicle capability parameter and a second vehicle capability parameter based on the condition. The vehicle capability parameters may indicate capabilities of the AV for making different types of motions, e.g., limits of the AV making different motions. The vehicle capability broadcaster may transmit the first vehicle capability parameter to a first planning module and transmit the second vehicle capability parameter to a second planning module. The first planning module and the second planning module may plan one or more motions of the AV in the operation based on the vehicle capability parameters. The vehicle capability broadcaster may update a vehicle capability parameter and transmit the updated vehicle capability parameter to one of the planning modules after the one or more motions are planned.

Abstract: Systems and methods for measuring passenger comfort and trading off passenger comfort with other metrics in autonomous vehicle planning and control. Perception of kinematic comfort relative to acceleration can vary depending on the frequency of acceleration. Systems and methods are provided to use the relationship between kinematic comfort and acceleration to introduce a cost on the ratio between acceleration and jerk. In various examples, the resulting cost can be traded off against other cost terms such as obstacle buffers and reference tracking constraints. Autonomous vehicle planning and control problem formulations can be encoded to include a direct tradeoff between both lateral and longitudinal comfort metrics and other variables.

Abstract: In described embodiments of method for executing autonomous bin picking, a physical environment comprising a bin containing a plurality of objects is perceived by one or more sensors. Multiple artificial intelligence (AI) modules feed from the sensors to compute grasping alternatives, and in some embodiments, detected objects of interest. Grasping alternatives and their attributes are computed based on the outputs of the AI modules in a high-level sensor fusion (HLSF) module. A multi-criteria decision making (MCDM) module is used to rank the grasping alternatives and select the one that maximizes the application utility while satisfying specified constraints.

Abstract: Examples of techniques for threat detection in an industrial process system are described herein. An aspect includes determining a plurality of subsystems of an industrial process system. Another aspect includes, for each of the plurality of subsystems, constructing and training a respective deep autoencoder (DAE) model of the subsystem based on data corresponding to the industrial process system. Another aspect includes monitoring the industrial process system using the plurality of DAE models corresponding to the plurality of subsystems. Another aspect includes, based on the plurality of DAE models, determining a cyberattack in a subsystem of the plurality of subsystems.

Abstract: Systems and techniques are provided for adjusting the planned path of an autonomous vehicle to converge with the actual path. An example method can include determining a first pose error associated with a first pose component from one or more pose components, wherein the first pose error is based on a first difference between an actual pose of an autonomous vehicle and a planned pose of the autonomous vehicle; determining that the first pose error associated with the first pose component exceeds a pose error threshold corresponding to the first pose component; and generating a new planned pose of the autonomous vehicle that yields a reduced first pose error associated with the first pose component, wherein the reduced first pose error is based on a second difference between the actual pose of the autonomous vehicle and the new planned pose of the autonomous vehicle.

Abstract: A system and method are disclosed for orchestrating the execution of computing tasks. An orchestration engine can receive task requests over a network from a plurality of process engines. The process engines may correspond to respective edge or field devices that are remotely located as compared to the orchestration engine. Each task request may indicate at least one task requirement for executing a respective computing task. A plurality of computing instances that have available computing resources can be selected from a set of computing instances. A predicted runtime can be generated for each of the computing tasks. In an example, based on the predicted runtimes, task requirements, available computing resources, and associated network conditions, a schedule and allocation scheme are determined by the orchestration engine.

Abstract: A system controller for visual servoing includes a technology module with dedicated hardware acceleration for deep neural network that retrieves a desired configuration of a workpiece object being manipulated by a robotic device and receives visual feedback information from one or more sensors on or near the robotic device that includes a current configuration of the workpiece object. The hardware accelerator executes a machine learning model trained to process the visual feedback information and determine a configuration error based on a difference between the current configuration of the workpiece object and the desired configuration of the workpiece object. A servo control module adapts a servo control signal to the robotic device for manipulation of the workpiece object in response to the configuration error.

Abstract: A computer-implemented method for failure classification of a surface treatment process includes receiving one or more process parameters that influence one or more failure modes of the surface treatment process and receiving sensor data pertaining to measurement of one or more process states pertaining to the surface treatment process. The method includes processing the received one or more process parameters and the sensor data by a machine learning model deployed on an edge computing device controlling the surface treatment process to generate an output indicating, in real-time, a probability of process failure via the one or more failure modes. The machine learning model is trained on a supervised learning regime based on process data and failure classification labels obtained from physics simulations of the surface treatment process in combination with historical data pertaining to the surface treatment process.

Abstract: An edge device can be configured to perform industrial control operations within a production environment that defines a physical location. The edge device can include a plurality of neural network layers that define a deep neural network. The edge device be configured to obtain data from one or more sensors at the physical location defined by the production environment. The edge device can be further configured to perform one or more matrix operations on the data using the plurality of neural network layers so as to generate a large scale matrix computation at the physical location defined by the production environment. In some examples, the edge device can send the large scale matrix computation to a digital twin simulation model associated with the production environment, so as to update the digital twin simulation model in real time.

Abstract: A computer-implemented method includes operating a controllable physical device to perform a task. The method also includes miming forward simulations of the task by a physics engine based on one or more physics parameters. The physics engine communicates with a parameter data layer where each of the one or more physics parameters is modeled with a probability distribution. For each forward simulation run, a tuple of parameter values is sampled from the probability distribution of the one or more physics parameters and fed to the physics engine. The method includes obtaining an observation pertaining to the task from the physical environment and a corresponding forward simulation outcome associated with each sampled tuple of parameter values. The method then includes updating the probability distribution of the one or more physics parameters in the parameter data layer based on the observation from the physical environment and the corresponding forward simulation outcomes.

Abstract: Distributed neural network boosting is performed by a neural network system through operating at least one processor. A method comprises providing a boosting algorithm that distributes a model among a plurality of processing units each being a weak learner of multiple weak learners that can perform computations independent from one another yet process data concurrently. The method further comprises enabling a distributed ensemble learning which enables a programmable logic controller (PLC) to use more than one processing units of the plurality of processing units to scale an application and training the multiple weak learners using the boosting algorithm. The multiple weak learners are machine learning models that do not capture an entire data distribution and are purposefully designed to predict with a lower accuracy. The method further comprises using the multiple weak learners to vote for a final hypothesis based on a feed forward computation of neural networks.

Abstract: Computerized system and method are provided. A robotic manipulator (12) is arranged to grasp objects (20). A gripper (16) is attached to robotic manipulator (12), which includes an imaging sensor (14). During motion of robotic manipulator (12), imaging sensor (14) is arranged to capture images providing different views of objects in the environment of the robotic manipulator. A processor (18) is configured to find, based on the different views, candidate grasp locations and trajectories to perform a grasp of a respective object in the environment of the robotic manipulator. Processor (18) is configured to calculate respective values indicative of grasp quality for the candidate grasp locations, and, based on the calculated respective values indicative of grasp quality for the candidate grasp locations, processor (18) is configured to select a grasp location likely to result in a successful grasp of the respective object.

Abstract: A system for supporting artificial intelligence inference in an edge computing device associated with a physical process or plant includes a neural network training module, a neural network testing module and a digital twin of the physical process or plant. The neural network training module is configured to train a neural network model for deployment to the edge computing device based on data including baseline training data and field data received from the edge computing device. The neural network testing module configured to validate the trained neural network model prior to deployment to the edge computing device by leveraging the digital twin of the physical process or plant.

Abstract: According to an aspect of the present disclosure, a computer-implemented includes creating a plurality of basic skill functions for a controllable physical device of an autonomous system. Each basic skill function includes a functional description for using the controllable physical device to interact with a physical environment to perform a defined objective. The method further includes selecting one or more basic skill functions to configure the controllable physical device to perform a defined task. The method also includes determining a decorator skill function specifying at least one constraint. The decorator skill function is configured to impose, at run-time, the at least one constraint, on the one or more basic skill functions. The method further includes generating executable code by applying the decorator skill function to the one or more basic skill functions, and actuating the controllable physical device using the executable code.

Abstract: In current applications of autonomous machines in industrial settings, the environment, in particular the devices and systems with which the machine interacts, is known such that the autonomous machine can operate in the particular environment successfully. Thus, current approaches to automating tasks within varying environments, for instance complex environments having uncertainties, lack capabilities and efficiencies. In an example aspect, a method for operating an autonomous machine within a physical environment includes detecting an object within the physical environment. The autonomous machine can determine and perform a principle of operation associated with a detected subcomponent of the object, so as to complete a task that requires that the autonomous machine interacts with the object. In some cases, the autonomous machine has not previously encountered the object.

Abstract: A system controller for visual servoing includes a technology module with dedicated hardware acceleration for deep neural network that retrieves a desired configuration of a workpiece object being manipulated by a robotic device and receives visual feedback information from one or more sensors on or near the robotic device that includes a current configuration of the workpiece object. The hardware accelerator executes a machine learning model trained to process the visual feedback information and determine a configuration error based on a difference between the current configuration of the workpiece object and the desired configuration of the workpiece object. A servo control module adapts a servo control signal to the robotic device for manipulation of the workpiece object in response to the configuration error.

Abstract: Examples of techniques for aspect-oriented programming based programmable logic controller (PLC) simulation are provided. An aspect including one of a hardware configuration aspect, an execution semantics aspect, and a communication architecture aspect, may be determined to be applied to a general model of an industrial system, the general model including a PLC model and a system model. The determined aspect may be applied to the general model. The industrial system may be simulated using the general model and the applied aspect.

Abstract: Examples of techniques for threat detection in an industrial process system are described herein. An aspect includes determining a plurality of subsystems of an industrial process system. Another aspect includes, for each of the plurality of subsystems, constructing and training a respective deep autoencoder (DAE) model of the subsystem based on data corresponding to the industrial process system. Another aspect includes monitoring the industrial process system using the plurality of DAE models corresponding to the plurality of subsystems. Another aspect includes, based on the plurality of DAE models, determining a cyberattack in a subsystem of the plurality of subsystems.

Abstract: A computer-implemented method for training a neural network on a hardware accelerator of an edge device includes dividing a trained neural network into a domain independent portion and a domain dependent portion. The domain independent portion of the neural network is deployed onto a dedicated neural network processing unit of the hardware accelerator of the edge device, and the domain dependent portion of the neural network is deployed onto one or more additional processors of the hardware accelerator of the edge device. The domain dependent portion on the additional processors of the hardware accelerator is retrained using data collected at the edge device.

Abstract: A system and method are disclosed for orchestrating the execution of computing tasks. An orchestration engine can receive task requests over a network from a plurality of process engines. The process engines may correspond to respective edge or field devices that are remotely located as compared to the orchestration engine. Each task request may indicate at least one task requirement for executing a respective computing task. A plurality of computing instances that have available computing resources can be selected from a set of computing instances. A predicted runtime can be generated for each of the computing tasks. In an example, based on the predicted runtimes, task requirements, available computing resources, and associated network conditions, a schedule and allocation scheme are determined by the orchestration engine.