Abstract: Embodiments of the present disclosure provide methods, systems, and computer program products for implementing user interface (UI) Task Automations. Disclosed embodiments include receiving an automation structure and inputs and outputs of the structure to create a task automation, and providing multi-modal interfaces to process one or more teaching demonstrations for the task automation, where the teaching demonstrations identify automation processing parameters and operations for the task automation. Interactive contextual guidance are generated to record conditional execution of one or more actions or expressions based on states of one or more UI elements of the teaching demonstrations. Disclosed embodiments include recording, based on the conditional execution of one or more actions or expressions, the teaching demonstrations, synthesizing a UI task automation program of the task automation from the teaching demonstrations, and presenting the UI task automation program for validation.

Abstract: An example system includes a processor to receive target asset information from an asset management system. The processor can generate an inspection mission based on the target asset information. The processor can generate unmanned aerial vehicle (UAV)-specific commands based on the inspection mission. The processor can transmit the UAV-specific commands to an unmanned aerial vehicle (UAV) platform. The processor can receive images and sensor data from the UAV. The processor can also send the images and sensor data to an artificial intelligence (AI) services module. The processor can receive feedback from the AI services module. The processor can further modify the inspection mission based on the feedback.