Abstract: Disclosed herein are methods and systems (sensors) that allow revision of HD maps for lane lines as the lane lines are created. In a non-limiting example, a method comprises receiving, by a processor from a sensor associated with a vehicle configured to paint a lane line, a color attribute, a patterns attribute, and a location of a lane line painted on a road by the vehicle; determining, by the processor, using the location received from the sensor, whether the road has an existing lane line; and revising, by the processor, a high definition map associated with at least one autonomous vehicle by removing the existing lane line from the high definition map and inserting the lane line in the high definition map.

Abstract: Embodiments are directed to calibrating multi-view triangulation systems that perceive surfaces and objects based on reflections of one or more scanned laser beams that are continuously sensed by two or more sensors. In addition to sampling and triangulating points from a spline formed by an unbroken line trajectory of a laser beam, the calibration system samples and triangulates a corresponding velocity vector. Iterative reduction is performed on velocity vectors instead of points or splines. The velocity vector includes directions and magnitudes along a trajectory of a scanning laser beam which are used to determine the actual velocities. Translation and rotation vectors are based on the velocity vectors for matching trajectories determined for two or more sensors having offset physical positions, which are used to calibrate sensor offset errors associated with the matching trajectories provided to a modeling engine.

Abstract: A method includes, traversing a laser line scanning sensor over a workpiece to generate a series of scan data according to a first set of scan parameters; assembling the series of scan data into a virtual model; detecting a first hole, defining absence of scan data, in a first region of the virtual model; responsive to the first hole defining a dimension less than a threshold dimension, assigning the first set of scan parameters to the first region; detecting a second hole, in a second region of the virtual model; responsive to the second hole defining a dimension greater than the threshold dimension, defining a second set of scan parameters associated with an increased resolution and assigning the second set of scan parameters to the second workpiece region; and compiling the first and second set of scan parameters into a scan protocol defining a minimum scan cycle duration.

Abstract: A method for controlling a robot is provided. The method includes the steps of: acquiring at least one of sound information and action information for a robot from a user in a serving place; determining identification information on the user on the basis of at least one of the sound information and the action information; and determining an operation to be performed by the robot on the basis of the identification information.

Abstract: Systems and methods for real time feedback and for updating welding instructions for a welding robot in real time is described herein. The data of a workspace that includes a part to be welded can be received via at least one sensor. This data can be transformed into a point cloud data representing a three-dimensional surface of the part. A desired state indicative of a desired position of at least a portion of the welding robot with respect to the part can be identified. An estimated state indicative of an estimated position of at least the portion of the welding robot with respect to the part can be compared to the desired state. The welding instructions can be updated based on the comparison.

Abstract: System and method for end-to-end differentiable joint image refinement and perception are provided. A learning machine employs an image acquisition device for acquiring a set of training raw images. A processor determines a representation of a raw image, initializes a set of image representation parameters, defines a set of analysis parameters of an image analysis network configured to process the image's representation, and jointly trains the set of representation parameters and the set of analysis parameters to optimize a combined objective function. A module for transforming pixel-values of the raw image to produce a transformed image comprising pixels of variance-stabilized values, a module for successively performing processes of soft camera projection and image projection, and a module for inverse transforming the transformed pixels are disclosed. The image projection performs multi-level spatial convolution, pooling, subsampling, and interpolation.

Abstract: Embodiments described herein systems and methods for detecting fluid leaks for an automated vehicle using image data. The automated vehicle includes a camera at or near the front of the chassis and a camera at or near the rear of the chassis. Each camera captures images of a road surface beneath vehicle as the vehicle passes a road surface. The cameras store images of the road surface into a log with timestamp or location stamp, by mapping the image to a location in the world. An algorithm de-warps the images to correct for lensing. Using the locations data, computer vision, and/or object recognition, a processor extracts features, overlays the images, and compares the features to identify differences between the images indicating dripping fluid. Multi-image comparisons avoid false positives. The processor may recognize that image features indicate fluid leaks based on characteristics of spots (e.g., color, location, size) or other features.

Abstract: Embodiments disclosed herein include systems and methods for generating proposed driving paths for an automated vehicle performing a lane-change. An autonomy system continually generates reference trajectories. The autonomy system then iteratively and recursively generates clothoid points tracing the reference trajectory, by the computer, but constrained by clothoid thresholds. The clothoid points define a clothoid representing a revised trajectory, effectively constrained by the clothoid thresholds. The autonomy system generates and updates driving instructions for the automated vehicle to follow a drive path represented by the clothoid. If the autonomy system determines clothoid points cannot be generated according to the thresholds, then the autonomy system determines the automated vehicle cannot safely or practicably perform the lane change maneuver for the given portion of road.

Abstract: Aspects of this technical solution can include a first layer having a first region and a second region, the first region and the second region having a first transmissivity property corresponding to a first portion of a spectrum of light and a second portion of the spectrum of light, having the first transmissivity property, and a second layer disposed over the first layer and having a third region and a fourth region, the third region and the fourth region having a second transmissivity property corresponding to the first portion of the spectrum of light and the second portion of the spectrum of light.

Abstract: An autonomous, mobile robotic device (AMR) is configured with one or more UVC radiation sources, and operates to traverse a path while disinfecting an interior space. Each UVC radiation source is connected to the AMR by an articulating arm that is controlled to orient each source towards a feature or surface that is selected for disinfection during the time that the AMR is moving through the space. The location of each feature selected for disinfection can be mapped, and this map information, a current AMR location and pose can be used to generate signals that are used to control the articulating arm to orient each UVC lamp towards a feature that is selected for disinfection.

Abstract: Disclosed herein are methods and systems to provide intelligent display for vehicles including a method that comprises determining data associated a road sign; retrieving driving data associated with a vehicle; generating, using the driving data and data associated with the road sign, a graphical overlay presenting a virtual object corresponding to the trajectory of the vehicle or data associated with the vehicle; and presenting on an electronic device associated with the vehicle, the graphical overlay while the electronic device is presenting an image of a surrounding of the vehicle, wherein the graphical overlay is superimposed upon an image of the road sign.

Abstract: A method and vehicle for external actor acknowledgment for automated vehicles is disclosed. In an example, a method comprises determining, by a processor, to control a vehicle to switch into a lane adjacent to the vehicle; monitoring, by the processor, a speed or a location of a second vehicle, the second vehicle in the lane adjacent to the vehicle; determining, by the processor, the speed or the location of the second vehicle satisfies a condition; controlling, by the processor, the vehicle to switch into the lane adjacent to the vehicle; and activating, by the processor, an acknowledgment sequence responsive to determining the vehicle has switched into the lane.

Abstract: An actuator system includes a sleeve for accommodating an appendage of a user therein, actuators, and a power source. Each actuator includes a deformable shell defining a pouch including an enclosed internal cavity with a fluid dielectric contained therein, and first and second electrodes disposed over opposing sides of the pouch. The power source provides a voltage between the first and second electrodes. The sleeve includes features for distributing the actuators within the sleeve in a predetermined manner. Application of the voltage produces directional forces on the appendage. In embodiments, the first and second electrodes are disposed over the pouch such that, when the actuator is activated, the fluid dielectric is displaced in a length direction within the pouch, and the features in the sleeve may or may not align the actuators such that the length direction of the actuators are in alignment.

Abstract: A vehicle can include a first camera on a first side of the vehicle and a second camera on a second side of the vehicle opposite the first side of the vehicle. The vehicle can include a processor communicatively coupled with the first camera and the second camera. The processor can be configured to receive a first image of a first lane line on a road in which the vehicle is driving from the first camera and a second image of a second lane line on the road from the second camera; detect the first lane line from the first image and the second lane line from the second image; determine a first location of the first lane line relative to a defined location of the vehicle and a second location of the second lane line relative to the defined location of the vehicle; and execute a correction sequence.

Abstract: An automatic insertion device and method of using the same is provided. A vibrator and an extender are connected to a penetrating member and are both in electrical communication with a controller. A detector identifies a subcutaneous target for insertion and the insertion angle, distance and trajectory for the penetrating member are calculated. The vibrator provides vibrations to the penetrating member and the extender advances the penetrating member for insertion. The vibrator and extender are in electrical communication with one another during the insertion process and adjustments to the insertion speed are made based on feedback of vibrational load encountered by the vibrator during insertion, and adjustments to the vibrations are made based on feedback of insertion load encountered by the extender during insertion. Iterative samples are taken to constantly adjust the operation of one motor based on the operations and feedback from the other motor.

Abstract: Disclosed herein are methods and systems to provide intelligent display for vehicles including a method that comprises determining, by a processor, that a current trajectory of an autonomous vehicle includes a revised road condition having at least one attribute; retrieving, by the processor using the at least one attribute, a graphical overlay corresponding to the revised road condition; and displaying, by the processor on an electronic device associated with the autonomous vehicle, the graphical overlay while the electronic device is presenting an image of a surrounding of the autonomous vehicle.

Abstract: In some implementations, the EMV uses a calibration to inform autonomous control over the EMV. To calibrate an EMV, the system first selects a calibration action comprising a control signal for actuating a control surface of the EMV. Then, using a calibration model comprising a machine learning model trained based on one or more previous calibration actions taken by the EMV, the system predicts a response of the control surface to the control signal of the calibration action. After the EMV executes the control signal to perform the calibration action, the EMV system monitors the actual response of the control signal and uses that to update the calibration model based on a comparison between the predicted and monitored states of the control surface.

Abstract: Systems and methods for identifying a robot end effector in a processing environment may utilize one or more sensors for digitally recording visual information and providing that information to an industrial workflow. The sensor(s) may be positioned to record at least one image of the robot including the end effector. A processor may determine the identity of the end effector from the recorded image(s) and a library or database stored digital models.

Abstract: Proposed is a rehabilitation exercise device for upper and lower limbs. The rehabilitation exercise device is characterized by including: a first support supporting a user's hand or foot; a second support supporting a user's forearm or calf; a pair of first hinges rotatably connecting the first support and the second support to each other; a third support supporting a user's upper arm or thigh; a pair of second hinges rotatably connecting the second support and the third support to each other; and a drive module selectively mounted on any one of the pair of first hinges and the pair of second hinges, and configured to pivot the first support or the second support.