Abstract: An autonomous vehicle's control systems include an A-kit module that operates autonomy logic to generate a desired trajectory from sensor data. A B-kit module receives the desired trajectory and generates inputs for actuators such as steering, brake and throttle actuators based on the desired trajectory. Safing logic (which may be located in the A-kit, B-kit, both the A-kit and the B-kit or elsewhere within or outside of the vehicle) receives a sensor fault indication and executes a contingency trajectory such as a safing maneuver to bring the vehicle to a safe state.

Abstract: Methods and apparatus for self-driving vehicles to safely control transitions into and out of autonomy modes. The techniques may be used in a single autonomous vehicle or adapted to collaborative control of vehicles travelling in formation.

Abstract: Methods and apparatus for platoon behaviors that discourage other vehicles from interfering.

Abstract: Methods and apparatus for controlling two or more vehicles travelling in formation. Selected vehicles may be fully or partially autonomously controlled; at least one vehicle is partially controlled by a human driver. Information is collected at each vehicle and from the drivers and it is shared with other vehicles and drivers to create a shared world model. Aspects of the shared world model may be presented to the human driver, who may then respond with a control input. Autonomy systems and the drivers on the vehicles then collaborate to make a collective decision to act or not to act and execute any such action in a coordinated manner.

Abstract: Methods and apparatus for controlling two or more vehicles travelling in formation. Selected vehicles may be fully or partially autonomously controlled; at least one vehicle is partially controlled by a human driver. Information is collected at each vehicle and from the drivers and it is shared with other vehicles and drivers to create a shared world model. Aspects of the shared world model may be presented to the human driver, who may then respond with a control input. Autonomy systems and the drivers on the vehicles then collaborate to make a collective decision to act or not to act and execute any such action in a coordinated manner.

Abstract: Techniques for operating an autonomous follower vehicle that is following a leader vehicle. A desired path to be traversed by the follower may be determined from a Leader Follower Relative Pose (LFRP) derived from sensor data. A pursuit pose is derived along the desired path from the present leader pose, such as either interpolating backward or forward. As a result, the pursuit distance no longer needs to be the same as the distance derived solely from the LFRP.

Abstract: Methods and apparatus that reduce demands on behavior of autonomous vehicles operating in a convoy, such as lane following or leader swap.

Abstract: A method and system for controlling an apparatus including receiving data indicative of an actual state of the apparatus, defining a first viewpoint relative to at least one of the environment and the apparatus, determining a first predicted state of the apparatus at time T, determining a first predicted state of the environment at time T, producing a first virtualized view from the first viewpoint, sending a first control signal to the apparatus after producing the first virtualized view, defining a second viewpoint relative to at least one of the apparatus and the environment, determining a second predicted state of the apparatus at time T+delta T, determining a second predicted state of the environment at time T+delta T, producing the second virtualized view from the second viewpoint, sending a second control signal to the apparatus after producing the second virtualized view, and changing the actual state of the apparatus based on the first control signal.

Abstract: A method and system for controlling an apparatus including receiving data indicative of an actual state of the apparatus, defining a first viewpoint relative to at least one of the environment and the apparatus, determining a first predicted state of the apparatus at time T, determining a first predicted state of the environment at time T, producing a first virtualized view from the first viewpoint, sending a first control signal to the apparatus after producing the first virtualized view, defining a second viewpoint relative to at least one of the apparatus and the environment, determining a second predicted state of the apparatus at time T+delta T, determining a second predicted state of the environment at time T+delta T, producing the second virtualized view from the second viewpoint, sending a second control signal to the apparatus after producing the second virtualized view, and changing the actual state of the apparatus based on the first control signal.

Abstract: A computer-assisted method for determining a position and orientation a sensor relative to a scene. The sensor has a plurality of degrees of freedom in position and orientation relative to the scene. The method includes sensing an image of the scene, the sensed image having a plurality of regions such that a sum of degrees of independent constraint of the plurality of regions equals or exceeds the degrees of freedom in position and orientation of the sensor relative to the scene, comparing the plurality of regions of the sensed image to a plurality of regions of a first image of the scene stored in a map, the first stored image representative of a position and orientation of the sensor relative to the scene, and determining sensor position and orientation based on the comparing.

Abstract: A mining machine having a position sensing and control apparatus is claimed. The mining machine has a vehicle body having forward and rearward ends and movable along a mine floor. A cutter head is mounted on the forward end of the mining machine for upward and downward movement relative to the vehicle body. A conveyor mounted on the vehicle body conveys material cut by the cutter head. The position sensing and control apparatus has at least one light source and at least one imaging device mounted on the machine. The position sensing and control apparatus captures images of natural features of an interior surface of a mine, digitizes the images and determines the distance between the imaging device and the natural feature to determine positional change of the machine.

Abstract: A method and apparatus for determining position is comprised of the steps of capturing an image related to the present position and comparing the captured image with one or more images from an iconic map. The iconic map is a map which stores images of a substantially flat surface over which a robot or vehicle is to operate. The stored images contain randomly occurring characteristics such as the fibers in a carpet, brush marks appearing in brushed concrete, and the like. Although such naturally occurring features are essentially random, when analyzed in small enough images, each image becomes unique. The position is determined based upon the image from the map which provides the highest correlation. Speed, wheel slippage, and other parameters can be calculated using the disclosed method.