Abstract: A driverless vehicle may include a processor, a sensor, a network interface, and a memory having stored thereon processor-executable instructions. The driverless vehicle may be configured to obtain a stream of sensor signals including sensor data related to operation of the driverless vehicle from the sensor and/or the network interface. The driverless vehicle may be configured to determine a confidence level associated with operation of the driverless vehicle from the sensor data, and store the confidence level and at least a portion of the sensor data. The driverless vehicle may also be configured to transmit via the network interface a request for teleoperator assistance, and the request may include the portion of the sensor data and the confidence level.

Abstract: A method for autonomously operating a driverless vehicle along a path between a first geographic location and a destination may include receiving communication signals from the driverless vehicle. The communication signals may include sensor data from the driverless vehicle and data indicating occurrence of an event associated with the path. The communication signals may also include data indicating that a confidence level associated with the path is less than a threshold confidence level due to the event. The method may also include determining, via a teleoperations system, a level of guidance to provide the driverless vehicle based on data associated with the communication signals, and transmitting teleoperations signals to the driverless vehicle. The teleoperations signals may include guidance to operate the driverless vehicle according to the determined level of guidance, so that a vehicle controller maneuvers the driverless vehicle to avoid, travel around, or pass through the event.

Abstract: A system, an apparatus or a process may be configured to implement an application that applies artificial intelligence and/or machine-learning techniques to predict an optimal course of action (or a subset of courses of action) for an autonomous vehicle system (e.g., one or more of a planner of an autonomous vehicle, a simulator, or a teleoperator) to undertake based on suboptimal autonomous vehicle performance and/or changes in detected sensor data (e.g., new buildings, landmarks, potholes, etc.). The application may determine a subset of trajectories based on a number of decisions and interactions when resolving an anomaly due to an event or condition. The application may use aggregated sensor data from multiple autonomous vehicles to assist in identifying events or conditions that might affect travel (e.g., using semantic scene classification). An optimal subset of trajectories may be formed based on recommendations responsive to semantic changes (e.g., road construction).

Abstract: Various embodiments relate generally to autonomous vehicles and associated mechanical, electrical and electronic hardware, computer software and systems, and wired and wireless network communications to provide an autonomous vehicle fleet as a service. More specifically, systems, devices, and methods are configured to simulate navigation of autonomous vehicles in various simulated environments. In particular, a method may include receiving data representing characteristics of a dynamic object, calculating a classification of a dynamic object to identify a classified dynamic object, identifying data representing dynamic-related characteristics associated with the classified dynamic object, forming a data model of the classified dynamic object, simulating a predicted range of motion of the classified dynamic object in a simulated environment to form a simulated dynamic object, and simulating a predicted response of a data representation of a simulated autonomous vehicle.

Abstract: A driverless vehicle may include a processor, a sensor, a network interface, and a memory having stored thereon processor-executable instructions. The driverless vehicle may be configured to obtain a stream of sensor signals including sensor data related to operation of the driverless vehicle from the sensor and/or the network interface. The driverless vehicle may be configured to determine a confidence level associated with operation of the driverless vehicle from the sensor data, and store the confidence level and at least a portion of the sensor data. The driverless vehicle may also be configured to transmit via the network interface a request for teleoperator assistance, and the request may include the portion of the sensor data and the confidence level.

Abstract: Various embodiments relate generally to autonomous vehicles and associated mechanical, electrical and electronic hardware, computer software and systems, and wired and wireless network communications to provide an autonomous vehicle fleet as a service. More specifically, systems, devices, and methods are configured to initiate modification of trajectories to influence navigation of autonomous vehicles. In particular, a method may include receiving a teleoperation message via a communication link from an autonomous vehicle, detecting data from the teleoperation message specifying an event associated with the autonomous vehicle, identifying one or more courses of action to perform responsive to detecting the data specifying the event, and generating visualization data to present information associated with the event to a display of a teleoperator computing device.

Abstract: Techniques for generating maps without shadows are discussed herein. A plurality of images can be captured by a vehicle traversing an environment representing various perspectives and/or lighting conditions in the environment. A shadow within an image can be identified by a machine learning algorithm trained to detect shadows in images and/or by projecting the image onto a three-dimensional (3D) map of the environment and identifying candidate shadow regions based on the geometry of the 3D map and the location of the light source. Shadows can be removed or minimized by utilizing blending or duplicating techniques. Color information and reflectance information can be added to the 3D map to generate a textured 3D map. A textured 3D map without shadows can be used to simulate the environment under different lighting conditions.

Abstract: Various embodiments relate generally to autonomous vehicles and associated mechanical, electrical and electronic hardware, computer software and systems, and wired and wireless network communications to provide an autonomous vehicle fleet as a service. More specifically, systems, devices, and methods are configured to simulate navigation of autonomous vehicles in various simulated environments. In particular, a method may include receiving data representing characteristics of a dynamic object, calculating a classification of a dynamic object to identify a classified dynamic object, identifying data representing dynamic-related characteristics associated with the classified dynamic object, forming a data model of the classified dynamic object, simulating a predicted range of motion of the classified dynamic object in a simulated environment to form a simulated dynamic object, and simulating a predicted response of a data representation of a simulated autonomous vehicle.

Abstract: Trajectory generation and/or execution architecture is described. In an example, a first signal can be determined at a first frequency, wherein the first signal comprises information associated with causing the system to move to a location. Further, a second signal can be determined at a second frequency different from the first frequency and based at least in part on the first signal. A system can be controlled to move to the location, based at least in part on the second signal.

Abstract: A system, an apparatus or a process may be configured to implement an application that applies artificial intelligence and/or machine-learning techniques to predict an optimal course of action (or a subset of courses of action) for an autonomous vehicle system (e.g., one or more of a planner of an autonomous vehicle, a simulator, or a teleoperator) to undertake based on suboptimal autonomous vehicle performance and/or changes in detected sensor data (e.g., new buildings, landmarks, potholes, etc.). The application may determine a subset of trajectories based on a number of decisions and interactions when resolving an anomaly due to an event or condition. The application may use aggregated sensor data from multiple autonomous vehicles to assist in identifying events or conditions that might affect travel (e.g., using semantic scene classification). An optimal subset of trajectories may be formed based on recommendations responsive to semantic changes (e.g., road construction).

Abstract: Techniques for generating maps without shadows are discussed herein. A plurality of images can be captured by a vehicle traversing an environment representing various perspectives and/or lighting conditions in the environment. A shadow within an image can be identified by a machine learning algorithm trained to detect shadows in images and/or by projecting the image onto a three-dimensional (3D) map of the environment and identifying candidate shadow regions based on the geometry of the 3D map and the location of the light source. Shadows can be removed or minimized by utilizing blending or duplicating techniques. Color information and reflectance information can be added to the 3D map to generate a textured 3D map. A textured 3D map without shadows can be used to simulate the environment under different lighting conditions.

Abstract: Techniques for generating maps without shadows are discussed herein. A plurality of images can be captured by a vehicle traversing an environment representing various perspectives and/or lighting conditions in the environment. A shadow within an image can be identified by a machine learning algorithm trained to detect shadows in images and/or by projecting the image onto a three-dimensional (3D) map of the environment and identifying candidate shadow regions based on the geometry of the 3D map and the location of the light source. Shadows can be removed or minimized by utilizing blending or duplicating techniques. Color information and reflectance information can be added to the 3D map to generate a textured 3D map. A textured 3D map without shadows can be used to simulate the environment under different lighting conditions.

Abstract: Techniques for decimating portions of a map of an environment are discussed herein. The environment can be represented by a three-dimensional (3D) map including a plurality of polygons and semantic information associated with the polygons. In some cases, decimation operations may be based on semantic information associated with the environment. Differing decimation operations and/or levels may be applied to polygons of different semantic classifications or differing contribution levels. Boundaries between regions having different semantic information can be preserved. Meshes can be decimated using different decimation operators or decimation levels and an accuracy of localizing can be compared using the various decimated meshes. An optimal mesh can be selected and sent to vehicles for localizing the vehicles in the environment.

Abstract: Techniques for decimating portions of a map of an environment are discussed herein. The environment can be represented by a three-dimensional (3D) map including a plurality of polygons and semantic information associated with the polygons. In some cases, decimation operations may be based on semantic information associated with the environment. Differing decimation operations and/or levels may be applied to polygons of different semantic classifications or differing contribution levels. Boundaries between regions having different semantic information can be preserved. Meshes can be decimated using different decimation operators or decimation levels and an accuracy of localizing can be compared using the various decimated meshes. An optimal mesh can be selected and sent to vehicles for localizing the vehicles in the environment.

Abstract: Various embodiments relate generally to autonomous vehicles and associated mechanical, electrical and electronic hardware, computer software and systems, and wired and wireless network communications to provide an autonomous vehicle fleet as a service. More specifically, systems, devices, and methods are configured to initiate modification of trajectories to influence navigation of autonomous vehicles. In particular, a method may include receiving a teleoperation message via a communication link from an autonomous vehicle, detecting data from the teleoperation message specifying an event associated with the autonomous vehicle, identifying one or more courses of action to perform responsive to detecting the data specifying the event, and generating visualization data to present information associated with the event to a display of a teleoperator computing device.

Abstract: A method for operating a driverless vehicle may include receiving, at the driverless vehicle, sensor signals related to operation of the driverless vehicle, and road network data from a road network data store. The method may also include determining a driving corridor within which the driverless vehicle travels according to a trajectory, and causing the driverless vehicle to traverse a road network autonomously according to a path from a first geographic location to a second geographic location. The method may also include determining that an event associated with the path has occurred, and sending communication signals to a teleoperations system including a request for guidance and one or more of sensor data and the road network data. The method may include receiving, at the driverless vehicle, teleoperations signals from the teleoperations system, such that the vehicle controller determines a revised trajectory based at least in part on the teleoperations signals.

Abstract: Techniques for generating and executing trajectories to guide autonomous vehicles are described. In an example, a first computer system associated with an autonomous vehicle can generate, at a first operational frequency, a route to guide the autonomous vehicle from a current location to a target location. The first computer system can further determine, at a second operational frequency, an instruction for guiding the autonomous vehicle along the route and can generate, at a third operational frequency, a trajectory based at least partly on the instruction and real-time processed sensor data. A second computer system that is associated with the autonomous vehicle and is in communication with the first computer system can execute, at a fourth operational frequency, the trajectory to cause the autonomous vehicle to travel along the route. The separation of the first computer system and the second computer system can provide enhanced safety, redundancy, and optimization.

Abstract: A teleoperator device may be configured to obtain a request for teleoperator assistance from a driverless vehicle and obtain teleoperator data in response to the request. The teleoperator device may also be configured to record at least some of the teleoperator input and/or guidance transmitted to the driverless vehicle based on the teleoperator input. Upon receiving a subsequent request, the teleoperator device may be configured to reproduce at least part of the former teleoperator input and/or to provide an option to activate guidance associated with the teleoperator input. The teleoperator device may also be configured to train a model and/or use a model to determine from vehicle data an option for presentation via a teleoperator interface and/or a presentation configuration of the teleoperator interface.

Abstract: A teleoperator device may be configured to obtain a request for teleoperator assistance from a driverless vehicle and obtain teleoperator data in response to the request. The teleoperator device may also be configured to record at least some of the teleoperator input and/or guidance transmitted to the driverless vehicle based on the teleoperator input. Upon receiving a subsequent request, the teleoperator device may be configured to reproduce at least part of the former teleoperator input and/or to provide an option to activate guidance associated with the teleoperator input. The teleoperator device may also be configured to train a model and/or use a model to determine from vehicle data an option for presentation via a teleoperator interface and/or a presentation configuration of the teleoperator interface.

Abstract: A method for autonomously operating a driverless vehicle along a path between a first geographic location and a destination may include receiving communication signals from the driverless vehicle. The communication signals may include sensor data from the driverless vehicle and data indicating occurrence of an event associated with the path. The communication signals may also include data indicating that a confidence level associated with the path is less than a threshold confidence level due to the event. The method may also include determining, via a teleoperations system, a level of guidance to provide the driverless vehicle based on data associated with the communication signals, and transmitting teleoperations signals to the driverless vehicle. The teleoperations signals may include guidance to operate the driverless vehicle according to the determined level of guidance, so that a vehicle controller maneuvers the driverless vehicle to avoid, travel around, or pass through the event.