Abstract: The present teaching relates to method, system, and medium, for generating an augmented alert in a hybrid vehicle. First information indicating an upcoming switch in an operating mode of the vehicle is received, which specifies a set of tasks, arranged in an order, to be completed by a driver in the vehicle to achieve the upcoming switch, and a task duration for each of the set of tasks by which the task is to be completed. A current state of the driver is obtained and used to determine a set of warnings to alert the driver to perform the set of tasks. Each warning corresponds to a task in the set of tasks and is created based on the current state of the driver. A warning schedule is generated based on the set of warnings in the order of the set of tasks and transmitted so that warnings in the warning schedule are delivered to the driver.

Abstract: The present teaching relates to method, system, medium, and implementation of determining depth information in autonomous driving. Stereo images are first obtained from multiple stereo pairs selected from at least two stereo pairs. The at least two stereo pairs have stereo cameras installed with the same baseline and in the same vertical plane. Left images from the multiple stereo pairs are fused to generate a fused left image and right images from the multiple stereo pairs are fused to generate a fused right image. Disparity is then estimated based on the fused left and right images and depth information can be computed based on the stereo images and the disparity.

Abstract: Embodiments described herein include a method of receiving, by a moving assisting vehicle, a calibration assistance request related to a moving ego vehicle that requested assistance in collaborative calibration of a sensor deployed on the moving ego vehicle. The method further includes analyzing the calibration assistance request to extract at least one of a schedule or an assistance route associated with the requested assistance. The method includes communicating with the moving ego vehicle about a desired location relative to the position of the moving ego vehicle for the moving assisting vehicle to be in order to assist the sensor to acquire information of a target present on the moving assisting vehicle. The method includes facilitating to drive the moving assisting vehicle to reach the desired location to achieve the collaborative calibration of the sensor on the moving ego vehicle.

Abstract: The present teaching relates to method, system, and medium, for switching a mode of a vehicle. Real-time data related to the vehicle are received, which include intrinsic/extrinsic capability parameters, based on which a set of tasks to switch from a current mode to a different mode is determined. A first duration of time required for the switch is determined based on a first risk evaluated with respect to the current mode and the real-time data. A task duration time needed by a driver to complete the task is estimated for each of the set of tasks. A second risk for the switching is estimated based on the required first duration of time and a total task duration times needed to complete the set of tasks. The switch is carried out when the second risk satisfying a criterion.

Abstract: The present teaching relates to system, method, medium for in-situ perception in an autonomous driving vehicle. A plurality of types of sensor data acquired continuously by a plurality of types of sensors deployed on the vehicle are first received, where the plurality of types of sensor data provide information about surrounding of the vehicle. Based on at least one model, one or more items are tracked from a first of the plurality of types of sensor data acquired by one or more of a first type of the plurality of types of sensors, wherein the one or more items appear in the surrounding of the vehicle. At least some of the one or more items are then automatically labeled on-the-fly via either cross modality validation or cross temporal validation of the one or more items and are used to locally adapt, on-the-fly, the at least one model in the vehicle.

Abstract: In one or more embodiments, a method comprises receiving, at a processor, an input signal from an input device in response to a first actuation of the input device by a driver of an autonomous vehicle. The input device is a device disposed with the autonomous vehicle and has a second actuation of the input device associated with a standard operation of the input device. The second actuation has an actuation pattern different from an actuation pattern of the first actuation. In response to the input signal, a determination is made by the processor to determine whether the autonomous vehicle can perform a maneuver safely. In response to determining that the autonomous vehicle can perform the maneuver safely, a signal is sent by the processor to cause the autonomous vehicle to perform the maneuver.

Abstract: A method includes detecting, via a processor of an autonomous vehicle, an upcoming downhill road segment of a route on which the autonomous vehicle is currently travelling. The detection is based on map data, camera data, and/or inertial measurement unit (IMU) data. In response to detecting the upcoming downhill road segment, a descent plan is generated for the autonomous vehicle. The descent plan includes a speed profile and a brake usage plan. The brake usage plan specifies a non-zero amount of retarder usage and an amount of foundation brake usage for a predefined time period. The method also includes autonomously controlling the autonomous vehicle, based on the descent plan, while the autonomous vehicle descends the downhill road segment.

Abstract: Systems, methods, and non-transitory computer-readable media can perform operations comprising determining visual geometry detections (e.g., lane line detections) associated with geometry corresponding with a map; aligning the visual geometry detections with the geometry based on transformations associated with selected degrees of freedom; and determining a pose of a vehicle based on alignment of the visual geometry detections with the geometry.

Abstract: The present teaching relates to system, method, medium for in-situ perception in an autonomous driving vehicle. A plurality of types of sensor data are received, which are acquired by a plurality of types of sensors deployed on the vehicle to provide information about surrounding of the vehicle. Based on at least one model, one or more surrounding items are tracked from a first of the plurality of types of sensor data acquired by a first type sensors. At least some of the tracked items are automatically labeled via cross validation and are used to locally adapt, on-the-fly, the at least one model. Model update information is received which from a model update center, which is derived based on the labeled at least some items. The at least one model is updated using the model update information.

Abstract: A computer system obtains a plurality of road images captured by one or more cameras attached to one or more vehicles. The one or more vehicles execute a model that facilitates driving of the one or more vehicles. For each road image of the plurality of road images, the computer system determines, in the road image, a fraction of pixels having an ambiguous lane marker classification. Based on the fraction of pixels, the computer system determines whether the road image is an ambiguous image for lane marker classification. In accordance with a determination that the road image is an ambiguous image for lane marker classification, the computer system enables labeling of the image and adds the labeled image into a corpus of training images for retraining the model.

Abstract: In an embodiment, a method comprises detecting, at a processor of an autonomous vehicle, a discrepancy between a map and a property sensed by at least one sensor onboard the autonomous vehicle, the property being associated with an external environment of the autonomous vehicle. In response to detecting the discrepancy, and based on the discrepancy, an annotation for the map is generated via the processor. A signal representing the annotation is caused to be transmit to a compute device that is remote from the autonomous vehicle. A signal representing a map update is received from the compute device that is remote form the autonomous vehicle. The map update is generated based on the annotation, the map update (1) including replacement information for a region of the map associated with the annotation, and (2) not including replacement information for a remainder of the map.

Abstract: An autonomous vehicle can obtain sensor data. Upon determining that the autonomous vehicle is in a lane adjacent a shoulder, and there is an object in the shoulder, the autonomous vehicle can determine if performing a lane change maneuver out of the lane prior to the autonomous vehicle being positioned adjacent to the object is feasible. If it is, the lane change maneuver can be performed. If it is not, a nudge maneuver and/or a deceleration can be performed.

Abstract: The present teaching relates to method, system, medium, and implementation of in-situ perception in an autonomous driving vehicle. A plurality of types of sensor data are acquired continuously via a plurality of types of sensors deployed on the vehicle, where the plurality of types of sensor data provide information about surrounding of the vehicle. One or more items surrounding the vehicle are tracked, based on some models, from a first of the plurality of types of sensor data from a first type of the plurality of types of sensors. A second of the plurality of types of sensor data are obtained from a second type of the plurality of sensors and are used to generate validation base data. Some of the one or more items are labeled, automatically, via validation base data to generate labeled at least some item, which is to be used to generate model updated information for updating the at least one model.

Abstract: In some embodiments, a method comprises receiving, at a processor of an autonomous vehicle and from at least one sensor, sensor data distributed within a time window. A first event being a first event type occurring at a first time in the time window is identified by the processor using a software model based on the sensor data. At least one first attribute associated with the first event is extracted by the processor. A second event being the first event type occurring at a second time in the time window is identified by the processor based on the at least one first attribute. In response to determining that the second event is not yet recognized as being the first event type, a first label for the second event is generated by the processor.

Abstract: The present teaching relates to method, system, and medium, for operating a vehicle. The method includes the steps of receiving Real-time data related to the vehicle are received. A current mode of operation of the vehicle is determined. A first risk associated with the current mode of operation of the vehicle is evaluated based on the real-time data in accordance with a risk model. If the first risk satisfies a first criterion, a second risk associated with switching the current mode to a different mode of operation of the vehicle is determined. The vehicle is switched from the current mode to the different mode if the second risk satisfies a second criterion.

Abstract: The present teaching relates to a method, system, medium, and implementation of processing image data in an autonomous driving vehicle. Sensor data acquired by one or more types of sensors deployed on the vehicle are continuously received. The sensor data provide different information about surrounding of the vehicle. Based on a first data set acquired by a first sensor of a first type of the one or more types of sensors at a specific time, an object is detected, where the first data set provides a first type of information about the surrounding of the vehicle. Depth information of the object is then estimated via object centric stereo at object level based on the object detected as well as a second data set acquired by a second sensor of the first type of the one or more types of sensors at the specific time. The second data set provides the first type of information about the surrounding of the vehicle with a different perspective as compared with the first data set.

Abstract: The present teaching relates to method, system, medium, and implementations for sensor calibration. An ego vehicle determines whether a sensor deployed on the ego vehicle to facilitate autonomous driving of the ego vehicle needs to be calibrated and sends, if it is determined that the sensor needs to be calibrated, a request for assistance in collaborative calibration of the sensor, with a first position of the ego vehicle or a first configuration of the sensor with respect to the ego vehicle. When a response of the request is received, an assisting vehicle is indicated to travel to be near the ego vehicle to facilitate the calibration of the sensor by collaborating with the moving ego vehicle and the ego vehicle coordinates with the assisting vehicle to enable the sensor to acquire information of a target present on the assisting vehicle for the collaborative calibration of the sensor.

Abstract: The present teaching relates to method, system, and implementations for glare control. A sensor housing assembly is provided on an autonomous vehicle to house at least one sensor therein and protect the at least one sensor from negative impact from an environment including glare from the environment that prevents the at least one sensor from capturing accurate information regarding a field of view with respect to the environment to facilitate autonomous driving of the autonomous vehicle. The negative impact on the at least one sensor is determined by a controller, which then activates a glare blocking mechanism in response to the determined negative impact. The glare blocking mechanism being mounted on the sensor housing assembly and configured to assist in blocking glare with respect to the at least one sensor.

Abstract: The present teaching relates to apparatus, method, medium, and implementations for initiating sensor calibration. A first GPS signal is received by a GPS receiver residing in an ego vehicle and is used to determine a first geo-position of the ego vehicle. A GPS related signal transmitted by a fiducial marker is received and is used to obtain a second geo-position of the fiducial marker. A distance between the ego vehicle and the fiducial marker is determined based on the first and second geo-positions and is used to determine whether to initiate calibration of one or more sensors using the fiducial marker.

Abstract: In some embodiments, a method can include executing a first machine learning model to detect at least one lane in each image from a first set of images. The method can further include determining an estimate location of a vehicle for each image, based on localization data captured using at least one localization sensor disposed at the vehicle. The method can further include selecting lane geometry data for each image, from a map and based on the estimate location of the vehicle. The method can further include executing a localization model to generate a set of offset values for the first set of images based on the lane geometry data and the at least one lane in each image. The method can further include selecting a second set of images from the first set of images based on the set of offset values and a previously-determined offset threshold.