Abstract: A method for training a neural network including receiving a plurality of images of a driver's field of view, generating a depth information, a driver's gaze probability and a known object indication for each of the plurality of images, estimating a probability of an unknown object within each of the plurality of images in response to the depth information, the driver's gaze probability and the known object indication, generating a plurality of annotated images in response to annotating each of the plurality of images having the probability of the unknown object exceeding a threshold probability to identify the unknown object, wherein each of the plurality of annotated images is annotated to identify the unknown object, and training the neural network in response to the plurality of annotated images.

Abstract: A method for adaptive cruise control for a vehicle may include performing a plurality of measurements of an environment surrounding the vehicle using a vehicle perception sensor. The environment surrounding the vehicle includes a plurality of remote vehicles. The method further may include determining one or more speed decision algorithm inputs based at least in part on the plurality of measurements. The method further may include determining an optimal vehicle speed for the vehicle based at least in part on the one or more speed decision algorithm inputs. The method further may include controlling the vehicle such that a speed of the vehicle is the optimal vehicle speed.

Abstract: A system includes a monitoring module configured to determine at least one of a location and a route of a vehicle, and a recommendation module configured to identify a plurality of service stations based on the at least one of the location and the route of the vehicle. The monitoring module is configured to compare a preference of a first user of the vehicle to preference data related to a second user of another vehicle, predict a preferred service station of the plurality of service stations based on the comparing, and present a recommendation to the first user, the recommendation indicating the preferred service station.

Abstract: An assistance system includes: a perception module configured to collect sensor data including data tracking behavior of a vehicle occupant in a host vehicle, and to determine perception information describing a current situation warranting initiation of an interactive dialog with the vehicle occupant; an interactive goal module configured to determine an interactive goal based on the determined perception information; an interaction timing module configured to determine timing for initiating the interactive dialog based on the interactive goal; a dialog module configured to, based on the perception information and the timing, initiate the interactive dialog to provide at least one of a suggestion and an offer to the vehicle occupant; and a vehicle control module configured to control operation of at least one of a device and a system of the host vehicle in response to the vehicle occupant accepting the at least one of the suggestion and the offer.

Abstract: A system for detecting an impairment of an operator of a vehicle includes an alcohol sensor, a camera, a start control, and a controller in electrical communication with the alcohol sensor, the camera, and the start control, the controller including a processor and a memory, the memory including instructions such that the processor is programmed to: determine that alcohol is detected using the alcohol sensor, disable the start control based on the detection of alcohol, perform a gaze nystagmus assessment of the operator using the camera, determine if the operator is impaired based on the gaze nystagmus assessment, and enable the start control when the operator is not impaired.

Abstract: Methods and systems are provided that include one or more first sensors, one or more second sensors, and a processor of a vehicle. The one or more first sensors have a first modality, and are configured to receive a first input from a passenger of the vehicle pertaining to a request. The processor is configured to at least facilitate providing instructions to the passenger for providing an additional input pertaining to the request within a predetermined amount of time. The one or more second sensors have a second modality that is different from the first modality, and are configured to receive a second input from the passenger pertaining to the request. The processor is further configured to at least facilitate interpreting the second input; and performing a vehicle action corresponding to the request based on the interpreting of the second input.

Abstract: A method for adaptive cruise control for a vehicle may include performing a plurality of measurements of an environment surrounding the vehicle using a vehicle perception sensor. The environment surrounding the vehicle includes a plurality of remote vehicles. The method further may include determining one or more speed decision algorithm inputs based at least in part on the plurality of measurements. The method further may include determining an optimal vehicle speed for the vehicle based at least in part on the one or more speed decision algorithm inputs. The method further may include controlling the vehicle such that a speed of the vehicle is the optimal vehicle speed.

Abstract: A computer-implemented method when executed by data processing hardware causes the data processing hardware to perform operations. The operations include generating, at an occupancy estimation network, an occupancy probability at one or more voxels, predicting, via a gaze prediction model, a gaze direction of a gaze prediction, and identifying, based on the predicted gaze direction, an object of interest. The operations also include generating, via an occupancy estimation application, a gaze saliency map based on the gaze direction and identified object of interest, and updating, based on the determined gaze direction and the gaze saliency map, the occupancy probability of the one or more voxels.

Abstract: A computer-implemented method when executed by data processing hardware causes the data processing hardware to perform operations. The operations include generating, at an occupancy estimation network, an occupancy probability at one or more voxels, predicting, via a gaze prediction model, a gaze direction of a gaze prediction, and identifying, based on the predicted gaze direction, an object of interest. The operations also include generating, via an occupancy estimation application, a gaze saliency map based on the gaze direction and identified object of interest, and updating, based on the determined gaze direction and the gaze saliency map, the occupancy probability of the one or more voxels.

Abstract: A system for managing a fleet of electric vehicles and respective fleet drivers includes a command unit having a processor and tangible, non-transitory memory on which instructions are recorded. The command unit is adapted to obtain input variables, including respective fleet tasks and their priority status. Route data for the respective fleet tasks is obtained. The command unit is adapted to obtain an objective function defined by a plurality of influence factors having respective weights. The command unit is adapted to obtain optimal charging schedules respectively for the electric vehicles and match the respective fleet tasks to the electric vehicles and the respective fleet drivers, based in part on the objective function, input variables and the route data. The influence factors may include energy cost optimization, timeliness of task completion and minimizing range anxiety. In some embodiments, the respective weights of the influence factors are designated by a fleet manager.

Abstract: An assistance system includes: a perception module configured to collect sensor data including data tracking behavior of a vehicle occupant in a host vehicle, and to determine perception information describing a current situation warranting initiation of an interactive dialog with the vehicle occupant; an interactive goal module configured to determine an interactive goal based on the determined perception information; an interaction timing module configured to determine timing for initiating the interactive dialog based on the interactive goal; a dialog module configured to, based on the perception information and the timing, initiate the interactive dialog to provide at least one of a suggestion and an offer to the vehicle occupant; and a vehicle control module configured to control operation of at least one of a device and a system of the host vehicle in response to the vehicle occupant accepting the at least one of the suggestion and the offer.

Abstract: A vehicle control system for camera-based vehicle navigation includes at least one vehicle camera configured to capture an image of a front view from a vehicle, a global positioning system (GPS) receiver configured to obtain a current location of the vehicle, a vehicle user interface including a display, and a vehicle control module. The vehicle control module is configured to obtain the current location of the vehicle via the GPS receiver, identify a sequence of vehicle navigation steps to a target destination, capture the image via the at least one vehicle camera, process the image with a machine learning model to detect multiple objects in the image, rank the multiple objects according to landmark scoring criteria indicative of an object recognition likelihood by a driver of the vehicle, and display a highest ranked one of the multiple objects in association with a next vehicle navigation step.

Abstract: A system for detecting an impairment of an operator of a vehicle includes an alcohol sensor, a camera, a start control, and a controller in electrical communication with the alcohol sensor, the camera, and the start control, the controller including a processor and a memory, the memory including instructions such that the processor is programmed to: determine that alcohol is detected using the alcohol sensor, disable the start control based on the detection of alcohol, perform a gaze nystagmus assessment of the operator using the camera, determine if the operator is impaired based on the gaze nystagmus assessment, and enable the start control when the operator is not impaired.

Abstract: A method of retrieving a lost item from a compartment to an owner of the lost item is provided. The method comprises detecting the lost item in the compartment to define an item image of the lost item relative to the compartment, updating an inventory list of lost objects, and identifying at least one potential user of the lost item. The method further comprises providing notification to the at least one potential user and providing viewable access of the item image. The method further comprises verifying ownership of the lost item to define the owner of the lost item, determining a preferred pickup location for the owner, storing the lost item at the preferred location defining a stored item, and confirming identity of the owner for retrieval of the stored item at the preferred location. The method further comprises allowing access to the stored item from the preferred location.

Abstract: A method of managing operator take-over of autonomous vehicle. The method includes gathering information on an external surrounding of the autonomous vehicle; analyzing the gathered information on the external surrounding of the autonomous vehicle to determine an upcoming traffic pattern; gathering information on an operator of the autonomous vehicle; analyzing the gathered information on the operator of the autonomous vehicle to determine an operator behavior; predicting an operator action based on the determined upcoming traffic pattern and the determined operator behavior; and initiating a predetermined vehicle response based on the predicted operator action. The predicting the operator action includes comparing the determined upcoming traffic pattern with a similar historic traffic pattern and retrieving a historical operator action in response to the similar historical pattern.

Abstract: A method of notifying an owner of a lost item in a vehicle having a vehicle compartment is provided. The method comprises providing at least one sensor to sense the lost item in the vehicle compartment. The method further comprises sensing the lost item on a point relative to a spherical coordinate system to define a sensed item data and determining a position of the lost item in cartesian coordinates based on the sensed item data to define a position data. The method further comprises translating the sensed item data and the position data for visualization of the lost item to define an item image of the lost item relative to the vehicle compartment, and updating an inventory list of lost objects to include the lost item with the item image. The method further comprises identifying the owner of the lost item by way of a perception algorithm, providing notification to the owner of the lost item, and providing viewable access of the item image such that the image is viewed by the owner of the lost item.

Abstract: A system for managing a fleet of electric vehicles and respective fleet drivers includes a command unit having a processor and tangible, non-transitory memory on which instructions are recorded. The command unit is adapted to obtain input variables, including respective fleet tasks and their priority status. Route data for the respective fleet tasks is obtained. The command unit is adapted to obtain an objective function defined by a plurality of influence factors having respective weights. The command unit is adapted to obtain optimal charging schedules respectively for the electric vehicles and match the respective fleet tasks to the electric vehicles and the respective fleet drivers, based in part on the objective function, input variables and the route data. The influence factors may include energy cost optimization, timeliness of task completion and minimizing range anxiety. In some embodiments, the respective weights of the influence factors are designated by a fleet manager.

Abstract: A method of monitoring a driver in an autonomous vehicle includes monitoring, with a driver monitoring system, a driver of a vehicle, collecting, with a data processor, data from the driver monitoring system related to gaze behavior of the driver, classifying, with the data processor, the driver as one of a plurality of driver statuses based on the data from the driver monitoring system, and sending, with the data processor, instructions to at least one vehicle system based on the classification of the driver.

Abstract: A method of retrieving a lost item from a compartment to an owner of the lost item is provided. The method comprises detecting the lost item in the compartment to define an item image of the lost item relative to the compartment, updating an inventory list of lost objects, and identifying at least one potential user of the lost item. The method further comprises providing notification to the at least one potential user and providing viewable access of the item image. The method further comprises verifying ownership of the lost item to define the owner of the lost item, determining a preferred pickup location for the owner, storing the lost item at the preferred location defining a stored item, and confirming identity of the owner for retrieval of the stored item at the preferred location. The method further comprises allowing access to the stored item from the preferred location.

Abstract: A method of notifying an owner of a lost item in a vehicle having a vehicle compartment is provided. The method comprises providing at least one sensor to sense the lost item in the vehicle compartment. The method further comprises sensing the lost item on a point relative to a spherical coordinate system to define a sensed item data and determining a position of the lost item in cartesian coordinates based on the sensed item data to define a position data. The method further comprises translating the sensed item data and the position data for visualization of the lost item to define an item image of the lost item relative to the vehicle compartment, and updating an inventory list of lost objects to include the lost item with the item image. The method further comprises identifying the owner of the lost item by way of a perception algorithm, providing notification to the owner of the lost item, and providing viewable access of the item image such that the image is viewed by the owner of the lost item.