Abstract: Methods and systems for reducing driver distraction and situation non-awareness related to a dialogue of an automated dialogue system in a vehicle. For a dialogue policy learning session, driver distraction is introduced as an input into a penalty assigner that assesses dialogue quality, and dialogue acts are extended to include dialogues and dialogue act presentation styles which reduce driver workload related to dialogues. The automated dialogue system policy is developed during the learning process by optimizing the penalties, an that automated dialogue workload is reduced in response to increased workload or anticipated workload on the driver. Methods and systems are presented for responding to both actual workload in regular vehicles as well as anticipated workload in autonomous vehicles.

Abstract: Methods and apparatus are provided for filtering sound in a vehicle. The methods includes generating a microphone signal corresponding to sounds in the passenger compartment. The methods also include receiving an audio-based service being utilized by at least one occupant. A sound separation mode is selected from the plurality of sound separation modes. Each sound separation mode corresponds to a different audio filtering scheme. The method also includes filtering the input received by the microphone in accordance with the selected sound separation mode to generate at least one filtered signal.

Abstract: Systems and methods for a vehicle including an eye tracking device. The systems and methods use input from the eye tracking device. The systems and methods are configured to communicate with a driver based on input from the eye tracking device. For example, the systems and methods are configured to generate indicators on a display based on input from the eye tracking device.

Abstract: A method is disclosed that provides text-to-speech (TTS) functionality to a telematics unit of a telematics-equipped vehicle. The method includes: receiving text content to be played back by an audio system of the telematics-equipped vehicle; determining, by a processor, a TTS rendering process to be used for the text content from a plurality of TTS rendering processes, wherein the plurality of TTS rendering processes include local TTS rendering using a local TTS engine at the telematics-equipped vehicle and remote TTS rendering using a remote TTS engine at a communications center; and causing, by the processor, the text content to be rendered as an audio signal for playback by the telematics-equipped vehicle using the determined TTS rendering process.

Abstract: The present disclosure relates to systems for implementing a computer-readable storage device comprising instructions, including a behavior recognizer, that, when executed by a system having a processor, cause the processor to perform operations, for providing personalized proactive assistance to a vehicle user. The operations comprise receiving a behavior input data package comprising a sequence of user events using the behavior recognizer, and determining the behavior input data package indicates proactive assistance to be presented to the vehicle user by the system, using a user behavior model and a machine state model of the behavior recognizer. The disclosure also relates to methods for providing personalized proactive assistance to a vehicle user.

Abstract: An audio signal may be received, in a processor associated with a vehicle. Sound related vehicle information representing one or more sounds may be received by the processor. The sound related vehicle information may or may not include an audio signal. A speech recognition process or system may be modified based on the sound related vehicle information.

Abstract: Methods and systems for reducing driver distraction and situation non-awareness related to a dialog of an automated dialog system in a vehicle. For a dialog policy learning session, driver distraction is introduced as an input into a penalty assigner that assesses dialog quality, and dialog acts are extended to include dialogs and dialog act presentation styles which reduce driver workload related to dialogs. The automated dialog system policy is developed during the learning process by optimizing the penalties, so that automated dialog workload is reduced in response to increased workload or anticipated workload on the driver. Methods and systems are presented for responding to both actual workload in regular vehicles as well as anticipated workload in autonomous vehicles.

Abstract: An automated vehicle includes a control system configured to selectively transfer the automated vehicle from an automated control mode to a manual control mode based on a transfer-of-control criterion. The transfer-of-control criterion is based on a current context of the automated vehicle and a dataset of previous transfer-of-control events and previous contexts associated with the operation of a plurality of additional automated vehicles.

Abstract: Methods and control systems are provided for automatically controlling operation of a vehicle. In one embodiment, the control system includes an exterior sensor for sensing the environment outside the vehicle. A processor is in communication with the exterior sensor and configured to calculate a driving plan of the vehicle based at least partially on the sensed environment outside the vehicle. The processor is also configured to calculate a confidence level of the driving plan of the vehicle based at least partially on the sensed environment around the vehicle. The control system also includes a display in communication with the processor and configured to receive data from the processor and display a representation of at least one of the driving plan and the confidence level.

Abstract: A method and system may manage the driver's attention while driving. The driver may be driving using an autonomous driving system or limited-ability autonomous driving system. A method may detect, by a sensor, characteristics of a driver; determine, based on the detected characteristics of the driver, whether the driver exercises sufficient supervisory control of the vehicle; and provide a series of one or more prompts, wherein each prompt's intrusiveness is related to the determination of whether the driver exercises sufficient supervisory control of the vehicle.

Abstract: A vehicle apparatus includes a seat and a transducer configured to vibrate such that a vibration is felt by a person sitting in the seat. A transducer control signal that is transmitted to the transducer is based on output from a sensor of the apparatus configured to measure data including parameters indicative of at least one of a vehicle system function, a vehicle environment, and driver state, or on output from the vehicle system indicating parameters related to the vehicle system, vehicle environment, or driver state.

Abstract: A method and system are disclosed for adaptive driver guidance for navigation and location-based services based on user behavior patterns. A driver-facing camera and a gaze tracking system determine the location of the driver's visual focus while an outside-facing camera detects and interprets external driving situations, a microphone and a speech analyzer identify driver vocalizations, and driver-proximate sensors and the driver-facing camera detect driver emotions. The driver's visual focus, the driver vocalizations and the driver emotions, along with vehicle system parameters from a data bus, are used to evaluate driver satisfaction with navigation guidance and determine driver behavior patterns. An adaptive navigation guidance engine modifies navigation guidance content and timing based on the driver satisfaction and behavior patterns. Adaptation of guidance for location-based services is also provided.

Abstract: A unified microphone pre-processing system includes a plurality of microphones arranged within a vehicle passenger compartment, a processing circuit or system configured to receive signals from one or more of the plurality of microphones, and the processing circuit configured to enhance the received signals for use by at least two of a telephony processing application, an automatic speech recognition processing application, and a noise cancellation processing application. The method includes receiving signals from one or more of a plurality of microphones arranged within a vehicle passenger compartment, and enhancing the received signals for use by at least two of a telephony processing application, an automatic speech recognition processing application, and a noise cancellation processing application. A computer readable medium containing executable instructions to cause a processor to perform a method in accordance with an embodiment of the invention is also described.

Abstract: A method for adaptive driver guidance for navigation and location-based services. A navigation system onboard a vehicle records errors, including both system errors and user errors, where the errors can be detected by missed turns, re-routing, and similar events. The error data is transmitted to a central server, where the data is analyzed to determine patterns of errors, both for an individual driver and across many drivers. Roadway locations which frequently experience driver navigational errors have the error type integrated as a route feature, and future navigational guidance is adapted to improve driver performance. Adaptations can include increased or decreased frequency, detail, timing and location of navigational instructions. Individual driver guidance can also be adapted based on the driver's tendency to make errors in response to specific guidance instructions. Adaptation of guidance for location-based services is also provided.

Abstract: A system and method for adapting a speech recognition and generation system. The system and method include providing a speech recognition and generation engine that processes speech received from a user and providing a dictionary adaptation module that adds out of vocabulary words to a baseline dictionary of the speech recognition and generation system. Words are added by extracting words that are encountered and adding out of vocabulary words to the baseline dictionary of the speech recognition and generation system.

Abstract: A vehicle includes a multi-touch screen and a controller. A method for providing information related to a vehicle function includes visually displaying on the multi-touch screen a representation of a portion of the vehicle including a plurality of operating sections including a plurality of vehicle functions and a HELP icon. One of the vehicle functions is selected in response to a user action that includes a dragging motion on the multi-touch screen between the HELP icon and the selected vehicle function. Information related to the selected vehicle function is accessed. A preferred mode is employed to communicate the information related to the selected vehicle function to the user.

Abstract: A method and system may manage the driver's attention while driving. The driver may be driving using an autonomous driving system or limited-ability autonomous driving system. A steering wheel device may indicate to the driver a level of required supervisory control of a vehicle. The steering wheel device may include indicators to flash lights, vibrate, or provide other indicators. The indicators may have distinct levels of intensity for each level of supervisory control required to safely control a vehicle.

Abstract: Methods and systems are provided for managing spoken dialog within a speech system. The method includes establishing a spoken dialog session having a first dialog context, and receiving a context trigger associated with an action performed by a user. In response to the context trigger, the system changes to a second dialog context. In response to a context completion condition, the system then returns to the first dialog context.

Abstract: A method for providing audible signals (such as speech) to a driver of a vehicle which appear to originate from a virtual sound source in front of the driver, so that it will feel normal for the driver to respond interactively by speaking without turning the head to the source of the audible signal. The driver's head position is estimated according to data provided by sensors in the driver's seat, and this position data, together with acoustical characteristics of the vehicle interior, is used to derive a transfer function for filtering electrical audible signals to the loudspeakers to simulate a virtual sound source in front of the driver.

Abstract: A method for augmenting a graphic displayed on a surface inside of a vehicle using a rear seat entertainment projection (RSEP) system includes generating the graphic for display on the surface inside the vehicle. When the graphic is displayed on the surface, an input that causes a reaction to the graphic displayed upon the surface is obtained, and the graphic displayed on the surface is augmented based on the reaction to the graphic.