Abstract: A method for augmenting a graphic displayed on a surface inside of a vehicle using a rear seat entertainment projection (RSEP) system includes generating the graphic for display on the surface inside the vehicle. When the graphic is displayed on the surface, an input that causes a reaction to the graphic displayed upon the surface is obtained, and the graphic displayed on the surface is augmented based on the reaction to the graphic.

Abstract: Systems and methods for arbitrating spoken dialog services include determining a capability catalog associated with a plurality of devices accessible within an environment. The capability catalog includes a list of the plurality of devices mapped to a list of spoken dialog services provided by each of the plurality of devices. The system arbitrates between the plurality of devices and the spoken dialog services in the capability catalog to determine a selected device and a selected dialog service.

Abstract: A method to navigate a vehicle utilizing a graphic projection display, includes monitoring a navigation status graphic representing a navigation intent displayed upon the graphic projection display, monitoring a user input indicated to a portion of the graphic projection display, initiating a user-defined navigation command based on the monitored navigation status graphic and the monitored user input, and operating the vehicle in accordance with the user-defined navigation command.

Abstract: Methods and systems are provided for shaping speech dialog of a speech system. In one embodiment, a method includes: receiving data related to a first utterance from a user of the speech system; processing the data based on at least one attribute processing technique that determines at least one attribute of the first utterance; determining a shaping pattern based on the at least one attribute; and generating a speech prompt based on the shaping pattern.

Abstract: A method and system for driver attention management system may include means for closed-loop diagnostics. A convenience message may alert a driver of an item of interest to the driver. A sensor may detect the driver's response to the convenience message. Based on the response to the convenience message, the characteristics of an attentive response from the driver may be determined. The determined attentive response may be used by a driver attention management system. The driver attention management system may be able to diagnose errors in the sensors that are used in the driver attention management system. The driver attention management system may also be able to determine whether a driver is exercising sufficient supervisory control of a vehicle by determining whether the driver is attentively responding to prompts provided by the driver attention management system. The driver attention management system may be used in an autonomous or semi-autonomous driving system.

Abstract: Methods and control systems are provided for automatically controlling operation of a vehicle. In one embodiment, the control system includes an exterior sensor for sensing the environment outside the vehicle. A processor is in communication with the exterior sensor and configured to calculate a driving plan of the vehicle based at least partially on the sensed environment outside the vehicle. The processor is also configured to calculate a confidence level of the driving plan of the vehicle based at least partially on the sensed environment around the vehicle. The control system also includes a display in communication with the processor and configured to receive data from the processor and display a representation of at least one of the driving plan and the confidence level.

Abstract: A vehicle includes a multi-touch screen and a controller. A method for providing information related to a vehicle function includes visually displaying on the multi-touch screen a representation of a portion of the vehicle including a plurality of operating sections including a plurality of vehicle functions and a HELP icon. One of the vehicle functions is selected in response to a user action that includes a dragging motion on the multi-touch screen between the HELP icon and the selected vehicle function. Information related to the selected vehicle function is accessed. A preferred mode is employed to communicate the information related to the selected vehicle function to the user.

Abstract: A method for adaptive driver guidance for navigation and location-based services. A navigation system onboard a vehicle records errors, including both system errors and user errors, where the errors can be detected by missed turns, re-routing, and similar events. The error data is transmitted to a central server, where the data is analyzed to determine patterns of errors, both for an individual driver and across many drivers. Roadway locations which frequently experience driver navigational errors have the error type integrated as a route feature, and future navigational guidance is adapted to improve driver performance. Adaptations can include increased or decreased frequency, detail, timing and location of navigational instructions. Individual driver guidance can also be adapted based on the driver's tendency to make errors in response to specific guidance instructions. Adaptation of guidance for location-based services is also provided.

Abstract: An adaptive, human-machine-interaction, system and method for executing system-actions at times in accordance with performance times of past user-actions to either accommodate user habits or to modify user behavior.

Abstract: A method and system for driver attention management system may include means for closed-loop diagnostics. A convenience message may alert a driver of an item of interest to the driver. A sensor may detect the driver's response to the convenience message. Based on the response to the convenience message, the characteristics of an attentive response from the driver may be determined. The determined attentive response may be used by a driver attention management system. The driver attention management system may be able to diagnose errors in the sensors that are used in the driver attention management system. The driver attention management system may also be able to determine whether a driver is exercising sufficient supervisory control of a vehicle by determining whether the driver is attentively responding to prompts provided by the driver attention management system. The driver attention management system may be used in an autonomous or semi-autonomous driving system.

Abstract: Methods and systems are provided for a speech system of a vehicle. In one embodiment, the method includes: generating an utterance signature from a speech utterance received from a user of the speech system without a specific need for a user identification interaction; developing a user signature for a user based on the utterance signature; and managing a dialog with the user based on the user signature.

Abstract: Methods and apparatus for displaying a near-focus one-dimensional marker on a head up display (HUD) such that the parallax disparity between the marker and a distant far-focus visual target is not apparent to a viewer looking at the visual target through the HUD. The one-dimensional marker is oriented at the same angle as the interocular line of the viewer's eyes, as captured by a digital camera facing the viewer. Additionally, a dashed one-dimensional marker is disclosed to reduce the visual noticeability of small inaccuracies in orientation.

Abstract: Methods and apparatus for displaying a near-focus one-dimensional marker on a head up display (HUD) such that the parallax disparity between the marker and a distant far-focus visual target is not apparent to a viewer looking at the visual target through the HUD. The one-dimensional marker is oriented at the same angle as the interocular line of the viewer's eyes, as captured by a digital camera facing the viewer. Additionally, a dashed one-dimensional marker is disclosed to reduce the visual noticeability of small inaccuracies in orientation.

Abstract: Methods and apparatus for creating and managing multiple dialogue models in a statistical dialogue modeling system capable of learning, and conducting human-machine dialogues based on selected models. Dialogue models are selected according to feature vectors that describe characteristics of the dialogue participants and their current situation. Mobile apparatus in motor vehicles can provide optimized dialogue service to occupants of the motor vehicles according to vehicle location and route, in addition to personal characteristics of the occupants, whether driver or passenger. When networked via a remote dialogue server, a large pool of dialogue participants is available for automatic building of dialogue models suitable for handling a variety of situations and participants.

Abstract: Estimating cognitive-load of a user in human-machine interaction by identifying an expression of cognitive-load within a user expression captured by a dialogue system and using a user model to estimate a level of the cognitive-load based on the expression of cognitive-load.

Abstract: Methods and systems for reducing driver distraction and situation non-awareness related to a dialogue of an automated dialogue system in a vehicle. For a dialogue policy learning session, driver distraction is introduced as an input into a penalty assigner that assesses dialogue quality, and dialogue acts are extended to include dialogues and dialogue act presentation styles which reduce driver workload related to dialogues. The automated dialogue system policy is developed during the learning process by optimizing the penalties, so that automated dialogue workload is reduced in response to increased workload or anticipated workload on the driver. Methods and systems are presented for responding to both actual workload in regular vehicles as well as anticipated workload in autonomous vehicles.

Abstract: An adaptive, human-machine-interaction, system and method for executing system-actions at times in accordance with performance times of past user-actions to either accommodate user habits or to modify user behavior.

Abstract: A method for providing audible signals (such as speech) to a driver of a vehicle which appear to originate from a virtual sound source in front of the driver, so that it will feel normal for the driver to respond interactively by speaking without turning the head to the source of the audible signal. The driver's head position is estimated according to data provided by sensors in the driver's seat, and this position data, together with acoustical characteristics of the vehicle interior, is used to derive a transfer function for filtering electrical audible signals to the loudspeakers to simulate a virtual sound source in front of the driver.

Abstract: An audio signal may be received, in a processor associated with a vehicle. Sound related vehicle information representing one or more sounds may be received by the processor. The sound related vehicle information may or may not include an audio signal. A speech recognition process or system may be modified based on the sound related vehicle information.

Abstract: Sound related vehicle information representing one or more sounds may be received in a processor associated with a vehicle. The sound related vehicle information may or may not include an audio signal. An audio signal output to a passenger may be modified based on the sound related vehicle information.