Abstract: A vehicle and many dynamic features move relative to the same reference frame. An infotainment system responds to a request from an occupant of a vehicle to provide information concerning a particular dynamic feature. The occupant provides the infotainment system with information concerning a bearing to the dynamic feature and the infotainment system identifies the dynamic feature in response.

Abstract: An emergent driving assistant for a vehicle includes a control circuitry that receives a constraint signal, a feature signal, and a motion signal. The feature signal is in a first or second state. The first state indicates that the driver exhibits a non-neutral emotional state or a non-neutral gaze state. The second state indicates that the driver exhibits neutral emotional and gaze states. The constraint signal indicates a constraint on motion of the vehicle on a section of a road. The motion signal indicates the vehicle's motion. The control circuitry determines, based on the constraint and motion signals, whether the vehicle is violating the constraint. It then relieves the driver from complete control over a vehicle subsystem when the feature signal is in the first state and when the vehicle is violating the constraint.

Abstract: While current voice assistants can respond to voice requests, creating smarter assistants that leverage location, past requests, and user data to enhance responses to future requests and to provide robust data about locations is desirable. A method for enhancing a geolocation database (“database”) associates a user-initiated triggering event with a location in a database by sensing user position and orientation within the vehicle and a position and orientation of the vehicle. The triggering event is detected by sensors arranged within a vehicle with respect to the user. The method determines a point of interest (“POI”) near the location based on the user-initiated triggering event. The method, responsive to the user-initiated triggering event, updates the database based on information related to the user-initiated triggering event at an entry of the database associated with the POI. The database and voice assistants can leverage the enhanced data about the POI for future requests.

Abstract: Provided are a system and method of input to a computer in a vehicle. An electronic communication is formed between a first electronic device and a display of a second electronic device that is viewable by a user from a location in the vehicle, including providing by the first electronic device a first input mode for the second electronic device. A multimodal application is executed that permits the user to interact with the display of the second electronic device by a combination of the first input mode and at least one second input mode for the second electronic device. The combination of the first input mode and the at least one second input mode controls the display of the first electronic device.

Abstract: An apparatus for entertaining an entertainee in a passenger vehicle includes an infotainment system having an automotive assistant that executes a spatially-cognizant entertainment application that interacts with the entertainee. In doing so, the automotive assistant receives information about the vehicle's environment from peripheral devices connected to the infotainment system. This provides the entertainment application with spatial intelligence that it then uses while interacting with the entertainee.

Abstract: A system and method of responding to a vocal utterance may include capturing and converting the utterance to word(s) using a language processing method, such as natural language processing. The context of the utterance and of the system, which may include multimodal inputs, may be used to determine the meaning and intent of the words.

Abstract: A vehicle system for classifying spoken utterance within a vehicle cabin as one of system-directed and non-system directed may include at least one microphone to detect at least one acoustic utterance from at least one occupant of the vehicle, at least one camera to detect occupant data indicative of occupant behavior within the vehicle corresponding to the acoustic utterance, and a processor programmed to receive the acoustic utterance, receive the occupant data, determine whether the occupant data is indicative of a vehicle feature, classify the acoustic utterance as a system-directed utterance in response to the occupant data being indicative of a vehicle feature, and process the acoustic utterance.

Abstract: While current voice assistants can respond to voice requests, creating smarter assistants that leverage location, past requests, and user data to enhance responses to future requests and to provide robust data about locations is desirable. A method for enhancing a geolocation database (“database”) associates a user-initiated triggering event with a location in a database by sensing user position and orientation within the vehicle and a position and orientation of the vehicle. The triggering event is detected by sensors arranged within a vehicle with respect to the user. The method determines a point of interest (“POI”) near the location based on the user-initiated triggering event. The method, responsive to the user-initiated triggering event, updates the database based on information related to the user-initiated triggering event at an entry of the database associated with the POI. The database and voice assistants can leverage the enhanced data about the POI for future requests.

Abstract: A vehicle and many dynamic features move relative to the same reference frame. An infotainment system responds to a request from an occupant of a vehicle to provide information concerning a particular dynamic feature. The occupant provides the infotainment system with information concerning a bearing to the dynamic feature and the infotainment system identifies the dynamic feature in response.

Abstract: A system and method of responding to a vocal utterance may include capturing and converting the utterance to word(s) using a language processing method, such as natural language processing. The context of the utterance and of the system, which may include multimodal inputs, may be used to determine the meaning and intent of the words.

Abstract: An apparatus for entertaining an entertainee in a passenger vehicle includes an infotainment system having an automotive assistant that executes a spatially-cognizant entertainment application that interacts with the entertainee. In doing so, the automotive assistant receives information about the vehicle's environment from peripheral devices connected to the infotainment system. This provides the entertainment application with spatial intelligence that it then uses while interacting with the entertainee.

Abstract: While current voice assistants can respond to voice requests, creating smarter assistants that leverage location, past requests, and user data to enhance responses to future requests and to provide robust data about locations is desirable. A method for enhancing a geolocation database (“database”) associates a user-initiated triggering event with a location in a database by sensing user position and orientation within the vehicle and a position and orientation of the vehicle. The triggering event is detected by sensors arranged within a vehicle with respect to the user. The method determines a point of interest (“POI”) near the location based on the user-initiated triggering event. The method, responsive to the user-initiated triggering event, updates the database based on information related to the user-initiated triggering event at an entry of the database associated with the POI. The database and voice assistants can leverage the enhanced data about the POI for future requests.

Abstract: Some embodiments described herein relate to a multimodal user interface for use in an automobile. The multimodal user interface may display information on a windshield of the automobile, such as by projecting information on the windshield, and may accept input from a user via multiple modalities, which may include a speech interface as well as other interfaces. The other interfaces may include interfaces allowing a user to provide geometric input by indicating an angle. In some embodiments, a user may define a task to be performed using multiple different input modalities. For example, the user may provide via the speech interface speech input describing a task that the user is requesting be performed, and may provide via one or more other interfaces geometric parameters regarding the task. The multimodal user interface may determine the task and the geometric parameters from the inputs.

Abstract: While current voice assistants can respond to voice requests, creating smarter assistants that leverage location, past requests, and user data to enhance responses to future requests and to provide robust data about locations is desirable. A method for enhancing a geolocation database (“database”) associates a user-initiated triggering event with a location in a database by sensing user position and orientation within the vehicle and a position and orientation of the vehicle. The triggering event is detected by sensors arranged within a vehicle with respect to the user. The method determines a point of interest (“POI”) near the location based on the user-initiated triggering event. The method, responsive to the user-initiated triggering event, updates the database based on information related to the user-initiated triggering event at an entry of the database associated with the POI. The database and voice assistants can leverage the enhanced data about the POI for future requests.

Abstract: Some embodiments described herein relate to a multimodal user interface for use in an automobile. The multimodal user interface may display information on a windshield of the automobile, such as by projecting information on the windshield, and may accept input from a user via multiple modalities, which may include a speech interface as well as other interfaces. The other interfaces may include interfaces allowing a user to provide geometric input by indicating an angle. In some embodiments, a user may define a task to be performed using multiple different input modalities. For example, the user may provide via the speech interface speech input describing a task that the user is requesting be performed, and may provide via one or more other interfaces geometric parameters regarding the task. The multimodal user interface may determine the task and the geometric parameters from the inputs.

Abstract: A system and method of responding to a vocal utterance may include capturing and converting the utterance to word(s) using a language processing method, such as natural language processing. The context of the utterance and of the system, which may include multimodal inputs, may be used to determine the meaning and intent of the words.

Abstract: Provided are a system and method of input to a computer in a vehicle. An electronic communication is formed between a first electronic device and a display of a second electronic device that is viewable by a user from a location in the vehicle, including providing by the first electronic device a first input mode for the second electronic device. A multimodal application is executed that permits the user to interact with the display of the second electronic device by a combination of the first input mode and at least one second input mode for the second electronic device. The combination of the first input mode and the at least one second input mode controls the display of the first electronic device.