Abstract: A user, such as the driver of a vehicle, to retrieve information related to a point of interest (POI) near the vehicle by pointing at the POI or performing some other gesture to identify the POI. Gesture recognition is performed on the gesture to generate a target region that includes the POI that the user identified. After generating the target region, information about the POI can be retrieved by querying a server-based POI service with the target region or by searching in a micromap that is stored locally. The retrieved POI information can then be provided to the user via a display and/or speaker in the vehicle. This process beneficially allows a user to rapidly identify and retrieve information about a POI near the vehicle without having to navigate a user interface by manipulating a touchscreen or physical buttons.

Abstract: A system for capturing image data for gestures from a passenger or a driver in a vehicle with a dynamic illumination level comprises a low-lux sensor equipped to capture image data in an environment with an illumination level below an illumination threshold, a high-lux sensor equipped to capture image data in the environment with the illumination level above the illumination threshold, and an object recognition module for activating the sensors. The object recognition module determines the illumination level of the environment and activates the low-lux sensor if the illumination level is below the illumination threshold. If the illumination level is above the threshold, the object recognition module activates the high-lux sensor.

Abstract: A help module provides help content to a user by determining an application for which help should be presented. In one embodiment, the user requests help for a particular application and the help module determines the application for which help should be presented based on the received request. Alternatively, the help module selects an application from a pre-determined list of applications as the application for which help should be presented. The help module retrieves user data for the determined application and generates help content that includes at least part of the retrieved user data. The generated help is then transmitted by the help module for presentation to the user.

Abstract: A system and method for combining two separate types of human machine interfaces, e.g., a voice signal and a gesture signal, performing voice recognition to a voice signal and gesture recognition to the gesture signal. Based on a confidence determination using the voice recognition result and the gesture recognition result the system can, for example, immediately perform the command/request, request confirmation of the command/request or determine that the command/request was not identified.

Abstract: A system for capturing image data for gestures from a passenger or a driver in a vehicle with a dynamic illumination level comprises a low-lux sensor equipped to capture image data in an environment with an illumination level below an illumination threshold, a high-lux sensor equipped to capture image data in the environment with the illumination level above the illumination threshold, and an object recognition module for activating the sensors. The object recognition module determines the illumination level of the environment and activates the low-lux sensor if the illumination level is below the illumination threshold. If the illumination level is above the threshold, the object recognition module activates the high-lux sensor.

Abstract: A method or system for selecting or pruning applicable verbal commands associated with speech recognition based on a user's motions detected from a depth camera. Depending on the depth of the user's hand or arm, the context of the verbal command is determined and verbal commands corresponding to the determined context are selected. Speech recognition is then performed on an audio signal using the selected verbal commands. By using an appropriate set of verbal commands, the accuracy of the speech recognition is increased.

Abstract: A vehicle based system and method for receiving voice inputs and determining whether to perform a voice recognition analysis using in-vehicle resources or resources external to the vehicle.

Abstract: A remote server receives traffic data from a plurality of probe vehicles traveling on roadways. The remote server stores the received traffic data in a regular lane database and/or a carpool lane database. The remote server differentiates the received traffic data for storage in the appropriate database based on the number of probe vehicles associated with each speed pattern observed within the received traffic data.

Abstract: A system, method, and computer program product for allowing a user to fix errors in a user input is described. An original user input providing a destination address or a point of interest is received by an in-vehicle computing system. Upon receiving a user input indicating an error in interpreting the original user input, the user is presented with a new query requesting the user to enter a portion of or a category associated with the original input. Once the updated user input providing a portion of the original input is received, the user input is identified and executed based on the original user input entry and the updated user input.

Abstract: A remote server receives traffic data from a plurality of probe vehicles traveling on roadways. The remote server stores the received traffic data in a regular lane database and/or a carpool lane database. The remote server differentiates the received traffic data for storage in the appropriate database based on the number of probe vehicles associated with each speed pattern observed within the received traffic data.

Abstract: A method and a system are provided for directing a user to a vehicle. A user may make a request, from a portable device, to find a vehicle. Respective locations of the vehicle and the portable device may be obtained. Walking directions to the vehicle may be determined based on the obtained respective locations. Based on the walking directions, a walking distance from the location of the portable device to the vehicle may be determined. When the walking distance is less than or equal to a predetermined distance, a near indication may be provided from the vehicle. The near indication may include a visual indication and/or an audio indication. In some embodiments, a current location of the portable device may be obtained periodically and updated walking directions may be presented by the portable device. The presented walking directions may include text, a map, or generated speech.