Abstract: A vehicle having a sensor and a head-up display is provided. The sensor can detect pedestrians at an intersection. The head-up display can depict an augmented reality indicator represented as the intersection and the pedestrians. The augmented reality indicator can be displayed directly in a driver's field of view centralized to provide a situational environment for the driver. The head-up display can show pedestrians outside the driver's field of view.

Abstract: A system for warning of potential hazards when a vehicle is turning has a sensor coupled to the vehicle and configured to capture data of objects located around the vehicle. A control unit is coupled to the sensor for processing the data captured by the sensor to generate graphical representations of objects captured by the sensor, graphical representations of projected paths of moving objects captured; and a graphical representation of a projected turning path of the vehicle.

Abstract: Navigating through objects or items in a display device using a first input device to detect pointing of a user's finger to an object or item and using a second input device to receive the user's indication on the selection of the object or the item. An image of the hand is captured by the first input device and is processed to determine a location on the display device corresponding to the location of the fingertip of the pointing finger. The object or the item corresponding to the location of the fingertip is selected after the second input device receives predetermined user input from the second input device.

Abstract: A method and system for providing situational awareness in a vehicle. The method and system include receiving environmental sensor data and vehicle performance sensor data. The method and system also include compiling the environmental sensor data and the vehicle performance data. The method and system additionally include determining one or more situational risks that are posed to the vehicle that occur within a surrounding environment of the vehicle based on the compiled environmental sensor data and the vehicle performance data. The method and system further include generating one or more projected graphical objects that represent the one or more situational risks that are determined to be posed to the vehicle.

Abstract: A system for indicating braking intensity to a main vehicle has an observational device monitoring positional and speed data of at least one vehicle proximate the main vehicle. A control unit is coupled to the observational device. The control unit processes the positional and speed data monitored by the observational device and generates graphical representations of the at least one vehicle proximate the main vehicle and graphical representations of a braking intensity level of the at least one vehicle proximate the main vehicle.

Abstract: A system for indicating braking intensity to a main vehicle has an observational device monitoring positional and speed data of at least one vehicle proximate the main vehicle. A control unit is coupled to the observational device. The control unit processes the positional and speed data monitored by the observational device and generates graphical representations of the at least one vehicle proximate the main vehicle and graphical representations of a braking intensity level of the at least one vehicle proximate the main vehicle.

Abstract: A method and system for providing situational awareness in a vehicle. The method and system include receiving environmental sensor data and vehicle performance sensor data. The method and system also include compiling the environmental sensor data and the vehicle performance data. The method and system additionally include determining one or more situational risks that are posed to the vehicle that occur within a surrounding environment of the vehicle based on the compiled environmental sensor data and the vehicle performance data. The method and system further include generating one or more projected graphical objects that represent the one or more situational risks that are determined to be posed to the vehicle.

Abstract: A vehicle having a sensor and a head-up display is provided. The sensor can detect pedestrians at an intersection. The head-up display can depict an augmented reality indicator represented as the intersection and the pedestrians. The augmented reality indicator can be displayed directly in a driver's field of view centralized to provide a situational environment for the driver. The head-up display can show pedestrians outside the driver's field of view.

Abstract: A vehicle-to-vehicle communication system providing a spatiotemporal look ahead and method thereof is provided. A trailing vehicle having a look ahead capability can communicate with a preceding vehicle. The preceding vehicle can measure a distance to a leading vehicle and provide that information through vehicle-to-vehicle communications to the trailing vehicle. The trailing vehicle can then display an augmented reality indicator above the vehicle through its head-up display indicating how far the leading vehicle is in front of the preceding vehicle. An icon representing the leading vehicle can be displayed within the augmented reality indicator representing the leading vehicle. Braking actions by the leading vehicle can be communicated to the trailing vehicle through the augmented reality indicator.

Abstract: A system or method for generating gestures in a robot during generation of a speech output by the robot by analyzing a speech text and selecting appropriate gestures from a plurality of candidate gestures. The speech text is analyzed and tagged with information relevant to generating of the gestures. Based on the speech text, the tagged information and other relevant information, a gesture identifier is selected. A gesture template corresponding to the gesture identifier is retrieved and then processed by adding relevant parameter to generate a gesture descriptor representing a gesture to be taken by the robot. A gesture motion is planned based on the gesture descriptor and analysis of timing associated with the speech, wherein the amplitude, frequency or speed of the selected gesture is modified based on random numbers of specific range depending on the status of the robot. Actuator signals for controlling the actuators such as arms and hands are generated based on the planned gesture motion.

Abstract: A heads-up display device for displaying graphic elements in view of a user while the user views an environment through a display screen. The heads-up display device includes at least one projector that projects a graphic element on a frontal focal plane in view of the user while the user views the environment through the display screen, and at least one projector that projects a graphic element on a ground-parallel focal plane in view of the user while the user views the environment through the display screen. The projector that projects the graphic element on the frontal focal plane is mounted on an actuator that linearly moves the projector so as to cause the frontal focal plane to move in a direction of a line-of-sight of the user. The projector that projects the ground-parallel focal plane is fixedly arranged such that the ground-parallel focal plane is static.

Abstract: A heads-up display device for displaying graphic elements in view of a user while the user views an environment through a display screen. The heads-up display device includes at least one projector that projects a graphic element on a dynamic, frontal focal plane in view of the user while the user views the environment through the display screen, and at least one projector that projects a graphic element on a static, ground-parallel focal plane in view of the user while the user views the environment through the display screen. A controller determines a target graphic element position and a graphic element size based on the target graphic element position for the graphic element projected on the frontal focal plane, so as to provide the user with an immersive three-dimensional heads-up display.

Abstract: A system for indicating braking intensity to a main vehicle has an observational device monitoring positional and speed data of at least one vehicle proximate the main vehicle. A control unit is coupled to the observational device. The control unit processes the positional and speed data monitored by the observational device and generates graphical representations of the at least one vehicle proximate the main vehicle and graphical representations of a braking intensity level of the at least one vehicle proximate the main vehicle.

Abstract: One or more embodiments of techniques or systems for 3-dimensional (3-D) navigation are provided herein. A heads-up display (HUD) component can project graphic elements on focal planes around an environment surrounding a vehicle. The HUD component can cause these graphic elements to appear volumetric or 3-D by moving or adjusting a distance between a focal plane and the vehicle. Additionally, a target position for graphic elements can be adjusted. This enables the HUD component to project graphic elements as moving avatars. In other words, adjusting the focal plane distance and the target position enables graphic elements to be projected in three dimensions along an x, y, and z axis. Further, a moving avatar can be ‘animated’ by sequentially projecting the avatar on different focal planes, thereby providing an occupant with the perception that the avatar is moving towards or away from the vehicle.

Abstract: A driver training system includes a training controller, a heads-up display device, and a driving cue adherence controller. The training controller is configured to receive inputs related to an operational state of a vehicle and an environment surrounding the vehicle, and to determine a driving cue based on the received inputs. The heads-up display device is configured to present the driving cue as an augmented reality graphic element in view of a driver by projecting graphic elements on a windshield of the vehicle. The driving cue adherence controller is configured to continuously determine a current level of adherence to the driving cue, and an aggregate level of adherence to the driving cue based on the continuously determined current level of adherence to the driving cue over a predetermined time period. The heads-up display device is configured to present the continuously determined aggregate level of adherence in view of the driver.

Abstract: Multi-level navigation monitoring and control is provided. A system includes a lane marking manager determining a first boundary line, a second boundary line, and a centerline of a current lane of travel. The system also includes a confidence level determiner assigning a first confidence level to the first boundary line, a second confidence level to the second boundary line, and a third confidence level to the centerline. Further, the system includes a user interface outputting representations of the first boundary line, the second boundary line, and the centerline based, at least in part, on the first confidence level, the second confidence level, and the third confidence level.

Abstract: A heads-up display device for displaying graphic elements in view of a user while the user views an environment through a display screen. The heads-up display device includes at least one projector that projects a graphic element on a frontal focal plane in view of the user while the user views the environment through the display screen, and at least one projector that projects a graphic element on a ground-parallel focal plane in view of the user while the user views the environment through the display screen. The projector that projects the graphic element on the frontal focal plane is mounted on an actuator that linearly moves the projector so as to cause the frontal focal plane to move in a direction of a line-of-sight of the user. The projector that projects the ground-parallel focal plane is fixedly arranged such that the ground-parallel focal plane is static.

Abstract: Generating a virtual model of environment in front of a vehicle based on images captured using an image capturing. The Images captured on an image capturing device of a vehicle are processed to extract features of interest. Based on the extracted features, a virtual model of the environment is constructed. The virtual model includes one or more surfaces. Each of the surfaces may be used as a reference surface to attach and move graphical elements generated to implement augmented reality (AR). As the vehicle moves, the graphical elements move as if the graphical elements are affixed to the one of the surfaces. By presenting the graphical elements to move together with real objects in front of the vehicle, a driver perceives the graphical elements as being part of the actual environment and reduces distraction or confusion associated with the graphical elements.

Abstract: A publish-subscribe architecture based blackboard system for selecting and exchanging selected information among a plurality of processing modules using filters for implementing conditions described in a procedural language to reduce the amount of information transmitted between the processing modules. More than one filter may be dynamically installed in a message hub to select and collect the published information to be sent to a certain subscribing module. By using the procedural language to describe the filters, the message hub can more intelligently select the information to be sent to the subscribing module. This reduces the amount of information transmitted via communication channels. Further, the subscribing module may be relieved from the task of filtering the information received from the message hub, allowing the subscribing module to devote more resources to other operations.

Abstract: A system and method for interaction in a vehicle includes establishing a bi-directional interaction session between a first display and a second display via a communication link, wherein each of the first display and the second display are communicatively coupled to the vehicle and the first display is operated by a first user and the second display is operated by a second user. Upon receiving a first interaction input associated generating a first augmented reality object based on the first interaction input and transmitting via the communication link the first augmented reality object to the second display. Upon receiving a second interaction input, generating a second augmented reality object based upon the second interaction input and transmitting via the communication link the second augmented reality object to the first display.