Abstract: A triggering condition for initiating an interaction session with an occupant of a vehicle is detected. A display is populated with representations of one or more options for operations associated with the vehicle. Based at least in part on an analysis of one or more signals generated by the occupant, a particular option is selected for implementation. An indication that the particular option has been selected is provided, and an operation corresponding to the particular option is initiated.

Abstract: A method and system for providing augmented reality based directions. The method and system include receiving a voice input based on verbal cues provided by one or more vehicle occupants in a vehicle. The method and system also include receiving a gesture input and a gaze input based on gestural cues and gaze cues provided by the one or more vehicle occupants in the vehicle. The method and system additionally include determining directives based on the voice input, the gesture input and the gaze input and associating the directives with the surrounding environment of the vehicle. Additionally, the method and system include generating augmented reality graphical elements based on the directives and the association of the directives with the surrounding environment of the vehicle. The method and system further include displaying the augmented reality graphical elements on a heads-up display system of the vehicle.

Abstract: Multi-level navigation monitoring and control is provided. A system includes a lane marking manager determining a first boundary line, a second boundary line, and a centerline of a current lane of travel. The system also includes a confidence level determiner assigning a first confidence level to the first boundary line, a second confidence level to the second boundary line, and a third confidence level to the centerline. Further, the system includes a user interface outputting representations of the first boundary line, the second boundary line, and the centerline based, at least in part, on the first confidence level, the second confidence level, and the third confidence level.

Abstract: Systems and methods for training an operator of a robotic surgery system are disclosed. One such method includes enabling the operator to perform a test procedure, recording vibrations of a surgical tool of the robotic surgery system during the test procedure, and generating a score for the operator based at least in part on the recorded vibrations of the surgical tool.

Abstract: One or more embodiments of techniques or systems for managing locations are provided herein. According to one embodiment, a system includes a heads up display (HUD) that receives an image associated with a location. The image may be captured by a camera of a vehicle. The system also includes a sensor component that detects a physical gesture performed by a user. Furthermore, the system includes an action component that correlates the physical gesture with an action associated with the image. The action component also performs the action. The action is one of saving the image to a storage component or deleting the image.

Abstract: A triggering condition for initiating an interaction session with an occupant of a vehicle is detected. A display is populated with representations of one or more options for operations associated with the vehicle. Based at least in part on an analysis of one or more signals generated by the occupant, a particular option is selected for implementation. An indication that the particular option has been selected is provided, and an operation corresponding to the particular option is initiated.

Abstract: Various exemplary embodiments relate to a command interpreter for use in a vehicle control system in a vehicle for interpreting user commands, a vehicle interaction system including such a command interpreter, a vehicle including such a vehicle interaction system, and related method and non-transitory machine-readable storage medium, including: a memory and a processor, the processor being configured to: receive, from at least one human via a first input device, a first input having a first type; receive a second input having a second type via a second input device, wherein the second type comprises at least one of sensed information describing a surrounding environment of the vehicle and input received from at least one human; interpret both the first input and the second input to generate a system instruction; and transmit the system instruction to a different system of the vehicle.

Abstract: A vehicle-to-vehicle communication system providing a spatiotemporal look ahead and method thereof is provided. A trailing vehicle having a look ahead capability can communicate with a preceding vehicle. The preceding vehicle can measure a distance to a leading vehicle and provide that information through vehicle-to-vehicle communications to the trailing vehicle. The trailing vehicle can then display an augmented reality indicator above the vehicle through its head-up display indicating how far the leading vehicle is in front of the preceding vehicle. An icon representing the leading vehicle can be displayed within the augmented reality indicator representing the leading vehicle. Braking actions by the leading vehicle can be communicated to the trailing vehicle through the augmented reality indicator.

Abstract: A system and method for interaction in a vehicle includes establishing a bi-directional interaction session between a first display and a second display via a communication link, wherein each of the first display and the second display are communicatively coupled to the vehicle and the first display is operated by a first user and the second display is operated by a second user. Upon receiving a first interaction input associated generating a first augmented reality object based on the first interaction input and transmitting via the communication link the first augmented reality object to the second display. Upon receiving a second interaction input, generating a second augmented reality object based upon the second interaction input and transmitting via the communication link the second augmented reality object to the first display.

Abstract: One or more embodiments of techniques or systems for managing locations are provided herein. According to one embodiment, a system includes a heads up display (HUD) that receives an image associated with a location. The image may be captured by a camera of a vehicle. The system also includes a sensor component that detects a physical gesture performed by a user. Furthermore, the system includes an action component that correlates the physical gesture with an action associated with the image. The action component also performs the action. The action is one of saving the image to a storage component or deleting the image.

Abstract: A method and system for providing situational awareness in a vehicle. The method and system include receiving environmental sensor data and vehicle performance sensor data. The method and system also include compiling the environmental sensor data and the vehicle performance data. The method and system additionally include determining one or more situational risks that are posed to the vehicle that occur within a surrounding environment of the vehicle based on the compiled environmental sensor data and the vehicle performance data. The method and system further include generating one or more projected graphical objects that represent the one or more situational risks that are determined to be posed to the vehicle.

Abstract: A system for indicating braking intensity to a main vehicle has an observational device monitoring positional and speed data of at least one vehicle proximate the main vehicle. A control unit is coupled to the observational device. The control unit processes the positional and speed data monitored by the observational device and generates graphical representations of the at least one vehicle proximate the main vehicle and graphical representations of a braking intensity level of the at least one vehicle proximate the main vehicle.

Abstract: A method and system for providing situational awareness in a vehicle. The method and system include receiving environmental sensor data and vehicle performance sensor data. The method and system also include compiling the environmental sensor data and the vehicle performance data. The method and system additionally include determining one or more situational risks that are posed to the vehicle that occur within a surrounding environment of the vehicle based on the compiled environmental sensor data and the vehicle performance data. The method and system further include generating one or more projected graphical objects that represent the one or more situational risks that are determined to be posed to the vehicle.

Abstract: A system for indicating braking intensity to a main vehicle has an observational device monitoring positional and speed data of at least one vehicle proximate the main vehicle. A control unit is coupled to the observational device. The control unit processes the positional and speed data monitored by the observational device and generates graphical representations of the at least one vehicle proximate the main vehicle and graphical representations of a braking intensity level of the at least one vehicle proximate the main vehicle.

Abstract: A vehicle-to-vehicle communication system providing a spatiotemporal look ahead and method thereof is provided. A trailing vehicle having a look ahead capability can communicate with a preceding vehicle. The preceding vehicle can measure a distance to a leading vehicle and provide that information through vehicle-to-vehicle communications to the trailing vehicle. The trailing vehicle can then display an augmented reality indicator above the vehicle through its head-up display indicating how far the leading vehicle is in front of the preceding vehicle. An icon representing the leading vehicle can be displayed within the augmented reality indicator representing the leading vehicle. Braking actions by the leading vehicle can be communicated to the trailing vehicle through the augmented reality indicator.

Abstract: A system for indicating braking intensity to a main vehicle has an observational device monitoring positional and speed data of at least one vehicle proximate the main vehicle. A control unit is coupled to the observational device. The control unit processes the positional and speed data monitored by the observational device and generates graphical representations of the at least one vehicle proximate the main vehicle and graphical representations of a braking intensity level of the at least one vehicle proximate the main vehicle.

Abstract: Multi-level navigation monitoring and control is provided. A system includes a lane marking manager determining a first boundary line, a second boundary line, and a centerline of a current lane of travel. The system also includes a confidence level determiner assigning a first confidence level to the first boundary line, a second confidence level to the second boundary line, and a third confidence level to the centerline. Further, the system includes a user interface outputting representations of the first boundary line, the second boundary line, and the centerline based, at least in part, on the first confidence level, the second confidence level, and the third confidence level.

Abstract: A system and method for interaction in a vehicle includes establishing a bi-directional interaction session between a first display and a second display via a communication link, wherein each of the first display and the second display are communicatively coupled to the vehicle and the first display is operated by a first user and the second display is operated by a second user. Upon receiving a first interaction input associated generating a first augmented reality object based on the first interaction input and transmitting via the communication link the first augmented reality object to the second display. Upon receiving a second interaction input, generating a second augmented reality object based upon the second interaction input and transmitting via the communication link the second augmented reality object to the first display.

Abstract: A method and system for providing augmented reality based directions. The method and system include receiving a voice input based on verbal cues provided by one or more vehicle occupants in a vehicle. The method and system also include receiving a gesture input and a gaze input based on gestural cues and gaze cues provided by the one or more vehicle occupants in the vehicle. The method and system additionally include determining directives based on the voice input, the gesture input and the gaze input and associating the directives with the surrounding environment of the vehicle. Additionally, the method and system include generating augmented reality graphical elements based on the directives and the association of the directives with the surrounding environment of the vehicle. The method and system further include displaying the augmented reality graphical elements on a heads-up display system of the vehicle.

Abstract: A system for indicating braking intensity to a main vehicle has an observational device monitoring positional and speed data of at least one vehicle proximate the main vehicle. A control unit is coupled to the observational device. The control unit processes the positional and speed data monitored by the observational device and generates graphical representations of the at least one vehicle proximate the main vehicle and graphical representations of a braking intensity level of the at least one vehicle proximate the main vehicle.