Abstract: The disclosure relates to technology for determining vehicle environment interaction metrics and/or passenger behavioral metrics for autonomous vehicles in a driving environment. A group of one or more autonomous vehicles independently determine a VEI score for a target vehicle within a predefined vicinity of the group of one or more vehicles. A target vehicle may determine a VPB score based on passengers within the target vehicle. VEI scores and/or VPB scores determined for a target vehicle may be used by the target vehicle to reinforce and/or correct driving actions of the target vehicle.

Abstract: Systems and methods for assisting navigation of a vehicle are disclosed. In one embodiment, a method of assisting navigation of a vehicle includes receiving navigational data relating to an intended route of the vehicle, receiving object data relating to at least one external object detected within a vicinity of a current position of the vehicle, determining whether the at least one external object affects an ability of the vehicle to proceed along the intended route, and generating at least one instruction relating to the ability of the vehicle to proceed along the intended route.

Abstract: Systems and methods for assisting navigation of a vehicle are disclosed. In one embodiment, a method of assisting navigation of a vehicle includes receiving navigational data relating to an intended route of the vehicle, receiving object data relating to at least one external object detected within a vicinity of a current position of the vehicle, determining whether the at least one external object affects an ability of the vehicle to proceed along the intended route, and generating at least one instruction relating to the ability of the vehicle to proceed along the intended route.

Abstract: The disclosure relates to technology for determining vehicle environment interaction metrics and/or passenger behavioral metrics for autonomous vehicles in a driving environment. A group of one or more autonomous vehicles independently determine a VEI score for a target vehicle within a predefined vicinity of the group of one or more vehicles. A target vehicle may determine a VPB score based on passengers within the target vehicle. VEI scores and/or VPB scores determined for a target vehicle may be used by the target vehicle to reinforce and/or correct driving actions of the target vehicle.

Abstract: The disclosure relates to technology within an autonomous vehicle for interacting with passengers to provide information about their surroundings as they travel within the autonomous vehicle. In one example, the system may automatically detect and push information about points of interest in the vicinity of the vehicle to the vehicle passengers. In another example, the system provides information about points of interest around the autonomous vehicle in response to physical and/or verbal cues from a passenger in the autonomous vehicle.

Abstract: An activity recognition device comprises a port configured to receive a video stream from a video source for a first object and a second object; a memory configured to store instructions and image frames of the video stream; and one or more processors, wherein the one or more processors execute the instructions stored in the memory, the one or more processors configured to: select portions of the image frames based on presence of the first object; determine areas within the portions of image frames, wherein locations of the first object in the video frames are bounded by the determined areas; determine motion of the first object and locations of a second object within the areas of the image frames; and identify an activity according to the determined motion and locations of the second object, and generate an alert according to the identified activity.

Abstract: An activity recognition device comprises a port configured to receive a video stream from a video source for a first object and a second object; a memory configured to store instructions and image frames of the video stream; and one or more processors, wherein the one or more processors execute the instructions stored in the memory, the one or more processors configured to: select portions of the image frames based on presence of the first object; determine areas within the portions of image frames, wherein locations of the first object in the video frames are bounded by the determined areas; determine motion of the first object and locations of a second object within the areas of the image frames; and identify an activity according to the determined motion and locations of the second object, and generate an alert according to the identified activity.

Abstract: An activity recognition device comprises a port configured to receive a video stream from a video source for a first object and a second object; a memory configured to store instructions and image frames of the video stream; and one or more processors, wherein the one or more processors execute the instructions stored in the memory, the one or more processors configured to: select portions of the image frames based on presence of the first object; determine areas within the portions of image frames, wherein locations of the first object in the video frames are bounded by the determined areas; determine motion of the first object and locations of a second object within the areas of the image frames; and identify an activity according to the determined motion and locations of the second object, and generate an alert according to the identified activity.

Abstract: A computer-implemented method of acquiring visual data is provided that comprises: determining, by one or more processors, a gaze point of a person in a vehicle; detecting, by the one or more processors, a gesture by the person in the vehicle; and in response to the detection of the gesture, causing, by the one or more processors, a camera to acquire visual data corresponding to the gaze point of the person.

Abstract: An activity recognition device comprises a port configured to receive a video stream from a video source for a first object and a second object; a memory configured to store instructions and image frames of the video stream; and one or more processors, wherein the one or more processors execute the instructions stored in the memory, the one or more processors configured to: select portions of the image frames based on presence of the first object; determine areas within the portions of image frames, wherein locations of the first object in the video frames are bounded by the determined areas; determine motion of the first object and locations of a second object within the areas of the image frames; and identify an activity according to the determined motion and locations of the second object, and generate an alert according to the identified activity.

Abstract: A system for determining distress of a driver of a vehicle is provided, comprising a plurality of sensors, including interior vehicle image sensors, an interior vehicle audio sensor, vehicle data sensors, and Global Positioning System (GPS) data sensors. The system also includes one or more processors configured to receive inputs from the plurality of sensors, and process the received inputs to obtain a driver heat change estimate, a driver expression estimate, a driver gesture estimate, an on-board diagnostics (OBD) estimate, and a GPS estimate. The one or more processors are further configured to store the estimates in a memory, use the stored estimates to generate deviation scores for each of the estimates, execute a machine learning algorithm to classify driver behavior as normal or impaired based on the deviation scores, and generate a warning based on the classification indicating impaired driver behavior.