Abstract: In one embodiment, a method includes scanning a real-world environment with a first device associated with a first user; generating a three-dimensional model of the real-world environment, transmitting the three-dimensional model to a head-mounted device associated with the first user, determining a pose of the head-mounted device by localizing the head-mounted device within the three-dimensional model based on images captured by a second camera of the head-mounted device, displaying, on the head-mounted device, a virtual space corresponding to the scanned real-world environment generated based on the three-dimensional model as viewed from the pose, and transmitting, to a remote head-mounted device of a second user, data corresponding to the three-dimensional model and the pose of the head-mounted device, the data being configured for rendering, by the remote head-mounted device, the virtual space with a first avatar corresponding to the first user having the pose.

Abstract: Some embodiments provide a vehicle that includes a protection system configured to mitigate hazards to vehicle occupants posed by dynamic elements located within proximity of the vehicle. The vehicle can, in response to determining that a dynamic element is moving along a trajectory that intersects a sweep volume of a vehicle portal, can selectively restrict operation of the portal so that an occupant is restricted from opening the portal into a volume through which the dynamic element may pass. The vehicle can restrict portal operation in response to detecting external dynamic elements that are not within an occupant's field of vision. The vehicle can communicate a limited selection of vehicle sensor data, including representations of a detected dynamic element, to a user device supporting an authorized user in response to detecting that the dynamic element is located within a certain proximity of the vehicle.

Abstract: Some embodiments provide a vehicle which includes a one or more sets of light emitter devices and sensor devices included in a common element assembly of the vehicle which includes a common window element via which the light emitter devices and sensor devices can interact with an external environment in which the vehicle is located. The sensor devices and light emitter devices can be communicatively coupled, and operation of the light emitter devices and sensor devices can be adjustably controlled to mitigate interference by the light emitter devices with sensor data representations generated by the sensor devices. The window element can include a reflection-mitigating layer which mitigates reflection of light beams emitted by one or more light emitter devices in an assembly towards one or more sensor elements of one or more sensor devices included in the same assembly.

Abstract: Some embodiments provide a vehicle that includes a protection system configured to mitigate hazards to vehicle occupants posed by dynamic elements located within proximity of the vehicle. The vehicle can, in response to determining that a dynamic element is moving along a trajectory that intersects a sweep volume of a vehicle portal, can selectively restrict operation of the portal so that an occupant is restricted from opening the portal into a volume through which the dynamic element may pass. The vehicle can restrict portal operation in response to detecting external dynamic elements that are not within an occupant's field of vision. The vehicle can communicate a limited selection of vehicle sensor data, including representations of a detected dynamic element, to a user device supporting an authorized user in response to detecting that the dynamic element is located within a certain proximity of the vehicle.

Abstract: Automated capture of image data for points of interest may be implemented for points of interest in an environment external to a vehicle. Sensors implemented as part of a vehicle may collect sensor data for an environment. Processing of the sensor data may be performed to detect points of interest in the environment. In response to detecting a point of interest, image data may be captured by one or more of the sensors implemented at the vehicle. Different types of image data may be captured, such as panoramic images and three-dimensional reconstructions of a scene. Metadata may be generated for captured image data which may describe the point of interest that is captured by the image data. The image data and the metadata may be stored locally at the vehicle or to a remote data store. The image data may also be shared with other computing devices.

Abstract: An autonomous navigation system which enables autonomous navigation of a vehicle along one or more portions of a driving route based on monitoring, at the vehicle, various features of the route as the vehicle is manually navigated along the route to develop a characterization of the route. The characterization is progressively updated with repeated manual navigations along the route, and autonomous navigation of the route is enabled when a confidence indicator of the characterization meets a threshold indication. Characterizations can be updated in response to the vehicle encountering changes in the route and can include a set of driving rules associated with the route, where the driving rules are developed based on monitoring the navigation of one or more vehicles of the route. Characterizations can be uploaded to a remote system which processes data to develop and refine route characterizations and provide characterizations to one or more vehicles.

Abstract: Some embodiments provide an autonomous navigation system which autonomously navigates a vehicle through an environment based on predicted trajectories of one or more separate dynamic elements through the environment. The system identifies contextual cues associated with a monitored dynamic element, based on features of the dynamic element and actions of the dynamic element relative to various elements of the environment, including motions relative to other dynamic elements. A monitored dynamic element can be associated with a particular intention, which specifies a prediction of dynamic element movement through the environment, based on a correlation between identified contextual cues associated with the monitored dynamic element and a set of contextual cues which are associated with the particular intention. A predicted trajectory of the dynamic element is generated based on an associated intention.

Abstract: Some embodiments provide an autonomous navigation system which enables autonomous navigation of a vehicle along one or more portions of a driving route based on monitoring, at the vehicle, various features of the route as the vehicle is manually navigated along the route to develop a characterization of the route. The characterization is progressively updated with repeated manual navigations along the route, and autonomous navigation of the route is enabled when a confidence indicator of the characterization meets a threshold indication. Characterizations can be updated in response to the vehicle encountering changes in the route and can include a set of driving rules associated with the route, where the driving rules are developed based on monitoring the navigation of one or more vehicles of the route. Characterizations can be uploaded to a remote system which processes data to develop and refine route characterizations and provide characterizations to one or more vehicles.

Abstract: A self-capacitive touch sensor panel configured to have a portion of both the touch and display functionality integrated into a common layer is provided. The touch sensor panel includes a layer with circuit elements that can switchably operate as both touch circuitry and display circuitry such that during a touch mode of the device the circuit elements operate as touch circuitry and during a display mode of the device the circuit elements operate as display circuitry. The touch mode and display mode can be time multiplexed. By integrating the touch hardware and display hardware into common layers, savings in power, weight and thickness of the device can be realized.

Abstract: Some embodiments provide a vehicle which includes a one or more sets of light emitter devices and sensor devices included in a common element assembly of the vehicle which includes a common window element via which the light emitter devices and sensor devices can interact with an external environment in which the vehicle is located. The sensor devices and light emitter devices can be communicatively coupled, and operation of the light emitter devices and sensor devices can be adjustably controlled to mitigate interference by the light emitter devices with sensor data representations generated by the sensor devices. The window element can include a reflection-mitigating layer which mitigates reflection of light beams emitted by one or more light emitter devices in an assembly towards one or more sensor elements of one or more sensor devices included in the same assembly.

Abstract: Some embodiments provide a vehicle that includes a protection system configured to mitigate hazards to vehicle occupants posed by dynamic elements located within proximity of the vehicle. The vehicle can, in response to determining that a dynamic element is moving along a trajectory that intersects a sweep volume of a vehicle portal, can selectively restrict operation of the portal so that an occupant is restricted from opening the portal into a volume through which the dynamic element may pass. The vehicle can restrict portal operation in response to detecting external dynamic elements that are not within an occupant's field of vision. The vehicle can communicate a limited selection of vehicle sensor data, including representations of a detected dynamic element, to a user device supporting an authorized user in response to detecting that the dynamic element is located within a certain proximity of the vehicle.

Abstract: Aspects of the present disclosure involve a method for determining a road vehicle velocity and slip angle. The current disclosure presents a technique for identifying a vehicle's velocity and slip angle, in the vehicle's coordinate frame. In one embodiment, two or more sensors are orthogonally located on the underside of the vehicle in order to obtain longitudinal and lateral velocity information for slip angle determination. In another embodiment, the two or more sensors can include an array of elements for beam steering and receiver beamforming. Spatial diversity is leveraged in identifying at least a slip angle and/or velocity of the vehicle. Doppler mapping is used as a means for slip angle determination and the clutter ridge of the Doppler map is embraced for identifying the slip angle.

Abstract: Some embodiments provide a vehicle which includes a one or more sets of light emitter devices and sensor devices included in a common element assembly of the vehicle which includes a common window element via which the light emitter devices and sensor devices can interact with an external environment in which the vehicle is located. The sensor devices and light emitter devices can be communicatively coupled, and operation of the light emitter devices and sensor devices can be adjustably controlled to mitigate interference by the light emitter devices with sensor data representations generated by the sensor devices. The window element can include a reflection-mitigating layer which mitigates reflection of light beams emitted by one or more light emitter devices in an assembly towards one or more sensor elements of one or more sensor devices included in the same assembly.

Abstract: A self-capacitance touch screen. In some examples, the touch screen comprises a plurality of display pixels, a first display pixel of the plurality of display pixels including a first touch electrode of a plurality of touch electrodes, and a gate line coupled to the first display pixel, wherein the gate line is configured such that a voltage at the gate line substantially follows a voltage at the first touch electrode. In some examples, the gate line is coupled to a resistor, the resistor being configured to decouple the gate line from ground. In some examples, the gate line is coupled to an AC voltage source.

Abstract: Some embodiments provide a vehicle that includes a protection system configured to mitigate hazards to vehicle occupants posed by dynamic elements located within proximity of the vehicle. The vehicle can, in response to determining that a dynamic element is moving along a trajectory that intersects a sweep volume of a vehicle portal, can selectively restrict operation of the portal so that an occupant is restricted from opening the portal into a volume through which the dynamic element may pass. The vehicle can restrict portal operation in response to detecting external dynamic elements that are not within an occupant's field of vision. The vehicle can communicate a limited selection of vehicle sensor data, including representations of a detected dynamic element, to a user device supporting an authorized user in response to detecting that the dynamic element is located within a certain proximity of the vehicle.

Abstract: Automated capture of image data for points of interest may be implemented for points of interest in an environment external to a vehicle. Sensors implemented as part of a vehicle may collect sensor data for an environment. Processing of the sensor data may be performed to detect points of interest in the environment. In response to detecting a point of interest, image data may be captured by one or more of the sensors implemented at the vehicle. Different types of image data may be captured, such as panoramic images and three-dimensional reconstructions of a scene. Metadata may be generated for captured image data which may describe the point of interest that is captured by the image data. The image data and the metadata may be stored locally at the vehicle or to a remote data store. The image data may also be shared with other computing devices.

Abstract: Automated capture of image data for points of interest may be implemented for points of interest in an environment external to a vehicle. Sensors implemented as part of a vehicle may collect sensor data for an environment. Processing of the sensor data may be performed to detect points of interest in the environment. In response to detecting a point of interest, image data may be captured by one or more of the sensors implemented at the vehicle. Different types of image data may be captured, such as panoramic images and three-dimensional reconstructions of a scene. Metadata may be generated for captured image data which may describe the point of interest that is captured by the image data. The image data and the metadata may be stored locally at the vehicle or to a remote data store. The image data may also be shared with other computing devices.

Abstract: Some embodiments provide an autonomous navigation system which autonomously navigates a vehicle through an environment based on predicted trajectories of one or more separate dynamic elements through the environment. The system identifies contextual cues associated with a monitored dynamic element, based on features of the dynamic element and actions of the dynamic element relative to various elements of the environment, including motions relative to other dynamic elements. A monitored dynamic element can be associated with a particular intention, which specifies a prediction of dynamic element movement through the environment, based on a correlation between identified contextual cues associated with the monitored dynamic element and a set of contextual cues which are associated with the particular intention. A predicted trajectory of the dynamic element is generated based on an associated intention.

Abstract: Some embodiments provide a sensor data-processing system which detects and classifies objects detected in an environment via fusion of sensor data representations generated by multiple separate sensors. The sensor data-processing system can fuse sensor data representations generated by multiple sensor devices into a fused sensor data representation and can further detect and classify features in the fused sensor data representation. Feature detection can be implemented based at least in part upon utilizing a feature-detection model generated via one or more of deep learning and traditional machine learning. The sensor data-processing system can adjust sensor data processing of representations generated by sensor devices based on external factors including indications of sensor health and environmental conditions.

Abstract: Some embodiments provide a vehicle that includes a protection system configured to mitigate hazards to vehicle occupants posed by dynamic elements located within proximity of the vehicle. The vehicle can, in response to determining that a dynamic element is moving along a trajectory that intersects a sweep volume of a vehicle portal, can selectively restrict operation of the portal so that an occupant is restricted from opening the portal into a volume through which the dynamic element may pass. The vehicle can restrict portal operation in response to detecting external dynamic elements that are not within an occupant's field of vision. The vehicle can communicate a limited selection of vehicle sensor data, including representations of a detected dynamic element, to a user device supporting an authorized user in response to detecting that the dynamic element is located within a certain proximity of the vehicle.