Abstract: An illustrative point cloud segmentation system generates an instance-wise semantic mask for a particular source image of a set of source images that has been used to construct a 3D point cloud representing a scene that includes one or more objects. The point cloud segmentation system maps a set of 3D points from the 3D point cloud to corresponding 2D points of the particular source image, then labels, based on contours defined by the instance-wise semantic mask to demarcate the one or more objects, the mapped set of 3D points in accordance with where the corresponding 2D point for each mapped 3D point is positioned with respect to the contours. Based on the labeling of the mapped 3D points, the point cloud segmentation system produces a segmented 3D point cloud including an instance-wise segmentation of the one or more objects at the scene. Corresponding methods and systems are also disclosed.

Abstract: An illustrative augmented reality tracking system obtains a volumetric feature descriptor dataset that includes: 1) a plurality of feature descriptors associated with a plurality of views of a volumetric target, and 2) a plurality of 3D structure datapoints that correspond to the plurality of feature descriptors. The system also obtains an image frame captured by a user equipment (UE) device. The system identifies a set of image features depicted in the image frame and detects, based on a match between the set of image features depicted in the image frame and a set of feature descriptors of the plurality of feature descriptors, that the volumetric target is depicted in the image frame. In response to this detecting and based on 3D structure datapoints corresponding to matched feature descriptors, the system determines a spatial relationship between the UE device and the volumetric target. Corresponding methods and systems are also disclosed.

Abstract: An illustrative augmented reality tracking system obtains a volumetric feature descriptor dataset that includes: 1) a plurality of feature descriptors associated with a plurality of views of a volumetric target, and 2) a plurality of 3D structure datapoints that correspond to the plurality of feature descriptors. The system also obtains an image frame captured by a user equipment (UE) device. The system identifies a set of image features depicted in the image frame and detects, based on a match between the set of image features depicted in the image frame and a set of feature descriptors of the plurality of feature descriptors, that the volumetric target is depicted in the image frame. In response to this detecting and based on 3D structure datapoints corresponding to matched feature descriptors, the system determines a spatial relationship between the UE device and the volumetric target. Corresponding methods and systems are also disclosed.

Abstract: An exemplary object identification system detects, based on a machine learning model, an object depicted within a video frame. The system identifies, based on the detecting of the object, a class label of the object and a region of interest, within the video frame, of the object. The system identifies, within the region of interest of the object, set of features of the object. The system compares the set of features of the object with a plurality of predefined features within a data store associated with the class label of the object. The system determines, based on the comparing of the set of features of the object with the plurality of predefined features within the data store, whether the object is configured to trigger an augmentation of video content associated with the video frame. Corresponding methods and systems are also disclosed.

Abstract: An exemplary object identification system detects, based on a machine learning model, an object depicted within a video frame. The system identifies, based on the detecting of the object, a class label of the object and a region of interest, within the video frame, of the object. The system identifies, within the region of interest of the object, set of features of the object. The system compares the set of features of the object with a plurality of predefined features within a data store associated with the class label of the object. The system determines, based on the comparing of the set of features of the object with the plurality of predefined features within the data store, whether the object is configured to trigger an augmentation of video content associated with the video frame. Corresponding methods and systems are also disclosed.

Abstract: An augmented reality projection device includes an image sensor having a field of view into a real-world environment, a spatial sensor configured to detect a location and an orientation of the device in the environment, and a projector configured to project content onto a physical surface within the environment. The device determines the location and orientation of the device based on sensor output from the spatial sensor, and determines that a virtual target object is included within the field of view of the image sensor based on the determined location and orientation and based on a particular target object profile from a library of predetermined target object profiles. The device identifies content associated with the virtual target object and directs the projector to project the content onto the physical surface within the environment, the physical surface associated with the virtual target object. Corresponding methods and systems are also disclosed.

Abstract: An augmented reality projection device includes an image sensor having a field of view into a real-world environment, a spatial sensor configured to detect a location and an orientation of the device in the environment, and a projector configured to project content onto a physical surface within the environment. The device determines the location and orientation of the device based on sensor output from the spatial sensor, and determines that a virtual target object is included within the field of view of the image sensor based on the determined location and orientation and based on a particular target object profile from a library of predetermined target object profiles. The device identifies content associated with the virtual target object and directs the projector to project the content onto the physical surface within the environment, the physical surface associated with the virtual target object. Corresponding methods and systems are also disclosed.

Abstract: An augmented reality presentation system directs a sensor included within an augmented reality projection device to capture an image of a portion of a real-world environment included within a field of view of the sensor. As the sensor captures the image, the system determines that a target object located within the real-world environment is included within the field of view of the sensor, and identifies augmented reality content associated with the target object. As the sensor continues capturing the image, the system directs a projector included within the augmented reality projection device to project the augmented reality content onto a physical surface within the real-world environment and associated with the target object. The physical surface is physically detached from the augmented reality projection device and is included within the field of view of the sensor while the augmented reality content is projected onto the physical surface.

Abstract: An augmented reality presentation system directs a sensor included within an augmented reality projection device to capture an image of a portion of a real-world environment included within a field of view of the sensor. As the sensor captures the image, the system determines that a target object located within the real-world environment is included within the field of view of the sensor, and identifies augmented reality content associated with the target object. As the sensor continues capturing the image, the system directs a projector included within the augmented reality projection device to project the augmented reality content onto a physical surface within the real-world environment and associated with the target object. The physical surface is physically detached from the augmented reality projection device and is included within the field of view of the sensor while the augmented reality content is projected onto the physical surface.