Abstract: Metadata is generated for a digital video project in a manner that facilitates mixing video with other content to render a composite video file. The metadata may include global information for the project, per-frame information that acts as a representation of continuous values throughout a video; and key-frame information which is a representation of discrete events throughout the video. The per-frame information may include, for example, point-wise location of specific objects and/or polygons/rectangles of tracked objects. The key-frame information may include information regarding scene changes, information regarding changes in emotion of a person and/or information regarding changes in pose of a person.

Abstract: The invention provides the techniques and systems that allow for the identification and classification of objects (i.e., humans) in images using a predictive segmentation model. More specifically, human forms are identified within an image by generating pixel-level bounding boxes for each possible object and using offsets and segmentation masking. In some instances, embodiments of the invention use an identified floor plane that intersects with a bounding box to identify a three-dimensional position for the intersection point, which can then be assigned to the human form and represent its depth within the image.

Abstract: The invention provides the techniques and systems that allow for the identification and classification of objects (i.e., humans) in images using a predictive segmentation model. More specifically, human forms are identified within an image by generating pixel-level bounding boxes for each possible object and using offsets and segmentation masking. In some instances, embodiments of the invention use an identified floor plane that intersects with a bounding box to identify a three-dimensional position for the intersection point, which can then be assigned to the human form and represent its depth within the image.