Abstract: An automatic visual data labeling framework for heterogeneous data types is described. An example method can include obtaining scan data and video data that each depict a scene including an object. The scan data can be generated by a scanner. The video data can be generated by a camera. The method can also include generating a virtual representation of the scene in a virtual environment based on the scan data. The virtual representation can include a virtual representation subset corresponding to the object. The virtual environment can be associated with a virtual camera. The method can also include applying label data to the virtual representation subset to create a labeled virtual representation subset corresponding to the object. The method can also include applying the labeled virtual representation subset to the object depicted in the video data based on a correlation of the scanner, the camera, and the virtual camera.

Abstract: A new apparatus and method for tracking a moving object with a moving camera provides a real-time, narrow field-of-view, high resolution and on target image by combining commanded motion with an optical flow algorithm for deriving motion and classifying background. Commanded motion means that movement of the pan, tilt and zoom (PTZ) unit is “commanded” by a computer, instead of being observed by the camera, so that the pan, tilt and zoom parameters are known, as opposed to having to be determined, significantly reducing the computational requirements for tracking a moving object.