Abstract: An apparatus and method for video encoding with low latency is disclosed. The apparatus comprises a video encoding module to encode input video data into compressed video data, one or more processing modules to provide the input video data to the video encoding module or to further process the compressed video data from the video encoding module, and one data memory associated with each processing module to store or to provide shared data between the video encoding module and each processing module. The encoding module and each processing module are configured to manage data access of one data memory by coordinating one of the video encoding module and one processing module to receive target shared data from one data memory after the target shared data from another of the video encoding module and one processing module are ready in said one data memory.