Abstract: Aspects of the disclosure provide for mechanisms for container scheduling in a computing system (e.g., a cloud computing environment). A method of the disclosure may include running a plurality of container groups on one or more node groups of a computing system, wherein each of the container groups comprises one or more containers configured to execute one of a plurality of jobs (containerized tasks); in view of a determination that a first job of the plurality of jobs is completed, removing, by a processing device, a first container group running on a first node of a first node group from the first node, wherein the first container group is configured to execute the first job; and migrating, by the processing device, one or more of the first plurality of container groups within the first node group to consolidate computing resources of the first node group.