Abstract: A method and apparatus for job submission are described. In one embodiment, the jobs are submitted by a job submission service or gateway that schedules large-scale data processing jobs on remote infrastructure. In one embodiment, the method comprises: receiving a request at a proxy service from a client, via a network communication, to submit a job to a cluster; and managing the job externally to the client, including sending a request to an orchestration system to launch an orchestration system job in a container to start the job running on the cluster via a client process run on a job client in the container and provide state information back to the proxy service regarding the orchestration system job.

Abstract: A method and apparatus for job submission are described. In one embodiment, the jobs are submitted by a job submission service or gateway that schedules large-scale data processing jobs on remote infrastructure. In one embodiment, the method comprises: receiving a request at a proxy service from a first client, via a first network communication, to submit a first job to a cluster; and managing the first job externally to the first client, including sending a request to an orchestration system to launch an orchestration system job in a container to start the first job running on the cluster via a client process run on a job client in the container and provide state information back to the proxy service regarding the orchestration system job.