Abstract: This application provides a data encoding and decoding method and a related device. In the encoding method, side information feature extraction is performed on a first feature map of current data, and quantization processing is performed, to obtain a first quantized feature map. Entropy encoding is performed based on the first quantized feature map, to obtain a first bitstream of the current data. A scaling coefficient is obtained based on the first quantized feature map, scaling processing is performed on a second feature map based on the scaling coefficient, and quantization processing is performed, to obtain a second quantized feature map. Scaling processing is performed on a first probability distribution parameter based on the scaling coefficient, to obtain a second probability distribution parameter, and entropy encoding is performed on the second quantized feature map based on the second probability distribution parameter, to obtain a second bitstream of the current data.

Abstract: Embodiments of the present specification provide a resource scheduling system and method, where a task processor receives a task processing request submitted for a task to be processed, and creates, based on the task processing request, a resource acquiring request and send same to a scheduler; a resource processing node receives the task processing request, and creates, based on the task processing request, schedulable resource information and sends same to the scheduler; the scheduler executes, according to the resource acquiring request and the schedulable resource information, resource scheduling on the task to be processed, to obtain a resource scheduling result, and sends the resource scheduling result to the resource processing node and the task processor. The resource acquiring request and the schedulable resource information are respectively sent by the task processor and the resource processing node to the scheduler directly.

Abstract: Embodiments of the present disclosure can provide distributed system resource allocation methods and apparatuses. The method comprises: receiving a resource preemption request sent by a resource scheduling server, the resource preemption request comprising job execution information corresponding to a first job management server; determining, according to the job execution information corresponding to the first job management server and comprised in the resource preemption request, resources to be returned by a second job management server and a resource return deadline; and returning, according to and the resource return deadline and a current job execution progress of the second job management server, the resources to be returned to the resource scheduling server before expiration of the resource return deadline.

Abstract: There is provided a method and a system for processing a communication channel. Including a heartbeat channel and a data channel between a master process and a worker process. The method includes determining at least one data channel associated with a heartbeat channel, detecting the determined at least one data channel, disconnecting the heartbeat channel when it is detected that any data channel is in a disconnected state to cause a heartbeat to time out, and ending a current task after it is determined that the heartbeat times out.

Abstract: A priority-based resource allocation method, includes accepting a resource application submitted by a job, the resource application including resource demand information and job priority information; determining, according to the resource demand information of the resource application, whether remaining resources of a system meet the resource application, and traversing, in an allocated resource application queue when the remaining resources do not meet the resource application, allocated resource applications having job priorities lower than that of the resource application; using the sum of system resources occupied by all traversed resource applications plus the remaining resources as available resources; and stopping traversing when the available resources meet the resource application, and allocating the available resources to the resource application.

Abstract: Embodiments of the present disclosure can provide distributed system resource allocation methods and apparatuses. The method comprises: receiving a resource preemption request sent by a resource scheduling server, the resource preemption request comprising job execution information corresponding to a first job management server; determining, according to the job execution information corresponding to the first job management server and comprised in the resource preemption request, resources to be returned by a second job management server and a resource return deadline; and returning, according to and the resource return deadline and a current job execution progress of the second job management server, the resources to be returned to the resource scheduling server before expiration of the resource return deadline.

Abstract: A computer system resource allocation method is disclosed. The method may be implemented by a process and may comprise acquiring a total system resource and resource allocation data of each resource user submitting a resource application request, the resource allocation data including a maximum resource quota and a requested amount of resource by the each resource user, determining a corresponding resource saturation rate as a ratio between the amount of requested resource and the maximum resource quota, sorting the resource users according to the calculated resource saturation rates of the respective resource users, determining a boundary resource user using a set condition, according to the sorted resource users, and identifying resource users with a resource saturation rate smaller than or equal to that of the boundary resource user to be B-class resource users, and identifying resource users with a resource saturation rate larger than that of the boundary resource user to be C-class resource users.

Abstract: There is provided a method and a system for processing a communication channel. including a heartbeat channel and a data channel between a master process and a worker process. The method includes determining at least one data channel associated with a heartbeat channel, detecting the determined at least one data channel, disconnecting the heartbeat channel when it is detected that any data channel is in a disconnected state to cause a heartbeat to time out, and ending a current task after it is determined that the heartbeat times out.

Abstract: A priority-based resource allocation method, includes accepting a resource application submitted by a job, the resource application including resource demand information and job priority information; determining, according to the resource demand information of the resource application, whether remaining resources of a system meet the resource application, and traversing, in an allocated resource application queue when the remaining resources do not meet the resource application, allocated resource applications having job priorities lower than that of the resource application; using the sum of system resources occupied by all traversed resource applications plus the remaining resources as available resources; and stopping traversing when the available resources meet the resource application, and allocating the available resources to the resource application.

Abstract: A computer system resource allocation method is disclosed. The method may be implemented by a process and may comprise acquiring a total system resource and resource allocation data of each resource user submitting a resource application request, the resource allocation data including a maximum resource quota and a requested amount of resource by the each resource user, determining a corresponding resource saturation rate as a ratio between the amount of requested resource and the maximum resource quota, sorting the resource users according to the calculated resource saturation rates of the respective resource users, determining a boundary resource user using a set condition, according to the sorted resource users, and identifying resource users with a resource saturation rate smaller than or equal to that of the boundary resource user to be B-class resource users, and identifying resource users with a resource saturation rate larger than that of the boundary resource user to be C-class resource users.