Abstract: The present disclosure discloses Spark collaborative computing, job method and apparatus for multiple K8s clusters, and addresses the problem that most of the current multiple K8s clusters adopt the model of federated clusters, and Spark's own method of scheduling and optimization cannot be implemented across domains, by implementing a cross-domain job method, setting the multiple K8s clusters as a master cluster and a slave cluster, with the master cluster being responsible for creating Spark's The master cluster is responsible for creating Spark's Driver container and Pods, and the slave cluster is responsible for creating Spark's Executor container and Pods. After the containers are created, a direct tunnel is established between the master cluster and the slave cluster by aggregating address information and access credentials through the Collaboration Center, and the containers in the slave cluster register with Driver and continuously send heartbeat messages through the tunnel.

Abstract: The present disclosure discloses Spark collaborative computing, job method and apparatus for multiple K8s clusters, and addresses the problem that most of the current multiple K8s clusters adopt the model of federated clusters, and Spark's own method of scheduling and optimization cannot be implemented across domains, by implementing a cross-domain job method, setting the multiple K8s clusters as a master cluster and a slave cluster, with the master cluster being responsible for creating Spark's The master cluster is responsible for creating Spark's Driver container and Pods, and the slave cluster is responsible for creating Spark's Executor container and Pods. After the containers are created, a direct tunnel is established between the master cluster and the slave cluster by aggregating address information and access credentials through the Collaboration Center, and the containers in the slave cluster register with Driver and continuously send heartbeat messages through the tunnel.

Abstract: A job decomposition processing method for distributed computing, which comprises: analyzing a source program to be run by program static analysis to determine a function call graph contained in the source program; determining feature information of functions contained in the source program by program dynamics analysis or/and a program intelligent decomposition algorithm, wherein the feature information of the functions is used to characterize relevant information when each function is being running; decomposing the source program based on the feature information of the functions, a function relationship and available resource information of a computing platform to form an execution recommendation for each function on the computing platform, i.e., which hardware resources are used for computing each function; finally inserting a modifier in the source program and starting computation on the computing platform.

Abstract: A job decomposition processing method for distributed computing, which comprises: analyzing a source program to be run by program static analysis to determine a function call graph contained in the source program; determining feature information of functions contained in the source program by program dynamics analysis or/and a program intelligent decomposition algorithm, wherein the feature information of the functions is used to characterize relevant information when each function is being running; decomposing the source program based on the feature information of the functions, a function relationship and available resource information of a computing platform to form an execution recommendation for each function on the computing platform, i.e., which hardware resources are used for computing each function; finally inserting a modifier in the source program and starting computation on the computing platform.

Abstract: The present invention discloses a cloud-side collaborative multi-mode private data circulation method based on a smart contract, including: S1, a system is initialized; S2, the original data are encrypted into private data, an encryption certificate z? for storage is generated, and z? includes metadata and a data certificate key?; S3, the DO calls a smart contract program to realize uplink of the encryption certificate z? and releases z? to a block chain through a smart contract, wherein the smart contract is open to all user accounts; S4, rapid data circulation is realized: when DO releases the data certificate, DU has been identified, a DU's account IDDU is set through an access policy, the DU obtains an encryption key for data access by executing a smart contract and a key algorithm, private data are obtained through metadata and decrypted to obtain a plaintext; and S5, the data circulation is confirmed.

Abstract: The present invention discloses an edge calculation-oriented reparametric neural network architecture search method, including the following steps: S1: designing linear operators and multi-branch block structures; S2: constructing a hypernetwork by stacking the multi-branch block structures; S3: training the hypernetwork through a gradient-based first-stage search algorithm; S4: deleting redundant branches in the hypernetwork to construct an optimal subnetwork; S5: converting the multi-branch optimal subnetwork into a single-branch network; and S6: completing task reasoning by using the single-branch network. The method is used to search the neural network structure capable of performing reparameterization, and ensures the reasoning real-time performance and the high efficiency of model operation while ensuring the reasoning precision.

Abstract: The present invention discloses an edge calculation-oriented reparametric neural network architecture search method, including the following steps: S1: designing linear operators and multi-branch block structures; S2: constructing a hypernetwork by stacking the multi-branch block structures; S3: training the hypernetwork through a gradient-based first-stage search algorithm; S4: deleting redundant branches in the hypernetwork to construct an optimal subnetwork; S5: converting the multi-branch optimal subnetwork into a single-branch network; and S6: completing task reasoning by using the single-branch network. The method is used to search the neural network structure capable of performing reparameterization, and ensures the reasoning real-time performance and the high efficiency of model operation while ensuring the reasoning precision.

Abstract: The present invention discloses a cloud-side collaborative multi-mode private data circulation method based on a smart contract, including: S1, a system is initialized; S2, the original data are encrypted into private data, an encryption certificate z? for storage is generated, and z? includes metadata and a data certificate key?; S3, the DO calls a smart contract program to realize uplink of the encryption certificate z? and releases z? to a block chain through a smart contract, wherein the smart contract is open to all user accounts; S4, rapid data circulation is realized: when DO releases the data certificate, DU has been identified, a DU's account IDDU is set through an access policy, the DU obtains an encryption key for data access by executing a smart contract and a key algorithm, private data are obtained through metadata and decrypted to obtain a plaintext; and S5, the data circulation is confirmed.