Abstract: A computing system including a plurality of processing devices configured to execute a Mixture-of-Experts (MoE) layer. The processing devices are configured to execute the MoE layer at least in part by receiving an input tensor including input tokens. Executing the MoE layer further includes computing a gating function output vector based on the input tensor and computing a sparse encoding of the input tensor and the gating function output vector. The sparse encoding indicates one or more destination expert sub-models. Executing the MoE layer further includes dispatching the input tensor for processing at the one or more destination expert sub-models, and further includes computing an expert output tensor. Executing the MoE layer further includes computing an MoE layer output at least in part by computing a sparse decoding of the expert output tensor. Executing the MoE layer further includes conveying the MoE layer output to an additional computing process.

Abstract: Provided is a time series deep survival analysis system combined with active learning. The system includes: a data collection module, an active learning module, and a time series deep survival analysis module; the data collection module is used for obtaining survival data of objects to be analyzed; combined with an active learning method, the active learning module selects a part of right censored data to label a survival time; and the time series deep survival analysis module constructs a time series deep survival analysis neural network model, and takes uncensored data and right censored data as model inputs, so as to obtain survival time prediction results of the objects to be analyzed. The present application can make full use of the right censored data in the survival data and time series features.

Abstract: Provided is a time series deep survival analysis system combined with active learning. The system includes: a data collection module, an active learning module, and a time series deep survival analysis module; the data collection module is used for obtaining survival data of objects to be analyzed; combined with an active learning method, the active learning module selects a part of right censored data to label a survival time; and the time series deep survival analysis module constructs a time series deep survival analysis neural network model, and takes uncensored data and right censored data as model inputs, so as to obtain survival time prediction results of the objects to be analyzed. The present application can make full use of the right censored data in the survival data and time series features.