Abstract: A data processing method, a related device and a system are disclosed. In an embodiment, a data processing method includes generating, by a client, a data digest for a stored data set, and sending the data digest to a server, wherein the data digest is used to trigger the server to determine, according to the data digest, feedback information for the client, receiving, by the client, the feedback information sent by the server, when the feedback information comprises a target data selection policy and a target policy parameter, determining, by the client, a data subset from the data set according to the target data selection policy and the target policy parameter, wherein the target policy parameter is used to limit a quantity of pieces of data in the data subset, and sending, by the client, the data subset to the server.

Abstract: A method and an apparatus for data processing in data modeling, where the method includes performing, according to a data transformation function corresponding to a preset data processing category identifier, data transformation on a data column corresponding to each characteristic in original data in order to generate a corresponding extended characteristic column, combining extended characteristic columns corresponding to all the characteristics in the original data in order to generate an extended characteristic set, determining a correlation coefficient of each characteristic in the extended characteristic set, selecting a characteristic whose correlation coefficient satisfies a specified condition as an important characteristic, and obtaining, by screening from the extended characteristic set, a data column corresponding to the important characteristic.

Abstract: A data processing method and apparatus are disclosed. The method is determining candidate computing frameworks for each sub-task in a sub-task set; predicating operation time and resource consumption that correspond to each candidate computing framework when the candidate computing framework executes the sub-task; and selecting, in the candidate computing frameworks according to the predicated operation time and resource consumption that correspond to each candidate computing framework when the candidate computing framework executes the sub-task, a target computing framework executing the sub-task (204), and executing the sub-task (205). In this way, a resource management system selects a target computing framework from multiple computing frameworks according to operation time and resource consumption, to execute each sub-task, so as to improve the data processing efficiency and working performance of the system.

Abstract: A data mining method and apparatus where the method includes determining multiple execution steps of a data mining process, acquiring a correspondence between a physical resource required by each execution step in a running process and a physical resource occupied by input data of the data mining process, determining a node for executing each execution step, determining, according to a maximum amount of data of input data that can be processed by the node for executing each step, a maximum amount of data of input data that can be processed by the distributed system, and processing to-be-mined data in accordance with the data mining process according to the maximum amount of data of the input data that can be processed by the distributed system. The input data is accurately and effectively limited such that normal running of the system can be ensured.

Abstract: A data processing method, a related device and a system are disclosed. In an embodiment, a data processing method includes generating, by a client, a data digest for a stored data set, and sending the data digest to a server, wherein the data digest is used to trigger the server to determine, according to the data digest, feedback information for the client, receiving, by the client, the feedback information sent by the server, when the feedback information comprises a target data selection policy and a target policy parameter, determining, by the client, a data subset from the data set according to the target data selection policy and the target policy parameter, wherein the target policy parameter is used to limit a quantity of pieces of data in the data subset, and sending, by the client, the data subset to the server.

Abstract: Embodiments of the present invention provide a data processing method. A data processing apparatus obtains a first dataset, and determines a change of a data feature of the first dataset relative to a data feature of a second dataset, where the second dataset is a dataset that is received before the data processing apparatus obtains the first dataset; determines a hyperparameter according to the data feature of the first dataset when the change of the data feature of the first dataset relative to the data feature of the second dataset is greater than or equal to a preset data feature threshold; determines a first data model according to the determined hyperparameter and the first dataset; and processes data according to the determined first data model, to improve efficiency of determining the first data model, thereby improving efficiency of processing data.

Abstract: A data processing method and apparatus are disclosed. The method is determining candidate computing frameworks for each sub-task in a sub-task set; predicating operation time and resource consumption that correspond to each candidate computing framework when the candidate computing framework executes the sub-task; and selecting, in the candidate computing frameworks according to the predicated operation time and resource consumption that correspond to each candidate computing framework when the candidate computing framework executes the sub-task, a target computing framework executing the sub-task (204), and executing the sub-task (205). In this way, a resource management system selects a target computing framework from multiple computing frameworks according to operation time and resource consumption, to execute each sub-task, so as to improve the data processing efficiency and working performance of the system.

Abstract: A method and an apparatus for data processing in data modeling, where the method includes performing, according to a data transformation function corresponding to a preset data processing category identifier, data transformation on a data column corresponding to each characteristic in original data in order to generate a corresponding extended characteristic column, combining extended characteristic columns corresponding to all the characteristics in the original data in order to generate an extended characteristic set, determining a correlation coefficient of each characteristic in the extended characteristic set, selecting a characteristic whose correlation coefficient satisfies a specified condition as an important characteristic, and obtaining, by screening from the extended characteristic set, a data column corresponding to the important characteristic.

Abstract: A data mining method and apparatus where the method includes determining multiple execution steps of a data mining process, acquiring a correspondence between a physical resource required by each execution step in a running process and a physical resource occupied by input data of the data mining process, determining a node for executing each execution step, determining, according to a maximum amount of data of input data that can be processed by the node for executing each step, a maximum amount of data of input data that can be processed by the distributed system, and processing to-be-mined data in accordance with the data mining process according to the maximum amount of data of the input data that can be processed by the distributed system. The input data is accurately and effectively limited such that normal running of the system can be ensured.

Abstract: The present invention discloses a message signature method, which includes: selecting a signature template that includes a signature variable for a message to be sent; parsing the signature variable in the signature template to obtain a current value of the signature variable, and filling the current value of the signature variable in the signature template to obtain a signed message; and sending the signed message. Meanwhile, the present invention further discloses a message signature device. With the present invention, signature content that changes dynamically can be obtained, which makes the message signature more interesting and personalized, easy to be implemented, and highly practicable.

Abstract: A recommendation method based on collaborative filtering is provided, which includes the following steps. A target user identifier (ID) is acquired. A user group ID corresponding to the target user ID is searched. A similarity between items is acquired, which is determined according to a user-item rating matrix corresponding to the user group M. An item is recommended to a target user according to the similarity between the items.

Abstract: The invention concerns a method for retrieving styrene monomer from discarded polystyrene scarp through pyrolytic reduction. The method provided by this invention involves the application of metal oxide catalyst and putting alloy additives on the bottom of a pyrolyzer. When the temperature of the pyrolyzer reaches 250.degree. C., the discarded polystyrene granules 3-5 mm in diameter are continuously fed at a constant rate. At the temperature of 350.degree. C. the gas is introduced. The temperature is kept in a range of 450.degree.-500.degree. C., till a batch polystyrene is completely pyrolyzed. During feeding the polystyrene a reduced pressure distillation is carried out. The yield of a liquid distillate is 90% of the feed stock in weight. The recovery rate of styrene amounts to 70-75%. The present invention provides an effective method for solving environmental pollution caused by discarded polystyrene and for retrieving polystyrene.