Abstract: The present application provides a data storage method, a data storage apparatus and a storage system, wherein the method includes: determining a data type of to-be-stored data when the to-be-stored data is obtained (S410); determining a target storage area with a data type same as that of the to-be-stored data based on the data type of data stored in each storage area in the SMR disk (S420); determining in the target storage area a target storage block into which the to-be-stored data is to be written (S430); generating the main index information and backup index information of the to-be-stored data based on the identifier of the target storage block (S440); generating the database index information of the to-be-stored data based on the to-be-stored data and the identifier of the target storage block (S450); and writing the to-be-stored data and the backup index information of the to-be-stored data into the target storage block, writing the main index information of the to-be-stored data into the CMR area or

Abstract: Disclosed is a data reconstruction method and apparatus, and an electronic device, and a storage medium. The method comprises: obtaining attribute information for a plurality of to-be-reconstructed data items; wherein the attribute information of any of the to-be-reconstructed data items is information recorded before the to-be-reconstructed data item is lost; determining, according to the attribute information for the plurality of to-be-reconstructed data items, a reconstruction order for the plurality of to-be-reconstructed data items in a preset target sorting manner; wherein, the target sorting manner relates to the attribute information, and in the target sorting manner, a data item of greater importance has a higher priority in reconstruction. Recovery rate of important data is increased.

Abstract: A data writing and reading method and apparatus, and a cloud storage system. The data writing method includes an access node receiving a data write request, identifying domain identification information contained in the data write request when failing to obtain an available management node, and querying a pre-saved index according to the domain identification information, wherein the index includes a correspondence between a resource pool and domain identification information, identifying a target resource pool that matches the domain identification information, each resource pool including at least one storage server, determining, from at least one storage server included in the target resource pool, one of the storage servers as a target storage server, and writing data to be written into the target storage server, to ensure that the cloud storage system operates normally without additional cost when all management nodes are at fault or the management node cluster network is abnormal.

Abstract: The present application provides a data storage method, a data storage apparatus and a storage system, wherein the method includes: determining a data type of to-be-stored data when the to-be-stored data is obtained (S410); determining a target storage area with a data type same as that of the to-be-stored data based on the data type of data stored in each storage area in the SMR disk (S420); determining in the target storage area a target storage block into which the to-be-stored data is to be written (S430); generating the main index information and backup index information of the to-be-stored data based on the identifier of the target storage block (S440); generating the database index information of the to-be-stored data based on the to-be-stored data and the identifier of the target storage block (S450); and writing the to-be-stored data and the backup index information of the to-be-stored data into the target storage block, writing the main index information of the to-be-stored data into the CMR area or

Abstract: A data processing method and device, and a distributed storage system are described. The method and device are applied in a dual-control storage server. The dual-control storage server comprises two controllers. If one controller fails due to abnormalities, the other controller determines the storage device managed by the failed controller, and the other controller scans the data in the determined storage device to obtain the metadata of the storage device, and uses the metadata to read the data stored in the determined storage device. It can be seen that in this solution, if one controller is abnormal, the other controller will take the place of the failed controller to provide external services. This improves the stability of the data storage by the dual-control storage server.

Abstract: Disclosed are a storage system, and a method and an apparatus for allocating storage resources. In the storage system, a target management node allocates a target storage node to a monitoring device according to a first storage request; the target storage node allocates a target storage volume to the monitoring device according to a second storage request, allocates a target block group from the target storage volume to the monitoring device, acquires monitoring data in the form of a data stream from the monitoring device, and stores the monitoring data in the target block group. The storage system may select a management node from a management cluster to allocate a storage node to a monitoring device, and the storage node may allocate a storage position to the monitoring device. The storage position that is allocated to monitoring data can be determined by the management node and the storage node hierarchically.

Abstract: The present disclosure relates to a method and apparatus for storing data, and belongs to the technical field of storage. The method includes: receiving a storage request carrying target data, wherein the target data includes at least one data stripe, each data stripe including a plurality of data blocks; determining, among a plurality of preset storage device groupings, a target storage device grouping for storing the target data; and storing, for each data stripe, the plurality of data blocks in the data stripe into different storage devices in the target storage device grouping respectively. The risk of data loss may be reduced by employing the present disclosure.

Abstract: Embodiments of the present application provide a method for storing video data in the cloud storage system, which includes: receiving to-be-stored video data; obtaining identification information of a storage object corresponding to the to-be-stored video data; determining the storage object corresponding to the to-be-stored video data, and a first data security level and a second data security level corresponding to the storage object based on the identification information; wherein, the first data security level is higher than the second data security level; for each frame in the to-be-stored video data, determining whether the frame is a key frame; and storing the frame into the determined storage object based on the first data security level when the frame is the key frame and storing the frame into the determined storage object based on the second data security level when the frame is not the key frame.

Abstract: The embodiments of the present application disclose a data processing method and system based on cloud storage. The method includes: a cloud management device receiving a data query request sent by a client via a cloud work device, wherein the data query request is used to request for querying media data that has been stored in a cloud domain, the cloud work device is a default storage cloud domain of an IP camera; the cloud management device querying whether the media data collected by the IP camera is stored in a cloud backup device according to the data query request; and if the cloud management device determines that the media data of the IP camera is stored in the cloud backup device according to the data query request, pushing an address of the media data to the cloud work device, wherein the address of the media data is used for the client to request for querying the media data from the cloud backup device.

Abstract: A method and device for improving data storage security, related to the technical field of cloud storage is disclosed. The method includes: detecting access counts of user data sets in a cloud storage resource pool, where the user data sets in the cloud storage resource pool are data obtained by encoding with an erasure coding algorithm of a first security level; determining a first user data set whose access count in the cloud storage resource pool meets a preset condition; obtaining a second security level according to attribute information of the cloud storage resource pool, wherein the attribute information includes the first security level and an increment for security step; and re-encoding the first user data set with an erasure coding algorithm of the second security level to obtain re-encoded first user data sets.

Abstract: The present disclosure provides a data storage method, belonging to the field of data processing. The method is applied to a storage server in a cloud storage system. The method includes: monitoring data transmission status of a data acquisition device; obtaining data exception information according to the monitored data transmission exceptional status; transmitting a first data backhaul request to the data acquisition device, the data acquisition device being configured to return first data acquired within the exception time period upon receiving the first data backhaul request; and storing the first data upon receiving the first data.

Abstract: A method and an apparatus for updating data for a distributed database system are disclosed.

Abstract: Disclosed is a data reconstruction method and apparatus, and an electronic device, and a storage medium. The method comprises: obtaining attribute information for a plurality of to-be-reconstructed data items; wherein the attribute information of any of the to-be-reconstructed data items is information recorded before the to-be-reconstructed data item is lost; determining, according to the attribute information for the plurality of to-be-reconstructed data items, a reconstruction order for the plurality of to-be-reconstructed data items in a preset target sorting manner; wherein, the target sorting manner relates to the attribute information, and in the target sorting manner, a data item of greater importance has a higher priority in reconstruction. Recovery rate of important data is increased.

Abstract: Embodiments of the present application provide a method for storing video data in the cloud storage system, which includes: receiving to-be-stored video data; obtaining identification information of a storage object corresponding to the to-be-stored video data; determining the storage object corresponding to the to-be-stored video data, and a first data security level and a second data security level corresponding to the storage object based on the identification information; wherein, the first data security level is higher than the second data security level; for each frame in the to-be-stored video data, determining whether the frame is a key frame; and storing the frame into the determined storage object based on the first data security level when the frame is the key frame and storing the frame into the determined storage object based on the second data security level when the frame is not the key frame.

Abstract: The embodiments of the present disclosure disclose a method and apparatus for reading or writing disk data. The disk includes a primary metadata block storing metadata, a backup metadata block for backing up metadata, and at least one object block group. Each object block group includes a data block storing object data, and an index block storing an index of the object data. The primary metadata block is located at a head of the disk; and the backup metadata block is located at a tail of the disk. The at least one object block group is located between the primary metadata block and the backup metadata block. In reading or writing object data, the index in the index block, the metadata in the primary metadata block and the metadata backed up in the backup metadata block can be separately operated. By applying the embodiments of the present disclosure, the life and security of the disk are increased.

Abstract: Embodiments of the present application provide a method and apparatus for displaying objects. In the method, data segments of to-be-stored data are stored in storage objects. A storage object is a minimum unit for data storage. The difference between the number of data segments stored in a storage object and that of another storage object is no more than a first preset threshold. Data segments are equally stored, to the greatest extent, into storage objects. The case that data having segments lost due to failure of a storage object cannot be restored is avoided.

Abstract: Disclosed are data storage, data reading, and data cleaning methods and devices, and a cloud storage system. Storage blocks of storage nodes are grouped into resource pools. A method can include: for each resource pool, determining a first number of occupied storage blocks in the resource pool (S401); determining whether the first number meets a preset data cleaning condition (S402); if so, sending a data cleaning instruction to a storage node where each occupied second storage block in the resource pool is located, such that the storage node cleans the data stored on the second storage block in the storage node (S403). That is to say, the management node determines the number of occupied storage blocks of a resource pool. When the number meets a preset data cleaning condition, the data in the storage block is cleaned. Such a process is simple, reducing the workload of management node.

Abstract: The present disclosure relates to a method and apparatus for storing data, and belongs to the technical field of storage. The method includes: receiving a storage request carrying target data, wherein the target data includes at least one data stripe, each data stripe including a plurality of data blocks; determining, among a plurality of preset storage device groupings, a target storage device grouping for storing the target data; and storing, for each data stripe, the plurality of data blocks in the data stripe into different storage devices in the target storage device grouping respectively. The risk of data loss may be reduced by employing the present disclosure.

Abstract: Disclosed are a storage system, and a method and an apparatus for allocating storage resources. In the storage system, a target management node allocates a target storage node to a monitoring device according to a first storage request; the target storage node allocates a target storage volume to the monitoring device according to a second storage request, allocates a target block group from the target storage volume to the monitoring device, acquires monitoring data in the form of a data stream from the monitoring device, and stores the monitoring data in the target block group. The storage system may select a management node from a management cluster to allocate a storage node to a monitoring device, and the storage node may allocate a storage position to the monitoring device. The storage position that is allocated to monitoring data can be determined by the management node and the storage node hierarchically.

Abstract: A method and device for improving data storage security, related to the technical field of cloud storage is disclosed. The method includes: detecting access counts of user data sets in a cloud storage resource pool, where the user data sets in the cloud storage resource pool are data obtained by encoding with an erasure coding algorithm of a first security level; determining a first user data set whose access count in the cloud storage resource pool meets a preset condition; obtaining a second security level according to attribute information of the cloud storage resource pool, wherein the attribute information includes the first security level and an increment for security step; and re-encoding the first user data set with an erasure coding algorithm of the second security level to obtain re-encoded first user data sets.