Abstract: Methods and systems of inserting image files into a container are described herein. One method includes overseeing a submission of images to containers, retrieving a job of inserting images into the container, and inserting images into the container by, for each of the plurality of images: (i) reading and analyzing source data including the image; (ii) opening the container, which includes records, where the image will be stored; (iii) determining whether the source data is valid to be entered into a record; (iv) responsive to a determination that the source of data is valid, preparing metadata; (v) writing the record into the container; and (vi) marking a status flag/mark of the record as being updated while writing the record into the container.

Abstract: A method and system for requesting information from a server are provided. The method may include sending, by a client to a server, an HTTP GET request to retrieve at least a portion of at least one derived data file, the at least one derived data file being dynamically generated by the server in response to the request using a data file virtualization policy and at least a portion of a data file. The data file virtualization policy and the data file may be stored in a storage accessible by the server, and the dynamic generation may comprise an aligned unbuffered direct read operation from the stored data file of a data size that is aligned to an integer multiple of the storage's block size. The at least the portion of the at least one derived data file may then be received by the client from the server.

Abstract: A method and system for storing data files are provided. The method includes receiving from a client computer system in communication with a server computer system, a first data file and a first data file virtualization policy; storing the first data file and the first data file virtualization policy on a storage device in communication with the server computer system; and deriving one or more second virtual data files using information from the first data file and the first data file virtualization policy, the one or more second virtual data files not being stored on the storage device. The method further includes generating a directory listing of the one or more second virtual data files such that the one or more second virtual data files appear to the client computer system as if the one or more second virtual data files is stored in the storage device.

Abstract: A method and system for requesting information from a server are provided. The method may include sending, by a client to a server, an HTTP GET request to retrieve at least a portion of at least one derived data file, the at least one derived data file being dynamically generated by the server in response to the request using a data file virtualization policy and at least a portion of a data file. The data file virtualization policy and the data file may be stored in a storage accessible by the server, and the dynamic generation may comprise an aligned unbuffered direct read operation from the stored data file of a data size that is aligned to an integer multiple of the storage's block size. The at least the portion of the at least one derived data file may then be received by the client from the server.

Abstract: A method and system for requesting information from a server are provided. The method may include sending, by a client to a server, an HTTP GET request to retrieve at least a portion of at least one derived data file, the at least one derived data file being dynamically generated by the server in response to the request using a data file virtualization policy and at least a portion of a data file. The data file virtualization policy and the data file may be stored in a storage accessible by the server, and the dynamic generation may comprise an aligned unbuffered direct read operation from the stored data file of a data size that is aligned to an integer multiple of the storage's block size. The at least the portion of the at least one derived data file may then be received by the client from the server.

Abstract: Methods and systems of inserting image files into a container are described herein. One method includes overseeing a submission of images to containers, retrieving a job of inserting images into the container, and inserting images into the container by, for each of the plurality of images: (i) reading and analyzing source data including the image; (ii) opening the container, which includes records, where the image will be stored; (iii) determining whether the source data is valid to be entered into a record; (iv) responsive to a determination that the source of data is valid, preparing metadata; (v) writing the record into the container; and (vi) marking a status flag/mark of the record as being updated while writing the record into the container.

Abstract: Methods and systems of inserting image files into a container are described herein. One method includes overseeing a submission of images to containers, retrieving a job of inserting images into the container, and inserting images into the container by, for each of the plurality of images: (i) reading and analyzing source data including the image; (ii) opening the container, which includes records, where the image will be stored; (iii) determining whether the source data is valid to be entered into a record; (iv) responsive to a determination that the source of data is valid, preparing metadata; (v) writing the record into the container; and (vi) marking a status flag/mark of the record as being updated while writing the record into the container.

Abstract: A method and system for requesting information from a server are provided. The method may include sending, by a client to a server, an HTTP GET request to retrieve at least a portion of at least one derived data file, the at least one derived data file being dynamically generated by the server in response to the request using a data file virtualization policy and at least a portion of a data file. The data file virtualization policy and the data file may be stored in a storage accessible by the server, and the dynamic generation may comprise an aligned unbuffered direct read operation from the stored data file of a data size that is aligned to an integer multiple of the storage's block size. The at least the portion of the at least one derived data file may then be received by the client from the server.

Abstract: Methods and systems of inserting image files into a container are described herein. One method includes overseeing a submission of images to containers, retrieving a job of inserting images into the container, and inserting images into the container by, for each of the plurality of images: (i) reading and analyzing source data including the image; (ii) opening the container, which includes records, where the image will be stored; (iii) determining whether the source data is valid to be entered into a record; (iv) responsive to a determination that the source of data is valid, preparing metadata; (v) writing the record into the container; and (vi) marking a status flag/mark of the record as being updated while writing the record into the container.

Abstract: A method and system for requesting information from a server are provided. The method may include sending, by a client to a server, an HTTP GET request to retrieve at least a portion of at least one derived data file, the at least one derived data file being dynamically generated by the server in response to the request using a data file virtualization policy and at least a portion of a data file. The data file virtualization policy and the data file may be stored in a storage accessible by the server, and the dynamic generation may comprise an aligned unbuffered direct read operation from the stored data file of a data size that is aligned to an integer multiple of the storage's block size. The at least the portion of the at least one derived data file may then be received by the client from the server.

Abstract: Methods and systems of inserting image files into a container are described herein. One method includes overseeing a submission of images to containers, retrieving a job of inserting images into the container, and inserting images into the container by, for each of the plurality of images: (i) reading and analyzing source data including the image; (ii) opening the container, which includes records, where the image will be stored; (iii) determining whether the source data is valid to be entered into a record; (iv) responsive to a determination that the source of data is valid, preparing metadata; (v) writing the record into the container; and (vi) marking a status flag/mark of the record as being updated while writing the record into the container.

Abstract: A method and system for requesting information from a server are provided. The method may include sending, by a client to a server, an HTTP GET request to retrieve at least a portion of at least one derived data file, the at least one derived data file being dynamically generated by the server in response to the request using a data file virtualization policy and at least a portion of a data file. The data file virtualization policy and the data file may be stored in a storage accessible by the server, and the dynamic generation may comprise an aligned unbuffered direct read operation from the stored data file of a data size that is aligned to an integer multiple of the storage's block size. The at least the portion of the at least one derived data file may then be received by the client from the server.

Abstract: Methods and systems of inserting image files into a container are described herein. One method includes overseeing a submission of images to containers, retrieving a job of inserting images into the container, and inserting images into the container by, for each of the plurality of images: (i) reading and analyzing source data including the image; (ii) opening the container, which includes records, where the image will be stored; (iii) determining whether the source data is valid to be entered into a record; (iv) responsive to a determination that the source of data is valid, preparing metadata; (v) writing the record into the container; and (vi) marking a status flag/mark of the record as being updated while writing the record into the container.

Abstract: A method and system for retrieving at least a portion of a first data file are provided. The method includes receiving a request for the at least a portion of the first data file, the request including a start of the at least a portion and a size of the at least a portion; computing a data offset that is aligned to an integer multiple of a block size of the storage device and nearest to the start of the at least a portion; computing a byte-range that is an integer multiple of the block size of the storage device; reading data within the byte-range; and transmitting the at least a portion starting at an offset relative to the data offset that is aligned to an integer multiple of the block size of the storage device.

Abstract: Methods and systems of managing data files are described herein. One method includes updating a container file of data files having a container file metadata section and one or more empty records, each record of the one or more empty records having: (i) a data file section reserved for storing a data file, (ii) a file metadata section reserved for storing metadata about the data file, and (iii) a record metadata section including information about the record and having at least a record status mark indicating that the record is empty. The method includes setting the record status mark of the one or more empty records to being updated; writing one or more records containing the data file into the one or more empty records within the container file. After successfully writing the one or more records resetting the record status mark to valid.

Abstract: A method and system for storing data files are provided. The method includes receiving from a client computer system in communication with a server computer system, a first data file and a first data file virtualization policy; storing the first data file and the first data file virtualization policy on a storage device in communication with the server computer system; and deriving one or more second virtual data files using information from the first data file and the first data file virtualization policy, the one or more second virtual data files not being stored on the storage device. The method further includes generating a directory listing of the one or more second virtual data files such that the one or more second virtual data files appear to the client computer system as if the one or more second virtual data files is stored in the storage device.

Abstract: A method and system for requesting information by a client computer system from a server computer system are provided. The method includes sending a request for policy capability of the server computer system for a data type; receiving a response to the request including a list of derived data types that are supported by the server computer system; generating a policy using the list of derived data types; and sending a first data file and a first data file virtualization policy for storage.

Abstract: A method and system for storing data files are provided. The method includes receiving a first data file and a first data file virtualization policy; associating the first data file with the first data file virtualization policy; and storing the first data file and the first data file virtualization policy on a storage device in communication with the computer system.

Abstract: Methods and systems of managing data files are described herein. One method includes updating a container file of data files having a container file metadata section and one or more empty records, each record of the one or more empty records having: (i) a data file section reserved for storing a data file, (ii) a file metadata section reserved for storing metadata about the data file, and (iii) a record metadata section including information about the record and having at least a record status mark indicating that the record is empty. The method includes setting the record status mark of the one or more empty records to being updated; writing one or more records containing the data file into the one or more empty records within the container file. After successfully writing the one or more records resetting the record status mark to valid.

Abstract: A method of managing a container file for storing data files includes creating a container file including a container file metadata section by creating one or more empty records in a storage device. Each record of the one or more empty records has a data file section reserved for storing a data file, a file metadata section reserved for storing metadata about the data file, and a record metadata section including information about the record and having at least a record status mark indicating that the record is empty. The method further includes setting a container status mark in the container file metadata section to available, after creating the container file.