Abstract: One or more indexes are built on data (concurrent with manipulation of data) wherein the index build operation is done without restricting the manipulation of data. The index is brought to consistency with the data based upon processing recovery log records to simulate index manipulations during data insert, update, or delete operations.

Abstract: A base table and related auxiliary table spaces are reorganized concurrently via a database utility. The database utility determines which auxiliary tables are related to the base table and automatically includes their respective auxiliary table in the same invocation of the utility. The reorganization is performed via allocated shadow data sets. The original data sets are switched with the newly built shadow data sets including the LOB shadows.

Abstract: A method, apparatus, and article of manufacture of a computer-implemented parallel database loading system. The optimum number of tasks to be processed by the system is determined by identifying the memory constraints of the system, by identifying available processing capabilities, and by determining a number of load and sort processes to be started in parallel based on the identified memory constraints and processing capabilities. Optimizing the number of load and sort processes increases overall system processing speed.

Abstract: One or more indexes are built on data (concurrent with manipulation of data) wherein the index build operation is done without restricting the manipulation of data. The index is brought to consistency with the data based upon processing recovery log records to simulate index manipulations during data insert, update, or delete operations.

Abstract: A technique for loading data into a data store connected to a computer. Under control of a main process, multiple agent load processes are started for loading data in parallel. The main process awaits receipt of a checkpoint signal from each agent load process. Then, upon receiving the checkpoint signal from each load process, the main process performs a checkpoint.

Abstract: Disclosed is a system, method, and program for extracting data from a record in a first format and inserting data into a record in a second format during an insert operation. A determination is made of location information for data in at least one record in at least one column in the first format involved in the insert operation from which data will be extracted and of location information for data in at least one record in at least one column in the second format involved in the insert operation into which the data extracted from a corresponding column in the first format will be inserted. For each column from which data will be extracted, the determined location information is used to generate at least one instruction to move the data in each column in the record in the first format to each corresponding column of one record in the second format.

Abstract: A technique for identifying changes in a data store connected to a computer. Initially, one or more interval changes are measured. Each interval change indicates an amount of change in the data store at an interval. Next, a data store change is estimated that indicates an amount of change in the data store across all of the intervals using each interval change.

Abstract: A method, apparatus, and article of manufacture for a computer-implemented building indexes system. Indexes are built for a database that is stored in a data storage device coupled to a computer. An amount of available memory is determined. An amount of memory for use in transmitting data between extract, sort, and index build tasks is determined. Then, a number of sort tasks to be used to build indexes is determined based on the determined amount of available memory, the determined amount of memory for use in transmitting data between tasks, and task memory requirements.

Abstract: A method, apparatus, and article of manufacture for a computer-implemented repartitioning system. Data is repartitioned in a database stored on a data storage device connected to a computer. First, it is detected that a partitioning scheme for the data has been altered. Next, partitions that would be affected by the altered partitioning scheme are identified. Then, the identified partitions are reorganized based on the altered partitioning scheme.

Abstract: Data is loaded to a data structure while an image copy of the data structure is concurrently formed. After data records are obtained from one or more data sources, each of the data records is associated with one of multiple pages. As each page is completed, it is written to a primary data structure. Also upon completion of each page in the primary data structure, concurrently with storage of the page in the primary data structure, an image copy of the page is made in an image copy data set. Partially or completely failed primary data structures may also be restored using image copies made according to the invention. Timestamps mark the time at which each page are made; image copy pages include the same timestamp as their respective primary pages. Upon detecting a data structure failure, each page of the image copy is sequentially reviewed. For each image page being reviewed, the page's timestamp is compared with the timestamp of the corresponding page from the primary data structure.

Abstract: A versioned-data management system (VDMSMS) is provided with a method for determining candidates for promotion in association with a user task. The VDMS maintains a list of parts changed as a result of a user task, referred to as a promote group. Before performing any changes the user informs the VDMS which user task is to be associated with the changes. All parts subsequently changed are automatically placed by the VDMS in the promote group associated with the given user task. When the parts associated with a user task for a given variant level are promoted, an iterative process is performed to determine the complete set of parts that must be promoted in support of the requested promote. Initially the set includes those parts in the promote group at the given variant level. Then all the other promote groups are searched to determine whether they contain any of the parts at the given variant level that are already in this set.

Abstract: A multiprocessing system forms a data structure, such as by loading reorganizing, or recovering, while concurrently collecting various statistics about the data structure. The data structure may comprise tables and/or indices, for example. A first processing unit forms the data structure by assimilating data from one or more data sources into data rows, storing the rows in a buffer, and copying the rows from the buffer to the data structure. Concurrently with the forming step, the same or a second processing unit retrieves the rows from the buffer and applies a predetermined analysis to the rows to formulate statistics regarding the data structure.

Abstract: A method, apparatus, and article of manufacture for a computer implemented recover/build index system. The recover/build index system builds a database index for a database file by scanning partitions of the database file in parallel to retrieve key values and their associated record identifier (rid) values. The recover/build index system then sorts the scanned key/rid values for each partition in parallel. Next, the recover/build index system performs one or more merges on the sorted key/rid values from all of the partitions to generate a single key/rid value stream. Finally, the recover/build index system builds the index using the single key/rid value stream.