Abstract: Disclosed are embodiments of a system for optimizing query processing in a federated information system. The system may be used to identify alternative query plans in a simulated environment and to calculate cost estimates associated with the alternative query plans, based not only on database statistics and query statements, but also based on workload and processing latencies associated with specific data source and with the federated information system as a whole. In addition the calculated cost estimates may also factor in data source availability and reliability. The system may use the alternative query plans and the associated cost estimates to influence query processing in a federated information system by feeding to the federated information system query plans that allow for cost-efficient query plan-level load distribution, cost-efficient query fragment plan-level load distribution, and load distribution based upon quality of service cost constraints.

Abstract: A system, method, and program storage device implementing the method, for integrating data in a database management system, wherein the method comprises grouping data sources and replicas of the data sources that provide analogous data into a common logical domain; writing application queries against the common logical domain; selecting a correct set of replicas of the data sources and a query-execution strategy for combining a content of the correct set of replicas of the data sources in order to answer the application queries according to query-cost-based optimization; selecting a correct set of data sources according to run-time constraints; shielding the application queries from changes to the data sources by dynamically binding the application queries against the correct sets of data sources and replicas of the data sources; and processing the application queries by generating an optimum query result based on the steps of grouping and shielding.

Abstract: A method masking data failures, when a master copy of data is unavailable comprises storing a single master copy of data and a replica copy of the data; writing to the master using a middleware component; and reading from either the master or the replica using the middleware component, when the master copy is unavailable. When the master is unavailable, the writes are stored in a table located in the middleware component as stored write requests, in which the stored write requests comprise UDI's to be made to the master. The reads are also performed from the table and the replica when the master is unavailable. When the master becomes available, the stored write requests are propagated to the master. Thus, the middleware allows the writes to run during times when the master is unavailable.

Abstract: Disclosed are embodiments of a system for optimizing query processing in a federated information system. The system may be used to identify alternative query plans in a simulated environment and to calculate cost estimates associated with the alternative query plans, based not only on database statistics and query statements, but also based on workload and processing latencies associated with specific data source and with the federated information system as a whole. In addition the calculated cost estimates may also factor in data source availability and reliability. The system may use the alternative query plans and the associated cost estimates to influence query processing in a federated information system by feeding to the federated information system query plans that allow for cost-efficient query plan-level load distribution, cost-efficient query fragment plan-level load distribution, and load distribution based upon quality of service cost constraints.

Abstract: Disclosed are embodiments of a system for optimizing query processing in a federated information system. The system may be used to identify alternative query plans in a simulated environment and to calculate cost estimates associated with the alternative query plans, based not only on database statistics and query statements, but also based on workload and processing latencies associated with specific data source and with the federated information system as a whole. In addition the calculated cost estimates may also factor in data source availability and reliability. The system may use the alternative query plans and the associated cost estimates to influence query processing in a federated information system by feeding to the federated information system query plans that allow for cost-efficient query plan-level load distribution, cost-efficient query fragment plan-level load distribution, and load distribution based upon quality of service cost constraints.

Abstract: A system, method, and program storage device implementing the method, for integrating data in a database management system, wherein the method comprises grouping data sources and replicas of the data sources that provide analogous data into a common logical domain; writing application queries against the common logical domain; selecting a correct set of replicas of the data sources and a query-execution strategy for combining a content of the correct set of replicas of the data sources in order to answer the application queries according to query-cost-based optimization; selecting a correct set of data sources according to run-time constraints; shielding the application queries from changes to the data sources by dynamically binding the application queries against the correct sets of data sources and replicas of the data sources; and processing the application queries by generating an optimum query result based on the steps of grouping and shielding.

Abstract: A system and method of lightweight asynchronous data replication that avoids the need for any persistent store at the replication source or communication channel, and is independent of the underlying data formats, wherein the method of data replication comprises replicating deltas from a source, embedding replication tracking information in the replicated deltas, wherein the tracking information comprises a timestamp and a sequence number, and applying deltas at a target. The tracking information is used to ensure that each delta is applied exactly once. In the event of a crash in the system, the target analyzes the tracking information to determine which deltas have been applied, and requests retransmission of replicated data from the source starting from the earliest unapplied delta. The source and target are treated as only delta producers and consumers, and as such the invention is applicable to replication between arbitrary data source formats.

Abstract: A computer-implemented method for minimizing the amount of time to access current data in a database which may be stored wholly in a DASD-oriented external storage subsystem or partly in DASD and partly in a stored high-speed electronic store while maintaining coherency of the data with respect to multiple user systems.

Abstract: A computer program product, such as a pre-recorded software program on a floppy disk, is disclosed, for use with a processing and database system for off-loading, to disk controller, the extraction of committed data. Responsive to the pre-recorded program instructions, the system first picks a Commit.sub.-- LSN value and insures all the data modified prior to the Commit.sub.-- LSN value is processed following the DBMS policy of reducing some disk I/Os or not for the modified pages cached in the system. If the policy is not to do disk I/Os for such pages, then the system places the identifiers of those pages in an ignore list. Otherwise, the system writes those pages to disk and empties the ignore list. Afterwards, the system forwards the ignore list and the Commit.sub.-- LSN along with information regarding the data to be processed to the controller.

Abstract: An efficient procedure for determining the set of buffer pool database pages that must be externalized to stable storage and for scheduling their write I/O's before release of a committing transaction's locks. In a multisystem database management system (DBMS) with high-speed shared external storage (SES) environment, a DBMS instance may follow "force-at-commit" protocol for a database that has intersystem read/write interest or may alternatively follow a "no-force-at-commit" policy when operating with a database for which only one system has interest. By introducing the concept of a series of unique ordinal numbers (ORD#) for each database assigned to buffer pool data pages whenever the page state changes from clean to dirty within a single DBMS instance, this procedure maintains a transaction page list (TPL) for each transaction in ORD# order.

Abstract: A computer-implemented method for minimizing the amount of time to access current data in a database which may be stored wholly in a DASD-oriented external storage subsystem or partly in DASD and partly in a stored high-speed electronic store while maintaining coherency of the data with respect to multiple user systems.

Abstract: In a combination of multiple concurrently-executing database management systems which share data storage resources, efficient lock processing for shared data is implemented by hiding from a global lock manager the distinction between transaction-interest and cache-interest locks that are processed at the DBMS level. The local lock manager of a DBMS, in response to a request for either type of lock, may issue a request to the global lock manager for a system-level lock without disclosing to the global lock manager the type of lock requested of the local lock manager. After receipt of the system level lock, the local lock manager can grant either transaction or cache interest locks locally on a data resource if the combined mode of locally-held locks on that data resource is greater than or equal to the requested mode.

Abstract: A method for ensuring data coherence while detecting whether the locally cached copy of a data page is invalid and responsively refreshing the locally cached page from a Shared Electronic Store (SES) in a multisystem shared disk environment. Locally cached data pages may become invalid in a multisystem shared disk environment because of transactions executed by other systems for the common database. Thus, whenever a transaction in a database management system (DBMS) instance desires to read or update a record in a locally cached data page, the DBMS must first verify validity for the locally cached copy and, for stale or invalid copies, must re-read and re-register the latest version in the SES. This invention provides a procedure for the necessary verification and refreshing steps that relies on page latching to serialize the combination of local multiuser and global multisystem activities. The procedure of this invention supports both record and page locking granularities.

Abstract: A method for controlling coherence of data elements sharable among a plurality of independently-operating CPCs (central processing complexes) in a multi-system complex (called a parallel sysplex) which contains sysplex DASDds (direct access storage devices) and a high-speed SES (shared electronic storage) facility. Sysplex shared data elements are stored in the sysplex DASD under a unique sysplex data element name, which is used for sysplex coherence control. Any CPC may copy any sysplex data element into a local cache buffers (LCB) in the CPC's main storage, where it has an associated sysplex validity bit. The copying CPC executes a sysplex coherence registration command which requests a SES processor to verify that the data element name already exists in the SES cache, and to store the name of the data element in a SES cache entry if found in the SES cache. Importantly, the registration command communicates to SES the CPC location of the validity bit for the LCB containing that data element copy.

Abstract: A method is disclosed for a database system for [off-loading] off-loading, to disk [controller] controller, the extraction of committed [data involving the] data. The system first [picking] picks a Commit.sub.-- LSN value and [insuring] insures all the data modified prior to the Commit.sub.-- LSN value is processed following the DBMS policy of reducing some disk I/Os or not for the modified pages cached in the system. If the policy is not to do disk I/Os for such [pages] pages, then the system places the identifiers of those pages in an ignore list. Otherwise, the system writes those pages to disk and empties the ignore list. [After which] Afterwards, the system forwards the ignore list and the Commit.sub.--LSN along with information regarding the data to be processed to the controller. The controller performs the off-load function by reading from disk every page identified by the system except those in the ignore [list] list, and [determining] determining, for each [page] page, if the page's Page.sub.

Abstract: A high-speed cache is shared by a plurality of independently-operating data systems in a multi-system data sharing complex. Each data system has access both to the high-speed cache and the lower-speed, secondary storage for obtaining and storing data. Management logic and the high-speed cache assures that a block of data obtained form the cache for entry into the secondary storage will be consistent with the version of the block of data in the shared cache with non-blocking serialization allowing access to a changed version in the cache while castout is being performed. Castout classes are provided to facilitate efficient movement from the shared cache to DASD.

Abstract: Disk check bits refer to bit patterns stored in particular bytes of a page which are used to detect errors in writing the page to storage. Every time a page is obtained from storage, changed from the version retained in storage, and written back to storage, the check bit pattern on the changed page is altered to be different from the bit pattern on the storage page. This is because the changed page overwrites the stored page. The invention provides a method for managing the check bits in a multi-DBMS system employing a high-speed shared electronic store as a store-in cache for all pages obtained from disk storage. When a page is first obtained from disk storage by a DBMS and changed, check bit information for the page is maintained in a directory of the storing cache which indicates what the patterns are for the version of the page in the disk storage. All pages which are modified are stored in the store-in cache and are only returned to disk storage from the cache.

Abstract: A method and means for achieving files of modifiable pages in a log based phased commit transaction management system (TMS) in which those pages which have been modified since the last full or incremental backup donot require during the copy operation any modifications to the page itself but merely to a common status page. This is accomplished by management of a pair of global log sequence numbers. Comparison between a first number (ICBU.sub.-- LSN) and each data page LSN as the page is modified permits the common status page to be updated to correctly reflect the changed status. Subsequent modifications to the same page donot require amendment of the status page. The status page indicia are reset as part of the backup procedure and for ascertaining the page copy set for incremental copying. The ICBU LSN assumes one of two values as a function of the copy operation and another value for processing page modifications after the copy operation. A second number (ICRF.sub.

Abstract: A computer-implemented method for minimizing the amount of time to access current data in a database which may be stored wholly in a DASD-oriented external storage subsystem or partly in DASD and partly in a stored high-speed electronic store while maintaining coherency of the data with respect to multiple user systems.

Abstract: A fast technique for transferring units of data between transaction systems in a shared disk environment. The owning system, having updated the page, generates a version number for the page which is stored with a lock possessed by the owning system. When a requesting system seeks a record on the page, its request for a lock illicit an indication that a more recent version of the page is required in the local memory. The buffer management component of a DBMS, with assistance from the lock management, triggers a memory to memory transfer of the page from the owning DBMS to the requesting DBMS using a low overhead communication protocol. The transfer of page is without disk I/O or the log I/O for the updates made to the page.