Abstract: Retrieving data records from a database is provided. A query is received by a database access API requesting a number of data records stored in the database. A parallel batch processor is created for data transmittal, and the parallel batch processor is returned to a client program. A next data record responsive to the query is requested, and the next data record is removed from a list of records. The next data record is then provided from the parallel batch processor to the client program.

Abstract: Performing a distributed database transaction using parallel writes to a distributed append-only database system is provided. A central database and a plurality of distributed databases, also known as “shards”, may be used. A request made to implement a distributed transaction, requiring updates to one or more shards, results in a monotonically increasing identification (ID) number being assigned to a change set. The request and change set may be registered at the central database. Once the change set is completely written to all of the appropriate shards, the change set is marked as completed in the central database. After write completion, a change set ID boundary at the central database is advanced to indicate the current fully changed status of the distributed database.

Abstract: Improving the efficiency of distributed database systems in providing geographically related information is provided by generating a data object identifier (ID) in association with geographical data. A geographical data object is received for storage in the distributed database system. A grid ID is generated based on spatial information contained in the geographical data object, a shardlet ID is generated indicating a shardlet location in a given shard on which the geographical data object is stored, and a sequence ID is generated indicating data placement within the shardlet location. The data object ID is assigned to the geographical data object, the data object ID comprising the grid ID, the shardlet ID, and the sequence ID.

Abstract: Retrieving data records from a database is provided. A query is received by a database access API requesting a number of data records stored in the database. A parallel batch processor is created for data transmittal, and the parallel batch processor is returned to a client program. A next data record responsive to the query is requested, and the next data record is removed from a list of records. The next data record is then provided from the parallel batch processor to the client program.

Abstract: Improving the efficiency of distributed database systems in providing geographically related information is provided by generating a data object identifier (ID) in association with geographical data. A geographical data object is received for storage in the distributed database system. A grid ID is generated based on spatial information contained in the geographical data object, a shardlet ID is generated indicating a shardlet location in a given shard on which the geographical data object is stored, and a sequence ID is generated indicating data placement within the shardlet location. The data object ID is assigned to the geographical data object, the data object ID comprising the grid ID, the shardlet ID, and the sequence ID.

Abstract: Performing a distributed database transaction using parallel writes to a distributed append-only database system is provided. A central database and a plurality of distributed databases, also known as “shards”, may be used. A request made to implement a distributed transaction, requiring updates to one or more shards, results in a monotonically increasing identification (ID) number being assigned to a change set. The request and change set may be registered at the central database. Once the change set is completely written to all of the appropriate shards, the change set is marked as completed in the central database. After write completion, a change set ID boundary at the central database is advanced to indicate the current fully changed status of the distributed database.