Abstract: An example operation may include one or more of receiving a plurality of transactions by an agent node, selecting, by the agent node, transactions from the plurality of the transactions that are the most likely to be conflicting based on common factors, combining, by the agent node, the selected transactions into a batch, and reordering the selected transactions within the batch to increase a success rate.

Abstract: An apparatus in one embodiment comprises at least one processing device having a processor coupled to a memory. The processing device is configured to distribute in-memory computations across a plurality of data processing clusters associated with respective data zones, and to combine local processing results of the distributed in-memory computations from the data processing clusters. The distributed in-memory computations utilize local data structures of respective ones of the data processing clusters. A given one of the local data structures in one of the data processing clusters receives local data of the corresponding data zone and is utilized to generate the local processing results of that data processing cluster that are combined with local processing results of other ones of the data processing clusters. The local data structures are configured to support batch mode extensions such as Spark SQL, Spark MLlib or Spark GraphX for performance of the distributed in-memory computations.

Abstract: Methods and systems to compute cost efficiency of virtual machines (“VMs”) running in a private cloud are described. Methods and systems compute a cost efficiency value for each VM in the private cloud based on cost of the VM in the private cloud, cost of similar VMs in the private cloud, price of similar VM running in the public cloud, and the cost of similar VMs running in one or more private clouds in the same geographical area. When the cost efficiency of a VM is greater than a cost efficiency threshold, the methods generate an alert and recommendations for moving the VM to a lower cost public cloud.

Abstract: A method in a storage device includes receiving from a host storage commands for execution in a non-volatile memory of the storage device. At least a subset of the storage commands are to be executed in accordance with an order-of-arrival in which the storage commands in the subset are received. The received storage commands are executed in the non-volatile memory in accordance with internal scheduling criteria of the storage device, which permit deviations from the order-of-arrival, but such that execution of the storage commands in the subset reflects the order-of-arrival to the host.

Abstract: Client-side partition-aware batch insert operations are presented. For example, a server generates partition metadata, which is provided to a client. The client uses the partition metadata to determine the database nodes to which to send batch insert requests. For example, the client divides batch insert data, such as records for a partitioned table, among multiple database nodes having partitions of the table. The client issues batch insert requests to the respective database nodes for execution. When executed by the database nodes, batch insert operations can be performed in parallel.

Abstract: Generally described, the present invention is directed to a network operating system that provides more effective ways of leveraging the connectivity of computer networks. In one embodiment, an XML virtual machine is implemented that accepts high-level application code written in an XML programming language as input. Functionality is provided to interpret or translate the application code written in an XML programming language into code that is suitable for execution across computer platforms. Moreover, the XML virtual machine supports the Model View Controller (MVC) design paradigm that facilitates true data abstraction from applications to a common data model. Multi-instance applications, with each instance potentially supporting multiple views, may be created and executed.

Abstract: A system for processing a batch job comprises a processor and a memory. The processor is configured to receive a batch job comprising a sequential or parallel flow of operations, wherein each operation has a defined input type and a defined output type. The processor is further configured to verify that the batch job can run successfully, wherein verifying includes checking that a first operation output defined type is compatible with a second operation input defined type when a first operation output is connected to a second operation input, and wherein verifying includes checking that a parameter used by a calculation in an operation is input to the operation. The memory is coupled to the processor and configured to provide the processor with instructions.

Abstract: Batch processing machines, systems and methods are provided. The method comprises copying target data from a target location to a first data storage medium, wherein the target data stored in the first data storage medium is utilized by a batch process; executing the batch process; checkpointing state information for the batch process at one or more time intervals while the batch process is executing; determining whether a data record in the target data stored in the target location was updated while the batch process was executing; and reinstating the batch process from a point in time prior to an earliest point in the batch process when a representation of an updated data record in the target data in the target location was accessed by the batch process.

Abstract: A relational database load operation is disclosed for loading data into a multi-table tablespace, such as a segmented tablespace in a DB2® environment. In one aspect, the load operation allows one or more tables to be replaced in a single pass of the tablespace without modifying, loading or replacing other tables in the tablespace. Thus, the disclosed operation can replace one or more tables in a single pass of the tablespace without the need to unload and reload tables not targeted for replacement. In another aspect, the load operation allows for a combined operation where one or more tables are replaced and one or more tables are resumed in a single pass of the multi-table tablespace without modifying other tables already residing in the tablespace.

Abstract: Example methods, apparatus and articles to test batch configurations are disclosed. A disclosed example method includes identifying, using a processor, an execution path through a batch configuration of a process control system, generating a test plan for the execution path, stimulating the process control system to execute the test plan, and recording a result of the test plan.

Abstract: A computer implemented method for cloud bursting applied to a database includes employing a database live migration using a database hot backup capability to support database cloud bursting without client service interruption in multitenant databases, ascertaining a critical time to start/redo the database cloud bursting to a public cloud so as to meet a service level agreement SLA while leveraging a private cloud for the database to a maximum level, and determining tenants of the database to burst into the public cloud to responsive to costs and benefits.

Abstract: An information retrieval system having: a client adapted for accessing a plurality of file sets stored on one of a plurality of file servers; a plurality of file servers configured to operate with a federated file system namespace; and a memory for storing re-direction information accessible by the client for identifying a request issued by the client for a file set at a first location in the namespace where the file set is located at a second, different location on one of the file servers and wherein the client in examining the re-direction information in the memory, re-directs the request to the second location in accordance with the re-direction information.

Abstract: Disclosed are a method and a system for transmitting a file folder from the sending end to the receiving end. The system uses a file folder transmission unit at the sending end side to generate a directory structure file of the file folder. The directory structure file may have properties such as the size of the file folder, paths and path lengths of the files in the file folder. The sending end then sends the directory structure file to the receiving end through the file folder transmission unit to allow the system to determine which files in the file folder need to be transmitted. The needed files in the file folder are then transmitted to the receiving end according to the determination. The sending end and the receiving end may communicate using an instant messaging tool. The disclosed method and system allow a faster and more convenient file folder network transmission.

Abstract: Embodiments are directed to simultaneously backing up data from multiple locations to a single location and to restoring data from a single location to multiple locations simultaneously. In an embodiment, a computer system receives a backup command from a user which indicates that various specified portions of data are to be backed up. The data portions are stored in multiple different locations in a parallel database. The computer system generates multiple backup commands specific for each location in which the data is stored. The backup commands initiate a parallel backup from the various locations to a single location in a data store. The computer system also executes the generated backup commands in parallel, so that the data from each of the different locations is backed up in the data store.

Abstract: A document migration system that controls release, from a source enterprise content management system, of batches of documents and metadata and loading, to a target enterprise content management system, of batches of documents and metadata that have been released from the source enterprise content management system. The document migration system maps source metadata attributes from the released metadata to target metadata attributes and stores migration records that describe migration operations from release from the source enterprise content management system through loading to the target enterprise content management system.

Abstract: A system and method for ensuring large and frequent updates to a data warehouse. The process leverages a set of temporary staging tables to track the updates. A set of intermediate steps are performed to accomplish bulk deletions of the outdated changed records, and perform modifications to the map tables for models such as snowflake. Finally, bulk load operations load the updates and insert them into the final dimension tables. The process ensures performance comparable to insertion-only schemes with at most only slight performance degradation. Furthermore, a modified process is applied on the newfact data warehouse dimension model. The process can be readily adapted to handle star schema and other hierarchical data warehouse models.

Abstract: A technique for restoring file systems by applying full and incremental backups together while streaming them from multiple devices provides a faster system restore from a full backup where incremental backups must also be applied. A first storage device streams the full backup while at least one second storage device streams at least one incremental backup. As files are detected in the incremental backup, they are written instead of the corresponding file in the full backup. Incremental backups can be pre-merged to reduce their number to one less than a number of storage devices available to stream the backups, so that the full backup can be streamed along with the pre-merged incremental backup(s) to restore the file system.

Abstract: A technique for restoring file systems by applying full and incremental backups together while streaming them from multiple devices provides a faster system restore from a full backup where incremental backups must also be applied. A first storage device streams the full backup while at least one second storage device streams at least one incremental backup. As files are detected in the incremental backup, they are written instead of the corresponding file in the full backup. Incremental backups can be pre-merged to reduce their number to one less than a number of storage devices available to stream the backups, so that the full backup can be streamed along with the pre-merged incremental backup(s) to restore the file system.

Abstract: A file system boundary emulation system emulates a virtual boundary of a filesystem within an existing file system for data management at a fileset granularity, within the framework of a wide area filesystem federation. The system dynamically assigns a fileset ID to the file that belongs to that fileset. The system comprises a fileset defined by the virtual boundary of the file. The virtual boundary is less than and contained within the file system. The fileset identifies the file via the file ID and the fileset ID. The system maps the file ID to the fileset ID. The filesets are dynamically created and removed based on administrative instructions. Filesets are used for fine grained data management and namespace control in a filesystem federation.

Abstract: A method for batch implementation of settings in a renal replacement therapy device including: displaying on a user interface control settings which may be manually selected by an operator; selecting an independent control setting of the plurality of control settings; adjusting the independent control setting to an independent control setting level selected by an operator; temporarily storing the adjusted independent control setting level; automatically adjusting a dependent control setting level based upon the independent control level; displaying the adjusted independent control setting level and the adjusted dependent control setting, and implementing both the adjusted independent control setting level and the adjusted dependent control setting to control the device, by actuating a batch setting acceptance operation.

Abstract: A computer implemented method for providing enhanced customer support is provided. The method comprises a replication server selecting a plurality of first entries in a source lightweight directory access protocol (LDAP) data store based on at least one attribute of the selected entries matching a predefined criteria, wherein a structure of the first entries is defined by a first schema. The method also comprises the replication server copying a plurality of attributes of each of the selected entries into a target lightweight directory access protocol data store, wherein the target lightweight directory access protocol data store contains a plurality of second entries, wherein a structure of the second entries is defined by a second schema, wherein the first schema is different from the second schema, and wherein the plurality of attributes copied do not include all of the attributes defined by the first schema.

Abstract: The input and batch processing of data for insertion in a database. In one aspect of the invention, processing input data includes receiving data for insertion into a database, the data including data fields holding data entries. At least one of the data fields is determined to be a standard field having a standard data entry, and at least one different data field is determined to have been designated a batch mode field, where each batch mode field has a plurality of associated batch mode data entries. A data record is created for each batch mode data entry of the batch mode field, where each data record includes a different batch mode data entry, and each data record includes a copy of the standard data entry.

Abstract: A server auditing process that stores only a single up-to-date data record along with the differences relative to previous changes in the record that allow the user to move “backward in time” to recreate previous values. The auditing feature introduces a baseline database table and a difference database table for each existing database table. The baseline table stores the most recent auditing data and the differences table complements the baseline table by storing pairs in the form of attribute name and previous value. By applying difference rows to baseline data, the user is able to recreate the data as it existed at any given timestamp and at a minimal storage cost. The architecture minimizes the impact of auditing on system performance by employing an asynchronous priority queue so that task processing is deferred until the system has adequate resources and other work is not affected.

Abstract: Consistency is managed among data operations by coalescing commit operations, adjusting a commit rate to optimize latency, and converging to fairness across servers. Write operations representing a change to data stored by one or more of a plurality of computing devices are received in succession by, for example, a cloud computing service. A state of a plurality of tracking objects is adjusted to indicate whether the change in data has been provided to the computing devices and whether the change in data has been acknowledged by the computing devices. Changes to the same data are coalesced such that only the most recent change is provided to the computing devices for storage. In some embodiments, the commit rate is adjustable such that the commit rate decreases quickly but increases slowly based on measured latencies.

Abstract: A method of efficiently generating and sending emails including creating an email template, setting up a campaign query, and distributing the email template and a set of information associated with the campaign query to a plurality of server groups. The method also includes running the campaign query on each of the plurality of server groups and obtaining a plurality of matching users; dividing the plurality of matching users into one or more batches; merging the email template with a set of information corresponding to each of the plurality of matching users from a first batch for each of the plurality of server groups, and sending the first batch of the merged emails directly from each of the plurality of server groups without saving copies of the merged emails.

Abstract: A replicated set of data is processed by receiving at a target, from one of a plurality of replication processing threads, a received batch of one or more non-synchronization tasks. It is determined that the received batch comprises a next batch to be performed at the target and the non-synchronization tasks included in the batch are performed in a task order.

Abstract: The present invention is embodied in an online-like transaction processing method and system for processing account information contained in batch process files, the method including: reading at least one batch file containing a plurality of records, each of the plurality of records being related to an associated one of a plurality of accounts; identifying which of the plurality of records relate to same ones of the plurality of accounts; identifying one of the accounts; and, processing all of the records identified as relating to the one of the accounts together and independent of processing any of the records relating to any other of the plurality of accounts.

Abstract: System, method, computer program for fast bulk loading data into database while bypassing exit routines. Method for bulk loading of data into database tables with exit routines defined for operations on such tables, method characterized by existence of exit routines is by-passed by performing data preprocessing in batch mode before loading; and loading preprocessed data into database by performing operations on lower level of tablespace and index spaces where database tables reside and not on database tables themselves.

Abstract: Embodiments of the invention broadly contemplate systems, methods, apparatuses and program storage devices providing a mechanism in which a file system and copy command (or file transfer command) allows the start of a copy operation when a file is being copied to and allow the system to continue to read the file as and when it gets updated (appended with additional data), thus permitting automated simultaneous file transfer and copy operations.

Abstract: Systems and methods for managing the processing of the same pieces of information, e.g., messages, by multiple consumers, in a prescribed order, without causing the degradation of any consumer's performance because of other consumers' access to the same information. A single information queue contains pieces of information to be accessed by multiple consumers. Each piece of information is stored in the information queue along with an information identifier that uniquely identifies the piece of information. A separate table is used to keep track of and identify the pieces of information in the information queue that have been accessed by respective consumers. This separate table is decoupled from the information queue, and, thus, each consumer's access of a piece of queued information does not impact any other consumer's access of the same piece of information.

Abstract: Data is replicated from a source to a target. For each of a plurality of replication processing threads (one thread at a time) a corresponding batch of one or more non-synchronization tasks is formed. Each batch of one or more non-synchronization tasks includes a next consecutive set of non-synchronization tasks drawn from a source of non-synchronization tasks that is common to the replication processing threads included in the plurality of replication processing threads. A replication processing thread that has associated with it an outstanding batch of one or more non-synchronization tasks that the thread has not finished communicates via an associated connection to the target as needed to perform such unfinished tasks included in the outstanding batch without regard to whether other threads included in the plurality of threads are communicating with the target via one or more other connections to the target.

Abstract: A recovery manager detects that a distributed transaction is unresolved for a first participant of said distributed transaction. The recovery manager identifies that the distributed transaction is unresolved for a second participant of said distributed transaction. The recovery manager generates a list of participants for which the distributed transaction is unresolved, the list including an entry for the first participant and an additional entry for the second participant. The recovery manager determines a result of the distributed transaction based on information received from a remote coordinator of said distributed transaction. The recovery manager notifies each participant identified in the list of the result.

Abstract: There is provided a storage system providing a storage volume and being coupled via a network to a secondary storage system for storing a backup of data stored in the storage volume, the storage system copies data stored in the storage volume to the secondary storage system, upon receiving an instruction to create a backup; records the size of the data copied; predict the size of data to be copied in the future based on the recorded size of the copied data; records a usable bandwidth of the network at a time when the data is copied to the secondary storage system; predicts a usable bandwidth in the future based on the recorded usable bandwidth of the network; and predicts a time period required for copying data to the secondary storage system based on the predicted size of data to be copied and the predicted usable bandwidth of the network.

Abstract: Embodiments of the present invention provide methods and systems for extracting data from multiple sources and loading data into a central repository. One embodiment of a method of the present invention includes extracting a first set of data from one or more data sources, correlating the first set of data with a second set of data contained in a central repository, comparing the first set of data with the second set of data, determining a set of operations to be applied to the second set of data and applying the set of operations to the second set of data.

Abstract: Methods and systems consistent with this invention manage a database of delivery destination information. Such methods and systems identify an item to be delivered to a destination; determine a batch of items for delivery having the item to be delivered to the destination; determine when the batch of items has been delivered: and update the database to indicate a delivery of the item destined to the destination after determining when the batch of items has been delivered.

Abstract: A method of organizing a transmission of repository data includes receiving, in a computer system, a request to transmit data from a data repository to a data recipient, the data to be transmitted by executing batch jobs that each identify a data amount to be transmitted to the data recipient. Control parameters are individually assigned to each of the batch jobs. Upon detecting during transmission that a performance parameter of the computer system does not meet a predefined standard, the data amount identified by at least one of the batch jobs is automatically changed in accordance with the control parameter assigned to the at least one of the batch jobs. An optimizer may determine the control parameters by solving a constraint optimization problem. The optimizer may take into account system characteristics such as priorities, transmission constraints or the volume of the data to be transmitted.

Abstract: A method of organizing a transmission of repository data includes receiving, in a computer system, a request to transmit data from a data repository to a data recipient. In response to the request, batch jobs for transmitting the data are performed. Each of the batch jobs identifies a data amount that is to be transmitted to the data recipient. Upon detecting during transmission that a performance parameter of the computer system does not meet a predefined standard, the data amount that is identified by at least one of the batch jobs is automatically changed. Changing the data amount may include splitting the batch job into at least two batch jobs, or merging the batch job with another batch job. A predictive model may be created for determining a control parameter that can be assigned to the batch jobs. The control parameter may help the system assume an optimal organization state.

Abstract: Methods, apparatus and computer programs are provided for data replication, such as for replicating a database or updating a cache. Source database change transactions are captured and batched together for efficient data transfer. On receipt at a target replica system, the batch of transactions within a message is separated and separate apply transactions corresponding to the source transactions are performed in parallel. A ‘transaction processed’ table is updated to reflect apply processing for each apply transaction. This table provides a confirmation of the status of each transaction that can be used during recovery processing to prevent re-apply of an apply transaction. The table can also be used to determine when it is safe to delete an incoming message from persistent storage on the target system, and to facilitate one-phase commit processing.

Abstract: A method of efficiently generating and sending emails including creating an email template, setting up a campaign query, and distributing the email template and a set of information associated with the campaign query to a plurality of server groups. The method also includes running the campaign query on each of the plurality of server groups and obtaining a plurality of matching users; dividing the plurality of matching users into one or more batches; merging the email template with a set of information corresponding to each of the plurality of matching users from a first batch for each of the plurality of server groups, and sending the first batch of the merged emails directly from each of the plurality of server groups without saving copies of the merged emails.