Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for stream processing with contextual data affinity. One of the methods includes receiving an event at a computing node of a stream processing system that includes one or more computing nodes and data representing a topology of functional modules. At a particular functional module of the topology, an operation that requests access to context data related to the event is determined based on a data attribute of the event. The context data is partitioned among the one or more computing nodes. Context data related to the event is obtained from the computing node. The operation of the particular functional module is processed using the context data, and a modified event is generated. The modified event is provided to a subsequent functional module according to the topology of functional modules.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for stream processing with contextual data affinity. One of the methods includes receiving an event at a computing node of a stream processing system that includes one or more computing nodes and data representing a topology of functional modules. At a particular functional module of the topology, an operation that requests access to context data related to the event is determined based on a data attribute of the event. The context data is partitioned among the one or more computing nodes. Context data related to the event is obtained from the computing node. The operation of the particular functional module is processed using the context data, and a modified event is generated. The modified event is provided to a subsequent functional module according to the topology of functional modules.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for stream processing with contextual data affinity. One of the methods includes receiving an event at a computing node of a stream processing system that includes one or more computing nodes and data representing a topology of functional modules. At a particular functional module of the topology, an operation that requests access to context data related to the event is determined based on a data attribute of the event. The context data is partitioned among the one or more computing nodes. Context data related to the event is obtained from the computing node. The operation of the particular functional module is processed using the context data, and a modified event is generated. The modified event is provided to a subsequent functional module according to the topology of functional modules.

Abstract: Methods and apparatus provide for an event identity manager that defines a topology of resources. The topology of resources represents relationships amongst the resources in a data center and each of the resources comprises resource attributes described in a data model. The event manager acquires event data describing an event that occurred amongst the resources. In addition, the event data comprises a format that is incompatible with the data model. The event manager correlates the event data with the data model in order to determine a locus of the event data within the topology of resources, the locus of the event data being a resource where the event is most likely associated.

Abstract: In a system including a host, a primary storage subsystem coupled to the host, a cache coupled to the host and separate from the primary storage system, a secondary storage subsystem, and a data mover coupling the primary and secondary storage systems, data is temporarily cached for future storage in the primary storage subsystem so as to preserve timestamp information and maintain data consistency for asynchronously mirroring the data at a secondary subsystem.

Abstract: In a system including a host, a primary storage subsystem coupled to the host, a cache coupled to the host and separate from the primary storage system, a secondary storage subsystem, and a data mover coupling the primary and secondary storage systems, data is temporarily cached for future storage in the primary storage subsystem so as to preserve timestamp information and maintain data consistency for asynchronously mirroring the data at a secondary subsystem.

Abstract: A logical partition includes at least one dedicated logical processor and at least one shared logical processor. The dedicated processor is a different type of processor than the shared processor, and/or the dedicated processor executes a different dispatching procedure than the shared processor. The use of the shared processor automatically ramps up, as the arrival rate of requests forwarded to the logical partition increases. Furthermore, the use of, the shared processor automatically ramps down, as the arrival rate decreases.

Abstract: A lock structure, which includes many entries, is partitioned into segments. A number of the segments are cleaned up in parallel, such that cleanup processing of the entire lock structure is optimized. The lock structure is maintained within a coupling facility, which provides access to the lock structure by one or more processors coupled to the coupling facility. The cleaning up of the lock structure is performed by commands driven by the one or more processors and executed within the coupling facility.

Abstract: A database management system ensures consistency between primary and mirrored backup copies of a database, despite occurrence of a suspending condition interrupting the normal process of mirroring the primary database. One or more primary controllers are provided, each having a data storage unit with multiple primary data storage devices. Multiple secondary controllers each have multiple associated secondary data storage devices, each secondary controller being coupled to one primary controller. One or more primary databases reside on the primary devices, with a corresponding number of secondary databases residing on the secondary devices. Each secondary database mirrors a corresponding primary database. Either a host, attached to a primary controller, or one of the primary controllers itself, maintains a map cross-referencing each primary and secondary database with the primary and secondary devices containing portions thereof.

Abstract: A lock structure, which includes many entries, is partitioned into segments. A number of the segments are cleaned up in parallel, such that cleanup processing of the entire lock structure is optimized. The lock structure is maintained within a coupling facility, which provides access to the lock structure by one or more processors coupled to the coupling facility. The cleaning up of the lock structure is performed by commands driven by the one or more processors and executed within the coupling facility.

Abstract: A lock structure, which includes many entries, is partitioned into segments. A number of the segments are cleaned up in parallel, such that cleanup processing of the entire lock structure is optimized. The lock structure is maintained within a coupling facility, which provides access to the lock structure by one or more processors coupled to the coupling facility. The cleaning up of the lock structure is performed by commands driven by the one or more processors and executed within the coupling facility.

Abstract: A fault tolerant recoverable connection device and methods are disclosed that include a primary router in an active state to provide a connection between clients and servers in a network, and a backup router in a standby state. The states of the primary and backup routers are switched when the primary router fails, the backup router has a better reach-ability state than the primary router, or by an operator command. Each router has a synchronization manager which maintains synchronized tables between the active and standby routers; a monitoring manager which monitors and switch the state of the routers; a reach-ability manager which monitors, updates, and compares the reach-ability set and state of the routers; and a keep alive manager which monitors the routers to provide a status notification to the monitoring manager.

Abstract: Two or more user applications executing on one or more processors, each controlled by an operating system, share use of a list and subsidiary list structure within a Structured External Storage (SES) facility to which each processor is connected. One of the applications registers interest in particular state transitions affecting one or more subsidiary lists within the list structure, causing a process within the SES to notify the appropriate processor when a list operation causes the particular state transition, without interrupting processing on the processor. The application receives notice of the state transition by periodically polling a vector within the processor, or by receiving control when a test by the operating system of a summary indicator for the vector causes an application exit to be driven.

Abstract: A method and system for capturing and controlling access to information in a data processing system are provided. The data processing system includes one or more operating systems coupled to a coupling facility. When one or more operating systems lose communication with the coupling facility, a surviving operating system captures some or all of the information in the coupling facility, including that information associated with the failed operating system(s). In order to capture the information when a system fails or at any other time, the information in the coupling facility is serialized, thereby preventing all access to the information except for those commands capturing the information. While the information is serialized, requests for the information are queued and then re-driven once serialization is released. If an operating system loses communication with the coupling facility during the creation of a dump, another operating system will continue the dump.

Abstract: A method and system for capturing and controlling access to information in a data processing system are provided. The data processing system includes one or more operating systems coupled to a coupling facility. When one or more operating systems lose communication with the coupling facility, a surviving operating system captures some or all of the information in the coupling facility, including that information associated with the failed operating system(s). In order to capture the information when a system fails or at any other time, the information in the coupling facility is serialized, thereby preventing all access to the information except for those commands capturing the information. While the information is serialized, requests for the information are queued and then re-driven once serialization is released. If an operating system loses communication with the coupling facility during the creation of a dump, another operating system will continue the dump.

Abstract: A method and apparatus for optimizing a data structure of an external data storage facility shared by a plurality of data processing systems, the data structure being allocated by a first allocation command which includes first allocation parameters based on an amount of storage space in the external data storage facility assigned for creation of the data structure and a composition of the data structure, includes a device for determining values of the first allocation parameters, to thereby determine a first composition of the data structure, a device for determining an actual usage of the data structure, to thereby determine a second composition of the data structure, a device for comparing the first composition of the data structure with the second composition of the data structure, and a device for issuing, based on an output from the comparing device, a second allocation command having second allocation parameters, to the data structure for reallocation thereof.

Abstract: A dumping service facility for data processing systems, including single systems, multisystems and shared facilities. Information, such as control information, is captured and a storage dump is created. During the capturing process, the information is serialized such that mainline commands (i.e., commands other than dump commands) are not allowed to access the information thereby possibly destroying the information. The information is stored within the storage dump in such a manner that programs can understand the information. That is, the storage dump contains a logical representation of the information being captured. Subsequent to capturing the information, serialization is released and mainline commands can once again access the information.

Abstract: A Structured External Storage (SES) processor is linked by a communication means to one or more general purpose processors. Two or more applications executing on the one or more general purpose processors communicate function request messages to a message processor within the SES to effect serialized sharing of data within the SES. Within the message processor, a predicate function means executes unconditionally on receipt of one of the function request messages, and a data function means executes conditionally and atomically with respect to the predicate function means following a "successful" condition produced by the predicate function means.

Abstract: In a coupled data processing system having multiple users, either in a single system or in a multi-system environment, a coupling facility storage structure is used to provide a log management facility. The log management facility provides for a real time physical log merge of the data written into the log stream without interprocessor communication required to process the records in logical sequence. The log management facility supports concurrent write, delete, browse, and asynchronous off-load to dasd processes across multi-users and multi-systems. The log management facility maintains the log records, independent of the log media, in time sequence. A logical block id is assigned to each log record written so that it can be directly accessed at a later time.

Abstract: A dumping service facility for data processing systems, including single systems, multisystems and shared facilities. Information, such as control information, is captured and a storage dump is created. During the capturing process, the information is serialized such that mainline commands (i.e., commands other than dump commands) are not allowed to access the information thereby possibly destroying the information. The information is stored within the storage dump in such a manner that programs can understand the information. That is, the storage dump contains a logical representation of the information being captured. Subsequent to capturing the information, serialization is released and mainline commands can once again access the information.