Abstract: Techniques for improving the efficiency of matrix multiplication (matmul) operations are disclosed. According to one particular embodiment, an AI inference/training engine may be implemented with at least one controller and a plurality of workers. The controller(s), which may be merged with one or more of the workers, execute instructions for AI calculations which include matmul operations involving a first matrix; and the workers are collectively preloaded with the first matrix. When the controller encounters an instruction for a matmul operation, it may identify a second matrix to be multiplied with the first matrix and share the second matrix with the workers. Each worker then multiplies at least a portion of the second matrix with a corresponding preloaded portion of the first matrix to generate intermediate results and send them back to the controller(s) to generate a final product of the matmul operation.

Abstract: Systems, methods, and computer-readable media for coordinating processing of data by multiple networked computing resources include monitoring data associated with a plurality of networked computing resources, and coordinating the routing of data processing segments to the networked computing resources.

Abstract: Embodiments of an overlay network with innovative virtual network switches and related network interface controllers are disclosed. According to one embodiment, the overlay network may comprise at least one virtual network switch (VNS), wherein each VNS is installed within a corresponding first processing endpoint which is logically above a network of virtual machines. And, the VNS may be configured to intercept data packets transmitted on a network layer logically below the network of virtual machines. The VNS may comprise: (a) a manager element configured to connect to at least one virtual network interface controller (VNIC), each VNIC being installed within a corresponding second processing endpoint which is also logically above the network of virtual machines; (b) a replicator node configured to replicate and route the data packets; and (c) a switch controller configured to control the first replicator node.

Abstract: Embodiments of an overlay network with innovative virtual network switches and related network interface controllers are disclosed. According to one embodiment, the overlay network may comprise at least one virtual network switch (VNS), wherein each VNS is installed within a corresponding first processing endpoint which is logically above a virtualization layer of a virtual network. And, the VNS may be configured to intercept data packets transmitted on a network layer logically below the virtualization layer of the virtual network. The VNS may comprise: (a) a manager element configured to connect to at least one virtual network interface controller (VNIC), each VNIC being installed within a corresponding second processing endpoint of the virtual network, the second processing endpoint being separate from the first processing endpoint; (b) a replicator node configured to replicate and route the data packets; and (c) a switch controller configured to control the first replicator node.

Abstract: In a processing system, an identifier for a current version of code for an application is published in a message to a shared event stream. Any instances of the application within the processing system may update to the current version before processing other messages having sequence numbers after the message containing the identifier. In this manner, multiple instances of the application may be periodically updated to maintain global consistency of the application and the shared event stream.

Abstract: Systems, methods, and computer-readable media for coordinating processing of data by multiple networked computing resources include monitoring data associated with a plurality of networked computing resources, and coordinating the routing of data processing segments to the networked computing resources.

Abstract: Embodiments of the present invention provide a novel system and method for TCP-to-multicast (T2M) communications. The T2M techniques may allow a client to make a single TCP connection that then fans out into communications with multiple back-end resources. Such one-to-many communications may be invisible to the client but can achieve many practical benefits.

Abstract: Communication techniques are disclosed for a distributed computing system. The technique may be applied to an inline clearing and settlement messaging protocol whereby a matching engine may issue a transaction request (or settlement request) upon matching a proposed trade, identifying the parties and assets for the trade. A message gateway may validate and transmit the transaction request to a sequencer which sequences the transaction request into a time-accurate event stream so that transaction requests are distributed to relevant parties in chronological order. Each party may respond to the transaction request by simply checking its account to confirm availability of the relevant asset for the proposed trade and issuing a clearance response. The clearance responses form the basis for a transaction response that the message gateway sends to the matching engine to indicate success or failure of the inline clearing and settlement.

Abstract: Systems 100, 1000, methods, and machine-interpretable programming or other instruction products for the management of data transmission by multiple networked computing resources 106, 1106. In particular, the disclosure relates to the synchronization of related requests for transmitting data using distributed network resources.

Abstract: Systems, methods, and computer-readable media for coordinating processing of data by multiple networked computing resources include monitoring data associated with a plurality of networked computing resources, and coordinating the routing of data processing segments to the networked computing resources.

Abstract: Systems 100, 1000, methods, and machine-interpretable programming or other instruction products for the management of data processing by multiple networked computing resources 106, 1106. In particular, the disclosure relates to the synchronization of related requests for processing of data using distributed network resources.

Abstract: Systems 100, 1000, methods, and machine-interpretable programming or other instruction products for the management of data transmission by multiple networked computing resources 106, 1106. In particular, the disclosure relates to the synchronization of related requests for transmitting data using distributed network resources.

Abstract: Systems, methods, and computer-readable media for coordinating processing of data by multiple networked computing resources include monitoring data associated with a plurality of networked computing resources, and coordinating the routing of data processing segments to the networked computing resources.

Abstract: Systems 100, 1000, methods, and machine-interpretable programming or other instruction products for the management of data processing by multiple networked computing resources 106, 1106. In particular, the disclosure relates to the synchronization of related requests for processing of data using distributed network resources.

Abstract: Communication techniques are disclosed for a distributed computing system. The technique may be applied to an inline clearing and settlement messaging protocol whereby a matching engine may issue a transaction request (or settlement request) upon matching a proposed trade, identifying the parties and assets for the trade. A message gateway may validate and transmit the transaction request to a sequencer which sequences the transaction request into a time-accurate event stream so that transaction requests are distributed to relevant parties in chronological order. Each party may respond to the transaction request by simply checking its account to confirm availability of the relevant asset for the proposed trade and issuing a clearance response. The clearance responses form the basis for a transaction response that the message gateway sends to the matching engine to indicate success or failure of the inline clearing and settlement.

Abstract: Embodiments of the transmission latency leveling apparatuses, methods and systems provide an electronic bidding order management infrastructure, such as a “point-of-presence,” which receives and routes electronic trading orders from different trading entities at a server via a transmission medium to create a certain amount of transmission latency before the trading orders could arrive at and be executed at electronic exchanges to reduce latency arbitrage and/or order book arbitrage that may be experienced by high frequency trading participants. A similar transmission latency may be applied to the egress transmission of market data updates issued by an electronic exchange. Other techniques for facilitating electronic trading are also disclosed.

Abstract: A method and system operate to secure and efficiently manage data. The method includes performing steps such as generating independent keys corresponding to multiple portions of segmented data and utilizing the independent keys to encrypt the multiple portions of segmented data. The method additionally includes generating a master key, encrypting the independent keys with the master key, and storing each portion of the segmented data adjacent to the corresponding independent key in a data and key storage device. The method additionally includes segmenting the master key, thereby creating multiple master key segments and storing the multiple master key segments in disparate locations separate from the data.

Abstract: In a message processing system, an application connected to an event stream publishes a schema for the structure of data payloads contained in messages from the application. Other readers and writers within the system can receive the schema and apply the schema to subsequent inbound and/or outbound messages as appropriate. The application may from time to time dynamically update the schema and publish a revised schema for use by the other applications connected to the event stream for subsequent messages.

Abstract: Systems 100, 1000, methods, and machine-interpretable programming or other instruction products for the management of data transmission by multiple networked computing resources 106, 1106. In particular, the disclosure relates to the synchronization of related requests for transmitting data using distributed network resources.

Abstract: In order to protect a trading party from predatory trading strategies employed by some market participants, especially during certain periods when quotes for a particular security are experiencing rapid changes or transitions, embodiments of the present invention facilitate and support a new type of trading orders whose booking and execution behaviors are dynamically varied in response to environmental market conditions. Pursuant to predefined rules for the new type of trading orders, the orders may be allowed to trade at more aggressive price levels if the market is relatively stable, and the orders can only trade at less aggressive price levels when the market is unstable.