Abstract: A monitoring system is configured for de-duplicating data for storing in a database. The monitoring system is configured for receiving a message including a sequence of fields and corresponding field values; generating an entry in a first mapping table that associates each unique field and each unique field value of the message to a corresponding index value that is unique; generating a first vector including index values; ordering the index values of the vector, the ordered index values indicating a structure of the message; generating an entry in a second mapping table that associates the structure of the message with a structure index value; generating a second vector including the structure index value and an ordered set of index values representing the field values; and storing, in a database, the second vector.

Abstract: A ring replication system receives and redundantly stores electronic data for access by users. Two or more storage devices are configured in a ring and circulate received data to each other. At least one such device receives incoming data records from an external source. One storage device is designated as the ordering device for assigning a sequence order to each data record, and the assigned sequence order is circulated around the ring. After confirming that the assigned sequence order has been indexed within each storage device on the ring, data records may then be accessed by users. One or more access portals may be coupled to one or more storage devices in the replication ring for providing users with access to stored data records. Data records are accessed in accordance with the assigned sequence order. A related method for redundant storage of data records is also disclosed.

Abstract: A monitoring system is configured for de-duplicating data for storing in a database. The monitoring system is configured for receiving a message including a sequence of fields and corresponding field values; generating an entry in a first mapping table that associates each unique field and each unique field value of the message to a corresponding index value that is unique; generating a first vector including index values; ordering the index values of the vector, the ordered index values indicating a structure of the message; generating an entry in a second mapping table that associates the structure of the message with a structure index value; generating a second vector including the structure index value and an ordered set of index values representing the field values; and storing, in a database, the second vector.

Abstract: A ring replication system receives and redundantly stores electronic data for access by users. Two or more storage devices are configured in a ring and circulate received data to each other. At least one such device receives incoming data records from an external source. One storage device is designated as the ordering device for assigning a sequence order to each data record, and the assigned sequence order is circulated around the ring. After confirming that the assigned sequence order has been indexed within each storage device on the ring, data records may then be accessed by users. One or more access portals may be coupled to one or more storage devices in the replication ring for providing users with access to stored data records. Data records are accessed in accordance with the assigned sequence order. A related method for redundant storage of data records is also disclosed.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for assigning channels in a messaging system. An example method includes: providing a plurality of channels, wherein each channel includes an ordered plurality of messages; assigning each channel to a channel bucket to form a plurality of channel buckets, wherein each channel bucket includes at least two channels from the plurality of channels; and assigning each channel bucket to a node selected from a plurality of nodes, wherein the node includes one or more buffers for storing messages according to the order from the channel buckets of the node.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for managing or tracking assets in a geographical area. One method includes providing a plurality of travel routes to a plurality of assets located in a geographical area, wherein each of the plurality of travel routes indicates a route along which a corresponding asset of the plurality of assets is to travel, and wherein the plurality of travel routes are based on an analysis of travel history of one or more of the plurality of assets. The method also includes receiving a request from a client device to travel to a destination in the geographical area. The method further includes determining, by one or more computer processors, one or more travel routes of the plurality of travel routes to the destination, wherein the one or more travel routes use different assets to travel to the destination. The method also includes providing the one or more travel routes to the client device.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for managing channels in an open data ecosystem. A method includes receiving user input indicating channel configuration information from a user of an open data ecosystem via at least one graphical user interface, wherein the open data ecosystem comprises a plurality of public channels and a plurality of private channels. The method further includes configuring, by a computer processing device, one or more channels of the plurality of public channels or the plurality of private channels based on the channel configuration information received from the user via the at least one graphical user interface.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for implementing functionality within a messaging system. An example method includes maintaining a plurality of channels, wherein each channel is associated with a respective key, and wherein at least one key is associated with a respective time-to-live and becomes unavailable when the respective time-to-live expires, and wherein each channel comprises a plurality of messages, and wherein each message comprises a value associated with a respective key to form a plurality of key-value pairs. The method also includes receiving a function comprising (i) a key for identifying a channel of the plurality of channels and (ii) processing instructions to be applied to one or more values associated with the key. The method also includes applying, by one or more computer processors, the processing instructions based at least in part on the key.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for managing or tracking assets in a geographical area. One method includes receiving one or more first messages from a plurality of assets on one or more first channels of a plurality of channels. The one or more first messages may indicate live geographical locations of the plurality of assets located in a geographical area. The method also includes displaying, via a graphical user interface, the live geographical locations of the plurality of assets on a map of the geographical area. The method further includes receiving on a second channel a message indicating a request from a first user device to travel to a destination. The method further includes determining one or more travel routes to the destination. The one or more travel routes may use different assets to transport the first user device to the destination.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for managing channels in an open data ecosystem. A method includes providing one or more graphical user interfaces to a first user of an open data ecosystem. The open data ecosystem includes a plurality of public channels and a plurality of private channels. The users of the open data ecosystem are able to receive messages on each of the plurality of public channels. The method also includes receiving first user input from the first user via the one or more graphical user interfaces. The method further includes configuring one or more channels of the plurality of public channels or the plurality of private channels based on the first user input received from the first user via the one or more graphical user interfaces.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for implementing key-value store functionality within a real-time messaging system. An example method includes: providing a plurality of channels, wherein each channel comprises an ordered plurality of messages, wherein each channel represents a unique key, and wherein each message comprises one or more key-value pairs; receiving a function comprising a key for identifying one of the plurality of channels and processing instructions to be applied to a subset of the key-value pairs; and applying the processing instructions based at least in part on the unique key.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing a video to subscribers of a messaging system. A method includes obtaining a live video stream generated by a video source. The method also includes publishing one or more messages including one or more frames of the live video stream to a first channel of a plurality of channels. The video source is associated with the first channel.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for selective distribution of messages from a scalable, real-time messaging system. An example method includes: receiving query instructions from receiving query instructions from a subscriber client subscribed to a channel of a plurality of channels; applying, by one or more computer processors, the query instructions to a plurality of messages for the channel as the plurality of messages are received to generate filtered messages, wherein the filtered messages comprise messages of the plurality of messages that satisfy the query instructions; and transmitting the filtered messages to the subscriber client.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing a video to subscribers of a messaging system. A method includes obtaining a live video stream generated by a video source. The method also includes publishing one or more messages including one or more frames of the live video stream to a first channel of a plurality of channels. The video source is associated with the first channel.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for selective distribution of messages from a scalable, real-time messaging system. An example method includes: receiving query instructions from a subscriber client, wherein the subscriber client is subscribed to a channel of a plurality of channels; receiving a plurality of messages from a plurality of publisher clients, wherein each message is associated with a particular one of the plurality of channels; applying the query instructions to the plurality of messages for the channel as the messages are received; and sending the messages resulting from the application of the query instructions to the subscriber client, wherein the messages received by the subscriber client from the channel are limited to those that satisfy the query instructions.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for assigning channels in a messaging system. An example method includes: providing a plurality of channels, wherein each channel includes an ordered plurality of messages; assigning each channel to a channel bucket to form a plurality of channel buckets, wherein each channel bucket includes at least two channels from the plurality of channels; and assigning each channel bucket to a node selected from a plurality of nodes, wherein the node includes one or more buffers for storing messages according to the order from the channel buckets of the node.

Abstract: Providing a video stream and metadata over channels is described. The method may include receiving a first message on a first channel of a plurality of channels, the first message encapsulating a video frame of a plurality of video frames. The method may also include generating, by a computer processing device, a second message comprising annotation metadata describing a characteristic of the video frame. The method may also include publishing the first message to a second channel of the plurality of channels and publishing the second message to a third channel of the plurality of channels.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving a first message on a first channel of a plurality of channels, wherein the first message comprises a video frame of a plurality of video frames and metadata describing characteristics of the video frame. The video frame is analyzed to detect an object within the video frame. Based on the analysis, the analysis metadata indicating the analysis performed and an indication of the detected object can be generated and then encapsulated in a new message with the video frame. The new message can be published to a second channel.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing a video to subscribers of a messaging system. A method includes obtaining a live video stream generated by a video source. The method also includes publishing one or more messages including one or more frames of the live video stream to a first channel of a plurality of channels. The video source is associated with the first channel.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for assigning channels in a messaging system. An example method includes: providing a plurality of channels, wherein each channel includes an ordered plurality of messages; assigning each channel to a channel bucket to form a plurality of channel buckets, wherein each channel bucket includes at least two channels from the plurality of channels; and assigning each channel bucket to a node selected from a plurality of nodes, wherein the node includes one or more buffers for storing messages according to the order from the channel buckets of the node.