Abstract: Technologies and solutions are also provided for determining a number of characters in encoded data, particularly for encoding formats that have variable byte lengths. Bytes in the encoding format can have different types, including at least one type that represents a continuation byte. That is, rather than having all data for a character being in a single byte, the data is encoded using two or more bytes. The number of continuation bytes can be counted and subtracted from a total number of bytes in a data set to determine the number of characters in the data set. Optionally, the validity of the data set with respect to an encoding format can be determined prior to, or concurrently with, determining a number of characters in the data set. SIMD techniques can be used with the character counting/validation processes to improve their performance.

Abstract: Techniques and solutions are provided for determining the validity of encoded data. Data encoding techniques associated with a particular format can encode characters as a sequence of bytes, where the bytes can be of particular types. Particular sequences of byte types can be valid or invalid using a given encoding format. Lookup tables can be defined to examine bytes in a byte sequence to determine whether the sequence is valid or invalid. In a particular example, results of lookup operations can produce a result in the form of a sequence of bits, where values of the bits can be used to identify that a sequence is invalid, as well a particular type of encoding error. The techniques can be implemented in ways that are particularly efficient for a computing system, such as implementing lookup operations using SIMD (“Single Instruction, Multiple Data”) techniques.

Abstract: A method may include generating, based at least on a schema configuration of one or more document stores, a plurality of data in a JavaScript Object Notation (JSON) format for storage at the document stores. One or more queries may be generated to match the plurality of data stored at the document stores. The one or more queries may be distributed for execution at the document stores by a scalable quantity of concurrently operating worker nodes. One or more performance metrics for the execution of the one or more queries at the one or more document stores may be generated. Performance improvements at the document stores may be applied based on the performance metrics. Related systems and computer program products are also provided.

Abstract: Technologies and solutions are also provided for determining a number of characters in encoded data, particularly for encoding formats that have variable byte lengths. Bytes in the encoding format can have different types, including at least one type that represents a continuation byte. That is, rather than having all data for a character being in a single byte, the data is encoded using two or more bytes. The number of continuation bytes can be counted and subtracted from a total number of bytes in a data set to determine the number of characters in the data set. Optionally, the validity of the data set with respect to an encoding format can be determined prior to, or concurrently with, determining a number of characters in the data set. SIMD techniques can be used with the character counting/validation processes to improve their performance.

Abstract: Techniques and solutions are provided for determining the validity of encoded data. Data encoding techniques associated with a particular format can encode characters as a sequence of bytes, where the bytes can be of particular types. Particular sequences of byte types can be valid or invalid using a given encoding format. Lookup tables can be defined to examine bytes in a byte sequence to determine whether the sequence is valid or invalid. In a particular example, results of lookup operations can produce a result in the form of a sequence of bits, where values of the bits can be used to identify that a sequence is invalid, as well a particular type of encoding error. The techniques can be implemented in ways that are particularly efficient for a computing system, such as implementing lookup operations using SIMD (“Single Instruction, Multiple Data”) techniques.

Abstract: A method may include generating, based at least on a schema configuration of one or more document stores, a plurality of data in a JavaScript Object Notation (JSON) format for storage at the document stores. One or more queries may be generated to match the plurality of data stored at the document stores. The one or more queries may be distributed for execution at the document stores by a scalable quantity of concurrently operating worker nodes. One or more performance metrics for the execution of the one or more queries at the one or more document stores may be generated. Performance improvements at the document stores may be applied based on the performance metrics. Related systems and computer program products are also provided.