Abstract: Disclosed are various embodiments for searchable encrypted data stores. A plurality of rows in a data table that have a cell in a column of the row that matches a value are identified. A bitmap that represents the plurality of rows is generated. The bitmap is encrypted. A key is then generated for a key-value pair. The key can be represented by a message authentication code (MAC) based at least in part on a tuple of a name of the data table, an identifier of the column, and the value. The key-value pair with the key and the encrypted bitmap is then sent to a remote computing device for storage.

Abstract: A system and method includes using a queue with map-reduce. The system includes a computer cluster that is to execute, by a first node, a first reduce operation on a first location of data to generate a first plurality of markers indicative of data at the first location of data and execute, by a second node, a second reduce operation on a second location of data to generate a second plurality of markers indicative of data at the second location of data. Responsive to generation of one or more markers, the computer cluster is to submit the one or more markers to a queue. Responsive to completing the first reduce operation by the first node, the computer cluster is to direct the first node to perform a first copy operation that copies first data identified by a first marker of the one or more markers in the queue.

Abstract: Systems and methods for requesting, tracking and reporting modifications to a record are the subject of the present disclosure. In one embodiment, the record is associated with a customer-relationship management or CRM system. According to varying embodiments, the system and method may be implemented through the use of one or more modules and may permit one of several actions to be taken with respect to a record.

Abstract: Generating, from transactions performed at a production computing system, information that can be used to effectively test new, updated, and/or modified source code to be deployed within the production computing system. In one example, this disclosure describes a method that includes communicating with a production processing system to determine an initial state of the production processing system; capturing information about a plurality of transactions executing across a plurality of application servers included within the production processing system; communicating with a test processing system to deploy source code within the test processing system that is not included in the production processing system; generating a replay test script; and communicating with the test processing system to enable the test processing system to execute the replay test script.

Abstract: A method, system, and computer program product for enterprise applications. Embodiments commence by accessing a first database table having columns pertaining to one or more cost items of a first project and accessing a second database table having columns pertaining to cost items of a second project. A user interface aids definition of user-defined inter-project attributes, wherein the user-defined inter-project attributes relate a database table column of the first project to a database table column of the second project. The user-defined inter-project attributes are used in preparing display information pertaining to at least two projects such that in response to a single action being performed under control of a client system, the prepared display information is sent to a display unit. In some cases, the prepared display information comprises a summary of values, and in some cases, an alert icon is displayed based on a summary value exceeding a threshold.

Abstract: The subject technology receives a query plan, the query plan comprising a set of query operations, the set of query operations including at least one aggregation and at least one join operation. The subject technology analyzes the query plan to identify an aggregation that is redundant. The subject technology removes the aggregation based at least in part on the analyzing. The subject technology determines at least one aggregation property corresponding to at least one query operation of the query plan. The subject technology inserts at least one adaptive aggregation operator in the query plan based at least in part on the at least one aggregation property. The subject technology provides a modified query plan based at least in part on the inserted at least one adaptive aggregation operator in the query plan.

Abstract: A computing device configured for using a member attribute to perform a database operation is described. The computing device includes a processor and instructions stored in memory. The computing device generates an object based on a class with a member. The member has an associated attribute that indicates a database mapping. The computing device also performs a database operation based on the attribute.

Abstract: Systems and methods for synchronizing data between a customer data management system and a data warehouse system. A data warehouse server may constantly monitor a dynamic metadata flow from the customer data management system, compare it with the metadata in the data storage device, and dynamically update the metadata in the data storage device. The data warehouse server may track activities over time and accumulate a long running history, which may include multiple versions of accounts in the customer data management system, e.g., the account as of today, the account as of yesterday, and another version that was the account two weeks ago.

Abstract: Systems and methods for optimizing memory in an interest-driven business intelligence system in accordance with embodiments of the invention are illustrated. A dictionary for storing values of a dataset may be partitioned in accordance with some embodiments. The partitions of the dictionary may be generated by mapping and reducer processes. The mapping processes receive a value, determine the dimension of the data to which the value belongs, and provides the value to a reducer process that handles the determined dimension. Each reducer process generates partitions of the dictionary for each dimension. The number of values in each partition is determined and compared to a threshold value. Partitions that have a number of values greater than the threshold are stored in a common memory. Partitions smaller than the threshold value can be combined with other partitions such that the cardinality of the combined partition exceeds the threshold value.

Abstract: During a first delta time period, monitoring a growth in a number of records and determining a highest-growth partition in the database. The highest-growth partition is divided into subranges. During a second delta time period, a growth is monitored for each subrange. For the subrange with a greatest growth, the subrange is subdivided into sub-subranges and a growth determined for each sub-subrange. The monitoring and the determining is repeated and further subdivisions made of divisions having the highest growths until growths have been recorded for N delta time periods. For each of the N delta time periods, weighted growths are determined for each subdivision. Expected record counts are determined for each of the divisions that are expected for a subsequent time period spanning the N delta time periods. Based on the expected record counts, a partition split point within the highest-growth partition is determined, and the highest-growth partition is split into two partitions.

Abstract: Systems and methods are disclosed for receiving, at a data intake and query system, a query that includes an indication to process data managed by a third-party data storage and processing system that supports a different query language than the data intake and query system. The data intake and query system identifies a third-party data storage and processing system that manages the data to be processed and generates a subquery for execution by the third-party data storage and processing system, generates instructions for one or more worker nodes to receive and process results of the subquery from the third-party data storage and processing system, and instructs the worker nodes to provide results of the processing to the data intake and query system.

Abstract: Certain aspects of the present disclosure provide techniques for generating application programming interface (API) code for an application. The method generally includes receiving information indicating a set of queries invoked within an application. A set of nodes in a graph projection of the API accessed by queries in the set of queries is identified by traversing the graph projection of the API for each query in the set of queries. A subgraph projection of the API including the identified set of nodes is identified, and code implementing operations associated with the identified set of nodes is generated from the generated subgraph projection of the API. The generated code is deployed for use with the application.

Abstract: Techniques for tracking software platform utilization by a plurality of entities are described herein. In an embodiment, a management computer system stores first entity data defining a first entity and associating the first entity with a plurality of first accounts, the first entity having access to the management computer system programmed which provides options for performing a plurality of tasks. The management computer system tracks a first plurality of interactions with the management computer system that are performed by each of the plurality of first accounts. The management computer system stores first interaction data defining one or more aspects of interaction with the management computer system that are performed by each of the plurality of first accounts. The management computer system stores second entity data defining a plurality of second entities and associating each of the plurality of second entities with a plurality of second accounts.

Abstract: A computer-implemented method is provided for generating a new formulation. The method includes dividing each of input formulations into constituent topics, based on analysis results for an analysis of the input formulations using a topic model algorithm. The method further incudes includes receiving an input query that specifies a set of fragrance. notes to he used to generate the new formulation, The method also includes choosing one of the input formulations which includes the set of fragrance notes to be used to generate the new formulation. The method additionally includes clustering the constituent topics of the chosen one of the input formulations based on a similarity metric. The method further includes generating the new formulation as a response to the input query by selecting, from the input formulations, materials for each of the clustered ones of the constituent topics.

Abstract: Various techniques are disclosed herein for storing and managing master data in hierarchical data systems. Several related concepts, embodiments, and examples are disclosed, including techniques for incremental rationalization in a hierarchical data model, techniques for implementing governance pools in a hierarchical data model, techniques for application materialization in a hierarchical data model, techniques for data intersection mastering in a hierarchical data model, techniques for change request visualization in a hierarchical data model, and techniques for hierarchy preparation in a hierarchical data model.

Abstract: A system for creating a semantic data warehouse including a convergence service configured to execute queries to connected data sources, to convert data from source to domain semantics, and to aggregate converted data. The convergence service is configured to invoke by an entity graph service that, on demand, defines a semantic entity representation, the needed queries and data sources to be queried; and projects and makes available the resulting data in the semantic entity representation.

Abstract: One or more computing devices may comprise congestion management circuitry, one or more client file system request buffers, and DESS interface circuitry. The congestion management circuitry is operable to determine an amount of congestion in the DESS. The one or more client file system request buffers is/are operable to queue first client file system requests of a first priority level and second client file system requests of a second priority level, wherein the first priority level is higher priority than the second priority level. The DESS interface circuitry is operable to control a rate at which the first file system requests and second file system requests are fetched from the one or more client file system request buffers based on the amount of congestion in the DESS, on the first priority level, and on the second priority level.

Abstract: A building energy management includes building equipment, one or more data platform services, a timeseries database, and an energy management application. The building equipment operate to monitor and control a variable and provide raw data samples of a data point associated with the variable. The timeseries database stores a plurality of timeseries associated with the data point. The plurality of timeseries include a timeseries of the raw data samples and the one or more optimized data timeseries generated by the data platform services based on the raw data timeseries. The energy management application generates an ad hoc dashboard including a widget and associates the widget with the data point. The widget displays a graphical visualization of the plurality of timeseries associated with the data point and includes interactive user interface options for switching between the plurality of timeseries associated with the data point.

Abstract: A task list can list tasks to be performed on a target host machine. Certain tasks in the task list can be revised to produce a revised task list. Tasks directed to storage devices can be revised depending on whether or not the storage devices are shared by both the target host machine and a reference host machine.

Abstract: A building energy management includes building equipment, one or more data platform services, a timeseries database, and an energy management application. The building equipment operate to monitor and control a variable and provide raw data samples of a data point associated with the variable. The timeseries database stores a plurality of timeseries associated with the data point. The plurality of timeseries include a timeseries of the raw data samples and the one or more optimized data timeseries generated by the data platform services based on the raw data timeseries. The energy management application generates an ad hoc dashboard including a widget and associates the widget with the data point. The widget displays a graphical visualization of the plurality of timeseries associated with the data point and includes interactive user interface options for switching between the plurality of timeseries associated with the data point.

Abstract: A semi-public blockchain maintained on one or more nodes in a map cloud platform comprises data for maintaining a global map of a predetermined geographic area. The blockchain also comprises a plurality of data records, where each data record is associated with an update to a global map. When a message associated with a map update to the global map is received, the nodes of the blockchain determine a consensus by evaluating the map update, where the evaluating comprises performing a plurality of proofs including a proof of location, a proof of iterations, a proof of physical delivery and a proof of safety. When consensus is attained and the map update is validated, a data record associated with the map update is generated and added to the blockchain with a timestamp and a link to prior data records in the blockchain.

Abstract: The disclosed computer-implemented method for automatically linking data analytics to storage may include (1) identifying a request to provision storage for a data analytics task, (2) collecting information relating to the data analytics task, the information comprising at least one of a data type of the data being used as input for the data analytics task and a characteristic of the data analytics task, (3) using a self-service provisioning tool to automatically compute, based on the collected information, a suggested type and size of data storage for the data analytics task, and (4) automatically provisioning data storage for the data analytics task based on the suggested type and size. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: Disclosed are methods, systems, and non-transitory computer-readable medium for context development. For instance, a first method may include obtaining first micro-application actor information associated with a first micro-application actor. The first micro-application actor information may include information for workflow rules, and the workflow rules may include data set rules, extract, transform, load (ETL) rules, and functional expressions. The first method may further include obtaining data from data sources based on the data set rules; applying the ETL rules to the obtained data to generate processed data; applying the functional expressions to the processed data to obtain an output; and performing at least one processing action based on the output. A second method may include generating a system component corresponding to a blueprint based on a user request.

Abstract: Various methods and apparatuses are described for performing high speed translations of data. In an example embodiment, record layout detection can be performed for data. In another example embodiment, data pivoting prior to field-specific data processing can be performed.

Abstract: A non-transitory computer readable medium storing instructions that, when executed by an electronic processor, perform a set of functions. The set of functions include extracting a report including a markup language document from a system. The set of functions also includes, for each of a plurality of processing tasks, determining whether the markup language document includes a path contained in a virtual table assigned to the processing task. The set of functions also includes, in response to the markup language document including the path contained in the virtual table, extracting data from the markup language document and executing the processing task to manipulate and queue the data for insertion into the combined database. The set of functions further includes, in response to each of the plurality of processing tasks completing without failure, inserting the data queued into one or more tables included in a database.

Abstract: According to embodiments, a multi-node database management system allows consumer processes (“consumers”) implementing a portion of a distributed data-combination operation to independently send a STOP notification to corresponding producer processes (“producers”). Upon a given consumer determining that the consumer requires no further information from corresponding producers, the consumer sends a STOP notification to the producers. When a given consumer sends out a STOP notification, the producers drop any data destined for the given consumer and also stops preparing data for and sending rows to the given consumer. Furthermore, once the producers receive STOP notifications from all of the consumers corresponding to the producers, the producers stop the current sub plan execution immediately without requiring completion of the sub plan.

Abstract: De-normalized data structure files generation systems and methods are provided. The system obtains files from sources wherein each file include records, parses files to validate records and attributes in the records, identifies a set of similar files from the validated files, and append two or more files from the set of similar files to obtain one or more consolidated files. Each of the one or more consolidate files corresponds to a specific category. The system further a predefined logic validation on each of the one or more consolidated files to obtain a logic validated file for each of the one or more consolidated files. Each logic validated file obtained for the one or more consolidated files include validated records. The system further generates a de-normalized data structure file including de-normalized records by merging each of the logic validated files to be used for generating intelligence reports.

Abstract: A requirements-traceability system extracts and classifies project requirements stored in a set of source documents. If a source document is unstructured, such as a natural-language word-processing file, the system uses a self-learning or cognitive natural-language tool to inferentially infer requirements in that document. Each requirement may be composed of more detailed sub-requirements in parent-child relationships. Requirements are reclassified into a standardized classification scheme and stored in a standardized hierarchical data structure in which each level corresponds to a requirement's relative degree of granularity. The tree is updated whenever requirements are revised, allowing users and downstream applications to bidirectionally trace each requirement's ancestors and descendants and to review and audit revision histories of the project's entire requirements hierarchy.

Abstract: Systems, methods and computer program products are provided. Metadata associated with an integration flow comprising a sequence of nodes are received. The metadata identifies data in one or more data objects used by the nodes of the integration flow. In response to initiation of the integration flow, an input data object is received. Initial context data for the integration flow are extracted, from the input data object, based on the metadata. The context data is processed at each of the nodes of the integration flow, wherein one or more of the nodes adds data from its output data object to the context data based on the metadata. Remaining data from the output data objects of one or more of the nodes which was not added to the context data based on the metadata is discarded.

Abstract: As disclosed herein, a method includes receiving a plurality of datasets from a database, wherein each dataset comprises one or more data fields represented in a single data format, and wherein the data fields from at least two of the datasets are represented in different data formats, combining the plurality of datasets to provide a created data column corresponding to all of the data fields from the plurality of datasets, organizing the data column into data clusters, wherein each data cluster includes data fields represented in a single data format, and wherein each data field belongs to a data cluster, providing a key-value map referencing data fields with respect to their corresponding data formats, and verifying the database with respect to the created column. A corresponding computer program product and computer system are also disclosed.

Abstract: A system and method of use resolves the frustration of repeated manual work during schema mapping. The system utilizes a transformation graph—a collection of nodes (unified attributes) and edges (transformations) in which source attributes are mapped and transformed. The system further leverages existing mappings and transformations for the purpose of suggesting to a user the optimal paths (i.e., the lowest cost paths) for mapping new sources, which is particularly useful when new sources share similarity with previously mapped sources and require the same transformations. As such, the system also promotes an evolving schema by allowing users to select which unified attributes they want to include in a target schema at any time. The system addresses the technical challenge of finding optimal transformation paths and how to present these to the user for evaluation.

Abstract: A method, apparatus, and computer-readable medium for generating categorical and criterion-based search results from a search query including receiving the search query, generating one or more query fragments, determining a category corresponding to the search query, determining one or more filters applicable to the search query and one or more core search terms applicable to the search query based at least in part on the determined category and the one or more query fragments, generating at least one custom query for at least one target database in the one or more target databases based at least in part on the one or more filters, the one or more core search terms, the determined category, and one or more attributes of the at least one target database, and executing the at least one custom query on the at least one target database to generate a set of search results.

Abstract: A method for processing events comprising time series data may include inferring different schema associated with the events. The method may also include storing property definitions corresponding to the events. Each property definition may include a name and a data type. The method may also include storing schema definitions corresponding to the different schema that are inferred. Each schema definition may include a set of one or more properties. The method may also include updating at least one data structure for storing information about the events based on the different schema that are inferred.

Abstract: Systems, computer program products, and methods are described herein for restoring a transformation state using blockchain technology. The present invention is configured to electronically receive a data transformation request to implement one or more changes to one or more target systems; electronically extract data from one or more source systems based on at least receiving the one or more data transformation protocols; determine the one or more target systems associated with the data transformation request; generate an image of the first state of the one or more target systems; generate a cryptodigit associated with the first state of the one or more target systems; store the generated cryptodigit and the image of the first state of the one or more target systems as a first node in a blockchain distributed ledger; and implement the one or more changes to the one or more target systems.

Abstract: A unified messaging platform is described which provides a comprehensive environment for collaboration, file sharing, and project management. In one aspects, a system includes hardware processing circuitry configured to receive a message, the message identifying a user via a user callout, identify a device associated with the user, identify a device type of the identified device and one or more applications on the identified device, generate, based on the device type and the one or more applications, a notification including machine-executable instructions that, when accessed and executed by the device, cause the one or more applications to display a notice about the user callout, and send the notification to the device.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing a statement that references a particular attribute of a particular topic, in response to providing the statement, obtaining one or more query patterns that each include one or more query terms that are used in queries submitted to a search system in obtaining a value for the particular attribute of the particular topic, generalizing one or more of the query patterns, and associating the one or more generalized query patterns with one or more other topics that include the particular attribute.

Abstract: A method may include detecting, at a development system hosting a first software application, a change to a first database table storing a master data associated with the first software application. The change may correspond to a customization applied to the first software application. The master data may include data objects that the first software application requires for performing a function of the first software application. In response to detecting the change to the first database table, the change may be applied to a second database table storing a replica of the master data. A transport request may be generated to include the customization and at least a portion of the second database table including the change. The transport request may be sent to a production system hosting a second software application to deploy the customization at the production system. Related systems and articles of manufacture are also provided.

Abstract: Performing data analytics processing in the context of a large scale distributed system that includes a massively parallel processing (MPP) database and a distributed storage layer is disclosed. In various embodiments, a data analytics request is received. A plan is created to generate a response to the request. A corresponding portion of the plan is assigned to each of a plurality of distributed processing segments, including by invoking as indicated in the assignment one or more data analytical functions embedded in the processing segment.

Abstract: A method stores records for a set of entities that are generated using an input parameter that is not based on a date. A query is received that includes one or more date parameters, the query for aggregating a value. Upon receiving the query, the method performs: selecting a set of records from the stored records that are valid based on comparing first date information determined from the one or more date parameters and second date information from the records; performing an aggregation calculation of the value for the set of records to generate a query result; and returning the query result in response to the query.

Abstract: Provided are computer-implemented methods and systems for publishing an application to a web container. An example method for publishing an application to a web container may include establishing a channel of communication with a user device associated with an end user. The method may further include embedding a web container into a web portal associated with a plurality of applications. The method may include executing an application in a user session associated with the end user. The method may further include capturing images of a virtual screen associated with the application executed on the application server. After the capture, the method may continue with sending the images to the web container of the web portal running in a web browser of the user device. The web container may publish the images to the web browser to display the application as part of the web portal in the web browser.

Abstract: A system for and a method of testing the performance of a database management system. The system and method utilize a data table generator, a query generator, and a query driver system that are configured to generate test data, generate a series of test queries, and execute the queries against the data in a controlled and measurable manner such that the performance of the database management system can be tested in a configurable, repeatable, and consistent manner to measure the impact of system software and configuration changes.

Abstract: A query optimizer improves the efficiency of a computer database system utilizing an input-output correlator used with a create function that indicates a correlation between an input to the function and an output of the function. In an example, the input-output correlator is an OR OUTPUT parameter of a create table function. The query optimizer determines whether it can pass a value of a query to the input of the function in response to the input-output correlator. Under appropriate conditions, the query optimizer passes the query value to the input of the function to significantly reduce the amount of data returned by the function thereby reducing the load on database resources.

Abstract: Systems and methods are provided for regulating a power converter. An example system controller includes: a driver configured to output a drive signal to a switch to affect a current flowing through an inductive winding of a power converter, the drive signal being associated with a switching period including an on-time period and an off-time period. The switch is closed in response to the drive signal during the on-time period. The switch is opened in response to the drive signal during the off-time period. A duty cycle is equal to a duration of the on-time period divided by a duration of the switching period. One minus the duty cycle is equal to a parameter. The system controller is configured to keep a multiplication product of the duty cycle, the parameter and the duration of the on-time period approximately constant.

Abstract: A computerized method for ingesting data from a relational database into a data lake is provided, wherein a user-defined function (UDF) is associated with a standard operation of extract, transform, load, or ETL, of an ETL pipeline. This UDF is triggered upon performing the standard operation and thereby allow a code associated with the UDF to be executed. Upon migrating data from one or more data sources into the relational database, the standard operation is executed, which triggers the UDF and, in turn, an execution of the code. As per the execution of this code, an entity running on the data lake is notified that a set of data migrated to the relational database is to be ingested according to given ingestion modalities specified by the code. Finally, the set of data can be ingested into the data lake according to the modalities. Related computer program products are also provided.

Abstract: A system for performing a timeliness control is disclosed. The system identifies a dataflow path for performing timeliness control and identifies a first network node and a second network node of the dataflow path for determining a latency between the first and the second network node. The system determines an output lineage corresponding to the dataflow path and identifies, from the output lineage, a first control value associated with the first network node and a second control value associated with the second network node. Then, the system extracts a first timestamp from the first control value and a second timestamp from the second control value and determines the latency based on the first timestamp and the second timestamp. Although the intranode latency is described herein with respect to a first and second nodes, the intra-node latency can be determined for up to n nodes using the techniques described herein.

Abstract: Methods and systems for efficiently downloading archived snapshot data from the cloud or from an archival data store are described. In a disaster recovery scenario in which an entire storage appliance for backing up different point in time versions of a virtual machine has failed (e.g., due to a fire), archived snapshot data for the different point in time versions may be acquired by a second storage appliance from an archival data store (e.g., cloud-based data storage) using one or more snapshot mapping files. A snapshot mapping file may include pointers to a plurality of data blocks within the archival data store for generating a full image snapshot associated with a particular point in time version of the virtual machine. The plurality of data blocks may comprise the minimum number of data blocks necessary to construct the particular point in time version of the virtual machine.

Abstract: A method includes determining, by a controller, a portion of data that is selected by a user. The portion of data includes source data that is to be transformed by at least one shaping function. The method also includes generating, by the controller, a first output recommendation data that communicates at least one recommended shaping function to apply to the portion of data. The first output recommendation data is generated based on patterns of shaping functions that have been previously chosen. The patterns of shaping functions that have been previously chosen can be chosen by a plurality of system users. The method also includes determining whether to apply the at least one recommended shaping function to the portion of data. The method also includes applying the at least one recommended shaping function based on the determining.

Abstract: The current document is directed to systems, and methods incorporated within the systems, that execute queries against log-file entries. A monitoring subsystem within a distributed computer system uses query results during analysis of log-file entries in order to detect changes in the state of the distributed computer system, identify problems or potential problems, and predict and forecast system characteristics. Because of the large numbers of log-file-entry containers that may need to be opened and processed in order to execute a single query, and because opening and reading through the entries in a log-file-entry container is a computationally expensive and time-consuming operation, the currently disclosed systems employ event-type metadata associated with log-file-entry containers to avoid opening and reading through the log-file entries of log-file-entry containers that do not contain log-file entries with event types relevant to the query.

Abstract: Systems, computer program products, and methods are described herein for data transformation prediction and code change analysis. The present invention is configured to electronically receive one or more data transformation protocols; electronically extract data from a first source system based on at least receiving the one or more data transformation protocols; initiate an impact analysis associated with transforming the data extracted from the first source system using the one or more data transformation protocols, wherein initiating further comprises determining one or more impacts of the data transformation on one or more other source systems; and initiate a presentation of a user interface for display on the user device, wherein the user interface comprises a graphical representation of the one or more impacts of the data transformation of the data extracted from the first source system on the one or more other source systems.

Abstract: A computer-implemented method for responding to user behaviors includes storing category specifications for a plurality of categories configured to characterize users, storing categories for users in a computer network system, detecting behaviors of a user in real time, and determining in real time if the behaviors of the user is within a first category specification associated with a first category that the user is tagged with. If the behaviors of the user exceed the first category specification, the method assigns a second category to the user in real time in response to the detected user behaviors.