Abstract: Techniques facilitating using flow graphs to represent a data analysis program in a cloud based system for open science collaboration and discovery are provided. In an example, a system can represent a data analysis execution as a flow graph where vertices of the flow graph represent function calls made during the data analysis program and edges between the vertices represent objects passed between the functions. In another example, the flow graph can then be annotated using an annotation database to label the recognized function calls and objects. In another example, the system can then semantically label the annotated flow graph by aligning the annotated graph with a knowledge base of data analysis concepts to provide context for the operations being performed by the data analysis program.

Abstract: Systems and methods for tokenization of log records for efficient data storage, log querying, and log data analytics can utilize a trie pattern conversion of the log files, storing trie data pattern IDs, free parameters, and metadata instead of the entire log record. New trie patterns can be discovered automatically by counting the occurrences of tokens matching wildcards for existing patterns.

Abstract: An item recommendation system includes a candidate item database system, a communication module, and a processor. Candidate items to be recommended to a user are stored in the candidate item database system in association with the access items accessed by the user. The communication module acquires one or more access items accessed by the user recently. The processor acquires one or more candidate items and correlation indexes thereof from the candidate item database system based on the one or more access items, and generates an item recommendation list, wherein the item recommendation list comprises the one or more candidate items and recommendation weights thereof, and the recommendation weights are determined based on the correlation indexes.

Abstract: An entirely automated system for the interpretation of the field layout for multi-field files uses a rich contextual framework constructed by the interaction of three subsystems to provide a holistic view of the contexts of a structured data file as defined by the location and data type of each field. The roles of each of the subsystems are (1) the determination of the file's metadata and positions of the different data fields; (2) the use of fallible oracles (i.e., no oracle must be capable of identifying the type for every record) to provide a set of interpretations of the fields at several levels; and (3) the accurate determination of the location and specific data type for each field without the necessity to interpret every record correctly, even in the presence of ambiguity of data. The system may operate on both delimited and fixed-width structure files.

Abstract: A method comprises receiving a selection of data from a fact table and one or more dimension tables stored in a data warehouse, mapping data points from the selection of the data from the fact table and the one or more dimension tables to a reference space utilizing a lens function, generating a cover of the reference space using a resolution function, clustering the data points mapped to the reference space using the cover and a metric function to determine each node of a plurality of nodes of a graph, each node including at least one data point, determining a plurality of segments of the graph, each segment including at least one node, and generating a segment data structure identifying each segment as well as membership of each segment, the membership of each segment including at least one node from the plurality of nodes in the graph.

Abstract: A system, computer-implemented method, and a computer-readable storage medium for determining estimations to statistical questions. Data statistics used in evaluating estimations to statistical questions are gathered from multiple sources in a database management system. A statistical question comprising, for example, cardinality estimations is received, wherein the question is posed by different database components, such as query optimizer, or execution engine. Estimation for the statistical question is computed, where the estimation is based on multiple data statistics and without using the data referred to in the question.

Abstract: Methods and systems are provided herein for playing back indexed conversations based on the presence of other people. When a user asks a query, the system monitors the area, determines the other users in the area, and searches its database for a conversation that addresses the query in consideration of the other users present in the area. The system filters the indexed conversations to find conversations that included all the users present and determines the best matching conversation based on the words of the query as well as the keywords from the conversation. Once the system has determined the best match conversation, the system plays back the conversation to the user.

Abstract: Universal automatic data update detection and publication may include receiving a request for requested information, which includes an information element associated with a structured data location in a structured data storage unit, identifying a predicate referencing the structured data location, including the predicate in a predicates registry by compiling the predicate into an intermediate representation, creating an asynchronous message bus channel corresponding to the predicate, detecting a data operation for the structured data storage unit, wherein the information element is associated with the data operation, evaluating the intermediate representation, determining a predicate domain change type corresponding to the data operation, generating a change notification including an indication of the change type, and publishing the change notification to the asynchronous message bus channel such that a presentation via the client device is updated in response to the change notification.

Abstract: One example method for predictive clinical planning and design includes instantiating a plurality of data objects, each data object of the plurality of data objects comprising clinical trial information; displaying a graphical user interface on one or more display screens, the graphical user interface providing a graphical representation of at least a portion of a clinical trial and comprising a plurality of graphical nodes; receiving a selection of the second graphical node; receiving, via an editor associated with the second graphical node, a modification of the second data object; propagating an indication of the modification to the first data object, the propagation modifying a clinical trial data item of the first data object; and displaying, within the first graphical node, the modified clinical trial data item of the first data object.

Abstract: An industrial process analysis system is disclosed The system comprises a process data connection device for the acquisition of process data from process data source, an input system for receiving at least one search instruction, an indexing system for indexing the process data to create a set of indexed process data a data processing device for processing the at least one search instruction to create a search parameter set and comparing distances of members of the search parameter set with corresponding members of the indexed process data to obtain a similarity value; and an output device to display results based on the similarity value.

Abstract: Techniques for implementing a streaming transaction in a transaction based data storage system is disclosed. In an embodiment, a server computer system stores a dataset comprising a plurality of files where the dataset comprises a corresponding version number. The server computer system receives a command to modify the dataset and, in response, starts a streaming transaction for the dataset. During the streaming transaction, the server computer system receives a plurality of updates to the dataset, wherein each of the plurality of updates modifies one or more files of the plurality of files. The server computer system executes the plurality of updates in the dataset without modifying the corresponding version number of the dataset. When the server computer system commits the streaming transaction to the dataset, the server computer system increments the corresponding version number of the dataset.

Abstract: Managing cooperative computer software applications by applying a link analysis algorithm to a data set including identifiers representing a plurality of computer software applications and including indicators of operational relationships between the computer software applications, thereby associating a cooperation value with each of the computer software applications represented within the data set, and notifying a computer software application manager of the computer software applications and their associated cooperation values.

Abstract: A registration framework is disclosed that allows assets to be registered with an analytics platform. When an asset is ingested into the analytics platform, the registration framework operates to register the asset in an asset roster. The asset roster identifies the asset and stores information about the asset. The registration framework can then be used by users to discover assets. Assets may also be deployed by the registration framework to workspaces.

Abstract: A mechanism is provided in a data processing system comprising at least one processor and at least one memory, the at least one memory comprising instructions executed by the at least one processor to cause the at least one processor to implement an automated lexicon expansion for an identified corpus. For a selected corpus in a set of corpora, the mechanism determines an estimated number of new terms in the selected corpus that are not in the lexicon based on a frequency count known terms in the selected corpus. Responsive to the estimated number of new terms in the selected corpus being greater than a threshold, the mechanism performs lexicon expansion using the selected corpus to form an expanded lexicon. Responsive to the estimated number of new terms in the selected corpus not being greater than the threshold, the mechanism halts lexicon expansion.

Abstract: A facility for managing information about document-related activities is described. In some cases, the facility uses particular kinds of structures to represent, in a document graph, document-related activities performed by particular users. In some cases, the facility uses these structures to enable one user to subscribe to the document-related activities performed by another user. In some cases, the facility uses these structures to aggregate document-related activities performed by users in a group of users, such as by aggregating topics that are addressed by documents that are the subject of these document-related activities. In some cases, the facility uses particular kinds of structures to represent, in a document graph, tasks that certain users either can help with or need help with. In some cases, the facility uses these structures to match users that can help with a task with users that need help with a task.

Abstract: Aspects automatically invoke automated dialog chat bots in response to determining that query text content meets a threshold relevance. A computer processor analyzes different words within text content of a user query input to identify via natural language processing query topics defined by combinations of the words. The processor drives a display device to present an automated dialog chat bot to the user that presents a chat bot series of dialog questions in response to determining that a query topic identified from analyzing the text content meets a threshold relevancy; or searches a database for results that satisfy keywords or query topics of the query content in response to failing to identify a query topic for the query text content, or to determining that an identified query topic does not meet the threshold relevancy.

Abstract: A mechanism is provided in a data processing system comprising at least one processor and at least one memory, the at least one memory comprising instructions executed by the at least one processor to cause the at least one processor to implement an automated lexicon expansion for an identified corpus. For a selected corpus in a set of corpora, the mechanism determines an estimated number of new terms in the selected corpus that are not in the lexicon based on a frequency count known terms in the selected corpus. Responsive to the estimated number of new terms in the selected corpus being greater than a threshold, the mechanism performs lexicon expansion using the selected corpus to form an expanded lexicon. Responsive to the estimated number of new terms in the selected corpus not being greater than the threshold, the mechanism halts lexicon expansion.

Abstract: A method may include extracting first entities from a first portion of an unstructured data source associated with a user, obtaining, based on the first entities, a contract model including elements and a contract type, generating, by applying the contract model to the first entities, a proposed contract including a contract score and, for each element, element values. Each element value may include an element value score. The method may further include identifying a structured data source associated with the user, obtaining, from the structured data source, structured data corresponding to the first entities, correlating the structured data with an element value of the proposed contract, and modifying, by applying the contract model to the structured data, the element value score of the element value.

Abstract: A system and method for controlling concurrent access to a shared resource in a distributed computing environment. A first user writes new data to the shared resource, then checks to see if at least one concurrent session to access the shared resource is running. If so, then the system does not allow the removal of data out of the shared resource. If not, then older data may be removed from the shared resource to make room for the new data.

Abstract: A method includes generating a first lock requests, each for transmission to a storage unit, where each first lock request indicates a first encoded data slice. First ballots are received, each of the first ballots corresponds to a storage unit, each of the first ballots indicates a first ranking of first requesting entities that includes the DST processing unit. First election result data is generated based on the first ballots. The first election result data indicates a first winner. When the first winner is the DST processing unit, slice access requests are generated in response to the first election result data indicating that the first winner is the DST processing unit, each for transmission to one of the storage units, where each of the slice access requests indicates the first encoded data slice.