Abstract: An apparatus and a method for preserving privacy in natural language databases are provided. Natural language input may be received. At least one of sanitizing or anonymizing the natural language input may be performed to form a clean output. The clean output may be stored.

Abstract: Systems and methods include: receiving input at a storage system managing a storage device in which a tree-based data structure is stored, the input identifying a set of heterogeneous operations to be applied to the tree-based data structure; determining one or more nodes of the tree-based data structure to which one or more of the set of heterogeneous operations are to be applied; determining one or more groups of the set of heterogeneous operations, the determining being based at least in part on the one or more nodes to which the heterogeneous operations are to be applied; isolating processing of each node from processing of other nodes; and processing each of the one or more nodes to which one or more of the set of heterogeneous operations are to be applied with one of the groups of the set of heterogeneous operations.

Abstract: A method for adding a media item to a playlist may include identifying a media item instance to be added to a playlist, and creating a playlist key for the media item instance, where the playlist key uniquely identifies the media item instance in the playlist. The method may further include storing the playlist key of the media item instance, an identifier of a media item associated with the media item instance and an identifier of the playlist in a data structure associated with the playlist.

Abstract: Techniques for deduplicating data streams are described herein. According to one embodiment, a first data stream is received to be stored in a storage system, where the first data stream includes data blocks and each data block includes a header and a footer. A boundary detector is to detect boundaries of the data blocks by matching at least a portion of a header with a footer of each data block and a header of an adjacent data block. An anchoring unit is to anchor the first data stream based on the determined boundaries of the data blocks using a plurality of anchors. A deduplication engine is to deduplicate the first data stream into a plurality of deduplicated data segments based on the plurality of anchors. The deduplicated data segments are then stored in one or more persistent storage devices of the storage system.

Abstract: According to one embodiment, a restore module of a storage system receives a request from a client device over a network for restoring a data stream stored in the storage system. In response to the request, the restore module identifies a sparse disk file stored in the storage system, where the sparse disk file represents the requested data stream. The sparse disk file includes payload blocks sparsely located and intertwined with metadata of the sparse disk file. A converter executed in a memory by a processor of the storage system converts the sparse disk file into a native disk file based on the payload blocks of the sparse disk file, using a fast-copy method without having physically copying data content of the payload blocks. A block-based accessing interface is provided to the client to allow the client accessing the native disk file. Each block of content represented by the native disk is accessed based on a block identifier and an offset indicating a location of the block within the native disk file.

Abstract: Described herein are systems and methods for supplementing and/or replacing free-entered text with tags, which may be phrases and/or individual words. The tags are then associated with an individual, such as a customer, and the association is stored in a database. At least in part because of the association of the tag with a customer, the tags may be required to be pre-approved. Additionally, a representative that entered the text, and to whom the tags are at least initially displayed, may be given the option of deleting the tag and/or identifying replacement tag(s).

Abstract: Embodiments of the present disclosure provide a method for generating an inverted index in accordance with a user generated collection query. The method comprises providing a field searchable data store that comprises a plurality of event records, each event record comprising a time-stamped portion of raw machine data. The method further comprises receiving a collection query that references a field name. Further, responsive to the collection query, an inverted index is generated by: a) determining an extraction rule associated with the field name; b) extracting a field value corresponding to the field name from one or more event records in the field searchable data store using the extraction rule; and c) populating the inverted index responsive to each extracted field value, wherein each entry comprises the field name, the corresponding field value and a reference value that identifies a location in the field searchable data store where an associated event record is stored.

Abstract: A method, system, apparatus, article of manufacture, and computer-readable storage medium provide the ability to merge multiple point cloud scans. A first raw scan file and a second raw scan file (each including multiple points) are imported. The scan files are segmented by extracting segments based on geometry in the scene. The segments are filtered to reduce a number of segments and identify features. A set of candidate matching feature pairs are acquired by coarsely registering features from one scan to features from another scan. The candidate pairs are refined by improving alignment based on corresponding points in the features. The candidate pairs are scored and then merged based on the scores.

Abstract: Roughly described, a training database contains N segments of data samples. Candidate individuals identify a testing experience level, a fitness estimate, a rule set, and a testing set TSi of the data samples on which it is tested. The testing sets have fewer than all of the data segments and they are not all the same. Testing involves testing on only the individual's assigned set of data segments, updating the fitness estimates and testing experience levels, and discarding candidates through competition. If an individual reaches a predetermined maturity level of testing experience, then validating involves further testing it on samples of the testing data from a testing data segment other than those in the individual's testing set TSi. Those individuals that satisfy validation criteria are considered for deployment.

Abstract: According to one embodiment, analytics module of a storage system receives a request for analyzing a data stream stored in the storage system. In response to the request, the analytics module identifies a sparse disk file stored in the storage system representing the requested data stream. The sparse disk file includes payload blocks sparsely located and intertwined with metadata of the sparse disk file. A converter converts the sparse disk file into multiple native disk files based on the payload blocks of the sparse disk file, using a fast-copy method without having physically copying data content of the payload blocks. A block-based accessing interface is provided to allow multiple clients to concurrently access the native disk files, respectively. Each block of content represented by the native disk is accessed based on a block identifier and an offset indicating a location of the block within the native disk file.

Abstract: A system, method and computer program product for generic source control for orchestration workflows. An example method may include receiving orchestration workflow information from an orchestration workflow engine. The received orchestration workflow information may be in a native file format. The received orchestration workflow information may be converted from a native file format to a predefined format. A request to check in the converted orchestration workflow information may be received, and responsive to receiving the request, the converted orchestration workflow information is stored in a source control system. A request to check out the converted orchestration workflow information may be received from a client computer, and, responsive to receiving the request, orchestration workflow change information may be generated, which indicate changes that have been made to the orchestration workflow information. The orchestration workflow change information may be sent to the client computer.

Abstract: Various embodiments for scrubbing data within a data storage subsystem are disclosed. According to one embodiment, a method is provided for scrubbing data of a storage element within a data storage subsystem, the method comprising: selecting a storage element from the plurality of storage events; determining that a quantity of active data has reached a predetermined quantity threshold; and temporarily suspending data modifications on a portion of the selected storage element while maintaining read access to the selected storage element in response to the determination.

Abstract: Innovations in the area of query processing for a database management system (“DBMS”) are presented herein. For example, for a database query, a query engine generates query code in an imperative language (such as a procedural, scripting language) based on query code in a declarative language (such as a structured query language). The query engine can embed the imperative-language query code in an intermediate representation of the database query, which is executed by the DBMS. In many instances (e.g., for non-linear operations of a database query), the imperative-language query code can be executed by the DBMS more quickly and efficiently than the original declarative-language query code. The DBMS returns results of the execution of the database query.

Abstract: Embodiments include a method, apparatus, program, and system for distributing data items among a plurality of data storage units, the data items being an aggregation of data from a plurality of data sources. The method comprises generating a semantic description of each of the plurality of data sources; calculating, for each pair of data sources from among the plurality of data sources, a degree of similarity between the semantic descriptions of the pair of data sources; and allocating data items to data storage units in dependence upon the calculated degree of similarity between the data source of a data item being allocated and the or each data source of data items already allocated to the data storage units.

Abstract: Accessing data in a database includes receiving, from a first user, a first query for a dataset stored in a database. A first set of patterns is provided in the dataset. For each pattern in the first set of patterns, a significance value is provided in response to the received first query. A set of tags is provided for flagging a pattern of the first set of patterns, the set of tags indicating at least two data categories describing the pattern. Input information received from the first user indicates tags of at least a first subset of patterns of the first set of patterns, wherein each tag of the tags is selected from the set of tags. The significance values of the first subset of patterns are adjusted based on the tags.

Abstract: A system and method for dynamically updating contents of a folder on a user device. The method includes: identifying a folder on the user device as a dynamic folder; determining at least one context parameter related to the dynamic folder; searching, based on the at least one context parameter, a plurality of resources of information to identify content items that that can be pushed to the dynamic folder; and causing, for each identified content item, a display of an icon in the dynamic folder, thereby dynamically updating contents of the dynamic folder with content items found through the search.

Abstract: The present disclosure provides a system and method for comprehensive data synchronization management between a sponsor-company's central electronic-laboratory-notebook system and either multiple contract-research-organizations or research sites. The system features a data loader server that can be deployed on-premise or in the cloud and allows scheduling of synchronization jobs of electronic-laboratory-notebook. The data loader software communicates to the contract research organization and the sponsor company's electronic laboratory notebook and executes scheduled or on-demand jobs. The data loader software may synchronized subsequent update of the data and may automatically delete the data from the contract research organization's site once a given transfer is complete. In some implementations, the method and system is configured for automation, scalability, and high-performance operations that focused on efficiency, security, configurability, and privacy/intellectual property protection.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using a snapshot manifest when storing files in a data store. One of the methods includes computing first static analysis results for a current snapshot; requesting, from a data storage system, a manifest that includes a plurality of unique identifiers that each identify a corresponding second object of second static analysis results for a previous snapshot; determining, for each first object of the first static analysis results, a unique identifier for the first object; determining, for each first object of the first static analysis results, whether the unique identifier for the first object occurs in the manifest; generating a batch of first objects having unique identifiers that do not occur in the manifest; and providing, to the data storage system, the batch of first objects having unique identifiers that do not occur in the manifest.

Abstract: A system and method for integrating a journal associated with a user into a calendar is disclosed. The journal application includes a calendar module, a metadata module, a user preference engine, an action engine, a suggestion engine and a user interface engine. The calendar module receives one or more goals set by the user and creates one or more events in the calendar. The metadata module aggregates one or more types of metadata associated with the user and the one or more events. The user preference engine associates a sharing level with the one or more types of metadata. The action engine executes one or more actions based on the one or more types of metadata. The suggestion engine determines an effect of the one or more actions on the one or more goals set by the user and provides one or more suggestions to the user.

Abstract: Embodiments are directed towards receiving and processing search queries directed towards relatively large sets of data. The data is stored in a record based datastore. From the stored data, field names, corresponding field values, and posting values may be determined. Posting values may be employed to locate records in the datastore that include the field names and field values. The field names, field values, and posting values may be employed to generate a lexicon. If queries are received, a lexicon query processor may employ the lexicon separate from the datastore to generate responses to the received queries. Queries may include clauses that may be processed using the lexicon separate from the datastore, such as, where clause expressions, group-by clause expressions, aggregation functions, or the like. A time values array may be used to enable queries to process group-by-time expressions that may return results grouped into sub-sets based on time ranges.