Abstract: A method may relate generally to data science and data analysis, computer software and systems, and wired and wireless network communications to provide an interface between repositories of disparate datasets and computing machine-based entities that seek access to the datasets, and, more specifically, to a computing and data storage platform that facilitates consolidation of one or more datasets. One or more computerized tools may be configured to discover, form, and analyze via one or more layered data files, interrelations among a system of networked collaborative datasets. A method may include transforming of a set of data to an atomized format to form an atomized dataset that includes a derived dataset attribute. The method may also include presenting data representing an annotation at the user interface based on the derived dataset attribute. An annotation may be associated with a layer file.

Abstract: In the management of deleted content, deleted data is input into a data analysis engine from one or more first computing devices. A parsing module parses the attributes of the deleted data and modifies the metadata of the deleted data based on results of the parsing. A routing module determines a pipeline with attributes matching the modified metadata of the deleted data and routes the modified deleted data to the pipeline. The modified deleted data in the pipeline is managed based on the pipeline configuration. One of more second computing devices may access the pipeline and evaluate the metadata of the modified deleted data in the pipeline. The one or more second computing devices determine whether or not to inherit the modified deleted data. In determining to inherit the modified deleted data, the one or more second computing devices assume ownership of the modified deleted data.

Abstract: Systems and methods for implementing extensible attributes in ETL are disclosed. In some examples, attributes configured at a source file may be extracted from the source file. The extracted attributes can be mapped to a target column of a data warehouse table, and then a dynamic ETL script may be generated. The dynamic script may be executed to move data associated with the attributes to an appropriate new column of the data warehouse.

Abstract: In one embodiment, a method includes receiving from a first user a text query inputted by the first user using an I/O device associated with the client system, the I/O device including a first keyboard layout. The method also includes identifying one or more physical-proximity phrases corresponding to the text query based at least in part on the first keyboard layout and calculating a confidence score for each of the identified physical-proximity phrases based at least in part on a search history of the first user. The method also includes identifying one or more objects, where each identified object matches at least one of the identified physical-proximity phrases having a confidence score greater than a threshold confidence score and sending to the first user one or more search results corresponding to one or more of the identified objects, respectively.

Abstract: A method, system and a computer program product are provided for organizing a community based on subject-related contributions by classifying user contributions Ci from a plurality of users in a community according to a plurality of subjects Sj to identify subjects in each user contribution, assembling one or more community quality values for each user that generated the user contribution, computing a subject-based quality rating for each user as a sum of a first contribution score based on community quality values for each user's recent contributions to the identified subject and a second contribution score based on community quality values for the user's past contributions to the identified subject, and ranking the plurality of users based on the subject-based quality ratings.

Abstract: An electronic device receives a message and identifying, in the received message, an entity and an item of contact information associated with the entity. The electronic device determines that a contact associated with the identified entity exists among a plurality of contacts in a database and that the contact does not comprise the identified item of contact information. In response to the determining, the electronic device updates the contact to comprise the item of contact information and an indication that the item of contact information is a suggested item of contact information.

Abstract: A Windows file system can be attached to a remote non-Windows disk stack thereby allowing a mass storage device to be redirected at the disk level even though a client terminal is running a non-Windows operating system. A client-side proxy can include a disk provider that is configured to obtain disk information from a mass storage device connected to the client terminal and provide it to the server-side agent. A virtual disk enumerator on the server can employ the disk information to emulate a disk stack so that a Windows specific file system can be loaded on the server. Any Windows-specific management commands that target the mass storage device can be handled by the virtual disk enumerator using the disk information, whereas any access commands can be routed to the disk provider which can interface with a non-Windows disk stack on the client terminal for handling.

Abstract: A deduplication service can be provided to a storage domain from a services framework that expands and contracts to both meet service demand and to conform to resource management of a compute domain. The deduplication service maintains a fingerprint database and reference count data in compute domain resources, but persists these into the storage domain for use in the case of a failure or interruption of the deduplication service in the compute domain. The deduplication service responds to service requests from the storage domain with indications of paths in a user namespace and whether or not a piece of data had a fingerprint match in the fingerprint database. The indication of a match guides the storage domain to either store the piece of data into the storage backend or to reference another piece of data. The deduplication service uses the fingerprints to define paths for corresponding pieces of data.

Abstract: The disclosed system and method acquire and store performance measurements relating to performance of a component in an information technology (IT) environment and log data produced by the IT environment, in association with corresponding time stamps. The disclosed system and method correlate at least one of the performance measurements with at least one of the portions of log data.

Abstract: Systems and methods of a memory allocation buffer to reduce heap fragmentation. In one embodiment, the memory allocation buffer structures a memory arena dedicated to a target region that is one of a plurality of regions in a server in a database cluster such as an HBase cluster. The memory area has a chunk size (e.g., 2 MB) and an offset pointer. Data objects in write requests targeted to the region are received and inserted to the memory arena at a location specified by the offset pointer. When the memory arena is filled, a new one is allocated. When a MemStore of the target region is flushed, the entire memory arenas for the target region are freed up. This reduces heap fragmentation that is responsible for long and/or frequent garbage collection pauses.

Abstract: Techniques are disclosed for dynamically changing a data protection plan based on a risk score. The risk score is continuously or periodically recalculated based on situational factors that are detected from external modules. The situational factors can include natural phenomena such as weather, fire, and seismic activity. The situational factors can include manmade phenomena such as financial conditions, political stability in the region where the data resides, war, terrorist attacks, and the like. The situational factors are retrieved from one or more external modules. The external modules may be IoT (Internet of Things) modules. The external modules are monitored, and as new data from the external modules becomes available, a risk score for stored data is computed. The risk score is then used to select an appropriate data protection plan.

Abstract: Data mining operations are performed within a columnar database management system. The columnar database management system stores input sets of data for a data mining operation. An input set of data is represented as a column of data in the columnar database management system. The columnar database management system stores instructions to perform one or more data mining operations for processing the input sets of data. The columnar database management system receives requests for performing data mining operations and performs the processing of the data mining operation within the columnar database management system. As a result, the processing of data mining operations is performed without requiring multiple data transfers between an application implementing the data mining operations and the columnar database management system.

Abstract: A technique includes communicating a plurality of hashes associated with chunks of an object to at least some stores of a plurality of stores on which the object is distributed; and in response to the communication, receiving responses indicating a distribution of the associated chunks. The technique includes selecting one of the stores based at least in part on the responses and communicating deduplicated data associated with the object to the selected store.

Abstract: One embodiment provides a method for storage management in a hierarchical file system. The method includes tracking directories for sub-file systems of the hierarchical set of file systems and maintaining a corresponding directory in a top-file system and a number of symbolic pointers in the corresponding directory which each point from the corresponding directory to a sub-file system where any portion of the tracked directory resides. If available space in a first sub-file system is below a threshold, the system identifies a second sub-file system with available space above the threshold, wherein the first sub-file system contains a first portion of the directory. If a second portion of the directory does not exist in the second sub-file system, the system creates the second portion of the directory in the second sub-file system and creates a link from the first portion of the directory to the second portion of the directory.

Abstract: An apparatus for optimizing a skewed join is described herein. The apparatus includes logic, at least partially including hardware logic, to determine that a dataset for the skewed join comprises a skewed key that does not fit in memory. The apparatus also includes logic to model the skewed join as a queue. The apparatus also includes logic to estimate a cost of the skewed join based on the modeled queue. The apparatus evaluates different join techniques, and partitioning strategies for the skewed join, and chooses the plan with the lowest cost.

Abstract: One embodiment provides a method for storage management in a hierarchical file system. The method includes tracking directories for sub-file systems of the hierarchical file system. A request for a unique directory in the hierarchical file system is received. The sub-file system of the hierarchical file system containing the unique directory is provided while ensuring that each directory resides in only one sub-file system. The system also maintains, in a top-file system, a corresponding directory and a symbolic pointer which points from the corresponding directory to a sub-file system where a given directory resides. Creation of new directories in sub-file systems also includes creation of corresponding directories in the top-file system and symbolic pointers from corresponding directory to new directory.

Abstract: An electronic device suggests contacts and calendar events for users based on their messages. The device can analyze a user's messages for contact and event information and automatically generate or update suggested contacts and calendar events for the user based on this information. The suggested contacts and calendar events can be searchable as if they were manually entered by the user, and the user can choose to add or ignore the suggested contacts and calendar events.

Abstract: A virtual assistant receives natural language interpretation hypotheses for user queries, determines entities and attributes from the interpretations, and requests data from appropriate data sources. A cost function estimates the cost of each data source request. Cost functions include factors such as contract pricing, access latency, and data quality. Based on the estimated cost, the virtual assistant sends requests to a plurality of data sources, each of which might be able to provide data necessary to answer the user query. By including user credits in the cost function, the virtual assistant provides better quality of results and answer latency for paying users. The virtual assistant minimizes latency by answering using data from the first responding data source or provides a latency guarantee by answering with the most accurate data received by a deadline. The virtual assistant measures data source response latency and caches responses for expensive requests.

Abstract: One embodiment provides a method for storage management in a hierarchical file system. The method includes tracking directories for sub-file systems of the hierarchical set of file systems and maintaining a directory while providing the directory is capable of residing in more than one sub-file system within the hierarchical file system. If available space in a first sub-file system is below a threshold, the system identifies a second sub-file system with available space above the threshold, wherein the first sub-file system contains a first portion of the directory. If a second portion of the directory exists in the second sub-file system, the system creates or expands a file in the second portion of the directory, otherwise the system first creates the second portion of the directory in the second sub-file system and then creates a link from the first portion of the directory to the second portion of the directory.

Abstract: An electronic device suggests contacts and calendar events for users based on their messages. The device can analyze a user's messages for contact and event information and automatically generate or update suggested contacts and calendar events for the user based on this information. The suggested contacts and calendar events can be searchable as if they were manually entered by the user, and the user can choose to add or ignore the suggested contacts and calendar events.