Abstract: Systems and techniques of de-duplicating file and/or blobs within a file system are presented. In one embodiment, an email system is disclosed wherein the email system receives email messages comprising a set of associated attachments. The system determines whether the associated attachments have been previously stored in the email system, the state of the stored attachment, and if the state of the attachment is appropriate for sharing copies of the attachment, then providing a reference to the attachment upon a request to share the attachment. In another embodiment, the system may detect whether stored attachments are corrupted and, if so, attempt to repair the attachment, and possibly, prior to sharing references to the attachment.

Abstract: The present invention is directed to architectures for receiving, from requestors, requests for information, identifying appropriate responders, unknown to the requestors, to provide the requested information, and effecting interactions between the requestors and responders.

Abstract: In an information management system, activity data is collected and analyzed for patterns. The information management system may be policy based. Activity data may be organized as entries including information on user, application, machine, action, object or document, time, and location. When checking for patterns in the activity or historical data, techniques may include inferencing, frequency checking, location and distance checking, and relationship checking, and any combination of these. Analyzing the activity data may include comparing like types or categories of information for two or more entries.

Abstract: This disclosure details the implementation of systems, methods and apparatuses for providing an integrated process tracking and management. The disclosure provides solutions for initiating, tracking, correlating and managing complex processes. In particular, the disclosure provides systems, methods and apparatuses for process tracking and management particularly suited to job listing matching and management. In an implementation, the system may be configured to receive and extract base data entry metrics from a user designated input, for example a user's resume or a user designated saved job listing. The base data entry metrics may be correlated with user correlation metrics to derive search parameters for identifying supplemental data entries for a particular user.

Abstract: Implementations of the present disclosure include actions of receiving search results that are responsive to the search query, the search results being respectively representative of resources, processing one or more triggering rules based on at least one of the search query and the search results, determining, based on processing the one or more triggering rules, that a set of data records is to be displayed in a search results page with the search results, the set of data records including data records that are specific to the user, determining a display prominence of at least one data record in the set of data records, the display prominence indicating a prominence of the at least one data record when displayed in the search results page, and providing the search results and the set of data records for display, the at least one data record being displayed based on the display prominence.

Abstract: Centralized contextual awareness is used to resolve conflicts. When two or more client devices interact, a current context of each client device is evaluated for rule-based decisions. Conflicts in rules may be arbitrated based on policies and goals to generate a resolution.

Abstract: Techniques are provided for anomaly, association and clustering detection. At least one code table is built for each attribute in a set of data. A first code table corresponding to a first attribute and a second code table corresponding to a second attribute are selected. The first code table and the second code table are merged into a merged code table, and a determination is made to accept or reject the merged code table. An anomaly is detected when a total compression cost for a data point is greater than a threshold compression cost inferred from one or more code tables. An association in a data table is detected by merging attribute groups, splitting data groups, and assigning data points to data groups. A cluster is inferred from a matrix of data and code words for each of the one or more code tables.

Abstract: A method is provided for storing files in a filesystem of a data storage system. The method includes (a) storing data of each file of a set of files of the filesystem in a set of data allocation units (AUs) of the filesystem on the data storage system, each data AU of the set of data AUs having a common data AU size, and (b) storing metadata pertaining to each file of the set of files in a set of metadata AUs of the filesystem on the data storage system, each metadata AU of the set of metadata AUs having a common metadata AU size, the common data AU size being larger than the common metadata AU size. A computerized apparatus and a computer program product are also provided for performing a method similar to that described above.

Abstract: The present invention is generally directed to methods, systems, and computer program products for synchronizing database data to a database cache. Embodiments of the invention facilitate synchronizing order data from an order management system database to an order cache. When order data is synchronized, more efficient order lookups of the order data can occur. In some embodiments, the order management system database feeds the order cache with the latest updates as relevant state for orders is modified. A trigger within the order management system database can indicate when order state is modified. The trigger is monitored. When the trigger indicates modified order state, a caching interface (e.g., a caching API) can be called to publish the modified order state to the order cache.

Abstract: An approach for specifying data in a standards style pattern of Service-Oriented Architecture (SOA) environments is provided. The approach implemented in a computer infrastructure, includes defining an interface including one or more local data elements and one or more references to one or more common data elements, of a service, the one or more common data elements being defined in a library for a plurality of services. The approach further includes configuring a data definition file (DDF) which indicates whether each of the one or more local data elements and the one or more common data elements is mandatory for the service. The approach further includes validating one or more data elements from a consumer as mandatory for the service based on the configured DDF.

Abstract: A method and system for reducing storage requirements and speeding up storage operations by reducing the storage of redundant data includes receiving a request that identifies one or more data objects to which to apply a storage operation. For each data object, the storage system determines if the data object contains data that matches another data object to which the storage operation was previously applied. If the data objects do not match, then the storage system performs the storage operation in a usual manner. However, if the data objects do match, then the storage system may avoid performing the storage operation.

Abstract: Disclosed are a method and an apparatus for determining an automatic scanning action.

Abstract: The present invention relates to a method, system, and computer program product for data backup, the method comprising: performing first chunking on current data by using the same chunking method as that used by original backup data to obtain a current chunk; calculating hash value of the current chunk; and acquiring, from a hash value table of the original backup data, an identifier of a matched chunk whose hash value is the same as the calculated hash value of the current chunk, and incrementing number of continuous matched chunks by one. Since the pertinence between original backup data and current data is maximally utilized, performance of de-duplication method can be efficiently improved.

Abstract: Precise quantile determination in a distributed environment is provided where data is distributed among worker nodes, one of which functions as a coordinator node. Each worker node has local data for precise quantile determination. The coordinator node derives a maximum relative error value ? which guarantees an exact result for every quantile can be determined in two passes with optimal memory consumption on this node. The worker nodes perform a distributed computation of quantile summaries of datapoints, that specify lower and upper bounds of quantile ranks for selected datapoints. The coordinator node merges the quantile summaries and determines, for each quantile rank, lower and upper bounds for values between which the quantile must occur. The worker nodes filter out, in a second pass, those datapoints that are not within the bounds and stream the qualifying data to the coordinator node. The coordinator node computes precise quantiles from the qualifying data.

Abstract: A question/answer creation system is described. The system includes a memory device and a processor connected to the memory device. The processor is configured to import a document having a set of questions based on content in the document, automatically create a candidate question from the content in the document, automatically generate answers for the set of questions and the candidate question using the content in the document, present the set of questions, the candidate question, and the answers to a content creator for user verification of accuracy, and store a verified set of questions in the document. The verified set of questions includes at least one verified question from the set of questions and the candidate question.

Abstract: A mechanism is provided in a data processing system comprising a processor and a memory configured to implement a question and answer system (QA), for improving answers to an input question. An input question is received and parsed for a known set of critical information required to answer the input question. Responsive to one or more pieces of critical information failing to be identifiable in the input question, a user who submitted the input question is prompted for the one or more pieces of critical information via a graphical user interface (GUI).

Abstract: Implementations are provided herein for data deduplication, and more particularly, to post-process data deduplication on a large scale out storage system. Multiple techniques and implementations are disclosed that offer greater efficiency, higher performance, and more stability when performing post-process data deduplication at large scale. Disclosed implementations are based on a process for data deduplication involving four main phases: enumeration, commonality, sharing, and update. Multi-level hashing can be used to identify candidates for deduplication during the enumeration phase, providing a more efficient use of compute resources. In addition, datasets can be phase rotated through the post-process deduplication steps providing a more controllable deduplication environment as well as a more efficient use of resources.

Abstract: A mechanism is provided for improved file synchronization of a magnetic tape. A destination device determines whether one or more file checksums exist in an extended file attribute associated with an identified file. Responsive to one or more file checksums existing in the extended file attribute associated with the identified file, the destination device reads the one or more file checksums out of the extended file attribute without accessing the magnetic tape. The destination device transmits the one or more file checksums to a source device. The source device segments the data of the new file into fixed-length blocks that do not overlap one another. The source device calculates one or more new file checksums for each of the fixed-length blocks. The source device transmits the one or more new file checksums to the destination device.

Abstract: A method for question/answer creation for a document is described. The method includes importing a document having a set of questions based on content in the document. The method also includes automatically creating a candidate question from the content in the document. The method also includes automatically generating answers for the set of questions and the candidate question using the content in the document. The method also includes presenting the set of questions, the candidate question, and the answers to a content creator for user verification of accuracy. The method also includes storing a verified set of questions in the document. The verified set of questions includes the candidate question.

Abstract: Systems, methods and computer program products for determining completion of commands in a library system and providing an indication of the completion to a component of the media library system so that other commands which are dependent upon the completion can be efficiently issued and executed. In one embodiment, a tape is mounted in a drive of the library and a filesystem mount command is issued to initiate a filesystem mount operation. Diagnostic information generated by the operating system for this operation is communicated to the media library management application. When the filesystem mount process is completed, a corresponding diagnostic message is communicated to the media library management application. Until this message is received by the media library management application, commands that are dependent upon the completion of the filesystem mount process are inhibited, and afterward these dependent commands are allowed to be issued.