Abstract: Examples may include container index persistent item tags. Examples may store chunk signatures in at least one container index and, for each chunk signature, store at least one persistent item tag identifying a respective backup item that references or formerly referenced the chunk signature. Examples may determine that all chunks formerly referenced by a backup item have been erased based on the persistent item tags in the at least one container index and output an indication that the backup item has been erased.

Abstract: Methods, systems, and computer-readable media for generating a statistically covaried machine learning model for performance measurement of service providers. The method receives a configuration file that includes one or more parameters associated with a plurality of individuals and parses it to generate and executing the database query on input data to generate sets of tabulated data of individuals of the plurality of individuals. The method next determines one or more measures of service providers listed in the configuration file using two or more tabulated data of individuals from the sets of tabulated data of individuals. The method finally generates a covaried machine learning model by training a machine learning model by statistically covarying measures and using them as training data.

Abstract: Updates to a hierarchical data structure may be selectively replicated to other replicas of the hierarchical data structure. An update for a hierarchical data structure may be received and committed to the hierarchical data structure. A determination as to whether any other replicas of the hierarchical data structure have permission to receive the update may be made. For those replicas of the hierarchical data structure with permission to receive the update, the update may be provided to the replicas and committed to the replicas. Different types of replication techniques may be implemented, such as pull-based replication techniques or push-based replication techniques. Replication permissions for objects of the hierarchical data structure may be individually defined, in some embodiments.

Abstract: Data deduplication techniques may use a fingerprint hash table and a backend location hash table in connection with performing operations including fingerprint insertion, fingerprint deletion and fingerprint lookup. Processing I/O operations may include: receiving a write operation that writes data to a target logical address; determining a fingerprint for the data; querying the fingerprint hash table using the fingerprint to determine a matching entry of the fingerprint hash table for the fingerprint; and responsive to determining that the fingerprint hash table does not have the matching entry that matches the fingerprint, performing processing including: inserting a first entry in the fingerprint hash table, wherein the first entry includes the fingerprint for the data and identifies a storage location at which the data is stored; and inserting a second entry in a backend location hash table, wherein the second entry references the first entry.

Abstract: Aspects of the disclosure relate to controlling access to secure information resources using rotational datasets and dynamically configurable data containers. A computing platform may receive, from a first enterprise user computing device, a first data transfer request comprising information scheduling a first data transfer operation. Based on receiving the first data transfer request, the computing platform may retrieve first information from a first data track computing platform. Subsequently, the computing platform may configure a second data track computing platform to receive the first information. After configuring the second data track computing platform, the computing platform may send, to the second data track computing platform, the first information. In addition, sending the first information to the second data track computing platform may cause the second data track computing platform to store the first information retrieved from the first data track computing platform.

Abstract: Techniques are disclosed which allow a secondary storage system to provide data to non-production workloads in conjunction with performing data backup and protection tasks. As disclosed, a secondary storage system exposes backup data stored by the secondary storage system to other workloads, such as test and development applications, data analytics, etc. These non-production workloads can run at the same time the secondary storage system provides backup services to a primary storage system. This consolidation eliminates the need for an enterprise to deploy separate storage clusters for analytics, test and development applications, etc. and eliminates unnecessary copies of data.

Abstract: A method and system for detecting ransomware and repairing data following an attack. The method includes, collecting file statistics for files in a file system, identifying an affected file based on collected file statistics, locking down of access to the file system in response to identifying the affected file, undoing of reconcile processing, repairing the affected files, and unlocking access to the file system. The system includes a computer node, a file system, a plurality of disc storage components, a backup client, a backup client, and a hierarchical storage client. The hierarchical storage client is configured to collect file statistics for files in file system, identify affected files based on collected file statistics for the file, lock down of access to the file system in response to an identified affected file, undo reconcile processing, repair the affected file; and unlock access to the file system.

Abstract: A method for performing multi-caching on data sources of a same type and different types by using a cluster-based processing system is provided. The method includes steps of: a big data cluster management device (a) determining whether a result set, corresponding to a query result, is present as first cache data in master or worker nodes, (b) if specific part of the result set is absent, (i) establishing an execution plan (ii) acquiring a first subset in the master or the worker nodes, (iii) acquiring a second subset in none of the master and the worker nodes, and (iv) applying joint operation thereto, and (c) applying data processing operation and output operation thereto thus acquiring the result set as the query result.

Abstract: A method of searching data being directed into a data heap looks for a predetermined element and then tags the data per the found element. The tags are applied by data heap tagging applications or “HeapTagApps” (HTAs), which are small, quickly executing software applications that are each focused on the tagging of data that includes a particular element in order to make the identification process rapid. Multiple HTAs in one or both of horizontal and vertical configurations may be constructed in order to provide any necessary level of speed or take full advantage of an available hardware configuration.

Abstract: At least one analytical agent extracts a plurality of attributes from each of a plurality of member input vectors. Each member input vector includes raw data characterizing contextual aspects about an associated and different user. Thereafter, a content search vector is generated for each user by the at least one analytical agent that includes the attributes extracted from the member input vector associated with such user and weights corresponding to each attribute that are particular to such user. A search engine, accessing a content library, then matches each content search vector with one of a plurality of content workflows based on both the attributes and weights within such content search vector. A context engine then initiates execution of each matching content workflow which results in tailored messages specified by the matching content workflow being sent to the user associated with the matching content workflow.

Abstract: Data deduplication techniques may use a fingerprint hash table and a backend location hash table in connection with performing operations including fingerprint insertion, fingerprint deletion and fingerprint lookup. Processing I/O operations may include: receiving a write operation that writes data to a target logical address; determining a fingerprint for the data; querying the fingerprint hash table using the fingerprint to determine a matching entry of the fingerprint hash table for the fingerprint; and responsive to determining that the fingerprint hash table does not have the matching entry that matches the fingerprint, performing processing including: inserting a first entry in the fingerprint hash table, wherein the first entry includes the fingerprint for the data and identifies a storage location at which the data is stored; and inserting a second entry in a backend location hash table, wherein the second entry references the first entry.

Abstract: An improved content indexing (CI) system is disclosed herein. For example, the improved CI system may include a distributed architecture of client computing devices, media agents, a single backup and CI database, and a pool of servers. After a file backup occurs, the backup and CI database may include file metadata indices and other information associated with backed up files. Servers in the pool of servers may, in parallel, query the backup and CI database for a list of files assigned to the respective server that have not been content indexed. The servers may then request a media agent to restore the assigned files from secondary storage and provide the restored files to the servers. The servers may then content index the received restored files. Once the content indexing is complete, the servers can send the content index information to the backup and CI database for storage.

Abstract: Updates to a hierarchical data structure may be selectively replicated to other replicas of the hierarchical data structure. An update for a hierarchical data structure may be received and committed to the hierarchical data structure. A determination as to whether any other replicas of the hierarchical data structure have permission to receive the update may be made. For those replicas of the hierarchical data structure with permission to receive the update, the update may be provided to the replicas and committed to the replicas. Different types of replication techniques may be implemented, such as pull-based replication techniques or push-based replication techniques. Replication permissions for objects of the hierarchical data structure may be individually defined, in some embodiments.

Abstract: Embodiments include a computer-implemented method including identifying, by a primary computer device, a plurality of records, each record having one or more attributes; standardizing, by the primary computer device, each of the plurality of records; assigning, by the primary computer device, an index to one or more of the one or more attributes; providing, by the primary computer device, instructions for clustering the standardized plurality of records in parallel into one or more clusters, each cluster including records having the same index, the one or more clusters being in a group; receiving, by the primary computer device, one or more groups, each group including one or more clusters sharing a same index; and linking one or more of the plurality of records in a cluster with another one or more of the plurality of records in another cluster within a same group.

Abstract: A computer-implemented method is provided for managing and sharing picture files. In one embodiment of the present invention, the method comprises providing a server platform and providing a datastore on the server platform for maintaining full resolution copies of the files shared between a plurality of sharing clients. A synchronization engine is provided on the server platform and is configured to send real-time updates to a plurality of sharing clients when at least one of the sharing clients updates or changes one of said files. A web interface may also be provided that allows a user to access files in the datastore through the use of a web browser.

Abstract: A system and method for generating activity summaries for users. User activity information is received by a user activity information receiver module. Once enough data is received and processed, the data is analyzes and segmented to determine and create an activity summary or story. Content is selected. The selection of the content includes selection of content items, such as multimedia items, e.g. pictures and videos. Secondary information, such as user activity information or location information is analyzed. A story is generated based on the selected content, including the selected content. The story is represented by a display of the selected media and other information associated with the media.

Abstract: An improved content indexing (CI) system is disclosed herein. For example, the improved CI system may include a distributed architecture of client computing devices, media agents, a single backup and CI database, and a pool of servers. After a file backup occurs, the backup and CI database may include file metadata indices and other information associated with backed up files. Servers in the pool of servers may, in parallel, query the backup and CI database for a list of files assigned to the respective server that have not been content indexed. The servers may then request a media agent to restore the assigned files from secondary storage and provide the restored files to the servers. The servers may then content index the received restored files. Once the content indexing is complete, the servers can send the content index information to the backup and CI database for storage.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, are described for resolving duplicate images. In one aspect, a method includes obtaining a selection of a single image from among a plurality of duplicate images. Each duplicate image has an associated set of metadata. The method also includes aggregating each set of metadata into aggregated information, and storing the selected image together with the aggregated information on data storage accessible to a data processing apparatus.

Abstract: A method for soliciting and creating collaborative content items is disclosed. The method includes receiving, by a user device of a first user, a request to contribute a content item for a personalized message to a second user, the personalized message for an event unique to the second user, wherein the first user is selected to receive the request to contribute the content item based on an affinity score between the first user and the second user, presenting the request to contribute the content item, receiving input from the first user identifying the content item to contribute for the personalized message to the second user, and causing the content item to be added to a collaborative content product generated for the second user, the collaborative content product comprising other content items of other users of the social network.

Abstract: A data storage management system incorporates image recognition and classification features. The illustrative system generates thumbnail images to represent images detected in secondary copies. Subsequent image recognition and classification operations are based on the thumbnail images without need to access the secondary copies from which the thumbnails were derived. The system indexes thumbnail images and respective relationships to each other and to the source secondary copies. Metadata from the source secondary copies is extracted and preserved with the thumbnails. Thumbnail images, metadata, and related index data (collectively “thumbnail data”) are stored locally in an illustrative content index server, or in an enhanced storage manager, thus improving performance without interfering with ongoing storage management operations. Features are disclosed for searching within the system and performing storage management operations based on image criteria. Access to/from other systems is also possible, e.g.

Abstract: An improved content indexing (CI) system is disclosed herein. For example, the improved CI system may include a distributed architecture of client computing devices, media agents, a single backup and CI database, and a pool of servers. After a file backup occurs, the backup and CI database may include file metadata indices and other information associated with backed up files. Servers in the pool of servers may, in parallel, query the backup and CI database for a list of files assigned to the respective server that have not been content indexed. The servers may then request a media agent to restore the assigned files from secondary storage and provide the restored files to the servers. The servers may then content index the received restored files. Once the content indexing is complete, the servers can send the content index information to the backup and CI database for storage.

Abstract: An improved content indexing (CI) system is disclosed herein. For example, the improved CI system may include a distributed architecture of client computing devices, media agents, a single backup and CI database, and a pool of servers. After a file backup occurs, the backup and CI database may include file metadata indices and other information associated with backed up files. Servers in the pool of servers may, in parallel, query the backup and CI database for a list of files assigned to the respective server that have not been content indexed. The servers may then request a media agent to restore the assigned files from secondary storage and provide the restored files to the servers. The servers may then content index the received restored files. Once the content indexing is complete, the servers can send the content index information to the backup and CI database for storage.

Abstract: A system and method supports key management in a distributed computing environment such as a distributed data grid. A binary radix tree is used to intern a plurality of binary keys. The binary radix tree is serialized to a byte buffer and a view of the binary is created. A byte sequence interface to the nodes of the serialized binary radix tree allows use of references which refer to positions in the serialized binary radix tree instead of requiring byte array copes of the interned keys. Use of references into the byte array in place of a byte array copies of interned keys reduces the memory overhead associated with referrers such as reverse indices which make reference to values associated with the plurality of binary keys. The reduction in memory overhead enhances performance and capabilities of a distributed computing environment such as a distributed data grid.

Abstract: Embodiments of an event based search system utilizing an event based search index are disclosed. These events may be associated with user interaction with content such that the search index is reflective of content with which users have interacted. The event based search index can be constructed utilizing agents distributed across users' devices within an enterprise. An agent on a user's device may be configured to monitor user interactions with content across a variety of resources and generate events based on these interactions. These events are provided to the search system to create the search index. The search results returned by these search systems are based on these events and thus are also reflective of user interactions with the content. Moreover, as different events may be created for multiple users' interactions with content, the events may be reflective of the importance of content within an enterprise.

Abstract: In one embodiment, a method includes A method comprising, by one or more computing devices of an online social network, receiving, from a client system of a first user of the online social network, a post that is parsed to identify a query, identifying one or more topics and one or more query-domains matching the query, searching an answers-index to identify one or more query-answer sets responsive to the query and matching at least one of the identified topics and at least one of the identified domains, searching, for each entity identified in each query-answer set, a posts-index to identify one or more comments corresponding to the identified entity, calculating a score for each comment based on social signals associated with the comment, and sending, to the client system of the first user, a suggested-answers page including references to each comment having a score greater than a threshold score.

Abstract: Apparatuses, systems, methods, and computer program products are disclosed for dynamically resizing logical storage blocks. A controller for a non-volatile storage device includes a block component that determines a total number of available erase blocks of the non-volatile storage device. A controller for a non-volatile storage device includes a size module that determines numbers of erase blocks from available erase blocks to include in each of a plurality of logical blocks as a function of a total number of available erase blocks such that the numbers of erase blocks for each of the logical blocks deviates from each other by less than a predetermined deviation limit. A controller for a non-volatile storage device includes a map module that generates logical blocks for the non-volatile storage device by assigning determined numbers of erase blocks to each of the logical blocks.

Abstract: Described herein is a computer implemented method for identifying one or more classifications for a particular ticket maintained by an issue tracking system. The method comprises: receiving data in respect of the particular ticket; retrieving cluster data in respect of a set of clusters; calculating cluster membership data in respect of the particular ticket; and identifying, based on the cluster membership data, one or more specific clusters from the set of clusters. For each specific cluster a classification associated with the specific cluster is identified and returned.

Abstract: A method for displaying a screen on an electronic device is provided. The method includes displaying, on a display of the electronic device, a first screen configured with a plurality of areas in which a plurality of contents are respectively displayed in a plurality of rows, and displaying, if an area is selected from among the plurality of areas, a second screen configured with one or more recommended item areas in which information related to content corresponding to the selected area is arranged.

Abstract: At least one analytical agent extracts a plurality of attributes from each of a plurality of member input vectors. Each member input vector includes raw data characterizing contextual aspects about an associated and different user. Thereafter, a content search vector is generated for each user by the at least one analytical agent that includes the attributes extracted from the member input vector associated with such user and weights corresponding to each attribute that are particular to such user. A search engine, accessing a content library, then matches each content search vector with one of a plurality of content workflows based on both the attributes and weights within such content search vector. A context engine then initiates execution of each matching content workflow which results in tailored messages specified by the matching content workflow being sent to the user associated with the matching content workflow.

Abstract: Embodiments are described for improved management of backed up data from a client device to a storage device. The storage device may be coupled to a backup server across a network. A backup of data from an application on a client device to a storage device may fail while the backup is in progress. Systems and methods described herein can detect and remove incomplete backups. Systems and methods described herein can also scan for, and delete, save sets of a backups within a specified time interval. Systems and methods described herein can update metadata that describes existing backup data so that existing backups may be used with an updated or changed application software.

Abstract: The present disclosure relates to a method, a device and a storage medium for providing data statistics in a computer. The method may include: obtaining a data collection from a server, wherein the data collection comprises a plurality of records, and each of the records comprise a target data field; obtaining an index number of each target data field according to the records respectively; obtaining a bitmap comprising a plurality of bitmap units, each bitmap unit having a unique index number; searching and locating a bitmap unit in the bitmap, and writing a predetermined data into the located bitmap unit, wherein the unique index number of the located bitmap unit corresponds to the index number of each target data field; and determining the bitmap unit having a same data with the predetermined data by traversing the bitmap, and counting a total number of the determined bitmap units.

Abstract: A method for distributing indexing of objects for an enterprise, comprising providing by a computer to an indexing server of an enterprise index entries respective to at least one object of the computer that was indexed in the computer, thereby updating an index of the indexing server of the enterprise with respect to the at least one object of the computer, and an apparatus for performing the same.

Abstract: Systems and methods for retaining data are disclosed in which refresh copy operations are performed on data stored in non-volatile solid-state memory. A controller may be configured to maintain a list of physical memory locations, the list sorted by a least recently used criterion. The controller may select a first entry from a top of the list and perform a refresh operation to copy data stored in a current physical memory location associated with the first entry to a new physical memory location, and may remove the first entry from the top of the list and add a new entry associated with the new physical memory location to a bottom of the list. The controller may repeat the select, perform, remove and add steps for a plurality of entries in the list, and the steps may be timed such that all refresh operations are performed for all of the plurality of entries within a set period of time.

Abstract: Systems and methods of managing computing resources of a computing system are described. A computing resource list and computing resource information may be stored at a data store. The computing resource list may identify a set of computing resources of a computing system, and the computing resource information may respectively describe the computing resources. The computing resource list may be updated in response to a new computing resource being added to the computing system or in response to an existing computing resource being removed from the computing system. Evaluation tasks for the computing resources may be performed, and a resource evaluation report may be generated during performance of at least one of the evaluation task.

Abstract: A system and method for data replication is described. A destination storage system receives a message from a source storage system as part of a replication process. The message includes an identity of a first file, information about where the first file is stored in the source storage system, a name of a first data being used by the first file and stored at a first location of the source storage system, and a fingerprint of the first data. The destination storage system determines that a mapping database is unavailable or inaccurate, and accesses a fingerprint database using the fingerprint of the first data received with the message to determine whether data stored in the destination storage system has a fingerprint identical to the fingerprint of the first data.

Abstract: A mechanism is provided in a data processing system for on-demand caching in a wide area network (WAN) separated distributed file system or clustered file system. The mechanism monitors file access by a plurality of cache sites in the WAN separated distributed file system or clustered file system. The mechanism identifies access patterns by cache sites. The mechanism shares the access patterns with the plurality of cache sites. A given cache site within the plurality of cache sites combines the access patterns with local access information and identifies files to pre-fetch based on the combined information.

Abstract: The present disclosure provides various systems and methods for indexing digital (electronic) documents and providing various error reporting and identification functions. The systems and methods may utilize various software, hardware, and firmware modules to identify notations, such as primary sheet names and reference sheet names on construction documents. Various algorithms and methods may be employed to identify errors, erroneous notations, missing sheets, missing details, and/or the like to aid in the correction of construction documents. Identified notations are indexed and may be used to create hyperlinked and/or backlinked notations in output files.

Abstract: A selective tuple versioning is used on a files system for preserving past states of file system nodes by adding a bitmap to a row for a node within a file system table for preserving the past state of the node in a file system, receiving a request for updating the node along with a node identification (ID) and associated attributes of the node needing to be updated, generating a second time value indicating the time of the updating, and duplicating the row for the node into a new row in the file system table with an end time set equal to the second time value if the bit in the bitmap for the node is set.

Abstract: User engagement in unwatched videos is predicted by collecting and aggregating data describing user engagement with watched videos. The data are normalized to reduce the influence of factors other than the content of the videos on user engagement. Engagement metrics are calculated for segments of watched videos that indicate user engagement with each segment relative to overall user engagement with the watched videos. Features of the watched videos within time windows are characterized, and a function is learned that relates the features of the videos within the time windows to the engagement metrics for the time windows. The features of a time window of an unwatched video are characterized, and the learned function is applied to the features to predict user engagement to the time window of the unwatched video. The unwatched video can be enhanced based on the predicted user engagement.

Abstract: Described is a technology by which a user is able to determine the content of a storage device, including when the storage device is non-operational. A user may use a device and/or program to provide a wirelessly-read identifier to query a repository that maintains cataloged data for the user's storage device. The query to the repository returns the cataloged data for that storage device in response, which is output to the user and the user knows the storage device's contents. Alternatively, the user may obtain a list of storage devices from the repository, and select one to view its cataloged data. When the storage device is operational, the persistent repository is updated with any changes to keep the cataloged data synchronized with the stored content.

Abstract: Method of retrieving event information is presented. Memento objects can be recognized by an archive engine. Based on the recognition, the archive engine obtains information related to the memento object, possibly one or more recognizable features, and uses the information to search for events associated with a timeline that have corresponding tags. The archive engine can then return the event information as a result set to a user.

Abstract: A monitoring server receives the latest monitored data and corresponding monitoring time from monitoring devices connected to the server at a specified time interval. The monitoring server records monitored data of each monitoring item and the corresponding monitoring time to a pointed node of a device data list, and adds the monitored data and the corresponding monitoring time, which are recorded in the pointed node of the device data list, into a monitored data list. When a web server requests real-time monitored data, corresponding monitored data is read from the device data list and sent to the web server. When the web server requests historical monitored data of an designated period, corresponding monitored data of the designated period is read from the monitored data list and sent to the web server.

Abstract: A computerized method for sharing removable storage media in a network, the method comprising associating, in an index entry, a first piece of removable storage media in a first storage device with at least a first storage policy copy and a second storage policy copy; copying, to the first piece of removable storage media, data associated with the first storage policy copy; and copying, to the first piece of removable storage media, data associated with the second storage policy copy.

Abstract: Techniques are described for managing data storage and retrieval, such as by generating a hash value for a beginning and/or ending portion of a new data group to be stored, attempting to match each generated hash value to a plurality of hash values associated with other existing data groups that are already stored, and comparing the new data group and an identified existing data group to determine any identical extended initial or final portion of the two data groups. The new data group may then be stored as the portion unique to the new data group, along with a reference to the existing identical extended portion of the existing data group. The new stored data group may be later retrieved using the unique portion of the data group, along with the existing extended portions corresponding to other stored data groups for any stored references.

Abstract: In one embodiment, a method determines data stored in a plurality of tables in a first database for archiving. The data is combined from the plurality of tables into a set of objects in a readable format where an object in the set of objects includes terms from the plurality of tables associated with the object. The method then stores the set of objects in the text format in a second database where a search query processor is able to search terms in the set of objects in the readable format. Then, the data stored in the plurality of tables in the first database is deleted in response to the archiving.

Abstract: Certain example embodiments of this invention relate to system and/or methods that pair a data extractor with a data accumulator, wherein these components may be located on any one or more computers in a network system. This distributed peer extract-accumulate approach is advantageous in that it reduces (and sometimes completely eliminates) the need for a “funnel” approach to data archiving, wherein all data is moved or backed up through a central computer or central computer system. In certain example embodiments, recall-accumulate, search, verify, and/or other archive-related activities may be performed in a similar peer-based and/or distributed manner. Certain example embodiments may in addition or in the alternative incorporate techniques for verifying the integrity of data in an archive system, and/or techniques for restoring/importing data from a non-consumable form.

Abstract: A system for managing documents, comprising: interfaces to a user interface, proving an application programming interface, a database of document images, a remote server, configured to communicate a text representation of the document from the optical character recognition engine to the report server, and to receive from the remote server a classification of the document; and logic configured to receive commands from the user interface, and to apply the classifications received from the remote server to the document images through the interface to the database. A corresponding method is also provided.

Abstract: A method of managing backup data. The method includes accessing, via a backup manager, index data of an initial snapshot and accessing, via the backup manager, index data of a subsequent snapshot. The method further includes determining, via the backup manager, whether the index data of the subsequent snapshot is different from the index data of the initial snapshot. Responsive to a determination that the index data of the subsequent snapshot is different from the index data of the initial snapshot, creating an updated index data and creating an updated snapshot with the updated index data.

Abstract: A storage system according to certain embodiments includes a client-side repository (CSR). The CSR may communicate with a client at a higher data transfer rate than the rate used for communication between the client and secondary storage. During copy operations, for instance, some or all of the data being backed up or otherwise copied to secondary storage is stored in the CSR. During restore operations, copies of the data stored in the CSR is accessed from the CSR instead of from secondary storage, improving performance. Remaining data blocks not stored in the CSR can be restored from secondary storage.

Abstract: A method of controlling access to a database includes autonomously archiving data within a database from a first storage device into a second storage device, according to an archive condition; the archive condition being input in conjunction with the data and being associated with the data; accepting an input of an access command to the database; determining whether data to be accessed in response to the access command input has already been archived in the second storage device based on the access command and the archive condition; and accessing data included in the database or data archived in the second storage device according to the access command based on the determination.