Abstract: A method is used in managing deduplication of data in storage systems. A digest is determined for a data object received for deduplication. A candidate data object is identified for deduplicating the data object. A digest associated with the candidate data object matches the digest associated with the data object. The digest in a digest segment is maintained based on identification of the candidate data object. The digest segment includes a set of digests associated with a set of data blocks identified for deduplication in an ordered arrangement.

Abstract: An information output system includes a storage device and a processing device. Content information including information of video, sound, and the like is stored in the storage device in association with personal identification information and position identification information indicating a person and a geographical position related to the content information.

Abstract: Architecture for handling large data selections with small and substantially constant memory footprints. The architecture facilitates the creation of sets of data objects (e.g., rows) of a data source based on selection of the data objects. The set structures can be defined according to a range (span) of data objects selected and a pattern of the objects selected. These set structures are then saved in memory, rather than the data objects, to provide optimized memory usage. In a database implementation, the solution stores the set representation (the structure) in nearly a constant amount of memory, regardless of the number of rows in the grid, and regardless of the number of rows selected. Memory usage can be proportional to the number of discontinuous spans of rows selected by the user. Structures in memory can be consolidated, replaced, or eliminated dynamically as the user changes row selections and pattern criteria.

Abstract: A file system includes: an application programming interface (API) configured to provide a file system access to an application running on a host computer; a key value file system configured to represent a file or a directory as an inode including one or more key-value pairs; a virtual file system configured to direct a file system call received from the application to the key value file system; and a key value API configured to provide the file system access to data stored in a data storage device. Each key-value pair contained in the inode includes a name of the file or the directory as a key and an identifier of a container that is associated with the file or the directory as a value. The data of the file is stored in the data storage device as being divided into one or more data blocks of a fixed size, and each of the one or more data blocks associated with the data of the file is accessible within the key value file system using the one or more key-value pairs.

Abstract: A replica database may receive a replication instruction from a master. The replica may maintain a version of a collection of data in database pages stored on a storage device. A replication thread may process the instruction. The replication thread may determine that an item affected by the instruction is located in a page that is both loaded into a memory buffer and subject to contention. The page may be modified with information indicating that the instruction has not been processed. A subsequent reader thread may, while processing a request to access the page, apply the instruction and complete processing of the request.

Abstract: In one embodiment, a theme may be obtained. A search query may be executed to identify a plurality of search results pertaining to the theme. A plurality of topics pertaining to the theme may be identified from the search results. Search log data pertaining to the plurality of topics may be ascertained from a search log. The plurality of topics may be ranked based, at least in part, upon the search log data. At least a portion of the plurality of topics may be provided according to the ranking.

Abstract: A method includes performing, by a computing device, a clustering operation to group documents of a document corpus into clusters in a feature vector space. The document corpus includes one or more labeled documents and one or more unlabeled documents. Each of the one or more labeled documents is assigned to a corresponding class in classification data associated with the document corpus, and each of the one or more unlabeled document is not assigned to any class in the classification data. The method also includes generating, by the computing device, a prompt requesting classification of a particular document of the document corpus, where the particular document is selected based on a distance between the particular document and a labeled document of the one or more labeled documents.

Abstract: Large quantities of data can be processed and/or queried relatively quickly using a combination of continuous event processing and a Map-Reduce algorithmic tool. The continuous event processor can continuously produce real-time results by merging (a) CQL query results from events received since a currently executing Map-Reduce job was started with (b) a most recent query result produced by a most recently completed Map-Reduce job. When the currently executing Map-Reduce job completes, its query result can be stored and made accessible to the continuous event processor, and a new Map-Reduce job can be started relative to event data that has grown in size since the execution of the last Map-Reduce job. The Map-Reduce algorithmic tool provides a convenient mechanism for analyzing and processing large quantities of data.

Abstract: Various embodiments of systems and methods to provide multi-threaded data analytics. In one aspect, a master view table is generated by retrieving data records corresponding to a plurality of entities from one or more data source tables. A plurality of aspects are determined from the generated master view table. Further, a plurality of aspect relational view tables are generated by comparing the plurality of aspects with one another based on relationship factors. At least one insight of the data records are determined by analyzing the plurality of aspect relational view tables and the master view table in multi-thread.

Abstract: In certain embodiments, techniques are provided (e.g., a method, a system, non-transitory computer-readable medium storing code or instructions executable by one or more processors) to provide data visualization and management services for files stored in a cloud storage system. In some embodiments, a tenant (e.g., an end user, customer, or subscriber to a cloud storage service) can view how their data is stored across data centers within a cloud storage service. A cloud file manager can analyze the tenant's data stored in the cloud storage service, and generate a data visualization interface that provides a fine grained visual representation of the tenant's data across the cloud storage service. In some embodiments, the tenant can define storage profiles and/or modify existing data storage locations dynamically through the data visualization interface. This simplifies data management for the tenants and provides increased flexibility of managing data in the cloud storage service.

Abstract: A system to provide image processing services responsive to requests including image data includes a system layer that forwards a request to an image application processing interface. Image processing provides an image comparison, barcode recognition, and optical character recognition. The image processing compares the image data to products in a database in order to identify a matching product. The system layer receives the matching information and forwards to a user.

Abstract: A distributed data storage system includes first and second data storage systems (DSSs) at respective sites and a cloud gateway at a third. The first DSS remotely mirrors data using synchronous and asynchronous channels both employing a block-based protocol (e.g., SCSI). The second DSS is connected to the synchronous channel to provide synchronous backup to the first DSS. The cloud gateway is connected to the asynchronous channel and has a cloud storage connection to a cloud storage system, the cloud storage connection using a wide area network interface and employing an object-based protocol. The cloud gateway (1) provides asynchronous backup to the first DSS via the asynchronous channel, and (2) uses the cloud storage connection to access object-based cloud data storage to store data of the asynchronous backup. The use of the cloud gateway and cloud storage system for an asynchronous third mirror enhances reliability/resiliency in a cost-effective manner.

Abstract: In one embodiment, a change data monitoring system may gather change data from multiple data sources each with a different proprietary source format. The change data monitoring system may receive a change data report having a change data set describing changes made to an online system from a data source of a data source set tracking the online system using multiple proprietary source formats. The change data monitoring system may convert the change data set from a proprietary source format to a standardized data presentation format. The change data monitoring system may present the change data set to a user in the standardized data presentation format.

Abstract: Methods according to the present disclosure include: creating a representative profile from at least one change profile with an identifying tag from a repository, the representative profile including fewer than all possible changes to a system from an event; creating a candidate profile for a first candidate system, not flagged as similar or dissimilar, from the plurality of systems, wherein the candidate profile includes fewer than all changes to the first candidate system from the event; calculating at least one difference between the representative profile and the candidate profile; where the at least one difference is not within at least one threshold, flagging the first candidate system as dissimilar; and where the at least one difference is within the at least one threshold, flagging the first candidate system as similar, associating the identifying tag with the candidate profile, and adding the candidate profile to the repository.

Abstract: The present invention relates to a system and method for providing a content recommendation service, including: a user terminal which transmits a content recommendation request signal including a copied keyword to a service providing device when a keyword is copied in a currently displayed page, which receives contents matched with the keyword from the service providing device and displays the contents on a notification bar, and which executes the specific contents and simultaneously registers the specific contents to a board of a corresponding content-type when the execution of specific contents is requested; and the service providing device which searches a prepared content DB in order to obtain contents matched with the keyword and transmits the obtained contents to the user terminal when the content recommendation request signal is received from said terminal.

Abstract: Accordingly, software providers are quickly migrating enterprise applications to reflect this new framework. However, companies and enterprises today lack a reliable method of handling the migration and amongst the challenges they face is handling the sizing and partition of the legacy public folder hierarchy into the new public folder mailbox structure. Accordingly, it would be beneficial to provide users with a means to handle this mapping from the legacy public folder hierarchy into the new public folder mailbox structure. Further, the cloud software provider migration methodology requires downtime in the source public folders such that mail-enabled public folders are queued freezing these communications until the migration is complete. Further, if the migration process fails then it must be reattempted in full which is not feasible for most business as critical business workflows require the availability of the public folders.

Abstract: Techniques associated with restoring a file system object are described in various implementations. In one example, a method may include receiving a request to restore a file system object, the file system object being stored in backup data produced from a raw image backup of a file system. The method may also include determining whether the backup data is accessible from an on-premise storage system, and retrieving blocks of data associated with the file system object from the backup data without restoring the file system. The data blocks may be retrieved from the on-premise storage system if the backup data is accessible from the on-premise storage system, or from the off-premise storage system if the backup data is not accessible from on-premise storage system. The method may also include causing the file system object to be restored.

Abstract: Embodiments provide indexing and searching features including the use of a configurable schema as part of providing partial update support of one or more aspects of an electronic document or documents, but are not so limited. In an embodiment, a system is configured to provide search services including partial update functionality based in part on use of a configurable schema to manage partial document updates and/or query processing operations. A method of one embodiment operates to use a configurable schema to define a number of merge sets that group various document attributes based in part on data source, update, and/or usage parameters to provide an efficient partial update mechanism. Other embodiments are included.

Abstract: Systems and methods are disclosed for automatically identifying and recovering storage objects. A storage system includes a plurality of storage objects associated with storage resources in communication with the storage system, and a storage processor. The storage processor initiates a recovery process in response to a first state of the storage processor and determines a status for each of the plurality of storage objects. The storage processor identifies one or more storage objects requiring recovery based on the status of each of the storage objects and determines a first storage object to recover based on a predetermined hierarchy of storage objects. The predetermined hierarchy is based on a dependency between one or more of the storage objects. The storage processor determines a recovery operation to recover the first storage object and initiates the recovery operation on the first storage object.

Abstract: Static sorted index replication is described. A method may include receiving data to store in a memory tree of a replica in a partitioned distributed data store. The method may also include storing the received data in the respective memory tree of one of a plurality of replicas. The method may further include storing the received data sequentially in a static sorted index.