Abstract: A data storage system migrates a device between a storage array and a cloud gateway based on monitored conditions such as access frequency. More particularly, both a logical volume and the associated data are migrated. The unique device ID (e.g. and without limitation the WWN or WWID) is maintained after migration so the migration is transparent to the host application. The device is deleted from the migration source after being moved to the migration target, thereby releasing resources such as memory, storage, processor cycles and bandwidth at the migration source. A multi-path IO driver in the host computer coordinates with a tiering program in the storage array and a monitoring program in the cloud gateway to manage migration of the logical volume.

Abstract: Processing a database query for sets of data includes assigning a unique identifier from an integer space to each entity within data and creating one or more sets of entities each pertaining to a corresponding entity within the data. A representation is then generated on disk for each set of entities, wherein each representation encompasses and is suited for a range of the unique identifiers of entities within a corresponding set and indicates a presence of an entity within that corresponding set. Finally, a query is processed based on the representation for each set of entities to retrieve data satisfying the query, wherein the representation provides a constant time for association and dissociation operations that are append-only operations with deferred merge and automatic filtering of deleted and duplicate entities at query time.

Abstract: Data loss prevention (“DLP”) rules can be automatically applied to items during a migration. When a migration is performed, a migration engine may be configured with migration configuration settings which define the items to be migrated from the source system to the target system. The migration engine may also be configured with DLP configuration settings which define the type of items on which DLP should be performed. When the DLP configuration settings indicate that DLP should be applied to an item to be migrated, the migration engine routes the item to a DLP engine rather than directly migrating the item to the target system. After the DLP engine has processed the item, the DLP engine can return the processed item to the migration engine which in turn can migrate the processed item to the appropriate location in the target system.

Abstract: Embodiments of the present disclosure relate generally to semantic indexing to improve search results of a large corpus. Some embodiments, with at least one of the keywords of the search query encoded by a semantic vector in a semantic vector space, identify a plurality of candidate publications in the publication corpus, the plurality of candidate publications encoded by a cluster of a plurality of semantic vectors in the semantic vector space, the identifying based on proximity in the semantic vector space between the at least one of the keywords of the search query and keywords in the plurality of candidate publications, the proximity based on a first machine-learned model that projects the at least one keyword in the search query and the keywords in the plurality of candidate publications into the semantic vector space.

Abstract: Various embodiments of systems and methods to determine data retention rules for data entities are described herein. In one aspect, the data entities are obtained. Usage statuses of the data entities are determined. One or more purpose of data corresponding to the one or more data entities is received. Further, legal entities corresponding to the one or more data entities are identified based on line organization attributes and the usage statuses. Process object attributes associated with the one or more data entities are identified based on the legal entities. Retention rules for the one or more data entities are determined based on the one or more purpose of data, the legal entities and the process object attributes.

Abstract: Embodiments of the invention provide methods and systems for caching data. One method includes receiving, through a user device, a selection of a set of data items, and determining, with an electronic processor, a storage rate, wherein the storage rate includes an integer (N). The method also include retrieving the set of data items and storing every Nth data item included in the set of data items to a non-transitory memory cache while discarding intervening data items.

Abstract: A system comprises a plurality of computing devices that are communicatively coupled via a network and have a file system distributed among them, and comprises one or more file system request buffers residing on one or more of the plurality of computing devices. File system choking management circuitry that resides on one or more of the plurality of computing devices is operable to separately control: a first rate at which a first type of file system requests (e.g., one of data requests, data read requests, data write requests, metadata requests, metadata read requests, and metadata write requests) are fetched from the one or more buffers, and a second rate at which a second type of file system requests (e.g., another of data requests, data read requests, data write requests, metadata requests, metadata read requests, and metadata write requests) are fetched from the one or more buffers.

Abstract: Examples disclosed herein relate to a system for generating an element identifier comprising an action engine to identify at least one event listener associated with a significant event in an application, receive an action associated with an element of the application, generate a composite event sequence comprising a plurality of event listeners associated with the action, and determine whether the composite event sequence is associated with the at least one significant event. The system may further comprise a metric engine to measure a performance metric associated with the received action and create a log record according to the composite event sequence comprising the performance metric.

Abstract: Systems, methods and tools for mapping data elements between a source data structure and a target data structure without the needing exactly matching values or a dictionary of synonyms. The embodiments of the present disclosure auto map data elements having similar phonetic sounds, even in the presence of one or more misspellings or alternative spellings. Embodiments of the present disclosure utilize Soundex algorithms to generate a key corresponding to each source and target data elements. Each Soundex key may be generated based on the phonetical sounds of the source and target data elements. By using phonetical sounds to generate the key, a Soundex algorithm allows for similarly sounding words, alternatively spelled words or misspelled words to generate the same Soundex key, creating equivalence between the naming of source and target data elements once the auto mapping function is implemented.

Abstract: A method, computer program and apparatus are disclosed that include accessing client data records, such as, medical records. The method may include receiving a data file at a server sent from at least one client and including client requirements. The method may also include storing the received data file locally at the server, executing an application that scans the server to determine if any new data files have been received. The method may also include storing the copied data file in a data folder stored in a file cluster, updating a table stored in a database to indicate that a new file has been stored, deleting the locally stored file from the server, and moving files specified by the client requirements from an export folder of the file cluster to the server so that the at least one client may access the exported files.

Abstract: The disclosed computer-implemented method for applying content-based retention policies to data artifacts may include (1) identifying one or more features of a data artifact detected on a computing system, (2) identifying a collection of data artifacts that are (A) stored on at least one storage system and (B) retained in accordance with a set of retention policies, (2) determining, based at least in part on the features, that the data artifact detected on the computing system and at least one data artifact within the collection exceed a certain level of similarity relative to one another, (3) analyzing at least one retention policy of the data artifact within the collection, and then (4) providing a suggestion to apply the retention policy of the data artifact within the collection to the data artifact detected on the computing system. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: Techniques that can minimize latency during remote access between nodes in a reliable distributed computing system. A local computing device includes a protocol data unit that interacts with a substantially similar unit at a remote computing device. Each unit executes a finite state machine that is designed to minimize both the amount of wait time between messages and the number of round-trip message exchanges. The state machine resolves each request as quickly as possible to one of three states: SUCCESS, in which the transfer is successful and it is feasible to free the data transfer buffer, COMPLETE, in which the transfer is finished and a next transfer can be initiated, ABORT, in which either the sending or receiving unit declares the transfer to have failed (or aborted by a higher level element).

Abstract: It is provided a storage system, comprising: a first storage device; a second storage device higher in I/O performance than the first storage device; a data amount reducing part configured to reduce a data amount of write data from a host computer; and a controller. The controller is configured to: change the storage area that is allocated to the specified logical area to a relocation destination storage area; manage an I/O load of the data and a reduction ratio of the data requested by the write request from the host computer to be written; determine whether or not data relocation is necessary by using the load per capacity reduction unit that is based on a size of the data reduced by the data amount reduction unit; and relocate the data that is determined as needing relocation between the first storage device and the second storage device.

Abstract: Embodiments are directed to presenting virtual machine backup files for instant restore by creating a virtual volume on a local machine with files that emulate remote VM files, and setting up kernel mode interceptor hook system object and the user mode process for I/O redirection. The virtual volume created and the file extents table is passed as an input to the user mode process. The user mode process waits for events triggered by the kernel mode driver object. If the I/O is within defined file boundaries, the file is converted to relative extents and read from the remote storage node. Write requests are automatically accomplished by attaching a differencing disk created on the local machine to the last known incremental file and performing a native OS mount of that file.

Abstract: Described is a system for detecting attacks of misinformation on communication networks. Network controllability metrics on a graphical representation of a communication network are computed. Changes in the network controllability metrics are detected, and attack of misinformation on the communication network are detected based on the detected changes in the network controllability metrics.

Abstract: Methods, systems, and apparatuses are described for provisioning storage devices. An example method includes specifying a logical zone granularity for logical space associated with a disk drive. The method further includes provisioning a zone of a physical space of the disk drive based at least in part on the specified logical zone granularity. The method also includes storing compressed data in the zone in accordance with the provisioning.

Abstract: A method, a system, and a computer program product for performing next level multi-level deduplication. A first zone stamp for a first data zone is generated and compared to a second zone stamp representing a second data zone, where the zones are first level data zones. The first and second data zones are deduplicated when the first zone stamp matches the second zone stamp. A second-level first zone stamp is selected when there is no match between first and second zone stamps. The second-level first zone stamp, representing a second-level first data zone in the first data zone, is compared to the second zone stamp and/or a second-level second zone stamp representing a second-level second data zone. The second-level first zone and one of the second data zone and the second-level second zone are deduplicated when the second-level first zone stamp matches one of the second zone stamp and the second-level second zone stamp.

Abstract: A method of recommending a friend in a first terminal is provided. The method includes generating first interest keyword information by analyzing event information of the first terminal, receiving second interest keyword information of a second terminal, comparing the first interest keyword information and the second interest keyword information, and displaying information recommending a user of the second terminal as a friend based on a result of the comparing.

Abstract: A system comprises a plurality of computing devices that are communicatively coupled via a network and have a file system distributed among them, and comprises one or more file system request buffers residing on one or more of the plurality of computing devices. File system choking management circuitry that resides on one or more of the plurality of computing devices is operable to separately control: a first rate at which a first type of file system requests (e.g., one of data requests, data read requests, data write requests, metadata requests, metadata read requests, and metadata write requests) are fetched from the one or more buffers, and a second rate at which a second type of file system requests (e.g., another of data requests, data read requests, data write requests, metadata requests, metadata read requests, and metadata write requests) are fetched from the one or more buffers.

Abstract: A method and system for executing database queries in parallel using a shared metadata store. The metadata store may reside on a master node, and the master node may distribute this metadata with query plans to worker nodes. The worker nodes may request additional metadata from the master node when necessary.

Abstract: A data storage system allows a user to search a secondary copy such as a back up, archive, or snapshot and receive an abbreviated version of the secondary copy of the file system as a result of the search. The abbreviated version of the secondary copy of the file system may include metadata such as a listing of secondary copy data that correspond with a search term or other filtering criteria provided by the user. An operating system of the user's computing device may mount the abbreviated version so that it can be displayed within a view of the file system of the computing device. Once a user selects one or more desired data objects listed in the abbreviated version, the selected actual one or more data objects are retrieved from secondary storage.

Abstract: Presented herein are methods, non-transitory computer readable media, and devices for allocating resources to a particular volume and triggering a consistency point based on the amount given to each volume, thus providing dynamic consistency point triggers. Methods for providing dynamic consistency point triggers are disclosed which include: determining a volume's capacity to utilize resources based on the volume's performance; receiving an allocation of the divided resources based on total system resources available within the storage system and the volume's performance; and triggering a consistency point upon exhausting a threshold percentage of the received/allocated resources.

Abstract: A method and system is provided to improve the throughput and processing time of ediscovery by breaking batches of electronically stored information (ESI) into individual documents or related pieces of ESI, and allowing the individual documents or pieces of ESI to proceed or stream to a subsequent stage in the ediscovery process while other documents or pieces of ESI are still completing earlier stages in the process. The system provides for tracking evidence media and file processing, which includes copying, extraction of documents from container files, document meta-data extraction, text extraction, text indexing, data culling, and transmittal to document review systems, with streaming system throughput and substantially less human intervention which will substantially reduce wait time and human labor.

Abstract: Described is a system for providing variants of a digital asset based on specific device capabilities of target devices. A developer may compress a digital asset that is part of a universal application to be installed on a set of target devices by selecting from a set of intent-based compression options. The compression options may include hardware-accelerated compression formats that utilize a graphics processing unit (GPU) during rendering. Despite the compression option selected, the application package includes a variant of the digital asset renderable on each type of target device including devices without a GPU. This allows a developer to freely choose any option without the concern of whether the option is compatible or supported by each type of device. A distribution server may then map attributes of a specific target to particular feature classes, and accordingly, distribute an appropriate variant of the digital asset to the target device.

Abstract: An information processing method and device, and an apparatus used for a terminal with multiple operation systems include: according to the content of information received in the current operation system, the type of the information is determined; according to the type of the information, the operation system for processing the information is determined, and the information is processed by the operation system. The current operation system can determine the operation system for processing the information according to the content and the type of the information received by a terminal.

Abstract: A method for enforcing secure processes between a user and a device involves determining that the user has initiated installation of a secure application, installing the RA part of the secure application, triggering a trusted UI session upon realization that the TA part of the secure application is not installed, receiving, via the trusted UI session, user credentials for authenticating the user and enforcing user-specific and device-specific security, cryptographically signing combined user credentials with a cryptographic signature to obtain an authentication object, passing the authentication object to a service provider associated with the secure application for extraction of the user credentials, and generating an authorization token permitting the installation of the TA part of the secure application upon verification of the cryptographically signed authentication object.

Abstract: Techniques described and suggested herein include systems and methods for optimizing throughput characteristics for data archives stored on data storage systems using redundancy coding techniques. For example, redundancy coded shards, which may include identity shards that contain unencoded original data of archives, may be configured such that a variable number of the shards can be leveraged to meet throughput requirements or time-to-retrieval limitations for retrieval requests associated with the archives stored and/or encoded therein. Implementing systems may monitor throughput rates, capabilities, and burdens, so as to adaptively account for changes to some or all of the monitored parameters.

Abstract: Techniques described and suggested herein include systems and methods for optimizing random access characteristics for data archives stored on data storage systems using redundancy coding techniques. For example, redundancy coded shards, which may include identity shards that contain unencoded original data of archives, may be configured such that a variable number of the shards can be leveraged to meet random access requirements for retrieval requests associated with the archives stored and/or encoded therein. Implementing systems may monitor random access rates, capabilities, and burdens, so as to adaptively account for changes to some or all of the monitored parameters.

Abstract: Techniques described and suggested herein include systems and methods for improving data performance characteristics for data archives stored on data storage systems using redundancy coding techniques, without necessitating expansion of the implementing data storage system. For example, redundancy coded shards, which may include identity shards that contain unencoded original data of archives, may be configured such that a variable number of the shards can be leveraged to meet performance requirements for retrieval requests associated with the archives stored and/or encoded therein. Multiple shards may be assigned to devices in an existing infrastructure to improve performance characteristics without changing redundancy code parameters. Implementing systems may monitor random access rates, capabilities, and burdens, so as to adaptively account for changes to some or all of the monitored parameters.

Abstract: A method and a system for archiving data from a source database to a target database perform the following step: a) specifying the data being subject to the archiving operation in the source database; b) extracting the data genealogy of the specified data, thereby revealing the physical relations among tables of the specified data and/or arbitrary rules defined by an administrator in order to create a data tree of the specified data; c) executing an export/import operation of the specified data from the source database to the target database, thereby starting in a direction from the root of the data tree to the leaves of the data tree; and d) after the successful execution of the export/import operation, executing a delete operation in the source database for the specified data, thereby starting in a direction of the leaves of the data tree to the root of the data tree.

Abstract: A system and method of content storage includes a content store for storing a plurality of first content blocks and one or more first indexes, a content manager including one or more first content analyzers, and an interface for receiving access requests for the plurality of first content blocks. Each of the one or more first indexes includes a plurality of first entries for organizing a plurality of second content blocks from the plurality of first content blocks according to a respective organizational structure. Each of the first entries includes a link to a corresponding content block from the plurality of second content blocks. Each of the plurality of content analyzers monitors the plurality of first content blocks for changes and updates a second index from the one or more first indexes based on information associated with the monitored changes.

Abstract: A machine may be configured to perform A/B testing on mobile applications. For example, the machine receives an identifier of a mobile device that stores a mobile application. The machine identifies a parameter of an element of a user interface displayed by the mobile application on the mobile device. The identifying of the parameter may be based on the identifier of the mobile device. The machine selects a parameter value that corresponds to the parameter. The selecting of the parameter value may be based on the identifier of the mobile device. The machine generates an instruction referencing the parameter value. The instruction may be executable by the mobile application to display the element of the user interface on the mobile device according to the parameter value. The machine transmits the instruction to the mobile device in response to receiving the identifier of the mobile device.

Abstract: In one aspect, a method includes migrating a first device on a first array to a second device on a second storage array. The migrating includes instructing an asset to scan the first array and the second array for the first device and the second device, reading a work buffer on the second array, sending a request to the work buffer for a chunk of the first device to copy to the second device, reading assigned chunk from the first device, copying the assigned chunk to the second device and notifying the work buffer that the copying of the assigned chunk was successful.

Abstract: Activities related to data analyses are managed in part using task objects representing tasks that need to be performed. In one embodiment, a method comprises: receiving a first request to generate a task object that describes a task; responsive to the first request, generating the task object, the task object being a data structure that comprises values for task object fields that represent attributes of the task; identifying, in a repository of data objects, a particular data object to associate with the task object; determining that a first field of the task object fields corresponds to a second field of the particular data object, the second field of the particular data object having a particular value; and assigning the first field of the task object to the particular value of the corresponding second field. In another embodiment, task objects are associated with geolocation data, and mapped or otherwise presented accordingly.

Abstract: According to one embodiment of the present invention, a system for managing data within a plurality of data management architectures includes at least one processor. The system persists an entity managed by a first data management architecture to a second data management architecture. The first data management architecture manages entity data within data sources and the second data management architecture manages persisted entities within a common repository. Entity attributes are mapped between the first and second data management architectures. The system further provides one or more supplemental attributes for the persisted (e.g., registration mode or fully persisted mode) entity within the second data management architecture, wherein the supplemental attributes are unmapped between the first and second data management architectures.

Abstract: A computer-implemented method for determining the Walsh-Hadamard transform of N samples of a signal, comprises electing a plurality of hashing C matrices ?1, . . . ?C, computing C hashes of a particular length based at least on a hashing front end and the plurality of matrices ?1, . . . ?C, forming a bipartite graph with a plurality of variable nodes and a plurality of check nodes, the variable nodes being non-zero coefficients to recover, and the check nodes being hashed samples, finding an isolated check node and recovering non-zero coefficients connected to the isolated check node by employing collision detection and support estimation of the signal, peeling from the bipartite graph the recovered non-zero coefficients, and repeating the computing step, forming step, finding step and peeling step until all the nodes in the plurality of check nodes are zero.

Abstract: A method, a system, and a computer-implemented method for performing multi-level deduplication of data are disclosed. A zone stamp is generated for each zone in a plurality of zones contained in at least one data stream. The zone stamp is compared to another zone stamp. The zone stamp and another zone stamp represent zones in the plurality of zones. The comparison is performed for zones at corresponding zone levels based on a determination that a zone stamp of a zone of a preceding zone level is not similar to another zone stamp of another preceding zone level. The zone at the preceding zone level includes at least one zone of a next zone level having a size smaller than or equal to a size of the zone of the preceding zone level. The zone and another zone are deduplicated based on a determination that the zone stamp is similar to another zone stamp.

Abstract: A system and method by which mail sorting equipment can correct postal addresses utilizing cloud technology. The real-time address correction system for correcting addresses of mail articles in real-time, comprises sorters, vision systems, controllers, processors, printers, local and remote computers, databases, bins, and a cloud system to tie together the local and remote computers in addition to the sorters and controllers. Corrected postal addresses are stored remotely and locally to the sorter and provided to the sorter as needed by a cloud based system. The system and method accommodates delays in providing the corrected postal addresses to the sorter.

Abstract: An approach is provided for managing data being transmitted from a mobile device. The mobile device receives a request from a user to initiate a transmission of data. The mobile device determines whether the data includes person or business-related sensitive information based on a format of the data, and if so, the mobile device determines a country in which the mobile device is currently located, determines a privacy policy of the country in which the mobile device is currently located, and determines whether the privacy policy applies to a type of the data corresponding to the format of the data; and if so, the mobile device notifies the user of the privacy policy of the country, identifies to the user the type of the data for which the privacy policy applies, and queries the user whether to transmit the data as requested by the user.

Abstract: A storage module and host device for storage module defragmentation are disclosed. In one embodiment, a host controller sends a storage module a first set of logical block addresses of a file stored in the storage module. The host controller receives a metric from the storage module indicative of a fragmentation level of the file in physical blocks of memory in the storage module. If the metric is greater than a threshold, the host controller reads the file and then writes it back to the storage module using a different set of logical block addresses. To avoid sending the file back and forth, in another embodiment, the host controller sends the fragmentation threshold and the different set of logical block addresses to the storage module. The storage module then moves the file itself if the metric indicative of the fragmentation level is greater than the threshold. Other embodiments are provided.

Abstract: Embodiments of the invention relate to sketching for M-estimators for performing regression. One embodiment includes providing one or more sets of input data. A matrix A and a vector b are generated using the input data. A processor device is used for processing the matrix A and the vector b based on a randomized sketching matrix S. A vector x that minimizes a normalized measure function is determined based on the matrix A and the vector b. A relationship between the input data is determined based on the vector x.

Abstract: Archiving may be integrated into an organization's existing data management systems instead of being configured as a separate system. This integration may occur by adding an archiving table to an existing database of the organization containing data that is to be archived. The archiving table may include multiple records, each record storing a binary large object representing a complete, self-contained archive of the organization's data at a preselected time. Incorporating archiving and archived data into the organization's existing data management systems in this manner may eliminate the need for a dedicated archiving system and may eliminate synchronization and interconnectivity issues with an independent archiving system.

Abstract: A cluster file system comprises a metadata server coupled to a plurality of object storage servers via a network. The metadata server comprises a controller configured to implement storage tiering control functionality for at least first and second storage tiers comprising respective disjoint subsets of the plurality of object storage servers. The metadata server is thereby configured to control movement of data between the first and second storage tiers. The object storage servers in the first storage tier may be configured to interface with object storage targets of a first type and the object storage servers in the second storage tier may be configured to interface with object storage targets of a second type different than the first type. For example, the object storage targets of the first type may comprise non-volatile electronic storage devices such as flash storage devices, and the object storage targets of the second type may comprise disk storage devices.

Abstract: A modular block allocator receives a cleaner message requesting dirty buffers associated with an inode be cleaned. The modular block allocator provides at least one bucket cache comprising a plurality of buckets, wherein each bucket represents a plurality of free data blocks. The dirty buffers are cleaned by allocating the data blocks of one of the buckets to the dirty buffers. The allocated data blocks are mapped to a stripe set and when the stripe set is full, the stripe set is sent to a storage system. In one embodiment of the invention, a modular block allocator includes a front end module and a back end module communicating with each other via an application programming interface (API). The front end module contains write allocation policies that define how blocks are laid out on disk. The back end module creates data structures for execution of the policies.

Abstract: A computer program product for low power storage array with metadata access includes sequentially writing data to a currently active disk drive in a storage array and storing metadata relating to the writes in a preallocated portion of the currently active disk drive, determining when the currently active disk drive is nearing full capacity, activating a next disk drive and cloning the stored metadata from the preallocated portion of the currently active disk drive to a preallocated portion of the next disk drive. When the currently active disk drive is full, sequentially writing data to the next disk drive.

Abstract: Systems and methods are provided herein for establishing data constructs necessary for efficient and transparent tiering of data from local storage to cloud storage, and there use in transferring data to and from cloud storage. Files data can split into chunks and stored as individual objects in cloud storage. A stub file can replace the local file in local storage and describe a mapping of cloud objects that contain data to specific regions of the file. Upon creation of the stub and transfer of data to cloud storage, local storage capacity previously dedicated to file data can be freed for other uses.

Abstract: A method to preferentially wait for fresh data from a primary source to become available in a system where there is also an older set of data from a secondary source. The method includes receiving a data request that is to be displayed and determining if the data from the primary source is available. If the primary source is not available, a dynamic threshold value is tested to detect if a wait time for access to the primary source is exceeded. If the wait time for access to the primary source is exceeded, then older data from the secondary source instead of the primary source is acquired. The dynamic threshold includes an elapsed time since receipt of the request as measured from a receipt time of a prior request.

Abstract: The present invention enables capturing API level calls using a combination of dynamic instrumentation and library overriding. The invention allows event level tracing of API function calls and returns, and is able to generate an execution trace. The instrumentation is lightweight and relies on dynamic library/shared library linking mechanisms in most operating systems. Hence we need no source code modification or binary injection. The tool can be used to capture parameter values, and return values, which can be used to correlate traces across API function calls to generate transaction flow logic.

Abstract: The technology disclosed can query configuration management system data and includes cross table selection criteria and joined data return.

Abstract: A data sharing method and a portable terminal are provided. The portable terminal is a first terminal having a first system and a second system which have a capability of operating a shared storage area. The method comprises: starting transmitting a file in the shared storage area to a second terminal by the first system; acquiring upload information of the file by the second system, when detecting that the first system fulfills a predetermined condition, during the transmission of the file in the shared storage area to the second terminal by the first system; and continuing the transmission of the file to the second terminal by the second system in accordance with the upload information.