Abstract: A system and method for creating shortcuts within a database for archived items. A client computer sends a retrieval request for a given item to a web server. The given item may be an electronic document. A custom HTTPModule within the web server intercepts the request. The HTTPModule uses a uniform resource locator (URL) provided in the request to locate a record associated with the given item. If a given fixed string value is read from the record in place of the original content data, then the web server requests original content data for the given item from an archive store. The record still maintains identification information, such as a document identifier and the URL in order to maintain links and workflows. The retrieval request is not rerouted to an alternate path, and the client computer receives the original content data, rather than an indication of a shortcut.

Abstract: A mechanism is provided for reorganizing a source index tree of a database table resulting in a target index tree of the database table is provided. A backup process reads source leaf pages of the source index tree in a logical order defined by a sequence of index keys. The logical order can be different from a physical order of the source leaf pages defined by a sequence of respective storage locations. The backup process constructs target leaf pages of the target index tree maintaining the logical order. A restore process constructs target non-leaf pages of the target index tree based on the distribution of the index keys among the constructed leaf pages and stores the target leaf and non-leaf pages.

Abstract: The disclosed embodiments disclose techniques for executing a cloud command for a distributed filesystem. Two or more cloud controllers collectively manage distributed filesystem data that is stored in one or more cloud storage systems; the cloud controllers ensure data consistency for the stored data, and each cloud controller caches portions of the distributed filesystem. During operation, a cloud controller presents a distributed-filesystem-specific capability to a client system as a file in the distributed filesystem (e.g., using a file abstraction). Upon receiving a request from the client system to access and/or operate upon this file, the client controller executes an associated cloud command. More specifically, the cloud controller initiates a specially-defined operation that accesses additional functionality for the distributed filesystem that exceeds the scope of individual reads and writes to a typical data file.

Abstract: A database system comprising a plurality of access keys stored in a first data memory device sector, each access key associated with a node value stored in a second data memory device sector. An access key processor configured to receive an input value and return the associated node value for the input value if the input value matches an access key stored in the first data memory device sector. The access key processor is configured to generate a revised input value if the input value does not match an access key stored in the first data memory device; a default node value stored in the second data memory device sector and associated with a portion of the input value, wherein the access key processor is configured to return the default node value as part of the revised input value.

Abstract: A computer program product comprises a computer useable medium. The computer useable medium has a computer readable program such that when the computer readable medium is executed on a computer, the computer is caused to provide a data interface between an adapter component and one or more application interface components for a runtime application. Further, the computer is caused to establish a cursor that iterates over a plurality of data objects within a data set of the runtime application. In addition, the computer is caused to establish an accessor that provides access to a data element of the data object. The computer is also caused to provide the cursor and the accessor to the adapter component so that the adapter component accesses data through the one or more application interface components of the runtime application.

Abstract: A server receives from a user's computer a request to store a file and a file hash value. The server determines whether a file with the same hash value is stored on the server. If so, the server grants access to the server's file copy. If not, the server requests the user to upload the file and stores it. The server grants access to the copy by sending the user a pointer to the copy's storage location and associating the user with the pointer in a database. The server can challenge the user's right to access the copy by requesting a file password or a portion of the file stored on the user's computer. The server can limit access to the server's copy to users who successfully respond to the challenge.

Abstract: A method for storing electronic data in a network including a server and at least two client machines. Electronic data may be archived in a predetermined location of a client machine. A local archiving list may be generated on the client machine and may include descriptive properties of the electronic data, as well as the predetermined location. The local archiving list may be transmitted from the client machine to the server to generate a global archiving list, which may then be transmitted to any other client machines in communication with the server. In this manner, each client machine in the network may store the location and descriptive properties of the archived electronic data to facilitate electronic data recovery.

Abstract: Disclosed herein are techniques for archiving data objects. It is determined whether a data object was rejected by an archiving module due to an information field thereof violating a protocol. If it is determined that the data object was rejected due to violation of the protocol, a compliant information field that complies with the protocol is generated such that the compliant information field causes the archiving module to permit archiving of the data object violating the protocol.

Abstract: Calendar repair using a standard message may be provided. Calendar events, such as appointments and meetings, may be created and copied to a plurality of attendee calendars. A first copy of the event may be compared to a second copy of the event to determine whether properties between the events are out-of-sync. If so, a standard meeting request message comprising the correct value may be sent to update the out-of-sync property.

Abstract: A method, article of manufacture, and apparatus for managing a cloud computing environment. In some embodiments, this includes modifying an object or a component of an object at runtime and storing the modified object or modified component of an object in a storage device. In some embodiments, components of an object such as data structures are modified. In some embodiments, objects may have more than one version.

Abstract: The invention relates generally to archiving data items in an information store. More particularly, the invention provides a computerized method for identifying, in a first information store, a first data item satisfying retention criteria; copying the first data item to a second information store; creating, in the first information store, a second data item containing a subset of the data of the first data item selected based on the data type of the first data item; and replacing the first data item, in the first information store, with the second data item.

Abstract: Systems and methods are disclosed for performing data storage operations, including content-indexing, containerized deduplication, and policy-driven storage, within a cloud environment. The systems support a variety of clients and cloud storage sites that may connect to the system in a cloud environment that requires data transfer over wide area networks, such as the Internet, which may have appreciable latency and/or packet loss, using various network protocols, including HTTP and FTP. Methods are disclosed for content indexing data stored within a cloud environment to facilitate later searching, including collaborative searching. Methods are also disclosed for performing containerized deduplication to reduce the strain on a system namespace, effectuate cost savings, etc. Methods are disclosed for identifying suitable storage locations, including suitable cloud storage sites, for data files subject to a storage policy.

Abstract: An application server disk image generating apparatus and method comprising a basic disk image generating component for generating basic disk images for basic programs used by the server; an incremental disk image generating component for generating incremental disk images including heritage relationship for other respective applications based on the basic programs used by the server; and an image profile generating means for generating an image profile for each of the basic disk images and the incremental disk images. By using the apparatus, the storage consumption can be decreased greatly and the storage efficiency can be improved. The invention also discloses an application server disk image management and distribution system to which the application server disk image generating apparatus is applied, and a system for provisioning the application server using disk images.

Abstract: A system for managing electronic information in a distributed system includes a shared central database for which a plurality of servers transmits data for storage. The shared central database is configured to store central schema information used for accessing the one or more data stores of the central database. Local databases each reference at least a portion of the central schema information for accessing the central database. Upon receiving a request for information, a local database directs the request to the central database based on the referenced schema information. The central database processes the request and transmits the data to the local database from which data was requested.

Abstract: A computer-implemented method for archiving information includes: executing a first application in a first process; determining that the first application is an archiving application configured to archive information stored in a transactional system; assigning, based on the determination, an archiving mode to the first process; receiving, from the first process and after assigning the archiving mode, a request to delete information; and processing the request to delete information according to the archiving mode.

Abstract: Provided is a system and method for archive in a distributed file system. The system includes at least one Name Node structured and arranged to map distributed data allocated to at least one Active Data Node, the Name Node further structured and arranged to direct manipulation of the distributed data by the Active Data Node. The system further includes at least one Archive Data Node coupled to at least one data read/write device and a plurality of portable data storage elements compatible with the data read/write device, the Archive Data Node structured and arranged to receive distributed data from at least one Active Data Node, archive the received distributed data to at least one portable data storage element and respond to the Name Node directions to manipulate the archived data. An associated method of use is also provided.

Abstract: Provided is a system and method for archive in a distributed file system. The system includes at least one Name Node structured and arranged to map distributed data allocated to at least one Active Data Node, the Name Node further structured and arranged to direct manipulation of the distributed data by the Active Data Node. The system further includes at least one Archive Data Node coupled to at least one data read/write device and a plurality of portable data storage elements compatible with the data read/write device, the Archive Data Node structured and arranged to receive distributed data from at least one Active Data Node, archive the received distributed data to at least one portable data storage element and respond to the Name Node directions to manipulate the archived data. An associated method of use is also provided.

Abstract: Provided is a system and method for archive in a distributed file system. The system includes at least one Name Node structured and arranged to map distributed data allocated to at least one Active Data Node, the Name Node further structured and arranged to direct manipulation of the distributed data by the Active Data Node. The system further includes at least one Archive Data Node coupled to at least one data read/write device and a plurality of portable data storage elements compatible with the data read/write device, the Archive Data Node structured and arranged to receive distributed data from at least one Active Data Node, archive the received distributed data to at least one portable data storage element and respond to the Name Node directions to manipulate the archived data. An associated method of use is also provided.

Abstract: Migrating data from an old storage device to a new storage device includes transferring the data from a first logical device on the old storage device to a second logical device on the new storage device, determining replication relationships for the first logical device, transferring the replication relationships; and transferring logical devices used for the replication relationships from the old storage device to the new storage device. The replication relationships may include a clone of the first logical device. Migrating data from an old storage device to a new storage device may also include suspending writes to the first logical storage device prior to transferring the data for the first logical storage device. The replication relationships may include at least one snapshot.

Abstract: Avoiding duplicative storage of managed content is disclosed. It is determined whether content associated with an object has been stored previously in an associated one of a plurality of storage locations used to store managed content with which the object is associated. If it is determined that the content has been stored previously in the storage location, the previously-stored content is associated with the object and the object, but not a duplicate copy of the content, is stored in the storage location.

Abstract: A system stores a snapshot and an associated data structure or index to storage media to create a secondary copy of a volume of data. In some cases, the associated index includes application specific data about a file system or other application that created the data to identify the location of the data. The associated index may include three entries, and may be used to facilitate the recovery of data via the snapshot. The snapshot may be used by ancillary applications to perform various functions, such as content indexing, data classification, deduplication, e-discovery, and other functions.

Abstract: A system and method to protect a target file from data damage wherein a wrapper application transparently intercepts a write call operative to affect the target file and stores the pertinent data in a delta file. Occasionally the target file is backed up in a temporary file and then updated. The wrapper application also intercepts a read call operative to access the target file and merges the update information with data from the target file in a temporary file. The resulting merged data is returned as read results data.

Abstract: A file server stores the storage management information and migration policy information. The storage management information includes the information that indicates a storage attribute for each storage apparatus. The migration policy information includes a plurality of information sets. Each of the information sets includes the information that indicates a condition of a file attribute and the information that indicates a condition of a storage attribute of a storage apparatus that is a migration destination. The file server specifies a migration target file, specifies a storage apparatus that conforms to the storage attribute condition that is indicated by the information set that includes the information that indicates a condition of a file attribute that conforms to of a file attribute of a target file based on the storage management information, and migrates a target file from a storage apparatus that has stored the target file to the storage apparatus that has been specified.

Abstract: A system and method for managing data repositories may include providing techniques for end users to access and manipulate reports stored in the repositories. Text-based, image-based, or other types of reports may be stored in online and offline repositories, and in response to a search request, reports stored in the online and offline repositories may be retrieved. End users may export report data from text-based and image-based formats by converting the data into a spreadsheet format using various customization techniques. Thus, end users may edit, modify, analyze, or otherwise manipulate information in online and offline reports, while maintaining integrity of the information in the repositories.

Abstract: Versioning of an archived document having at least one of a first element, a second element, and a third element, is managed. The first element is mapped to a source set identifier, the second element is mapped to a first source identifier, and/or the third element is mapped to a second source identifier. The source set identifier, the first source identifier, and the second source identifier are agnostic to a type of the document and a method in which the document is captured. A determination is made as to whether the document comprises a copy of an existing document in an archive, a new version of an existing document in the archive, or a new document to be stored in the archive based upon an analysis of the mapped at least one of the source set identifier, the first source identifier, and the second source identifier.

Abstract: A method and system for storage of unstructured data in external data storage uses low-cost, minimally-functional external data stores (EDS) to store immutable, unstructured content. An external storage layer (ESL) interposed between an e-discovery management application (EMA), and the EDS constitutes an intermediary allowing access to external storage from the EMA and adding functionality unavailable on EDSs, offsetting the functional sacrifice incurred by using the EDS and preserving cost advantage. Caching content on the ESL during propagation to the EDS eliminates latency during file propagation. The ESL creates metadata and maintains an index of the data, allowing the data owner to search and retrieve from the EDS. The ESL compresses, decompresses, encrypts and decrypts data. An ESL vendor can service a number of clients on a fee or subscription basis. The ESL can distribute client data across EDSs and mirror data stored on a first ESL on another ESL.

Abstract: Collecting contact information for a plurality of contact entities from various sources and ranking the contact information based at least on the sources. The ranking of the contact information is determined based on the reliability of the sources. The ranked contact information is shared with users subject to privacy settings. The privacy setting allows the users or the contact entity to share certain contact information with others while keeping certain contact information privately or sharing the contact information with a limited number of users. After a change in the contact information from a reliable source is detected, the change may be propagated to other sources or client devices of the users.

Abstract: Archive management is enhanced by logically partitioning a physical cluster. Using an interface, an administrator defines “tenants” within the cluster. A namespace is a logical partition of the cluster for a collection of objects. Each namespace has a private file system. This approach enables a user to segregate cluster data into logical partitions. Using the interface, a namespace for a tenant is configured without affecting a configuration of another namespace. One configuration option is “versioning,” by which an administrator can elect to enable multiple versions of a same data object to be stored in association with a namespace. Once versioning is enabled for a namespace, the administrator can set a configuration parameter identifying a time period for maintaining a version. Preferably, versioning is dasabled for a data object under retention.

Abstract: A flashcopy of a source storage volume to a target storage volume is initiated. The content of the source storage volume is stored on the target storage volume in a space efficient manner. The space requirement of the stored content on the target storage volume is monitored. The flashcopy is terminated when the space requirement reaches a predetermined level. The stored content on the target storage volume is copied to a backup storage medium. A new flashcopy of the source storage volume is initiated.

Abstract: Indexes for predefined search orders of items in a database are generated and stored. When a client issues a database query a responsive pre-generated index list is retrieved and provided to the client for use in, e.g., populating a U/I view for a user. Only those items that a client needs, e.g., for populating a current U/I view, are retrieved from the database and output to the client. When a change is rendered to the database, e.g., an item is added or deleted or an existing item is altered, only the change is output to the client, rather than the entire modified index or altered item. In this manner clients can more quickly and efficiently respond to user data query requests by performing some processing upfront and by limiting communications traffic to communications relevant to the client's current processing.

Abstract: A map difference data generation apparatus includes: most recent and supplementary map data storage devices storing primary most recent and supplementary map data, respectively; a map update reflection device generating secondly most recent and supplementary map data according to an update of a first link, and generating tertiary most recent and supplementary map data according to an update of a second link; a determination device determining a dependency relationship between the update of the first and second links, in accordance with results of searching a route in the tertiary most recent and supplementary map data between first and second nodes, which are both ends of the second link; and a map difference data generation device generating map difference data, which defines a combination of the update of the first and second links, when the update of the first and second links have the dependency relationship.

Abstract: An inter-home content sharing apparatus and method are provided. The inter-home content sharing apparatus includes a home network protocol stack which communicates with the home network devices according to a home network protocol; a remote storage controller which receives a request for sharing content from the home network devices through the home network protocol, connects to a remote storage to upload the content, and controls the remote storage to extract metadata of the content; and a message controller which controls transception of notification messages including sharing information on the uploaded content.

Abstract: A flashcopy of a source storage volume to a target storage volume is initiated. The content of the source storage volume is stored on the target storage volume in a space efficient manner. The space requirement of the stored content on the target storage volume is monitored. The flashcopy is terminated when the space requirement reaches a predetermined level. The stored content on the target storage volume is copied to a backup storage medium. A new flashcopy of the source storage volume is initiated.

Abstract: Methods and apparatus to extract data encoded in media content are disclosed. An example method includes sampling a media content signal to generate digital samples, determining a frequency domain representation of the digital samples, determining a first rank of a first frequency in the frequency domain representation, determining a second rank of a second frequency in the frequency domain representation, combining the first rank and the second rank with a set of ranks to create a combined set of ranks, comparing the combined set of ranks to a set of reference sequences, determining a data represented by the combined set of ranks based on the comparison, and storing the data in a memory device.

Abstract: The claimed subject matter relates to an architecture that can determine costs associated with updating file formats. In particular, the architecture can interface with a network-accessible data storage service in order to determine a cost-benefit to the data storage service for a wide variety of conversion scenarios applicable to the particular topology of the data storage service. For example, the cost-benefit can differ for storage services configured according to a client-server model relative to storage services configured according to a distributed topology. Regardless, the architecture can identify a legacy format, select a converter for converting the legacy format to the updated format, and then determine the cost-benefit for a variety of conversion or migration scenarios.

Abstract: Embodiments may recover from faults by forming a new set of rows by removing rows associated with faulting save operations and repeating the saving and forming operations using the new set of rows until a set of rows that can be saved from the known start state without fault is determined. When the subset of successful rows is found, embodiments are able to provide assurance that no side effects (i.e., code or operations triggered by saving of a data to a particular location) have been executed on behalf of any of the failed rows (side effects from custom PL/SOQL code included) by deferring execution of triggers until an entire set of rows can be saved and committed.

Abstract: Method, system, and programs for information search and retrieval. A query is received and is processed to generate a feature-based vector that characterizes the query. A unified representation is then created based on the feature-based vector, that integrates semantic and feature based characterizations of the query. Information relevant to the query is then retrieved from an information archive based on the unified representation of the query. A query response is generated based on the retrieved information relevant to the query and is then transmitted to respond to the query.

Abstract: Disclosed is a method and system for archiving data. A server computer (or any computing device) receives data transmitted over a network from a client computer, wherein at least some of the data was previously collected by a scientific instrument during an experiment. After receiving the data, the server computer updates (e.g., creates) an index for the received data, archives the received data, and automatically transmits a notification to the client computer that the received data has been archived.

Abstract: The present invention provides techniques for use in audience-related measurements, including hybrid techniques which include use of panel-based audience-related measurement information and census-based audience-related measurement information. Techniques are provided in which panel-based audience-related measurement information is obtained from multiple providing entities, and census-based audience-related measurement information is obtained one or more providing entities. The obtained information is stored in a database. The stored information may be provided to the information-providing entities, and may be used in calibrating or improving the accuracy of audience-related measurements.

Abstract: Methods and systems include embodiments that recursively save parent, grandparent, and other records in a database that depend from a record. User-provided code within a save event or trigger can thus call further save methods without corrupting the database. Junction objects, objects that reflect records with two or more parents, can also be recursively saved.

Abstract: Database management and security is implemented in a variety of embodiments. In one such embodiment, data sets containing sensitive data elements are analyzed using aliases representing sensitive data elements. In another embodiment, the sensitive data elements are stored in an encrypted form for use from a secure access, while the alias is available for standard access.

Abstract: An investment value of a media file is automatically determined by recording an interaction with the media file. Further, a uniqueness value of the media file is automatically determined by determining a probability that the media file is irreplaceable. In addition, an archival prioritization of the media file is performed in comparison with an additional media file. An archival storage device stores the media file if the archival storage device has space to accommodate the media file and the media file has a higher archival prioritization than the additional media file.

Abstract: A storage system according to one embodiment includes a first storage tier; a second storage tier; logic for storing instances of a file in the first storage tier and the second storage tier; logic for determining an ownership status for each instance of the file in the storage system, wherein the ownership status includes owned and unowned; logic for determining a location of each instance of the file in the storage system; logic for determining whether each instance of the file in the first storage tier is being accessed or not being accessed; logic for assigning each instance of the file to one of a plurality of indices using the determined ownership status, location, and whether the instance is being accessed; logic for receiving a request to access the file or instance thereof from a user; logic for selecting an instance of the file based on an assignment of the instance of the file to one of the indices; and logic for providing the user with access to the selected instance of the file or copy thereof.

Abstract: A storage system according to one embodiment includes a first storage tier; a second storage tier; logic for storing instances of a file in the first storage tier and the second storage tier; logic for determining when to migrate an instance of the file associated with a first user and stored on the first storage tier to the second storage tier; logic for searching for an instance of the file or portion thereof on the second storage tier that is not associated with any user; logic for associating the instance of the file or portion thereof on the second storage tier with the first user; and logic for disassociating the instance of the file on the first storage tier from the first user. Additional systems, methods, and computer program products are also presented.

Abstract: A method for retrieving deleted data is described. The present method includes receiving a request to locate deleted data. The request includes criteria for approximating said deleted data. The deleted data is stored in a recovery log. The method also includes receiving an affirmation that the located deleted data is the deleted data being requested. The affirmation is by the requester of said deleted data. The method further includes transmitting the recovered data to the requester upon receiving the affirmation.

Abstract: A program for identifying and automatically acting on statistical arbitrage opportunities between related equities and contracts. The present invention describes an improved technique to perform statistical-pairs arbitraging in a dynamic marketplace with less risk than prior art approaches. The present invention employs an array of recent data and performance ratios involving bid and ask prices for correlated items, such as stocks.

Abstract: A content platform (or “cluster”) that comprises a redundant array of independent nodes is logically partitioned. Using a web-based interface, an administrator defines one or more “tenants” within the cluster, wherein a tenant has a set of attributes: namespaces, administrative accounts, data access accounts, and a permission mask. A namespace is a logical partition of the cluster that serves as a collection of objects typically associated with at least one defined application. Each namespace has a private file system with respect to other namespaces. This approach enables a user to segregate cluster data into logical partitions. According to this disclosure, tenant information, including all associated namespaces, in the cluster (the “source cluster”) is replicated to at least one target cluster over a replication link.

Abstract: Writing data in a distributed database having a plurality of nodes is disclosed. Writing includes receiving a write request at a node, wherein the write request is associated with one or more operations to define an atomic transaction and performing the atomic transaction based on the request. The atomic transaction includes writing to a first version of the database in the node and writing to an entity representative of a state of the first version of the database.

Abstract: A method, including assigning, to each tier in a storage system comprising multiple tiers, a respective range of priority scores, and calculating a compression ratio for a file stored on one of the multiple tiers. Using the compression ratio, a priority score is calculated for the file, and the file is migrated to the tier whose assigned range of priority scores includes the calculated priority score.

Abstract: A system and associated method for continuously optimizing data archive management scheduling. A job scheduler receives, from an archive management system, inputs of task information, replica placement data, infrastructure topology data, and resource performance data. The job scheduler models a flow network that represents data content, software programs, physical devices, and communication capacity of the archive management system in various levels of vertices according to the received inputs. An optimal path in the modeled flow network is computed as an initial schedule, and the archive management system performs tasks according to the initial schedule. The operations of scheduled tasks are monitored and the job scheduler produces a new schedule based on feedbacks of the monitored operations and predefined heuristics.