Abstract: A method, article of manufacture, and apparatus for efficiently backing up information are disclosed. In some embodiments, this comprises receiving data and analyzing the data. In some embodiments, the data may be manipulated. In some embodiments, the data may come from multiple sources. Chunk headers, data chunks and chunk maps are then created based on analyzing the data. Chunk headers store the data manipulation technique of the data chunk. In some embodiments, chunk headers store the size of the manipulated and un-manipulated data chunks. The chunk headers, data chunks and chunk maps are then organized into a datastream. The datastream is then stored in a storage device. In some embodiments, the received data may be discarded. In some embodiments, a chunk header is associated with a data chunk.

Abstract: In one illustrative embodiment, a computer-implemented method for identifying program components, generates, by a processor unit, associations between the program components stored in a computer usable storage medium to create a first set of relationships, and assigns, by the processor unit, a probability to each relationship in the first set of relationships to create a second set of relationships, wherein the probability indicates a strength of the associations between the program components.

Abstract: An information managing method for managing information based upon an electronic message containing apparatus information or event information transmitted from a substrate processing apparatus, the information managing method comprising: storing the apparatus information of the substrate processing apparatus at a transmission time of the electronic message in a first apparatus information storage unit; comparing the event information with a condition for accumulating the apparatus information when the electronic message is transmitted; and accumulating the apparatus information in a second apparatus information storage unit by associating the apparatus information with a time stamp of a generation of the event information when the condition is satisfied.

Abstract: The present invention relates generally to a system and method for reviewing and evaluating performance. In particular, the present invention relates to a system and method for reviewing and evaluating performances of an official or group of officials at an event or events. Even more specifically, according to embodiments of the present invention, the system and method can involve reviewing and evaluating a referee's performance during a football game or games.

Abstract: A program for identifying and automatically acting on statistical arbitrage opportunities between related equities and contracts. The present invention describes an improved technique to perform statistical-pairs arbitraging in a dynamic marketplace with less risk than prior art approaches. The present invention employs an array of recent data and performance ratios involving bid and ask prices for correlated items, such as stocks.

Abstract: In an embodiment, communities are generated on demand. In this specification a community is a group of webpages in which users share ideas with one another by posting ideas and sending messages for one another to read. An on-demand community is a community that may be created via tools specialized for creating communities, with just a few keys strokes and/or mouse clicks and by adding information (e.g., about the members and/or the topic or set of topics that the community is focused upon), such that a community maybe established within a short amount of time, such as a few minutes or a few hours. Optionally, the communities may be initially populated with ideas related to a particular topic or set of topics. Optionally, each member may be provided with tools for establishing one or more profile page and/or one or more friend pages.

Abstract: In one embodiment, a method includes storing a first data table entry applying a schema used at a first point in time along with pointer data and pattern space information collectively representing the first data table entry at the first point in time and generating, at a later point in time, a map responsive to a schema change. The map comprises new pointer data or new pattern space information.

Abstract: A plurality of log processes are synchronized. Each is independently performed in parallel with one another, into a single set of log files. A line buffering mechanism of an operating system (OS) of the computing environment forecloses interleaving of the log processes. Log management operations are concurrently performed by a single process protected by a file-system lock of the OS. The log management operations include at least one of a log compression, log retention, and log rotation operation.

Abstract: Systems and methods for dynamically managed data retention are described. The system comprises a tiered framework having a plurality of namespaces. The namespaces are configured by a user to have selected data retention attributes. Data including a manifest may be received by the system, processed, and directed to a namespace based upon the manifest. Data storage partitions may be created automatically in association with a namespace, and the data partitions may be assigned partition attributes. Data in a storage partition may be migrated automatically to another namespace based on the partition attributes. Code necessary for creating storage partitions and migrating data is generated by the data management system.

Abstract: An online transactional data processing (OLTP) system is provided that includes a relational database for storing transactional data, an OLTP application program for processing the transactional data, and a change log for storing a set of change documents that describe transformations performed on the transactional data by the OLTP application program. To correct a run of the OLTP application program, the set of change documents is used to re-establish the original state. A re-run of the OLTP application program may produce a new set of change documents in the random access memory (RAM) of the OLTP system. Further, the original set of change documents stored in the change log may be at least partly overwritten by the new set of change documents.

Abstract: A system and method for document image acquisition and retrieval find application in litigation for responding to discovery requests. The method includes receiving automatically acquired electronic image logs comprising image data and associated records for documents processed by a plurality of image output devices within an organization. When a request for document production is received, the image logs (and/or information extracted therefrom) are automatically filtered through at least one classifier trained to return documents responsive to the document request, and documents corresponding to the filtered out image logs are output. One of the filters may be configured for filtering out documents that include attorney-client exchanges.

Abstract: A redundant array of independent nodes are networked together. Each node executes an instance of an application that provides object-based storage. The nodes are grouped into a plurality of systems each having multiple nodes. A data protection level method comprises setting a numerical value of a system dynamic data protection level for each system of nodes; and in response to user input, setting a value of a data protection level for one or more data objects in a system, the value being a fixed numerical value or a dynamic value. If the one or more data objects have a dynamic value of the data protection level in a system, the one or more data objects inherit the system dynamic data protection level of the system in which the one or more data objects reside. The value of the data protection level represents a number of copies of data of the one or more data objects to be kept where the one or more data objects reside.

Abstract: A storage system, according to one embodiment, includes a processor and logic integrated with and/or executable by the processor. The logic is configured to: search for an instance of a file or portion thereof on a second storage tier; at least one of: associate the instance of the file or portion thereof on the second storage tier with a first user when the instance of the file or portion thereof is not associated with any user, and replicate the instance of the file or portion thereof on the second storage tier and associate the replicated instance of the file or portion thereof on the second storage tier with the first user; and disassociate an instance of the file on a first storage tier from the first user.

Abstract: Synthetic backups are created without accessing previous backup data or retrieving backup data from a cloud storage service. A backup system provides two or more backup data sets to a cloud spanning storage interface for storage in deduplicated form as label maps and data segments in a cloud storage service. A specification defines portions of two or more previous backup data sets to be copied into the synthetic backup. Labels corresponding with the specified portions of previous backup data sets are identified and added to a new label map to create a deduplicated synthetic backup. The completed label map is transferred to the cloud storage service. To provide access to the synthetic backup, the cloud spanning storage interface reconstructs all or a portion of the synthetic backup from the new label map and the data segments created during deduplication of previous backup data sets.

Abstract: A data integrity verification method and system based on a root random number to ensure secure distributed data storage on a public cloud. A new root random number can be generated in response to receiving a file for storage to the public cloud. A unique random number tag for each data chunk associated with the file can be calculated via a shift operation and the tag can be added to the data chunk. A hash function (message digests) can be then generated and concatenated with the data chunk and the random number tag. The data chunk in conjunction with the hash and the random number tag can be encrypted by an encryption module and stored to the public cloud in order to provide multiple levels of security with respect to the distributed public cloud storage. Upon file retrieval, the encryption module decrypts all data chunks and recalculates the hash in order to verify the data integrity of the file.

Abstract: A continuous query identified by an archived relation of an application may be received. A physical query plan may be generated for the continuous query and/or a child operator plan may be identified. A buffer operator may be inserted between the child operator and its parent operator and/or the event information from the child operator may be stored in the buffer operator. A query operator may be identified in the physical query plan. It may be determined that the query operator identified in the physical query plan is a same type as a second query operator in a second continuous query concurrently executing. Further, a combined query plan may be generated based at least in part on the query operator identified in the physical query plan being the same type as the second query operator in the second continuous query.

Abstract: At least a portion of data from a first processing system is archived onto a second processing system based on partitions of the data. A query received at the first processing system is processed at the second processing system to retrieve archived data satisfying the received query in response to determining at the first processing system that the received query encompasses archived data. Embodiments of the present invention further include methods, systems, and computer program products for archiving and accessing data in substantially the same manner described above.

Abstract: A method may include receiving a continuous query identified by an archived relation associated with an application. The method may also include generating a physical query plan. Additionally, the method may include constructing a structured query language (SQL) equivalent expression corresponding to an attribute utilized by the operator and/or constructing an output SQL expression for the identified operator based at least in part on the SQL equivalent expression. Additionally, the method may include constructing the archiver query for the identified operator based at least in part on the output SQL expression. Further, the method may include executing the archiver query to obtain a result set of data records related to the application and/or generating a snapshot output of one or more data values related to the application based at least in part on the result set of data records.

Abstract: A method may include receiving a continuous query identified by an archived view. The method may also include creating the archived view, the archived view identified by a join query related to two or more archived relations associated with an application and/or generating a query plan for the continuous query. The method may also include identifying a view root operator in the archived view, the view root operator identified as a join operator in the archived view and/or identifying a query operator in the query plan that topologically precedes the view root operator. Further, the method may include constructing an archiver query for the identified query operator that topologically precedes the view root operator, executing the archiver query to obtain a result set of data records related to the application, and/or generating a snapshot output of one or more data values related to the application.

Abstract: Techniques for lifecycle state management and in-database archiving are described. Activity tracking refers to techniques that collect statistics related to user access patterns, such as the frequency or recency with which users access particular database elements. The statistics gathered through activity tracking can be supplied to data classification techniques to automatically classify the database elements or to assist users with manually classifying the database elements. Then, once the database elements have been classified, in-database archiving techniques can be employed to move database elements to different storage tiers based on the classifications. However, although the techniques related to activity tracking, data classification, and in-database archiving may be used together as described above; each technique may also be practiced separately.

Abstract: In some examples, a method may include receiving a continuous query, the continuous query being identified based at least in part on an archived relation associated with an application. The method may also include generating a physical query plan for the continuous query. In some examples, the method may also include identifying a query operator in the physical query plan and/or constructing an archiver query for the identified query operator. In some aspects, the method may also include executing the archiver query to obtain a result set of data records related to the application and/or initializing a state of the query operator based at least in part on the result set of data records. Further, the method may also include generating a snapshot output of one or more data values related to the application based at least in part on the state of the identified query operator.

Abstract: According to one embodiment of the present invention, at least a portion of data from a first processing system is archived onto a second processing system based on partitions of the data. A query received at the first processing system is processed at the second processing system to retrieve archived data satisfying the received query in response to determining at the first processing system that the received query encompasses archived data. Embodiments of the present invention further include methods, systems, and computer program products for archiving and accessing data in substantially the same manner described above.

Abstract: A method and system for processing input media for provision to a text to speech engine comprising: a rules engine configured to maintain and update rules for processing the input media; a pre-parsing filter module configured to determine one or more metadata attributes using pre-parsing rules; a parsing filter module configured to identify content component from the input media using the parsing rules; a context and language detector configured to determine a default context and a default language; a learning agent configured to divide the content component into units of interest; a tagging module configured to iteratively assign tags to the units of interest using the tagging rules, wherein each tag is associated with a post-parsing rule; a post-parsing filter module configured to modify the content component by executing the post-parsing rules identified by the tags assigned to the phrases and strings.

Abstract: Various embodiments for operating a transformation system, capable of transforming a logical data object (LO) to a transformed logical data object (TLO), are provided. In one such embodiment, an open LO request to a certain LO and addressed by the at least one client to the at least one storage device, is intercepted. An identifier (ID) in a header of a TLO corresponding to the requested LO and stored in the at least one storage device, is obtained. The obtained ID is used to characterize the TLO and the LO. A determination is made whether the transformation system handles at least one open LO characterized by an ID with a same value as the obtained ID. The requested LO is opened if at least one open LO is not found. An instance corresponding to the intercepted open LO request is generated. The instance is associated to the obtained ID.

Abstract: A computer-implemented method for managing application availability. The method may include identifying an application running on a first cluster node of a failover cluster and copying configuration data of the application to a storage location accessible by a second cluster node of the failover cluster. The method may also include detecting failure of the first cluster node, restoring the configuration data to the second cluster node, and executing the application on the second cluster node in accordance with the configuration data. Various other methods, systems, and computer-readable media are also disclosed herein.

Abstract: Maintaining data at a failover site includes an application writing data at a primary site corresponding to the failover site, where data is transferred asynchronously from the primary site to the failover site, the application issuing an application check point and initiating a system check point in response to the application issuing the application check point, where the system check point causes data at the failover site to be consistent with the primary site. The application check point may complete only after the system check point completes. The application check point may complete independently of completion of the system check point. The application check point may complete either only after the system check point completes or independently of completion of the system check point according to a specific criteria.

Abstract: Some embodiments provide different frameworks that implement conflict avoidance systems and methods for ensuring uniqueness in identifying assets for different customers that are deployed to server capacity of one or more distributed platforms participating in a federation. Specifically, different frameworks are provided whereby the distributed platforms authorize use of a domain before configuring the domain to identify assets of a customer. A method performed in one such framework includes receiving a domain that is specified for identifying assets of a first customer belonging to a first distributed platform of the federation. The method determines whether the domain conflicts with a domain that is configured by a second distributed platform of the federation. The method then communicates with the first distributed platform (i) to configure the received domain when there is no conflict and (ii) to prevent the first distributed platform from configuring the received domain when there is a conflict.

Abstract: Database table aggregation is implemented by a method that includes encoding first and second components via a waveform definition, the first and second components specifying criteria for aggregating data, and the first component is defined to provide data aggregation at a higher granularity than the second component. The method also includes generating a complex waveform representing the components in a pattern corresponding to the waveform definition and criteria, which spans a first axis indicative of a time period for the aggregation. The method includes providing a byte count for aggregated data stored in a first table defined by the criteria, aggregating the data for the time period, and updating the complex waveform to reflect results of the aggregation that includes generating a waveform representing a second table along a second axis depicted at a location corresponding to a time in which the data aggregation for the first table was initiated.

Abstract: A database archiving performance benefit determination system may include a data reduction module to ascertain a reduction value of data stored on a database, and a database setup module to ascertain a setup of the database. A performance modeling module may calculate a performance increase for a database application using the database based on the reduction value, the setup of the database, and at least one parameter representing the database application.

Abstract: In some embodiments, scripts may be used to perform parcel data acquisition, conversion, and clean-up/repair in an automated manner and/or through graphical user interfaces. The scripts may be used, for example, to repair geometries of new parcel data, convert multi-part parcel geometries to single part parcel geometries (explode), eliminate duplicate parcel geometries, append columns, create feature classes, and append feature classes. These scripts may be executed in a predetermined manner to increase efficiency. In some embodiments, different combinations of attributes may be appended to stored parcel data. In some embodiments, a tracking application may be used to track information about sources of data. In some embodiments, a tracking application may be used to track which system users are assigned to specific tasks (e.g., in a data acquisition project).

Abstract: A method, article of manufacture, and apparatus for protecting data. In some embodiments, this includes tracking changed blocks in a virtual machine, determining a MFT range of the virtual machine, identifying a common region between the changed blocks and MFT range, parsing the common region to determine a list of changed files, and storing the list of changed files in a file index.

Abstract: Stubbing systems and methods are provided for intelligent data management in a replication environment, such as by reducing the space occupied by replication data on a destination system. In certain examples, stub files or like objects replace migrated, de-duplicated or otherwise copied data that has been moved from the destination system to secondary storage. Access is further provided to the replication data in a manner that is transparent to the user and/or without substantially impacting the base replication process. In order to distinguish stub files representing migrated replication data from replicated stub files, priority tags or like identifiers can be used. Thus, when accessing a stub file on the destination system, such as to modify replication data or perform a restore process, the tagged stub files can be used to recall archived data prior to performing the requested operation so that an accurate copy of the source data is generated.

Abstract: Tools can be provided for conducting a conference/meeting and/or obtaining, managing and archiving conference/meeting data. For example, a meeting participation application and multi-layer presentation data (including a presentation document and an overlay layer) can be provided through a network to a participant. The meeting participation application allows the participant to make annotations which overlay the presentation document, and captures the user input as data in the overlay layer. Thereafter, processing may be performed to extract keywords from the captured annotations, and such extracted keywords can be archived along with meeting materials, documents, information and other content as meeting data in a meeting database.

Abstract: In an embodiment, communities are generated on demand. In this specification a community is a group of webpages in which users share ideas with one another by posting ideas and sending messages for one another to read. An on-demand community is a community that may be created via tools specialized for creating communities, with just a few keys strokes and/or mouse clicks and by adding information (e.g., about the members and/or the topic or set of topics that the community is focused upon), such that a community may be established within a short amount of time, such as a few minutes or a few hours. Optionally, the communities may be initially populated with ideas related to a particular topic or set of topics. Optionally, each member may be provided with tools for establishing one or more profile page and/or one or more friend pages.

Abstract: The invention discloses a data organization method for a change oriented spreadsheet application. In one embodiment, the valid updates to cells and the update times are stored with the cell positions as the primary index, and the valid updates to the same cell are arranged in the order of time. In another embodiment, the valid updates to cells are stored with the update time points of the valid updates of the cells as the primary index, and all the valid updates at the same valid update time point are arranged into an update table, the update table having the same cell structure as the spreadsheet file. In yet another embodiment, data structures organized in both manners are maintained at the same time.

Abstract: Methods and systems are provided herein that facilitate cost-effective and reliable data identification in an archival data storage system. In an embodiment, a data object stored in an archival data storage system is identified by a data object identifier which encodes storage location information that may be used to locate a data object stored in an archival data storage system that reduces the cost to store a global index. The data object identifier may also encode policy information such as access control information usable for validating subsequent access to the data object, payload validation information such as size and digest usable for verifying the integrity of the payload data, metadata validation information such as error-detection codes usable for validating integrity of the data object identifier and other information.

Abstract: A storage system according to one embodiment includes logic integrated with and/or executable by a hardware processor, the logic being configured to: determine an ownership status for each of a plurality of instances of a file in a first storage tier and in a second storage tier of the storage system; determine locations of the instances of the file in the storage system; determine whether the instances of the file in the first storage tier are being accessed or not being accessed; and assign each of the instances of the file to one of a plurality of indices using the determined ownership status, location, and whether the instances are being accessed.

Abstract: A computer-implemented method for deduplicating data transferred via physical storage media may include: 1) identifying data stored at a first location that is to be transferred to a second location via a physical storage medium, 2) deduplicating the identified data, 3) storing the deduplicated data on the physical storage medium, and then, after the physical storage medium has been physically transported from the first location to the second location, 4) transferring the deduplicated data from the physical storage medium to a storage device at the second location.

Abstract: A method and system for efficient space management for single-instance-storage volumes is provided. A backup module storing data within a collection of containers according to access locality and retention time of the data, wherein the retention time defines an amount of time the data is stored within the collection of containers before deletion of the data, and the access locality comprises an order in which the data is to be accessed is further provided. A compaction module compacting the stored data by selecting at least two containers among the collection of containers, wherein the selection is performed using a predetermined criteria that includes access locality and retention time of the data is also provided. The compaction module distributes the data among the at least two containers. The compaction criteria creates an imbalance among the containers to create more empty, full, or nearly full containers.

Abstract: Methods and systems are disclosed for calculating required scratch media. In one embodiment, the method comprises obtaining backup job information from one or more backup applications for a plurality of backup jobs, calculating a required number of scratch media needed for one or more future executions of at least one of the backup jobs using the backup job information, and presenting the required number of scratch media to a user.

Abstract: Method, system, and computer program product to archive data objects, by providing an object store and a shadow object store each configured to store one or more data objects, the object store and the shadow object store residing in different storage devices, creating a first object stored in the object store, the first object having at least one attribute, and responsive to receiving a request to archive the first object, transferring the first object to the shadow object store, and creating, in the object store, a reference to a location of the first object in the shadow object store, the first object remaining accessible through the object store and the shadow object store following the transfer.

Abstract: Method, system, and computer program product to archive data objects, by providing an object store and a shadow object store each configured to store one or more data objects, the object store and the shadow object store residing in different storage devices, creating a first object stored in the object store, the first object having at least one attribute, and responsive to receiving a request to archive the first object, transferring the first object to the shadow object store, and creating, in the object store, a reference to a location of the first object in the shadow object store, the first object remaining accessible through the object store and the shadow object store following the transfer.

Abstract: Various embodiments provide one or more of systems, methods, and software that replicate a document workspace, including comments and participant information. Some embodiments allow participants to view and manipulate comments while a network connection is not available. Additionally, the document typically contains knowledge of a comment repository holding comments submitted by participants which eliminates a need for a comment discovery mechanism. Some embodiments provide various means for viewing, modifying, and adding comments even while disconnected from the network. Comments made while disconnected may later be pushed to the repository when a connection becomes available. Further embodiments may provide a background notification via a user interface to notify participants when new comments are received or new reviewers are added.

Abstract: Apparatus, systems, and methods may operate to detect a plurality of changes to one of a database format and database content between a first version of a database and a second version of the database, and to transmit change information to a receiving entity, enabling display of the plurality of changes in at least one of a row-wise collective format, a column-wise collective format, a field-wise collective format, or a record-wise collective format. Additional apparatus, systems, and methods are disclosed.

Abstract: Various embodiments described herein each include one or more of systems, methods, data structures, and software to replicate a document or workflow workspace, including comments and other data added by document or workflow participants. Some embodiments allow participants to create, view, and manipulate public comments and other actions and private comments and other actions addressed specifically to individual participants, but prevent participants from viewing comments addressed only to one or more other participants. In some embodiments, the document may be distributed to participants via whatever means are convenient. The document may contain knowledge of a comment repository holding comments or other workflow data. Some embodiments include downloading comments and other data from a repository, identifying which comments and other data is intended for display to a viewing participant, and displaying the identified comments and other data.

Abstract: A data storage system according to certain aspects can archive database data associated with different database applications. The data storage system according to certain aspects may provide database archiving modules that include logic incorporating and/or based on the native schema and/or native commands specific to particular database applications. The database archiving modules according to certain aspects may determine the relationship between tables associated with corresponding database applications and archive selected database data based on the native schema and native commands.

Abstract: An archive for digital content comprises archive storage, an archive service and a manifest. The archive storage is a unified storage structure for storing items, such a directory having a plurality of subdirectories. The manifest is stored within the archive storage when the archive storage is loaded onto a storage device, and may comprise an index of items stored in the unified structure of the archive and/or an organizational structure that supports defined categories that characterize items stored in the unified structure and/or at least one backup queue that temporarily queues a list of items that satisfy predetermined backup criteria by have not been backed up. The archive service serves as an intermediate between users, e.g., operators, software modules, programs, services, etc., and the archive storage to control requests for access to items stored in the unified storage structure.

Abstract: A handheld electronic device, such as a GPS-enabled wireless communications device with an embedded camera, automatically geotags a set of data, such as a digital photo, video, notes, or a blog, with a textual plain-language description of the current location. When the data is generated, the current location of the device is determined, e.g. using a GPS receiver. A textual plain-language description of the current location is then generated, e.g. by reverse geocoding the GPS position coordinates or by correlating the current time with a calendar event from which language descriptive of the event can be extracted. This textual plain-language description is automatically generated and written into a tag or metadata file associated with the photo or other set of data. By automatically geotagging data with textual plain-language descriptions that go beyond mere coordinates of latitude and longitude, data can be searched and managed more efficiently.

Abstract: A method and system can be used to read and obtain data from messaging files regardless of the messaging environment used to generate the messaging files. The method and system can read part of a messaging file to identify the type of entry (e.g., email message, calendar item, address book entry, etc.) and access information on where information within the entry is located within the messaging file based on an identifying signature. The method and system can be used to obtain data from messaging files without having to recreate the messaging environment, including individual email accounts. The data can be stored in a target storage medium in a format that is more usable and more easily searched.

Abstract: An exemplary process includes storing telephone numbers in a telephone number database, identifying which telephone numbers in the telephone number database have digits that occur in an alphabetic pattern as defined by a reference list, and designating the telephone numbers with digits occurring in the alphabetic pattern as patterned telephone numbers. An exemplary process of identifying alphabetic patterns includes assigning at least one letter in an alphabet to a first digit, assigning at least one other letter in an alphabet to a second digit, accessing a telephone number database storing telephone numbers having a plurality of digits, identifying a letter combination created by at least two digits of at least one of the telephone numbers in the telephone number database, and determining whether the letter combination forms an alphabetic pattern as defined by a reference list.