Abstract: A system and method for synchronizing data in first and second computer servers is provided. The first computer server includes a first plurality of data sets each having a first identifier and a first set of attributes. The second computer server includes second plurality of data sets each having a second identifier and a second set of attributes. The method includes transmitting a second identifier and a second checksum value both associated with one of the second plurality of data sets to the first computer server. The method further includes accessing one of the first plurality of data sets having a first identifier corresponding to the transmitted second identifier to determine a first checksum value associated with the accessed data set.

Abstract: The invention concerns a method of comparing by a comparator tool a pair of electronic data files each comprising a plurality of data elements, the method comprising: identifying at least one data element in each of said files; replacing the values of said at least one identified data elements in each of said files by a same reference value; comparing the files to detect differences between values of the data elements; and generating an output report indicating said differences.

Abstract: Embodiments described herein are directed to validating an aggregate document. An instance signature can be generated for a first instance of a data page retrieved for inclusion in the aggregate document and can be compared to a baseline signature associated with a second instance of the data page. A similarity value can be calculated in response to the comparison. The similarity value indicates a degree of similarity between the first instance and the second instance of the data page. Based on the similarity value it can be determined whether to delete or bypass the data page in the aggregate document.

Abstract: Provided is a system and article of manufacture for mirroring data. A mirror policy indicating volumes in a first storage system is processed to mirror to volumes in a second storage system and volumes in the second storage system to mirror to volumes in a third storage system. The third storage system is at a first geographical location remote with respect to a second geographical location including the first and second storage systems. A command is transmitted to cause the copying of updates to the volumes in the first storage system to corresponding volumes in the second storage system indicated in the mirror policy. Upon an occurrence of an event, the causing the suspension of the copying of updates to the volumes in the first storage system indicated in the mirroring policy to the volumes in the second storage system.

Abstract: An embodiment of the invention provides an apparatus and method for optimizing reads in a mirrored file system. The apparatus and method receives a plurality of read request blocks for reading the target regions in disks. The apparatus and method will chain the read request blocks in a first set, where all of the read request blocks in the first set are targeted to a first disk. The read request blocks in the first set are then sent as a read request to the first disk. When each read request block in the first set has completed accessing their respective target regions in the first disk, then the read data is generated from the first disk. Therefore, by chaining the read request blocks in a read request to a single disk, read striping is not performed across multiple disks during a read operation.

Abstract: An investment portfolio management facility is disclosed. The facility is a computerized system for providing data integrity for investment portfolios. When an entry is made, the entry is checked for consistency with previously-made entries and with rules for portfolio entries. If an error is detected, the system alerts users to the error and also provides signals to check for further errors. The user may be made aware of the error or errors through a user interface.

Abstract: A technique for maintaining consistency between a data object and references to the object in a file. An indication that a source object has changed is received. One or more of the changes made to the source object are identified. A file comprising one or more references related to the source object is analyzed to identify those references that may be inconsistent with the changes made to the source object.

Abstract: Various technologies and techniques are disclosed for providing a data warehouse test automation framework system. A data generation module is provided that is operable to generate data scenarios that ensure specific logic is being validated against a data warehouse. A data validation module is provided that has data validation blocks that provide a framework for validating data completeness and data integrity of a data warehouse. The data validation blocks are represented by query templates that provide specifications for how queries that perform the validating of the data completeness and the data integrity should be structured. Dimensions in the data warehouse are modeled using an object oriented programming syntax.

Abstract: A processor selects file system metadata. A processor identifies each unit of data in a file system. The processor determines if the unit of data contains file system metadata. The processor writes a unit of data of metadata to a diagnostic file system, provided it was determined that the unit of data contains file system metadata. The processor then determines if the unit of data contains user data. If the unit of data contains user data, the processor writes a sparse object to the diagnostic file.

Abstract: A query caching system and method for enabling the caching of software object instances at the granularity of query level. A query component in a container can issue a query to retrieve a query result from a database within a scope of a transaction. The query result includes one or more instances of a class that represents one or more persisted data entries retrieved from the database. A cache management component retrieves the query result for the query in the cache when a query registration component finds out that another query matches the query in the query registry. If the class is expected to remain unchanged within the transaction, the class can be configured to be used concurrently by multiple users, using an optimistic concurrency strategy. The cached query result can be invalidated during the transaction, when any row in any table in the database associated with the cached query result, or a range of any data entry of the one or more persisted data entries in the query is updated or invalidated.

Abstract: Methods, systems and computer program products are provided for managing at least one cache for a database. In one method, an operation record is inserted in an operations log for each write operation to the database. The operation record includes a Log Sequence Number (LSN). At least one cache is updated using operation records in the operations log. To update a cache, unapplied operations in the operations log for the cache are identified using an applied LSN associated with the cache. The applied LSN denotes an LSN of a last operation applied to the cache. The unapplied operations are then applied to the cache and the applied LSN is updated with an LSN corresponding to the last unapplied operation of the unapplied operations that were applied to the cache during updating the cache.

Abstract: A method and system for cleansing anomalies from sequence-based data at query time. Sequence-based data such as RFID data is loaded into a database. One or more cleansing rules are received at a cleansing rules engine. The cleansing rule engine converts the cleansing rule(s) to a template that includes logic to compensate for anomalies in the sequence-based data. A query to retrieve the sequence-based data is received by a query rewrite engine. The query rewrite engine rewrites the query by applying the template logic. The rewritten query is executed at query time. The result of the rewritten query execution is identical to the result of executing the original query on a data set generated by applying the cleansing rule to all of the sequence-based data.

Abstract: A system and method verifies and repairs mirrored data sets. Verification modules executing on both the source and destination computers cooperate to identify a common persistent consistency point image (PCPI) of the source and destination data sets. Once the common image has been identified, the source sends a data stream comprising the data from the source data set to the destination to be compared with the destination data set.

Abstract: A file system includes a plurality of servers to store file data as segments or chunks; and first data that includes file identifiers for files for which the file data are stored as segments; and second data that maps the file identifiers to the segments to which the file identifiers correspond; and location data that identifies which of the plurality of servers stores which of the segments, the location data being keyed on segment identifiers, each segment identifier being based on the data in a corresponding segment.

Abstract: Multiple files in a versioned file system are grouped to form a fusion unit on a server. The fusion unit is exposed to a client as a browsable folder having separate files. When the server receives an indication of a change to file belonging to the fusion unit, the server determines whether the change to the file causes a conflict on the fusion unit. If the change does cause a conflict, then the conflict is reported; otherwise the fusion unit is updated to incorporate the change.

Abstract: A method for transferring metadata including: separating, using a processor, objects in a metadata registry into system-defined objects and user-defined objects, identifying, using the processor, a consistent set of the user-defined objects to export based on relationships of the user-defined objects with other objects, and exporting, using the processor, the consistent set of user-defined objects. A method for transferring metadata may also include: receiving, using a processor, a consistent set of user-defined objects for import into a metadata registry; and importing, using the processor, the set of user-defined objects into the metadata registry, the importing comprising validating the consistency of the set of user-defined objects.

Abstract: A source application reads a body of data in data block sized units and calculates a checksum value for each data block before sending the data block, the calculated checksum value and the identifier. Upon receipt, a destination application independently calculates a checksum value for each received data block and compares the two checksums. Non-matching checksums indicate a network-induced error in the data block. Identifiers for the erroneous data blocks are transmitted to the source application after all of the data blocks have been initially transmitted. The source application thereafter resends only those data blocks identified. The destination application repeats the process of comparing checksums and transmitting identifiers to the source application until all of the data blocks of the body of data have been correctly received, and then uses the data blocks to recreate the body of data.

Abstract: An embodiment relates to a computer-implemented data processing system and method for storing a data set at a plurality of data centers. The data centers and hosts within the data centers may, for example, be organized according to a multi-tiered ring arrangement. A hashing arrangement may be used to implement the ring arrangement to select the data centers and hosts where the writing and reading of the data sets occurs. Version histories may also be written and read at the hosts and may be used to evaluate causal relationships between the data sets after the reading occurs.

Abstract: A system and method for collection of electronically stored information (ESI) from Windows based desktops and laptops is disclosed that are under the control of remote custodians. The system and method include an external persistent memory storage device and a software application tool that is loaded onto the persistent memory storage device. The external persistent memory storage device is connected to the computer system hosting the persistent memory storage device to be examined, for example, by way of a USB or Ethernet port. Once connected to the computer system hosting the persistent memory storage device to be examined, a Quick Start program, which, when opened, allows the required processing to be methodically performed. Documentation is provided for completing information regarding the chain of custody of the external persistent memory storage device. The documentation may be imprinted on a security receptacle for receiving the external persistent memory storage device.

Abstract: A first computational platform generates a data structure that indicates a set of blocks, wherein the indicated set of blocks have to be rewritten to revert a logical storage structure stored in the first computational platform to a previous state. An Input/Output (I/O) request that corresponds to a read operation on a selected block of the logical storage structure is received. A determination is made from the data structure that the selected block has to be rewritten to revert the logical storage structure stored in the first computational platform to the previous state. The first computational platform receives the selected block from a second computational platform, in response to a request made by the first computational platform to the second computational platform for the selected block.

Abstract: A method to expose status information is provided. The status information is associated with metadata extracted from multimedia files and stored in a metadata database. The metadata information that is extracted from the multimedia files is stored in a read queue to allow a background thread to process the metadata and populate the metadata database. Additionally, the metadata database may be updated to include user-define metadata, which is written back to the multimedia files. The user-defined metadata is included in a write queue and is written to the multimedia files associated with the user-defined metadata. The status of the read and write queues are exposed to a user through a graphical user interface. The status may include the list of multimedia files included in the read and write queues, the priorities of each multimedia file, and the number of remaining multimedia files.

Abstract: Method, system, and computer program product embodiments for recording data on a contactless integrated circuit (IC) memory associated with a data storage cartridge are provided. In one exemplary embodiment, an index of a plurality of files to be recorded on a storage media of the data storage cartridge is parsed with a table of contents (TOC) profile file to build a table of contents (TOC) specific to an owning application of the plurality of files. The TOC is written to the contactless IC memory.

Abstract: Disclosed is a technique for maintaining statistics. A query is received. Column group generation is performed to form one or more column groups. Column group refinement is performed based on statistics data generated for a previously received query. A statistics check is automatically performed. A statistics collection command is generated to obtain statistics.

Abstract: Records, including data for a virtual catalog, may be received from a number of sources. Each of the received records may be validated and a determination may be made as to whether one or more previously-received records matches the received record. When two or more records are determined to be matching records, a composite object may be created and information from the two or more records may be included in the composite object. If the matching records include conflicting information, then previously-defined rules may be applied to determine which items of the conflicting information have precedence over other items of the conflicting information. A virtual catalog may be created from the received records and the created composite object based on customized attributes.

Abstract: Techniques provide a file plan including a plurality of containers, wherein each container is capable of providing management information for record information objects assigned to the container, wherein the record information objects represent documents, wherein one of the containers points to a physical record. An electronic record associated with the physical record is stored. The physical record is automatically associated with the electronic record by updating the file plan.

Abstract: A system and method for managing data during consistency points in a storage system is provided. A buffer data control structure is modified to include a flags array that tracks various status flags for both a current and a next consistency point (CP). By utilizing multiple pointers within a buffer control structure, the storage system may permit write operations to continue to a data container undergoing write allocation. Received writes during a write allocation procedure are stored in raw data buffers and the buffer control structure is marked as being dirty for a next CP.

Abstract: Disclosed file system management techniques can augment and/or enhance a file management system (e.g., a conventional file system) provided for organizing data stored in computer readable storage medium (e.g., a HDD). Data and metadata can be written to a file system space of a file system without using a file management system and without incorporating the data into the file system. However, the metadata can include information allowing the written data to be (later) incorporated into the file system and without having to use the file system, thereby allowing write performance to be enhanced. Generally, metadata can provide additional information including data (e.g., integrity data) that cannot be provided or efficiently provided by the file management system to augment a limited or reduced file system. Integrity data can be especially useful for error recovery (e.g., after a system failure).

Abstract: Techniques are provided through which a user is verified as authorized to modify a website. A web crawler generates a filename and content for the user, who purports to be authorized to modify a particular website. The web crawler sends the filename and content toward the user. The user stores a file with the filename on a server that hosts the website. The user places the content within the file. The web crawler determines whether the file is stored on the server and whether the content is in the file. If so, then the web crawler stores information that indicates that the user is authorized to receive information pertaining to the website, which may be confidential information. If the file is not stored on the server or if the file does not contain the content, then the web crawler does not provide any information to the user pertaining to the website.

Abstract: A database system has a contention monitor which determines when the level of contention for accessing or inserting records in the database rises above a threshold, and inhibits non-critical access to the database to reduce the level of contention. In a preferred embodiment, the level of contention is determined by periodically measuring the time for an INSERT operation on the database, and comparing the time to a threshold derived from a baseline time measurement for the operation during a time of normal database activity. Thus the contention level is inferred from the time to do the operation, in this case the INSERT query. In one embodiment, the contention monitor notifies a system administrator to take action to reduce the contention. In another embodiment, the contention monitor informs the system to take action automatically according to predetermined selections by the system administrator.

Abstract: Identification of corrupted event data may be provided. Calendar events, such as appointments and meetings, may be created and copied to a plurality of attendee calendars. Changes to the event may be logged and, if the change results from a user interaction with a user interface, a user intent identifier may be associated with the log entry. Other changes that do not result from direct user interaction may not be associated with the user intent identifier. Event corruption detection may identify out-of-sync properties between two calendar events associated with the same meeting and, if the out-of-sync property is not associated with the user intent identifier, the properties may be updated to match each other.

Abstract: A transaction system that allows for analysis and administration at the global transaction participant level is disclosed.

Abstract: A data generation system provides for generating domain-specific, context-sensitive data collections as synthetic data for testing the performance of data processing systems. Within the data generation system, a composition module defines a data generation template containing a plurality of fields each capable of holding one or more values according to specifications defined for predetermined data types. An evaluation module sorts the fields in an order of dependency so that fields whose values affect the values in other of the fields are ordered before the fields whose values are affected by values in other fields. A data generation module populates the fields with values and retrieves a subset of the values populating the plurality of fields for generating each of a plurality of data sets, which are written into memory and made accessible for use in testing data processing systems.

Abstract: Updating a set of items is disclosed. A set of items is received. The set of items is partitioned into groups. Group dependency information for the groups is calculated. Optionally, a dependency report is produced. Optionally, groups are updated. Optionally, change impact analysis is performed.

Abstract: A system and method for creating notes for business object instances are described. In various embodiments, a system includes modules to receive note data and bind notes to business object instances. In various embodiments, the system saves notes to a database via a dedicated database connection in a dedicated transaction. In various embodiments, a user interface is provided for creating and modifying notes on business content. In various embodiments, a method for creating notes in a user interface and attaching the notes to one or more positions in a user interface screen displaying business content in an enterprise information system is presented.

Abstract: A device maintains, in a database, a plurality of data items, each data item of the plurality of data items being associated with a respective category. The device associates, in the database, a first counter value with each data item, the first counter value indicating a number of times the respective category has been deleted from the database at a time when the data item was stored in the database. The device associates, in the database or another database, a second counter value with the respective category, the second counter value indicating a current value for a number of times the respective category has been deleted from the database. The device selectively deletes, from the database, one or more data items of the plurality of data items from the database based on the first counter values and the second counter value.

Abstract: Embodiments of the present invention solve the technical problem of identifying, collecting, and managing rules that improve poor quality data on enterprise initiatives ranging from data governance to business intelligence. In a specific embodiment of the present invention, a method is provided for producing data quality rules for a data set. A set of candidate conditional functional dependencies are generated comprised of candidate seeds of attributes that are within a certain degree of relatedness in the ontology of the data set. The candidate conditional functional dependencies are then applied to the data refined until they reach a quiescent state where they have not been refined even though the data they have been applied to has been stable. The resulting refined candidate conditional functional dependencies are the data enhancement rules for the data set and other related data sets.

Abstract: A computer-based method for managing files includes: configuring an access control list which illustrates all the accessible rights to corresponding users, the accessible rights comprise the right for comparing selected files, the right for merging selected files and the right for dividing a selected file; saving created files in a file transfer protocol (FTP) server, and saving file information of the files in a database, the file information including a file path of each of the files; reading from the FTP server selected files that need to be compared according to respective file paths if a files comparing request is received, comparing the selected files, and outputting differences between the selected files; reading from the FTP server selected files that need to be merged according to respective file paths if a files merging request is received, merging the selected files to create a merged file, and saving information of the merged file in the database; reading from the FTP server a selected file that n

Abstract: In general, embodiments of the invention relate to reading data from and writing data to a storage system. Specifically, embodiments of the invention relate to a read only mode for a portion of a storage system. In one embodiment, a selective read-only mode for a portion of a storage system is implemented by monitoring a condition that affects a subset of persistent storage in a storage system, by detecting the condition, by entering a read-only mode for the subset, and by enforcing a policy of processing write requests and read requests to the storage system, which includes processing the write requests without modifying user data stored on the subset and processing the read requests, including requests for user data stored on the subset.

Abstract: A method is provided for loading data from a source database to a target database that includes at least one table. Prior to loading the data from the source database into the target database, at least one referential integrity constraint and/or at least one consistency requirement regarding the data is automatically identified. A subset of the data that satisfies the at least one referential integrity constraint and/or consistency requirement is then automatically identified. The identified subset of the data is then loaded into the target database as a unit of work.

Abstract: An imaging apparatus is capable of recording a first image file and a second image file which differs from the first image file in a recording format and which needs to be managed by a management file. The imaging apparatus includes an imaging unit that converts a subject optical image into an image signal, a signal processor that creates based on the image signal the first image file, or image data including the second image file and a management file associated with the second image file, and a controller that controls the signal processor. The controller checks consistency between the management file and the second image file, and controls the signal processor such that, when the management file is not consistent with the second image file, creation of the image data is inhibited but creation of the first image file is allowed.

Abstract: Example systems, methods, and apparatus economize generating and processing incremental journal files while maintaining internal consistency. One example method determines whether a sequence number associated with a first inode description in a disaster recovery (DR) journal entry is out of sequence with a second corresponding inode description in a DR metadump. The example method controls a DR journal process to provide a file system inconsistency signal and to suspend application of the DR journal entry to the DR metadump. The suspending and signaling can occur upon determining that a first access time independent verification code computed from the first inode description does not match a second access time independent verification code computed from the second inode description.

Abstract: A read-only protection method for removable storage medium has steps of establishing a copy prohibited list, receiving a write command for the removable storage medium, determining whether to allow duplication of data to the removable storage medium, allowing duplication of data to the removable storage medium when the data to be duplicated are not listed in the copy prohibited list and prohibiting duplication of data to the removable storage medium when the data to be duplicated are listed in the copy prohibited list. The method of the present invention prohibits copying of pre-designated data to the removable storage medium, but writing other data is allowed.

Abstract: Exemplary embodiments provide a computer implemented method, apparatus, and computer-usable program code for moving a software partition from an origination network file system client data processing system to a destination network file system client data processing system. Responsive to receiving a request to perform a checkpoint operation on a software partition, network file system related mount information for the software partition is gathered. Determined ports of a network are unblocked. Unwritten data on the origination network file system client data processing system is synchronized with a remote network file system server. The network is re-blocked. A checkpoint file is generated and stored. The checkpoint file is sent to the destination network file system data processing system.

Abstract: A computer-implemented method, apparatus, and computer-usable program code for preserving file locks while moving a software partition from an origination network file system client data processing system to a destination network file system client data processing system is provided. A request for a file is received. A determination is made as to whether the request is for a file that is within a software partition. Responsive to a determination that the request is for a file within a software partition, a determination is made as to whether the request is a lock request. Responsive to a determination that the request is a lock request, a determination is made as to whether the software partition is being restarted. Responsive to a determination that the software partition is being restarted, the lock request is blocked from being sent to a remote network file system server.

Abstract: Methods and systems for automated assessment of the operational risk for an organization based on sampling the operations of the organization. These approaches can be used for automated comparison of the operational risk of two or more organizational operations.

Abstract: An apparatus and method of providing accurate and consistent open spectrum results for secondary devices from different geo-location databases is presented. The results, which may be independently derived by each database, are independent of the database queried. The comparison permits some amount of latitude in spatial and temporal consistency between the databases as errors are only indicated if the temporal or spatial discrepancies are pervasive. In addition, large percentages of different locations showing discrepancies when compared also lead to corrective action being taken. Corrective actions that may be taken include forcing problematic databases to update, shunting requests by secondary devices in the problematic locations to acceptable databases or shutting down the problematic databases entirely.

Abstract: A method, system and computer program for quality management of a plurality of documents associated with a data-processing operation of an organization is provided. The documents include several fields, the organization has employees, and the method comprises determination of error rates. Errors are reduced in the plurality of documents by focusing on critical fields. The occurrence of errors is predicted by determining a correlation between the errors and a set of attributes, which is updated. Reducing and predicting errors control the error rate. A method for measuring the quality of a plurality of documents is also provided. The measurement is based on the relative operational impact of the errors and the frequency of errors associated with each field.

Abstract: A repository has a database containing a number of artifacts storing data and a system device model defining various entities, including the artifacts and properties used in the artifacts. To update a system device model in database an extension package is passed to the repository. Update software identifies differences introduced by the extension package that are only permitted if the data in the artifacts is compatible and updates the database if and only if the data and extension package are compatible.

Abstract: The present invention provides a system and method for automatically refining ontology within a specific context. The system comprises: a rich context extractor for discovering a semantics relationship conflict existing between an original ontology schema and application data; and an ontology schema and mapping refiner for refining the original ontology schema based on the semantics relationship conflict discovered by the rich context extractor, and creating a new mapping between the refined ontology schema and a data schema of the application data. According to the invention, users can save a lot of work of manual refinement, since the ontology schema is automatically refined based on contexts in the application data.

Abstract: A cue sheet generation system is used to compose a cue sheet for submission to PRS from an input EDL. The system parses the EDL to extract data relating to use of musical works associated with a PRS. The system employs both local and remote databases to retrieve information relating to the extracted musical work data. The information is then used to construct a cue sheet in a form appropriate for submission to a PRS.