Abstract: An automated method may include clustering documents into a plurality of clusters, selecting a representative document, respectively, for two of the plurality of clusters, determining a final redirect target document for each of the representative documents in the two of the plurality of clusters, determining whether the final redirect target documents are duplicate documents of each other; and re-clustering the two of the plurality of clusters together if it is determined that the final redirect target documents are duplicate documents.

Abstract: The present invention relates to a system and a method performed in a client-server computing environment for managing the access requested by user applications (10) to a central, non-standard database type data repository (22) having proprietary access and data structures, in which data repository (22) the data integrity is controlled and checked by a further “mature” application running independently of the user applications (10). In order to provide an improved, cost-effective multiple-user access method, the following steps are proposed: a) performing a first update on said data repository (22) of a first user application (10A) in a transactional form, and b) in case a second user application (10B) requests a second update of said repository (22) during said first update transaction, c) blocking a write access until said first update's transaction has been completed.

Abstract: Image integrity in an archive can be verified using document characteristics. Embodiments of the invention provide a way to verify the integrity of a stored document image by determining document characteristics, which can also be embedded in the image file. Before allowing access to the image file by an application, the characteristics data from an image analysis can be compared to either or both of, characteristics information otherwise stored, or embedded characteristics data. The embedded data can optionally be encrypted. In example embodiments the data can include a result of an optical character recognition of contents of the document, a length of data describing the image, a percentage of a specified color of pixels in the image, or a checksum. Example embedding techniques can include those making use of a tagged image file format (TIFF) header, a steganographic watermark, or an image artifact.

Abstract: The client computer which transmits an access request specifying an object existing in the first file system and the second computer which accesses the second file system are connected to the first computer which accesses the first file system. The second file system includes a shared directory. A specific object which is an object complying with the path name including the name determined in accordance with the type of the second computer is stored in the shared directory. The controller mounts the shared directory to the first file system. The controller creates a link which comprises a name determined in accordance with a certain naming regulation independent of the type of the computer and corresponds to the specific object in the first file system.

Abstract: A method and system for combined commit transaction request and subsequent operation request for committing the operations of a synchronized transaction by one or more applications (301, 4001, 501) on a resource manager (302, 402, 502). The method comprises: receiving a combined request (310, 410, 510) for an operation and a request to commit any outstanding synchronized transaction; committing the outstanding transaction (311, 414, 512); and processing (313, 413, 517) the requested operation outside the outstanding transaction. For example, in an asynchronous messaging process, the combined request specifies an option in a get operation request to commit any outstanding units of work prior to carrying out the get operation.

Abstract: An embodiment of the invention is a log management system analyzing and managing a log acquired in a computer. It generates log groups each formed of log records with reference to the log. It identifies active periods, in each of which a display area is active, in the log groups, and compares a start-to-end period from a start time to an end time of a reference log group selected from the log groups with active periods of subject log groups other than the reference operation log group individually to identify one or more subject log groups having an active period included in the start-to-end period. It individually determines whether to include the identified one or more subject log groups in the same first cluster as the reference log group, based on an active period length of each of the identified one or more subject log groups within the start-to-end period.

Abstract: Systems. Methods, and Computer Program Products are provided for recovering transactions of failed nodes using a recovery procedure in a clustered file system (CFS). A data segment is determined that the data segment should be copied to a final storage location by validating that an ownership of the data segment is not associated with any other operational node, via a distributed shared memory (DSM) agent. The ownership of the data segment is set to a local DSM agent.

Abstract: Systems and methods for generating files in a virtual file system in the memory of a network system are discussed. The network system receives a filename including at least one file metadata. The file metadata includes a file size of the file, a random seed for generating content of the file, and modification information of the file. File content for the file may be generated based on the filename. The file content may then be provided to the network system.

Abstract: Member objects of a computer system part(s) in an Enterprise Information System (EIS) are identified and categorized for export to a packaging process or to another computer system over tiers of network(s). An intermediate representation of the part(s) is made while applying context rule(s) to determine a standard specified context or a non-specified context of the parts. For a standard specified context, a directed search acquires the set of runnable and/or non-runnable member objects in a location(s) in the EIS. For a non-specified context, an implicit traversal search is performed for any of the set of runnable and/or non-runnable member objects in one or more locations in an Enterprise Information System (EIS). Set(s) of runnable and/or non-runnable member objects are accessed at their locations in the EIS and a preliminary package specification is made therefrom. Digital assets listed therein are updated with export descriptors added to the extended environment.

Abstract: Systems, Methods, and Computer Program Products are provided for performing concurrent checkpoints from file system agents residing on different nodes within in a clustered file system (CFS). Responsibility to checkpoint a modified and a committed data segment to a final storage location is assigned to one of the file system agents. One of the file system agents, which is assigned, is the file system agent whose associated distributed shared memory (DSM) agent is an owner of the data segment.

Abstract: Systems, Methods, and Computer Program Products are provided for concurrent checkpointing and modifications in a transactional clustered file system (CFS). Shadow data segments, whose contents are identical to an original data segment currently being written by a checkpoint operation, for users that require access for modification to data segments concurrently being written within a checkpoint operation.

Abstract: Systems. Methods, and Computer Program Products are provided for implementing transactional processing for user operations in a clustered file system (CFS). Transactional functionality is provided for user defined operations for one of writing and modifying files, and user defined write operations and individual user defined modification operations to various possible alternative files are wrapped into either a single transaction or multiple transactions individual.

Abstract: A dispatching system adjusts resources to meet real-time changes in demand. When a customer requests service, a work assignment is generated and sent to an employee. When a customer cancels the requested service, a cancellation code is sent to the employee. The cancellation code informs the employee that the work assignment has been canceled.

Abstract: Directories in a file system are defined with a dummy cluster in a file allocation table as the initial entry. Subsequent clusters in a directory's definition may define any data for the directory that can be changed in a transaction-safe mode. A directory may be modified in a transaction-safe mode by modifying any of the subsequent clusters while tracking changes in a second file allocation table. When the changes have been made to the directory, a pointer to the second file allocation table may be switched to indicate that the second file allocation table is now last known good. The first file allocation table may then be synchronized with the second.

Abstract: Systems. Methods, and Computer Program Products are provided for concurrent processing of transactions and read operations for achieving serialization and isolation in a clustered file system (CFS). Users, performing read only operations, are allowed to currently access the CFS while mutually excluding and serializing transactions of users affecting a same portion of the CFS. Transactions are ordered across a cluster of nodes of the CFS according to the transactions termination time.

Abstract: Systems, Methods, and Computer Program Products are provided for restoring data segments in a clustered file system (CFS). Contents of the data segments, that were modified during a transaction, which is being rolled-back to the most recent contents of the data segments prior to the transaction commencing, are restored. Locations of the most recent contents of the data segments, which are restored, are identified.

Abstract: Collective buffering and data pattern solutions are provided for storage, retrieval, and/or analysis of data in a collective parallel processing environment. For example, a method can be provided for data storage in a collective parallel processing environment. The method comprises receiving data to be written for a plurality of collective processes within a collective parallel processing environment, extracting a data pattern for the data to be written for the plurality of collective processes, generating a representation describing the data pattern, and saving the data and the representation.

Abstract: Systems, Methods, and Computer Program Products are provided for implementing transactional mechanisms by a plurality of procedures on data segments by using distributed shared memory (DSM) agents in a clustered file system (CFS). A new data segment is allocated and an associated cache data segment and metadata data segments, which are allocated for the new data segment and loaded into a cache and modified during the allocating of the new data segment, are added to a list of data segments modified within an associated transaction. The DSM agents assign an exclusive permission to the new data segment.

Abstract: The present invention is directed to a method and system for efficient write journal entry management maintaining minimum write journal information stored in a nonvolatile memory through utilizing an additional structure in a fast volatile memory. The method and system may manage write journaling of a file volume including multiple fixed sized regions and assign a persistent 1-bit synchronization status (the write journal information) to each data region. In addition, a non-persistent I/O counter (the additional structure) for each region to manage the persistent 1-bit synchronization status during run-time. The present invention may provide a mechanism to determine when write I/O operations have not successfully completed to a specific region of the file volume.

Abstract: Systems and methods for transactional processing within a clustered file system wherein user defined transactions operate on data segments of the file system data. The users are provided within an interface for using a transactional mechanism, namely services for opening, writing and rolling-back transactions. A distributed shared memory technology is utilized to facilitate efficient and coherent cache management within the clustered file system based on the granularity of data segments (rather than files).

Abstract: An information processing apparatus includes a file obtaining unit, a saving unit, a save-state information storage unit, an accepting unit, an updating unit, and a transmitting unit. The file obtaining unit obtains a first file from a file management apparatus that manages the first file. The saving unit saves the first file. The save-state information storage unit stores save-state information about a save state of the first file. The accepting unit accepts a manipulation performed on the first file saved in the saving unit. The updating unit updates the save-state information, when the save state of the first file is changed in response to the accepted manipulation. The transmitting unit transmits the save-state information to the file management apparatus.

Abstract: A system and method for improving access efficiency in a database. The database stores values of a plurality of keys associated with the respective keys. The system of the invention executes a plurality of transactions on the database, and acquires and records a referenced value which is a value of a key referenced in a corresponding transaction from the database according to the execution of each of the transactions. Then, according to commit requests of the plurality of transactions, the system requests a reply of a resultant table including an arrangement of judgment results obtained by judging whether the value of the key stored in the database is maintained as the referenced value without change made by another transaction for the respective transactions. The system further judges whether each transaction is successful, based on the resultant table sent back and commits only transactions judged to be successful.

Abstract: An electronic data system comprises memory storage having stored data, file system software, and a transaction file. The transaction file is maintained by the file system software, and includes a plurality of transaction records corresponding to transactions that have been or are to be executed on one or more files and/or the or more directories of the file system. The file system software operates to organize and maintain the stored data in the files and directories and also to coalesce multiple transaction records meeting one or more criteria into fewer coalesced transaction records. The physical memory space required by the transaction file is reduced by the transaction record coalescing. The coalesced transaction records may be constructed so that they represent a logical result of applying each transaction record of a transaction record set in chronological order.

Abstract: The invention provides a remittance platform in which an enterprise, such as Wells Fargo, serves as a remittance transfer agent, where the remittance function is integrated with a bank. The invention allows access to the remittance program by both account holders with the enterprise and persons who do not have an account with the enterprise. The person accessing the service may pick the remittance service they want and the country they want. However, the service is not anchored to a particular account and can therefore work with both bank partners and non-bank partners and account holders and non-account holders. Further, the system may be private-labeled. Additionally, the invention provides a mechanism that allows one to send money easily to other countries and it allows bank partners to participate in the program easily as well. This is possible because the enterprise provides all of the processing in an integrated fashion.

Abstract: A method and apparatus for optimizing storage space allocations, using at least one processor, for computer data in distributed file systems is described. In one embodiment, the method includes processing input/output activity that is associated with computer data to determine a current state of at least one file in a distributed file system, at flush time, combining various storage space allocation decisions applied over at least one network protocol to determine a plurality of file system operations that define storage space, based on the current state of the at least one file, for the computer data and executing the plurality of file system operations on the computer data stored in the storage space.

Abstract: A computer method and a system for detecting the file type of an electronic file, the method including the steps of: (a) using a predetermined number of bytes at the beginning of the file to create a list of probable file types; (b) testing the file against a detection rule for each file type in the list until a match is found; if no match is found (c) testing the file against other known detection rules for file types to find a match.

Abstract: Methods, systems, and computer-readable media provide for generating a report indicating job availability. According to embodiments, a method for generating a report indicating job availability is provided. According to the method, a selected assignment group is displayed. A number of status messages received by a technician in the selected assignment group is displayed. The status messages indicate that no jobs are available for the technician. An amount of lost time associated with the technician in the selected assignment group is determined. The lost time includes a difference between a time at which the technician received one of the status messages and a time at which the technician is dispatched to a next job. The amount of lost time associated with the technician in the selected assignment group is displayed.

Abstract: A media system is disclosed that uses preemptive recording of media files to reduce playback latency when media tracks are subsequently selected for playback during the recording process. The media system comprises a primary storage device capable of storing media files and a secondary storage device capable of reading digital media files from a removable storage medium. The system also includes a media player capable of playing media files stored on the primary storage device and a recorder that is connected to read digital media data from the secondary storage device. The recorder stores media files corresponding to the digital media data of the removable storage medium on the primary storage device.

Abstract: An image transmission apparatus is high in convenience, operability and reliability when newly registering a transmission destination to an address book. The apparatus obtains a list of destination names corresponding to recipients who have registered a recipient setting designating a transmission method; receives from a user a selection of whether to follow the recipient setting; receives from the user (a) if a selection to not follow the recipient setting has been received, a destination name and a transmission method to correspond thereto, and (b) if a selection to follow the recipient setting has been received, a selection of a destination name from the list; in the case of (a), registers the destination name and the transmission method in association as a candidate for the destination; and in the case of (b), registers the selected destination name with an indication that the recipient setting is to be followed, as a candidate.

Abstract: A computer implemented method for ensuring the quality of processed corporate entity data, the method comprising: sequentially processing the corporate entity data through a series of serially connected drivers, the serially connected drivers comprise a data collection driver, an entity matching driver, an identification number driver, a corporate linkage driver, and a predictive indicator driver; and conducting a quality assurance of the corporate entity data as it is processed in each of the driver, wherein the quality assurance comprises: (i) sampling the corporate entity data from each the driver periodically, thereby generating sample data; (ii) evaluating the sample data; and (iii) adjusting the processing based upon the evaluation, thereby producing high quality data.

Abstract: Provided are techniques for increasing transaction processing throughput. A transaction item with a message identifier and a session identifier is obtained. The transaction item is added to an earliest aggregated transaction in a list of aggregated transactions in which no other transaction item as the same session identifier. A first aggregated transaction in the list of aggregated transactions that has met execution criteria is executed. In response to determining that the aggregated transaction is not committing, the aggregated transaction is broken up into multiple smaller aggregated transactions and a target size of each aggregated transaction is adjusted based on measurements of system throughput.

Abstract: One example method presents a synthetic view of data stored by a shared device file system. The synthetic view provides a “fictional” single namespace for data stored by the shared device file system. The method includes accepting a command to access data stored by the shared device file system. The command may be native to a user requesting the access. The command addresses the data stored by the shared device file system using the single namespace provided by the synthetic view. The method includes creating a replacement command(s) for accessing data stored by the shared device file system using one or more actual namespaces different from the single fictional namespace provided by the synthetic view. With the replacement command(s) prepared, the method proceeds to access data stored by the shared device file system using the replacement command(s).

Abstract: Systems, Methods, and Computer Program Products are provided for performing concurrent checkpoints from file system agents residing on different nodes within in a clustered file system (CFS). Responsibility to checkpoint a modified and a committed data segment to a final storage location is assigned to one of the file system agents. One of the file system agents, which is assigned, is the file system agent whose associated distributed shared memory (DSM) agent is an owner of the data segment.

Abstract: Systems. Methods, and Computer Program Products are provided for concurrent processing of transactions and read operations for achieving serialization and isolation in a clustered file system (CFS). Users, performing read only operations, are allowed to currently access the CFS while mutually excluding and serializing transactions of users affecting a same portion of the CFS.

Abstract: A security model is provided in a transactional logging infrastructure that is arranged as a protected subsystem built on an underlying secure file system. Files in the underlying file system used by virtual log streams are protected from direct user writes, and are written-to only through the protected subsystem that is brokered by a machine-wide principal so that virtual log files sharing the same multiplexed physical log are kept secure from each other. Log file handles and user- and kernel-mode objects are exposed to log clients through interfaces using consistent security semantics for both dedicated and virtual logs. Log clients are agnostic of the underlying secure file system and can only manipulate file system containers—abstract objects that implement the physical log and used to virtualize the file system by normalizing input/output operations—by using the interfaces brokered by the principal in the protected subsystem.

Abstract: Systems. Methods, and Computer Program Products are provided for implementing transactional processing for user operations in a clustered file system (CFS). Transactional functionality is provided for user defined operations for one of writing and modifying files, and user defined write operations and individual user defined modification operations to various possible alternative files are wrapped into either a single transaction or multiple transactions individual.

Abstract: Provided is a method that includes receiving a file from a network site, wherein the file defines display information for one or more content items, parsing the file to display the one or more content items. Parsing includes encountering, in the file, a request to transmit analytics data to a remote analytics site, delaying transmission of the analytics data to wait for encountering of subsequent requests in the file, encountering, in the file, one or more subsequent requests to transmit other analytics data to the remote analytics site, aggregating the analytics data and the other analytics data into an analytics request for the remote analytics site, and sending the analytics request to the remote analytics site, such that the remote analytics site receives the analytics data and the other analytics via the same analytics request.

Abstract: A method for increasing the QoS in a data center. The method can be employed in first and second components of the data center. In one embodiment, the method includes a first component of the data center receiving first and second requests. The first component generates first and second priority values corresponding to the first and second requests, respectively. The first component processes the first and second requests to generate third and fourth requests, respectively, wherein the first request is processed before the second request if the first priority value is numerically greater than the second priority value, or the first request is processed after the second request if the first priority value is numerically less than the second priority value. A second component of the data center receives the third and fourth requests. The second component generates third and fourth priority values corresponding to the third and fourth requests, respectively.

Abstract: Systems and methods for transactional processing within a clustered file system wherein user defined transactions operate on data segments of the file system data. The users are provided within an interface for using a transactional mechanism, namely services for opening, writing and rolling-back transactions. A distributed shared memory technology is utilized to facilitate efficient and coherent cache management within the clustered file system based on the granularity of data segments (rather than files).

Abstract: Methods and apparatuses for data protection against corrupted write operations. In one embodiment, a technique of crash protection uses an atomically updated global transaction indicator to switch a set of data structures from one set of versions to another set. In one embodiment, the storage space for multiple versions of a data structure is allocated at the time the data structure is created on the storage device so that the multiple versions of the data structure can be kept close by. Between two consistent points, some data structures are modified to create new versions without changing the corresponding previous versions; and unmodified data structures are not copied. At a consistent point, the global transaction indicator is updated to indicate a set of consistent versions of the data structures, such as metadata of a file system.

Abstract: Embodiments of the invention broadly contemplate systems, methods, apparatuses and program storage devices providing a mechanism in which a file system and copy command (or file transfer command) allows the start of a copy operation when a file is being copied to and allow the system to continue to read the file as and when it gets updated (appended with additional data), thus permitting automated simultaneous file transfer and copy operations.

Abstract: Methods and apparatuses for data protection against corrupted write operations. In one embodiment, a technique of crash protection uses an atomically updated global transaction indicator to switch a set of data structures from one set of versions to another set. In one embodiment, the storage space for multiple versions of a data structure is allocated at the time the data structure is created on the storage device so that the multiple versions of the data structure can be kept close by. Between two consistent points, some data structures are modified to create new versions without changing the corresponding previous versions; and unmodified data structures are not copied. At a consistent point, the global transaction indicator is updated to indicate a set of consistent versions of the data structures, such as metadata of a file system.

Abstract: A hardware-based file system includes multiple linked sub-modules that perform functions ancillary to client data handling. Each sub-module is associated with a metadata cache. A doubly-rooted structure is used to store each file system object at successive checkpoints. Metadata is stored within an object and/or as a separate object. Provisions are made for allocating sparse objects. A delayed write feature is used for writing certain objects into non-volatile storage. Checkpoints can be retained as read-only versions of the file system. Modifications to the file system are accomplished without affecting the contents of retained checkpoints. The file system can be reverted to a retained checkpoint. Multiple file servers can be interconnected as a cluster, and each file server stores requests from another file server. Interconnections between file servers can be dynamically modified. A distributed locking mechanism is used to control access to file system objects stored by the file servers.

Abstract: Various embodiments of systems and methods for file system transaction log flush optimization are described herein. An optimizer is working as an intelligent processing unit, autonomously determining the best possible time to flush all collected transaction data modifications to the file system when operating under high load, or flushing each modification separately under low load. When operating under high load, batches of data modifications are collected and written together to the file system in a single write operation, thus decreasing the number of write operations and achieving better utilization of the system resources.

Abstract: A method and system for storage checkpointing of an independent computer application. The independent computer application is launched by a coordinator; and the coordinator installs at least one of an exec interceptor and a fork interceptor. The coordinator also installs at least one file operations interceptor for all file operations and registers the independent computer application with the coordinator. The independent computer application is run and the at least one file operations interceptor is called upon encountering a file operation. The file operations interceptor logs a file event in a file operations database and passes the operation to at least one of a file system, an operating system, at least one or more device drivers, and a storage disk via a storage interface. The file operations interceptor also verifies that the file operation has been issued.

Abstract: A document management system separates building information into a variety of data sets. Each data set has at least one common attribute that links it to all other types of data sets for the building. The information for maintaining the building is stored in a manner allowing users to retrieve only selective information from a vast amount of stored information. Users can query and retrieve data sets in a vast number of combinations relating to a specific building, or floor, room, system or system component in the building.

Abstract: A protected file is retained in secondary storage for a retention period, and a corresponding stub file is retained in primary storage for the retention period. The stub file retains attributes of the file indicating a location of the file data in the secondary storage and indicting that the stub file is to be retained for the retention period. A system administrator may instruct a primary file server that a secondary file server supports retention based protection and it is desired to protect stub files corresponding to protected files that are migrated to the secondary file server. The primary file server may request the secondary file server to return a protection status of the file after migration. This enables automatic policy-based migration to both file level retention (FLR) and non-FLR retention protected secondary storage from diverse applications accessing FLR or non-FLR files in the primary storage.

Abstract: A requester includes a business process history DB having recorded therein GBPIDs, input messages, and provider names, and each of providers includes a log DB having recorded therein log data containing DBPIDs and images before updates of the DB. Moreover, in the requester, an UNDO information creator and a REDO information creator refer to the business process history DB to respectively create UNDO information and REDO information for the provider in charge of the business process of a GBPID after the modification REDO. Furthermore, in the provider, an UNDO processor and a REDO processor refer to the log DB to respectively perform UNDO and REDO processes.

Abstract: Methods and computer-readable media for maintaining transactional link-level consistency between a database and a file system. A file system change is logged in a record of a database log and a file corresponding to the file system change is created in a file system folder. During a restart recovery process, an analysis operation and a conditional redo operation are performed based on the database log, and a conditional redo operation and an undo operation are performed based on the files in the file system folder. An undo operation is then performed based on the database log.

Abstract: Processing for a data package is disclosed. An operation is received including a data package. The operation is performed with respect to each of one or more data objects included in the data package, in a manner determined at least in part by a context data applicable to the operation.