Abstract: Described are systems and methods for preserving digital assets, which assets comprise one or more files. The system and methods prepare a digital file for ingest into an asset management system, store a plurality of copies of the digital file based on a set of storage policies for the digital file, and perform a health check on each copy of the digital file. The system and method may include performing an asset repair on the copies of the digital file that failed the health check as well as the exporting of a digital file.

Abstract: Provided are techniques for determining whether a character code point value of a first plurality of character code point values corresponds to a second character code point value from a second plurality of character code point values, first value associated with a first encoding version and the second value associated with a second encoding. In response to the first value does not corresponding to any of the second character code point values, a determination is made as to whether the value corresponds to a third character code point value of a third plurality of code point values stored in a character value record table (CVRT). In response the value corresponding to the third value, an entry in the CVRT that associates the character with the third value is made; and the character is stored in conjunction with an application associated with the second encoding using the third value.

Abstract: Embodiments of the present invention are directed to a system and method for a central intelligence system for managing, analyzing, and maintaining large scale, connected information systems. The centralized information system may receive data from servers, databases, mainframes, processes, and other technological assets. A user is able to use the centralized information system to run analyses on the data associated with the connected systems, including: historical analysis, real-time analysis, and predictive modeling. The system can monitor the data and automatically correct identified errors without the need of human intervention. The centralized information system can also generate risk management profiles and automatically modify data to conform to the risk management profiles.

Abstract: According to one embodiment of the present invention, a system analyzes data in response to detecting occurrence of an event, and includes a computer system including at least one processor. The system maps fields between the data and a fingerprint definition identifying relevant fields of the data to produce a fingerprint for the data. The data is deleted after occurrence of the event. The produced fingerprint is stored in a data repository, and retrieved in response to detection of the event occurrence after the data has been deleted. The system analyzes the retrieved fingerprint to evaluate an impact of the event on corresponding deleted data. Embodiments of the present invention further include a method and computer program product for analyzing data in response to detecting occurrence of an event in substantially the same manner described above.

Abstract: According to one embodiment of the present invention, a system analyzes data in response to detecting occurrence of an event, and includes a computer system including at least one processor. The system maps fields between the data and a fingerprint definition identifying relevant fields of the data to produce a fingerprint for the data. The data is deleted after occurrence of the event. The produced fingerprint is stored in a data repository, and retrieved in response to detection of the event occurrence after the data has been deleted. The system analyzes the retrieved fingerprint to evaluate an impact of the event on corresponding deleted data. Embodiments of the present invention further include a method and computer program product for analyzing data in response to detecting occurrence of an event in substantially the same manner described above.

Abstract: This invention pertains generally to a method for resolving and managing eventual consistency conflicts when using a Prefix Hash Tree (“PHT”) in which the underlying storage system is a Distributed Hash Table (“DHT”). An embodiment according to the within invention comprises a computer implemented method for resolving eventual consistency conflicts when using a PHT and DHT.

Abstract: Various of the disclosed embodiments provide systems and methods to compensate for certain event log errors. For example, when a system fails to record the occurrence of several events (a file closing, a file modification, a network socket opening, etc.) the disclosed embodiments may identify the discrepancy and provide a synthesized event sequence suitable to fulfill the purposes of the event log. In this manner, for example, a client may still be accurately billed for their use of a licensed software or system, even if their usage was punctuated with occasional failures to record their activity.

Abstract: A method, an apparatus, and a computer program product for wireless communication are provided. The apparatus determines that a file of interest is transmitted within a service, determines a failure to download the file of interest, and triggers a repair procedure of the file of interest at a time corresponding to an end of a file delivery event, wherein the time is derived from one or more information elements included in broadcast schedule description.

Abstract: A computing system includes a plurality of dispersed storage (DS) processing units operable to receive a continuous data stream, simultaneously disperse storage error encode the continuous data stream to produce a plurality of encoded data slices and store the plurality of encoded data slices in a DS memory.

Abstract: A computer implemented method and apparatus for normalizing and predicting time series data. The method comprises accessing collected data comprising a plurality of intervals; defining a variation for each interval in the plurality of intervals, wherein each variation is a cost value; clustering the cost values, wherein clustering identifies anomalies in the collected data; correcting the anomalies in the collected data; and creating a set of normalized data from the corrected data.

Abstract: A method begins by determining slice names of encoded data slices stored within a dispersed storage network (DSN). The method continues by determining dispersed storage (DS) units within the DSN storing a set of the encoded data slices associated with the slice names. The method continues by determining one or more revision numbers associated with the slice names. The method continues by determining if same slice names have different associated revision numbers and, when the same slice names have different associated revision numbers, adding the slice names to a revision mailbox for subsequent correction.

Abstract: An apparatus for providing improved data compression may include an encoder comprising a quantizer for encoding input data and a side model. The quantizer may be trained with respect to high priority data among the input data and may be configured to partially encode the input data by encoding the high priority data. The side model may be trained jointly with the training of the quantizer and is configured to model low priority data among the input data.

Abstract: A method, for handling partially inconsistent states among members of a cluster in an erratic storage network that responds to requests from a client, includes assigning a unique commit identifier corresponding to each successive modification of state of the cluster when an update request has been successfully completed and correlating an incoming request to a given member of the cluster with any commit identifiers necessary to satisfy the request. The method further includes detecting, on the incoming request to the given member of the cluster, whether the commit identifiers necessary to satisfy the request have been applied to the given member, and processing the incoming request based on whether the commit identifiers necessary to satisfy the request have been applied to the given member. Operation of the members can be asynchronous.

Abstract: A method, apparatus, and computer program product for processing data is disclosed. In one aspect of the invention, a computer implemented method comprises receiving, on one or more computers, a record having one or more attributes from a source system. The method also comprises measuring, on one or more computers, a data accuracy of the received record as compared to a golden record stored in a master data management system. One or more remediation actions are performed, on one or more computers, to enforce improvements to the measured data accuracy of the received record in the source system. In one or more embodiments, measurement of data accuracy comprises calculating, on one or more computers, an accuracy score defined by a closeness of the received record to the golden record.

Abstract: System and method embodiments are provided for integrity check and recovery in a key/value store. An embodiment method includes receiving a command to retrieve a data block stored in the key-value store system, the command indicating a key associated with the data block. The method further includes retrieving one or more copies of the stored data block including the key, a value, a data integrity check algorithm, and an integrity value, and performing data integrity check on the retrieved one or more copies of the data block using the data integrity check algorithm, the integrity value, and at least one of the key and the value. Upon one or more copies of the data block failing the data integrity check, the one or more copies of the data block are repaired and the data block is delivered.

Abstract: In various embodiments, an active-active replication solution is provided with one generic PL/SQL stored procedure (e.g., a PL/SQL stored procedure) configured to handle all application tables' conflict detection and resolution. In various aspects, the generic stored procedure simplifies initial setup, maintenance and management of complex mission critical active-active replication projects.

Abstract: According to a first aspect of the present invention there is provided a method, implemented by a webserver in communication with a database, for facilitating blogging by members of a number of social networks, said members being in communication with the web-server via a data network, for example the Internet, the method comprising the steps of: capturing login information for a plurality of users, said login information identifying the users; prompting the users to enter blog entries on one or more topics; updating the database to associate the blog entries with respective users and topics; and publishing web-pages presenting topics with links to said blog entries associated therewith.

Abstract: A computer-implemented method comprising partitioning data representing an input instance of a database including multiple tuples into multiple fragments of tuples, detecting tuples which violate a data quality specification in respective ones of the fragments, selecting a data cleaning asset on the basis of characteristics of errors in detected tuples for a fragment and based on declared asset capabilities, assigning a selected data cleaning asset to the fragment, the selected data cleaning asset to provide a set of candidate corrections for the detected tuples in the fragment, providing data representing an output instance of the database in which detected tuples are replaced with selected candidate corrections.

Abstract: Embodiments of the present application relate to a method for generating special topic pages, a device for generating special topic pages, and a computer program product for generating special topic pages. A method for generating special topic pages is provided. The method includes determining a configuration file bound to a special topic category corresponding to a received keyword, determining sub-categories that are under a category associated with the keyword in a quantity equal to the special topic content page module quantity in the configuration file, regarding the sub-categories as sub-category keywords in special topic content page modules, looking up product information that meets the query condition for the special topic content page modules in a database, regarding the looked up product information as content in the special topic content page modules, and generating the special topic content page modules within the special topic page.

Abstract: A computer implemented method for repairing records of a database, comprises determining a first set of records of the database which violate a functional dependency of the database, modifying records in the first set to make them consistent with the functional dependency to provide an output consistent database instance, determining a second set of records of the output consistent database instance comprising duplicate records, merging duplicate records in the second set in dependence on the functional dependencies of the records to provide a modified database instance.

Abstract: In accordance with disclosed embodiments, there are provided methods, systems, and apparatuses for fixing logical or physical corruption in databases using LSM trees including, for example, means for storing records in a LSM database at the host organization; processing transactions to the LSM database by writing the transactions into immutable extents for subsequent merge into the LSM database; recording a history of the transactions in a log; identifying corruption in at least one of the records of the LSM database represented within the immutable extents prior to use of the immutable extents in the LSM database; and correcting the identified corruption to the at least one of the records of the LSM database based at least in part on the recorded history of the transactions in the log during live operation of the LSM database. Other related embodiments are disclosed.

Abstract: A remote storage digital video recorder (RS-DVR) system is disclosed. The RS-DVR system includes a network interface to communicate data between the RS-DVR system and a subscriber system via a network, a file system module coupled to the network interface, an ingest agent coupled to the file system module to receive encoded media segments that represent media content files encoded at a plurality of different bitrates; and a storage architecture coupled to the file system to store the encoded media segments, resulting in stored media segments. The RS-DVR carries out a number of functions and operations to service multiple subscribers and associated subscriber systems, such as various storage device management operations, file structure techniques, assignment of recorded media to subscribers, file system indexing, and supporting shared and per-subscriber content rights.

Abstract: Techniques are provided for using near-full bloom filters for efficiently identifying hash slices in which the deviation between replicas is sufficient to justify remedial measures. Techniques are also described for adjusting the size of slices and the size of the bloom filters, so that the bloom-filter-to-bloom-filter comparison serves as an accurate indicator of the degree to which the contents of the slices of a slice pair have deviated. Slice size may vary from slice pair to slice pair, so that relatively sparsely populated portions of the ring (access key ranges into which fewer chunks fall) are represented by relatively larger slices, while relatively densely populated portions of the ring (access key ranges into which more chunks fall) are represented by relatively smaller slices.

Abstract: A system and method for matching transaction records to merchant records of a merchant profile database is provided, the transaction records containing transaction data of financial presentation devices that are presentable to a plurality of merchants, the transaction data including merchant identifying data that identifies the merchant for the transaction. The system includes a memory storing a plurality of transaction records, a merchant profile database storing a plurality of merchant profile records, a processor, and a match logic module executable by the processor and adapted to recognize a plurality of variations in the merchant identifying data contained in the transaction records, the match logic module operable to match each of the transaction records to an associated merchant profile record in the merchant profile database according to the recognized variations in the merchant identifying data.

Abstract: A computing device includes a processing module and an interface. The processing module is operable to receive, from a requesting device via the interface, a data storage request that includes data for storage. The processing module then determines whether substantially identical data is currently stored in a dispersed storage network (DSN) memory. When the substantially identical data is stored in the DSN memory, the processing module generates, for the requesting device, a second unique retrieval matrix of a plurality of sets of encoded data slices corresponding to the already stored substantially identical data, wherein the requesting device can recover at least a portion of the data based on the second unique retrieval matrix of the plurality of sets of encoded data slices.

Abstract: An object matching system comprises a plurality of disparate databases comprising data objects and a master data server. The master data server comprises a computer programmed to provide a plurality of adapters configured to connect to said plurality of disparate databases, a matching module configured to compare data objects provided by said plurality of adapters through use of an object matching rule to determine at least two matching data objects, and a data integrator configured to merge said at least two matching data objects to produce a master data object.

Abstract: Processing genetic data includes receiving two or more genetic data sets for an individual from one or more genetic data sources, wherein the genetic data sets comprises data pertaining to the individual's deoxyribonucleic acid (DNA); merging the genetic data sets from the one or more genetic data sources to obtain a set of merged genetic data for the individual, including: identifying data in the genetic data sets that is conflicting, the identified data corresponding to a genetic marker associated with a variation that occurs at a region in the individual's genome; analyzing the identified data to resolve a discrepancy attributed to the identified conflicting data and automatically determine an appropriate value that corresponds to the genetic marker, the analysis and the determination being based at least in part on contextual information; and storing the appropriate value in the set of merged genetic data.

Abstract: A customer communication system of a mobile communication network automatically generates a report concerning the location of a customer notification file within the customer communication system to allow for easier file review in response to an error message. In the examples, a file information database is accessed to obtain information regarding the expected file name or expected location of the customer notification file. Using the file information, a search is conducted for the location of the customer notification file. Error correction information is also collected regarding the customer notification file. The system then generates a report combining the information regarding the location of the customer notification file with the reference information regarding any error correction instructions. The report is published, thereby allowing any user responsible for the correction of an error message to access the file location information and the associated error correction instructions.

Abstract: A redaction process obtains redaction data indicating content to be redacted in a document. In addition, the redaction process obtains non-redaction data indicating content not to be redacted in the document. Furthermore, the redaction process obtains proximity data indicating proximate expressions to be matched against the document. In this manner, the redaction process processes the redaction data, non-redaction data and proximity data against the document to produce a redact list and a potential list. Upon receiving user selections from both the redact and the potential lists, the redaction process applies a redaction function to the document to produce a redacted version of the document.

Abstract: A method and system for managing and reconciling naming conflicts in a configuration database. Attributes are collected about a detected resource in a network. Valid names for the detected resource are created based on the collected attributes and a set of naming rules. A valid name is created for each naming rule, and the naming rules have a priority order. A master-alias table is search to locate a match between existing names of known resources recorded in the master-alias table and any of the valid names. A partial match of resource attributes is determined to exist when all of the valid names in the set of valid names do not match an existing name in a matching entry. The detected resource is determined to be a new resource or an existing resource based on a priority of the naming rules used to create the valid names.

Abstract: Described herein is a technology for designing a dashboard. In some embodiments, first and second dashboards are provided. Conflict analysis on the first and second dashboard is performed. The conflicts are resolved if any conflicts are detected. The first and second dashboards are merged to form a merged dashboard if no conflicts are detected or after resolving the conflicts.

Abstract: A computer-implemented method for repairing system files may include 1) identifying a request to repair a corrupted system file in an operating system, 2) receiving file metadata describing the corrupted system file and system metadata describing the operating system, 3) identifying an uncorrupted version of the corrupted system file by i) identifying a series of matching tests for matching the corrupted system file with the uncorrupted version, the series of matching tests including at least one file metadata item from the file metadata and at least one system metadata item from the system metadata, and ii) applying the series of matching tests in a predetermined order to a database of uncorrupted system files until a matching test matches the corrupted system file with the uncorrupted version of the system file. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A method for correcting service manual textual inconsistencies. Extracting textual procedures from service documents stored in a memory of a service document storage device. Each term of an extracted textual procedure terminology is compared to a correlating target name terminology for identifying any matching terms by a processor. An overlap similarity is computed as a function of the identified matching terms from the extracted textual procedure terminology and the correlating target name terminology. A determination is made whether the overlap similarity is greater than a predetermined similarity threshold. The service documents are modified to change the extracted textual procedure terminology to the correlating target name terminology in response to the overlap similarity being greater than the predetermined similarity threshold and the extracted textual procedure terminology not exactly matching the correlating target name terminology.

Abstract: Systems and methods are provided for data integrity checking in a computing system. In one exemplary embodiment, the method includes receiving, from each of a plurality of computing devices of the computing system, application transaction logs, wherein the application transaction logs are related to a plurality of applications. The method also includes comparing, by the central computing device, the received application transaction logs to a transactions recorded in a database to identify missing transactions. In addition, the method includes performing one or more actions in response to the identified missing transactions.

Abstract: A computer-implemented system and method performs an iterative process to assess the installation of an upgrade version of a database product for consistency with a baseline version of the database product. To assess the installation, the baseline version and the upgrade version are reconciled by modifying one or both of the baseline and upgrade versions. The modified baseline and upgrade versions are then analyzed to determine whether any remaining inconsistencies exist. Any remaining inconsistencies are then identified and classified, and reconciled. Thereafter, the process is repeated iteratively until the upgrade version is reconciled with the baseline version.

Abstract: According to some embodiments, a method and apparatus are provided to receive an indication of data corrections to a database and receive an indication that the data corrections to the database were verified. A first amount of points to award to a first user associated with the data corrections and a second amount of points to award to a second user associated with the verification of the data corrections is determined. The first amount of points is awarded to the first user and the second amount of points is awarded to the second user.

Abstract: A system, method, and medium for providing configurable item configuration data by receiving a plurality of configuration data sets from a plurality of sources, all which pertain to the same configurable item (CI), then using weighting rules and preferences to assign weight values for each option, feature, and component in each report according to discrepancies and commonalities between the data sets, creating a new data set for the configurable item by selecting options, features, and components having the greatest weight values among all of the data sets, assigning confidence factors to each option, feature, and component by weight comparisons between the plurality of data sets; updating a configuration management database entry for the configurable item accordingly.

Abstract: A computer-based method and scoring system for management of metadata is provided.

Abstract: A process for staging file assets on a live Web server is described that includes detecting an index page of the Web server, creating a staging folder on the Web server, wherein the staging folder does not default to a directory listing when accessed, inserting a randomized string into a name of file assets containing content to be staged, and storing the file assets in the staging folder. By creating the staging folder that does not default to a directory listing when accessed, a system is enabled where users may access the file assets while other users may not.

Abstract: A system, method, and auditing device for tracking removal of CPI. The auditing device includes a processor for executing a set of instructions and a memory for storing the set of instructions. The set of instructions are executed to receive one or more electronic devices for verification of CPI removal, the one or more electronic devices being one or more of a plurality of makes and models of electronic devices, determine whether CPI is included on the one or more electronic devices, record an identification and metadata of the one or more electronic devices in response to determining CPI is included on the one or more electronic devices, quarantine the one or more electronic devices until the CPI is verifiably removed, and record the identification and metadata for the one or more electronic devices to a database in response to determining the CPI was included on the one or more electronic devices.

Abstract: Data processing systems and methods are provided for correcting data inconsistencies within one or more databases and/or data repositories. In accordance with one implementation, a correction module is selected from a set of correction modules, and the selected correction module is configured to correct data inconsistencies of a solvable data inconsistency type. Data having an data inconsistency of the solvable data inconsistency type is identified within one or more databases or data repositories. If the selected correction module is unassociated with an obstacle data inconsistency type, or if the identified data not include an inconsistency of the obstacle data inconsistency type, then the correction module corrects the data inconsistency within the identified data.

Abstract: Systems, methods, and other embodiments associated with transient detection for predictive health management are described. In one embodiment, a method includes receiving a health signal from a data outlet. The health signal corresponds to a derivative variable derived from a combination of data processing system metrics not exposed beyond the data outlet. A transient is detected in the health signal. In response to detecting the transient, the method includes performing a corrective action. The example method may also include detecting the transient in a health signal from a data processing system by collecting historical values of the health signal; selecting a first statistical model that best fits the historical values; receiving a present value of the health signal; and applying the first statistical model to the present value of the health signal to determine whether the present value of the health signal is a transient.

Abstract: A customer communication system of a mobile communication network automatically generates a report concerning the location of a customer notification file within the customer communication system to allow for easier file review in response to an error message. In the examples, a file information database is accessed to obtain information regarding the expected file name or expected location of the customer notification file. Using the file information, a search is conducted for the location of the customer notification file. Error correction information is also collected regarding the customer notification file. The system then generates a report combining the information regarding the location of the customer notification file with the reference information regarding any error correction instructions. The report is published, thereby allowing any user responsible for the correction of an error message to access the file location information and the associated error correction instructions.

Abstract: Systems and methods for presenting a visual representation of the multimedia genres in multimedia content over time are provided. In particular, a user may be presented with a temporal genre chart that depicts the amount of each multimedia genre contained in a selected multimedia content. The temporal genre chart may also depict the variation in the amount of each multimedia genre over the duration of the multimedia content. Such temporal genre charts may provide a more accurate overview of multimedia content to the user than typical single genre tags or limited content previews.

Abstract: Apparatus, methods and media for correcting a defective check processing datum. The apparatus may include, and the methods and media may involve, a receiver that is configured to receive from memory a first transaction record. The transaction record may include Magnetic Ink Character Recognition (MICR) line data. The MICR line data may be electronically read from a check. The transaction record may include non-MICR data. The non-MICR data may be electronically read from the check. The apparatus may include, and the methods and media may involve, a processor that is configured to identify a defective datum among the MICR line data. The processor may identify a portion of the non-MICR data that corresponds to the defective datum. The processor may store in memory a second transaction record. The second transaction record may include corrected data that includes an element that is derived from the identified portion of the non-MICR data.

Abstract: A method for refining data discrepancies in data loads from multiple data stores includes receiving a data set containing data records from one or more data sources, comparing the received data set with a prior data set to identify delta records among corresponding records of the received and the prior data sets, recalculating a best record for data located in each of the corresponding delta records, and if a discrepancy exists in a data value for corresponding delta records, executing a refinement action rule. The refinement action rule includes at least one replace statement and search criteria. The method also includes capturing a user's interaction with a user interface presenting the data set, and storing the interaction in a data store as a refinement action rule. A system for implementing the method and a computer readable medium are also described.

Abstract: Systems and methods are provided for transmitting data for secure storage. For each of two or more data sets, a plurality of shares are generated containing a distribution of data from an encrypted version of the data set. The shares are then stored in a shared memory device, wherein a data set may be reconstructed from a threshold number of the associated plurality of shares using an associated key. Also provided are systems and methods for providing access to secured data. A plurality of shares containing a distribution of data from an encrypted version of a data set are stored in a memory device. A client is provided with a virtual machine that indicates the plurality of shares, and the capability to reconstruct the data set from the plurality of shares using an associated key.

Abstract: A time-efficient means for identifying and processing cascading deletes due to referential constraint violations includes: logging, to an error file, all primary key (“PK”) errors detected during table load operations; building a foreign key (“FK”) index for each child table; recursively probing each relevant FK index to identify all loaded rows that violate a referential constraint due to a PK error; logging all identified FK errors to the error file; and using the (preferably sorted) error file contents to identify, mark and physically delete table rows that violate a referential constraint. The described cascade delete processing methods make only a single pass through the table data, using ordinary computer files to track and organize rows identified for deletion. Use of error files rather than tablescans (multiple passes through the loaded table data) can provide a significant reduction in table load times, especially for large or intricately “related” tables.

Abstract: A method for refining data discrepancies in data loads from multiple data stores includes receiving a data set containing data records from one or more data sources, comparing the received data set with a prior data set to identify delta records among corresponding records of the received and the prior data sets, recalculating a best record for data located in each of the corresponding delta records, and if a discrepancy exists in a data value for corresponding delta records, executing a refinement action rule. The refinement action rule includes at least one replace statement and search criteria. The method also includes capturing a user's interaction with a user interface presenting the data set, and storing the interaction in a data store as a refinement action rule. A system for implementing the method and a computer readable medium are also described.

Abstract: Systems and methods for time series data error detection, correction, and transformation may detect gaps and anomalies in time series data, such as from a meter device, and may correct the gaps and adjust the anomalies prior to long-term record storage. Data forecasting may be used to correct the errors in the time series data. The error corrected data may be regarded as an actual set of time series data and become a base data set against which additional heuristic projections are generated. In addition, the time series data may be transformed into any number of physical and virtual device hierarchies that represent the underlying data source configurations, and may then be stored in an analytical database for further analysis. The hierarchies may be irregular and may change over time.