Abstract: A system and method for performing testing of data at a data warehouse is provided. The methodology of the invention describes steps to develop and further invoke one or more data quality-accuracy test cases from a framework. The data quality-accuracy test cases check the sanity of the data stored at the data warehouse. The one or more data quality-accuracy test cases are developed based on at least one predefined strategy, which in turn are stored in the framework. The methodology further executes the developed one or more data quality-accuracy test cases as either batch or independently, based on the requirements of the test. Thereafter, the methodology maintains traceability of the executed test at the data warehouse, incorporating details from the development of the one or more data quality-accuracy test cases to the final output of the test.

Abstract: A computer-implemented method for detecting a set of inconsistent data records in a database including multiple records, comprises selecting a data quality rule representing a functional dependency for the database, transforming the data quality rule into at least one rule vector with hashed components, selecting a set of attributes of the database, transforming at least one record of the database selected on the basis of the selected attributes into a record vector with hashed components, computing a dot product of the rule and record vectors to generate a measure representing violation of the data quality rule by the record.

Abstract: A system and method for identifying anomalies in indicators, such as key performance indicators (KPIs) of a telecom system are disclosed. The method can learn over time behavior of the indicator and can statistically identify what should be considered anomalous. Learning can be performed on a per indicator basis that each presents different statistical qualities. The method can associate the indicator to a profile, such as one of several statistical distributions and can operate accordingly. Association may be determined by the correlation of the indicator to statistical distribution. The method can identify correlations between indicators when identifying the statistical distribution and especially when the associated statistical distribution is an unidentified profile. The method can include comparison of actuals versus prediction and sending alerts when anomalies are found.

Abstract: In response to receiving a request from a client to store an object, a key-durable storage system may assign the object to a volume in its data store, generate a key for the object (e.g., an opaque identifier that encodes information for locating the object in the data store), store the object on one disk in the assigned volume, store the key redundantly in the assigned volume (e.g., using a replication or erasure coding technique), and may return the key to the client. To retrieve the object, the client may send a request including the key, and the system may return the object to the client. If a disk fails, the system may determine which objects were lost, and may return the corresponding keys to the appropriate clients in a notification. The system may be used to back up a more expensive object-redundant storage system.

Abstract: Data management systems and methods include a cloud-based platform coupled to a system of agents or folders hosted on client devices. The platform does not store actual data but instead makes use of metadata provided by the agents to track a location of all data in the system and manage the distributed storage, movement and processing of the actual data among the agents. In so doing, the platform pools networked storage into “virtual clusters” using local storage at the agents. The agents collectively monitor, store, and transfer or move data, and perform data processing operations as directed by the platform, as described in detail herein. The agents include agents hosted on or coupled to processor-based devices, agents hosted on devices of a local area network, agents hosted on devices of a wide area network, agents hosted on mobile devices, and agents hosted on cloud-based devices.

Abstract: Example systems and methods of database migration optimized by feedback are presented. In one example, a migration of database data from a first to a second database by multiple concurrent processes may be initiated on a computing system. Processing time of at least some of the processes may be monitored during the migration. Based on this monitoring, at least one portion of the database data being migrated by one of the concurrent processes may be segmented into multiple segments, wherein each of the multiple segments may be migrated by a separate one of the concurrent processes. Also, a load on the computing system may be monitored during the migration. Based on this monitoring, a number of the concurrent processes may be adjusted. In other examples, consistency checking for subsequent database migrations may be based on consistency checking results for the current migration.

Abstract: Method, system, and computer program product embodiments for recording data on a contactless integrated circuit (IC) memory associated with a data storage cartridge are provided. In one exemplary embodiment, an index of a plurality of files to be recorded on a storage media of the data storage cartridge is parsed with a table of contents (TOC) profile file to build a table of contents (TOC) specific to an owning application of the plurality of files. The TOC is written to the contactless IC memory.

Abstract: Techniques for configuring validation rules in a client-server architecture, and for enforcing such validation rules are provided. A developer is enabled to configure a display screen for an application to enable a user at a client to input data. The developer is further enabled to input a validation rule that is configured to be applied to validate the data at the client and/or at a server. The validation rule is integrated into code of the application. During execution of the application, a client-side rules engine may be present to evaluate the validation rule at the client, and a server-side rules engine may be present to evaluate the validation rule at the server. The client-side rules engine and server-side rules engine may be configured to evaluate validation rules in an asynchronous manner.

Abstract: According to an aspect, a method for correcting an invalid script in a web application includes determining an invalid reference in an invalid script. A storage location is determined in a database corresponding to the invalid reference based on a data relationship mapping, wherein the data relationship mapping indicates the correspondence between the reference and a storage location in the database. An up-to-date value at the storage location is queried and the queried up-to-date value is determined to be the correct value of the invalid reference.

Abstract: The one or more non-transitory computer readable storage mediums storing one or more sequences of instructions are provided. The one or more non-transitory computer readable storage mediums executed by one or more processors causes (i) obtaining a associated data of an individual from one or more identities, (ii) extracting information from the associated data to obtain an extracted information, (iii) standardizing the extracted information to obtain a standardized extracted information, (iv) obtaining additional information associated with the one or more identities based on the standardized extracted information, (v) calculating a confidence level for the additional information, (vi) comparing, the additional information with trustworthy information from a database to verify an accuracy of the additional information, and (vii) identifying the individual from the one or more identities and the associated data based on the confidence level and the accuracy.

Abstract: A methodology for assisting a user in a combination of functional blocks by defining a value representative of an affinity degree among the functional blocks. Such affinity degree is influenced by available historic data derived by previous uses of the functional blocks which had been recorded into a repository.

Abstract: A computer determines that the type of one or more of a relational operator and operands of a relational expression originated in a first type system, and determines the sign of at least one of the operands. The computer rewrites the relational expression based on the sign of at least one of the operands, sends the rewritten relational expression for evaluation in a second type system, and receives the evaluated rewritten relational expression after evaluation in the second type system. The computer can rewrite the relational expression by generating a group of terms joined disjunctively, as well as by generating a group of conjunctive terms joined disjunctively.

Abstract: Systems and methods are disclosed for tracking the conversion of data from a hardcopy or physical format such as radiograph film to electronic format such as DICONDE format. The method provides the capability of automatic consistency checks of image quality generated by the digitizer as well as allows for process quality checks by users. Authentication and authorization is built into the digitization process to allow access to authorized users for a particular task. The system provides the capability to generate statistical process control (SPC) curves and reports of the consistency checks. Disaster recovery capability is built into the system.

Abstract: A system and method of detecting cache inconsistencies among distributed data centers is described. Key-based sampling captures a complete history of a key for comparing cache values across data centers. In one phase of a cache inconsistency detection algorithm, a log of operations performed on a sampled key is compared in reverse chronological order for inconsistent cache values. In another phase, a log of operations performed on a candidate key having inconsistent cache values as identified in the previous phase is evaluated in near real time in forward chronological order for inconsistent cache values. In a confirmation phase, a real time comparison of actual cache values stored in the data centers is performed on the candidate keys identified by both the previous phases as having inconsistent cache values. An alert is issued that identifies the data centers in which the inconsistent cache values were reported.

Abstract: A description of types of metadata can provide, in one embodiment, an index to the types of metadata in a time based metadata track that can be associated with a time based media track having audio or video or both. The description can be non-time based and be separate from the metadata track, and the description can be examined to determine whether a particular type of metadata exists in the time based metadata track without having to search through the track to determine whether the particular type of metadata exists.

Abstract: Method and apparatus for recording associations with logs are described. In one embodiment, the method comprises obtaining a first media identifier corresponding to a first media; accessing a log that contains one or more entries that associate two or more media identifiers with each other; and determining that the first media is related to a second media based on the log indicating that a second media identifier is associated with, but different from, the first media identifier.

Abstract: A global information management system (GIMS) includes a collection of standards and methods that allow information management on a global scale. A GIMS computer network includes a central registration database (CRD) and one or more GIMS computer systems connected over a network. Each GIMS computer system includes a relational database having a set of standardized tables. The CRD may provide a GIMS network-unique system ID to each GIMS computer system. Each GIMS computer system uses the GIMS network-unique system ID as part of a primary key for each record generated by and stored in the set of standardized tables of the GIMS database. The GIMS enables global database normalization through the globally unique identification of database records.

Abstract: Methods, systems, and computer program products for identifying a container associated with a plurality of files are disclosed. According to one aspect, a method includes providing for associating a file with a container associated with at least one file to form a plurality of associated files. The prevailing metadata is not required to be from all of the plurality of associated files. Further, the container may be identified based on the prevailing metadata.

Abstract: A data enrichment system may include an attribute relevance module to measure relevance of an attribute to a data object to be enriched. The data object may include the attribute including a known or an unknown value. An output value confidence module may calculate a confidence of an output value of a source used for enrichment of the data object. The output value may represent the known and/or unknown values of the attribute. The system may use the measured relevance of the attribute and the calculated confidence of the output value to determine assignment of the known or unknown values to the attribute.

Abstract: Reliability of data reports can be determined by a device that receives a number of reports from different sources. One method includes: receiving data reports from devices. The data reports are associated with an occurrence of an event. The method also includes determining reliability data representing reliability of the data reports. The reliability can be determined based on one or more different defined characteristics such as the location at which a data report was generated relative to the location of the event, whether the data report was the most recently-received data report and/or the number of data reports reporting that an event is ongoing relative to the number of data reports reporting that the event is no longer ongoing. The method can also include determining whether a data report includes information indicative of a false positive report or a false negative report.

Abstract: A method, article of manufacture, and apparatus for efficient conflict resolution among stateless processes is disclosed. In some embodiments, a file system view request is sent to a process manager. A check is then made to ensure that a connection to the requested file system is available. A stateless process to interact with the file system is created, a stateless process to display the file system is created, and a state machine to check the validity of operational requests to be performed on the file system is also created. A display is then used to select one conflict resolution mechanism. A plurality of operational requests to interact with the file system is sent to the process manager. For each operational request, the state machine is used to check for valid requests. The valid requests are then performed. For each invalid operational request, the selected conflict resolution mechanism is used to determine whether to terminate or perform the invalid operational request.

Abstract: A method of composing an integrated ontology is provided. The method makes use of feature models for the process of modular development of ontologies. The feature models are adapted to assist the user in the process of selection of appropriate and combinable ontologies from an ontology repository for a given use case scenario. The usage of a feature model provides a view of all possible combinations, i.e. all combinations that do not result in an inconsistent ontology. The feature model is specifying dependencies between different ontologies thereby expediting the selection of appropriate ontologies. The usage of reasoning techniques provides for an in-situ consideration of restrictions for the selection of ontologies.

Abstract: Systems and methods are disclosed for checking the data integrity of a data object copied between storage pools by comparing data fingerprints of data objects, comprising scheduling a series of successive copy operations over time for copying a data object from a source data store to a target data store; generating a partial fingerprint of the data object at the source data store that creates a fingerprint from a subset of the data object; sending the partial fingerprint of the data object to the target data store; sending any new data contents to the target data store; and creating a partial fingerprint of the data object at the target data store and comparing it to the received partial fingerprint to determine if they differ, thereby allowing incremental verification that the copy of the data object at the target data store is the same as at the source data store.

Abstract: This disclosure is directed to techniques for providing comparing first and second XML files to one another. According to these techniques, a computing device (e.g., a version control service executing on the computing device), may be configured generate at least two edit transcripts that each include one or more operational changes that may be applied to data elements of the first XML file to arrive at data elements of the second XML file (or vice versa). The computing device may select at least one optimal edit transcript based on which of the number of operational changes of the at least two edit transcripts.

Abstract: Methods and systems are disclosed for detecting data divergence or inconsistency across replicas of data maintained in replica nodes in a shared-nothing distributed computer database system. The replica nodes communicate with a coordinator node over a computer network. The method includes the steps of: (a) receiving an operation at the coordinator node; (b) transmitting the operation to the replica nodes to be executed by each replica node to generate an operation result and a hash representation of the operation or of the operation result; (c) receiving the operation result and the hash representation generated by each of the replica nodes; and (d) determining whether the operation resulted in data divergence or inconsistency by detecting when the hash representations received from the replica nodes are not all the same.

Abstract: A method of correlating data for multiple product configurations is provided comprising enhancing, by a processor, data set definition to accommodate data models of data sets describing multiple product configurations. The method also comprises comparing, by the processor, values of the data sets utilizing at least one matching algorithm and effectivity expressions identifying relevant rows for comparison in the data sets. The method also comprises enhancing, by the processor, the at least one matching algorithm to identify perfect and partial matches between the data sets wherein values of all data contained in the data sets are compared in one single operation comprising simultaneous validation of engineering data for the multiple product configurations.

Abstract: A data collection system that provides the means to collect, store and make data available for a location analytics inference pipeline. The system incorporates a feedback mechanism enabling algorithms produced from the inference pipeline to drive the collection strategy to yield higher data quality and to produce reference data for model validation.

Abstract: A data integration processing device configured to integrate a plurality of graphs includes: an integration processing method selecting means 4 for selecting an integration processing method used for integration of inputted graphs; and an integration process executing means 6, having a plurality of integration processing methods, for integrating a plurality of graphs by executing an integration process in accordance with an integration processing method selected by the integration processing method selecting means 4 from among the plurality of integration processing methods. The integration processing method selecting means 4, with respect to each of nodes in inputted graphs, selects an integration processing method used for integrating lower nodes in accordance with frequency that the lower nodes are consistent, when upper nodes are consistent.

Abstract: A file storage apparatus comprises: duplication determination unit that determines whether file supplied from client apparatus and file stored in storage unit coincide with each other in same format, and stores the file supplied from client apparatus in the storage unit if the files do not coincide in the same format; and storage management unit that associates, if duplication determination unit determines that the files coincide in the same format, format of the file supplied from the client apparatus with the file stored in the storage unit, reads file stored in the storage unit in response to file read request from client apparatus, converts, if format associated with the read file exists, the read file into the format, and provides the converted file.

Abstract: Systems, devices, features, and methods for updating a geographic database, such as a navigation-related database, and/or reporting discrepancies associated with geographic data of the geographic database are disclosed. For example, one method comprises capturing a photograph of an observed geographic feature in a geographic region. Comment information corresponding to the observed geographic feature may be stored. The comment information is indicative of a discrepancy between the observed geographic feature and the geographic data corresponding to the geographic region. The comment information may be associated with the photograph to generate a report, and the report is transmitted.

Abstract: An architecture for a multimedia search system is described. To perform similarity matching of multimedia query frames against reference content, reference database comprising of a cluster index using cluster keys to perform similarity matching and a multimedia index to perform sequence matching is built. Methods to update and maintain the reference database that enables addition and removal of the multimedia contents, including portions of multimedia content, from the reference database in a running system are described. Hierarchical multi-level partitioning methods to organize the reference database are presented. Smart partitioning of the reference multimedia content according to the nature of the multimedia content, and according to the popularity among the social media, that supports scalable fast multimedia identification is also presented.

Abstract: A method for converting a distributed system includes providing a central database in communication with a database, in which the central database includes central schema information for accessing data stored in the central database. The method further includes transferring content data and schema information from the database to the central database for storage. The method further includes connecting schema information stored in the database to the central schema information such that each database is configured to receive a request for information, redirect the request from the database to the central database based on the referenced schema information, and receive, from the central database, the requested information.

Abstract: A method for data mining on compressed data vectors by a certain metric being expressible as a function of the Euclidean distance is suggested. In a first step, for each compressed data vector, positions and values of such coefficients having the largest energy in the compressed data vector are stored. In a second step, for each compressed data vector, the coefficients having not the largest energy in the compressed data vector are discarded. In a third step, for each compressed data vector, a compression error is determined in dependence on the discarded coefficients in the compressed data vector. In a fourth step, at least one of an upper and a lower bound for the certain metric is retrieved in dependence on the stored positions and the stored values of the coefficients having the largest energy and the determined compression errors.

Abstract: A mechanism is provided in a data processing system for reliable asynchronous solid-state device based de-duplication. Responsive to receiving a write request to write data to the file system, the mechanism sends the write request to the file system, and in parallel, computes a hash key for the write data. The mechanism looks up the hash key in a de-duplication table. The de-duplication table is stored in a memory or a solid-state storage device. Responsive to the hash key not existing in the de-duplication table, the mechanism writes the write data to a storage device, writes a journal transaction comprising the hash key, and updates the de-duplication table to reference the write data in the storage device.

Abstract: Provided are techniques for determining whether a character code point value of a first plurality of character code point values corresponds to a second character code point value from a second plurality of character code point values, first value associated with a first encoding version and the second value associated with a second encoding. In response to the first value does not corresponding to any of the second character code point values, a determination is made as to whether the value corresponds to a third character code point value of a third plurality of code point values stored in a character value record table (CVRT). In response the value corresponding to the third value, an entry in the CVRT that associates the character with the third value is made; and the character is stored in conjunction with an application associated with the second encoding using the third value.

Abstract: In a Virtual Input/Output (I/O) Server (VIOS) partition within a data processing system that comprises cluster-aware VIOSes, a method includes: performing, via a backup/restore utility of a cluster aware (CA) operating system (OS) executing on a processor resource of the first VIOS partition, a backup operation on the first VIOS partition, which creates a first configuration backup file having configuration information about the hardware, logical and virtual devices of the VIOS partition; storing the configuration backup file within local storage; and responsive to receipt of a VIOS restore command: retrieving the configuration backup file from the local storage; and restoring the configuration of the hardware, logical and virtual devices of the first VIOS to a state that existed at a time at which the backup operation creating the configuration backup file was performed.

Abstract: A unified framework to understand multimedia signals utilizes the loosely annotated multimedia data on the Web, analysis it in various signal domains, such as text, image, audio and combinations thereof, and builds an association graph called the “Multimedia Brain,” which basically comprises visual signals, audio signals, text phrases and the like that capture a multitude of objects, experiences and their attributes and the links among them that capture similar intent or functional and contextual relationships.

Abstract: Techniques are described for identifying conflicts between an index of temporal keys and a prospective temporal key. The prospective temporal key specifies a prospective range of time. Embodiments scan the index to identify a first temporal key that potentially conflicts with the prospective temporal key. The first temporal key specifies a first range of time and is identified based on a comparison between the first range of time and the prospective range of time. Embodiments determine whether the prospective temporal key conflicts with any temporal keys in the index, where the prospective temporal key conflicts with the first temporal key if the first range of time overlaps with the prospective range of time and the first temporal key is not a pseudo-deleted key, and such that the prospective temporal key does not conflict with any temporal keys if the temporal key does not conflict with the first temporal key.

Abstract: This disclosure is related to further approximating multiple data vectors of a dataset. The multiple data vectors are initially approximated by one or more stored principle components. A processor performs multiple iterations of determining an updated estimate of a further principle component based on the multiple data vectors that are initially approximated by the one or more stored principle components. The processor performs this step such that the updated estimate of the further principal component further approximates the dataset. In each iteration the processor constrains the updated estimate of the further principal component to be orthogonal to each of the one or more stored principal components. The data vectors of the dataset are not manipulated but remain the same data vectors that are approximated by the stored principal components.

Abstract: A method of determining and optimizing the location of a new insurance agency is disclosed to increase market penetration of underrepresented markets. The method comprises the use of a scoring algorithm to rank various geographic regions or related zip codes. The scoring algorithm may be implemented by a location modeling system based on variables selected by a user.

Abstract: A method and system of optimizing a ranked list (5) of recommended items that is based in a multidimensional data set (2) comprising context-aware information about the of a plurality of users and a plurality of items. A mathematical recommendation model (3) is trained with the multidimensional data set (2) by applying a smooth objective function that allows the use of fast optimizing algorithm and that quantifies the relevance of the ranked lists provided by an optimization algorithm.

Abstract: Disclosed is system for monitoring data changes during a data replication process. The system includes a modeling module configured to select tables and fields to be monitored during execution of the data replication process, a trigger module configured to track changes of data being generated during execution of a program by inserting triggers into a destination system at the start of a program execution and then dropping the trigger at the end of program execution, a snapshot module configured to track changes of data being generated during execution of a program by generating a snapshot of data at the beginning and the end of program execution, and a report module configured to generate a report indicating changes in data based on the changes in data indicated by the triggers and based on the changes in data indicated by the snapshots of data.

Abstract: In response to receiving a request from a client to store an object, a key-durable storage system may assign the object to a volume in its data store, generate a key for the object (e.g., an opaque identifier that encodes information for locating the object in the data store), store the object on one disk in the assigned volume, store the key redundantly in the assigned volume (e.g., using a replication or erasure coding technique), and may return the key to the client. To retrieve the object, the client may send a request including the key, and the system may return the object to the client. If a disk fails, the system may determine which objects were lost, and may return the corresponding keys to the appropriate clients in a notification. The system may be used to back up a more expensive object-redundant storage system.

Abstract: A system and method for submission of digital assets to a digital asset submission system are disclosed. The digital asset submission system can manage submissions of digital assets to a network-based distribution system. Submission of digital assets to the digital asset submission system can be performed over a network in a controlled manner such that the digital assets can be validated prior to transmission of the digital assets to the digital asset submission system. Advantageously, digital assets to be submitted for distribution can be substantially validated before the digital assets are transmitted to the digital asset submission system.

Abstract: An approach is provided for determining at least one entity specified in at least one data record. The approach further involves determining one or more data sources available from the at least one entity. The approach further involves processing and/or facilitating a processing of the one or more data sources to determine information for a verification, an update, or a combination thereof of the at least one data record.

Abstract: A system and method for reading file blocks includes reading an inode associated with the file from the file system, the inode including one or more first block pointers, determining a height of a file tree associated with the file, and determining whether a value of a second block pointer selected from the one or more first block pointers is consistent with the file having been stored using a block allocation pattern. When the value of the second block pointer is consistent with the file having been stored using the block allocation pattern the method further includes pre-fetching a plurality of file blocks based on the block allocation pattern, verifying that the pre-fetched file blocks are consistent with the file tree, and retrieving one or more data blocks of the file. In some examples, the block allocation pattern corresponds to the file being stored in streaming order to consecutively and contiguously located blocks.

Abstract: Guarded file access operations are provided for creating and using guarded file descriptors, which can detect and prevent erroneous file access operations in computer programs. A file descriptor can be associated with a guard identifier to create a guarded file descriptor. The association can be established when the file is opened, and can be maintained independently of the computer program, which ordinarily maintains its own association between files, file descriptors, and guard identifiers. Subsequent file operations using the guarded file descriptor check that the guard identifier previously associated with that file descriptor is presented, and generate errors without performing the requested file operations if the correct guard identifier is not presented. This check serves as a validation of the computer program's use of file descriptors. An error and stack trace can be generated for use in analyzing a cause of the guard violation.

Abstract: A semantic layer (universe), which is created on a source database (DB), is migrated to a target DB. The migration includes pre-migration steps, actual migration and post-migration steps. The pre-migration steps prepare the target DB for the actual migration by configuring the target DB and determining the differences between the source DB and the target DB. During the actual migration, data, tables and views are migrated to the target DB conforming to the target database structure, functions and configuration. A new universe is created on the target database and all consumers of the source universe such as created reports are changed to refer to the new universe.

Abstract: A method for correcting service manual textual inconsistencies. Extracting textual procedures from service documents stored in a memory of a service document storage device. Each term of an extracted textual procedure terminology is compared to a correlating target name terminology for identifying any matching terms by a processor. An overlap similarity is computed as a function of the identified matching terms from the extracted textual procedure terminology and the correlating target name terminology. A determination is made whether the overlap similarity is greater than a predetermined similarity threshold. The service documents are modified to change the extracted textual procedure terminology to the correlating target name terminology in response to the overlap similarity being greater than the predetermined similarity threshold and the extracted textual procedure terminology not exactly matching the correlating target name terminology.

Abstract: A method for using confidence factors in forming a system may include receiving a tolerable confidence factor. The method may also include utilizing only resources and relationships of a plurality of resources and relationships with confidence factors equal to or greater than the tolerable confidence factor to form the system.