Abstract: A computational device receives a plurality of versions of an input data schema. At least one element is selected from the plurality of versions of the input data schema based on an expected result. A combined schema is generated based on the at least one selected element. The input data is processed according to the combined schema.

Abstract: A computer system for converting data from one of a plurality of different legacy systems to one of a plurality of different target systems includes one or more processors, memory, a database stored in the memory, and a software framework stored in the memory for execution by the one or more processors. Each of the plurality of different legacy systems has a legacy data format and each of the plurality of different target systems has a target data format. The software framework includes a plurality of software components callable by an output adaptor for performing a plurality of data conversion functions. The software framework is configured to interact with each of the plurality of different legacy systems having the legacy data format and/or each of the plurality of different target systems having the target data format. Other example computer systems and methods are also disclosed.

Abstract: A system and a method for linking textual and physical concepts are disclosed. The method includes extracting candidate phrases from a knowledge base for a device, the candidate phrases including noun phrases. A set of candidate concepts is generated, based on the extracted noun phrases. Provision is made, e.g., on a graphical user interface, for a user to generate mapped concepts for physical components of the device by selecting, for each concept to be mapped, a physical component shown in a graphical representation of the device and at least one of the candidate concepts which is to be linked to that physical component. The knowledge base is indexed, based on the mapped concepts. In this way, textual expressions in the knowledge base are linked to a respective physical component through one of the mapped concepts.

Abstract: An object-oriented system provides a comprehensive and integrated tool to manage, operate, analyze and inspect structures by providing 3-D visualization of the structures, a database interface, connectivity with one or more databases, a data display and analysis capabilities. The structural model is stored as an object-oriented, serialized file as a series of objects, including primitives, coordinates, object names, group names and other object identifiers. The system integrates various types of data, including tabulated textual data, annotated engineering drawings, photographic records, graphical plots, audio and videotaped records, from different tables and databases. Data are displayed to the user based on queries that the user submits to the system, which queries are evaluated at run-time. As a result, the user achieves unparalleled flexibility in data analysis and evaluation.

Abstract: A method, system, and computer program product for managing time dimension tables are disclosed. In a first aspect, the method comprises providing an intelligent time dimension agent application and optimizing a time dimension table by the intelligent time dimension agent based upon changing data in associated fact tables. In a second aspect, the system comprises a processor and a memory coupled to the processor, wherein the memory includes an application which, when executed by the processor, causes the processor to carry out the steps of the method. In a third aspect, the computer program product comprises a non-transitory computer readable medium having a computer readable program recorded thereon, wherein the computer readable program, when executed on a computer device, causes the computer device to carry out the steps of the method.

Abstract: Resources for data lineage discovery, data lineage analysis, role-based security, notification. The resources may include or involve machine readable memory that is configured to store a technical data element (“TDE”); a receiver that is configured to receive a query for data lineage information corresponding to a business element identifier; and a processor configured to: register a logical association between the business element identifier and the TDE; and formulate the data lineage information of the TDE associated with the business element identifier. The receiver may be configured to receive a criterion that is required to access one or more technical data elements (“TDEs”) associated with the business element identifier. The receiver may be configured to receive an election to receive a notification of a change of data lineage. The processor may be configured to toggle between a first data lineage graph and a second data lineage graph.

Abstract: Resources for data lineage discovery, data lineage analysis, role-based security, notification. The resources may include or involve machine readable memory that is configured to store a technical data element (“TDE”); a receiver that is configured to receive a query for data lineage information corresponding to a business element identifier; and a processor configured to: register a logical association between the business element identifier and the TDE; and formulate the data lineage information of the TDE associated with the business element identifier. The receiver may be configured to receive a criterion that is required to access one or more technical data elements (“TDEs”) associated with the business element identifier. The receiver may be configured to receive an election to receive a notification of a change of data lineage. The processor may be configured to toggle between a first data lineage graph and a second data lineage graph.

Abstract: According to a present invention embodiment, a system determines a relationship between source and target database tables, and includes a computer system including at least one processor. Potential pivot keys of the target database table are determined, and maps are created for each potential pivot key between the database tables based on distinct values. Transformations for each map are generated that enable target data to be produced from source data. The transformations for each potential pivot key are analyzed and the potential pivot key with the transformations that generate the greatest amount of matching data is selected as the resulting pivot key. The database table columns corresponding to the resulting pivot key are determined to be associated by the relationship. Embodiments of the present invention further include a method and computer program product for determining a relationship between source and target database tables in substantially the same manner described above.

Abstract: A method, system and computer program product for storing rich text data that comprises identifying plain text and rich text attributes from the rich text data, wherein the rich text attributes specify richness features of the plain text, storing the plain text in a first legacy data record, and storing the rich text attributes in a second legacy data record prefixed by a token, wherein the token is recognizable by an application capable of applying the rich text attributes to the plain text to present the rich text data.

Abstract: A method for determining the authorship of a picture, wherein the method comprises at least the following steps: —transferring the picture to be examined or parts of the picture to be examined with the aid of a digitizing means, in particular a scanner, into at least one data set, —analyzing the data set(s) and determining characteristic features or parts of characteristic features, in particular dots or lines or dot or line groups or patterns, contained in the data set in digitized form, wherein the characteristic features to be determined are stored in a database, —and wherein the database includes an additional associated data set for each of the stored characteristic features.

Abstract: The APPARATUSES, METHODS AND SYSTEMS FOR PROVIDING A VIRTUAL DEVELOPMENT AND DEPLOYMENT ENVIRONMENT INCLUDING REAL AND SYNTHETIC DATA (“SYNONYM”) provides a development and test environment with reduced database storage requirements that uses synthetic data based on anonymized real data. SYNONYM allows the use of sensitive data for testing while protecting such data as required by privacy laws, secrecy laws and company policies.

Abstract: Online transactional processing (OLTP) transactions and online analytic processing (OLAP) transactions (e.g., aggregation operations, etc.) are both initiated on at least one table within a columnar oriented insert-only database in which at least a portion of the transactions are executed concurrently. Subsequently, it is checked, for each transaction, whether a corresponding record number is visible for the OLTP transaction using a create baselist bitvector and a delete baselist bitvector for the corresponding table. Thereafter, the OLTP transactions and the OLAP transactions having visible corresponding record numbers are executed. Related apparatus, systems, techniques and articles are also described.

Abstract: A method and apparatus for parallelization of data processing. The method including: parsing a data processing flow to split a write table sequence for the data processing flow; generating a plurality of instances of the data processing flow based at least in part on the split write table sequence; and scheduling the plurality of instances for parallelization of data processing.

Abstract: Method and system for designing a business domain model, a Data Warehouse (DW) model and a mapping therebetween synchronously are provided. The method includes: designing a business domain model based on business logic; designing a DW model based on a structure of a data cube in a DW and designing a mapping between the business domain model and the DW model synchronously; analyzing the business domain model, the DW model and the mapping therebetween based on a predetermined syntax rule; and generating a transactional database corresponding to the business domain model, a DW database corresponding to the DW model, and a mapping between data in the transactional database and in the DW database automatically and synchronously. The system includes a business domain model design unit, a DW model design unit, a mapping design unit, an analysis unit and an automatic generation unit. Mappings are designed more easily, efficiently and accurately.

Abstract: The disclosed device provides idealized and reusable data source interfaces. The process of idealizing includes reengineering of an original data model using a surrogate key based model. The technique emphasizes readability and performance of the resulting operational data store. In, addition, the disclosed device provides a unique method for handling changes which allows for all types of changes to be automatically implemented in the operational data store by table conversion. Further the disclosed device provides inline materialization which supports a continuous data flow dependency chain. A continuous dependency chain is used to provide automated documentation as well as a dynamic paralleled transformation process.

Abstract: A data transfer system and method are provided in the present invention. Wherein, the data transfer system and method comprises a source data obtaining service module and a target table updating service module, both of which are divided into a main part and an affiliated part, and wherein the affiliated part is a dynamic function library, which can package sub-processings such as source data obtaining, data transformation and data inserting/updating. Meanwhile, the data transfer system and method can support quasi real-time data transfer tasks and real-time data transfer tasks at the same time. The data transfer system and method support multi-computer disaster tolerance and extension, and the customization of the dynamic function library can facilitate the change in the requirements of data transfer.

Abstract: A method and system for flexibly transferring data from one or more data sources to one or more data destinations within an information network where each of the one or more data sources have data in a particular source format and each of the one or more data destinations have data in the same or another particular destination format using a parameter database that includes parameters to control the transfer of data, a scheduler that initiates the transfer of data, and a data loader in communications with the parameter database and scheduler that, upon initiation by the scheduler, extracts data from the one or more data sources, manipulates the extracted source data into one or more destination formats associated with the one or more data destinations, and inserts the data into one or more data destinations according to the parameters within the parameter database.

Abstract: Embodiments of the disclosed invention include an apparatus, method, and computer program product for creating and executing a client workflow for web data extraction. For example, the disclosed embodiments provide a system for web data extraction. The system includes a data storage component configured for storing a plurality of preconfigured reusable software components that provide services for creating a client workflow for web data extraction. The system also includes a communication interface operable to receive workflow definitions from a client for creating the client workflow for web data extraction utilizing at least one of the plurality of preconfigured reusable software components. The system has a processor for executing instructions to run the client workflow for web data extraction.

Abstract: A method, apparatus, and machine-readable medium are disclosed for processing change information from a first system comprising a first database at a second system comprising a second database. An embodiment of the method includes receiving a first message comprising the change information at the second system, processing the first message into a processed message, determining whether a custom script is needed in the processing, and incorporating the change information in the second database. An embodiment of the machine-readable medium includes instructions which when executed by a processor cause the processor to perform the method. An embodiment of the apparatus includes an input module configured to receive the first message comprising the change information, a processing module configured to process the first message into the processed message, and a transaction module configured to incorporate the change information in the second database.

Abstract: A computing device maintains an input history in memory. This input history includes input strings that have been previously entered into the computing device. When the user begins entering characters of an input string, a predictive input engine is activated. The predictive input engine receives the input string and the input history to generate a candidate list of predictive inputs which are presented to the user. The user can select one of the inputs from the list, or otherwise continue entering characters. The computing device generates the candidate list by combining frequency and recency information of the matching strings from the input history. Additionally, the candidate list can be manipulated to present a variety of candidates. By using a combination of frequency, recency and variety, a favorable user experience is provided.

Abstract: A computer implemented method and apparatus calculate a freshness cost for each of a plurality of information integration flow graphs and select one of the plurality of information integration flow graphs based upon the calculated freshness cost.

Abstract: A query is received by a database server from a remote application server. The query is associated with a calculation scenario that defines a data flow model that includes one or more calculation nodes with each calculation node defining one or more operations to execute on the database server. Thereafter, at least one of the calculation nodes is transformed into a star schema. Next, the database server instantiates the calculation scenario with the transformed at least one calculation node. Subsequently, a calculation engine of the database server executes the operations defined by the calculation nodes of the instantiated calculation scenario other than the transformed at least one calculation node and, additionally, an OLAP engine executes the transformed at least one calculation node to collectively result in a responsive data set.

Abstract: Techniques for data validation may include dynamically generating one or more database queries to be performed on a target data warehouse and a baseline data warehouse based on warehouse model metadata for the target data warehouse and the baseline data warehouse. The techniques may further include executing the one or more database queries against the target data warehouse and the baseline data warehouse to receive one or more data sets from the baseline data warehouse and one or more data sets from the target data warehouse. The techniques may further include comparing the one or more data sets from the baseline data warehouse and the one or more data sets from the target data warehouse to validate target data in the target data warehouse against baseline data in the baseline data warehouse.

Abstract: Systems and methods for managing data, such as metadata or non-metadata such as content. In one exemplary method, a composite document is received and it is determined whether the composite document contains at least one subdocument and if it does, the method captures metadata and/or content from the subdocument and stores the captured metadata and/or content for use in future searches (or an immediate search). The metadata and/or content from the composite document is typically combined together with information about the hierarchy of the subdocuments in the document. The type of information in metadata for one type of file differs from the type of information in metadata for another type of file. Other methods are described and data processing systems and machine readable media are also described.

Abstract: A method for processing data using snapshots is provided. The method comprises generating a primary snapshot of data stored in a first storage medium, wherein the primary snapshot is a copy of the data stored in the first storage medium at a point in time; generating one or more secondary snapshots of the primary snapshot, wherein the secondary snapshots are copies of the data stored on the first storage medium at the point in time; and extracting the data stored in the first storage medium at the point in time by accessing the data included in the secondary snapshots, wherein multiple processing units concurrently transform the extracted data and load the transformed data onto a second storage medium.

Abstract: There are provided methods and systems to identify an item based on data associated with the item. Information is received that is descriptive of an item to be listed on an information storage and retrieval platform. The information is associated with an aspect-value pair, which is an aspect of the item and a value of the aspect. An expression of an interest of a user in the item is received. The expression is associated with the aspect-value pair. In response to the associating of the expression with the aspect-value pair, the item is identified.

Abstract: Aspects of the disclosure relate to workflow controller compatibility for in order to format workflow data such that communication between incompatible workflow controllers is facilitated. A compatibility processing module may execute one or more processes to format a workflow such that communication between previously incompatible workflow controllers is facilitated. A first workflow controller is configured with a compatibility processing module and receives a large number of data points. The compatibility module executes one or more processes on a workflow such that the processed workflow is compatible with a second workflow controller.

Abstract: A compatibility processing module, for executing one or more processes to format and manipulate data, such that communication between previously-incompatible data warehouses is facilitated. In particular, a first warehouse is disclosed, wherein the first data warehouse is configured with a compatibility processing module, for receiving a large number of data points, and for executing one or more processes on a stored portion of the received data points such that the resulting processed data points are compatible with formatting conventions of a second data warehouse.

Abstract: Certain examples provide systems and methods for formlet generation and presentation. Certain examples provide one or more formlets to be used to construct a clinical application. Certain examples leverage a content-based system, clinical element queries and clinical element transforms to generate a formlet to be used in a clinical application.

Abstract: A method and apparatus for information repository workflows enables the transfer of information between healthcare sites and medical research facilities. Large quantities of medical information may be directly transferred to an information repository or indirectly transferred to the repository through the use of pointers. The information is cleansed and normalized prior to storage in a production database within the repository. The cleansing process is conducted while ensuring integrity of the production database is maintained and while continuing to receive additional information transfers. Errors encountered during processing are logged and reported.

Abstract: A system and method maintains mappings from data containers to their parent directories within a file system of a storage system. Each inode is modified to include a primary name data structure comprising a parent directory inode and a parent directory cookie value. The parent directory cookie value identifies a particular directory entry within a specified block of a directory identified by parent directory inode. An alternate name file is utilized to store alternate names, such as those associated with hard links.

Abstract: Methods, systems, and computer program products for generating code from a data flow associated with an extract, transform, and load (ETL) process. In one implementation, the method includes identifying a data exchange requirement between a first operator and a second operator in the data flow. The first operator is a graphical object that represents a first data transformation step in the data flow and is associated with a first type of runtime engine, and the second operator is a graphical object that represents a second data transformation step in the data flow and is associated with a second type of runtime engine. The method further includes generating code to manage data staging between the first operator and the second operator in the data flow. The code exchanges data from a format associated with the first type of runtime engine to a format associated with the second type of runtime engine.

Abstract: A pivot analysis method using a condition group is applicable to a front end processing device and includes the following steps. A file name processing interface is presented according to a plurality of file names. A file name selection value is received via a first sub interface of the file name processing interface. A range setting value is received via a second sub interface of the file name processing interface. A file name computing value is received via a third sub interface of the file name processing interface. A file name processing value generated by integrating the file name selection value, the file name range setting value and the file name computing value, is outputted. A multidimensional array is received to present a pivot analysis table.

Abstract: A method and system is provided for maintaining customer data in a data store system utilizing a scalable partitioning framework. More specifically, the data store of a customer service system is partitioned (divided) into multiple partitions by a partitionable key of customer data so that each partition owns a subset of the customer data. By maintaining several partitions that store a subset of the customer data exclusive to each other, blackout or brownout problems can be local to one partition and, thus, the availability for the entire system will be increased. Moreover, a set of partitionable keys, a minimal unit to be moved between partitions, is grouped and associated with a partition. By eliminating direct dependencies between the partitions and the partitionable keys, the system can have great flexibility with regard to migrating customer data between partitions and adding a new partition.

Abstract: A system maps data within a data source to a target data model, and comprises a computer system including at least one processor. The system determines an identifier for each data object of the data source based on the data within that data object, wherein the identifier indicates for that data object a corresponding concept within a domain ontological representation of a data model of the data source. The determined identifiers for the data objects of the data source are compared to the target data model to determine mappings between the data objects of the data source and the target data model. Data objects from the data source are extracted for the target data model in accordance with the mappings. Present invention embodiments further include a method and computer program product for mapping data within a data source to a target data model.

Abstract: A data integration system is disclosed that incorporates one or more techniques for simplifying the design and maintenance of a mapping. As components are added or removed to an existing design, the data integration system removes the need to specify all input and output attributes. In one aspect, components types are implemented that allow assignment expressions to reference all or part of upstream components. Therefore, attributes of certain types of components can be propagated to downstream components or otherwise inherited from upstream components with minimal effort on the part of a map designer. During code generation the attributes required to be projected by any component can be derived based on the needs of the downstream components.

Abstract: A data integration system is disclosed that incorporates one or more techniques for eases the design and maintenance of a mapping. As components are added to an existing design, the data integration system removes the need to specify all input and output attributes. In one aspect, components types are implement that allow entity relationships to be added and/or edited in a flow view of a logical design. Therefore, attributes of components representing datasets can be added and propagated to downstream components with minimal effort on the part of a map designer.

Abstract: A data warehouse system comprising a warehouse database and a data warehouse manager communicatively coupled to the database. The warehouse manager is to store data to and retrieve data from the warehouse database and perform metadata reconciliation to update metadata of objects in the data warehouse to reflect a change in metadata of a first object in the warehouse by identifying a first set of objects impacted by the change to the metadata of the first object, identifying a second set of objects on which the first object depends, identifying at least one task that has to be completed to propagate the impact of the change in the metadata of the first object to objects in the first and second sets of objects, performing the task, and dynamically computing additional tasks based on whether or not definitions of objects in the first or second sets of objects changes based upon completion of the at least one task.

Abstract: Provided is a method and system for scheduling a task in a data warehouse. A task in a data warehouse is scheduled based on selection of a report related to the data warehouse.

Abstract: A virtual persistence platform is described that provides requirement-driven persistence store orchestration. Application developers can annotate program code with persistence properties and requirements, and a compiler component of the virtual persistence platform generates a persistence service level agreement (PSLA) that becomes attached to the application. After deployment and launch, the virtual persistence platform uses the PSLA to handle persistence commands from the application and perform persistence store orchestration.

Abstract: An apparatus for providing improved data compression may include an encoder comprising a quantizer for encoding input data and a side model. The quantizer may be trained with respect to high priority data among the input data and may be configured to partially encode the input data by encoding the high priority data. The side model may be trained jointly with the training of the quantizer and is configured to model low priority data among the input data.

Abstract: Systems, methods, and other embodiments associated with and\ adaptive data model and warehouse palette are provided. In one embodiment, a method includes providing a user interface for collecting item definition attributes from a user. A database structure is generated to store item data according to collected the item definition attributes. An extract, transform, and load (ETL) layer is generated to extract item data from user data, transform the extracted data for storing in the database structure, and load the transformed extracted data into the database structure.

Abstract: A data warehouse incorporates processing for creating, managing, and otherwise maintaining master data. The data warehouse may communicate with a master data manager to obtain services for handling master data. A surrogate master data identifier may be defined by the data warehouse to reference the master data, thereby decoupling any modifications of the master data identifier that may be made by the master data manager. The data warehouse may export the master data to an application system, and conversely import master data from an application system.

Abstract: A method to search concrete positions based on abstract interests or vice versa is disclosed. Based on user's initial inputs of interests to positions mapping (PI Map), this method extends the map further with other users' similar one. Weights are associated to each interest to position connection in the map to represent preferences. Multiple layers in the map are interconnected to have different level of abstraction. A personal PI Map database is established based on these initial inputs, extension, weights and multiple layers. When user inquires specific interests with constrain and execution order, the method use the PI Map to find the optimal route to concrete positions. Based on the users' usage and final choice, the PI Map is dynamically adjusted through connections and associated weight. Further data analytics is conducted based on the aggregated PI Map from a group of users.

Abstract: An integrated web-based dealership management system providing accounting, financial reporting, parts and service sales tracking, vehicle and parts inventory, vehicle sales tracking, and customer management software developed on a relational database on a web server and with web application tools.

Abstract: The present invention relates to a system and method for flexibly integrating a data warehouse with one or more operational database in real-time. The system comprises of a plurality of components embedded under one or more layers. The system comprises of a staging database, an ETL (extract transform load) module, a data warehouse and a networking module. The flexible integration is enabled by invoking one or more web services from a business enterprise. The invention further provides one or more analytical modules for performing an intelligent operation to carry out comparative analysis of the data. The designing and implementation module enables a deployment of the system on any related technology platform and tools.

Abstract: Computer system and method are provided which include or utilize first and second databases, and a receiver for receiving online data. The first database stores received online data in a first data structure, and the second database stores the online data in a second data structure, with the second structure being obtained by applying a transformation to the online data in the first data structure. The system also has a software component for generating an analytical model using at least part of the online data stored in the second database, and a processor and memory storing a plurality of applications that are executable on the processor, where a mapping application includes instructions that, when executed, cause at runtime the processor to automatically retrieve at least part of the online data from the second database, and store in a storage of the system the retrieved online data.

Abstract: The invention described herein provides a load engine and method for efficiently accomplishing mass conversions of customer data into an existing customer database. In particular, the method incorporates existing business rules for validating new customer data and for creating tables for the new customer data, creates load files for the new customer data, and provides a means for running multi-threaded data loads of the new customer data tables onto an existing customer database.

Abstract: The present invention is a sample analyzing system, including a sample analyzer and a management apparatus connected to the sample analyzer via a communication network. The management apparatus includes: a first memory that stores a computer program for the sample analyzer and manual data which corresponds to a version of the computer program; a first communication device; and a first controller configured to transmit, via the first communication device to the sample analyzer, the computer program and the manual data corresponding to the version of the computer program stored in the first memory. The sample analyzer includes: a second communication device; a second memory that stores the computer program and the manual data received by the second communication device; and a second controller configured to execute the computer program stored in the second memory.

Abstract: Techniques are disclosed for cost modeling in a data flow model. In one embodiment, a data flow model is provided that includes multiple data flow objects, each data flow object including one or more data units. Each data flow object represents a respective information asset. Quality and cost components are assigned to each data unit of a first data flow object. A cost property is determined for each data unit of the first data flow object, based on the assigned components. An object cost property is also determined for the first data flow object. The determined cost properties may be used to identify information assets that are more cost-effective to upgrade, relative to other information assets.