Abstract: Methods, non-transitory computer readable media, and devices that determine when a job extracted from a stack is a pending job. When the determining indicates that the job is a pending job, a web service indicated in the job is executed. Another job is extracted from a web service response, and the another job is inserted into the stack. The web service is configured to obtain a web page to be analyzed based on the URL, execute the web page in an emulated JavaScript environment, and return the web service response. When the determining indicates that the job is not a pending job, a data collector event handler indicated in the job is executed. The data collector event handler is configured to update an output resource based on content of the analyzed web page included in the job.

Abstract: Techniques for decompressing data in a database system. A query is received, which pertains to a subset of data within a compressed set of data. One or more decompression strategies are evaluated using a cost model. The cost model includes an estimated filter factor. A low cost decompression strategy is selected based on the results of the evaluation of the one or more decompression strategies. One or more bytes representing the requested subset of data are located within the compressed set of data. Only a portion of the compressed data that corresponds to the subset of data is decompressed, using the selected decompression strategy, while leaving the remaining set of data in a compressed state.

Abstract: Methods and apparatus, including computer program products, implementing and using techniques for decompressing data in a database system. A query is received, which pertains to a subset of data within a compressed set of data. One or more decompression strategies are evaluated using a cost model. The cost model includes an estimated filter factor. A low cost decompression strategy is selected based on the results of the evaluation of the one or more decompression strategies. One or more bytes representing the requested subset of data are located within the compressed set of data. Only a portion of the compressed data that corresponds to the subset of data is decompressed, using the selected decompression strategy, while leaving the remaining set of data in a compressed state.

Abstract: Systems and methods for creating and populating temporary database tables with intermediate data that can be preserved once a database application session ends and used outside of the instant database operation without storing this data in persistent memory are provided. A local temporary database table may be used only in the local instance of a database application, and a global temporary table makes intermediate data available across multiple applications and multiple application instances.

Abstract: A system and method for managing distributed coherent datasets using a hierarchical change log is provided. In some embodiments, a distributed storage system is provided that includes a primary storage device containing a primary dataset and a mirror storage device containing a mirror dataset. The mirror dataset includes a coherent copy of the primary dataset. The distributed storage system further includes a hierarchical change log tracking a coherence state for the mirror dataset. The hierarchical change log includes a first sub-log and a second sub-log, and a block range of the first sub-log overlaps a block range of the second sub-log. The hierarchical change log may define a priority relationship between the first sub-log and the second sub-log governing the overlap. The first sub-log and the second sub-log may be independently configured and may be different in one of a representation and a block size.

Abstract: A method, performed by a computing system, includes detecting a data call from an application running on the system, the data call being to access data through a Portable Operating System Interface (POSIX) Application Programming Interface (API), the data being stored on a storage system associated with the computing system. The method further includes, in response to detecting the data call, obtaining, through use of a context extraction module, contextual information associated with the data call. The method further includes accessing the data according to the data call and storing the contextual information.

Abstract: A device includes circuitry configured to provide a configurable platform including a rules-based processing engine, access and manipulate a plurality of configurable databases, retrieve first data from one of the configurable databases, register the first data for task programs, authenticate the first data according to authenticity parameters, process the first data against processing rules, identify and configure each task program when the assessment of the first data satisfies predetermined criteria, measure the ETL data load flow against a predetermined performance threshold, route the ETL data load flow to a database processing engine, and output a data disbursement of results when the first data is authenticated and the predetermined performance threshold has been satisfied by the rules-based processing engine. In one aspect, such implementation can increase data search and retrieval times as well as outputting a more thorough and accurate count of eligible end-user services.

Abstract: A system for translating versioned data service requests and responses is provided. A service request for data may have multiple different versions, with each version requesting different types of data. The system may be configured to translate a service request having a versioned format into a service request having a baseline format. The system may execute the service request in the baseline format to generate a service request response, containing the data requested. The system may also be configured to translate the service request response from a baseline response format back into the versioned data service response format of the original request.

Abstract: A database system rewrites database queries based on rewrite constraints specification. The rewrite constraints specification provides directives to the database system to generate temporary tables for storing intermediate results of database queries and rewrite the corresponding database queries in terms of the temporary tables. The subqueries for matching the rewrite constraints specification may be specified in various ways. For example, the rewrite constraints specification may identify the subqueries by using one or more aliases. The rewrite constraints specification may specify a list of tables such that all database queries that join the database tables specified in the rewrite constraints specification are determined to match. The optimizer is able to optimize the rewritten database queries better by getting a better estimate for the statistics describing the temporary tables.

Abstract: A proposed modification to a record of a base data structure is identified, the records of the base data structure sorted by primary key. A type of modification of the proposed modification is identified. A record is added to a differential data structure of the type, the differential data structure record describing the proposed modification. A record is added to a delta data structure sorted by the primary key, the delta data structure record including the primary key value of the record, the type of the proposed modification, and a pointer to the record added to the differential data structure. Data can be fetched using the delta data structure to apply modifications to a set of records requested in the fetch and generate a modified set of records to be returned in a response to the request.

Abstract: Methods, storage facilities and computer software products implement embodiments of the present invention that include mapping, by a storage system including one or more storage devices, a set of storage blocks on a given storage device to a redo log file configured to store transactions performed by a transaction processing system. An archiving condition is specified, and upon the transaction processing system completing a given transaction a copy of the given transaction is stored to the redo log file. Upon the archiving condition being met, the storage system can remap the set of storage blocks to an archive log file.

Abstract: Exemplary embodiments are provided for integrating data into an agnostic data broker, wherein a type and structure of the data is previously unknown to the data broker. Aspects of the exemplary embodiment include ingesting the data from a data source by providing a first API through which a first API call is received that includes both the data and a manifest that describes a type of the data and the structure of the data; storing the data in a data repository; and providing a second API through which a second API call is received that queries the data based on the manifest.

Abstract: A system comprises a processor that that receives, through a network, a first data structure from a first source system. Further, the processor receives, through the network, a second data structure from a second source system. In addition, the processor normalizes the first data structure and the second data structure according to a common interface such that at least one constituent of the common interface is immutable, the common interface is backward compatible, and the common interface is forward compatible. The first data structure is at least partially distinct from the second data structure.

Abstract: Facilitating migration of data from a first system format to a second system. A method includes, at an extension receiving an indication that the extension should be used for data migrations. The method further includes receiving a request from a migration coordinator for migration instructions. At the extension, the method further includes identifying whether or not migration instructions are available and if the migration instructions are available, then providing the instructions to the migration coordinator. At the extension, the method further includes identifying if information about loading data is available, and if information about loading data is available, providing the information about loading data to the migration coordinator. At the extension, the method further includes identifying if a template is specified for migrating data, and if a template is specified, identifying the template to the migration coordinator.

Abstract: Systems and methods for performing a mobile range query are provided. A system can include a first computer readable medium configured to iteratively transmit a mobile range query, as well as a second computer readable medium configured to: receive a mobile range query; compute a range query result; build two min-heaps that contain in-border interest points and out-border intersect points respectively; construct an initial candidate safe region by popping top elements in the two min-heaps while they are not empty; computing the intersections of the domain region of the top elements and the candidate safe region and redefining the candidate safe region using the intersections; and return the mobile range query results to the first medium.

Abstract: A method, computer system, and computer program product for eliminating confirmation bias in a user search query is provided. The present invention may include receiving a user-entered search query from an open ended-search tool. The invention may also include identifying a field associated with the received user-entered search query. The invention may further include creating a dictionary based on the identified field. The invention may also include determining the received user-entered search query relates to an effect by parsing the created dictionary. The invention may further include identifying one or more causes associated with the effect by parsing the created dictionary. The invention may also include generating a plurality of suggested search queries based on the one or more identified causes.

Abstract: A technique to generate a feature set. A plurality of samples from a data set can be clustered. Features can be selected based on the clusters. The features can be added to the feature set. Additional samples can be clustered and features selected and added to the feature set until a convergence threshold is reached.

Abstract: There is provided an information processing system including an information processing apparatus and a plurality of terminal devices, wherein each terminal device among the plurality of terminal devices is able to display information in a format supported in the terminal device, the terminal devices acquiring information in formats supported in the respective terminal devices from the information processing apparatus, the information processing apparatus comprising: a memory and one or more processors to execute the program and perform a process including: performing conversion operations for converting newly registered information in a given format into information in a plurality of formats; and distributing a completion report indicating completion of a conversion operation into any one of the plurality of formats upon the conversion operation into the one of the plurality of formats being completed.

Abstract: A technique of batching tuples can include determining a plurality of key-attributes for a plurality of tuples, creating a batch tuple, and calculating a hash value for the batch tuple.

Abstract: A database system allows users to specify plan constraint specification that limit choices of execution plans considered by an optimizer of the database system for optimizing database queries. The plan constraint specification specifies attributes of execution plans. The plan constraint specification may identify tables/intermediate results that the plan constraint is applicable to using table names or aliases. The database system applies the plan constraint specification to database queries that match the tables/aliases specified in the plan constraint specification. The database system limits the choice of execution plans evaluated for a database query to execution plans satisfying the attributes specified in an applicable plan constraint specification. The plan constraint specification may specify distribution of a table, a join order for tables, the join mechanism, cardinality of a table or intermediate result, and so on.