Abstract: An embodiment provides intermediate data derived in the form of column stores which are in turn based on hierarchical data stores. This intermediate data represents a reduced subset of data matched appropriately to a query (or modified query) such that the amount of data handled in a query processing task on large data is greatly reduced. An embodiment may appropriately choose column data stores and/or modify queries in order leverage parallelization techniques such as map-reduce in order to query large data. The result is the ability to query large data stores in parallel while reducing the amount of data that must be handled.

Abstract: A computer-implemented method of storing data for fast lookup comprises forming a first and a second array of pointers, forming a record to store, the record comprising fields for, a first list pointer, a second list pointer, which is not the first field in the record, a first key, and a second key. The method further comprises determining a first index based at least in part the first key, setting the value of the pointer at the first index in the first array to the location of the first pointer field of the record, determining a second index based at least in part the second key, and setting the value of the pointer at the second index in the second array to the location of the second pointer field of the record.

Abstract: In an embodiment, Partition Change Tracking (PCT) refresh is performed by using join dependencies on partitioning columns to derive and fill in identifiers of rows and/or partitions containing the rows in the refresh expressions. In an embodiment, the join dependencies that form the Materialized View's (MV's) query definition and the partitioning predicate of the table are used to automatically generate a statement which is run in order to derive and fill in identifiers of the rows and/or partitions that are being changed. The identifiers are then plugged into the refresh expression, and the refresh expression is run. Running the refresh expression causes the rows identified to be refreshed.

Abstract: Methods and systems are presented for custom caching. Application threads define caches. The caches may be accessed through multiple index keys, which are mapped to multiple application thread-defined keys. Methods provide for the each index key and each application thread-defined key to be symmetrical. The index keys are used for loading data from one or more data sources into the cache stores on behalf of the application threads. Application threads access the data from the cache store by providing references to the caches and the application-supplied keys. Some data associated with some caches may be shared from the cache store by multiple application threads. Additionally, some caches are exclusively accessed by specific application threads.

Abstract: A distributed, cloud-based storage system provides a reliable, deduplicated, scalable and high performance backup service to heterogeneous clients that connect to it via a communications network. The distributed cloud-based storage system guarantees consistent and reliable data storage while using structured storage that lacks ACID compliance. Consistency and reliability are guaranteed using a system that includes: 1) back references from shared objects to referring objects, 2) safe orders of operation for object deletion and creation, 3) and simultaneous access to shared resources through sub-resources.

Abstract: According to one embodiment of the present invention, a system analyzes one or more change records based on text analytics using dictionaries and rules for the analysis in order to generate an index of analyzed data that represents the one or more change records. The change records each include a change and corresponding time frame for occurrence of the change. Information from a request is applied to the index of analyzed data to determine one or more candidate causes for the incident and the corresponding time frame for occurrence of the change. A time associated with the request is correlated with the corresponding time frame for occurrence of the change to identify the one or more candidate causes in the one or more change records as causes for the incident. Embodiments of the present invention further include a method and computer program product for determining causes of an incident.

Abstract: The text search apparatus has an information storage that stores plural transposed indexes associating characters or character strings appearing in a document to be searched with the appearance positions of the characters or character strings. The transposed indexes were generated for a document in which beginning marks are added in front of texts to be subject to forward matching search. The incremental searcher of the text search apparatus adds a beginning mark in front of a search keyword and executes a forward matching search using a set of transposed indexes. The main searcher executes a partial match search using the same set of transposed indexes.

Abstract: A process is disclosed for the computer management of inverted lists and inverted indices, in which the standard representation and processing of inverted lists is changed in order to achieve a simpler, more compact and more efficient architecture.

Abstract: A system for managing documents, comprising: interfaces to a user interface, proving an application programming interface, a database of document images, a remote server, configured to communicate a text representation of the document from the optical character recognition engine to the report server, and to receive from the remote server a classification of the document; and logic configured to receive commands from the user interface, and to apply the classifications received from the remote server to the document images through the interface to the database. A corresponding method is also provided.

Abstract: An electronic device with one or more processors, memory and a display obtains a file header for a file that corresponds to a plurality of separately indexed clusters. The file is divided into segments one or more of which include multiple sequential clusters. The file header includes a segment index that enables identification of a segment that includes requested content. The device receives a request to seek to a respective position within the file. In response, the device identifies a first segment that includes content that corresponds to the respective position based on the segment index, obtains the first segment, and obtains a content index for a respective cluster within the first segment. After obtaining the first segment and the content index, the device identifies respective content within the respective cluster that corresponds to the respective position based on a content index and provides the respective content to a user.

Abstract: Keys are obtained and aggregated by storing a primary object as an entry in a parent keys storage and a child keys storage, the entry identified as unvisited in each. An object evaluation process is then performed until all unique entries in the parent keys storage and all unique entries in the child keys storage have been visited and by committing the keys of at least one related object as an entry to the hierarchical database. The object evaluation process visits each unvisited object in the parent keys storage and child keys storage by selecting, for the unvisited object, objects in the parent direction that have not already been visited and objects in the child direction that have not already been visited and by inserting the keys of the selected related objects as entries in the parent keys storage or child keys storage.

Abstract: Provided are methods comprising receiving a query for information from the database, determining particular data element types and data element values that are the subject of the query, instantiating a query data structure containing the data element types and the data element values that are the subject of the query, identifying records within the database that contain one or more data element types and/or data element values that are included in the query data structure, and instantiating a results data structure comprising information relating to the identified records.

Abstract: Embodiments are provided for using heuristics for selecting and saving content to a synced online content management system. In some embodiments, one or more content items and/or indices thereto may be received within a first application. For example, a user may receive a photograph within a text message application. In some embodiments, a first defined gesture may be detected by a user device and in response, a second application may open. In some embodiments, a second defined gesture may be detected, and in response a (a) store, (b) share, and/or (c) an assign to a collection, operation may be performed within the second application. Alternatively, these operations may be performed within the second application based on at least one predefined rule (without a second gesture required).

Abstract: A method for representing a database in a computer readable medium. Accessing a first table in the database. The first table has rows of data, each row of data having one or more columns. Storing a first representation of the first table in a volatile computer memory in a column-oriented format, the column-oriented format comprising at least one B-tree for at least one column, wherein the B-tree is composed of at least one array and the at least one B-tree includes references to a plurality of arrays, each array of the plurality of arrays comprised of data corresponding to the rows of one column of the table, wherein the storing further comprising storing data corresponding to the rows in a packed format. Storing a second representation of the database on the computer-readable medium, the second representation substantially identical to the first representation.

Abstract: Methods and systems for managing assessment of media content electronically submitted to a network-based media distribution system. A submitter can prepare a media package that is associated with a particular media asset (e.g. media title), and then electronically submit the media package to the media distribution system. The media distribution system can then process the media package to produce various components that are used by the media distribution system to electronically distribute media content of the media asset. According to one aspect, the media distribution system can manage a review process on the various components so that the components can be individually approved or rejected. According to another aspect, embodiments pertain to a reviewer's workspace that can assist a user in reviewing the submitted media content. According to still another aspect, embodiments can utilize a plurality of reviewers to review various media assets that have been submitted.

Abstract: Managing user bookmark information includes receiving a bookmark-related action request and determining a type of action associated with the bookmark-related action request and user information associated with the bookmark-related action request. In the event that the type of action corresponds to an add bookmark action, managing user bookmark information further includes generating a bookmark data record, the bookmark data record comprising the user information and information to be bookmarked; determining, using the user information, bookmark database information associated with a bookmark database to which the bookmark data record is to be stored, the bookmark database being one of a plurality of bookmark databases; generating index information based on the user information and the bookmark database information; storing the index information in an index database that is separate from the plurality of bookmark databases; and storing the bookmark data record in the bookmark database.

Abstract: A system and method for generating a snapshot of data associated with one or more cloud-based applications are disclosed. Application programming interfaces (APIs) and connections associated with one or more applications registered and on a server computer and used by a company are retrieved from a table by a lookup. All data associated with the one or more applications based on the APIs and connections are also retrieved. The data associated with the one or more applications is then mapped to a client-specific representation and data format. The data associated with the one or more applications is converted to the client-specific representation and data format.

Abstract: A computer system configures data elements based on textual sources by identifying subunits of a textual source, indexing the subunits into a sequence comprised of terms, identifies based on a target a base subsequence of the sequence, and stores the terms in such a way that they can be expanded or contracted and a user can rapidly and efficiently derive relevant information and context even from a vast amount of information including by navigable display to the user. Other methods and systems of configuring and displaying data elements from textual sources are provided.

Abstract: Architecture that includes an index creation algorithm that utilizes available resources and dynamically adjusts to successfully scale with increased resources and be able to do so for any data distribution. The resources can be processing resources, memory, and/or input/output, for example. A finer level of granularity, called a segment, is utilized to process tuples in a partition while creating an index. The segment also aligns with compression techniques for the index. By choosing an appropriate size for a segment and using load balancing the overall time for index creation can be reduced. Each segment can then be processed by a single thread thereby limiting segment skew. Skew is further limited by breaking down the work done by a thread into parallelizable stages.

Abstract: Techniques, devices and systems for publishing digital contents such as encyclopedia are provided. One method for such digital publishing includes obtaining entries of encyclopedic resource files; indexing attributes of each of the entries by using preset indexing rules; reorganizing the entries based on the attributes; and publishing the reorganized entries by applying a preset template.

Abstract: A method for receiving a data stream that includes data samples, each data sample having one of a plurality of actual values. For each data sample in the data stream, a first index in a dictionary is selected. The dictionary includes indices corresponding to each of the plurality of actual values. The first index corresponds to an actual value of the data sample. A predicted value of the data sample is generated in response to previously received data samples in the data stream and to a prediction algorithm. A second index in the dictionary that corresponds to an actual value in the dictionary that is closest to the value of the predicted value is selected. The difference between the first index and the second index is calculated and compressed. The compressed difference between the first index and the second index is then output. This process is performed for each data sample in the data stream.

Abstract: An approach provides distributed editing and storage of digital media. Video information is retrieved during recording of the video information to a video file. The video information is edited during the recording of the video information. An index file for the media is generated during the recording of the media, wherein the index file include indices for decoding the media; and periodically updating the index file throughout the recording of the media. After completion of the recording of the media, another index file is generated corresponding to the media for inclusion into the media file.

Abstract: Generating and storing, for a multitude of polygonal areas, spatial coordinates of a multitude of piecewise-linear spatial boundary segments. The polygonal boundary of each area comprises boundary segments; each boundary segment forms a portion of the polygonal boundary of at most two adjacent spatial areas. Can further include one or both of (i) an indicator, for each spatial boundary segment, of the at most two corresponding adjacent spatial areas that are separated by that boundary segment or (ii) an indicator, for each spatial area, of one or more boundary segments that together form the entire polygonal boundary of that spatial area. The electronic indicia of the second dataset can be used, inter alia, (i) to determine in which of a multitude of at least partly contiguous spatial areas is located a given spatial point, or (ii) to graphically render the polygonal borders of the areas.

Abstract: Electronic items may be searched using search indices. A user device may determine a manner in which to obtain a search index for an electronic item from among multiple possible manners of obtaining the search index, and the search index may be obtained in the determined manner. Verification may also be performed to determine if electronic items stored in memory of the user device have changed.

Abstract: The present disclosure describes methods, systems, and computer program products for extracting entity interaction information from business relevant data.

Abstract: Systems, methods and computer program products for using searchable aggregate indices associated with non-aggregated value storage. In one method, a search system stores metadata values for each of a plurality of objects in a storage unit. The metadata values are stored in corresponding value storage locations that are associated with an identifiable metadata fields. An aggregate index is provided which includes a dictionary of terms that are contained in metadata values associated with a designated set of the metadata fields. The aggregate index is searched for one or more specific search terms, and one or more of the metadata values are retrieved from the value storage locations in response to the search, where the individual metadata fields associated with the retrieved metadata values are identified.

Abstract: Methods and systems are provided for tracking object instances stored on a plurality of network nodes, which tracking enables a global determination of when an object has no references across the networked nodes and can be safely de-allocated. According to one aspect of the invention, each node has a local object store for tracking and optionally storing objects on the node, and the local object stores collectively share the locally stored instances of the objects across the network. One or more applications, e.g., a file system and/or a storage system, use the local object stores for storing all persistent data of the application as objects.

Abstract: In various embodiments, a system and related method for organizing transactional data from a diverse and heterogeneous application environment is disclosed. In an example embodiment, a system includes a file system and one or more daemon indexers in electrical communication with the file system. The file system is arranged as a non-relational and serverless file system to allow for cost-effectiveness with ready scalability. The file system is to receive, in substantially real-time, unsorted transactional data from a publishing module. The one or more daemon indexers are arranged to receive the unsorted transactional data from the file system, organize the unsorted transactional data by operational characteristics, and store the organized transactional data on the file system.

Abstract: Various embodiments for storing a logical object are provided. In one such embodiment, by way of example only, incoming data is divided corresponding to a logical data object into a plurality of independent streams, associating each data chunk of a plurality of obtained data chunks with a corresponding stream among the plurality of independent streams. At least one of the obtained data chunks and derivatives thereof is sequentially accommodated in accordance with an order the obtained chunks are received, while keeping the association with the corresponding streams. A global index is generated as a single meta-data stream accommodated in the logical data object and comprising information common to the plurality of independent streams and related to mapping between data in the logical data object and the obtained data chunks.

Abstract: Systems and computer program products for relating facts stored in healthcare databases are provided. At least two fact tables stored in a healthcare database including data meeting a criteria of interest are located. An identification key is assigned to the at least two fact tables including the located data meeting the criteria of interest. The identification key provides access to a dimension table including a list of subjects associated with the at least two fact tables including the located data meeting the criteria of interest so as to allow future identification of the subjects meeting the criteria of interest.

Abstract: The question and answer data editing device for editing dialog content to generate question and answer data, includes a detecting unit that detects a part of the dialog content similar to existing question and answer data stored, and a extracting unit that extracts a context in which the dialog content is made from dialog content in the proximity of the similar part detected and registers the context extracted as new question and answer data or as index information of the question and answer data.

Abstract: Indexing and retrieving real time content in a social networking system is disclosed. A user-term index includes user-term partitions, each user-term partition comprising temporal databases. As a post is received from a user, a user identifier, a post identifier, and a post is extracted. An object store communicatively coupled to a temporal database for recently received content is queried to determine whether terms in the post has already been stored. A term identifier is stored in the user-term index with the user and post identifiers. A forward index stores the post by post identifier. Responsive to a search query, the user-term index is searched by the user's connections and the terms. A real time search engine compiles the results of the user-term index query and retrieves the stored posts from the forward index. The search results may then be ranked and cached before presentation to the searching user.

Abstract: An item information database of a document rating calculation device stores a relation among items of a document and a rating for each item. A document retrieval unit retrieves a document fulfilling a retrieval condition, and, for condition items of the retrieval condition, specifies such item. A fulfilling-item set specifying unit selects a set of related items for each of items fulfilling the condition items of the retrieval condition, in the document retrieved by the document retrieval unit, based on the mutual relation among the items stored in the item information database, and performs a logical operation of the retrieval condition between selected sets of related items to specify a set of fulfilling items. A score calculator calculates a document rating of the retrieved document from the ratings of items in the set of fulfilling items specified by the fulfilling-item set specifying unit and stored in the item information database.

Abstract: A data storage system having mutable objects incorporating time is described herein. According to the systems and methods described herein, a data item may be partitioned into parts (data objects) and stored as an index object. As the object storage system provides immutable objects, when a new version of a data item needs to be stored, only those parts (data objects) of the data item that changed need be saved rather than the entire data item. The systems and methods described herein allow for efficient storage, access and manipulation of mutable data items using an underlying immutable object system.

Abstract: Examples disclosed herein provide systems, methods, and software for indexing attachable applications for computing systems. In one example, a method of attaching an application to a computing system includes identifying an application attach triggering event for the computing system. The method further includes, identifying a storage location for the application based on the application attach triggering event and an application index, and attaching at least one storage volume to the computing system corresponding to the storage location.

Abstract: A file generation system for storage of structured data onto a distributed database includes an intermediate data generation module to generate a set of intermediate key-value pairs for each of one or more records in at least one subset of the structured data. A key-value pair includes a key and a value corresponding to the key, where the key is a unique identifier of the value. A file generation system further includes an intermediate data sorting module to sort the set of intermediate key-value pairs to generate a plurality of output files. Each of the plurality of output files includes at least one key-value pair. Further, the file generation system includes a file storing module to store the plurality of output files in the distributed database, where the plurality of output files are representative of the structured data.

Abstract: Techniques for maintaining a cascading index are provided. In one approach, one or more branch node compression techniques are applied to the main index of a cascading index. In an approach, a Bloom filter is generated and associated with, e.g., a branch node in the main index. The Bloom filter is used to determine whether, without accessing any leaf blocks, a particular key value exists, e.g., in leaf blocks associated with the branch node. In an approach, a new redo record is generated in response to a merge operation between two levels of the cascading index. The new redo record comprises (a) one or more addresses of blocks that are affected by the merge operation, (b) data is that being “pushed down” to a lower level of the cascading index, and (c) one or more addresses of blocks that are written to storage as a result of the merge operation.

Abstract: Data indexing includes receiving data from a data source; classifying the data into one of a plurality of categories according to a predetermined data classification criteria; establishing a corresponding relationship between the data and an index associated with the data, the index having a preset maximum capacity; and recording the relationship between the data and the index. The index is one of a plurality of indices, and each of the plurality of indices is exclusively written by an index writing device.

Abstract: An apparatus for generating indexes of data may include a processor and memory storing executable computer code causing the apparatus to at least perform operations including obtaining an order number responsive to receipt of a request from a device to index an item(s) of data. The computer program code may further cause the apparatus to map the order number to a key value and link the key value to the data and provide one or more index entries to a memory device to enable storage of the index entries. The index entries may include information corresponding to the key value and the data. The computer program code may further cause the apparatus to assign a new index row(s) including the data for inclusion in a set of index rows of a designated partition(s) to obtain a built index(es) of the data. Corresponding methods and computer program products are also provided.

Abstract: A system facilitates collaborative communications and information sharing in a network defined by a model. The model and a portion of the system are stored on a storage component coupled to a terminal. The system captures context information and user-defined data, the user-defined data provided during user interaction of the user in a first domain of the network, and dynamically stores the context information as metadata associated with the user-defined data, the user-defined data and the metadata stored on the storage component; a tracking component for tracking a change of the user from the first domain to a second domain of the network and dynamically updating the stored metadata based on the change, where the user accesses the user-defined data from the second domain; and an interface to the system that permits the user to create and view the user-defined data according to the model of the network.

Abstract: A specific item within an item class is identified by defining sets of descriptor data from a training library. The collected descriptor data is grouped and organized into a hierarchical tree, where each leaf node is defined by relations between corresponding parts of the descriptor data. Registrable sets of descriptor data are then identified from a collection of registrable samples. The registrable sets of descriptors are sorted into the hierarchical tree. When an input sample to be identified is received, a test set of descriptor data is generated from the input sample. The test set is then sorted into the hierarchical tree. Each leaf node that receives a part of the test set provides a vote for the registered samples it contains. The registered sample with the most votes is deemed a match for the input sample.

Abstract: Methods, systems, and media are provided for facilitating generation of an inference index. In embodiments, a canonical entity is referenced. The canonical entity is associated with web documents. One or more queries that, when input, result in a selection of at least one of the web documents are identified. An entity document is generated for the canonical entity. The entity document includes the identified queries and/or associated text from the content of a document or from an entity title that result in the selection of the at least one of the web documents. The entity document and corresponding canonical entity can be combined with additional related entity documents and canonical entities to generate an inference index.

Abstract: A system searches a data collection using a bloom filter index to reduce the search scope to improve search efficiency, while at the same time allowing more flexible searches of the data collection using search terms containing any arbitrary string of data.

Abstract: Computer-readable media, computer systems, and computing devices facilitate enhancing a web index with uniform resource locator (URL)/non-encoding character (NEC) word pairs to facilitate relevance ranking of search results provided in response to a search query that includes NEC words. URLs are received from web pages and substrings extracted therefrom. Additional elements are received from the web page, word-broken into sequences of NEC words, and the NEC words are converted into encoding-language representations which are matched against the URL substrings to identify candidate URL/NEC pairs for utilization in relevance ranking.

Abstract: Systems, methods, and other embodiments associated with a unit of work for incremental data processing are described. In one embodiment, a method includes selecting a unit of work key for a program that processes records in a source table. The unit of work key is selected such that modifications to a record having a certain unit of work key value will not affect the program's processing of records having a different unit of work key value. The selected unit of work key is associated with the program. When a record in the source table is created, modified, or deleted, a unit of work key value is identified for the record and a selected set of records having the identified unit of work key value is provided to the program. Thus, records in the data source that do not have the identified unit of work key values are not provided to the program.

Abstract: A database system comprises an interface for a storage device, and a control device for accessing the storage device through the interface. The storage device stores a table that manages a plurality of rows comprising a plurality of item values, and an index configured in a tree structure based on a plurality of nodes enabling to identify the rows by using one or more item values. The control device identifies an item value condition included in a search condition of a search query, determines whether or not the node of the index corresponding to the item value condition is reference-disabled, and when the node is reference-disabled, identifies a range of item values managed by the reference-disabled node, and searches for a row that satisfies the search condition for the identified range.

Abstract: The invention provides an apparatus for processing data items in a data source, and an equivalent method. More specifically, the apparatus is configured to reduce a lattice representation of data items in a data source. The apparatus has a processor that is operable to retrieve data items from the data source and to determine a context defining relationships between data items and one or more properties associated with the data items. An initial lattice data structure is generated based on the determined context. The processor then reduces the size of the lattice by dividing the initial lattice data structure into a plurality of subgroup lattice, reducing the size of each of the subgroups of lattice, and combining them to form a reduced lattice data structure.

Abstract: A computer system includes a photo processing mechanism that allows cataloging and storing a user's photos using relationships between people that allow the user's photos to be retrieved using a search engine. A user enters people and specifies relationships, and may also enter locations, events, and other information. Photos are then processed, and indexing info is generated for each photo that may include any or all of the following: user-defined relationships, system-derived relationships, user-defined locations, system-defined locations, user-defined events, and system-derived events and ages for the people in the photos. The indexing info may be stored as metadata with the photo or may be stored separately from the photo. The indexing info allows photos to be retrieved using a powerful search engine.

Abstract: A system and method for collectively indexing a collection of documents in paper or electronic form. The collective index is created for all documents, which may come from a variety of sources and be initially presented in a variety of formats. Documents are converted to a standard electronic format, then analyzed and processed to identify, locate, and tag objects of interest. Hierarchical menus are created with multiple categories.

Abstract: Annotation techniques are provided. In one aspect, a method for processing a computer-based material is provided. The method comprises the following steps. The computer-based material is presented. One or more portions of the computer-based material are determined to be of interest to a user. The one or more portions are annotated to permit return to the one or more portions at a later time. In another aspect, a user interface is provided. The user interface comprises a computer-based material; a viewing focal area encompassing a portion of the computer-based material; and one or more indicia associated with and annotating the portion of the computer-based material.