Abstract: In one embodiment, a distributed database system supporting flexible configuration of data clusters is disclosed. The system includes a cluster manager, an index, and a dataset distributed over one or more database clusters. Where the nodes of the clusters may report ownership of a particular range, the index contains an alternate range. The cluster manager receives requests to access a range of data within database and queries the index to determine the appropriate nodes and/or clusters with which to connect. The cluster manager then directs the requestor to connect to the specified nodes and/or clusters.

Abstract: Shuffling data stored in columnar tables improves data storage security, particularly when used in conjunction with other security operations, such as tokenization and cryptography. A data table is accessed, and pointer values of at least one column of the accessed table are shuffled, generating a protected table. An index table mapping index values to the shuffled pointer values is generated, allowing a user with access to both the protected table and the index table to generate the original table. Without both tables, users are only able to see either the shuffled data or the index values. Example shuffling methods include, but are not limited to, random shuffling, grouped shuffling, sorting by column value, and sorting by index value.

Abstract: In accordance with embodiments, there are provided mechanisms and methods for synchronizing data in a database network system. These mechanisms and methods for synchronizing data in database network system can enable embodiments to provide users a synchronization button on a UI or synchronization field through an API for specifying data for synchronization. The ability of embodiments to provide users a synchronization button on a UI or synchronization field through an API for specifying data for synchronization can enable users to easily and efficiently change and update data in a database system.

Abstract: Various embodiments are generally directed an apparatus and method for receiving information to write on a clustered system comprising at least a first cluster and a second cluster, determining that a failure event has occurred on the clustered system creating unsynchronized information, the unsynchronized information comprising at least one of inflight information and dirty region information, and performing a resynchronization operation to synchronize the unsynchronized information on the first cluster and the second cluster based on log information in at least one of an inflight tracker log for the inflight information and a dirty region log for the dirty region information.

Abstract: Technologies are generally described for partial cloud data storage. In one example, a method includes dividing, by a system comprising a processor, a file into a set of source packets in response to an indication that the file is to be stored in a data store of a network device. The method also includes transforming the set of source packets into a set of encoded packets by encoding the set of packets into codeword symbols of an error correcting code. Further, the method includes facilitating storage of a first portion of the set of encoded packets to the data store of the network device and a second portion of the set of encoded packets to one or more user devices. A first number of packets in the first portion is more than a second number of packets in the second portion and the second portion is at least used to decode the file.

Abstract: Disclosed are methods, apparatus, systems, and computer readable storage media for providing a reference to a content object in a user interface using an on-demand database service. A computing device can receive data regarding identification of a content object, where the content object is stored in a data repository external to the on-demand database service. The data regarding the content object can be stored in a persistent object in a database of the on-demand database service. A reference can be provided representing the persistent object to a display device operable to display the reference in a user interface when the display device accesses the on-demand database service. One or more graphical representations can be exposed regarding the content object for display in the user interface by the display device, where the exposed graphical representations depend at least in part on the data repository.

Abstract: Stream-based data deduplication is provided in a multi-tenant shared infrastructure but without requiring “paired” endpoints having synchronized data dictionaries. Data objects processed by the dedupe functionality are treated as objects that can be fetched as needed. As such, a decoding peer does not need to maintain a symmetric library for the origin. Rather, if the peer does not have the chunks in cache that it needs, it follows a conventional content delivery network procedure to retrieve them. In this way, if dictionaries between pairs of sending and receiving peers are out-of-sync, relevant sections are then re-synchronized on-demand. The approach does not require that libraries maintained at a particular pair of sender and receiving peers are the same. Rather, the technique enables a peer, in effect, to “backfill” its dictionary on-the-fly. On-the-wire compression techniques are provided to reduce the amount of data transmitted between the peers.

Abstract: Lock access is managed in a data network having an initiator node and a remote target by issuing a lock command from a first process to the remote target via an initiator network interface controller to establish a lock on a memory location, and prior to receiving a reply to the lock command communicating a data access request to the memory location from the initiator network interface controller. Prior to receiving a reply to the data access request, an unlock command issues from the initiator network interface controller. The target network interface controller determines the lock content, and when permitted by the lock accesses the memory location. After accessing the memory location the target network interface controller executes the unlock command. When the lock prevents data access, the lock operation is retried a configurable number of times until data access is allowed or a threshold is exceeded.

Abstract: Data file in the data deduplication system are associated with a file identifier defined to have a first part identifier for denoting a location of the data file in a storage, and a second part identifier for uniquely identifying the data file in the data deduplication system over time.

Abstract: Resiliency in file replication scenarios via maintenance of multiple replication queues with differing susceptibility to various sources of data loss. A plurality of requests are received at a first file system location to write to one or more file system objects at the first file system location. Details about the plurality of requests are recorded in at least two replication queues which differ, at least in part, as to types of failures which will cause data loss. Responsive to detection of data loss in one of the replication queues, details about the plurality of requests are retrieved from another of the replication queues.

Abstract: Multiple instances of a computer system subscribe to a central data storage system. The central data storage system receives a set of entities that the instances wish to synchronize with one another, along with a schema representing those entities, from each instance. The central data storage system receives changes to the identified entities from the various instances, identifies conflicts, and synchronizes changes from a given instance to the other subscribing instances.

Abstract: The present invention relates to a device for detecting unwanted intrusions into an information network comprising a module for receiving raw data from the network, a plurality of search engines configured to detect an attack indicator and any derived data which may be corrupted, a distribution module suitable for allocating at least one search engine to each piece of raw data, an administrator module linked to the search engines and to the distribution module and configured to transmit each piece of derived data to said module as new raw data if it has not already been processed by said same search engine(s), so as to provide recursive analysis of each piece of raw data received by said receiving module. The invention further relates to a process implemented by a device of this type.

Abstract: Replicating a primary application cache that serves a primary application on one network node into a secondary application cache that serves a secondary application on a second network node. Cache portions that are within the primary application cache are identified, and then identifiers (but not the cache portions) are transferred to the second network node. Once these identifiers are received, the cache portions that they identify may then be retrieved into the secondary application caches. This process may be repeatedly performed such that the secondary application cache moves towards the same state as the primary application cache though the state of the primary application cache also changes as the primary application operates by receiving read and write requests.

Abstract: Systems and methods are described for backing up files and directories using a common backup format. The files and directories may be represented by objects within a data stream constructed using the common backup format. The data streams may be traversed and updated using a size tree such that modifications are made to individual objects within the data streams without complete traversal. This process results in efficient management of storage systems as read and write operations are not dependent on exhaustive traversal of data streams.

Abstract: a storage device wiping system and method that is activated from a remote server or other site when a computer is reported lost or stolen. The wipe technique selectively wipes all data files and free space before beginning to wipe the entire storage device. This causes any personal data files, photos, videos, and the like to be wiped first. Once the wiping process starts, it will continue until complete. The process starts or continues whenever the computer is booted. Only when all personal and sensitive data is wiped, will the system then change the encryption key (if there is one) and begin wiping the entire storage device.

Abstract: A computer system may perform substitutions for fields in a set of records, where performing a given substitution involves replacing a field in the set of records with a replacement field, and the substitutions remove the context information in the set of records while maintaining relevance of the set of records. Then, the computer system may generate an artificial set of records based, at least in part, on the set of records, where a given artificial record includes one or more modified portions of the set of records. Next, the computer system may combine the set of records and the artificial set of records into a second set of records, where at least some phrases or values in the second set of records are uniformly distributed.

Abstract: Resiliency in file replication scenarios via maintenance of multiple replication queues with differing susceptibility to various sources of data loss. A plurality of requests are received at a first file system location to write to one or more file system objects at the first file system location. Details about the plurality of requests are recorded in at least two replication queues which differ, at least in part, as to types of failures which will cause data loss. Responsive to detection of data loss in one of the replication queues, details about the plurality of requests are retrieved from another of the replication queues.

Abstract: At least one server receives at least one signal representing a request for an initiation of the server for the installation and configuration of an application. The server connects with client(s) after receiving the signal and transmits at least one display image to the client such that the client can render the display image via a web interface, wherein the display image provides information regarding the server. The server receives an application installer, wherein the client is can use the web interface to facilitate transmission of the application installer. The server installs and configures the application based on at least one input received from the client, wherein the client is enabled to use the web interface to facilitate transmitting the input to the server. The server generates an image based on the application configuration and transmits the image to a data management system for storage until deployment.

Abstract: In a synchronization system, the present invention provides an improved user interface through which a user can view and manage settings associated with the user's account in the synchronization system. In the preferred embodiment, a column is displayed for each electronic device associated with the user's account in the synchronization system. In each column is a visual representation of items (e.g., folders) that are (1) backed up, remotely accessible and/or synchronized in the synchronization system and (2) located on the electronic device associated with such column. For each item that is synchronized across multiple devices, all the visual representations of such item in the columns are aligned across a single row in the interface. In the preferred embodiment, there is an arrow, or other visual indicator, between the visual representations of such items to indicate that the items are synchronized.

Abstract: A designated storage system receives a request to store data in the local storage as a backup copy. The designated storage system requests a file system in the computer system to store the backup copy as a file in the local storage and maintains a record describing storage locations for each of the one or more sets of contiguous available file system data blocks. The storage system may transmit the record to a management computer configured to track which of the computer systems has stored the backup copy. The storage system then requests the file system to delete the file, whereupon the file system removes the file descriptor and frees the one or more file system data blocks in order to satisfy the deletion request but does not delete the data stored in the one or more file system data blocks.

Abstract: In accordance with an embodiment, described herein is a system and method for providing a job manager for use with a cloud computing environment. In accordance with an embodiment, the system include a job manager that manages the execution of jobs within the cloud environment including their job states. A job manager service provides an application program interface which receives administrative commands to be processed within the cloud environment as jobs. The job manager updates a job registry, including registering instances of the administrative commands together with unique job identifiers, and returning the job identifiers so that a user can retrieve command process status, and the result of the job can be stored in the job registry. For example, the job manager can perform housekeeping tasks, such as purging jobs according to a retention policy, performing any necessary cleanup, and performing security checks to ensure tasks are authorized.

Abstract: A computer-implemented method includes receiving a search query from a user through a user interface of a user computing device, identifying a search term within the search query, the search term including at least a portion of the search query, generating, based at least in part on the search term, one or more alternative search terms that are each different from the search term, and sending, over the communication network, the one or more alternative search terms to the user computing device.

Abstract: A device may correspond to a physical access controller in a distributed physical access control system. The device in a distributed system may include logic configured to detect a request from an application to access an application dataset, wherein the application dataset corresponds to a distributed dataset and determine whether the application dataset exists in the distributed system. The logic may be further configured to generate the application dataset in the distributed system, in response to determining that the application dataset does not exist in the distributed system, and send, to other devices in the distributed system, a request to join a dataset group that includes devices associated with the application dataset, in response to determining that the application dataset exists in the distributed system.

Abstract: Systems and methods for multi-object reporting in a content management system. A report type definition may define which objects are involved and how they are related. A report execution engine may generate a multi-object query language statement to translate the report type definition into query language. A query language execution engine may break the query language statement down into separate single pieces. A cost optimization engine may determine if it is cost efficient to join the objects. An indexed access execution engine may extract unique IDs of the objects and join the unique IDs to generate an index. A Lucene based search engine may be accessed according to the index, and the response is post processed to generate a multi-object report.

Abstract: In one embodiment, a node coupled to a plurality of storage devices executes a storage input/output (I/O) stack having a plurality of layers including a persistence layer. A portion of non-volatile random access memory (NVRAM) is configured as one or more logs. The persistence layer cooperates with the NVRAM to employ the log to record write requests received from a host and to acknowledge successful receipt of the write requests to the host. The log has a set of entries, each entry including (i) write data of a write request and (ii) a previous offset referencing a previous entry of the log. After a power loss, the acknowledged write requests are recovered by replay of the log in reverse sequential order using the previous record offset in each entry to traverse the log.

Abstract: A web-based system scans content for specific terms, and transforms occurrences of the terms into hypertext links. Each hypertext link provides access to a dynamically generated web page which contains aggregated content related to the respective term. The aggregated content may be gathered through a distributed keyword search of various content sources, including web sites and other sources on a wide area network. The results of the keyword search are aggregated into a single page or document, preferably with filtering to remove page elements not well suited for display on a mobile device. Occurrences of specific terms on this dynamically generated page may similarly be transformed into links, such that the user can browse content from various sources within a confined environment.

Abstract: Described are techniques and systems to migrate data from a first data structure to a second data structure stored in datastores which are replicated with one another. A “hot” datastore is replicated with one or more “warm” datastores. Triggers maintain consistency between the first data structure and the second data structure. Migration may involve testing using the second data structure of the “warm” datastore. Data processed by the first data structure on the “hot” datastore is distributed via replication to the “warm” datastore, and then by a trigger to the second data structure. Data processed by the second data structure on the “warm” datastore is distributed via trigger to the first data structure, and then by replication to the “hot” datastore. Once performance of the second data structure is deemed acceptable, the “warm” datastore may be designated as “hot” and synonyms therein may direct data to the second data structure.

Abstract: An apparatus, and an associated method, facilitates synchronization of a group of data objects. Batches of data objects are iteratively processed. When a synchronization response indicates that the data of the request is unsynchronizable, data associated with the synchronization request is marked. A retry procedure is subsequently utilized to attempt synchronization of the marked data objects and to determine the individual data objects that cannot be synchronized.

Abstract: A method for sharing documents between on-demand services is provided. In an embodiment, a user of a first on-demand service may be able to view a list of content that includes content stored at the first on-demand service and content stored at a second on-demand service. The content of the second on-demand service may be associated with information about the content, allowing the content to be shared among multiple users of the first on-demand service. The user wanting to view the content, select or click on an indicator identifying the content, a connection to the second on-demand service is established, and images of the content are sent from the second on-demand service to the first on-demand service.

Abstract: Methods, systems, and apparatus for obtaining one or more metadata files, determining, by one or more computers and in accordance with a minor compaction setting, to perform a minor compaction of the one or more metadata files, creating one or more intermediate metadata files that each include at least compacted contacts of one or more of the metadata files, according to the determination to perform minor compaction of the one or more metadata files, determining, in accordance with a major compaction setting, to perform a major compaction of one or more of the intermediate metadata files, and creating one or more snapshot metadata files that each include at least compacted contents of one or more of the intermediate metadata files, according to the determination to perform the major compaction of one or more of the intermediate metadata files.

Abstract: Systems, methods, and graphical user interfaces are disclosed that assist a user in deconflicting concurrency conflicts in a peering network in which ambiguous concurrency conflicts can arise. In accordance with some embodiments, a method for assisting a user in deconflicting concurrency conflicts is disclosed. The method includes detecting a plurality of ambiguous data conflicts between the local deployment and the peer deployment. The method further includes providing a graphical user interface to a user at the local deployment that allows the user to filter the plurality of ambiguous data conflicts according to a selected data conflict type of a plurality of predefined data conflict types selectable by the user through the graphical user interface. By providing such as graphical user interface, the user can easily filter a large number (e.g., hundreds) of ambiguous concurrency conflicts that may exist at a given time between the local deployment and the peer deployment.

Abstract: Described herein are systems and methods for efficient data replication. A set of hashes for a source object to be replicated is sent from the source local deduplication store to the remote server. The remote server generates a set of object hashes representative of data in the source object that is already present on the remote server, and data indicative of source object hashes that are not present on the remote server. The remote server transmits the generated data to the source local deduplication store. The source local deduplication store identifies portions of the source object that are not already present on the remote server based on the received data. The source local deduplication store transmits the identified portions of the source object to the remote server to replicate the source object on the remote server.

Abstract: A method synchronizes data between a first computer and a second computer. An original first data in a first computer is changed into revised first data in the first computer by inserting a data change into the original first data. The data change in the revised first data is identified and transmitted to a second computer in a message. The message instructs the second computer to convert an original second data stored in the second computer into a revised second data by inserting the data change into the original second data, where the original second data and the revised second data are used and managed by a resident application software on the second computer. The message is executable without use of the resident application software on the second computer, thus allowing changes to be made across disparate platforms.

Abstract: An exemplary information-processing device includes: a first receiving unit configured to receive plural categories for each of which a search condition is set, from a configuration device via a network; a first display control unit configured to control a display unit to display the received plural categories; a selecting unit configured to select one category from among the received plural categories; a transmitting unit configured to transmit to a search device a search condition that is set for the selected category; a second receiving unit configured to receive from the search device via the network a search result obtained using the transmitted search condition; and a second display control unit configured to control the display unit to display a content corresponding to the selected category, based on the received search result.

Abstract: Embodiments of the present invention provide a method, system and computer program product for mapping models to relational databases for reporting tools. In an embodiment of the invention, a model mapping method for models of a model driven development (MDD) environment can include initializing a database table and selecting a data source storing a modeling framework representation of a model. A first query can be executed against an application programming interface (API) of the data source supporting a modeling framework query language to retrieve selected elements of the model. Likewise, a second query can be executed against the API of the data source to retrieve selected attributes of the selected elements of the model. Finally, rows of the database table can be populated with the retrieved selected elements of the model and corresponding columns of the database table can be populated with the retrieved selected attributes of the selected elements of the model.

Abstract: A data enrichment system may include an attribute relevance module to measure relevance of an attribute to a data object to be enriched. The data object may include the attribute including a known or an unknown value. An output value confidence module may calculate a confidence of an output value of a source used for enrichment of the data object. The output value may represent the known and/or unknown values of the attribute. The system may use the measured relevance of the attribute and the calculated confidence of the output value to determine assignment of the known or unknown values to the attribute.

Abstract: Techniques for distributed storage using a plurality of computing devices connected to a network can include storing an electronic file in a local storage layer of one of the computing devices. The stored electronic file can be asymmetrically transmitted, in portions, over the network to other computing devices to store the file across the other computing devices in a distributed storage layer. The electronic file can be asynchronously transmitted over the network to a cloud storage layer such that the electronic file is mirrored in the cloud storage layer. The local storage layer of each computing device can store, for each electronic file stored in the distributed storage layer, metadata having pointers to locations of the portions the electronic files stored in the local storage layer and distributed storage layer. The electronic files stored in the distributed storage layer can be displayed as stored in a single logical drive.

Abstract: Scalable architectures, systems, and services are provided herein for generating jobs by applying user-specified rules to events in an action log framework (ALF) stream is disclosed. More specifically, collaboration environments can include features or mechanisms that allow end-users or collaborators to perform a variety of actions such as, for example, file uploads and previews, or collaboration operations such as, for example, task assignment and comments. These actions can be captured or logged by an action log framework and, as described herein, automatically translated into one or more jobs by applying customizable user-specified rules.

Abstract: Federated restores of availability groups are described. A system backs up an availability group from a node in a cluster of nodes based on an identifier of the cluster of nodes. The system outputs information associated with at least one database replica in any availability group which is backed up based on the identifier of the cluster of nodes in response to a user request for the information. The system restores a user-selected database replica to a user-selected node in the cluster of nodes based on a user selecting at least some of the information.

Abstract: A zero downtime upgrade procedure upgrading a source system to a target system is initiated that prepares software for the target system in parallel to the operation of the source system. As part of the upgrade procedure, source tables of the source system are renamed. Thereafter, the renamed source tables are cloned for the target system. Further, the renamed source tables are equipped with database triggers to transfer data from the renamed source tables to the cloned tables used by the source system according to a source database schema. Next, the target tables are generated that include updated software content for later use by the target system while the source tables are used via a bridge database schema. Tables can then be shared between the source database schema accessed via the bridge database schema and the target system.

Abstract: Read-only nodes of a distributed database system may implement index structure navigation using page versions. A read request may be received at a read only node of a distributed database for select data. Data pages linked together to form an index structure for data stored for the distributed database may be navigated according to versions maintained for the data pages in order to identify one or more locations to access for the select data. One or more prior versions of data pages may be selected as part navigating the index structure according to a consistent view of the distributed database associated with the read request. Change notifications may also be received at the read-only node modifying the data pages of the index structure. The index structure modifications may be applied without blocking the index structure navigation for servicing the read request.

Abstract: Systems and methods are provided for modifying metadata associated with content that is improperly formatted. In one configuration a metadata pre-processor receives metadata from a remote source, determines whether the received metadata is properly formatted, and, if it is not, modifies the metadata based on information received from a second remote source. In one configuration the modified metadata is then used to identify information associated with the content.

Abstract: Shuffling data stored in columnar tables improves data storage security, particularly when used in conjunction with other security operations, such as tokenization and cryptography. A data table is accessed, and pointer values of at least one column of the accessed table are shuffled, generating a protected table. An index table mapping index values to the shuffled pointer values is generated, allowing a user with access to both the protected table and the index table to generate the original table. Without both tables, users are only able to see either the shuffled data or the index values. Example shuffling methods include, but are not limited to, random shuffling, grouped shuffling, sorting by column value, and sorting by index value.

Abstract: Methods and systems for a copy-offload operation are provided. A soft range lock is placed for a data container for generating a token for a copy-offload operation for copying the data container from a source location to a destination location, where presence of the soft range lock indicates that content of the data container has not changed during the copy-offload operation. A token for the copy-offload operation represents the content of data container and includes information regarding the soft range lock. The token with the soft range lock information is provided to the client that requests the copy-offload operation. If the soft range lock exists, then the data container is copied without using a point in time copy of the data container.

Abstract: A method, system, and computer program product. The method for non-intrusive redeployment of a standby database facility comprises configuring a database system having a shared lock manager process to synchronize two or more concurrent access instances, then granting lock requests for access to a cache of database blocks. At some moment in time, the shared lock manager process may fail, and a monitor process detects the failure or other stoppage of the shared lock manager process. A new shared lock manager process and other processes are started, at least one of which serves for identifying the database blocks in the cache that have not yet been written to the database. The identified blocks are formed into a recovery set of redo operations. During this time, incoming requests for access to the cache of database blocks are briefly blocked, at least until the recovery set of redo operations has been formed.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating real-time search results. In one aspect, a method includes receiving a search query from a client; determining that real time search results should be included in a user interface document responsive to the search query; generating the user interface document, including client software to cause the client to present real time search results for the query; and sending the user interface document to the client.

Abstract: A data processing method capable of providing improved bidirectional data portability includes receiving, at a first device, a request from a client computer to export data records related to the client computer, wherein the data records have been created under control of a first instance of an application program, where at least a portion of the data records have a first creation timestamp, identifying the data records, generating a package for export of the data records by formatting the data records into an intermediate format, by a second device, opening the package and providing the data to a second instance of an application program on the second device, where a portion of the data records have a second creation timestamp that is later than the first creation timestamp, creating the data records, and setting, for each data record of the portion, the second creation timestamp to the first creation timestamp.

Abstract: A data replication system and method is disclosed in which a master file server uses a first filter in a kernel space to intercept file I/O events, send the file I/O events over a first network, for example a local area network, to a second filter in a kernel space of a first replica file server, and submit the file I/O event to a file system program in user space of the master file server to be processed. The second filter records the file I/O event in a memory of the second file server and sends an acknowledge message to the first filter indicating the file I/O event received by the second filter has been recorded in the replica file server. The first filter notifies user land in the first file server that the file I/O event has been processed if the first filter has received the acknowledge message and the file system program has completed processing the file I/O event in the first file server.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for updating data stored within the database. In some implementations, actions include determining a cut-off date, defining a first group of data within a first table based on the cut-off date, defining a second group of data within the first table based on the cut-off date, providing the second group of data in a second table, converting the first group of data from a first data structure to a second data structure to provide converted first data within the first table, making the converted first data available for access over a network, converting the second group of data from the first data structure to the second data structure to provide converted second data in the second table, and making the converted second data available for access over the network.

Abstract: Embodiments described herein may involve inconsistent queues. An example implementation may involve sending, to a playback device of a media playback system, a queue update message indicating a queue identification that indicates a first version of a playback queue at the playback device, and a playlist at the computing device. Thereafter, the implementation may involve receiving an error message indicating that the queue identification indicated in the queue update message has been superseded by a queue identification that indicates a second version of the playback queue at the playback device. Based on the received error message, the implementation may involve determining that the playlist at the computing device is different from the playback queue of the playback device. Based on the determination, the implementation may involve causing second one or more media items in the playback queue to be replaced with first one or more media items in the playlist.