Abstract: Technical solutions are described to implement a scalable write ahead log using a distributed file system. A general aspect includes a method for providing consistency among metadata replicas and content in an enterprise content management cluster. The method includes recording a transaction log entry in response to receiving a content modification request, the transaction log entry including a version identifier set to a first version value. The method also includes updating the transaction log entry to a second version value in response to successfully modifying content and one of a plurality of metadata replicas containing metadata corresponding to the request. The method also includes updating the transaction log entry to a third version value in response to successfully modifying each of the metadata replicas. The present document further describes examples of other aspects such as methods, computer products.

Abstract: Methods and a system are provided. A method includes automatically detecting, by an attribute structural variation detector, attribute structural variations in record schemas of a database lacking schema enforcement. The automatically detecting step includes encoding, by an encoder, nodes in the record schemas based on respective updated node labels to obtain a plurality of codes. The encoding step comprises, for each of the plurality of codes: recording, by a label frequency counter, a frequency f1 of the record schemas that include a given label; and recording, by a label frequency counter, a frequency fc of the record schemas that use a given one of the plurality of codes to update a label of a next level. An attribute variation is detected and retrieved responsive to the frequency fc?0, and the frequency f1>(two times the frequency fc).

Abstract: Technical solutions are described to implement a scalable write ahead log using a distributed file system. A general aspect includes a method for providing consistency among metadata replicas and content in an enterprise content management cluster. The method includes recording a transaction log entry in response to receiving a content modification request, the transaction log entry including a version identifier set to a first version value. The method also includes updating the transaction log entry to a second version value in response to successfully modifying content and one of a plurality of metadata replicas containing metadata corresponding to the request. The method also includes updating the transaction log entry to a third version value in response to successfully modifying each of the metadata replicas. The present document further describes examples of other aspects such as methods, computer products.

Abstract: Method and apparatus for configuring relevant parameters of MapReduce applications. The method includes: receiving a request for processing a first MapReduce job; obtaining job feature attributes of historical MapReduce jobs; searching out a job feature attribute of a second MapReduce job associated with the first MapReduce job from within the job feature attributes of the historical MapReduce jobs; configuring relevant parameters of the first MapReduce job based on the job feature attribute of the second MapReduce job. According to this method of configuring parameters, network overheads of file transfer can be effectively reduced, the method of configuring parameters of the MapReduce job can be processed locally as much as possible, thereby effectively increasing system resource utilization while reducing the administrator's configuration burden. An apparatus for configuring relevant parameters of MapReduce application is also provided.

Abstract: A method and system for generating a job alert. According to embodiments of the present invention, before a target job is processed, a characteristic of input and output of the target job in at least one stage is determined through analyzing a historical job, and a resource overhead associated with the processing of the target job is calculated based on the characteristic of input and output. Then, an alert for the target job is generated in response to the resource overhead exceeding a predetermined threshold. In such manner, an alert for the target job can be proactively generated before the resource overhead problem occurs, so as to enable an administrator or developer to discover a fault in advance and adopt measures actively to avoid loss and damage to the intermediate results or output data when the target job is processed.

Abstract: A system, method and computer program product configured for processing database data in a distributed database system, wherein the distributed database system comprises a plurality of computing nodes communicatively coupled via computer networks, the method comprising: creating a plurality of different data replicas wherein each of the data replicas is created in the following way: sorting the database data according to at least one data attribute; generating a row key based on the at least one data attribute; and using the sorted database data with the row key as the data replica, storing different data replicas in different computing nodes; and creating an index for each of the data replicas according to its row key.

Abstract: Garbage collection in a first node server of an in-memory replication system includes: in response to a garbage collection trigger in the first node server, determining whether identification information for a data object eligible for garbage collection in the first node server has been received by the first node server from at least a second node server in the in-memory replication system; and if the identification information has been received from at least the second node server, performing garbage collection on the data object with the first node server.

Abstract: A method and an apparatus for determining a location of a mobile device. The location of a mobile device is determined accurately according to information which includes call data records of the mobile device. By employing a partial ellipse integral model, two physical world factors are taken into consideration in reducing the location uncertainty in call data records. The factors include: spatiotemporal constraints of the device's movement in the physical world and the telecommunication cell area's geometry information, which increase the accuracy of determining the location of a mobile device.

Abstract: Methods and a system are provided. A method includes automatically detecting, by an attribute structural variation detector, attribute structural variations in record schemas of a database lacking schema enforcement. The automatically detecting step includes encoding, by an encoder, nodes in the record schemas based on respective updated node labels to obtain a plurality of codes. The encoding step comprises, for each of the plurality of codes: recording, by a label frequency counter, a frequency f1 of the record schemas that include a given label; and recording, by a label frequency counter, a frequency fc of the record schemas that use a given one of the plurality of codes to update a label of a next level. An attribute variation is detected and retrieved responsive to the frequency fc?0, and the frequency f1>(two times the frequency fc).

Abstract: Methods and a system are provided. A method includes automatically detecting, by an attribute structural variation detector, attribute structural variations in record schemas of a database lacking schema enforcement. The automatically detecting step includes encoding, by an encoder, nodes in the record schemas based on respective updated node labels to obtain a plurality of codes. The automatically detecting step further includes clustering, by a clusterer, the plurality of codes into one of a used category and an unused category. The used category and the unused category respectively consist of any of the plurality of codes used or unused to update a child label. The automatically detecting step also includes, when an intersection set formed from the used and unused categories has at least one member, retrieving, by the attribute structural variation detector, the at least one member as a structural variation between at least two of the record schemas.

Abstract: Embodiments include methods and devices for identifying record schemas in a non-relational database by assigning a record to a schema bucket according to structural characteristics of the record and identifying a record schema of the record within the schema bucket so that records with isomorphic record schemas in the non-relational database can be determined. Aspects also include encoding keys of a lowest level of a record according to a global codemap, sorting the keys of the lowest level that belong to different parent keys respectively and updating key names of corresponding parent keys in the parent level of a children level according to the codes of the keys of the children level.

Abstract: A mechanism is provided for identifying a usage for data in a data structure. A set of configuration files associated with a set of services are analyzed to identify at least one class associate with the data in the data structure thereby forming a data structure-to-class mapping. Source code associated with the set of services is analyzed to identify a set of services used by at least one class in the data structure-to-class mapping thereby forming a service-to-class mapping. A set of specification files associated with the set of services are analyzed to identify a set of uses associated with at least one service in the service-to-class mapping thereby forming a use-to-service mapping. An identification of usage information of the data structure is generated using the data structure-to-class mapping, the service-to-class mapping, and the use-to-service mapping.

Abstract: A system, method and computer program product configured for processing database data in a distributed database system, wherein the distributed database system comprises a plurality of computing nodes communicatively coupled via computer networks, the method comprising: creating a plurality of different data replicas wherein each of the data replicas is created in the following way: sorting the database data according to at least one data attribute; generating a row key based on the at least one data attribute; and using the sorted database data with the row key as the data replica, storing different data replicas in different computing nodes; and creating an index for each of the data replicas according to its row key.

Abstract: A computer program product configured to implement a method for processing database data in a distributed database system, wherein the distributed database system comprises a plurality of computing nodes communicatively coupled via computer networks, the method comprising: creating a plurality of different data replicas wherein each of the data replicas is created in the following way: sorting the database data according to at least one data attribute; generating a row key based on the at least one data attribute; and using the sorted database data with the row key as the data replica, storing different data replicas in different computing nodes; and creating an index for each of the data replicas according to its row key.

Abstract: A computer processing method includes receiving network data; filtering a node with a degree higher than a predefined threshold in the network data; storing the filtered node and its neighborhood relationship; clustering the filtered network data to obtain primary group(s); and obtaining a final group based on the filtered node and its neighborhood relationship and the primary group(s). The computer processing method and a corresponding system can be applicable to the processing for network data of large scale, and reduce greatly the processing time for clustering the network data of large scale, and the invention can be implemented well in parallel.

Abstract: The present invention provides a method and apparatus of controlling subscription requests, which can be used in a publish/subscribe engine. The method includes parsing a received subscription request into a predicate expression; determining an occurrence probability of the subscription request based on occurrence probabilities of predicates in the predicate expression; estimating a message increment to be caused by the subscription request based on a message publishing rate associated with the subscription request and on the occurrence probability of the subscription request; and controlling a quality of service of messages based on the estimated message increment.

Abstract: Embodiments include methods and devices for identifying record schemas in a non-relational database by assigning a record to a schema bucket according to structural characteristics of the record and identifying a record schema of the record within the schema bucket so that records with isomorphic record schemas in the non-relational database can be determined. Aspects also include encoding keys of a lowest level of a record according to a global codemap, sorting the keys of the lowest level that belong to different parent keys respectively and updating key names of corresponding parent keys in the parent level of a children level according to the codes of the keys of the children level.

Abstract: Embodiments of the present invention disclose a method and apparatus for generating a schema of a non-relational database. In the embodiments of the present invention, relationship among keys in at least one entry of a non-relational database may be determined, the keys may be grouped into at least one group based on the determined relationship, and a schema of the non-relational database may be generated according to the at least one group.

Abstract: A computer program product for performing a method comprising receiving, by a processor executing on a computing device, data to be processed from a scheduler configured to assign job data. The processor also storing the received data to be processed into a single queue, wherein the single queue is shared by the multiple virtual machines running on the physical machine, and in response to an idle virtual machine being among the multiple virtual machines, assigning, by the processor, data in the queue to the idle virtual machine to be processed by the idle virtual machine, wherein storing the received data to be processed into a single queue comprises parsing the received data to be processed and storing data to be processed, which is determined as specific to a predetermined application after the parsing, into the single queue.

Abstract: A method and an apparatus for determining a location of a mobile device. The location of a mobile device is determined accurately according to information which includes call data records of the mobile device. By employing a partial ellipse integral model, two physical world factors are taken into consideration in reducing the location uncertainty in call data records. The factors include: spatiotemporal constraints of the device's movement in the physical world and the telecommunication cell area's geometry information, which increase the accuracy of determining the location of a mobile device.