Abstract: A process for reducing amount of transmission of data to/from an external storage is performed in a computer. The process includes: storing a plurality of data sets by deduplicating a plurality in the external storage, wherein two or more data sets selected in order generated are collected in an object; determining necessity/unnecessity of defragmentation in units of object group in which two or more objects are collected in order generated; when determining to execute defragmentation, executing first defragmentation processing of acquiring all of the objects included in the object group as first objects from the external storage, combining valid data set having a number of references of 1 or more included in the first objects based on the order generated and the number of references to regenerate one or more second object, and storing the second object in place of the first objects in the external storage.

Abstract: A data processing apparatus includes a memory configured to store a bit array including a first Bloom filter associating with a first subset containing a data element matching a first classification condition and a second Bloom filter associating with a second subset containing a data element matching a second classification condition, and a processor configured to, when a first data element to be a search target is inputted, determine whether the same data element as the first data element is present in the first subset by using the first Bloom filter, determine whether the same data element as the first data element is present in the second data subset by using the second Bloom filter, and when all the data elements contained in the first subset are deleted, delete the first Bloom filter from the bit array.

Abstract: An information processing device includes a processor. The processor configured to extract part of data from estimation target data as a plurality of pieces of sample data and manage a number of duplications of the extracted plurality of pieces of sample data, classify the plurality of pieces of sample data into a first group and a second group based on the number of duplications, the first group having a number of duplications equal to or less that a predetermined number, the second group having a number of duplications more than a predetermined number, specify a first deduplication rate for sample data classified into the first group, specify a second deduplication rate for sample data classified into the second group, and specify a deduplication rate of the estimation target data based on the first deduplication rate and the second deduplication rate.

Abstract: A data processing apparatus includes a memory configured to store a bit array including a first Bloom filter associating with a first subset containing a data element matching a first classification condition and a second Bloom filter associating with a second subset containing a data element matching a second classification condition, and a processor configured to, when a first data element to be a search target is inputted, determine whether the same data element as the first data element is present in the first subset by using the first Bloom filter, determine whether the same data element as the first data element is present in the second data subset by using the second Bloom filter, and when all the data elements contained in the first subset are deleted, delete the first Bloom filter from the bit array.

Abstract: A process for reducing amount of transmission of data to/from an external storage is performed in a computer. The process includes: storing a plurality of data sets by deduplicating a plurality in the external storage, wherein two or more data sets selected in order generated are collected in an object; determining necessity/unnecessity of defragmentation in units of object group in which two or more objects are collected in order generated; when determining to execute defragmentation, executing first defragmentation processing of acquiring all of the objects included in the object group as first objects from the external storage, combining valid data set having a number of references of 1 or more included in the first objects based on the order generated and the number of references to regenerate one or more second object, and storing the second object in place of the first objects in the external storage.

Abstract: An information processing apparatus includes: a memory; and a processor coupled to the memory and configured to: each time when receiving a write request of write data, divide the write data into a plurality of unit bit strings having a fixed size; calculate a complexity of a data value indicated by each of the plurality of unit bit strings; determine a division position in the write data based on a variation amount of the complexity; divide the write data into a plurality of chunks by dividing the write data at the division position; and store data of the plurality of chunks in a storage device while performing deduplication.

Abstract: A storing unit stores a data set including a plurality of data elements and a first Bloom filter used to determine whether a query-target data element is present in the data set. A calculating unit deletes, when some data elements are deleted, a first bit array from the first Bloom filter. The first bit array has the number of bits corresponding to the number of deleted data elements. When a query-target first data element is entered, the calculating unit adds a second bit array temporarily to a second Bloom filter obtained by deleting the first bit array. The second bit array has the same number of bits as the first bit array, with all bits set to a specific value. Using the second Bloom filter, the calculating unit determines whether the first data element is present in the data set, from which some data elements have been deleted.

Abstract: A storing unit stores a data set including a plurality of data elements and a first Bloom filter used to determine whether a query-target data element is present in the data set. A calculating unit deletes, when some data elements are deleted, a first bit array from the first Bloom filter. The first bit array has the number of bits corresponding to the number of deleted data elements. When a query-target first data element is entered, the calculating unit adds a second bit array temporarily to a second Bloom filter obtained by deleting the first bit array. The second bit array has the same number of bits as the first bit array, with all bits set to a specific value. Using the second Bloom filter, the calculating unit determines whether the first data element is present in the data set, from which some data elements have been deleted.

Abstract: A disclosed information processing method is executed in a distributed processing system that processes data by plural information processing apparatuses. And the information processing method includes: obtaining, by a first information processing apparatus of the plural information processing apparatuses and from a second information processing apparatus that manages relations among data, identification information of first data that has a predetermined relation with second data and identification information of an information processing apparatus that manages the first data, upon detecting access to the second data managed by the first information processing apparatus; reading out, by the first information processing apparatus, the first data, upon determining that the information processing apparatus that manages the first data corresponds to the first information processing apparatus; and loading, by the first information processing apparatus, the first data into a cache.

Abstract: An information processing apparatus includes a receiving unit that receives an access request for data from one of a plurality of information processing apparatuses in a distributed processing system in which the information processing apparatuses execute a process in a distributed manner, a query issuing unit that issues, when the access request for the data is received by the receiving unit, a query to each of the information processing apparatuses as to whether the data is stored in a page cache managed by an operating system on each of the information processing apparatuses, and a responding unit that makes a response to the access request, the response specifying, as an access destination, an information processing apparatus that has responded to the query issued by the query issuing unit.

Abstract: An information processing apparatus includes a receiving unit that receives an access request for data from one of a plurality of information processing apparatuses in a distributed processing system in which the information processing apparatuses execute a process in a distributed manner, a query issuing unit that issues, when the access request for the data is received by the receiving unit, a query to each of the information processing apparatuses as to whether the data is stored in a page cache managed by an operating system on each of the information processing apparatuses, and a responding unit that makes a response to the access request, the response specifying, as an access destination, an information processing apparatus that has responded to the query issued by the query issuing unit.

Abstract: Each of a plurality of, as many as three or more, processes is executed by one of a first virtual machine and a second virtual machine, and each of the first and second virtual machines executes at least one of the processes. At the execution of each of the processes, a virtual memory unit corresponding to the process is referred to. Based on ranks each assigned in advance to one of the processes, a processor changes an assignment destination of a physical memory area currently assigned to each of virtual memory units, except for a virtual memory unit corresponding to a last-rank process, to a virtual memory unit corresponding to a next-rank process following a process corresponding to a virtual memory unit to which the physical memory area is currently assigned.

Abstract: A disclosed information processing method is executed in a distributed processing system that processes data by plural information processing apparatuses. And the information processing method includes: obtaining, by a first information processing apparatus of the plural information processing apparatuses and from a second information processing apparatus that manages relations among data, identification information of first data that has a predetermined relation with second data and identification information of an information processing apparatus that manages the first data, upon detecting access to the second data managed by the first information processing apparatus; reading out, by the first information processing apparatus, the first data, upon determining that the information processing apparatus that manages the first data corresponds to the first information processing apparatus; and loading, by the first information processing apparatus, the first data into a cache.

Abstract: An information processing device includes a memory and a processor coupled to the memory, wherein the processor executes a process comprising selecting data included in a same file as deletion target data from the memory when deleting the data cached in the memory at the caching from the memory and deleting the deletion target data and the data selected at the selecting, from the memory.