Patents by Inventor Jiwu Shu
Jiwu Shu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11899939Abstract: A read/write request processing method and server are provided. In this method, each terminal is grouped, and different service durations are assigned for all terminal groups, so that a server can process, within any service duration, only a read/write request sent by a terminal in a terminal group corresponding to the service duration. According to the application, a cache area of a network interface card of the server is enabled to store only limited quantities of queue pairs (QPs) and work queue elements (WQEs), thereby preventing uneven resource distribution in the cache area of the network interface card.Type: GrantFiled: July 9, 2021Date of Patent: February 13, 2024Assignees: Huawei Technologies Co., Ltd., TSINGHUA UNIVERSITYInventors: Jiwu Shu, Youmin Chen, Youyou Lu, Wenlin Cui
-
Method and system for constructing persistent memory index in non-uniform memory access architecture
Patent number: 11687392Abstract: A method for constructing a persistent memory index in a non-uniform memory access architecture includes: maintaining partial persistent views in a persistent memory and maintaining a global volatile view in a DRAM; an underlying persistent memory index processing a request in a foreground thread when cold data is accessed; when hot data is accessed, reading a key-value pair for a piece of hot data in the global volatile view in response to a query operation carried in the request, and in response to an insert/update/delete operation carried in the request, updating a local partial persistent view and the global volatile view; and in response to a hotspot migration, a background thread generating new partial persistent views and a new global volatile view, and recycling the partial persistent views and the global volatile view for old hot data into the underlying persistent memory index.Type: GrantFiled: November 23, 2021Date of Patent: June 27, 2023Assignee: TSINGHUA UNIVERSITYInventors: Jiwu Shu, Qing Wang, Youyou Lu, Zhuo Cheng -
METHOD AND SYSTEM FOR CONSTRUCTING PERSISTENT MEMORY INDEX IN NON-UNIFORM MEMORY ACCESS ARCHITECTURE
Publication number: 20220413952Abstract: A method for constructing a persistent memory index in a non-uniform memory access architecture includes: maintaining partial persistent views in a persistent memory and maintaining a global volatile view in a DRAM; an underlying persistent memory index processing a request in a foreground thread when cold data is accessed; when hot data is accessed, reading a key-value pair for a piece of hot data in the global volatile view in response to a query operation carried in the request, and in response to an insert/update/delete operation carried in the request, updating a local partial persistent view and the global volatile view; and in response to a hotspot migration, a background thread generating new partial persistent views and a new global volatile view, and recycling the partial persistent views and the global volatile view for old hot data into the underlying persistent memory index.Type: ApplicationFiled: November 23, 2021Publication date: December 29, 2022Inventors: Jiwu SHU, Qing WANG, Youyou LU, Zhuo CHENG -
Patent number: 11327939Abstract: A method for indexing dirty data in a storage system page includes: obtaining a point quantity of storage points in the storage page and dirty data distribution information; creating a bitmap based on the point quantity and dirty data distribution information; creating an extended segment set based on the dirty data distribution information, and obtaining the number of current extended segments in the extended segment set; obtaining, according to the point quantity, a first storage cost for indexing dirty data using the bitmap in the target storage page; obtaining, according to the number of current extended segments and the segment capacity, a second storage cost for indexing dirty data using the extended segments in the target storage page; and determine, according to the first storage cost and the second storage cost, to index the dirty data in the target storage page by means of the bitmap or the extended segments.Type: GrantFiled: January 24, 2018Date of Patent: May 10, 2022Assignee: ZTE CORPORATIONInventors: Shengmei Luo, Jiwu Shu, Youyou Lu, Hongzhang Yang
-
Patent number: 11269772Abstract: The present invention provides persistent memory storage engine device based on log structure and a control method, including persistent memory allocators, persistent operation logs, and a volatile index structure. The control method of log structure-based storage engine includes: allocating by persistent memory allocators, new spaces to each processor for storing updated key value pairs; organizing acquired operation information into compact log entries, and adding compact log entries into persistent operation logs according to first preset rule, where first preset rule is performing batch persistency on compact log entries from the plurality of processor cores; and updating index entries in volatile index structure to point to new key value pairs. This application fully exploits opportunity to reduce persistence overhead by redesigning log structure storage format and batch persistence mode.Type: GrantFiled: August 28, 2019Date of Patent: March 8, 2022Assignee: Tsinghua UniversityInventors: Jiwu Shu, Youmin Chen, Bohong Zhu, Youyou Lu
-
Publication number: 20210334011Abstract: A read/write request processing method and server are provided. In this method, each terminal is grouped, and different service durations are assigned for all terminal groups, so that a server can process, within any service duration, only a read/write request sent by a terminal in a terminal group corresponding to the service duration. According to the application, a cache area of a network interface card of the server is enabled to store only limited quantities of queue pairs (QPs) and work queue elements (WQEs), thereby preventing uneven resource distribution in the cache area of the network interface card.Type: ApplicationFiled: July 9, 2021Publication date: October 28, 2021Inventors: Jiwu SHU, Youmin CHEN, Youyou LU, Wenlin CUI
-
Patent number: 11086560Abstract: The invention discloses a data storage access method, device and apparatus for persistent memory. The method includes: enabling a file system in device to receive, in a kernel space, an access request of a user library, where the user library operates in user mode, and the access request is initiated by third-party application through user library and carries operation type; if the operation type is read operation, enabling the file system to allow third-party application to directly access persistent memory space of device through user library; and if the operation type is not read operation, enabling the file system to allow third-party application to access persistent memory space of device through user library and kernel thread, where kernel thread operates in kernel mode. In this way, the present invention can achieve both high performance and data security of persistent memory, and provide technical support for scalability in multi-core scenario.Type: GrantFiled: August 28, 2019Date of Patent: August 10, 2021Assignee: Tsinghua UniversityInventors: Jiwu Shu, Youmin Chen, Bohong Zhu, Youyou Lu
-
Publication number: 20210019257Abstract: The present invention provides persistent memory storage engine device based on log structure and a control method, including persistent memory allocators, persistent operation logs, and a volatile index structure. The control method of log structure-based storage engine includes: allocating by persistent memory allocators, new spaces to each processor for storing updated key value pairs; organizing acquired operation information into compact log entries, and adding compact log entries into persistent operation logs according to first preset rule, where first preset rule is performing batch persistency on compact log entries from the plurality of processor cores; and updating index entries in volatile index structure to point to new key value pairs. This application fully exploits opportunity to reduce persistence overhead by redesigning log structure storage format and batch persistence mode.Type: ApplicationFiled: August 28, 2019Publication date: January 21, 2021Inventors: Jiwu SHU, Youmin CHEN, Bohong ZHU, Youyou LU
-
Publication number: 20210011652Abstract: The invention discloses a data storage access method, device and apparatus for persistent memory. The method includes: enabling a file system in device to receive, in a kernel space, an access request of a user library, where the user library operates in user mode, and the access request is initiated by third-party application through user library and carries operation type; if the operation type is read operation, enabling the file system to allow third-party application to directly access persistent memory space of device through user library; and if the operation type is not read operation, enabling the file system to allow third-party application to access persistent memory space of device through user library and kernel thread, where kernel thread operates in kernel mode. In this way, the present invention can achieve both high performance and data security of persistent memory, and provide technical support for scalability in multi-core scenario.Type: ApplicationFiled: August 28, 2019Publication date: January 14, 2021Inventors: Jiwu SHU, Youmin CHEN, Bohong ZHU, Youyou LU
-
Patent number: 10789012Abstract: A write method and a write apparatus for a storage device, where the write method includes: acquiring n numerical values that need to be written; determining n bits corresponding to the n numerical values, and information about a stuck-at fault included in the n bits; grouping the n bits into B groups of bits, so that the B groups of bits meet a grouping condition; and correspondingly writing the n numerical values according to information about a stuck-at fault included in each group of bits in the B groups of bits and a numerical value that needs to be written and that is corresponding to the information about the stuck-at fault included in each group of bits in the B groups of bits.Type: GrantFiled: January 17, 2018Date of Patent: September 29, 2020Assignee: HUAWEI TECHNOLOGIES CO., LTD.Inventors: Jiwu Shu, Jie Fan, Guanyu Zhu
-
Publication number: 20200034340Abstract: A flash file system and a data management method thereof are provided, the system including: a creation module, configured to divide a flash memory into a file system region and a flash buffer region; a marking module configured to mark written data as dirty data in a memory buffer when the data are written and an amount of the written data is less than or equal to a preset marking threshold; a synchronization module, configured to merge the dirty data in the memory buffer and write the same into the flash buffer region when data synchronization is required, and notify a backfilling module when the flash buffer region is full; and the backfilling module, configured to read the dirty data in the flash buffer region, write the dirty data into the file system region, and erase the flash buffer region.Type: ApplicationFiled: February 6, 2018Publication date: January 30, 2020Inventors: Jiwu SHU, Shengmei LUO, Youyou LU, Jiacheng ZHANG, Hongzhang YANG
-
Publication number: 20190370238Abstract: A method for indexing dirty data in a storage system page includes: obtaining a point quantity of storage points in the storage page and dirty data distribution information; creating a bitmap based on the point quantity and dirty data distribution information; creating an extended segment set based on the dirty data distribution information, and obtaining the number of current extended segments in the extended segment set; obtaining, according to the point quantity, a first storage cost for indexing dirty data using the bitmap in the target storage page; obtaining, according to the number of current extended segments and the segment capacity, a second storage cost for indexing dirty data using the extended segments in the target storage page; and determine, according to the first storage cost and the second storage cost, to index the dirty data in the target storage page by means of the bitmap or the extended segments.Type: ApplicationFiled: January 24, 2018Publication date: December 5, 2019Inventors: Shengmei Luo, Jiwu Shu, Youyou Lu, Hongzhang Yang
-
Patent number: 10379954Abstract: The present invention provides a method and an apparatus for cache management of transaction processing in persistent memory.Type: GrantFiled: December 28, 2015Date of Patent: August 13, 2019Assignee: TSINGHUA UNIVERSITYInventors: Jiwu Shu, Youyou Lu
-
Patent number: 10372337Abstract: A write request processing method and a memory controller, where the method includes, determining a second write request set, by the memory controller, after determining that a quantity of write requests in a to-be-scheduled first write request set is less than a quantity of unoccupied storage units in a memory, where the write request in the first write request set is located before a first memory barrier, where a write request in the second write request set is a log write request, and where the write request in the second write request set is located behind the first memory barrier. The memory controller sends the write request in the first write request set and the write request in the second write request set in parallel to different unoccupied storage units in the memory.Type: GrantFiled: November 10, 2017Date of Patent: August 6, 2019Assignee: HUAWEI TECHNOLOGIES CO., LTD.Inventors: Jiwu Shu, Long Sun, Yuangang Wang
-
Patent number: 10191851Abstract: The present invention discloses a method for distributed transaction processing in a flash memory, including the following steps: S1. performing two-phase commit on a transaction, removing a state log record of a two-phase commit protocol, and internalizing as an operation on flash memory metadata in a transaction interface; S2. storing a temporary data object as a shadow version while performing the transaction, using a shadow mapping table to store the address of the shadow version or a state of a page, using page metadata to record transaction information, using a transaction metadata page to record a transaction state, and using a transaction state table to record an address of the transaction metadata page; and S3. when the coordinator or a participant fails, recovering the FTL mapping table, shadow mapping table, and transaction state table with the help of stored data and flash memory metadata.Type: GrantFiled: December 28, 2015Date of Patent: January 29, 2019Assignee: TSINGHUA UNIVERSITYInventors: Jiwu Shu, Youyou Lu, Fei Li
-
Patent number: 10048999Abstract: The present invention discloses a method for optimizing recovery of a single-disk failure, including the following steps: obtaining, according to current load information, an amount of data expected to be read and an allowed number of iterations; obtaining a recovery optimization policy for failed data in each single stripe, and combining an initial recovery policy for multiple stripes; and further optimizing the initial recovery policy by using a greedy algorithm based on tabu search, subject to the amount of data expected to be read and the allowed number of iterations, to finally obtain an optimal recovery policy with a smallest quantity of seeks. The optimization method of the present invention reduces the amount of data to be read and the quantity of seek operations, and improves the efficiency of recovering a single-disk failure. The present invention further discloses an apparatus for optimizing recovery of a single-disk failure.Type: GrantFiled: December 28, 2015Date of Patent: August 14, 2018Inventors: Jiwu Shu, Zhirong Shen
-
Publication number: 20180143787Abstract: A write method and a write apparatus for a storage device, where the write method includes: acquiring n numerical values that need to be written; determining n bits corresponding to the n numerical values, and information about a stuck-at fault included in the n bits; grouping the n bits into B groups of bits, so that the B groups of bits meet a grouping condition; and correspondingly writing the n numerical values according to information about a stuck-at fault included in each group of bits in the B groups of bits and a numerical value that needs to be written and that is corresponding to the information about the stuck-at fault included in each group of bits in the B groups of bits.Type: ApplicationFiled: January 17, 2018Publication date: May 24, 2018Applicant: HUAWEI TECHNOLOGIES CO.,LTD.Inventors: Jiwu Shu, Jie Fan, Guanyu Zhu
-
Patent number: 9959053Abstract: The present invention provides a method for constructing an NVRAM-based efficient file system, including the following steps: S1. determining a file operation type of the file system, where the file operation type includes a file read operation, a non-persistent file write operation, and a persistent file write operation; and S2. if the file operation type is a non-persistent file write operation, writing, by the file system, content of the non-persistent file write operation to a dynamic random access memory DRAM, updating a corresponding DRAM cache block index, and flushing, at a preset time point, the content of the non-persistent file write operation back to a non-volatile random access memory NVRAM asynchronously, or otherwise, copying, by the file system, related data directly between the NVRAM/DRAM and the user buffer.Type: GrantFiled: December 28, 2015Date of Patent: May 1, 2018Inventors: Jiwu Shu, Jiaxin Ou, Youyou Lu
-
Publication number: 20180088827Abstract: A write request processing method and a memory controller, where the method includes, determining a second write request set, by the memory controller, after determining that a quantity of write requests in a to-be-scheduled first write request set is less than a quantity of unoccupied storage units in a memory, where the write request in the first write request set is located before a first memory barrier, where a write request in the second write request set is a log write request, and where the write request in the second write request set is located behind the first memory barrier. The memory controller sends the write request in the first write request set and the write request in the second write request set in parallel to different unoccupied storage units in the memory.Type: ApplicationFiled: November 10, 2017Publication date: March 29, 2018Inventors: Jiwu Shu, Long Sun, Yuangang Wang
-
Patent number: 9898228Abstract: A write method and a write apparatus for a storage device, where the write method includes: acquiring n numerical values that need to be written; determining n bits corresponding to the n numerical values, and information about a stuck-at fault included in the n bits; grouping the n bits into B groups of bits, so that the B groups of bits meet a grouping condition; and correspondingly writing the n numerical values according to information about a stuck-at fault included in each group of bits in the B groups of bits and a numerical value that needs to be written and that is corresponding to the information about the stuck-at fault included in each group of bits in the B groups of bits.Type: GrantFiled: May 19, 2016Date of Patent: February 20, 2018Assignee: HUAWEI TECHNOLOGIES CO., LTD.Inventors: Jiwu Shu, Jie Fan, Guanyu Zhu