Patents by Inventor Hulin DAI

Hulin DAI has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Tensor-based optimization method for memory management of a deep-learning GPU and system thereof
    Patent number: 11625320
    Abstract: The present disclosure relates to a tensor-based optimization method for GPU memory management of deep learning, at least comprising steps of: executing at least one computing operation, which gets tensors as input and generates tensors as output; when one said computing operation is executed, tracking access information of the tensors, and setting up a memory management optimization decision based on the access information, during a first iteration of training, performing memory swapping operations passively between a CPU memory and a GPU memory so as to obtain the access information about the tensors regarding a complete iteration; according to the obtained access information about the tensors regarding the complete iteration, setting up a memory management optimization decision; and in a successive iteration, dynamically adjusting the set optimization decision of memory management according to operational feedbacks.
    Type: Grant
    Filed: July 1, 2020
    Date of Patent: April 11, 2023
    Assignee: HUAZHONG UNIVERSITY OF SCIENCE AND TECHNOLOGY
    Inventors: Xuanhua Shi, Xuan Peng, Hai Jin, Hulin Dai, Weiliang Ma, Qian Xiong
  • TENSOR-BASED OPTIMIZATION METHOD FOR MEMORY MANAGEMENT OF A DEEP-LEARNING GPU AND SYSTEM THEREOF
    Publication number: 20210142178
    Abstract: The present disclosure relates to a tensor-based optimization method for GPU memory management of deep learning, at least comprising steps of: executing at least one computing operation, which gets tensors as input and generates tensors as output; when one said computing operation is executed, tracking access information of the tensors, and setting up a memory management optimization decision based on the access information, during a first iteration of training, performing memory swapping operations passively between a CPU memory and a GPU memory so as to obtain the access information about the tensors regarding a complete iteration; according to the obtained access information about the tensors regarding the complete iteration, setting up a memory management optimization decision; and in a successive iteration, dynamically adjusting the set optimization decision of memory management according to operational feedbacks.
    Type: Application
    Filed: July 1, 2020
    Publication date: May 13, 2021
    Inventors: Xuanhua SHI, Xuan PENG, Hai JIN, Hulin DAI, Weiliang MA, Qian XIONG