Patents by Inventor Ying-Hau Wu

Ying-Hau Wu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20220152512
    Abstract: The invention discloses a pure end-to-end deep reinforcement learning for training car racing game AI bot that uses only the velocity information extracted from screen for both training and testing phases without using any internal state from game environment, such as the car facing angle. The learned AI bot can play better than the average performance of human players. In addition, the reward function is designed to consist only the velocity value, and use Ape-X distributed training framework combined with a variant of Deep Q Network to solve the sparse training signal problem caused by the reward function of an original design. Moreover, limit learner rate method is designed that improves the training efficiency and training performance. The AI bot trained in this way can achieve performance beyond the average human level and reach a level close to professional players.
    Type: Application
    Filed: January 31, 2022
    Publication date: May 19, 2022
    Applicant: Kabushiki Kaisha Ubitus
    Inventors: Chiu-Chou Lin, I-Chen Wu, Jung-Chang Kuo, Ying-Hau Wu, An-Lun Teng, Pei-Wen Huang
  • Patent number: 11253783
    Abstract: The invention discloses a pure end-to-end deep reinforcement learning for training car racing game AI bot that uses only the velocity information extracted from screen for both training and testing phases without using any internal state from game environment, such as the car facing angle. The learned AI bot can play better than the average performance of human players. In addition, the reward function is designed to consist only the velocity value, and use Ape-X distributed training framework combined with a variant of Deep Q Network to solve the sparse training signal problem caused by the reward function of an original design. Moreover, limit learner rate method is designed that improves the training efficiency and training performance. The AI bot trained in this way can achieve performance beyond the average human level and reach a level close to professional players.
    Type: Grant
    Filed: January 20, 2020
    Date of Patent: February 22, 2022
    Inventors: Chiu-Chou Lin, Ying-Hau Wu, Kuan-Ming Lin, PeiWen Huang, I-Chen Wu, Cheng-Lun Tsai
  • Publication number: 20220014447
    Abstract: A method for enhancing quality of media uses an artificial intelligence (AI) enhancing model built-in the client device to enhance the quality of video streams. The AI enhance module is pre-trained by using a neural network in the server to analyze differences between the decoded images and the raw images that are generated by the server. Wherein, the AI enhance module enhances decoded images by using algorithms which are defined by analyzing differences between the decoded images and the raw images. Such that, the enhanced images are visually more similar to the raw images than the decoded images do.
    Type: Application
    Filed: September 26, 2021
    Publication date: January 13, 2022
    Applicant: Kabushiki Kaisha Ubitus
    Inventors: Jung-Chang Kuo, Wen-Kae Tsao, Ying-Hau Wu
  • Publication number: 20200238178
    Abstract: The invention discloses a pure end-to-end deep reinforcement learning for training car racing game AI bot that uses only the velocity information extracted from screen for both training and testing phases without using any internal state from game environment, such as the car facing angle. The learned AI bot can play better than the average performance of human players. In addition, the reward function is designed to consist only the velocity value, and use Ape-X distributed training framework combined with a variant of Deep Q Network to solve the sparse training signal problem caused by the reward function of an original design. Moreover, limit learner rate method is designed that improves the training efficiency and training performance. The AI bot trained in this way can achieve performance beyond the average human level and reach a level close to professional players.
    Type: Application
    Filed: January 20, 2020
    Publication date: July 30, 2020
    Applicant: Kabushiki Kaisha Ubitus
    Inventors: Chiu-Chou Lin, Ying-Hau Wu, Kuan-Ming Lin, PeiWen Huang, I-Chen Wu, Cheng-Lun Tsai