Patents by Inventor Cheng-Lung JEN

Cheng-Lung JEN has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11836893
    Abstract: A video processing circuit includes an input buffer, an online adaptation circuit, and an artificial intelligence (AI) super-resolution (SR) circuit. The input buffer receives input low-resolution (LR) frames and high-resolution (HR) frames from a video source over a network. The online adaptation circuit forms training pairs, and calculates an update to representative features that characterize the input LR frames using the training pairs. Each training pair formed by one of the input LR frames and one of the HR frames. The AI SR circuit receives the input LR frames from the input buffer and the representative features from the online adaptation circuit. Concurrently with calculating the update to the representative features, the AI SR circuit generates SR frames for display from the input LR frames based on the representative features. Each SR frame has a higher resolution than a corresponding one of the input LR frames.
    Type: Grant
    Filed: February 4, 2021
    Date of Patent: December 5, 2023
    Assignee: MediaTek Inc.
    Inventors: Cheng Lung Jen, Pei-Kuei Tsung, Yao-Sheng Wang, Chih-Wei Chen, Chih-Wen Goo, Yu-Cheng Tseng, Ming-En Shih, Kuo-Chiang Lo
  • Publication number: 20230328202
    Abstract: A frame interpolation method for generating a third image frame interpolated between a first image frame and a second image frame includes: performing motion estimation upon a first input image frame and a second input image frame, to obtain a single-directional motion, wherein the first input image frame is derived from the first image frame, and the second input image frame is derived from the second image frame; scaling the single-directional motion according to a time point of the third image frame, to generate a scaled motion; deriving a forward-warped result from a result of performing a forward warping operation and a first inverse operation upon the scaled motion; performing a second inverse operation upon the forward-warped result, to generate an inversed result; and generating the third image frame according to the first image frame, the second image frame, the forward-warped result, and the inversed result.
    Type: Application
    Filed: March 29, 2023
    Publication date: October 12, 2023
    Applicant: MEDIATEK INC.
    Inventors: Yao-Sheng Wang, Pei-Kuei Tsung, Chia-Ni Lu, Yu-Sheng Lin, Chien-Yu Huang, Chih-Wen Goo, Cheng-Lung Jen
  • Publication number: 20230053776
    Abstract: A system collects a training dataset for training an artificial intelligence (AI) model. The system receives high-resolution (HR) images and information of one or more regions-of-interest (ROIs) in the HR images. The system maps a stride distribution to the ROIs, and samples the HR images with non-uniform strides according to the ROIs and the stride distribution to generate corresponding low-resolution (LR) images. The system then trains the AI model to perform super-resolution (SR) operations using training pairs formed by the HR images and respective corresponding LR images.
    Type: Application
    Filed: July 21, 2022
    Publication date: February 23, 2023
    Inventors: Wai Mun Wong, Chia-Da Lee, Cheng Lung Jen, Chun Chen Lin, Shih-Che Chen, Pei-Kuei Tsung
  • Patent number: 11404025
    Abstract: A video processing system includes an input port and a video processing circuit. The input port obtains device information of a display panel. The video processing circuit obtains an input frame and the device information, configures an image enhancement operation according to the device information, generates an output frame by performing the image enhancement operation upon the input frame, and transmits the output frame to the display panel for video playback.
    Type: Grant
    Filed: March 15, 2020
    Date of Patent: August 2, 2022
    Assignee: MEDIATEK INC.
    Inventors: Cheng-Lung Jen, Pei-Kuei Tsung, Chih-Wen Goo, Yu-Cheng Tseng, Yu-Lin Hou, Kuo-Chiang Lo, Chia-Da Lee, Tung-Chien Chen
  • Publication number: 20210334586
    Abstract: An image processing circuit stores a training database and models in memory. The image processing circuit includes an attribute identification engine to identify an attribute from an input image according to a model stored in the memory. By enhancing the input image based on the identified attribute, a picture quality (PQ) engine in the image processing circuit generates an output image for display. The image processing circuit further includes a data collection module to generate a labeled image based on the input image labeled with the identified attribute, and to add the labeled image to the training database. A training engine in the image processing circuit then re-trains the model using the training database.
    Type: Application
    Filed: March 3, 2021
    Publication date: October 28, 2021
    Inventors: Chih-Wei Chen, Pei-Kuei Tsung, Chia-Da Lee, Yao-Sheng Wang, Hsiao-Chien Chiu, Cheng Lung Jen, Yu-Cheng Tseng, Kuo-Chiang Lo, Yu Chieh Lan
  • Publication number: 20210287340
    Abstract: A video processing circuit includes an input buffer, an online adaptation circuit, and an artificial intelligence (AI) super-resolution (SR) circuit. The input buffer receives input low-resolution (LR) frames and high-resolution (HR) frames from a video source over a network. The online adaptation circuit forms training pairs, and calculates an update to representative features that characterize the input LR frames using the training pairs. Each training pair formed by one of the input LR frames and one of the HR frames. The AI SR circuit receives the input LR frames from the input buffer and the representative features from the online adaptation circuit. Concurrently with calculating the update to the representative features, the AI SR circuit generates SR frames for display from the input LR frames based on the representative features. Each SR frame has a higher resolution than a corresponding one of the input LR frames.
    Type: Application
    Filed: February 4, 2021
    Publication date: September 16, 2021
    Inventors: Cheng Lung Jen, Pei-Kuei Tsung, Yao-Sheng Wang, Chih-Wei Chen, Chih-Wen Goo, Yu-Cheng Tseng, Ming-En Shih, Kuo-Chiang Lo
  • Publication number: 20210287338
    Abstract: An image processing circuit performs super-resolution (SR) operations. The image processing circuit includes memory to store multiple parameter sets of multiple artificial intelligent (AI) models. The image processing circuit further includes an image guidance module, a parameter decision module, and an SR engine. The image guidance module operates to detect a representative feature in an image sequence including a current frame and past frames within a time window. The parameter decision module operates to adjust parameters of one or more AI models based on a measurement of the representative feature. The SR engine operates to process the current frame using the one or more AI models with the adjusted parameters to thereby generate a high-resolution image for display.
    Type: Application
    Filed: December 10, 2020
    Publication date: September 16, 2021
    Inventors: Ming-En Shih, Ping-Yuan Tsai, Yu-Cheng Tseng, Kuo-Chen Huang, Kuo-Chiang Lo, Hsin-Min Peng, Chun Hsien Wu, Pei-Kuei Tsung, Tung-Chien Chen, Yao-Sheng Wang, Cheng Lung Jen, Chih-Wei Chen, Chih-Wen Goo, Yu-Sheng Lin, Tsu Jui Hsu
  • Publication number: 20210287339
    Abstract: An image processing apparatus includes a super-resolution (SR) circuit and a resizer circuit. The SR circuit performs an SR operation upon a first image to generate a second image, wherein a resolution of the second image is not lower than a resolution of the first image, and the SR operation is based, at least in part, on one or more artificial intelligence (AI) models. The resizer circuit performs a resize operation upon the second image to generate a third image, wherein a resolution of the third image is not lower than the resolution of the second image, and no AI model is involved in the resize operation.
    Type: Application
    Filed: March 9, 2021
    Publication date: September 16, 2021
    Inventors: Ming-En Shih, Yu-Cheng Tseng, Kuo-Chen Huang, Pei-Kuei Tsung, Hsin-Min Peng, Ping-Yuan Tsai, Kuo-Chiang Lo, Chun-Hsien Wu, Chih-Wei Chen, Cheng-Lung Jen
  • Patent number: 11004232
    Abstract: An object detection apparatus includes a boundary box decision circuit and a processing circuit. The boundary box decision circuit receives lens configuration information of a lens, and refers to the lens configuration information to determine a bounding box distribution of bounding boxes that are assigned to different detection distances with respect to the lens for detection of a target object. The processing circuit receives a captured image that is derived from an output of an image capture device using the lens, and performs object detection upon the captured image according to the bounding box distribution of the bounding boxes.
    Type: Grant
    Filed: February 12, 2020
    Date of Patent: May 11, 2021
    Assignee: MEDIATEK INC.
    Inventors: Chih-Wei Chen, Pei-Kuei Tsung, Shao-Yi Wang, Hung-Jen Chen, Kuan-Yu Chen, Cheng-Lung Jen
  • Publication number: 20210012110
    Abstract: An object detection apparatus includes a boundary box decision circuit and a processing circuit. The boundary box decision circuit receives lens configuration information of a lens, and refers to the lens configuration information to determine a bounding box distribution of bounding boxes that are assigned to different detection distances with respect to the lens for detection of a target object. The processing circuit receives a captured image that is derived from an output of an image capture device using the lens, and performs object detection upon the captured image according to the bounding box distribution of the bounding boxes.
    Type: Application
    Filed: February 12, 2020
    Publication date: January 14, 2021
    Inventors: Chih-Wei Chen, Pei-Kuei Tsung, Shao-Yi Wang, Hung-Jen Chen, Kuan-Yu Chen, Cheng-Lung Jen
  • Publication number: 20200327864
    Abstract: A video processing system includes an input port and a video processing circuit. The input port obtains device information of a display panel. The video processing circuit obtains an input frame and the device information, configures an image enhancement operation according to the device information, generates an output frame by performing the image enhancement operation upon the input frame, and transmits the output frame to the display panel for video playback.
    Type: Application
    Filed: March 15, 2020
    Publication date: October 15, 2020
    Inventors: Cheng-Lung Jen, Pei-Kuei Tsung, Chih-Wen Goo, Yu-Cheng Tseng, Yu-Lin Hou, Kuo-Chiang Lo, Chia-Da Lee, Tung-Chien Chen
  • Publication number: 20200135236
    Abstract: A mobile device enables a user to edit a video containing a human figure, such that an original human pose is modified into a target human pose in the video. In response to a user command, the mobile device first identifies key points of the human figure from a frame of the video. The user command indicates a target position of a given key point of the key points. The mobile device generates a target frame including the target human pose, with the given key point of the target human pose at the target position. An edited frame sequence is generated on the display including the target frame. The edited frame sequence shows the movement of the human pose transitioning into the target human pose.
    Type: Application
    Filed: October 29, 2018
    Publication date: April 30, 2020
    Inventors: Shih-Jung Chuang, Cheng-Lung Jen, Chih-Chung Chiang, Hsin-Ying Ko
  • Patent number: 9898672
    Abstract: A system of detection, tracking and identification of an evolutionary adaptation of a vehicle lamp includes an image capture device and a processor. The image capture device captures an image of a vehicle. The processor processes the image of the vehicle to generate a detection result of the vehicle lamp, analyzes and integrates vehicle lamp dynamic motion information and vehicle lamp multiple scale variation information based on the detection result, and then tracks the position of the vehicle lamp by applying a multiple scale vehicle lamp measurement model.
    Type: Grant
    Filed: March 29, 2016
    Date of Patent: February 20, 2018
    Assignee: INSTITUTE FOR INFORMATION INDUSTRY
    Inventors: Cheng-Lung Jen, Yen-Lin Chen, Chao-Wei Yu, Meng-Tsan Li, Augustine Tsai
  • Patent number: 9807316
    Abstract: An image segment method is provided in this disclosure. The method is suitable for an electronic apparatus including a first camera and a motion sensor. The method includes steps of: providing at least one pre-defined model mask; fetching pose data from the motion sensor, the pose data being related to an orientation or a position of the first camera; adjusting one of the at least one pre-defined model mask into an adaptive model mask according to the pose data; and, extracting an object from an image captured by the first camera according to the adaptive model mask.
    Type: Grant
    Filed: August 28, 2015
    Date of Patent: October 31, 2017
    Assignee: HTC Corporation
    Inventors: Cheng-Lung Jen, Pol-Lin Tai, Jing-Lung Wu, Hsin-Ti Chueh
  • Publication number: 20170220880
    Abstract: A system of detection, tracking and identification of an evolutionary adaptation of a vehicle lamp includes an image capture device and a processor. The image capture device captures an image of a vehicle. The processor processes the image of the vehicle to generate a detection result of the vehicle lamp, analyzes and integrates vehicle lamp dynamic motion information and vehicle lamp multiple scale variation information based on the detection result, and then tracks the position of the vehicle lamp by applying a multiple scale vehicle lamp measurement model.
    Type: Application
    Filed: March 29, 2016
    Publication date: August 3, 2017
    Inventors: Cheng-Lung JEN, Yen-Lin CHEN, Chao-Wei YU, Meng-Tsan LI, Augustine TSAI
  • Publication number: 20160073040
    Abstract: An image segment method is provided in this disclosure. The method is suitable for an electronic apparatus including a first camera and a motion sensor. The method includes steps of: providing at least one pre-defined model mask; fetching pose data from the motion sensor, the pose data being related to an orientation or a position of the first camera; adjusting one of the at least one pre-defined model mask into an adaptive model mask according to the pose data; and, extracting an object from an image captured by the first camera according to the adaptive model mask.
    Type: Application
    Filed: August 28, 2015
    Publication date: March 10, 2016
    Inventors: Cheng-Lung JEN, Pol-Lin TAI, Jing-Lung WU, Hsin-Ti CHUEH