Patents by Inventor Yao-Sheng Wang
Yao-Sheng Wang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11836893Abstract: A video processing circuit includes an input buffer, an online adaptation circuit, and an artificial intelligence (AI) super-resolution (SR) circuit. The input buffer receives input low-resolution (LR) frames and high-resolution (HR) frames from a video source over a network. The online adaptation circuit forms training pairs, and calculates an update to representative features that characterize the input LR frames using the training pairs. Each training pair formed by one of the input LR frames and one of the HR frames. The AI SR circuit receives the input LR frames from the input buffer and the representative features from the online adaptation circuit. Concurrently with calculating the update to the representative features, the AI SR circuit generates SR frames for display from the input LR frames based on the representative features. Each SR frame has a higher resolution than a corresponding one of the input LR frames.Type: GrantFiled: February 4, 2021Date of Patent: December 5, 2023Assignee: MediaTek Inc.Inventors: Cheng Lung Jen, Pei-Kuei Tsung, Yao-Sheng Wang, Chih-Wei Chen, Chih-Wen Goo, Yu-Cheng Tseng, Ming-En Shih, Kuo-Chiang Lo
-
Publication number: 20230334619Abstract: A device produces a dolly zoom effect with automatic focal length adjustment. The device uses a camera to capture an initial image including at least a foreground object and a background. The device includes a size tracking circuit to identify the size of the foreground object in the initial image. The device further includes a focal length control circuit. The focal length control circuit calculates an adjusted focal length of the camera to maintain the size of the foreground object in subsequently captured images.Type: ApplicationFiled: April 18, 2022Publication date: October 19, 2023Inventors: Chih-Wei Chen, Pei-Kuei Tsung, Yao-Sheng Wang, Chun Chen Lin, Chia-Ching Lin, Hsiao-Chien Chiu
-
Publication number: 20230328202Abstract: A frame interpolation method for generating a third image frame interpolated between a first image frame and a second image frame includes: performing motion estimation upon a first input image frame and a second input image frame, to obtain a single-directional motion, wherein the first input image frame is derived from the first image frame, and the second input image frame is derived from the second image frame; scaling the single-directional motion according to a time point of the third image frame, to generate a scaled motion; deriving a forward-warped result from a result of performing a forward warping operation and a first inverse operation upon the scaled motion; performing a second inverse operation upon the forward-warped result, to generate an inversed result; and generating the third image frame according to the first image frame, the second image frame, the forward-warped result, and the inversed result.Type: ApplicationFiled: March 29, 2023Publication date: October 12, 2023Applicant: MEDIATEK INC.Inventors: Yao-Sheng Wang, Pei-Kuei Tsung, Chia-Ni Lu, Yu-Sheng Lin, Chien-Yu Huang, Chih-Wen Goo, Cheng-Lung Jen
-
Publication number: 20230153958Abstract: Aspects of the disclosure provide a frame processor for processing frames with aliasing artifacts. For example, the frame processor can include a super-resolution (SR) and anti-aliasing (AA) engine and an attention reference frame generator coupled to the SR and AA engine. The SR and AA engine can be configured to enhance resolution and remove aliasing artifacts of a frame to generate a first high-resolution frame with aliasing artifacts and a second high-resolution frame with aliasing artifacts removed. The attention reference frame generator can be configured to generate an attention reference frame based on the first high-resolution frame and the second high-resolution frame.Type: ApplicationFiled: January 6, 2023Publication date: May 18, 2023Applicant: MEDIATEK INC.Inventors: Jen Cheng LUNG, Pei-Kuei TSUNG, Chih-Wei CHEN, Yao-Sheng WANG, Shih-Che CHEN, Yu-Sheng LIN, Chih-Wen GOO, Shih-Chin LIN, Huang TSUNG-SHIAN, Ying-Chieh CHEN
-
Publication number: 20230087097Abstract: A booster engine enhances the quality of a frame sequence. The booster engine receives, from a first stage circuit, the frame sequence with quality degradation in at least a frame. The the quality degradation includes at least one of uneven resolution and uneven frame per second (FPS). The booster engine queries an information repository for reference information on the frame, using a query input based on at least a region of the frame to obtain a query output. The booster engine then applies a neural network to the query input and the query output to generate an optimized frame, and sends an enhanced frame sequence including the optimized frame to a second stage circuit.Type: ApplicationFiled: September 7, 2022Publication date: March 23, 2023Inventors: Yao-Sheng Wang, Pei-Kuei Tsung, Chiani Lu, Chao-Min Chang, Yu-Sheng Lin, Wai Mun Wong
-
Publication number: 20230067568Abstract: The quality of a frame sequence is enhanced by a booster engine collaborating with a first stage circuit. The first stage circuit adjusts the quality degradation of the frame sequence when a condition in constrained resources is detected. The quality degradation includes at least one of uneven resolution and uneven frame per second (FPS). The booster engine receives the frame sequence from the first stage circuit, and generates an enhanced frame sequence based on the frame sequence for transmission to a second stage circuit.Type: ApplicationFiled: August 24, 2022Publication date: March 2, 2023Inventors: Yao-Sheng Wang, Pei-Kuei Tsung, Chiung-Fu Chen, Wai Mun Wong, Chao-Min Chang, Yu-Sheng Lin, Chiani Lu, Chih-Cheng Chen
-
Patent number: 11580621Abstract: Aspects of the disclosure provide a device for processing frames with aliasing artifacts. For example, the device can include a motion estimation circuit, a warping circuit coupled to the motion estimation circuit, and a temporal decision circuit coupled to the warping circuit. The motion estimation circuit can estimate a motion value between a current frame and a previous frame. The warping circuit can warp the previous frame based on the motion value such that the warped previous frame is aligned with the current frame and determine whether the current frame and the warped previous frame are consistent. The temporal decision circuit can generate an output frame, the output frame including either the current frame and the warped previous frame when the current frame and the warped previous frame are consistent, or the current frame when the current frame and the warped previous frame are not consistent.Type: GrantFiled: December 7, 2020Date of Patent: February 14, 2023Assignee: MEDIATEK INC.Inventors: Jen Cheng Lung, Pei-Kuei Tsung, Chih-Wei Chen, Yao-Sheng Wang, Shih-Che Chen, Yu-Sheng Lin, Chih-Wen Goo, Shih-Chin Lin, Huang Tsung-Shian, Ying-Chieh Chen
-
Publication number: 20220358619Abstract: A system produces a dolly zoom effect by utilizing side view information. The system first captures a main image at a main location. The main image includes at least a foreground object of a given size and a background. The system calculates one or more side view locations based on a zoom-in factor to be applied to the background and an estimated size of the foreground object. The system then guides a user to capture one or more side view images at the one or more side view locations. The foreground object of the given size is superimposed onto a zoomed-in background. Then the side view information is used by the system to perform image inpainting.Type: ApplicationFiled: April 18, 2022Publication date: November 10, 2022Inventors: Chih-Wei Chen, Pei-Kuei Tsung, Yao-Sheng Wang, Chun Chen Lin, Chia-Ching Lin
-
Publication number: 20210334586Abstract: An image processing circuit stores a training database and models in memory. The image processing circuit includes an attribute identification engine to identify an attribute from an input image according to a model stored in the memory. By enhancing the input image based on the identified attribute, a picture quality (PQ) engine in the image processing circuit generates an output image for display. The image processing circuit further includes a data collection module to generate a labeled image based on the input image labeled with the identified attribute, and to add the labeled image to the training database. A training engine in the image processing circuit then re-trains the model using the training database.Type: ApplicationFiled: March 3, 2021Publication date: October 28, 2021Inventors: Chih-Wei Chen, Pei-Kuei Tsung, Chia-Da Lee, Yao-Sheng Wang, Hsiao-Chien Chiu, Cheng Lung Jen, Yu-Cheng Tseng, Kuo-Chiang Lo, Yu Chieh Lan
-
Publication number: 20210287340Abstract: A video processing circuit includes an input buffer, an online adaptation circuit, and an artificial intelligence (AI) super-resolution (SR) circuit. The input buffer receives input low-resolution (LR) frames and high-resolution (HR) frames from a video source over a network. The online adaptation circuit forms training pairs, and calculates an update to representative features that characterize the input LR frames using the training pairs. Each training pair formed by one of the input LR frames and one of the HR frames. The AI SR circuit receives the input LR frames from the input buffer and the representative features from the online adaptation circuit. Concurrently with calculating the update to the representative features, the AI SR circuit generates SR frames for display from the input LR frames based on the representative features. Each SR frame has a higher resolution than a corresponding one of the input LR frames.Type: ApplicationFiled: February 4, 2021Publication date: September 16, 2021Inventors: Cheng Lung Jen, Pei-Kuei Tsung, Yao-Sheng Wang, Chih-Wei Chen, Chih-Wen Goo, Yu-Cheng Tseng, Ming-En Shih, Kuo-Chiang Lo
-
Publication number: 20210287338Abstract: An image processing circuit performs super-resolution (SR) operations. The image processing circuit includes memory to store multiple parameter sets of multiple artificial intelligent (AI) models. The image processing circuit further includes an image guidance module, a parameter decision module, and an SR engine. The image guidance module operates to detect a representative feature in an image sequence including a current frame and past frames within a time window. The parameter decision module operates to adjust parameters of one or more AI models based on a measurement of the representative feature. The SR engine operates to process the current frame using the one or more AI models with the adjusted parameters to thereby generate a high-resolution image for display.Type: ApplicationFiled: December 10, 2020Publication date: September 16, 2021Inventors: Ming-En Shih, Ping-Yuan Tsai, Yu-Cheng Tseng, Kuo-Chen Huang, Kuo-Chiang Lo, Hsin-Min Peng, Chun Hsien Wu, Pei-Kuei Tsung, Tung-Chien Chen, Yao-Sheng Wang, Cheng Lung Jen, Chih-Wei Chen, Chih-Wen Goo, Yu-Sheng Lin, Tsu Jui Hsu
-
Publication number: 20210174473Abstract: Aspects of the disclosure provide a device for processing frames with aliasing artifacts. For example, the device can include a motion estimation circuit, a warping circuit coupled to the motion estimation circuit, and a temporal decision circuit coupled to the warping circuit. The motion estimation circuit can estimate a motion value between a current frame and a previous frame. The warping circuit can warp the previous frame based on the motion value such that the warped previous frame is aligned with the current frame and determine whether the current frame and the warped previous frame are consistent. The temporal decision circuit can generate an output frame, the output frame including either the current frame and the warped previous frame when the current frame and the warped previous frame are consistent, or the current frame when the current frame and the warped previous frame are not consistent.Type: ApplicationFiled: December 7, 2020Publication date: June 10, 2021Applicant: MEDIATEK INC.Inventors: Jen Cheng LUNG, Pei-Kuei TSUNG, Chih-Wei CHEN, Yao-Sheng WANG, Shih-Che CHEN, Yu-Sheng LIN, Chih-Wen GOO, Shih-Chin LIN, Huang TSUNG-SHIAN, Ying-Chieh CHEN
-
Patent number: 10755169Abstract: A system performs convolution operations based on an analysis of the input size. The input includes data elements and filter weights. The system includes multiple processing elements. Each processing element includes multipliers and adders, with more of the adders than the multipliers. According to at least the analysis result which indicates whether the input size matches a predetermined size, the system is operative to select a first mode or a second mode. In the first mode, a greater number of the adders than the multipliers are enabled for each processing element to multiply transformed input and to perform an inverse transformation. In the second mode, an equal number of the adders and the multipliers are enabled for each processing element to multiply-and-accumulate the input. One or more of the multipliers are shared by the first mode and the second mode.Type: GrantFiled: December 14, 2017Date of Patent: August 25, 2020Assignee: MediaTek Inc.Inventors: Pei-Kuei Tsung, Chien-Hung Lin, Yao-Sheng Wang, Po-Yu Chen
-
Publication number: 20190114536Abstract: A system performs convolution operations based on an analysis of the input size. The input includes data elements and filter weights. The system includes multiple processing elements. Each processing element includes multipliers and adders, with more of the adders than the multipliers. According to at least the analysis result which indicates whether the input size matches a predetermined size, the system is operative to select a first mode or a second mode. In the first mode, a greater number of the adders than the multipliers are enabled for each processing element to multiply transformed input and to perform an inverse transformation. In the second mode, an equal number of the adders and the multipliers are enabled for each processing element to multiply-and-accumulate the input. One or more of the multipliers are shared by the first mode and the second mode.Type: ApplicationFiled: December 14, 2017Publication date: April 18, 2019Inventors: Pei-Kuei Tsung, Chien-Hung Lin, Yao-Sheng Wang, Po-Yu Chen
-
Publication number: 20180070010Abstract: An image capturing apparatus and an image zooming method thereof are provided. In the method, a wide image and a tele image are captured by utilizing a wide-angle lens and a telephoto lens respectively. An object of interest in the wide image or the tele image is recognized. Then, a zoom factor is received to zoom the wide image or the tele image, and a capture range of a window of interest (WOI) for capturing each of the wide image and the tele image is adjusted in a zooming process such that a center of the wide image captured by the window of interest moves toward the object of interest. Also, when the zoom factor reaches a magnification of the telephoto lens, the object of interest is as the same position in the wide image and the tele image captured from the window of interest.Type: ApplicationFiled: May 15, 2017Publication date: March 8, 2018Applicant: Altek Semiconductor Corp.Inventors: Yu-Chih Wang, Shou-Te Wei, Yao-Sheng Wang, Chi-Ying Huang, Cheng-Ming Chen
-
Patent number: 9697604Abstract: An image capturing device and a method for detecting image deformation thereof are provided. The method is for the image capturing device having a first sensor and a second image sensor, and the method includes the following steps. A first image is captured through the first image sensor, and a second image is captured through the second image sensor. A deform detection is performed according to the first and second images so as to obtain a comparison information between the first and second images. Whether a coordinate parameter relationship between the first and second images being varied is determined according to the comparison information, in which the coordinate parameter relationship is associated with a spatial configuration relationship between the first and second image sensors.Type: GrantFiled: June 12, 2014Date of Patent: July 4, 2017Assignee: Altek Semiconductor Corp.Inventors: Yu-Chih Wang, Hong-Long Chou, Che-Lun Chuang, Yao-Sheng Wang
-
Publication number: 20170155889Abstract: An image capturing device, a depth information generation method and an auto-calibration method thereof are provided. The methods are adapted to an image capturing device having dual lens without pre-alignment and include the following steps. A scene is captured by using the dual lens to generate a first image and a second image. First feature points and second feature points are respectively detected from the two images to calculate pixel offset information between the two images, and a rotation angle between the two images are obtained accordingly. An image warping process is performed on the two images according to the pixel offset information and the rotation angle to generate a first reference image and a second reference image aligned with the first reference image. Depth information of the scene is calculated or a stereoscopic image is generated according to the first reference image and the second reference image.Type: ApplicationFiled: February 4, 2016Publication date: June 1, 2017Inventors: Young-Fei Chien, Yu-Chih Wang, Hong-Long Chou, Che-Lun Chuang, Yao-Sheng Wang
-
Patent number: 9210303Abstract: The present disclosure illustrates a lens distortion correction method to solve influence for distortion correction caused by an alignment error between a lens center and a center of image sensor unit during assembling. The present disclosure is characterized in that the spatial geometric calibration is incorporated with the lens distortion correction and different image centers are selected repeatedly when transformation relationship of image coordinates is used to perform the lens distortion correction, so as to correct the image center of the image to be corrected and enhance the accuracy of lens distortion correction.Type: GrantFiled: June 3, 2014Date of Patent: December 8, 2015Assignee: ALTEK SEMICONDUCTOR CORPORATIONInventors: Hong-Long Chou, Yu-Chih Wang, Wen-Yan Chang, Yao-Sheng Wang
-
Publication number: 20150304527Abstract: The present disclosure illustrates a lens distortion correction method to solve influence for distortion correction caused by an alignment error between a lens center and a center of image sensor unit during assembling. The present disclosure is characterized in that the spatial geometric calibration is incorporated with the lens distortion correction and different image centers are selected repeatedly when transformation relationship of image coordinates id used to perform the lens distortion correction, so as to correct the image center of the image to be corrected and enhance the accuracy of lens distortion correction.Type: ApplicationFiled: June 3, 2014Publication date: October 22, 2015Applicant: Altek Semiconductor CorporationInventors: Hong-Long CHOU, Yu-Chih WANG, Wen-Yan CHANG, Yao-Sheng WANG
-
Publication number: 20150213588Abstract: An image capturing device and a method for detecting image deformation thereof are provided. The method is for the image capturing device having a first sensor and a second image sensor, and the method includes the following steps. A first image is captured through the first image sensor, and a second image is captured through the second image sensor. A deform detection is performed according to the first and second images so as to obtain a comparison information between the first and second images. Whether a coordinate parameter relationship between the first and second images being varied is determined according to the comparison information, in which the coordinate parameter relationship is associated with a spatial configuration relationship between the first and second image sensors.Type: ApplicationFiled: June 12, 2014Publication date: July 30, 2015Inventors: Yu-Chih Wang, Hong-Long Chou, Che-Lun Chuang, Yao-Sheng Wang