Patents by Inventor Yen-Kuang Chen

Yen-Kuang Chen has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11388423
    Abstract: A video processing unit can include a non-object-based region-of-interest detection neural network, a threshold selection module and a region-of-interest map generator. The non-object-based region-of-interest detection neural network can be configured to receive a video frame and generate a plurality of candidate non-object-based region-of-interest blocks. The threshold selection module can be configured to receive the plurality of candidate non-object-based region-of-interest blocks and identify a plurality of selected region-of-interest blocks based on a predetermined threshold. The region-of-interest map generator can be configured to receive the selected non-object-based region-of-interest blocks and generate a region-of-interest map.
    Type: Grant
    Filed: March 23, 2020
    Date of Patent: July 12, 2022
    Assignee: Alibaba Group Holding Limited
    Inventors: Minghai Qin, Sicheng Li, Guanlin Wu, Tae Meon Bae, Yen-kuang Chen
  • Publication number: 20220215241
    Abstract: This application describes methods, systems, and apparatus, including computer programs encoded on computer storage media, for microarchitecture-aware program sampling. An exemplary method includes receiving one or more traces collected from one or more microarchitectures executing a computer program for evaluating hardware configurations; training a machine learning (ML) model with multi-task learning based on the one or more traces as one or more training tasks; generating a plurality of embedded vectors representing the computer program; and updating, based on the trained ML model, the plurality of embedded vectors.
    Type: Application
    Filed: January 5, 2021
    Publication date: July 7, 2022
    Inventors: Yuanwei FANG, Minghai QIN, Yen-kuang CHEN
  • Publication number: 20220210008
    Abstract: Data is received describing a local model of a first device generated by the first device based on sensor readings at the first device and a global model is updated that is hosted remote from the first device based on the local model and modeling devices in a plurality of different asset taxonomies. A particular operating state affecting one or more of a set of devices deployed in particular machine-to-machine network is detected and the particular machine-to-machine network is automatically reconfigured based on the global model.
    Type: Application
    Filed: August 6, 2021
    Publication date: June 30, 2022
    Applicant: Intel Corporation
    Inventors: Shao-Wen Yang, Michael J. Nolan, Ignacio J. Alvarez Martinez, Robert Adams, John Brady, Mark Kelly, Yen-Kuang Chen
  • Patent number: 11375241
    Abstract: The present disclosure relates to a method for compensating an image. The method comprises estimating transform coefficients of a frequency component for a first image based on the first image, performing a dot multiplication operation between the estimated transform coefficients and a basis function associated with the frequency component to generate a compensation image, and combining the first image and the compensation image to generate a combined image.
    Type: Grant
    Filed: October 20, 2020
    Date of Patent: June 28, 2022
    Assignee: Alibaba Group Holding Limited
    Inventors: Zihao Liu, Sicheng Li, Minghai Qin, Yen-kuang Chen
  • Patent number: 11366979
    Abstract: Image data is accessed. The image data includes frequency domain components. A subset of the frequency domain components is selected based on the relative importance of the frequency domain components. Only the subset of the frequency domain components is provided to an accelerator that executes a neural network to perform an artificial intelligence task using the subset of frequency domain components.
    Type: Grant
    Filed: November 14, 2019
    Date of Patent: June 21, 2022
    Assignee: Alibaba Group Holding Limited
    Inventors: Yuhao Wang, Minghai Qin, Yen-Kuang Chen
  • Publication number: 20220191537
    Abstract: In one embodiment, an apparatus comprises processing circuitry to: receive, via a communication interface, a compressed video stream captured by a camera, wherein the compressed video stream comprises: a first compressed frame; and a second compressed frame, wherein the second compressed frame is compressed based at least in part on the first compressed frame, and wherein the second compressed frame comprises a plurality of motion vectors; decompress the first compressed frame into a first decompressed frame; perform pixel-domain object detection to detect an object at a first position in the first decompressed frame; and perform compressed-domain object detection to detect the object at a second position in the second compressed frame, wherein the object is detected at the second position in the second compressed frame based on: the first position of the object in the first decompressed frame; and the plurality of motion vectors from the second compressed frame.
    Type: Application
    Filed: October 25, 2021
    Publication date: June 16, 2022
    Applicant: Intel Corporation
    Inventors: Yiting Liao, Yen-Kuang Chen, Shao-Wen Yang, Vallabhajosyula S. Somayazulu, Srenivas Varadarajan, Omesh Tickoo, Ibrahima J. Ndiour
  • Patent number: 11360906
    Abstract: The devices within an inter-device processing system maintain data coherency in the last level caches of the system as a cache line of data is shared between the devices by utilizing a directory in one of the devices that tracks the coherency protocol states of the memory addresses in the last level caches of the system.
    Type: Grant
    Filed: August 14, 2020
    Date of Patent: June 14, 2022
    Assignee: Alibaba Group Holding Limited
    Inventors: Lide Duan, Hongyu Liu, Hongzhong Zheng, Yen-Kuang Chen
  • Publication number: 20220179635
    Abstract: This application describes methods, systems, and apparatus, including computer programs encoded on computer storage media, of an AI-assisted compiler. An example method includes obtaining intermediate code and executable code generated by compiling a computer program with a compiler; determining a reward based on one or more traces obtained by executing the executable code in a runtime system; generating an embedding vector based on the intermediate code and the one or more traces to represent code execution states; determining, using a reinforcement learning agent, one or more optimization actions based on the embedding vector and the reward; and updating the compiler by applying the one or more optimization actions.
    Type: Application
    Filed: December 8, 2020
    Publication date: June 9, 2022
    Inventors: Yuanwei FANG, Yen-kuang CHEN
  • Publication number: 20220173987
    Abstract: Example task assignment methods disclosed herein for video analytics processing in a cloud computing environment include determining a graph, such as a directed acyclic graph, including nodes and edges to represent a plurality of video sources, a cloud computing platform, and a plurality of intermediate network devices in the cloud computing environment. Disclosed example task assignment methods also include specifying task orderings for respective sequences of video analytics processing tasks to be executed in the cloud computing environment on respective video source data generated by respective ones of the video sources.
    Type: Application
    Filed: September 13, 2021
    Publication date: June 2, 2022
    Inventors: Hong-Min Chu, Shao-Wen Yang, Yen-Kuang Chen
  • Publication number: 20220147567
    Abstract: A method and apparatus for characteristic-based video processing include: in response to receiving a region of a picture of a video sequence, determining a characteristic in the region, the region being independent of other regions of the picture for video coding; determining a class associated with the region based on the characteristic, the class being selected from a plurality of classes; and encoding the region using a parameter set associated with the class, the parameter set being selected from a plurality of parameter sets for video coding at different quality levels.
    Type: Application
    Filed: January 21, 2022
    Publication date: May 12, 2022
    Inventors: Shaolin XIE, Minghai QIN, Yen-kuang CHEN, Tae Meon BAE, Qinggang ZHOU
  • Publication number: 20220124375
    Abstract: The present disclosure relates to a method for compensating an image. The method comprises estimating transform coefficients of a frequency component for a first image based on the first image, performing a dot multiplication operation between the estimated transform coefficients and a basis function associated with the frequency component to generate a compensation image, and combining the first image and the compensation image to generate a combined image.
    Type: Application
    Filed: October 20, 2020
    Publication date: April 21, 2022
    Inventors: Zihao Liu, Sicheng Li, Minghai Qin, Yen-kuang Chen
  • Publication number: 20220103831
    Abstract: The present disclosure relates to a method for scheduling computation resources for generating feature maps for video. The method comprises determining runtime for generating feature maps of a reference picture and a predicted picture, determining available computation resources for generating the feature maps, and allocating, based on the runtime, one or more computation resources among the available computation resources for generating the feature maps such that the feature maps are generated at regular time intervals.
    Type: Application
    Filed: September 30, 2020
    Publication date: March 31, 2022
    Inventors: Sicheng Ll, Yuanwei Fang, Minghai Qin, Yen-kuang Chen
  • Publication number: 20220094961
    Abstract: The systems and methods are configured to efficiently and effectively determine or find an estimated optimal encoding parameter set. In one embodiment, a video encoding parameter set estimation method comprises: performing an offline encoding parameter set characteristic prediction process that determines an estimate of a candidate encoding parameter set characteristic; and performing an encoding parameter set search process that identifies a predicted or estimated optimal video encoding parameter set. The encoding parameter set search process can include applying a constraint to the candidate encoding parameter set characteristic; and determining if candidate encoding parameter set meets an objective, wherein the determining is performed if the constraint is satisfied. The candidate encoding parameter set characteristic can be an estimated encoding time of the candidate encoding parameter set. The objective can be the best video quality out of a plurality of candidate encoding parameter sets.
    Type: Application
    Filed: May 4, 2021
    Publication date: March 24, 2022
    Inventors: Tae Meon BAE, Minghai QIN, Yen-kuang CHEN, Guanlin WU, Sicheng LI
  • Patent number: 11277626
    Abstract: Video coding techniques including differential bit rate or quality coding of one or more regions of interest and one or more non-regions of interest based on information including one or more of coordinates of the one or more regions of interest, a target complexity, residual encoder bit data, a requested quality, a difference between the current video data frame and a reconstructed video data frame, a target quality, a requested bit rate, frame target bit allocation and an as encoded bit rate.
    Type: Grant
    Filed: February 21, 2020
    Date of Patent: March 15, 2022
    Assignee: Alibaba Group Holding Limited
    Inventors: Guanlin Wu, Minghai Qin, Tae Meon Bae, Sicheng Li, Yuanwei Fang, Yen-Kuang Chen
  • Publication number: 20220076095
    Abstract: Systems and methods for providing a neural network with multiple sparsity levels include sparsifying a matrix associated with the neural network to form a first sparse matrix; training the neural network using the first sparse matrix to form a second sparse matrix by fixing values and locations of non-zero elements of the first sparse matrix and updating a zero-value element of the first sparse matrix to be a non-zero value, wherein non-zero elements of the second sparse matrix includes the non-zero elements of the first sparse matrix; and outputting the second sparse matrix for executing the neural network.
    Type: Application
    Filed: September 4, 2020
    Publication date: March 10, 2022
    Inventors: Minghai QIN, Tianyun ZHANG, Fei SUN, Yen-Kuang CHEN
  • Publication number: 20220078473
    Abstract: The present disclosure relates to a computer-implemented method for processing video data. The method comprises receiving a user input corresponding to a first picture of the video data, generating, based on the user input, prediction information of the first picture with respect a reference picture of the video data, and encoding the first picture using the prediction information.
    Type: Application
    Filed: September 8, 2020
    Publication date: March 10, 2022
    Inventors: Yuhao WANG, Minghai QIN, Jian LOU, Yen-Kuang Chen
  • Publication number: 20220067509
    Abstract: The present disclosure relates to a system and method for machine learning from partial compressed representation. In some embodiments, an exemplary machine learning system includes: a compressor having circuitry configured to use a compression neural network to compress an image into a compressed representation, the compressed representation comprising a sequence of compressed channels; a selector having circuitry configured to select a part of the compressed channels from the compressed representation; and a learning module having circuitry configured to perform a learning task on the selected compressed channels.
    Type: Application
    Filed: September 2, 2020
    Publication date: March 3, 2022
    Inventors: Minghai QIN, Zhenzhen WANG, Yen-Kuang CHEN
  • Publication number: 20220067507
    Abstract: The present disclosure relates to a system and method for image processing. In some embodiments, an exemplary image processing method includes: receiving an image; compressing, with a compression neural network, the image into a compressed representation; and performing, with a processing neural network, a machine learning task on the compressed representation to generate a learning result. The compression neural network and the processing neural network are jointly trained.
    Type: Application
    Filed: August 28, 2020
    Publication date: March 3, 2022
    Inventors: Sicheng Li, Zihao Liu, Yen-Kuang Chen
  • Patent number: 11263261
    Abstract: A method and apparatus for characteristic-based video processing include: in response to receiving a region of a picture of a video sequence, determining a characteristic in the region, the region being independent of other regions of the picture for video coding; determining a class associated with the region based on the characteristic, the class being selected from a plurality of classes; and encoding the region using a parameter set associated with the class, the parameter set being selected from a plurality of parameter sets for video coding at different quality levels.
    Type: Grant
    Filed: February 14, 2020
    Date of Patent: March 1, 2022
    Assignee: Alibaba Group Holding Limited
    Inventors: Shaolin Xie, Minghai Qin, Yen-kuang Chen, Tae Meon Bae, Qinggang Zhou
  • Publication number: 20220058024
    Abstract: A method of performing out-of-order execution in a processing system comprising a processing unit and one or more accelerators comprises dispatching a plurality of coarse-grained instructions, each instruction extended to comprise one or more tags, wherein each tag comprises dependency information for the respective instruction expressed at a coarse-grained level. The method also comprises translating the plurality of coarse-grained instructions into a plurality of fine-grained instructions, wherein the dependency information is translated into dependencies expressed at a fine-grained level. Further, the method comprises resolving the dependencies at the fine-grained level and scheduling the plurality of fine-grained instructions for execution across the one or more accelerators in the processing system.
    Type: Application
    Filed: August 18, 2020
    Publication date: February 24, 2022
    Inventors: Yuanwei FANG, Fei SUN, Fei XUE, Yuejian XIE, Yuhao WANG, Yen-Kuang CHEN