Patents by Inventor Taoran Lu

Taoran Lu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20160366422
    Abstract: Sample data and metadata related to spatial regions in images may be received from a coded video signal. It is determined whether specific spatial regions in the images correspond to a specific region of luminance levels. In response to determining the specific spatial regions correspond to the specific region of luminance levels, signal processing and video compression operations are performed on sets of samples in the specific spatial regions. The signal processing and video compression operations are at least partially dependent on the specific region of luminance levels.
    Type: Application
    Filed: February 19, 2015
    Publication date: December 15, 2016
    Applicant: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Peng YIN, Guan-Ming SU, Taoran LU, Tao CHEN, Walter J. HUSAK
  • Publication number: 20160286225
    Abstract: Video data are coded in a coding-standard layered bit stream. Given a base layer (BL) and one or more enhancement layer (EL) signals, the BL signal is coded into a coded BL stream using a BL encoder which is compliant to a first coding standard. In response to the BL signal and the EL signal, a reference processing unit (RPU) determines RPU processing parameters. In response to the RPU processing parameters and the BL signal, the RPU generates an inter-layer reference signal. Using an EL encoder which is compliant to a second coding standard, the EL signal is coded into a coded EL stream, where the encoding of the EL signal is based at least in part on the inter-layer reference signal. Receivers with an RPU and video decoders compliant to both the first and the second coding standards may decode both the BL and the EL coded streams.
    Type: Application
    Filed: September 24, 2013
    Publication date: September 29, 2016
    Inventors: Peng Yin, Taoran Lu, Tao Chen
  • Publication number: 20160134870
    Abstract: A high dynamic range input video signal characterized by either a gamma-based or a perceptually-quantized (PQ) source electro-optical transfer function (EOTF) is to be compressed. Given a luminance range for an image-region in the input, for a gamma-coded input signal, a rate-control adaptation method in the encoder adjusts a region-based quantization parameter (QP) so that it increases in highlight regions and decreases in dark regions, otherwise, for a PQ-coded input, the region-based QP increases in the dark areas and decreases in the highlight areas.
    Type: Application
    Filed: November 5, 2015
    Publication date: May 12, 2016
    Applicant: Dolby Laboratories Licensing Corporation
    Inventors: Taoran Lu, Peng Yin, Tao Chen, Guan-Ming Su
  • Publication number: 20160111130
    Abstract: In an embodiment, a method of creating a skimming preview of a video includes electronically receiving a plurality of video shots, analyzing each frame in a video shot from the plurality of video shots, where analyzing includes determining a saliency of each frame of the video shot. The method also includes determining a key frame of the video shot based on the saliency of each frame the video shot, extracting visual features from the key frame, performing shot clustering of the plurality of video shots to determine concept patterns based on the visual features, and generating a reconstruction reference tree based on the shot clustering. The reconstruction reference tree includes video shots categorized according to each concept pattern.
    Type: Application
    Filed: October 26, 2015
    Publication date: April 21, 2016
    Inventors: Taoran Lu, Zheng Yuan, Yu Huang, Dapeng Oliver Wu, Hong Heather Yu
  • Publication number: 20160088304
    Abstract: A multi-layer video system has a first layer encoder that encodes a first layer of video information, at least one second layer encoder that encodes at least one second layer of video information, and an encoder side reference processing unit (RPU) that estimates one or more of an optimal filter or an optimal process that applies on a reference picture that is reconstructed from the first video information layer, and processes a current picture of the second video information layer, based on a correlation between the first layer reconstructed reference picture. The correlation relates to a complexity characteristic that scaleably corresponds to the first video information layer reconstructed reference picture and the second video information layer current picture. A scalable video bitstream is outputted, which may be decoded by a compatible decoder. A decoder side RPU and the encoder side RPU function as an RPU pair.
    Type: Application
    Filed: December 4, 2015
    Publication date: March 24, 2016
    Inventors: Taoran LU, Peng YIN, Yuwen HE
  • Patent number: 9247246
    Abstract: A multi-layer video system has a first layer encoder that encodes a first layer of video information, at least one second layer encoder that encodes at least one second layer of video information, and an encoder side reference processing unit (RPU) that estimates one or more of an optimal filter or an optimal process that applies on a reference picture that is reconstructed from the first video information layer, and processes a current picture of the second video information layer, based on a correlation between the first layer reconstructed reference picture. The correlation relates to a complexity characteristic that scaleably corresponds to the first video information layer reconstructed reference picture and the second video information layer current picture. A scalable video bitstream is outputted, which may be decoded by a compatible decoder. A decoder side RPU and the encoder side RPU function as an RPU pair.
    Type: Grant
    Filed: March 19, 2013
    Date of Patent: January 26, 2016
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Taoran Lu, Peng Yin, Yuwen He
  • Publication number: 20150350661
    Abstract: The precision of up-sampling operations in a layered coding system is preserved when operating on video data with high bit-depth. In response to bit-depth requirements of the video coding or decoding system, scaling and rounding parameters are determined for a separable up-scaling filter. Input data are first filtered across a first spatial direction using a first rounding parameter to generate first up-sampled data. First intermediate data are generated by scaling the first up-sampled data using a first shift parameter. The intermediate data are then filtered across a second spatial direction using a second rounding parameter to generate second up-sampled data. Second intermediate data are generated by scaling the second up-sampled data using a second shift parameter. Final up-sampled data may be generated by clipping the second intermediate data.
    Type: Application
    Filed: December 4, 2013
    Publication date: December 3, 2015
    Applicant: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Peng YIN, Taoran LU, Tao CHEN
  • Publication number: 20150326865
    Abstract: Video data are coded in a coding-standard layered bit stream. Given a base layer (BL) and one or more enhancement layer (EL) signals, the BL signal is coded into a coded BL stream using a BL encoder which is compliant to a first coding standard. In response to the BL signal and the EL signal, a reference processing unit (RPU) determines RPU processing parameters. In response to the RPU processing parameters and the BL signal, the RPU generates an inter-layer reference signal. Using an EL encoder which is compliant to a second coding standard, the EL signal is coded into a coded EL stream, where the encoding of the EL signal is based at least in part on the inter-layer reference signal. Receivers with an RPU and video decoders compliant to both the first and the second coding standards may decode both the BL and the EL coded streams.
    Type: Application
    Filed: September 24, 2013
    Publication date: November 12, 2015
    Applicant: DOLY LABORATORIES LICENSING CORPORATION
    Inventors: Peng Yin, Taoran Lu, Tao Chen
  • Patent number: 9171578
    Abstract: In an embodiment, a method of creating a skimming preview of a video includes electronically receiving a plurality of video shots, analyzing each frame in a video shot from the plurality of video shots, where analyzing includes determining a saliency of each frame of the video shot. The method also includes determining a key frame of the video shot based on the saliency of each frame the video shot, extracting visual features from the key frame, performing shot clustering of the plurality of video shots to determine concept patterns based on the visual features, and generating a reconstruction reference tree based on the shot clustering. The reconstruction reference tree includes video shots categorized according to each concept pattern.
    Type: Grant
    Filed: May 9, 2011
    Date of Patent: October 27, 2015
    Assignee: Futurewei Technologies, Inc.
    Inventors: Taoran Lu, Zheng Yuan, Yu Huang, Dapeng Oliver Wu, Hong Heather Yu
  • Publication number: 20150271619
    Abstract: Embodiments of the present disclosure relate to processing audio or video signals captured by multiple devices. An apparatus for processing video and audio signals includes an estimating unit and a processing unit. The estimating unit may estimate at least one aspect of an array at least based on at least one video or audio signal captured respectively by at least one of portable devices arranged in an array. The processing unit may apply the aspect at least based on video to a process of generating a surround sound signal via the array, or apply the aspect at least based on audio to a process of generating a combined video signal via the array. With cross-referencing visual or acoustic hints, an improvement can be achieved in generating an audio or video signal.
    Type: Application
    Filed: March 16, 2015
    Publication date: September 24, 2015
    Applicant: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Xuejing Sun, Taoran Lu, Peng Yin
  • Patent number: 8891009
    Abstract: A system and method for retargeting video sequences are provided. A method for retargeting a video includes a plurality of frames includes determining saliency information for the plurality of frames, determining a cost metric for the video, and retargeting the video based on the cost metric to produce a retargeted video. The cost metric considers loss due to cropping, scaling, temporal factors, and spatial factors. The retargeting makes use of a crop window for each frame in the plurality of frames.
    Type: Grant
    Filed: August 29, 2011
    Date of Patent: November 18, 2014
    Assignee: Futurewei Technologies, Inc.
    Inventors: Taoran Lu, Zheng Yuan, Yu Huang, Dapeng Oliver Wu, Hong Heather Yu
  • Publication number: 20140286397
    Abstract: A high resolution 3D image may be encoded into a first multiplexed image frame and a second multiplexed image frame in a base layer (BL) video signal and an enhancement layer (EL) video signal. The first multiplexed image frame may comprise horizontal high resolution image data for both eyes, while the second multiplexed image frame may comprise vertical high resolution image data for both eyes. Encoded symmetric-resolution image data for the 3D image may be distributed to a wide variety of devices for 3D image processing and rendering. A recipient device may reconstruct reduced resolution 3D image from one of the first multiplexed image frame or the second multiplexed image frame. A recipient device may also reconstruct high resolution 3D image by combining high resolution image data from both of the first multiplexed image frame and the second multiplexed image frame.
    Type: Application
    Filed: September 27, 2012
    Publication date: September 25, 2014
    Applicant: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Tao Chen, Hariharan Ganapathy, I, Samir N. Hulyalkar, Gopi Lakshminarayanan, Peng Yin, Taoran Lu, Walter J. Husak
  • Publication number: 20140010295
    Abstract: Methods and apparatus are provided for geometric-based intra prediction. An apparatus includes a video encoder for encoding picture data for at least a portion of a block in a picture by detecting a local geometric pattern in a surrounding area with respect to the portion, and performing at least one of interpolation and extrapolation with respect to an edge direction of the local geometric pattern to generate an intra prediction for the portion.
    Type: Application
    Filed: January 19, 2012
    Publication date: January 9, 2014
    Applicant: THOMSON LICENSING
    Inventors: Taoran Lu, Qian Xu, Joel Sole, Peng Yin, Yunfei Zheng, Xiaoan Lu
  • Publication number: 20130251027
    Abstract: A multi-layer video system has a first layer encoder that encodes a first layer of video information, at least one second layer encoder that encodes at least one second layer of video information, and an encoder side reference processing unit (RPU) that estimates one or more of an optimal filter or an optimal process that applies on a reference picture that is reconstructed from the first video information layer, and processes a current picture of the second video information layer, based on a correlation between the first layer reconstructed reference picture. The correlation relates to a complexity characteristic that scaleably corresponds to the first video information layer reconstructed reference picture and the second video information layer current picture. A scalable video bitstream is outputted, which may be decoded by a compatible decoder. A decoder side RPU and the encoder side RPU function as an RPU pair.
    Type: Application
    Filed: March 19, 2013
    Publication date: September 26, 2013
    Applicant: Dolby Laboratories Licensing Corporation
    Inventors: Taoran Lu, Peng Yin, Yuwen He
  • Patent number: 8406297
    Abstract: A system and method for region-of-interest-based bit-allocation scheme for video coding is provided. A method for encoding an image sequence of inter-frames and intra-frames includes grouping the inter-frames and the intra-frames in at least one group of pictures (GOP), and performing a frame-level bit-allocation to inter-frames and the intra-frames in the GOP. For each frame of the inter-frames and the intra-frames in the GOP, the method also includes partitioning the frame into a plurality of macroblocks, identifying macroblocks in the plurality of macroblocks as having regions of interest (ROI), and performing a macroblock level bit-allocation for the frame based on macroblocks identified as having ROI. The method further includes encoding the image sequence based on the bit-allocations, thereby producing an encoded image sequence, and outputting the encoded image sequence.
    Type: Grant
    Filed: September 3, 2009
    Date of Patent: March 26, 2013
    Assignee: FutureWei Technologies, Inc.
    Inventors: Taoran Lu, Zhifeng Chen, Dapeng Oliver Wu, Yu Huang, Jun Tian, Hong Heather Yu
  • Publication number: 20130050574
    Abstract: A system and method for retargeting video sequences are provided. A method for retargeting a video includes a plurality of frames includes determining saliency information for the plurality of frames, determining a cost metric for the video, and retargeting the video based on the cost metric to produce a retargeted video. The cost metric considers loss due to cropping, scaling, temporal factors, and spatial factors. The retargeting makes use of a crop window for each frame in the plurality of frames.
    Type: Application
    Filed: August 29, 2011
    Publication date: February 28, 2013
    Applicant: FutureWei Technologies Inc.
    Inventors: Taoran Lu, Zheng Yuan, Yu Huang, Dapeng Oliver Wu, Hong Heather Yu
  • Publication number: 20120033949
    Abstract: In an embodiment, a method of creating a skimming preview of a video includes electronically receiving a plurality of video shots, analyzing each frame in a video shot from the plurality of video shots, where analyzing includes determining a saliency of each frame of the video shot. The method also includes determining a key frame of the video shot based on the saliency of each frame the video shot, extracting visual features from the key frame, performing shot clustering of the plurality of video shots to determine concept patterns based on the visual features, and generating a reconstruction reference tree based on the shot clustering. The reconstruction reference tree includes video shots categorized according to each concept pattern.
    Type: Application
    Filed: May 9, 2011
    Publication date: February 9, 2012
    Applicant: FutureWei Technologies, Inc.
    Inventors: Taoran Lu, Zheng Yuan, Yu Huang, Dapeng Oliver Wu, Hong Heather Yu
  • Publication number: 20100098162
    Abstract: A system and method for region-of-interest-based bit-allocation scheme for video coding is provided. A method for encoding an image sequence of inter-frames and intra-frames includes grouping the inter-frames and the intra-frames in at least one group of pictures (GOP), and performing a frame-level bit-allocation to inter-frames and the intra-frames in the GOP. For each frame of the inter-frames and the intra-frames in the GOP, the method also includes partitioning the frame into a plurality of macroblocks, identifying macroblocks in the plurality of macroblocks as having regions of interest (ROI), and performing a macroblock level bit-allocation for the frame based on macroblocks identified as having ROI. The method further includes encoding the image sequence based on the bit-allocations, thereby producing an encoded image sequence, and outputting the encoded image sequence.
    Type: Application
    Filed: September 3, 2009
    Publication date: April 22, 2010
    Applicant: FutureWei Technologies, Inc.
    Inventors: Taoran Lu, Zhifeng Chen, Dapeng Oliver Wu, Yu Huang, Jun Tian, Hong Heather Yu