Patents by Inventor Shujie Liu

Shujie Liu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10282633
    Abstract: A method for processing media assets includes, given a first media asset, deriving characteristics from the first media asset, searching for other media assets having characteristics that correlate to the characteristics of the first media asset, when a match is found, deriving content corrections for the first media asset or a matching media asset from the other of the first media asset or the matching media asset, and correcting content of the first media asset or the matching media asset based on the content corrections.
    Type: Grant
    Filed: October 20, 2016
    Date of Patent: May 7, 2019
    Assignee: Apple Inc.
    Inventors: Shujie Liu, Jiefu Zhai, Chris Y. Chung, Hsi-Jung Wu, Yunfei Zheng, Albert E. Keinath, Xiaosong Zhou, Ke Zhang
  • Patent number: 10198792
    Abstract: Several implementations relate, for example, to depth encoding and/or filtering for 3D video (3DV) coding formats. A sparse dyadic mode for partitioning macroblocks (MBs) along edges in a depth map is provided as well as techniques for trilateral (or bilateral) filtering of depth maps that may include adaptive selection between filters sensitive to changes in video intensity and/or changes in depth. One implementation partitions a depth picture, and then refines the partitions based on a corresponding image picture. Another implementation filters a portion of a depth picture based on values for a range of pixels in the portion. For a given pixel in the portion that is being filtered, the filter weights a value of a particular pixel in the range by a weight that is based on one or more of location distance, depth difference, and image difference.
    Type: Grant
    Filed: October 14, 2010
    Date of Patent: February 5, 2019
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Wang Lin Lai, Shujie Liu, Dong Tian
  • Patent number: 10062412
    Abstract: Methods for organizing media data by automatically segmenting media data into hierarchical layers of scenes are described. The media data may include metadata and content having still image, video or audio data. The metadata may be content-based (e.g., differences between neighboring frames, exposure data, key frame identification data, motion data, or face detection data) or non-content-based (e.g., exposure, focus, location, time) and used to prioritize and/or classify portions of video. The metadata may be generated at the time of image capture or during post-processing. Prioritization information, such as a score for various portions of the image data may be based on the metadata and/or image data. Classification information such as the type or quality of a scene may be determined based on the metadata and/or image data. The classification and prioritization information may be metadata and may be used to organize the media data.
    Type: Grant
    Filed: June 3, 2016
    Date of Patent: August 28, 2018
    Assignee: Apple Inc.
    Inventors: Shujie Liu, Yunfei Zheng, Xiaosong Zhou, Hsi-Jung Wu, Ke Zhang, Albert E. Keinath, Chris Y. Chung
  • Publication number: 20180165796
    Abstract: Several implementations relate, for example, to depth encoding and/or filtering for 3D video (3DV) coding formats. A sparse dyadic mode (308) for partitioning macroblocks (MBs) along edges in a depth map is provided as well as techniques for trilateral (or bilateral) filtering of depth maps that may include adaptive selection between filters sensitive to changes in video intensity and/or changes in depth. One implementation partitions a depth picture, and then refines the partitions based on a corresponding image picture. Another implementation filters a portion of a depth picture based on values for a range of pixels in the portion. For a given pixel in the portion that is being filtered, the filter weights a value of a particular pixel in the range by a weight that is based on one or more of location distance, depth difference, and image difference.
    Type: Application
    Filed: January 26, 2018
    Publication date: June 14, 2018
    Applicant: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Wang Lin LAI, Shujie LIU, Dong TIAN
  • Publication number: 20170357871
    Abstract: Techniques are disclosed for estimating quality of images in an automated fashion. According to these techniques, a source image may be downsampled to generate at least two downsampled images at different levels of downsampling. Blurriness of the images may be estimated starting with a most-heavily downsampled image. Blocks of a given image may be evaluated for blurriness and, when a block of a given image is estimated to be blurry, the block of the image and co-located blocks of higher resolution image(s) may be designated as blurry. Thereafter, a blurriness score may be calculated for the source image from the number of blocks of the source image designated as blurry.
    Type: Application
    Filed: June 9, 2017
    Publication date: December 14, 2017
    Inventors: Jiefu Zhai, Ke Zhang, Yunfei Zheng, Shujie Liu, Albert Keinath, Xiaosong Zhou, Chris Chung, Hsi-Jung Wu
  • Publication number: 20170358059
    Abstract: Techniques for cropping images containing an occlusion are presented. A method for image editing is presented comprising, when an occlusion is detected in an original digital image, determining an area occupied by the occlusion, assigning importance scores to different content elements of the original digital image, defining a cropping window around an area of the original digital image that does not include the area occupied by the occlusion and that is based on the importance scores, and cropping the original digital image to the cropping window.
    Type: Application
    Filed: June 9, 2017
    Publication date: December 14, 2017
    Inventors: Ke Zhang, Jiefu Zhai, Yunfei Zheng, Shujie Liu, Albert E. Keinath, Xiaosong Zhou, Chris Y. Chung, Hsi-Jung Wu
  • Publication number: 20170109596
    Abstract: A method for processing media assets includes, given a first media asset, deriving characteristics from the first media asset, searching for other media assets having characteristics that correlate to the characteristics of the first media asset, when a match is found, deriving content corrections for the first media asset or a matching media asset from the other of the first media asset or the matching media asset, and correcting content of the first media asset or the matching media asset based on the content corrections.
    Type: Application
    Filed: October 20, 2016
    Publication date: April 20, 2017
    Inventors: Shujie Liu, Jiefu Zhai, Chris Y. Chung, Hsi-Jung Wu, Yunfei Zheng, Albert E. Keinath, Xiaosong Zhou, Ke Zhang
  • Publication number: 20160357605
    Abstract: A system for processing media on a resource restricted device, the system including a memory to store data representing media assets and associated descriptors, and program instructions representing an application and a media processing system, and a processor to execute the program instructions, wherein the program instructions represent the media processing system, in response to a call from an application defining a plurality of services to be performed on an asset, determine a tiered schedule of processing operations to be performed upon the asset based on a processing budget associated therewith, and iteratively execute the processing operations on a tier-by-tier basis, unless interrupted.
    Type: Application
    Filed: June 3, 2016
    Publication date: December 8, 2016
    Inventors: Albert Keinath, Ke Zhang, Yunfei Zheng, Shujie Liu, Jiefu Zhai, Chris Y. Chung, Xiaosong Zhou, Hsi-Jung Wu
  • Publication number: 20160358628
    Abstract: Methods for organizing media data by automatically segmenting media data into hierarchical layers of scenes are described. The media data may include metadata and content having still image, video or audio data. The metadata may be content-based (e.g., differences between neighboring frames, exposure data, key frame identification data, motion data, or face detection data) or non-content-based (e.g., exposure, focus, location, time) and used to prioritize and/or classify portions of video. The metadata may be generated at the time of image capture or during post-processing. Prioritization information, such as a score for various portions of the image data may be based on the metadata and/or image data. Classification information such as the type or quality of a scene may be determined based on the metadata and/or image data. The classification and prioritization information may be metadata and may be used to organize the media data.
    Type: Application
    Filed: June 3, 2016
    Publication date: December 8, 2016
    Inventors: Shujie Liu, Yunfei Zheng, Xiaosong Zhou, Hsi-Jung Wu, Ke Zhang, Albert E. Keinath, Chris Y. Chung
  • Publication number: 20160092561
    Abstract: Systems and processes for improved video editing, summarization and navigation based on generation and analysis of metadata are described. The metadata may be content-based (e.g., differences between neighboring frames, exposure data, key frame identification data, motion data, or face detection data) or non-content-based (e.g., exposure, focus, location, time) and used to prioritize and/or classify portions of video. The metadata may be generated at the time of image capture or during post-processing. Prioritization information, such as a score for various portions of the image data may be based on the metadata and/or image data. Classification information such as the type or quality of a scene may be determined based on the metadata and/or image data. The classification and prioritization information may be metadata and may be used to automatically remove undesirable portions of the video, generate suggestions during editing or automatically generate summary video.
    Type: Application
    Filed: December 3, 2014
    Publication date: March 31, 2016
    Applicant: Apple Inc.
    Inventors: Shujie Liu, Ke Zhang, Xiaosong Zhou, Hsi-Jung Wu, Chris Y. Chung, James O. Normile, Douglas S. Price, Albert E. Keinath
  • Publication number: 20150350653
    Abstract: An encoding system may include a video source that provides video data to be coded, a video coder, a transmitter, and a controller to manage operation of the system. The controller may control the video coder to code and compress the image information from the video source into video data, based upon one or more motion prediction parameters. The transmitter may transmit the video data. A decoding system may decode the video data based upon the motion prediction parameters.
    Type: Application
    Filed: May 28, 2014
    Publication date: December 3, 2015
    Applicant: Apple Inc.
    Inventors: Jae Hoon Kim, Shujie Liu, Dazhong Zhang, Xiaosong Zhou, Chris Y. Chung, Hsi-Jung Wu
  • Patent number: 9031357
    Abstract: A temporal information integration dis-occlusion system and method for using historical data to reconstruct a virtual view containing an occluded area. Embodiments of the system and method use temporal information of the scene captured previously to obtain a total history. This total history is warped onto information captured by a camera at a current time in order to help reconstruct the dis-occluded areas. The historical data (or frames) from the total history match only a portion of the frames contained in the captured information. This warping yields warped history information. Warping is performed by using one of two embodiments to match points in an estimation of the current information to points in the captured information. Next, regions of current information are split using a classifier. The warped history information and the captured information then are merged to obtain an estimate for the current information and the reconstructed virtual view.
    Type: Grant
    Filed: May 4, 2012
    Date of Patent: May 12, 2015
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Philip Andrew Chou, Cha Zhang, Zhengyou Zhang, Shujie Liu
  • Publication number: 20140184744
    Abstract: Various implementations address depth coding and related disciplines. In one particular implementation, a segmentation is determined for a particular portion of a video image in a sequence of video images. The segmentation is determined based on reference depth indicators that are associated with at least a portion of one video image in the sequence of video images. Target depth indicators associated with the particular portion of the video image are processed. The processing is based on the determined segmentation in the particular portion of the video image. In another particular implementation, a segmentation is determined for at least a given portion of a video image based on depth indicators associated with the given portion. The segmentation is extended from the given portion into a target portion of the video image based on pixel values in the given portion and on pixel values in the target portion.
    Type: Application
    Filed: August 26, 2011
    Publication date: July 3, 2014
    Applicant: THOMSON LICENSING
    Inventors: Shujie Liu, Wang Lin Lai, Dong Tian
  • Publication number: 20130294710
    Abstract: A temporal information integration dis-occlusion system and method for using historical data to reconstruct a virtual view containing an occluded area. Embodiments of the system and method use temporal information of the scene captured previously to obtain a total history. This total history is warped onto information captured by a camera at a current time in order to help reconstruct the dis-occluded areas. The historical data (or frames) from the total history match only a portion of the frames contained in the captured information. This warping yields warped history information. Warping is performed by using one of two embodiments to match points in an estimation of the current information to points in the captured information. Next, regions of current information are split using a classifier. The warped history information and the captured information then are merged to obtain an estimate for the current information and the reconstructed virtual view.
    Type: Application
    Filed: May 4, 2012
    Publication date: November 7, 2013
    Applicant: Microsoft Corporation
    Inventors: Philip Andrew Chou, Cha Zhang, Zhengyou Zhang, Shujie Liu
  • Publication number: 20120200669
    Abstract: Several implementations relate, for example, to depth encoding and/or filtering for 3D video (3DV) coding formats. A sparse dyadic mode for partitioning macroblocks (MBs) along edges in a depth map is provided as well as techniques for trilateral (or bilateral) filtering of depth maps that may include adaptive selection between filters sensitive to changes in video intensity and/or changes in depth. One implementation partitions a depth picture, and then refines the partitions based on a corresponding image picture. Another implementation filters a portion of a depth picture based on values for a range of pixels in the portion. For a given pixel in the portion that is being filtered, the filter weights a value of a particular pixel in the range by a weight that is based on one or more of location distance, depth difference, and image difference.
    Type: Application
    Filed: October 14, 2010
    Publication date: August 9, 2012
    Inventors: Wang Lin Lai, Shujie Liu, Dong Tian
  • Patent number: 8226844
    Abstract: This invention is concerned with biocompatible magnetic nanocrystals highly soluble and dispersible in a physiological buffer, powder of biocompatible magnetic nanocrystals and nanocrystals bearing surface reactive N-hydroxysuccinimide ester moiety, and preparations thereof. The magnetic nanocrystals in powder form are highly soluble in a physiological buffer. The resultant aqueous colloidal solution presents long term stability in ambient conditions. Moreover, the carboxyl group on the surface of the magnetic nanocrystals can be converted to N-hydroxysuccinimide ester moiety in an organic solvent. The resultant powder of the magnetic nanocrystals carrying surface N-hydroxysuccinimide ester moiety is soluble and dispersible in an aqueous solution. Different types of biomolecules bearing amino group can covalently be attached to the magnetic nanocrystal simply by mixing them in aqueous solutions.
    Type: Grant
    Filed: March 18, 2011
    Date of Patent: July 24, 2012
    Assignee: Institute of Chemistry, Chinese Academy of Sciences
    Inventors: Mingyuan Gao, Fengqin Hu, Shujie Liu, Xianyong Lu
  • Patent number: 8017031
    Abstract: This invention is concerned with biocompatible magnetic nanocrystals highly soluble and dispersible in a physiological buffer, powder of biocompatible magnetic nanocrystals and nanocrystals bearing surface reactive N-hydroxysuccinimide ester moiety, and preparations thereof. The magnetic nanocrystals in powder form are highly soluble in a physiological buffer. The resultant aqueous colloidal solution presents long term stability in ambient conditions. Moreover, the carboxyl group on the surface of the magnetic nanocrystals can be converted to N-hydroxysuccinimide ester moiety in an organic solvent. The resultant powder of the magnetic nanocrystals carrying surface N-hydroxysuccinimide ester moiety is soluble and dispersible in an aqueous solution. Different types of biomolecules bearing amino group can covalently be attached to the magnetic nanocrystal simply by mixing them in aqueous solutions.
    Type: Grant
    Filed: January 14, 2008
    Date of Patent: September 13, 2011
    Assignee: Institute of Chemistry, Chinese Academy of Sciences
    Inventors: Mingyuan Gao, Fengqin Hu, Shujie Liu, Xianyong Lu
  • Publication number: 20110207894
    Abstract: This invention is concerned with biocompatible magnetic nanocrystals highly soluble and dispersible in a physiological buffer, powder of biocompatible magnetic nanocrystals and nanocrystals bearing surface reactive N-hydroxysuccinimide ester moiety, and preparations thereof. The magnetic nanocrystals in powder form are highly soluble in a physiological buffer. The resultant aqueous colloidal solution presents long term stability in ambient conditions. Moreover, the carboxyl group on the surface of the magnetic nanocrystals can be converted to N-hydroxysuccinimide ester moiety in an organic solvent. The resultant powder of the magnetic nanocrystals carrying surface N-hydroxysuccinimide ester moiety is soluble and dispersible in an aqueous solution. Different types of biomolecules bearing amino group can covalently be attached to the magnetic nanocrystal simply by mixing them in aqueous solutions.
    Type: Application
    Filed: March 18, 2011
    Publication date: August 25, 2011
    Applicant: Institute of Chemistry Chinese Academy of Sciences
    Inventors: Mingyuan GAO, Fengqin Hu, Shujie Liu, Xianyong Lu
  • Publication number: 20080203351
    Abstract: This invention is concerned with biocompatible magnetic nanocrystals highly soluble and dispersible in a physiological buffer, powder of biocompatible magnetic nanocrystals and nanocrystals bearing surface reactive N-hydroxysuccinimide ester moiety, and preparations thereof. The magnetic nanocrystals in powder form are highly soluble in a physiological buffer. The resultant aqueous colloidal solution presents long term stability in ambient conditions. Moreover, the carboxyl group on the surface of the magnetic nanocrystals can be converted to N-hydroxysuccinimide ester moiety in an organic solvent. The resultant powder of the magnetic nanocrystals carrying surface N-hydroxysuccinimide ester moiety is soluble and dispersible in an aqueous solution. Different types of biomolecules bearing amino group can covalently be attached to the magnetic nanocrystal simply by mixing them in aqueous solutions.
    Type: Application
    Filed: January 14, 2008
    Publication date: August 28, 2008
    Inventors: Mingyuan Gao, Fengqin Hu, Shujie Liu, Xianyong Lu