Patents by Inventor Shujie Liu
Shujie Liu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10282633Abstract: A method for processing media assets includes, given a first media asset, deriving characteristics from the first media asset, searching for other media assets having characteristics that correlate to the characteristics of the first media asset, when a match is found, deriving content corrections for the first media asset or a matching media asset from the other of the first media asset or the matching media asset, and correcting content of the first media asset or the matching media asset based on the content corrections.Type: GrantFiled: October 20, 2016Date of Patent: May 7, 2019Assignee: Apple Inc.Inventors: Shujie Liu, Jiefu Zhai, Chris Y. Chung, Hsi-Jung Wu, Yunfei Zheng, Albert E. Keinath, Xiaosong Zhou, Ke Zhang
-
Patent number: 10198792Abstract: Several implementations relate, for example, to depth encoding and/or filtering for 3D video (3DV) coding formats. A sparse dyadic mode for partitioning macroblocks (MBs) along edges in a depth map is provided as well as techniques for trilateral (or bilateral) filtering of depth maps that may include adaptive selection between filters sensitive to changes in video intensity and/or changes in depth. One implementation partitions a depth picture, and then refines the partitions based on a corresponding image picture. Another implementation filters a portion of a depth picture based on values for a range of pixels in the portion. For a given pixel in the portion that is being filtered, the filter weights a value of a particular pixel in the range by a weight that is based on one or more of location distance, depth difference, and image difference.Type: GrantFiled: October 14, 2010Date of Patent: February 5, 2019Assignee: Dolby Laboratories Licensing CorporationInventors: Wang Lin Lai, Shujie Liu, Dong Tian
-
Patent number: 10062412Abstract: Methods for organizing media data by automatically segmenting media data into hierarchical layers of scenes are described. The media data may include metadata and content having still image, video or audio data. The metadata may be content-based (e.g., differences between neighboring frames, exposure data, key frame identification data, motion data, or face detection data) or non-content-based (e.g., exposure, focus, location, time) and used to prioritize and/or classify portions of video. The metadata may be generated at the time of image capture or during post-processing. Prioritization information, such as a score for various portions of the image data may be based on the metadata and/or image data. Classification information such as the type or quality of a scene may be determined based on the metadata and/or image data. The classification and prioritization information may be metadata and may be used to organize the media data.Type: GrantFiled: June 3, 2016Date of Patent: August 28, 2018Assignee: Apple Inc.Inventors: Shujie Liu, Yunfei Zheng, Xiaosong Zhou, Hsi-Jung Wu, Ke Zhang, Albert E. Keinath, Chris Y. Chung
-
Publication number: 20180165796Abstract: Several implementations relate, for example, to depth encoding and/or filtering for 3D video (3DV) coding formats. A sparse dyadic mode (308) for partitioning macroblocks (MBs) along edges in a depth map is provided as well as techniques for trilateral (or bilateral) filtering of depth maps that may include adaptive selection between filters sensitive to changes in video intensity and/or changes in depth. One implementation partitions a depth picture, and then refines the partitions based on a corresponding image picture. Another implementation filters a portion of a depth picture based on values for a range of pixels in the portion. For a given pixel in the portion that is being filtered, the filter weights a value of a particular pixel in the range by a weight that is based on one or more of location distance, depth difference, and image difference.Type: ApplicationFiled: January 26, 2018Publication date: June 14, 2018Applicant: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Wang Lin LAI, Shujie LIU, Dong TIAN
-
Publication number: 20170357871Abstract: Techniques are disclosed for estimating quality of images in an automated fashion. According to these techniques, a source image may be downsampled to generate at least two downsampled images at different levels of downsampling. Blurriness of the images may be estimated starting with a most-heavily downsampled image. Blocks of a given image may be evaluated for blurriness and, when a block of a given image is estimated to be blurry, the block of the image and co-located blocks of higher resolution image(s) may be designated as blurry. Thereafter, a blurriness score may be calculated for the source image from the number of blocks of the source image designated as blurry.Type: ApplicationFiled: June 9, 2017Publication date: December 14, 2017Inventors: Jiefu Zhai, Ke Zhang, Yunfei Zheng, Shujie Liu, Albert Keinath, Xiaosong Zhou, Chris Chung, Hsi-Jung Wu
-
Publication number: 20170358059Abstract: Techniques for cropping images containing an occlusion are presented. A method for image editing is presented comprising, when an occlusion is detected in an original digital image, determining an area occupied by the occlusion, assigning importance scores to different content elements of the original digital image, defining a cropping window around an area of the original digital image that does not include the area occupied by the occlusion and that is based on the importance scores, and cropping the original digital image to the cropping window.Type: ApplicationFiled: June 9, 2017Publication date: December 14, 2017Inventors: Ke Zhang, Jiefu Zhai, Yunfei Zheng, Shujie Liu, Albert E. Keinath, Xiaosong Zhou, Chris Y. Chung, Hsi-Jung Wu
-
Publication number: 20170109596Abstract: A method for processing media assets includes, given a first media asset, deriving characteristics from the first media asset, searching for other media assets having characteristics that correlate to the characteristics of the first media asset, when a match is found, deriving content corrections for the first media asset or a matching media asset from the other of the first media asset or the matching media asset, and correcting content of the first media asset or the matching media asset based on the content corrections.Type: ApplicationFiled: October 20, 2016Publication date: April 20, 2017Inventors: Shujie Liu, Jiefu Zhai, Chris Y. Chung, Hsi-Jung Wu, Yunfei Zheng, Albert E. Keinath, Xiaosong Zhou, Ke Zhang
-
Publication number: 20160357605Abstract: A system for processing media on a resource restricted device, the system including a memory to store data representing media assets and associated descriptors, and program instructions representing an application and a media processing system, and a processor to execute the program instructions, wherein the program instructions represent the media processing system, in response to a call from an application defining a plurality of services to be performed on an asset, determine a tiered schedule of processing operations to be performed upon the asset based on a processing budget associated therewith, and iteratively execute the processing operations on a tier-by-tier basis, unless interrupted.Type: ApplicationFiled: June 3, 2016Publication date: December 8, 2016Inventors: Albert Keinath, Ke Zhang, Yunfei Zheng, Shujie Liu, Jiefu Zhai, Chris Y. Chung, Xiaosong Zhou, Hsi-Jung Wu
-
Publication number: 20160358628Abstract: Methods for organizing media data by automatically segmenting media data into hierarchical layers of scenes are described. The media data may include metadata and content having still image, video or audio data. The metadata may be content-based (e.g., differences between neighboring frames, exposure data, key frame identification data, motion data, or face detection data) or non-content-based (e.g., exposure, focus, location, time) and used to prioritize and/or classify portions of video. The metadata may be generated at the time of image capture or during post-processing. Prioritization information, such as a score for various portions of the image data may be based on the metadata and/or image data. Classification information such as the type or quality of a scene may be determined based on the metadata and/or image data. The classification and prioritization information may be metadata and may be used to organize the media data.Type: ApplicationFiled: June 3, 2016Publication date: December 8, 2016Inventors: Shujie Liu, Yunfei Zheng, Xiaosong Zhou, Hsi-Jung Wu, Ke Zhang, Albert E. Keinath, Chris Y. Chung
-
Publication number: 20160092561Abstract: Systems and processes for improved video editing, summarization and navigation based on generation and analysis of metadata are described. The metadata may be content-based (e.g., differences between neighboring frames, exposure data, key frame identification data, motion data, or face detection data) or non-content-based (e.g., exposure, focus, location, time) and used to prioritize and/or classify portions of video. The metadata may be generated at the time of image capture or during post-processing. Prioritization information, such as a score for various portions of the image data may be based on the metadata and/or image data. Classification information such as the type or quality of a scene may be determined based on the metadata and/or image data. The classification and prioritization information may be metadata and may be used to automatically remove undesirable portions of the video, generate suggestions during editing or automatically generate summary video.Type: ApplicationFiled: December 3, 2014Publication date: March 31, 2016Applicant: Apple Inc.Inventors: Shujie Liu, Ke Zhang, Xiaosong Zhou, Hsi-Jung Wu, Chris Y. Chung, James O. Normile, Douglas S. Price, Albert E. Keinath
-
Publication number: 20150350653Abstract: An encoding system may include a video source that provides video data to be coded, a video coder, a transmitter, and a controller to manage operation of the system. The controller may control the video coder to code and compress the image information from the video source into video data, based upon one or more motion prediction parameters. The transmitter may transmit the video data. A decoding system may decode the video data based upon the motion prediction parameters.Type: ApplicationFiled: May 28, 2014Publication date: December 3, 2015Applicant: Apple Inc.Inventors: Jae Hoon Kim, Shujie Liu, Dazhong Zhang, Xiaosong Zhou, Chris Y. Chung, Hsi-Jung Wu
-
Patent number: 9031357Abstract: A temporal information integration dis-occlusion system and method for using historical data to reconstruct a virtual view containing an occluded area. Embodiments of the system and method use temporal information of the scene captured previously to obtain a total history. This total history is warped onto information captured by a camera at a current time in order to help reconstruct the dis-occluded areas. The historical data (or frames) from the total history match only a portion of the frames contained in the captured information. This warping yields warped history information. Warping is performed by using one of two embodiments to match points in an estimation of the current information to points in the captured information. Next, regions of current information are split using a classifier. The warped history information and the captured information then are merged to obtain an estimate for the current information and the reconstructed virtual view.Type: GrantFiled: May 4, 2012Date of Patent: May 12, 2015Assignee: Microsoft Technology Licensing, LLCInventors: Philip Andrew Chou, Cha Zhang, Zhengyou Zhang, Shujie Liu
-
Publication number: 20140184744Abstract: Various implementations address depth coding and related disciplines. In one particular implementation, a segmentation is determined for a particular portion of a video image in a sequence of video images. The segmentation is determined based on reference depth indicators that are associated with at least a portion of one video image in the sequence of video images. Target depth indicators associated with the particular portion of the video image are processed. The processing is based on the determined segmentation in the particular portion of the video image. In another particular implementation, a segmentation is determined for at least a given portion of a video image based on depth indicators associated with the given portion. The segmentation is extended from the given portion into a target portion of the video image based on pixel values in the given portion and on pixel values in the target portion.Type: ApplicationFiled: August 26, 2011Publication date: July 3, 2014Applicant: THOMSON LICENSINGInventors: Shujie Liu, Wang Lin Lai, Dong Tian
-
Publication number: 20130294710Abstract: A temporal information integration dis-occlusion system and method for using historical data to reconstruct a virtual view containing an occluded area. Embodiments of the system and method use temporal information of the scene captured previously to obtain a total history. This total history is warped onto information captured by a camera at a current time in order to help reconstruct the dis-occluded areas. The historical data (or frames) from the total history match only a portion of the frames contained in the captured information. This warping yields warped history information. Warping is performed by using one of two embodiments to match points in an estimation of the current information to points in the captured information. Next, regions of current information are split using a classifier. The warped history information and the captured information then are merged to obtain an estimate for the current information and the reconstructed virtual view.Type: ApplicationFiled: May 4, 2012Publication date: November 7, 2013Applicant: Microsoft CorporationInventors: Philip Andrew Chou, Cha Zhang, Zhengyou Zhang, Shujie Liu
-
Publication number: 20120200669Abstract: Several implementations relate, for example, to depth encoding and/or filtering for 3D video (3DV) coding formats. A sparse dyadic mode for partitioning macroblocks (MBs) along edges in a depth map is provided as well as techniques for trilateral (or bilateral) filtering of depth maps that may include adaptive selection between filters sensitive to changes in video intensity and/or changes in depth. One implementation partitions a depth picture, and then refines the partitions based on a corresponding image picture. Another implementation filters a portion of a depth picture based on values for a range of pixels in the portion. For a given pixel in the portion that is being filtered, the filter weights a value of a particular pixel in the range by a weight that is based on one or more of location distance, depth difference, and image difference.Type: ApplicationFiled: October 14, 2010Publication date: August 9, 2012Inventors: Wang Lin Lai, Shujie Liu, Dong Tian
-
Patent number: 8226844Abstract: This invention is concerned with biocompatible magnetic nanocrystals highly soluble and dispersible in a physiological buffer, powder of biocompatible magnetic nanocrystals and nanocrystals bearing surface reactive N-hydroxysuccinimide ester moiety, and preparations thereof. The magnetic nanocrystals in powder form are highly soluble in a physiological buffer. The resultant aqueous colloidal solution presents long term stability in ambient conditions. Moreover, the carboxyl group on the surface of the magnetic nanocrystals can be converted to N-hydroxysuccinimide ester moiety in an organic solvent. The resultant powder of the magnetic nanocrystals carrying surface N-hydroxysuccinimide ester moiety is soluble and dispersible in an aqueous solution. Different types of biomolecules bearing amino group can covalently be attached to the magnetic nanocrystal simply by mixing them in aqueous solutions.Type: GrantFiled: March 18, 2011Date of Patent: July 24, 2012Assignee: Institute of Chemistry, Chinese Academy of SciencesInventors: Mingyuan Gao, Fengqin Hu, Shujie Liu, Xianyong Lu
-
Patent number: 8017031Abstract: This invention is concerned with biocompatible magnetic nanocrystals highly soluble and dispersible in a physiological buffer, powder of biocompatible magnetic nanocrystals and nanocrystals bearing surface reactive N-hydroxysuccinimide ester moiety, and preparations thereof. The magnetic nanocrystals in powder form are highly soluble in a physiological buffer. The resultant aqueous colloidal solution presents long term stability in ambient conditions. Moreover, the carboxyl group on the surface of the magnetic nanocrystals can be converted to N-hydroxysuccinimide ester moiety in an organic solvent. The resultant powder of the magnetic nanocrystals carrying surface N-hydroxysuccinimide ester moiety is soluble and dispersible in an aqueous solution. Different types of biomolecules bearing amino group can covalently be attached to the magnetic nanocrystal simply by mixing them in aqueous solutions.Type: GrantFiled: January 14, 2008Date of Patent: September 13, 2011Assignee: Institute of Chemistry, Chinese Academy of SciencesInventors: Mingyuan Gao, Fengqin Hu, Shujie Liu, Xianyong Lu
-
Publication number: 20110207894Abstract: This invention is concerned with biocompatible magnetic nanocrystals highly soluble and dispersible in a physiological buffer, powder of biocompatible magnetic nanocrystals and nanocrystals bearing surface reactive N-hydroxysuccinimide ester moiety, and preparations thereof. The magnetic nanocrystals in powder form are highly soluble in a physiological buffer. The resultant aqueous colloidal solution presents long term stability in ambient conditions. Moreover, the carboxyl group on the surface of the magnetic nanocrystals can be converted to N-hydroxysuccinimide ester moiety in an organic solvent. The resultant powder of the magnetic nanocrystals carrying surface N-hydroxysuccinimide ester moiety is soluble and dispersible in an aqueous solution. Different types of biomolecules bearing amino group can covalently be attached to the magnetic nanocrystal simply by mixing them in aqueous solutions.Type: ApplicationFiled: March 18, 2011Publication date: August 25, 2011Applicant: Institute of Chemistry Chinese Academy of SciencesInventors: Mingyuan GAO, Fengqin Hu, Shujie Liu, Xianyong Lu
-
Publication number: 20080203351Abstract: This invention is concerned with biocompatible magnetic nanocrystals highly soluble and dispersible in a physiological buffer, powder of biocompatible magnetic nanocrystals and nanocrystals bearing surface reactive N-hydroxysuccinimide ester moiety, and preparations thereof. The magnetic nanocrystals in powder form are highly soluble in a physiological buffer. The resultant aqueous colloidal solution presents long term stability in ambient conditions. Moreover, the carboxyl group on the surface of the magnetic nanocrystals can be converted to N-hydroxysuccinimide ester moiety in an organic solvent. The resultant powder of the magnetic nanocrystals carrying surface N-hydroxysuccinimide ester moiety is soluble and dispersible in an aqueous solution. Different types of biomolecules bearing amino group can covalently be attached to the magnetic nanocrystal simply by mixing them in aqueous solutions.Type: ApplicationFiled: January 14, 2008Publication date: August 28, 2008Inventors: Mingyuan Gao, Fengqin Hu, Shujie Liu, Xianyong Lu