Patents by Inventor Ya-Hsuan Lee

Ya-Hsuan Lee has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11049314
    Abstract: Methods and apparatus of processing 360-degree virtual reality images are disclosed. According to one method, the method receives coded data for an extended 2D (two-dimensional) frame including an encoded 2D frame with one or more encoded guard bands, wherein the encoded 2D frame is projected from a 3D (three-dimensional) sphere using a target projection, wherein said one or more encoded guard bands are based on a blending of one or more guard bands with an overlapped region when the overlapped region exists. The method then decodes the coded data into a decoded extended 2D frame including a decoded 2D frame with one or more decoded guard bands, and derives a reconstructed 2D frame from the decoded extended 2D frame.
    Type: Grant
    Filed: February 27, 2020
    Date of Patent: June 29, 2021
    Assignee: MEDIATEK INC
    Inventors: Cheng-Hsuan Shih, Chia-Ying Li, Ya-Hsuan Lee, Hung-Chih Lin, Jian-Liang Lin, Shen-Kai Chang
  • Patent number: 11004173
    Abstract: A video processing method includes: obtaining a plurality of projection faces from an omnidirectional content of a sphere, wherein the omnidirectional content of the sphere is mapped onto the projection faces via cubemap projection, and the projection faces comprise a first projection face; obtaining, by a re-sampling circuit, a first re-sampled projection face by re-sampling at least a portion of the first projection face through non-uniform mapping; generating a projection-based frame according to a projection layout of the cubemap projection, wherein the projection-based frame comprises the first re-sampled projection face packed in the projection layout; and encoding the projection-based frame to generate a part of a bitstream.
    Type: Grant
    Filed: September 26, 2018
    Date of Patent: May 11, 2021
    Assignee: MEDIATEK INC.
    Inventors: Jian-Liang Lin, Peng Wang, Lin Liu, Ya-Hsuan Lee, Hung-Chih Lin, Shen-Kai Chang
  • Publication number: 20210127126
    Abstract: A video decoding method includes decoding a part of a bitstream to generate a decoded frame. The decoded frame is a projection-based frame that comprises at least one projection face and at least one guard band packed in a projection layout. At least a portion of a 360-degree content of a sphere is mapped to the at least one projection face via projection. The decoded frame is in a 4:2:0 chroma format or a 4:2:2 chroma format, and a guard band size of each of the at least one guard band is equal to an even number of luma samples.
    Type: Application
    Filed: October 21, 2020
    Publication date: April 29, 2021
    Inventors: Ya-Hsuan Lee, Jian-Liang Lin
  • Patent number: 10922783
    Abstract: A cube-based projection method includes generating pixels of different square projection faces associated with a cube-based projection of a 360-degree image content of a sphere. Pixels of a first square projection face are generated by utilizing a first mapping function set. Pixels of a second square projection face are generated by utilizing a second mapping function set. The different square projection faces include the first square projection face and the second square projection face. The second mapping function set is not identical to the first mapping function set.
    Type: Grant
    Filed: February 26, 2019
    Date of Patent: February 16, 2021
    Assignee: MEDIATEK INC.
    Inventors: Ya-Hsuan Lee, Jian-Liang Lin
  • Publication number: 20210006838
    Abstract: A video decoding method includes: decoding a part of a bitstream to generate a decoded frame, and parsing at least one syntax element from the bitstream. The decoded frame is a projection-based frame that includes projection faces packed in a cube-based projection layout. At least a portion of a 360-degree content of a sphere is mapped to the projection faces via cube-based projection. The at least one syntax element is indicative of a guard band configuration of the projection-based frame.
    Type: Application
    Filed: July 1, 2020
    Publication date: January 7, 2021
    Inventors: Ya-Hsuan Lee, Jian-Liang Lin
  • Publication number: 20210006832
    Abstract: A video encoding method includes: encoding a projection-based frame to generate a part of a bitstream, wherein at least a portion of a 360-degree content of a sphere is mapped to projection faces via cube-based projection, and the projection-based frame has the projection faces packed in a cube-based projection layout; and signaling at least one syntax element via the bitstream, wherein said at least one syntax element is associated with a mapping function that is employed by the cube-based projection to determine sample locations for each of the projection faces.
    Type: Application
    Filed: June 11, 2020
    Publication date: January 7, 2021
    Inventors: Ya-Hsuan Lee, Jian-Liang Lin
  • Publication number: 20210006785
    Abstract: A video decoding method includes decoding a part of a bitstream to generate a decoded frame, and parsing at least one syntax element from the bitstream. The decoded frame is a projection-based frame that has projection faces packed in a cube-based projection layout. At least a portion of a 360-degree content of a sphere is mapped to the projection faces via cube-based projection.
    Type: Application
    Filed: June 10, 2020
    Publication date: January 7, 2021
    Inventors: Ya-Hsuan Lee, Jian-Liang Lin
  • Publication number: 20200296401
    Abstract: Methods and apparatus of video coding for 3D video data are disclosed. According to one method, the gradients of the geometry frame are derived. A reconstructed point cloud is reconstructed using the geometry frame. One or more candidate holes in the reconstructed point cloud are filled based on the gradients of the geometry frame. According to another method of encoding for 3D video data, candidate hole locations in a geometry frame, patch or layer are determined. Source points projected to the candidate hole locations are grouped to generate grouped points. The grouped points are removed from an original patch containing the grouped points.
    Type: Application
    Filed: March 10, 2020
    Publication date: September 17, 2020
    Inventors: Ya-Hsuan LEE, Jian-Liang LIN
  • Publication number: 20200234399
    Abstract: An exemplary video processing method includes: receiving an omnidirectional content corresponding to a sphere; obtaining a plurality of projection faces from the omnidirectional content of the sphere according to a pyramid projection; creating at least one padding region; and generating a projection-based frame by packing the projection faces and the at least one padding region in a pyramid projection layout. The projection faces packed in the pyramid projection layout include a first projection face. The at least one padding region packed in the pyramid projection layout includes a first padding region. The first padding region connects with at least the first projection face, and forms at least a portion of one boundary of the pyramid projection layout.
    Type: Application
    Filed: August 17, 2018
    Publication date: July 23, 2020
    Inventors: Jian-Liang Lin, Peng Wang, Ya-Hsuan Lee, Hung-Chih Lin, Shen-Kai Chang
  • Publication number: 20200213570
    Abstract: A video processing method includes: receiving a part of a bitstream; decoding the part of the bitstream to generate a reconstructed projection-based frame with at least one projection face and at least one padding region packed in a projection layout of a 360-degree Virtual Reality (360 VR) projection; obtaining chroma sampling position information that is signaled via the bitstream; and performing a blending process for generating a blended chroma sample value at a target chroma sample position by blending a first chroma sample value obtained for a first chroma sample position in the at least one projection face and a second chroma sample value obtained for a second chroma sample position in the at least one padding region. At least one of the target chroma sample position, the first chroma sample position and the second chroma sample position is determined according to the chroma sampling position information.
    Type: Application
    Filed: December 30, 2019
    Publication date: July 2, 2020
    Inventors: Cheng-Hsuan Shih, Ya-Hsuan Lee, Jian-Liang Lin
  • Publication number: 20200193676
    Abstract: Methods and apparatus of processing 360-degree virtual reality images are disclosed. According to one method, the method receives coded data for an extended 2D (two-dimensional) frame including an encoded 2D frame with one or more encoded guard bands, wherein the encoded 2D frame is projected from a 3D (three-dimensional) sphere using a target projection, wherein said one or more encoded guard bands are based on a blending of one or more guard bands with an overlapped region when the overlapped region exists. The method then decodes the coded data into a decoded extended 2D frame including a decoded 2D frame with one or more decoded guard bands, and derives a reconstructed 2D frame from the decoded extended 2D frame.
    Type: Application
    Filed: February 27, 2020
    Publication date: June 18, 2020
    Inventors: Cheng-Hsuan SHIH, Chia-Ying LI, Ya-Hsuan LEE, Hung-Chih LIN, Jian-Liang LIN, Shen-Kai CHANG
  • Patent number: 10614609
    Abstract: Methods and apparatus of processing 360-degree virtual reality images are disclosed. According to one method, a 2D (two-dimensional) frame is divided into multiple blocks. The multiple blocks are encoded or decoded using quantization parameters by restricting a delta quantization parameter to be within a threshold for any two blocks corresponding to two neighboring blocks on a 3D sphere. According to another embodiment, one or more guard bands are added to one or more edges that are discontinuous in the 2D frame but continuous in the 3D sphere. Fade-out process is applied to said one or more guard bands to generate one or more faded guard bands. At the decoder side, the reconstructed 2D frame is generated from the decoded extended 2D frame by cropping said one or more decoded faded guard bands or by blending said one or more decoded faded guard bands and reconstructed duplicated areas.
    Type: Grant
    Filed: July 13, 2018
    Date of Patent: April 7, 2020
    Assignee: MEDIATEK INC.
    Inventors: Cheng-Hsuan Shih, Chia-Ying Li, Ya-Hsuan Lee, Hung-Chih Lin, Jian-Liang Lin, Shen-Kai Chang
  • Patent number: 10593012
    Abstract: A video processing method includes receiving an omnidirectional content corresponding to a sphere, generating a projection-based frame according to at least the omnidirectional content and a segmented sphere projection (SSP) format, and encoding, by a video encoder, the projection-based frame to generate a part of a bitstream. The projection-based frame has a 360-degree content represented by a first circular projection face, a second circular projection face, and at least one rectangular projection face packed in an SSP layout. A north polar region of the sphere is mapped onto the first circular projection face. A south polar region of the sphere is mapped onto the second circular projection face. At least one non-polar ring-shaped segment between the north polar region and the south polar region of the sphere is mapped onto said at least one rectangular projection face.
    Type: Grant
    Filed: March 20, 2018
    Date of Patent: March 17, 2020
    Assignee: MEDIATEK INC.
    Inventors: Ya-Hsuan Lee, Hung-Chih Lin, Jian-Liang Lin, Shen-Kai Chang
  • Publication number: 20200074587
    Abstract: Methods and apparatus of processing spherical images related to segmented sphere projection (SSP) are disclosed. According to one method, a North Pole region of the spherical image is projected to a first circular image and a South Pole region of the spherical image is projected to a second circular image using a mapping process selected from a mapping group comprising equal-area mapping, non-uniform mapping and cubemap mapping. Methods and apparatus of processing spherical images related to rotated sphere projection (RSP) are also disclosed. According to this method, the spherical image is projected into a first part of rotated sphere projection corresponding to a ?×? region of the spherical image and a second part of rotated sphere projection corresponding to a remaining part of the spherical image using equal-area mapping.
    Type: Application
    Filed: April 20, 2018
    Publication date: March 5, 2020
    Inventors: Ya-Hsuan LEE, Jian-Liang LIN, Shen-Kai CHANG
  • Patent number: 10573076
    Abstract: A video processing method includes: receiving an omnidirectional image/video content corresponding to a viewing sphere, generating a sequence of projection-based frames according to the omnidirectional image/video content and a viewport-based cube projection layout, and encoding the sequence of projection-based frames to generate a bitstream. Each projection-based frame has a 360-degree image/video content represented by rectangular projection faces packed in the viewport-based cube projection layout. The rectangular projection faces include a first rectangular projection face, a second rectangular projection face, a third rectangular projection face, a fourth rectangular projection face, a fifth rectangular projection face, and a sixth rectangular projection face split into partial rectangular projection faces.
    Type: Grant
    Filed: December 12, 2017
    Date of Patent: February 25, 2020
    Assignee: MEDIATEK INC.
    Inventors: Hung-Chih Lin, Chia-Ying Li, Le Shi, Ya-Hsuan Lee, Jian-Liang Lin, Shen-Kai Chang
  • Publication number: 20190272616
    Abstract: A video processing method includes: obtaining a plurality of square projection faces from an omnidirectional content of a sphere according to a cube-based projection, scaling the square projection faces to generate a plurality of scaled projection faces, respectively, creating at least one padding region, generating a projection-based frame by packing the scaled projection faces and said at least one padding region in a projection layout of the cube-based projection, and encoding the projection-based frame to generate a part of a bitstream.
    Type: Application
    Filed: February 27, 2019
    Publication date: September 5, 2019
    Inventors: Ya-Hsuan Lee, Jian-Liang Lin
  • Publication number: 20190272617
    Abstract: A cube-based projection method includes generating pixels of different square projection faces associated with a cube-based projection of a 360-degree image content of a sphere. Pixels of a first square projection face are generated by utilizing a first mapping function set. Pixels of a second square projection face are generated by utilizing a second mapping function set. The different square projection faces include the first square projection face and the second square projection face. The second mapping function set is not identical to the first mapping function set.
    Type: Application
    Filed: February 26, 2019
    Publication date: September 5, 2019
    Inventors: Ya-Hsuan Lee, Jian-Liang Lin
  • Patent number: 10356386
    Abstract: A video processing method includes obtaining projection face(s) from an omnidirectional content of a sphere, and obtaining a re-sampled projection face by re-sampling at least a portion of a projection face of the projection face(s) through non-uniform mapping. The omnidirectional content of the sphere is mapped onto the projection face(s) via a 360-degree Virtual Reality (360 VR) projection. The projection face has a first source region and a second source region. The re-sampled projection face has a first re-sampled region and a second re-sampled region. The first re-sampled region is derived from re-sampling the first source region with a first sampling density. The second re-sampled region is derived from re-sampling the second source region with a second sampling density that is different from the first sampling density.
    Type: Grant
    Filed: April 3, 2018
    Date of Patent: July 16, 2019
    Assignee: MEDIATEK INC.
    Inventors: Ya-Hsuan Lee, Peng Wang, Jian-Liang Lin, Shen-Kai Chang
  • Publication number: 20190026858
    Abstract: A video processing method includes: obtaining a plurality of projection faces from an omnidirectional content of a sphere, wherein the omnidirectional content of the sphere is mapped onto the projection faces via cubemap projection, and the projection faces comprise a first projection face; obtaining, by a re-sampling circuit, a first re-sampled projection face by re-sampling at least a portion of the first projection face through non-uniform mapping; generating a projection-based frame according to a projection layout of the cubemap projection, wherein the projection-based frame comprises the first re-sampled projection face packed in the projection layout; and encoding the projection-based frame to generate a part of a bitstream.
    Type: Application
    Filed: September 26, 2018
    Publication date: January 24, 2019
    Inventors: Jian-Liang Lin, Peng Wang, LIN LIU, Ya-Hsuan Lee, Hung-Chih Lin, Shen-Kai Chang
  • Publication number: 20190026934
    Abstract: Methods and apparatus of processing 360-degree virtual reality images are disclosed. According to one method, a 2D (two-dimensional) frame is divided into multiple blocks. The multiple blocks are encoded or decoded using quantization parameters by restricting a delta quantization parameter to be within a threshold for any two blocks corresponding to two neighboring blocks on a 3D sphere. According to another embodiment, one or more guard bands are added to one or more edges that are discontinuous in the 2D frame but continuous in the 3D sphere. Fade-out process is applied to said one or more guard bands to generate one or more faded guard bands. At the decoder side, the reconstructed 2D frame is generated from the decoded extended 2D frame by cropping said one or more decoded faded guard bands or by blending said one or more decoded faded guard bands and reconstructed duplicated areas.
    Type: Application
    Filed: July 13, 2018
    Publication date: January 24, 2019
    Inventors: Cheng-Hsuan SHIH, Chia-Ying LI, Ya-Hsuan LEE, Hung-Chih LIN, Jian-Liang LIN, Shen-Kai CHANG