Patents by Inventor Shen-Kai Chang

Shen-Kai Chang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11494870
    Abstract: An exemplary video processing method includes: receiving an omnidirectional content corresponding to a sphere; obtaining a plurality of projection faces from the omnidirectional content of the sphere according to a pyramid projection; creating at least one padding region; and generating a projection-based frame by packing the projection faces and the at least one padding region in a pyramid projection layout. The projection faces packed in the pyramid projection layout include a first projection face. The at least one padding region packed in the pyramid projection layout includes a first padding region. The first padding region connects with at least the first projection face, and forms at least a portion of one boundary of the pyramid projection layout.
    Type: Grant
    Filed: August 17, 2018
    Date of Patent: November 8, 2022
    Assignee: MEDIATEK INC.
    Inventors: Jian-Liang Lin, Peng Wang, Ya-Hsuan Lee, Hung-Chih Lin, Shen-Kai Chang
  • Patent number: 11057643
    Abstract: A video processing method includes: receiving an omnidirectional content corresponding to a sphere, obtaining projection faces from the omnidirectional content, and creating a projection-based frame by generating at least one padding region and packing the projection faces and said at least one padding region in a 360 VR projection layout. The projection faces packed in the 360 VR projection layout include a first projection face and a second projection face, where there is an image content discontinuity edge between the first projection face and the second projection face if the first projection face connects with the second projection face. The at least one padding region packed in the 360 VR projection layout includes a first padding region, where the first padding region connects with the first projection face and the second projection face for isolating the first projection face from the second projection face in the 360 VR projection layout.
    Type: Grant
    Filed: March 12, 2018
    Date of Patent: July 6, 2021
    Assignee: MEDIATEK INC.
    Inventors: Ya-Hsuan Lee, Chia-Ying Li, Hung-Chih Lin, Jian-Liang Lin, Shen-Kai Chang
  • Patent number: 11049314
    Abstract: Methods and apparatus of processing 360-degree virtual reality images are disclosed. According to one method, the method receives coded data for an extended 2D (two-dimensional) frame including an encoded 2D frame with one or more encoded guard bands, wherein the encoded 2D frame is projected from a 3D (three-dimensional) sphere using a target projection, wherein said one or more encoded guard bands are based on a blending of one or more guard bands with an overlapped region when the overlapped region exists. The method then decodes the coded data into a decoded extended 2D frame including a decoded 2D frame with one or more decoded guard bands, and derives a reconstructed 2D frame from the decoded extended 2D frame.
    Type: Grant
    Filed: February 27, 2020
    Date of Patent: June 29, 2021
    Assignee: MEDIATEK INC
    Inventors: Cheng-Hsuan Shih, Chia-Ying Li, Ya-Hsuan Lee, Hung-Chih Lin, Jian-Liang Lin, Shen-Kai Chang
  • Patent number: 11004173
    Abstract: A video processing method includes: obtaining a plurality of projection faces from an omnidirectional content of a sphere, wherein the omnidirectional content of the sphere is mapped onto the projection faces via cubemap projection, and the projection faces comprise a first projection face; obtaining, by a re-sampling circuit, a first re-sampled projection face by re-sampling at least a portion of the first projection face through non-uniform mapping; generating a projection-based frame according to a projection layout of the cubemap projection, wherein the projection-based frame comprises the first re-sampled projection face packed in the projection layout; and encoding the projection-based frame to generate a part of a bitstream.
    Type: Grant
    Filed: September 26, 2018
    Date of Patent: May 11, 2021
    Assignee: MEDIATEK INC.
    Inventors: Jian-Liang Lin, Peng Wang, Lin Liu, Ya-Hsuan Lee, Hung-Chih Lin, Shen-Kai Chang
  • Patent number: 10972730
    Abstract: Methods and apparatus of processing cube face images are disclosed. According to embodiments of the present invention, one or more discontinuous boundaries within each assembled cubic frame are determined and used for selective filtering, where the filtering process is skipped at said one or more discontinuous boundaries within each assembled cubic frame when the filtering process is enabled. Furthermore, the filtering process is applied to one or more continuous areas in each assembled cubic frame.
    Type: Grant
    Filed: April 17, 2019
    Date of Patent: April 6, 2021
    Assignee: MEDIATEK INC.
    Inventors: Hung-Chih Lin, Jian-Liang Lin, Chia-Ying Li, Chao-Chih Huang, Shen-Kai Chang
  • Patent number: 10963987
    Abstract: A video processing method includes receiving a bitstream, and decoding, by a video decoder, the bitstream to generate a decoded frame. The decoded frame is a projection-based frame that has a 360-degree image/video content represented by triangular projection faces packed in a triangle-based projection layout. An omnidirectional image/video content of a viewing sphere is mapped onto the triangular projection faces via a triangle-based projection of the viewing sphere. An equator of the viewing sphere is not mapped along any side of each of the triangular projection faces.
    Type: Grant
    Filed: March 26, 2020
    Date of Patent: March 30, 2021
    Assignee: MEDIATEK INC.
    Inventors: Hung-Chih Lin, Chao-Chih Huang, Chia-Ying Li, Hui Ou Yang, Jian-Liang Lin, Shen-Kai Chang
  • Patent number: 10909656
    Abstract: Methods and apparatus of processing cube face images are disclosed. According one method, each set of six cubic faces is converted into one rectangular assembled image by assembling each set of six cubic faces to maximize a number of continuous boundaries and to minimize a number of discontinuous boundaries. Each continuous boundary corresponds to one boundary between two connected faces with continuous contents from one face to another face. Each discontinuous boundary corresponds to one boundary between two connected faces with discontinuous contents from one face to another face. The method may further comprise applying video coding to the video sequence outputting the compressed data of the video sequence. According to another method, a fully-connected cubic-face image representing an unfolded image from the six faces of the cube is generated and the blank areas are filled with padding data to form a rectangular assembled image.
    Type: Grant
    Filed: March 20, 2019
    Date of Patent: February 2, 2021
    Assignee: MEDIATEK INC.
    Inventors: Hung-Chih Lin, Shen-Kai Chang
  • Patent number: 10827159
    Abstract: According to one method, at a source side or an encoder side, a selected viewport associated with the 360-degree virtual reality images is determined. One or more parameters related to the selected pyramid projection format are then determined. According to the present invention, one or more syntax elements for said one or more parameters are included in coded data of the 360-degree virtual reality images. The coded data of the 360-degree virtual reality images are provided as output data. At a receiver side or a decoder side, one or more syntax elements for one or more parameters are parsed from the coded data of the 360-degree virtual reality images. A selected pyramid projection format associated with the 360-degree virtual reality images is determined based on information including said one or more parameters. The 360-degree virtual reality images are then recovered according to the selected viewport.
    Type: Grant
    Filed: August 20, 2018
    Date of Patent: November 3, 2020
    Assignee: MEDIATEK INC.
    Inventors: Peng Wang, Hung-Chih Lin, Jian-Liang Lin, Shen-Kai Chang
  • Patent number: 10825229
    Abstract: A projection-based frame is generated according to an omnidirectional video frame and a triangle-based projection layout. The projection-based frame has a 360-degree image content represented by triangular projection faces assembled in the triangle-based projection layout. A 360-degree image content of a viewing sphere is mapped onto the triangular projection faces via a triangle-based projection of the viewing sphere. One side of a first triangular projection face has contact with one side of a second triangular projection face, one side of a third triangular projection face has contact with another side of the second triangular projection face. One image content continuity boundary exists between one side of the first triangular projection face and one side of the second triangular projection face, and another image content continuity boundary exists between one side of the third triangular projection face and another side of the second triangular projection face.
    Type: Grant
    Filed: March 12, 2020
    Date of Patent: November 3, 2020
    Assignee: MEDIATEK INC.
    Inventors: Jian-Liang Lin, Hung-Chih Lin, Chia-Ying Li, Shen-Kai Chang, Chi-Cheng Ju, Chao-Chih Huang, Hui Ouyang
  • Patent number: 10771791
    Abstract: For omnidirectional video such as 360-degree Virtual Reality (360VR) video, a video system that support independent decoding of different views of the omnidirectional video is provided. A decoder for such a system can extract a specified part of a bitstream to decode a desired perspective/face/view of an omnidirectional image without decoding the entire image while suffering minimal or no loss in coding efficiency.
    Type: Grant
    Filed: August 7, 2017
    Date of Patent: September 8, 2020
    Assignee: MEDIATEK INC.
    Inventors: Jian-Liang Lin, Hung-Chih Lin, Shen-Kai Chang
  • Publication number: 20200252650
    Abstract: A video processing method includes: receiving a bitstream, wherein a part of the bitstream transmits encoded information of a projection-based frame that has a 360-degree content represented by projection faces packed in a 360-degree Virtual Reality (360 VR) projection layout, and the projection-based frame has at least one boundary; and decoding, by a video decoder, the part of the bitstream, including: generating a reconstructed frame, parsing a flag from the bitstream, and applying an in-loop filtering operation to the reconstructed frame. The flag indicates that the in-loop filtering operation is blocked from being applied to each of said at least one boundary in the reconstructed frame. In response to the flag, the in-loop filtering operation is blocked from being applied to each of the at least one boundary in the reconstructed frame.
    Type: Application
    Filed: April 23, 2020
    Publication date: August 6, 2020
    Inventors: Cheng-Hsuan Shih, Shen-Kai Chang, Jian-Liang Lin, Hung-Chih Lin
  • Publication number: 20200234399
    Abstract: An exemplary video processing method includes: receiving an omnidirectional content corresponding to a sphere; obtaining a plurality of projection faces from the omnidirectional content of the sphere according to a pyramid projection; creating at least one padding region; and generating a projection-based frame by packing the projection faces and the at least one padding region in a pyramid projection layout. The projection faces packed in the pyramid projection layout include a first projection face. The at least one padding region packed in the pyramid projection layout includes a first padding region. The first padding region connects with at least the first projection face, and forms at least a portion of one boundary of the pyramid projection layout.
    Type: Application
    Filed: August 17, 2018
    Publication date: July 23, 2020
    Inventors: Jian-Liang Lin, Peng Wang, Ya-Hsuan Lee, Hung-Chih Lin, Shen-Kai Chang
  • Publication number: 20200226711
    Abstract: A video processing method includes receiving a bitstream, and decoding, by a video decoder, the bitstream to generate a decoded frame. The decoded frame is a projection-based frame that has a 360-degree image/video content represented by triangular projection faces packed in a triangle-based projection layout. An omnidirectional image/video content of a viewing sphere is mapped onto the triangular projection faces via a triangle-based projection of the viewing sphere. An equator of the viewing sphere is not mapped along any side of each of the triangular projection faces.
    Type: Application
    Filed: March 26, 2020
    Publication date: July 16, 2020
    Inventors: Hung-Chih Lin, Chao-Chih Huang, Chia-Ying Li, Hui Ou Yang, Jian-Liang Lin, Shen-Kai Chang
  • Publication number: 20200211258
    Abstract: A projection-based frame is generated according to an omnidirectional video frame and a triangle-based projection layout. The projection-based frame has a 360-degree image content represented by triangular projection faces assembled in the triangle-based projection layout. A 360-degree image content of a viewing sphere is mapped onto the triangular projection faces via a triangle-based projection of the viewing sphere. One side of a first triangular projection face has contact with one side of a second triangular projection face, one side of a third triangular projection face has contact with another side of the second triangular projection face. One image content continuity boundary exists between one side of the first triangular projection face and one side of the second triangular projection face, and another image content continuity boundary exists between one side of the third triangular projection face and another side of the second triangular projection face.
    Type: Application
    Filed: March 12, 2020
    Publication date: July 2, 2020
    Inventors: Jian-Liang Lin, Hung-Chih Lin, Chia-Ying Li, Shen-Kai Chang, Chi-Cheng Ju, Chao-Chih Huang, Hui Ouyang
  • Publication number: 20200193676
    Abstract: Methods and apparatus of processing 360-degree virtual reality images are disclosed. According to one method, the method receives coded data for an extended 2D (two-dimensional) frame including an encoded 2D frame with one or more encoded guard bands, wherein the encoded 2D frame is projected from a 3D (three-dimensional) sphere using a target projection, wherein said one or more encoded guard bands are based on a blending of one or more guard bands with an overlapped region when the overlapped region exists. The method then decodes the coded data into a decoded extended 2D frame including a decoded 2D frame with one or more decoded guard bands, and derives a reconstructed 2D frame from the decoded extended 2D frame.
    Type: Application
    Filed: February 27, 2020
    Publication date: June 18, 2020
    Inventors: Cheng-Hsuan SHIH, Chia-Ying LI, Ya-Hsuan LEE, Hung-Chih LIN, Jian-Liang LIN, Shen-Kai CHANG
  • Patent number: 10679324
    Abstract: A video processing method includes receiving a bitstream, and decoding, by a video decoder, the bitstream to generate a decoded frame. The decoded frame is a projection-based frame that has a 360-degree image/video content represented by triangular projection faces packed in an octahedron projection layout. An omnidirectional image/video content of a viewing sphere is mapped onto the triangular projection faces via an octahedron projection of the viewing sphere. An equator of the viewing sphere is not mapped along any side of each of the triangular projection faces.
    Type: Grant
    Filed: July 2, 2019
    Date of Patent: June 9, 2020
    Assignee: MEDIATEK INC.
    Inventors: Hung-Chih Lin, Chao-Chih Huang, Chia-Ying Li, Hui Ou Yang, Jian-Liang Lin, Shen-Kai Chang
  • Patent number: 10652516
    Abstract: A video processing method includes receiving an omnidirectional content corresponding to a sphere, generating a projection-based frame according to the omnidirectional content and a pyramid projection layout, and encoding, by a video encoder, the projection-based frame to generate a part of a bitstream. The projection-based frame has a 360-degree content represented by a base projection face and a plurality of lateral projection faces packed in the pyramid projection layout. The base projection face and the lateral projection faces are obtained according to at least projection relationship between a pyramid and the sphere.
    Type: Grant
    Filed: January 3, 2018
    Date of Patent: May 12, 2020
    Assignee: MEDIATEK INC.
    Inventors: Jian-Liang Lin, Peng Wang, Hung-Chih Lin, Shen-Kai Chang
  • Patent number: 10643370
    Abstract: A projection-based frame is generated according to an omnidirectional video frame and an octahedron projection layout. The projection-based frame has a 360-degree image content represented by triangular projection faces assembled in the octahedron projection layout. A 360-degree image content of a viewing sphere is mapped onto the triangular projection faces via an octahedron projection of the viewing sphere. One side of a first triangular projection face has contact with one side of a second triangular projection face, one side of a third triangular projection face has contact with another side of the second triangular projection face. One image content continuity boundary exists between one side of the first triangular projection face and one side of the second triangular projection face, and another image content continuity boundary exists between one side of the third triangular projection face and another side of the second triangular projection face.
    Type: Grant
    Filed: September 30, 2017
    Date of Patent: May 5, 2020
    Assignee: MEDIATEK INC.
    Inventors: Jian-Liang Lin, Hung-Chih Lin, Chia-Ying Li, Shen-Kai Chang, Chi-Cheng Ju, Chao-Chih Huang, Hui Ouyang
  • Patent number: 10614609
    Abstract: Methods and apparatus of processing 360-degree virtual reality images are disclosed. According to one method, a 2D (two-dimensional) frame is divided into multiple blocks. The multiple blocks are encoded or decoded using quantization parameters by restricting a delta quantization parameter to be within a threshold for any two blocks corresponding to two neighboring blocks on a 3D sphere. According to another embodiment, one or more guard bands are added to one or more edges that are discontinuous in the 2D frame but continuous in the 3D sphere. Fade-out process is applied to said one or more guard bands to generate one or more faded guard bands. At the decoder side, the reconstructed 2D frame is generated from the decoded extended 2D frame by cropping said one or more decoded faded guard bands or by blending said one or more decoded faded guard bands and reconstructed duplicated areas.
    Type: Grant
    Filed: July 13, 2018
    Date of Patent: April 7, 2020
    Assignee: MEDIATEK INC.
    Inventors: Cheng-Hsuan Shih, Chia-Ying Li, Ya-Hsuan Lee, Hung-Chih Lin, Jian-Liang Lin, Shen-Kai Chang
  • Patent number: 10593012
    Abstract: A video processing method includes receiving an omnidirectional content corresponding to a sphere, generating a projection-based frame according to at least the omnidirectional content and a segmented sphere projection (SSP) format, and encoding, by a video encoder, the projection-based frame to generate a part of a bitstream. The projection-based frame has a 360-degree content represented by a first circular projection face, a second circular projection face, and at least one rectangular projection face packed in an SSP layout. A north polar region of the sphere is mapped onto the first circular projection face. A south polar region of the sphere is mapped onto the second circular projection face. At least one non-polar ring-shaped segment between the north polar region and the south polar region of the sphere is mapped onto said at least one rectangular projection face.
    Type: Grant
    Filed: March 20, 2018
    Date of Patent: March 17, 2020
    Assignee: MEDIATEK INC.
    Inventors: Ya-Hsuan Lee, Hung-Chih Lin, Jian-Liang Lin, Shen-Kai Chang