Patents by Inventor Fanyi Duanmu
Fanyi Duanmu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12137199Abstract: A system obtains a data set representing immersive video content for display at a display time, including first data representing the content according to a first level of detail, and second data representing the content according to a second higher level of detail. During one or more first times prior to the display time, the system causes at least a portion of the first data to be stored in a buffer. During one or more second times prior to the display time, the system generates a prediction of a viewport for displaying the content to a user at the display time, identifies a portion of the second data corresponding to the prediction of the viewport, and causes the identified portion of the second data to be stored in the video buffer. At the display time, the system causes the content to be displayed to the user using the video buffer.Type: GrantFiled: January 8, 2024Date of Patent: November 5, 2024Assignee: Apple Inc.Inventors: Fanyi Duanmu, Jun Xin, Hsi-Jung Wu, Xiaosong Zhou
-
Publication number: 20240323373Abstract: A block may be identified. The block may be partitioned into one or more (e.g., two) sibling nodes (e.g., sibling nodes B0 and B1). A partition direction and a partition type for the block may be determined. If the partition type for the block is binary tree (BT), one or more (e.g., two) partition parameters may be determined for sibling node B0. A partition parameter (e.g., a first partition parameter) may be determined for sibling node B1. A decoder may determine whether to receive an indication of a second partition parameter for B1 based on, for example, the partition direction for the block, the partition type for the block, and the first partition parameter for B1. The decoder may derive the second partition parameter based on, for example, the partition direction and type for the block, and the first partition parameter for B1.Type: ApplicationFiled: May 31, 2024Publication date: September 26, 2024Applicant: VID SCALE, INC.Inventors: Yuwen He, Fanyi Duanmu, Xiaoyu Xiu, Yan Ye
-
Patent number: 12028520Abstract: A block may be identified. The block may be partitioned into one or more (e.g., two) sibling nodes (e.g., sibling nodes BO and B1). A partition direction and a partition type for the block may be determined. If the partition type for the block is binary tree (BT), one or more (e.g., two) partition parameters may be determined for sibling node BO. A partition parameter (e.g., a first partition parameter) may be determined for sibling node B1. A decoder may determine whether to receive an indication of a second partition parameter for B1 based on, for example, the partition direction for the block, the partition type for the block, and the first partition parameter for B1. The decoder may derive the second partition parameter based on, for example, the partition direction and type for the block, and the first partition parameter for B1.Type: GrantFiled: November 1, 2018Date of Patent: July 2, 2024Assignee: VID SCALE, Inc.Inventors: Yuwen He, Fanyi Duanmu, Xiaoyu Xiu, Yan Ye
-
Publication number: 20240146892Abstract: A system obtains a data set representing immersive video content for display at a display time, including first data representing the content according to a first level of detail, and second data representing the content according to a second higher level of detail. During one or more first times prior to the display time, the system causes at least a portion of the first data to be stored in a buffer. During one or more second times prior to the display time, the system generates a prediction of a viewport for displaying the content to a user at the display time, identifies a portion of the second data corresponding to the prediction of the viewport, and causes the identified portion of the second data to be stored in the video buffer. At the display time, the system causes the content to be displayed to the user using the video buffer.Type: ApplicationFiled: January 8, 2024Publication date: May 2, 2024Inventors: Fanyi Duanmu, Jun Xin, Hsi-Jung Wu, Xiaosong Zhou
-
Patent number: 11956295Abstract: Techniques for multi-view video streaming are described in the present disclosure, wherein a viewport prediction may be employed at a client-end based on analysis of pre-fetched media item data and ancillary information. A streaming method may first prefetch a portion of content of a multi-view media item. The method may next identify a salient region from the prefetched content and may then download additional content of the media item that corresponds to the identified salient region.Type: GrantFiled: March 20, 2020Date of Patent: April 9, 2024Assignee: APPLE INC.Inventors: Fanyi Duanmu, Alexandros Tourapis, Jun Xin, Hsi-Jung Wu, Xiaosong Zhou
-
Patent number: 11924391Abstract: A system obtains a data set representing immersive video content for display at a display time, including first data representing the content according to a first level of detail, and second data representing the content according to a second higher level of detail. During one or more first times prior to the display time, the system causes at least a portion of the first data to be stored in a buffer. During one or more second times prior to the display time, the system generates a prediction of a viewport for displaying the content to a user at the display time, identifies a portion of the second data corresponding to the prediction of the viewport, and causes the identified portion of the second data to be stored in the video buffer. At the display time, the system causes the content to be displayed to the user using the video buffer.Type: GrantFiled: December 16, 2022Date of Patent: March 5, 2024Assignee: Apple Inc.Inventors: Fanyi Duanmu, Jun Xin, Hsi-Jung Wu, Xiaosong Zhou
-
Publication number: 20230117742Abstract: A system obtains a data set representing immersive video content for display at a display time, including first data representing the content according to a first level of detail, and second data representing the content according to a second higher level of detail. During one or more first times prior to the display time, the system causes at least a portion of the first data to be stored in a buffer. During one or more second times prior to the display time, the system generates a prediction of a viewport for displaying the content to a user at the display time, identifies a portion of the second data corresponding to the prediction of the viewport, and causes the identified portion of the second data to be stored in the video buffer. At the display time, the system causes the content to be displayed to the user using the video buffer.Type: ApplicationFiled: December 16, 2022Publication date: April 20, 2023Inventors: Fanyi Duanmu, Jun Xin, Hsi-Jung Wu, Xiaosong Zhou
-
Patent number: 11570417Abstract: A system obtains a data set representing immersive video content for display at a display time, including first data representing the content according to a first level of detail, and second data representing the content according to a second higher level of detail. During one or more first times prior to the display time, the system causes at least a portion of the first data to be stored in a buffer. During one or more second times prior to the display time, the system generates a prediction of a viewport for displaying the content to a user at the display time, identifies a portion of the second data corresponding to the prediction of the viewport, and causes the identified portion of the second data to be stored in the video buffer. At the display time, the system causes the content to be displayed to the user using the video buffer.Type: GrantFiled: May 20, 2021Date of Patent: January 31, 2023Assignee: Apple Inc.Inventors: Fanyi Duanmu, Jun Xin, Hsi-Jung Wu, Xiaosong Zhou
-
Publication number: 20220377304Abstract: A system obtains a data set representing immersive video content for display at a display time, including first data representing the content according to a first level of detail, and second data representing the content according to a second higher level of detail. During one or more first times prior to the display time, the system causes at least a portion of the first data to be stored in a buffer. During one or more second times prior to the display time, the system generates a prediction of a viewport for displaying the content to a user at the display time, identifies a portion of the second data corresponding to the prediction of the viewport, and causes the identified portion of the second data to be stored in the video buffer. At the display time, the system causes the content to be displayed to the user using the video buffer.Type: ApplicationFiled: May 20, 2021Publication date: November 24, 2022Inventors: Fanyi Duanmu, Jun Xin, Hsi-Jung Wu, Xiaosong Zhou
-
Patent number: 10972753Abstract: Techniques are disclosed for coding and delivering multi-view video in which the video is represented as a manifest file identifying a plurality of segments of the video available for download. The multi-view video may be partitioned spatially into a plurality of tiles that, in aggregate, encompass the entire spatial area of the video. The tiles are coded as segments contains coded video representing content contained within its respective tile. Tiles may be given different sizes based on saliency of the content within their respective regions. In this manner, tiles with high levels of interest may have relatively large spatial areas, which can lead to efficient coding in the presence of content motion.Type: GrantFiled: September 13, 2019Date of Patent: April 6, 2021Assignee: Apple Inc.Inventors: Fanyi Duanmu, Eduardo Asbun, Xiaosong Zhou, Jun Xin, Hsi-Jung Wu, John Su, Samir Gehani, Christopher Flick, Shalini Sahoo
-
Publication number: 20210099507Abstract: Techniques for multi-view video streaming are described in the present disclosure, wherein a viewport prediction may be employed at a client-end based on analysis of pre-fetched media item data and ancillary information. A streaming method may first prefetch a portion of content of a multi-view media item. The method may next identify a salient region from the prefetched content and may then download additional content of the media item that corresponds to the identified salient region.Type: ApplicationFiled: March 20, 2020Publication date: April 1, 2021Inventors: Fanyi DUANMU, Alexandros TOURAPIS, Jun XIN, Hsi-Jung WU, Xiaosong ZHOU
-
Publication number: 20210084332Abstract: Techniques are disclosed for coding and delivering multi-view video in which the video is represented as a manifest file identifying a plurality of segments of the video available for download. The multi-view video may be partitioned spatially into a plurality of tiles that, in aggregate, encompass the entire spatial area of the video. The tiles are coded as segments contains coded video representing content contained within its respective tile. Tiles may be given different sizes based on saliency of the content within their respective regions. In this manner, tiles with high levels of interest may have relatively large spatial areas, which can lead to efficient coding in the presence of content motion.Type: ApplicationFiled: September 13, 2019Publication date: March 18, 2021Inventors: Fanyi DUANMU, Eduardo ASBUN, Xiaosong ZHOU, Jun XIN, Hsi-Jung WU, John SU, Samir GEHANI, Christopher FLICK, Shalini SAHOO
-
Publication number: 20200304788Abstract: A block may be identified. The block may be partitioned into one or more (e.g., two) sibling nodes (e.g., sibling nodes BO and B1). A partition direction and a partition type for the block may be determined. If the partition type for the block is binary tree (BT), one or more (e.g., two) partition parameters may be determined for sibling node BO. A partition parameter (e.g., a first partition parameter) may be determined for sibling node B1. A decoder may determine whether to receive an indication of a second partition parameter for B1 based on, for example, the partition direction for the block, the partition type for the block, and the first partition parameter for B1. The decoder may derive the second partition parameter based on, for example, the partition direction and type for the block, and the first partition parameter for B1.Type: ApplicationFiled: November 1, 2018Publication date: September 24, 2020Applicant: VID SCALE, INC.Inventors: Yuwen He, Fanyi Duanmu, Xiaoyu Xiu, Yan Ye
-
Patent number: 10148977Abstract: An encoding apparatus, decoding apparatus, and coding methods are provided. A method of decoding including receiving, by a decoder, a bitstream from an encoder, scanning, using the decoder, the bitstream to identify a first flag corresponding to a string of index values in a block other than a last string and a second flag corresponding to the last string of index values from the block, determining, by the decoder, that a context model used to encode the first flag is the same as the context model used to encode the second flag, and generating, by the decoder, a video frame using the context model.Type: GrantFiled: June 9, 2016Date of Patent: December 4, 2018Assignee: Futurewei Technologies, Inc.Inventors: Haoping Yu, Meng Xu, Wei Wang, Fanyi Duanmu, Shervin Minaee
-
Publication number: 20160373756Abstract: An encoding apparatus, decoding apparatus, and coding methods are provided.Type: ApplicationFiled: June 9, 2016Publication date: December 22, 2016Inventors: Haoping Yu, Meng Xu, Wei Wang, Fanyi Duanmu, Shervin Minaee