Patents by Inventor Eun Seok Ryu

Eun Seok Ryu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240135590
    Abstract: A method of learning a neural network-based image compression model according to the disclosed embodiment, may include receiving a learning target image as an input; encoding the input image through the neural network-based image compression model configured to include a weight parameter, and decoding the encoded image through the neural network-based image compression model; calculating an entropy estimation value for a network model weight of the neural network-based image compression model; calculating a reconstruction performance value by comparing qualities of the learning target image and the decoded image; and learning the neural network-based image compression model by updating the weight parameter of the neural network-based image compression model based on the entropy estimation value for the network model weight and the reconstruction performance value. Accordingly, it is possible to minimize the size of the weight of the neural network-based image compression model.
    Type: Application
    Filed: June 21, 2023
    Publication date: April 25, 2024
    Applicant: Research & Business Foundation SUNGKYUNKWAN UNIVERSITY
    Inventors: Eun-Seok RYU, Soonbin LEE, Jong-Beom JEONG
  • Publication number: 20240073493
    Abstract: Systems and methods are provided herein for generating a summary for a piece of content using a thumbnail container. This may be accomplished by a system receiving a thumbnail container related to a piece of content. The system may also receive user information, a device characteristic, and/or content information related to the piece of content and use the received data to select a machine learning model. The selected machine learning model can identify one or more thumbnails of the thumbnail container as a thumbnail of interest to a user. The system can then generate a summary of the piece of content based on the thumbnail identified by the machine learning model and display the generated summary for the user.
    Type: Application
    Filed: August 30, 2022
    Publication date: February 29, 2024
    Inventors: Ghulam Mujtaba, Eun Seok Ryu, Reda Harb
  • Publication number: 20240048764
    Abstract: Disclosed herein are a multi-view video encoding/decoding method and apparatus, and a method for transmitting a bitstream generated by the multi-view video encoding method. The multi-view video encoding method according to the present disclosure may include generating first bitstreams for each of a plurality of quantization parameters (QPs) different from each other by encoding an atlas for a multi-view video in the quantization parameters; extracting second bitstreams for sub-regions in the atlas from the first bitstreams; and generating a third bitstream by merging, among the second bitstreams, second bitstreams with a predetermined bit rate.
    Type: Application
    Filed: July 19, 2023
    Publication date: February 8, 2024
    Applicant: RESEARCH & BUSINESS FOUNDATION SUNGKYUNKWAN UNIVERSITY
    Inventors: Eun Seok RYU, Jong Beom JEONG, Soon Bin LEE
  • Publication number: 20230334706
    Abstract: Disclosed herein are an immersive image encoding/decoding method and apparatus, and a method for transmitting a bitstream generated by the immersive image encoding method. An immersive image encoding method according to the present disclosure may include: generating geometry atlases for an immersive image; aligning the geometry atlases to make an alignment height of the geometry atlases correspond to a height of a texture atlas; and generating a geometry bitstream by encoding the aligned geometry atlases.
    Type: Application
    Filed: March 2, 2023
    Publication date: October 19, 2023
    Applicant: RESEARCH & BUSINESS FOUNDATION SUNGKYUNKWAN UNIVERSITY
    Inventors: Eun Seok RYU, Jong Beom JEONG, Soon Bin LEE
  • Patent number: 11627340
    Abstract: Systems, methods, and instrumentalities are provided to implement video coding system (VCS). The VCS may be configured to receive a video signal, which may include one or more layers (e.g., a base layer (BL) and/or one or more enhancement layers (ELs)). The VCS may be configured to process a BL picture into an inter-layer reference (ILR) picture, e.g., using picture level inter-layer prediction process. The VCS may be configured to select one or both of the processed ILR picture or an enhancement layer (EL) reference picture. The selected reference picture(s) may comprise one of the EL reference picture, or the ILR picture. The VCS may be configured to predict a current EL picture using one or more of the selected ILR picture or the EL reference picture. The VCS may be configured to store the processed ILR picture in an EL decoded picture buffer (DPB).
    Type: Grant
    Filed: April 30, 2021
    Date of Patent: April 11, 2023
    Assignee: VID SCALE, Inc.
    Inventors: Yan Ye, George W. McClellan, Yong He, Xiaoyu Xiu, Yuwen He, Jie Dong, Can Bal, Eun Seok Ryu
  • Publication number: 20230086192
    Abstract: Methods and systems are disclosed for a mobile device to decode video based on available power and/or energy. For example, the mobile device may receive a media description file (MDF) from for a video stream from a video server. The MDF may include complexity information associated with a plurality of video segments. The complexity information may be related to the amount of processing power to be utilized for decoding the segment at the mobile device. The mobile device may determine at least one power metric for the mobile device. The mobile device may determine a first complexity level to be requested for a first video segment based on the complexity information from the MDF and the power metric. The mobile device may dynamically alter the decoding process to save energy based on the detected power/energy level.
    Type: Application
    Filed: November 28, 2022
    Publication date: March 23, 2023
    Applicant: VID SCALE, Inc.
    Inventors: Yuwen He, Yan Ye, Yong He, George W. McClellan, Eun Seok Ryu
  • Patent number: 11575871
    Abstract: Provided are a method and an apparatus for streaming a multi-view 360 degree video, and a method for streaming a 360 degree video according to an embodiment of the present disclosure includes: encoding a multi-view video to a bitstream of a base layer and a bitstream of a tile layer constituted by at least one tile; selecting a tile included in a user view video in the encoded bitstream of the tile layer by using user view information received from a 360 degree video rendering apparatus, and video information of the multi-view video; extracting tile data included in the selected user view video from the encoded bitstream of the tile layer, and generating a tile bitstream corresponding to the extracted tile data; and transmitting the encoded bitstream of the base layer and the generated tile bitstream to the 360 degree video rendering apparatus.
    Type: Grant
    Filed: October 13, 2021
    Date of Patent: February 7, 2023
    Assignee: Research & Business Foundation Sungkyunkwan University
    Inventors: Jong Beom Jeong, Soon Bin Lee, Eun Seok Ryu
  • Patent number: 11516485
    Abstract: Methods and systems are disclosed for a mobile device to decode video based on available power and/or energy. For example, the mobile device may receive a media description file (MDF) from for a video stream from a video server. The MDF may include complexity information associated with a plurality of video segments. The complexity information may be related to the amount of processing power to be utilized for decoding the segment at the mobile device. The mobile device may determine at least one power metric for the mobile device. The mobile device may determine a first complexity level to be requested for a first video segment based on the complexity information from the MDF and the power metric. The mobile device may dynamically alter the decoding process to save energy based on the detected power/energy level.
    Type: Grant
    Filed: May 18, 2021
    Date of Patent: November 29, 2022
    Assignee: VID SCALE, Inc.
    Inventors: Yuwen He, Yan Ye, Yong He, George W. McClellan, Eun Seok Ryu
  • Publication number: 20220343545
    Abstract: An image encoding/decoding method and apparatus are provided. An image decoding method according to the present disclosure includes: receiving an image, in which a first atlas for a basic view of a current image and a second atlas for an additional view of the current image are merged; extracting an image divided in a predetermined image unit within the first atlas and the second atlas; dividing the first atlas and the second atlas in the predetermined image unit; and reconstructing the image divided in the predetermined image unit, wherein the dividing of the first atlas and the second atlas in the predetermined image unit may non-uniformly divide the first atlas and the second atlas.
    Type: Application
    Filed: April 25, 2022
    Publication date: October 27, 2022
    Applicant: Research & Business Foundation Sungkyunkwan University
    Inventors: Eun Seok RYU, Jong Beom JEONG, Soon Bin LEE
  • Publication number: 20220256131
    Abstract: A video transmission method according to embodiments comprises: a pre-processing step for processing video data; a step for encoding the video data; and/or a step for transmitting a bitstream including the video data. A video reception method according to embodiments comprises the steps of: receiving video data; decoding the video data; and/or rendering the video data.
    Type: Application
    Filed: March 12, 2020
    Publication date: August 11, 2022
    Inventors: Hyunmook OH, Sejin OH, Eun Seok RYU, Soonbin LEE, Dongmin JANG, Jong Beom JEONG
  • Publication number: 20220116578
    Abstract: Provided are a method and an apparatus for streaming a multi-view 360 degree video, and a method for streaming a 360 degree video according to an embodiment of the present disclosure includes: encoding a multi-view video to a bitstream of a base layer and a bitstream of a tile layer constituted by at least one tile; selecting a tile included in a user view video in the encoded bitstream of the tile layer by using user view information received from a 360 degree video rendering apparatus, and video information of the multi-view video; extracting tile data included in the selected user view video from the encoded bitstream of the tile layer, and generating a tile bitstream corresponding to the extracted tile data; and transmitting the encoded bitstream of the base layer and the generated tile bitstream to the 360 degree video rendering apparatus.
    Type: Application
    Filed: October 13, 2021
    Publication date: April 14, 2022
    Applicant: RESEARCH & BUSINESS FOUNDATION SUNGKYUNKWAN UNIVERSITY
    Inventors: Jong Beom JEONG, Soon Bin LEE, Eun Seok RYU
  • Patent number: 11184584
    Abstract: An image decoding method includes: receiving a bitstream that includes video data and signaling data; decoding base layer video data; and decoding at least one enhancement layer video data based on the signaling data and the base layer video data, wherein the video data includes the base layer video data for a base layer and the at least one enhancement layer video data for at least one enhancement layer predicted from the base layer, wherein the signaling data includes region of interest information indicating a region of interest corresponding to a gaze direction of a user in an entire region of a virtual space for video conferencing service.
    Type: Grant
    Filed: June 27, 2017
    Date of Patent: November 23, 2021
    Assignee: GACHON UNIVERSITY OF INDUSTRY-ACADEMIC COOPERATION FOUNDATION
    Inventor: Eun-Seok Ryu
  • Publication number: 20210274199
    Abstract: Methods and systems are disclosed for a mobile device to decode video based on available power and/or energy. For example, the mobile device may receive a media description file (MDF) from for a video stream from a video server. The MDF may include complexity information associated with a plurality of video segments. The complexity information may be related to the amount of processing power to be utilized for decoding the segment at the mobile device. The mobile device may determine at least one power metric for the mobile device. The mobile device may determine a first complexity level to be requested for a first video segment based on the complexity information from the MDF and the power metric. The mobile device may dynamically alter the decoding process to save energy based on the detected power/energy level.
    Type: Application
    Filed: May 18, 2021
    Publication date: September 2, 2021
    Applicant: VID SCALE, Inc.
    Inventors: Yuwen He, Yan Ye, Yong He, George W. McClellan, Eun Seok Ryu
  • Publication number: 20210250619
    Abstract: Systems, methods, and instrumentalities are provided to implement video coding system (VCS). The VCS may be configured to receive a video signal, which may include one or more layers (e.g., a base layer (BL) and/or one or more enhancement layers (ELs)). The VCS may be configured to process a BL picture into an inter-layer reference (ILR) picture, e.g., using picture level inter-layer prediction process. The VCS may be configured to select one or both of the processed ILR picture or an enhancement layer (EL) reference picture. The selected reference picture(s) may comprise one of the EL reference picture, or the ILR picture. The VCS may be configured to predict a current EL picture using one or more of the selected ILR picture or the EL reference picture. The VCS may be configured to store the processed ILR picture in an EL decoded picture buffer (DPB).
    Type: Application
    Filed: April 30, 2021
    Publication date: August 12, 2021
    Applicant: Vid Scale, Inc.
    Inventors: Yan Ye, George W. McClellan, Yong He, Xiaoyu Xiu, Yuwen He, Jie Dong, Can Bal, Eun Seok Ryu
  • Patent number: 11039151
    Abstract: Methods and systems are disclosed for a mobile device to decode video based on available power and/or energy. For example, the mobile device may receive a media description file (MDF) from for a video stream from a video server. The MDF may include complexity information associated with a plurality of video segments. The complexity information may be related to the amount of processing power to be utilized for decoding the segment at the mobile device. The mobile device may determine at least one power metric for the mobile device. The mobile device may determine a first complexity level to be requested for a first video segment based on the complexity information from the MDF and the power metric. The mobile device may dynamically alter the decoding process to save energy based on the detected power/energy level.
    Type: Grant
    Filed: November 27, 2019
    Date of Patent: June 15, 2021
    Assignee: VID SCALE, Inc.
    Inventors: Yuwen He, Yan Ye, Yong He, George W. McClellan, Eun Seok Ryu
  • Patent number: 11012717
    Abstract: Systems, methods, and instrumentalities are provided to implement video coding system (VCS). The VCS may be configured to receive a video signal, which may include one or more layers (e.g., a base layer (BL) and/or one or more enhancement layers (ELs)). The VCS may be configured to process a BL picture into an inter-layer reference (ILR) picture, e.g., using picture level inter-layer prediction process. The VCS may be configured to select one or both of the processed ILR picture or an enhancement layer (EL) reference picture. The selected reference picture(s) may comprise one of the EL reference picture, or the ILR picture. The VCS may be configured to predict a current EL picture using one or more of the selected ILR picture or the EL reference picture. The VCS may be configured to store the processed ILR picture in an EL decoded picture buffer (DPB).
    Type: Grant
    Filed: October 24, 2019
    Date of Patent: May 18, 2021
    Assignee: VID SCALE, Inc.
    Inventors: Yan Ye, George W McClellan, Yong He, Xiaoyu Xiu, Yuwen He, Jie Dong, Can Bal, Eun Seok Ryu
  • Publication number: 20200389621
    Abstract: An image decoding method includes: receiving a bitstream that includes video data and signaling data; decoding base layer video data; and decoding at least one enhancement layer video data based on the signaling data and the base layer video data, wherein the video data includes the base layer video data for a base layer and the at least one enhancement layer video data for at least one enhancement layer predicted from the base layer, wherein the signaling data includes region of interest information indicating a region of interest corresponding to a gaze direction of a user in an entire region of a virtual space for video conferencing service.
    Type: Application
    Filed: June 27, 2017
    Publication date: December 10, 2020
    Inventor: Eun-Seok RYU
  • Patent number: 10812542
    Abstract: An electronic device and a method are provided. The electronic device includes a first service in response to a service request by a first electronic device, identifying at least one function relating to the first service, which is available in a second electronic device external to the first electronic device, and providing a second service relating to the service request on the basis of the at least one function. Other embodiments may be made.
    Type: Grant
    Filed: November 18, 2015
    Date of Patent: October 20, 2020
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Yong-Joon Jeon, Geon-Soo Kim, Dong-Hyun Yeom, Min-Kyung Hwang, Eun-Seok Ryu, Cheol-Ho Cheong
  • Patent number: 10701378
    Abstract: The present invention generally relates to a parallel video processing apparatus and method for a multicore computing system. According to a specific example of the present invention, since video unit sizes matched to the performance of each core are derived, video units obtained by segmenting an input image screen according to a video codec type are allocated to corresponding cores according to the derived video unit sizes, and then the cores process the allocated video units in parallel, a processing speed differences of each core for the segmented video units may be reduced, and thus the processing speed may be improved, and the power consumption may be reduced.
    Type: Grant
    Filed: February 16, 2017
    Date of Patent: June 30, 2020
    Assignee: GACHON UNIVERSITY OF INDUSTRY—ACADEMIC COOPERATION FOUNDATION
    Inventor: Eun-Seok Ryu
  • Publication number: 20200099943
    Abstract: Methods and systems are disclosed for a mobile device to decode video based on available power and/or energy. For example, the mobile device may receive a media description file (MDF) from for a video stream from a video server. The MDF may include complexity information associated with a plurality of video segments. The complexity information may be related to the amount of processing power to be utilized for decoding the segment at the mobile device. The mobile device may determine at least one power metric for the mobile device. The mobile device may determine a first complexity level to be requested for a first video segment based on the complexity information from the MDF and the power metric. The mobile device may dynamically alter the decoding process to save energy based on the detected power/energy level.
    Type: Application
    Filed: November 27, 2019
    Publication date: March 26, 2020
    Applicant: VID SCALE, Inc.
    Inventors: Yuwen He, Yan Ye, Yong He, George W. McClellan, Eun Seok Ryu