Abstract: Disclosed are an LSTM based personalization viewpoint estimation apparatus and method. According to an embodiment of the present disclosure, a viewpoint of a user is estimated using LSTM with respect to a 360-degree raw image and a viewpoint image that is a region of interest of the user and a tile including the estimated viewpoint is transmitted over a network, so that the amount of data to transmit compared to the network bandwidth may be reduced and a viewpoint of each individual may be estimated.
Type:
Grant
Filed:
December 10, 2020
Date of Patent:
July 12, 2022
Assignee:
Fdn. For Res. & Bus., Seoul Nat. Univ. Of Sci. & Tech.
Inventors:
Dong Ho Kim, Bong-Seok Seo, Changjong Hyun
Abstract: An apparatus and method of producing sound using a terminal is proposed. According to an embodiment of the present invention, it is possible to provide realistic sound when playing contents and easily produce contents with improved immersion by making uniform a sound received through the microphone of the lightweight terminal through distortion compensation and recording the uniform sound in a stereophonic manner.
Type:
Grant
Filed:
December 10, 2020
Date of Patent:
April 5, 2022
Assignee:
Fdn. For Res. & Bus., Seoul Nat. Univ. Of Sci. & Tech.
Inventors:
Dong Ho Kim, Bong-Seok Seo, Subin Hwang
Abstract: According to a specific embodiment of the present invention, an object at each viewpoint is recognized through image recognition, each recognized object is labeled, directional values and label values of objects that are determined as being the same are then input into an MPD, the MPD is transported, a direction of an object at a viewpoint to be moved, within an image, is corrected with a derived offset directional value, reproduction is performed, and thus, only with the labeling and the directional value of the object, the same content can be displayed on a screen without the user switching between directions. Accordingly, a reduction in an amount of data to be processed can improve a processing speed, and in turn, a sense of reality can be improved. Additionally, compatibility with an existing DASH structure is ensured, and applicability to existing image transport systems is widely expandable.
Type:
Grant
Filed:
December 6, 2019
Date of Patent:
July 6, 2021
Assignee:
Fdn. For Res.&Bus., Seoul Nat. Univ. Of Sci.&Tech.
Abstract: There is disclosed a system and method of predicting a location of a user's viewport using location information of a sound source in 360 virtual reality (VR) content. According to the present invention, the spatial representation description (SRD) and the sound source localization information (SLI) of the audio MPD are transmitted with the video MPD being extended, the SRD of the sound source is used to derive the location of the sound source, and the weights of the respective items of the region of interest (ROI), the sound source localization information (SLI), the current viewport, and the pole are allocated differentially according to the bandwidth condition and then multiplied by the reference bitrate to determine the segment bitrate to be provided next, thereby improving the accuracy of predicting the location of the user's viewport and ensuring the quality of experience (QoE) for regeneration speed and regeneration quality.
Type:
Grant
Filed:
November 29, 2018
Date of Patent:
August 25, 2020
Assignee:
Fdn. For Res.&Bus., Seoul Nat. Univ. Of Sci.&Tech.
Inventors:
Ye Hoon Lee, Seung Ho Choi, Dong Ho Kim, Eunyoung Jeong, Deokgyu Yun
Abstract: An apparatus and a method for broadcasting a stereoscopic 3D video, since the LLR operation of each of the HP bitstream and the LP bitstream is provided by the four fundamental arithmetic operations through the logarization for the probability that a video bit for the reception symbol vector is to be transmitted, the operation complexity of the HP bitstream LLR and the LP bitstream LLR is lowered. A high-quality stereoscopic video can be displayed and the left video bitstream is updated by providing the prior bitstream of the left video to the first SISO decoder, thereby improving reliability of the decoding for the left video.
Type:
Grant
Filed:
November 10, 2017
Date of Patent:
December 3, 2019
Assignee:
Fdn. for Res. & Bus., Seoul Nat. Univ. of Sci. & Tech.