Abstract: Disclosed are an LSTM based personalization viewpoint estimation apparatus and method. According to an embodiment of the present disclosure, a viewpoint of a user is estimated using LSTM with respect to a 360-degree raw image and a viewpoint image that is a region of interest of the user and a tile including the estimated viewpoint is transmitted over a network, so that the amount of data to transmit compared to the network bandwidth may be reduced and a viewpoint of each individual may be estimated.

Abstract: The present invention relates to a system and a method of preloading a multi-view video. According to an embodiment of the present invention, load of a system is reduced and client's Quality of Experience (QoE) is maximized. In addition, the sense of direction, distance, and space for virtual reality are felt in the same manner as those for the real environment, so that a virtual reality service is provided realistically, thereby further improving immersion and interest in the virtual reality service.

Abstract: An apparatus and method of producing sound using a terminal is proposed. According to an embodiment of the present invention, it is possible to provide realistic sound when playing contents and easily produce contents with improved immersion by making uniform a sound received through the microphone of the lightweight terminal through distortion compensation and recording the uniform sound in a stereophonic manner.

Abstract: According to a specific embodiment of the present invention, an object at each viewpoint is recognized through image recognition, each recognized object is labeled, directional values and label values of objects that are determined as being the same are then input into an MPD, the MPD is transported, a direction of an object at a viewpoint to be moved, within an image, is corrected with a derived offset directional value, reproduction is performed, and thus, only with the labeling and the directional value of the object, the same content can be displayed on a screen without the user switching between directions. Accordingly, a reduction in an amount of data to be processed can improve a processing speed, and in turn, a sense of reality can be improved. Additionally, compatibility with an existing DASH structure is ensured, and applicability to existing image transport systems is widely expandable.

Abstract: The present invention relates to a system for providing a stereoscopic 3D 360-degree virtual reality (VR) service based on a hybrid network. According to a detailed embodiment of the present invention, standardizing and multiplexing based on an ATSC 3.0 protocol for a base layer stream, an enhancement layer stream, and a stereoscopic stream which are derived from a high resolution left eye image and a high resolution right eye image which are captured by 360-degree cameras may be performed by performing MPD signaling, and thus realistic media such as HD and UHD resolution 360-degree VR broadcast services, stereoscopic 3D 360-degree VR services, etc. may be provided. In addition, system complexity may be reduced by deriving a base layer stream, an enhancement layer stream, and a stereoscopic stream by using one encoder, and thus compression efficiency may be improved.

Abstract: There is disclosed a system and method of predicting a location of a user's viewport using location information of a sound source in 360 virtual reality (VR) content. According to the present invention, the spatial representation description (SRD) and the sound source localization information (SLI) of the audio MPD are transmitted with the video MPD being extended, the SRD of the sound source is used to derive the location of the sound source, and the weights of the respective items of the region of interest (ROI), the sound source localization information (SLI), the current viewport, and the pole are allocated differentially according to the bandwidth condition and then multiplied by the reference bitrate to determine the segment bitrate to be provided next, thereby improving the accuracy of predicting the location of the user's viewport and ensuring the quality of experience (QoE) for regeneration speed and regeneration quality.

Abstract: An apparatus and a method for broadcasting a stereoscopic 3D video, since the LLR operation of each of the HP bitstream and the LP bitstream is provided by the four fundamental arithmetic operations through the logarization for the probability that a video bit for the reception symbol vector is to be transmitted, the operation complexity of the HP bitstream LLR and the LP bitstream LLR is lowered. A high-quality stereoscopic video can be displayed and the left video bitstream is updated by providing the prior bitstream of the left video to the first SISO decoder, thereby improving reliability of the decoding for the left video.