Abstract: Various concepts for media content streaming are described. Some allow for streaming spatial scene content in a spatially unequal manner so that the visible quality for the user is increased, or the processing complexity or used bandwidth at the streaming retrieval site is decreased. Others allow for streaming spatial scene content in a manner enlarging the applicability to further application scenarios.

Abstract: Various concepts for media content streaming are described. Some allow for streaming spatial scene content in a spatially unequal manner so that the visible quality for the user is increased, or the processing complexity or used bandwidth at the streaming retrieval site is decreased. Others allow for streaming spatial scene content in a manner enlarging the applicability to further application scenarios.

Abstract: Disclosed are a method an electronic device and a computer storage medium for generating a video. The method includes: receiving a video generating instruction, wherein the video generating instruction is generated in response to a user operation on a video generating link on a video playback page; obtaining video templates based on the video generating instruction, where the video templates comprises a first video template, and the first video template is a template adopted by a current video shown on the video playback page; determining a target template based on the video template; and generating the video based on the target template.

Abstract: At lease a computer program product is provided for efficiently encoding or decoding a video frame. The computer program product when executed by one or more processors configures the one or more processors to compress or encode the different video subsections within the video frame with different compression methods. The visual artifact is reduced between the different video subsections encoded or compressed with the different compression methods within the video frame.

Abstract: A system is provided for efficiently encoding and decoding a video frame with different subsections to improve and reduce visual distortion. The system comprises an encoder for encoding the different video subsections within the video frame with different compression methods. The system also comprises a correspond decoder for decoding the encoded video frame by the encoder. Therefore, the visual distortion is reduced between the different video subsections encoded with the different compression methods.

Abstract: Disclosed herein is an immersive video processing method. The immersive video processing method includes: determining a priority order of pruning for source videos; extracting patches from the source videos based on the priority order of pruning; generating at least one atlas based on the extracted patches; and encoding metadata. Herein, a first flag indicating whether or not an atlas includes a patch including information on an entire region of a first source video may be encoded into the metadata.

Abstract: A method and a device provide for transmitting information representing a viewpoint in a 3D scene represented with a set of volumetric video contents; receiving a first volumetric video content of the set, the first volumetric video content being according to a range of points of view comprising the viewpoint, the first volumetric video content being represented with a set of first patches, each of which corresponds to a 2D parametrization of a first group of points in a 3D part of the 3D scene associated with the first volumetric video content, and at least one first patch refers to an area of a second patch corresponding to a 2D parametrization of a second group of points in another 3D part of the 3D scene associated with a second volumetric video content of the set of volumetric video contents.

Abstract: An optoelectronic sensor for detecting objects in a monitored zone is provided, wherein the sensor has a scanning unit that is movable about an axis of rotation and that has a plurality of scanning modules accommodated therein for a periodic scanning of the monitored zone and for a generation of corresponding received signals and that has a control and evaluation unit for acquiring information on the objects from the received signals; and wherein the scanning modules each comprise a light transmitter for transmitting a light beam and a light receiver for generating a respective received signal from the light beam remitted by the objects. A respective mirror element is here associated with the scanning modules to set an angle of elevation of a respective scanning plane detected by a scanning module with respect to a central scanning plane perpendicular to the axis of rotation.

Abstract: A method for processing an image, which is performed by an image processing apparatus, is provided. The method includes acquiring a first image including an object and a second image including an object identical to the object in the first image under the same condition, acquiring three-dimensional direction information of a specific part of the object in the first image, and providing a three-dimensionally processed image by three-dimensionally rotating the object in the second image by an angle that corresponds to the acquired three-dimensional direction information of the specific part of the object in the first image.

Abstract: Various concepts for media content streaming are described. Some allow for streaming spatial scene content in a spatially unequal manner so that the visible quality for the user is increased, or the processing complexity or used bandwidth at the streaming retrieval site is decreased. Others allow for streaming spatial scene content in a manner enlarging the applicability to further application scenarios.

Abstract: A method of generating a representation of a virtual environment includes obtaining a mesh of at least part of the virtual environment; detecting the continuous and non-overlapping portions of that mesh, hereafter ‘patches’; populating a texture map with representations of the patches by, for successive patches in order of large to small, identifying a position on the texture map where a current patch meets a non-overwrite criterion, wherein the a non-overwrite criterion requires that texels corresponding to the current patch do not overwrite texels of any previously positioned patch, and successive positions for each current patch are tested at intervals starting from a common origin position; and associating the current patch with the identified position; setting colour values for the texels of the texture map responsive to colour information corresponding to the obtained mesh; and outputting the obtained mesh and texture map for use by a third party.

Abstract: A computerized method for transmitting one or more video streams, the method may include receiving at least one input video stream that comprises visual information obtained from multiple fields of view that differ from each other; converting the at least one input video stream to a group of encoded independent self-contained video streams (EISCVSs), by performing a codec-agnostic process; wherein different EISCVSs comprise visual information from different spatial segments of the at least one input video stream; receiving a first request to receive video information related to a first direction related to a first user; generating a first video stream that comprises a first sub-set of EISCVSs that is related to the first direction; and sending the first video stream to a device of the first user, over a first communication link that has a first bandwidth that is lower than a bandwidth required to convey the input video stream.

Abstract: Devices, systems, and methods for digital video coding, which includes matrix-based intra prediction methods for video coding, are described. In a representative aspect, a method for video processing includes determining, for encoding a current video block of a video into a bitstream representation of the current video block, a type of neighboring samples of the current video block to be used according to a rule, and adding, based on the determining, an encoded representation of the current video block to the bitstream representation, where the current video block is encoded using a matrix based intra prediction (MIP) mode in which a prediction block of the current video block is determined by performing, on previously coded samples of the video, a boundary downsampling operation, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation.

Abstract: A method of decoding video data includes decoding, from a coded video bitstream and as an unsigned integer 0-th order Exp-Golomb-coded syntax element with the left bit first, a value that specifies a target recovery point picture for a current picture of a current sequence of pictures, wherein the target recovery point picture is located at or after the current picture in display order; and recovering decoding of the current sequence of pictures at the target recovery point picture.

Abstract: A method of processing video data includes determining, by processing circuitry, a plurality of neighboring samples for predicting a current block. The plurality of neighboring samples are arranged outside of a region of a current picture, the region comprising the current block, a row of samples adjacent to a top row of the current block, and a column of samples adjacent to a left column of the current block. The method further comprises deriving, by the processing circuitry, local illumination compensation information for the current block using the plurality of neighboring samples and generating, by the processing circuitry, a prediction block using the local illumination compensation information.

Abstract: High frame rate image data having backward compatibility is favorably transmitted. Image data of each picture of a base layer included in a base stream sent from a transmission side has been subjected to a mixing process in a linear space or a non-linear space. On a reception side, the inverse mixing process can be performed appropriately by performing in a corresponding space on the basis of processing space information indicating whether or not the mixing process is performed in the linear space or the non-linear space.

Abstract: A camera, including: two imaging systems each comprising a different optical path corresponding to a different viewing angle of an object; one or more illumination sources; a mask disposed with multiple pairs of apertures, wherein each aperture of each aperture pair corresponds to a different one of the imaging systems; at least one detector configured to acquire multiple image pairs of the object from the two imaging systems via the multiple pairs of apertures; and a processor configured to produce from the multiple acquired image pairs a multi-layer three dimensional reconstruction of the object.

Abstract: At least a method and an apparatus are provided for efficiently encoding or decoding a video frame to smooth out or reduce visual distortions such as mosquito noise between different video subsections encoded with different compression methods within a video frame. For example, a plurality of surrounding neighboring video subsections of the video frame are compressed using a first compression method (e.g., inter coding), with an associated first compression parameter set. The center video subsection of the video frame is twice compressed, first with the same first compression method, then with a different, second compression method (e.g., intra coding). Therefore, the mosquito noise or visual artifact is reduced between the video subsections encoded with the different compression methods.

Abstract: A communication terminal device is a glasses-type communication terminal device having an optically transmissive display mounted thereon. The communication terminal device includes first and second radio-frequency modules that perform radio-frequency signal processing and a baseband module that is connected to the first and second radio-frequency modules via communication lines so as to be communicable and that performs baseband signal processing. The first and second radio-frequency modules are selectively switched by the baseband module to perform a reception operation. When the first radio-frequency module performs the reception operation, a reception signal received by the first radio-frequency module is retransmitted from the second radio-frequency module.

Abstract: A system performs image stabilization of a display in a vehicle, in particular a motor vehicle. The system includes at least one display, in particular a monitor, for visualization; at least one sensor, in particular an acceleration sensor; and a computer unit, in particular an on-board computer. The system is designed to detect, by way of the sensor, a shock to the vehicle, in particular as a result of unevenness of the roadway, and to carry out on the basis thereof, a compensation calculation by use of the computer unit and to output a correction signal to the display, in order to stabilize the visualization on the display.

Abstract: According to one embodiment, a measurement method includes: acquiring a first picture including a background image and a substance, the substance allowing transmission of light from the background image; acquiring a second picture including the background image and the substance in a different positional relation with respect to the first picture; and calculating a first displacement amount representing a difference in position of the background image between the first picture and the second picture.

Abstract: An image pickup apparatus, image processing apparatus and corresponding program and method are disclosed. In one example, a second captured image acquired from another apparatus is aligned with a first captured image. Image stabilization is carried out in response to a positional relation between the captured images. For example, when overlapping between the captured images is equal to or smaller than an image stabilization limitation threshold value, the image stabilization is stopped or a correction range is limited for at least one of the captured images. When the amount of overlapping is larger than the image stabilization limitation threshold value, the image stabilization for both of the captured images is carried out without limitation. The captured images are aligned with each other by using the captured image with limited image stabilization, or both captured images where stabilization is carried out without limitation, thereby producing a panoramic image.

Abstract: The disclosed technology presents a device and a method, respectively, for generating an augmented reality (AR) image (or AR video). The device configures to obtain a first image of a scene, obtain a second image of an object, obtain a depth range, and capture a third image of only the parts of the scene inside the depth range. Further, the device configures to generate occlusion information based on the third image, and overlay the first image and the second image based on the occlusion information to generate the AR image.

Abstract: A three-dimensional geometry measurement apparatus includes: a relationship identification part that identifies a combination of a first imaging pixel and a second imaging pixel corresponding to the same projection coordinate; a determination part that determines, whether or not at least one of the first imaging pixel or the second imaging pixel is a defective pixel on the basis of a distance between a projection pixel of the projection image; and a geometry measurement part that measures a geometry of an object to be measured using the first imaging pixel or the second imaging pixel corresponding to the combination, for which the first imaging pixel and the second imaging pixel that are determined to be not the defective pixel.

Abstract: A method of decoding an encoded video bitstream using at least one processor, including: obtaining from the encoded video bitstream a coded video sequence including a picture unit corresponding to a coded picture; obtaining a picture header (PH) network abstraction layer (NAL) unit included in the picture unit; obtaining at least one video coding layer (VCL) network abstraction layer (NAL) unit included in the picture unit; decoding the coded picture based on the PH NAL unit, the at least one VCL NAL unit, and an adaptation parameter set (APS) included in an APS NAL unit obtained from the coded video sequence; and outputting the decoded picture, wherein the APS NAL unit is available to the at least one processor before the at least one VCL NAL unit.

Abstract: A system for encoding and decoding a video coding block of a multi-view video signal is provided. A decoder is configured to decode a texture-depth video coding block (t0, d0) of a first texture frame and a first depth map associated with a first view for providing a decoded texture-depth video coding block (t0, d0) and the first depth map. A synthesized predicted texture-depth video coding block (tsyn, dsyn) of a view synthesis texture frame and a view synthesis depth map associated with a second view is generated. An inpainted synthesized predicted texture-depth video coding block is generated. Based on the impainted predicted texture-depth video block, the decoder reconstructs a texture-depth video coding block (t1, d1) of a second texture frame and a second depth map associated with the second view. An encoder is configured to encode the texture-depth video coding block in a manner that complements the decoding provided by the decoder.

Abstract: An object identification method and an object identification device, the object identification method comprises: capturing color images and depth images that are aligned; performing motion detection on the captured color images and depth images to acquire a motion start frame and a motion end frame; comparing the motion end frame with the motion start frame in the color images to acquire a set of motion pixels; performing connected component analysis on the acquired set of motion pixels to obtain at least one connected component; and identifying an object in the at least one connected component.

Abstract: There is provided an image encoding/decoding method and apparatus. The image encoding method of the present invention includes: generating at least one candidate block including warped reference picture (WRP) Flag information in an advanced motion vector prediction (AMVP) mode; constructing a candidate list including the at least one candidate block; and generating a prediction block of a current block based on the candidate list.

Abstract: A position estimation apparatus, a tracker, a position estimation method, and a program which enable estimation of the position or orientation of each of plural trackers in a common coordinate system are provided. A point cloud storage section (80) stores a common point cloud with positions expressed using a common coordinate system. A position estimation section (86) estimates the position or orientation of a first tracker in the common coordinate system on the basis of the common point cloud and first feature point data. The position estimation section (86) estimates the position or orientation of a second tracker in the common coordinate system on the basis of the common point cloud and second feature point data.

Abstract: Provided is an image display method for performing drawing in a display region overlapping at least with a part of an external scene in a state in which the external scene is visible. The image display method images a region including the display region, and extracts an operating object from a captured image in which this region is imaged, as a region of a color of the operating object. In accordance with a size of the region of the color thus extracted, a drawing mode of the operating object is changed, and image display in the display region is controlled in accordance with the changed drawing mode. As the control of the image display, for example, performing drawing, and moving or replicating a drawn image is assumed.

Abstract: Provided are a method and apparatus for processing a video bitstream, a network device and a readable storage medium. The method includes: parsing a bitstream to be extracted, and acquiring parameter information about an extractable sub-bitstream from a data unit of the bitstream to be extracted; determining a picture type parameter value of a random access picture in the sub-bitstream according to the parameter information; and configuring, in a process of extracting the sub-bitstream from the bitstream to be extracted, a picture type parameter value in a data unit of the sub-bitstream according to the picture type parameter value of the random access picture.

Abstract: The present application provides a method and a device of encoding and decoding based on free viewpoint, and relates to the technical field of video encoding. The method includes: generating a planar splicing image and splice information based on multiple single-viewpoint videos at a server side; generating a planar splicing video based on the planar splicing image; generating camera side information of the planar splicing video based on camera side information existing in the multiple single-viewpoint videos; and encoding the planar splicing video, the splice information and the camera side information of the planar splicing video to generate a planar splicing video bit stream, and decoding a planar splicing video bit stream to acquire a virtual viewpoint according to viewpoint information of a viewer at client side.

Abstract: [Problem] To provide an information processing apparatus, an information processing method, and a program. [Solution] An information processing apparatus including a display control unit that causes a display unit to display a virtual image in a three-dimensional space. The display control unit causes the display unit to display only one of a left-eye image and a right-eye image corresponding to the virtual image if it is determined that the virtual image is located outside of a predetermined range in a depth direction when viewed from a user of the display unit, and causes the display unit to display the left-eye image and the right-eye image if it is determined that the virtual image is located inside of the predetermined range.

Abstract: A recording medium includes a video stream of a standard-luminance range and a video stream of high-luminance range, which are used selectively in accordance with a playback environment. The recording medium also includes a subtitle stream of the standard-luminance range and a subtitle stream of the high-luminance range, which are used selectively in accordance with the playback environment. A playlist file includes a management region where playback control information relating to a main stream is stored, and includes an extended region. The management region stores first playback control information specifying playing of the video stream of the high-luminance range and the subtitle stream of the high-luminance range in combination. The extended region stores second playback control information specifying playing of the video stream of the standard-luminance range and the subtitle stream of the standard-luminance range in combination.

Abstract: A method includes receiving an input video stream and scaling the input video stream into two or more spatial layers. For each spatial layer, the method also includes generating a temporal layer prediction pattern by: obtaining a temporal base layer for a corresponding spatial layer; identifying, based on the temporal base layer, a plurality of temporal layers and a plurality of temporal time slots during a temporal period; and aligning the temporal base layer for the corresponding spatial layer with one of the temporal time slots during the temporal period. Each temporal time slot is associated with one of the temporal base layer or one of the plurality of temporal layers for the corresponding spatial layer. The temporal base layer for each corresponding spatial layer is aligned with a different temporal time slot than each other temporal base layer for each other corresponding spatial layer.

Abstract: A point cloud intensity completion method and system based on semantic segmentation are provided. The point cloud intensity completion method includes: acquiring an RGB image and point cloud data of a road surface synchronously by a photographic camera and a lidar; performing spatial transformation on the point cloud data by using a conversion matrix to generate a two-dimensional reflection intensity projection map and a two-dimensional depth projection map; performing reflection intensity completion on the RGB image and the two-dimensional reflection intensity projection map to obtain a single-channel reflection intensity projection map; performing depth completion on the RGB image and the two-dimensional depth projection map to obtain a single-channel depth projection map; and performing coarse-grained completion on the RGB image, the single-channel reflection intensity projection map and the single-channel depth projection map to obtain a two-dimensional coarse-grained reflectance intensity projection map.

Abstract: A method for transmitting data for a three-dimensional image is provided. The method comprises the steps of: generating a plurality of voxelized points corresponding to a plurality of voxels, respectively, from a plurality of points constituting a three-dimensional image; grouping the plurality of voxelized points into a plurality of segments, wherein each of the plurality of segments includes at least one of the plurality of voxelized points; for each segment, projecting the plurality of points and generating a plurality of two-dimensional images; generating a packed two-dimensional image from the generated plurality of two-dimensional images; decoding data for the packed two-dimensional image, and encapsulating same; and transmitting the decoded and encapsulated data.

Abstract: A method of video decoding performed by a video decoder includes receiving a coded video bitstream containing a current picture. The method includes determining whether a current block in the current picture is coded in intra block copy (IBC) mode. The method includes in response to a determination that the current block is coded in IBC mode, determining whether a mode with a motion vector offset is enabled for the IBC encoded current block. The method further includes in response to a determination that the mode with the motion vector offset is enabled for the IBC encoded current block, decoding the current block in accordance with an offset associated with the current block. Furthermore, the fractional offsets are not permitted for the IBC encoded current block.

Abstract: Disclosed is an approach for displaying 3D videos in a VR and/or AR system. The 3D videos may include 3D animated objects that escape from the display screen. The 3D videos may interact with objects within the VR and/or AR environment. The 3D video may be interactive with a user such that based on user input corresponding to decisions elected by the user at certain portions of the 3D video such that a different storyline and possibly a different conclusion may result for the 3D video. The 3D video may be a 3D icon displayed within a portal of a final 3D render world.

Abstract: Provided is an information processing apparatus, including: an estimation processing section that, on the basis of three-dimensional data and a first image feature value that are set and a second image feature value that is acquired from a captured image captured by a first imaging apparatus, estimates a position and attitude of the first imaging apparatus.

Abstract: A method for processing 360-degree image data by a device for receiving a 360-degree video according to the present invention comprises the steps of: receiving 360-degree image data; obtaining information relating to an encoded picture and metadata from the 360-degree image data, wherein the metadata includes camera lens information; decoding a picture including a target circular area on the basis of the information relating to the encoded picture; and rendering the target circular area by processing same on the basis of the camera lens information.

Abstract: Enhanced techniques for volumetric stage mapping based on a calibration object are described. An example method includes obtaining a plurality of images of a calibration object, the images being obtained from a plurality of image sensors positioned about the calibration object, and the calibration object having location information associated with a volumetric capture surface on which the calibration object is located; generating, based on the images, a reconstructed object associated with the calibration object, the reconstructed object representing a three-dimensional representation of the calibration object; determining reconstruction quality information associated with the reconstructed object, the determination being based on a ground-truth representation of the calibration object; and outputting the reconstruction quality information.

Abstract: Systems and techniques for performing illumination compensation in processing video data include deriving one or more illumination compensation parameters for a block of a picture based on one or more tools which may be used for inter-prediction of the block. Illumination compensation can be selectively applied for the block based on whether bi-directional prediction is to be applied for the inter-prediction of the block. In some cases if it is determined that bi-directional prediction is to be applied for inter-prediction of the block, illumination compensation may be avoided for the block.

Abstract: The invention relates to a method comprising encoding, into or along a bitstream of media content, a set of indicators to indicate one or more of unequality types, wherein an unequality type defines different encoding parameters for a video stream on a first view or region and for a video stream on a second view or region. The invention also relates to an apparatus and a computer program product for implementing the method.

Abstract: A method and device for encoding an image divided into blocks. The image contains separate first and second zones). The encoding implements the following, for at least one current block of the image: determining to which of the first and second zones the current block pertains; if the current block pertains to the first zone, encoding the current block by using a first encoding method; if the current block pertains to the second zone, encoding the current block by using a second encoding method including the following: from the position of the current block in the second zone, identifying a previously encoded, then decoded block located in the first zone of the image; and reproducing the value of at least one encoding parameter associated with the identified block.

Abstract: In various implementations, a method includes obtaining a first frame that is characterized by a first resolution associated with a first memory allocation. In some implementations, the method includes down-converting the first frame from the first resolution to a second resolution that is lower than the first resolution initially defining the first frame in order to produce a reference frame. In some implementations, the second resolution is associated with a second memory allocation that is less than a target memory allocation derived from the first memory allocation. In some implementations, the method includes storing the reference frame in a non-transitory memory. In some implementations, the method includes obtaining a second frame that is characterized by the first resolution. In some implementations, the method includes performing an error correction operation on the second frame based on the reference frame stored in the non-transitory memory.

Abstract: Methods and apparatus for generating stereoscopic images for display with respect to a virtual display screen (VDS) include: setting a VDS position for displaying a stereoscopic image of an object in a virtual scene, the VDS having a depth profile that approximates a depth profile of the object; generating the stereoscopic image for display at the VDS within the virtual scene; and controlling a configuration of the VDS based on the detected change in the viewpoint of the stereoscopic image by the viewer.

Abstract: A method of decoding a bitstream by an electronic device is provided. A block unit is determined from an image frame according to the bitstream. One of a plurality of candidate groups is selected based on a set flag in the bitstream. A plurality of merge mode with motion vector difference (MMVD) indications of the block unit is determined according to the bitstream. A plurality of MMVD prediction parameters of the block unit is determined based on the plurality of MMVD indications and the selected candidate group. The block unit is reconstructed based on the plurality of MMVD prediction parameters.

Abstract: Systems and methods for inserting supplemental content into presentations of two-dimensional video content are disclosed. Exemplary implementations may: obtain two-dimensional video content depicting a three-dimensional space; obtain supplemental content; obtain a model of the three-dimensional space defining the one or more visible physical features within the three-dimensional space; determine the camera position of the two-dimensional video content; identify a presentation location within the two-dimensional video content; determine integration information; modify the two-dimensional video content to include the supplemental content at the identified presentation locations in accordance with the integration information and/or perform other operations.

Abstract: Provided is a scalable video-decoding method based on multiple layers. The scalable video-decoding method according to the present invention comprises: a step of predicting first filter information of a video to be filtered using the information contained in an object layer and/or information contained in another layer, and generating second filter information in accordance with the prediction; and a step of filtering the video to be filtered using the second filter information. According to the present invention, the amount of information being transmitted is reduced, and video compression performance is improved.