Abstract: A method and device for coding attribute information of a point cloud may include obtaining the point cloud including a set of points in a three-dimensional space. The attribute information of the point cloud is coded using a YCoCg-R transform.

Abstract: Systems, methods, and non-transitory computer-readable medium storing instructions that, when executed, causes a processor to perform operations to display a three-dimensional (3D) space. The methods may include, with an imaging device, capturing a first series of frames as the imaging device travels from a first location to a second location within a space, and capturing a second series of frames as the imaging device travels from the second location to the first location. The method may also include determining a first segment in the first series of frames that matches a second segment in the second series of frames to create a segmentation dataset, generating video clip data based on the segmentation dataset, the video clip data defining a series of video clips, and displaying the series of video clips.

Abstract: An apparatus for transmitting a video comprises an inter-view redundancy remover configured to remove redundant information of pictures for viewing positions, where redundant pixel information between the pictures in adjacent viewing positions is removed, a packing unit configured to pack the pictures and generate packing information, and an encoder configured to encode the pictures. The apparatus is further configured to perform multi-view packing the pictures into a packed picture, where each view for the picture includes different types of a texture and a depth map, and a residual of texture and a depth map are generated for a subsidiary view based on redundancy between each view. The apparatus is further configured to generate signaling information for the inter-view redundancy remover, the packing unit, or the multi-view packing.

Abstract: In various examples there is an apparatus for aligning three-dimensional, 3D, representations of people. The apparatus comprises at least one processor and a memory storing instructions that, when executed by the at least one processor, perform a method comprising accessing a first 3D representation which is an instance of a parametric model of a person; accessing a second 3D representation which is a photoreal representation of the person; computing an alignment of the first and second 3D representations; and computing and storing a hologram from the aligned first and second 3D representations such that the hologram depicts parts of the person which are observed in only one of the first and second 3D representations; or controlling an avatar representing the person where the avatar depicts parts of the person which are observed in only one of the first and second 3D representations.

Abstract: An electronic device used in a method for expanding image depth obtains first images by a first sensor, the first images comprising depth information. The electronic device obtains second images by a second sensor, the second images comprising gradient information, and the first images correspond to the second images. The electronic device determines the pixels in the first images which contain expandable content according to the gradient information of the second images, applies expansion accordingly to the pixels in the first images to generate third images, and generate target depth maps according to the gradient information of the second images and the depth information of the third images.

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, a bit stream structure may be used to communicate compressed point cloud data. The bit stream structure may include point cloud compression network abstraction layer (PCCNAL) units that enable use of groups of frames (GOFs), frame, and sub-frame signaling of patch information. Such a bit stream structure may permit low delay streaming and random access reconstruction of point clouds amongst other applications.

Abstract: A method for high-precision true color three dimensional reconstruction of mechanical component. Firstly performs image acquisition: the left and right high-resolution grayscale cameras are fixed at same height and spaced at certain distance, an optical transmitter fixed between the two grayscale cameras, and low-resolution color camera fixed above optical transmitter, thus images of measured high-precision mechanical component are shot. Then performs image processing: all images are transmitted to a computer, which uses image processing to record surface information of measured high-precision mechanical component in the point cloud by high-precision true color three-dimensional reconstruction, which reflects color texture information of the surface, so as to realize the non-contact high-precision true color three dimensional reconstruction of high-precision mechanical component.

Abstract: Embodiments of the present application provide a data processing method and an electronic device. The data processing method includes: determining whether a current collection scene satisfies a condition for enabling a high-dynamic range (HDR) collection function; automatically enabling the HDR collection function in response to the current collection scene satisfying the condition for enabling the HDR collection function; and collecting at least two two-dimensional images with different exposures within a collection time of one frame of three-dimensional video data based on the HDR collection function; wherein the at least two two-dimensional images are configured to enable a mobile edge computing (MEC) server to build a three-dimensional video.

Abstract: Systems and methods for generating a three-dimensional reconstruction from a two-dimensional image of an asset are described. In some aspects, at least one computer hardware processor is used to perform: receiving a two-dimensional input image of an asset; encoding, using a first statistical model, the input image into a latent vector; and generating, using a second statistical model, at least one depth image from the latent vector, wherein pixel values in the at least one depth image correspond to coordinates of a point cloud.

Abstract: A method of generating a composite image includes capturing a video image of a physical scene with a camera, identifying a green-screen region within the video image, identifying a viewpoint and a position and/or orientation of the green-screen region relative to the viewpoint, and generating a modified video image rendered from the viewpoint onto a display surface in which the green-screen region is replaced with an image of a virtual object. The image of the virtual object is generated by projection rendering of a model of the virtual object based on the position and/or orientation of the green-screen region relative to the viewpoint such that the virtual object is constrained within the green-screen region.

Abstract: A system and method for creating an improved three-dimensional image includes several steps. One step includes providing one or more adjacent viewing zones, where each of the adjacent viewing zones includes several views of content, and where the adjacent viewing zones include central subset zones that include centrally located views within the adjacent viewing zones, and transition subset views that include views at edges of the adjacent viewing zones. Another step includes inserting at least one of the views from the central subset views into the transition zone to create an expanded transition zone. A further step includes removing at least one transition subset view from the adjacent viewing zone and replacing the removed at least one transition subset view with the inserted at least one of the views from the central subset views.

Abstract: Reconstructing a second component signal relating to a second component of a multi-component picture from a spatially corresponding portion of a reconstructed first component signal and a correction signal derived from a data stream for the second component promises increased coding efficiency over a broader range of multi-component picture content. By including the spatially corresponding portion of the reconstructed first component signal into the reconstruction of the second component signal, any remaining inter-component redundancies/correlations present such as still present despite a possibly a priori performed component space transformation, or present because of having been introduced by such a priori performed component space transformation, for example, may readily be removed by way of the inter-component redundancy/correlation reduction of the second component signal.

Abstract: An image processing apparatus having a processor configured to: select a reference frame from a frame group including a plurality of images; acquire a reference correct answer frame representing a region of interest in the selected reference frame; generate a complementary correct answer frame corresponding to a frame other than the reference frame included in the frame group based on at least one reference correct answer frame; and generate a correct answer image group for machine learning from the reference correct answer frame and the complementary correct answer frame.

Abstract: A 360 image data processing method performed by a 360 video receiving device, according to the present invention, comprises the steps of: receiving 360 image data; acquiring information and metadata on an encoded picture from the 360 image data; decoding the picture on the basis of the information on the encoded picture; and rendering the decoded picture and an overlay on the basis of the metadata, wherein the metadata includes overlay-related metadata, the overlay is rendered on the basis of the overlay-related metadata, and the overlay-related metadata includes information on a region of the overlay.

Abstract: An image coding method according to the present document comprises the steps of: deriving transform coefficients for a current block on the basis of residual-related information; and generating residual samples of the current block on the basis of the transform coefficients. The residual-related information comprises low frequency non-separable transform (LFNST) index information, showing information relating to non-separable transform for low-frequency transform coefficients of the current block, on the basis of a matrix-based intra-prediction (MIP) flag showing whether or not MIP is applied to the current block. The residual samples are generated from the transform coefficients on the basis of the LFNST index information.

Abstract: Example systems and methods for virtual visualization of a three-dimensional (3D) model of an object in a two-dimensional (2D) environment. The method may include superimposing a first 3D model of an object onto the 2D environment, and replacing the first 3D model of the object with a second 3D model of an object. Further, the method may include superimposing a smart 3D model of an object onto the 2D environment. Additionally, the method may include a code or mark to identify images of the 2D environment to which 3D models of objects have been superimposed.

Abstract: According to an embodiment, an image projection device outputting an image to a screen comprises an input unit receiving an image from an outside, a sensor unit sensing a viewer's position and gaze direction, a controller correcting the received image into a preset model based on the viewer's position and gaze direction sensed by the sensor unit, and an output unit outputting the preset model.

Abstract: Various concepts for media content streaming are described. Some allow for streaming spatial scene content in a spatially unequal manner so that the visible quality for the user is increased, or the processing complexity or used bandwidth at the streaming retrieval site is decreased. Others allow for streaming spatial scene content in a manner enlarging the applicability to further application scenarios.

Abstract: An apparatus for stitching together multiple camera images to form a blended image having an output projection format. The apparatus is configured to convert each of the multiple camera images into the output projection format. It is configured to stitch together the converted images to form a single image. It is also configured to output the single image as the blended image having the output projection format.

Abstract: A video transmission method that includes predicting, from a texture picture or a depth picture of an anchor viewing position, a picture for a target viewing position on the basis of target viewing position information and processing a prediction error with respect to the predicted picture on the basis of a source picture of the target viewing position. An error-prone region map is generated on the basis of the predicted picture and the source picture. The video transmission method also includes patch packing the prediction error-processed picture on the basis of the error-prone region map and encoding the packed patch on the basis of the texture picture or the depth picture of the anchor viewing position.

Abstract: The present disclosure relates to an information processing apparatus and an information processing method that enable processing to be performed simply, and a program. By converting a point cloud representing a three-dimensional structure into two dimensions, a geometry image and a texture image, and three-dimensional information metadata required for constructing the geometry image and the texture image in three dimensions are obtained. Then, one PC sample included in a Point Cloud displayed at a specific time is generated by storing the geometry image, the texture image, and the three-dimensional information metadata in accordance with a playback order required at a time of reproducing and playing back the geometry image and the texture image in three dimensions on the basis of the three-dimensional information metadata. It is possible to apply to a data generation device that generates data for distribution of a Point Cloud.

Abstract: Techniques are described enabling users to transfer the association of a cloud-managed video encoding or decoding device from one region of a cloud provider network to another. A video processing service of a cloud provider network enables users to purchase video encoding or decoding devices that can be used to encode and reliably transfer video content to the video processing service from locations of the users' choice. The video processing service receives a request to transfer the association of a video encoding or decoding device from one region of the cloud provider to another and the video processing service executes workflows that enable the association of a video encoding or decoding device to be transferred to one region from another.

Abstract: Various concepts for media content streaming are described. Some allow for streaming spatial scene content in a spatially unequal manner so that the visible quality for the user is increased, or the processing complexity or used bandwidth at the streaming retrieval site is decreased. Others allow for streaming spatial scene content in a manner enlarging the applicability to further application scenarios.

Abstract: At lease a computer program product is provided for efficiently encoding or decoding a video frame. The computer program product when executed by one or more processors configures the one or more processors to compress or encode the different video subsections within the video frame with different compression methods. The visual artifact is reduced between the different video subsections encoded or compressed with the different compression methods within the video frame.

Abstract: Various concepts for media content streaming are described. Some allow for streaming spatial scene content in a spatially unequal manner so that the visible quality for the user is increased, or the processing complexity or used bandwidth at the streaming retrieval site is decreased. Others allow for streaming spatial scene content in a manner enlarging the applicability to further application scenarios.

Abstract: Disclosed are a method an electronic device and a computer storage medium for generating a video. The method includes: receiving a video generating instruction, wherein the video generating instruction is generated in response to a user operation on a video generating link on a video playback page; obtaining video templates based on the video generating instruction, where the video templates comprises a first video template, and the first video template is a template adopted by a current video shown on the video playback page; determining a target template based on the video template; and generating the video based on the target template.

Abstract: An optoelectronic sensor for detecting objects in a monitored zone is provided, wherein the sensor has a scanning unit that is movable about an axis of rotation and that has a plurality of scanning modules accommodated therein for a periodic scanning of the monitored zone and for a generation of corresponding received signals and that has a control and evaluation unit for acquiring information on the objects from the received signals; and wherein the scanning modules each comprise a light transmitter for transmitting a light beam and a light receiver for generating a respective received signal from the light beam remitted by the objects. A respective mirror element is here associated with the scanning modules to set an angle of elevation of a respective scanning plane detected by a scanning module with respect to a central scanning plane perpendicular to the axis of rotation.

Abstract: Disclosed herein is an immersive video processing method. The immersive video processing method includes: determining a priority order of pruning for source videos; extracting patches from the source videos based on the priority order of pruning; generating at least one atlas based on the extracted patches; and encoding metadata. Herein, a first flag indicating whether or not an atlas includes a patch including information on an entire region of a first source video may be encoded into the metadata.

Abstract: A method and a device provide for transmitting information representing a viewpoint in a 3D scene represented with a set of volumetric video contents; receiving a first volumetric video content of the set, the first volumetric video content being according to a range of points of view comprising the viewpoint, the first volumetric video content being represented with a set of first patches, each of which corresponds to a 2D parametrization of a first group of points in a 3D part of the 3D scene associated with the first volumetric video content, and at least one first patch refers to an area of a second patch corresponding to a 2D parametrization of a second group of points in another 3D part of the 3D scene associated with a second volumetric video content of the set of volumetric video contents.

Abstract: A system is provided for efficiently encoding and decoding a video frame with different subsections to improve and reduce visual distortion. The system comprises an encoder for encoding the different video subsections within the video frame with different compression methods. The system also comprises a correspond decoder for decoding the encoded video frame by the encoder. Therefore, the visual distortion is reduced between the different video subsections encoded with the different compression methods.

Abstract: A method for processing an image, which is performed by an image processing apparatus, is provided. The method includes acquiring a first image including an object and a second image including an object identical to the object in the first image under the same condition, acquiring three-dimensional direction information of a specific part of the object in the first image, and providing a three-dimensionally processed image by three-dimensionally rotating the object in the second image by an angle that corresponds to the acquired three-dimensional direction information of the specific part of the object in the first image.

Abstract: Various concepts for media content streaming are described. Some allow for streaming spatial scene content in a spatially unequal manner so that the visible quality for the user is increased, or the processing complexity or used bandwidth at the streaming retrieval site is decreased. Others allow for streaming spatial scene content in a manner enlarging the applicability to further application scenarios.

Abstract: A method of generating a representation of a virtual environment includes obtaining a mesh of at least part of the virtual environment; detecting the continuous and non-overlapping portions of that mesh, hereafter ‘patches’; populating a texture map with representations of the patches by, for successive patches in order of large to small, identifying a position on the texture map where a current patch meets a non-overwrite criterion, wherein the a non-overwrite criterion requires that texels corresponding to the current patch do not overwrite texels of any previously positioned patch, and successive positions for each current patch are tested at intervals starting from a common origin position; and associating the current patch with the identified position; setting colour values for the texels of the texture map responsive to colour information corresponding to the obtained mesh; and outputting the obtained mesh and texture map for use by a third party.

Abstract: Devices, systems, and methods for digital video coding, which includes matrix-based intra prediction methods for video coding, are described. In a representative aspect, a method for video processing includes determining, for encoding a current video block of a video into a bitstream representation of the current video block, a type of neighboring samples of the current video block to be used according to a rule, and adding, based on the determining, an encoded representation of the current video block to the bitstream representation, where the current video block is encoded using a matrix based intra prediction (MIP) mode in which a prediction block of the current video block is determined by performing, on previously coded samples of the video, a boundary downsampling operation, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation.

Abstract: A computerized method for transmitting one or more video streams, the method may include receiving at least one input video stream that comprises visual information obtained from multiple fields of view that differ from each other; converting the at least one input video stream to a group of encoded independent self-contained video streams (EISCVSs), by performing a codec-agnostic process; wherein different EISCVSs comprise visual information from different spatial segments of the at least one input video stream; receiving a first request to receive video information related to a first direction related to a first user; generating a first video stream that comprises a first sub-set of EISCVSs that is related to the first direction; and sending the first video stream to a device of the first user, over a first communication link that has a first bandwidth that is lower than a bandwidth required to convey the input video stream.

Abstract: A method of decoding video data includes decoding, from a coded video bitstream and as an unsigned integer 0-th order Exp-Golomb-coded syntax element with the left bit first, a value that specifies a target recovery point picture for a current picture of a current sequence of pictures, wherein the target recovery point picture is located at or after the current picture in display order; and recovering decoding of the current sequence of pictures at the target recovery point picture.

Abstract: A method of processing video data includes determining, by processing circuitry, a plurality of neighboring samples for predicting a current block. The plurality of neighboring samples are arranged outside of a region of a current picture, the region comprising the current block, a row of samples adjacent to a top row of the current block, and a column of samples adjacent to a left column of the current block. The method further comprises deriving, by the processing circuitry, local illumination compensation information for the current block using the plurality of neighboring samples and generating, by the processing circuitry, a prediction block using the local illumination compensation information.

Abstract: High frame rate image data having backward compatibility is favorably transmitted. Image data of each picture of a base layer included in a base stream sent from a transmission side has been subjected to a mixing process in a linear space or a non-linear space. On a reception side, the inverse mixing process can be performed appropriately by performing in a corresponding space on the basis of processing space information indicating whether or not the mixing process is performed in the linear space or the non-linear space.

Abstract: A camera, including: two imaging systems each comprising a different optical path corresponding to a different viewing angle of an object; one or more illumination sources; a mask disposed with multiple pairs of apertures, wherein each aperture of each aperture pair corresponds to a different one of the imaging systems; at least one detector configured to acquire multiple image pairs of the object from the two imaging systems via the multiple pairs of apertures; and a processor configured to produce from the multiple acquired image pairs a multi-layer three dimensional reconstruction of the object.

Abstract: A system performs image stabilization of a display in a vehicle, in particular a motor vehicle. The system includes at least one display, in particular a monitor, for visualization; at least one sensor, in particular an acceleration sensor; and a computer unit, in particular an on-board computer. The system is designed to detect, by way of the sensor, a shock to the vehicle, in particular as a result of unevenness of the roadway, and to carry out on the basis thereof, a compensation calculation by use of the computer unit and to output a correction signal to the display, in order to stabilize the visualization on the display.

Abstract: At least a method and an apparatus are provided for efficiently encoding or decoding a video frame to smooth out or reduce visual distortions such as mosquito noise between different video subsections encoded with different compression methods within a video frame. For example, a plurality of surrounding neighboring video subsections of the video frame are compressed using a first compression method (e.g., inter coding), with an associated first compression parameter set. The center video subsection of the video frame is twice compressed, first with the same first compression method, then with a different, second compression method (e.g., intra coding). Therefore, the mosquito noise or visual artifact is reduced between the video subsections encoded with the different compression methods.

Abstract: A communication terminal device is a glasses-type communication terminal device having an optically transmissive display mounted thereon. The communication terminal device includes first and second radio-frequency modules that perform radio-frequency signal processing and a baseband module that is connected to the first and second radio-frequency modules via communication lines so as to be communicable and that performs baseband signal processing. The first and second radio-frequency modules are selectively switched by the baseband module to perform a reception operation. When the first radio-frequency module performs the reception operation, a reception signal received by the first radio-frequency module is retransmitted from the second radio-frequency module.

Abstract: According to one embodiment, a measurement method includes: acquiring a first picture including a background image and a substance, the substance allowing transmission of light from the background image; acquiring a second picture including the background image and the substance in a different positional relation with respect to the first picture; and calculating a first displacement amount representing a difference in position of the background image between the first picture and the second picture.

Abstract: An image pickup apparatus, image processing apparatus and corresponding program and method are disclosed. In one example, a second captured image acquired from another apparatus is aligned with a first captured image. Image stabilization is carried out in response to a positional relation between the captured images. For example, when overlapping between the captured images is equal to or smaller than an image stabilization limitation threshold value, the image stabilization is stopped or a correction range is limited for at least one of the captured images. When the amount of overlapping is larger than the image stabilization limitation threshold value, the image stabilization for both of the captured images is carried out without limitation. The captured images are aligned with each other by using the captured image with limited image stabilization, or both captured images where stabilization is carried out without limitation, thereby producing a panoramic image.

Abstract: The disclosed technology presents a device and a method, respectively, for generating an augmented reality (AR) image (or AR video). The device configures to obtain a first image of a scene, obtain a second image of an object, obtain a depth range, and capture a third image of only the parts of the scene inside the depth range. Further, the device configures to generate occlusion information based on the third image, and overlay the first image and the second image based on the occlusion information to generate the AR image.

Abstract: A three-dimensional geometry measurement apparatus includes: a relationship identification part that identifies a combination of a first imaging pixel and a second imaging pixel corresponding to the same projection coordinate; a determination part that determines, whether or not at least one of the first imaging pixel or the second imaging pixel is a defective pixel on the basis of a distance between a projection pixel of the projection image; and a geometry measurement part that measures a geometry of an object to be measured using the first imaging pixel or the second imaging pixel corresponding to the combination, for which the first imaging pixel and the second imaging pixel that are determined to be not the defective pixel.

Abstract: There is provided an image encoding/decoding method and apparatus. The image encoding method of the present invention includes: generating at least one candidate block including warped reference picture (WRP) Flag information in an advanced motion vector prediction (AMVP) mode; constructing a candidate list including the at least one candidate block; and generating a prediction block of a current block based on the candidate list.

Abstract: A method of decoding an encoded video bitstream using at least one processor, including: obtaining from the encoded video bitstream a coded video sequence including a picture unit corresponding to a coded picture; obtaining a picture header (PH) network abstraction layer (NAL) unit included in the picture unit; obtaining at least one video coding layer (VCL) network abstraction layer (NAL) unit included in the picture unit; decoding the coded picture based on the PH NAL unit, the at least one VCL NAL unit, and an adaptation parameter set (APS) included in an APS NAL unit obtained from the coded video sequence; and outputting the decoded picture, wherein the APS NAL unit is available to the at least one processor before the at least one VCL NAL unit.

Abstract: A position estimation apparatus, a tracker, a position estimation method, and a program which enable estimation of the position or orientation of each of plural trackers in a common coordinate system are provided. A point cloud storage section (80) stores a common point cloud with positions expressed using a common coordinate system. A position estimation section (86) estimates the position or orientation of a first tracker in the common coordinate system on the basis of the common point cloud and first feature point data. The position estimation section (86) estimates the position or orientation of a second tracker in the common coordinate system on the basis of the common point cloud and second feature point data.

Abstract: Provided is a scalable video-decoding method based on multiple layers. The scalable video-decoding method according to the present invention comprises: a step of predicting first filter information of a video to be filtered using the information contained in an object layer and/or information contained in another layer, and generating second filter information in accordance with the prediction; and a step of filtering the video to be filtered using the second filter information. According to the present invention, the amount of information being transmitted is reduced, and video compression performance is improved.