Abstract: The present invention relates to an encoding method and decoding method, and a device using the same. The encoding method according to the present invention comprises the steps of: specifying an intra prediction mode for a current block; and scanning a residual signal by intra prediction of the current block, wherein the step of scanning the residual signal can determine a scanning type for a luminance signal and a chroma signal of the current block according to an intra prediction mode for a luminance sample of the current block.

Abstract: Aspects of the disclosure provide methods and apparatuses for video processing. In some examples, an apparatus for video processing includes processing circuitry. For example, processing circuitry determines a frame interval for a current block in a current frame within a sequence of frames. The frame interval indicates a group of frames in the sequence of frames with collocated blocks of the current block that satisfy an error metric requirement comparing to the current block. Further, the processing circuitry determines a replacement block based on the collocated blocks in the group of frames, and replaces the current block in the current frame with the replacement block.

Abstract: Improved video coding and decoding techniques are described, including techniques to derive quantization step sizes adaptively with quantization step size table templates. Quantization techniques described provide finer-grained control over quantization with a more flexible quantization step size especially at higher degrees of quantization. This may result in improved overall compression quality. Other coding parameters, such as in-loop filtering parameters, may be derived based on the more flexible quantization parameters.

Abstract: Method and apparatus for constrained de-blocking filter are disclosed. One method receives input data related to a current block in a current picture at a video encoder side or a video bitstream corresponding to compressed data including the current block in the current picture at a video decoder side, and determines a first boundary associated with the current block, wherein the first boundary corresponds to one vertical boundary or one horizontal boundary of the current block. The method then applies de-blocking process to a reconstructed current block corresponding to the current block to result in a filtered-reconstructed current block, using a plurality of first reference samples at a same side of the first boundary, and replaces a first set of the first reference samples by one or more padding values. The method then generates a filtered decoded picture including the filtered-reconstructed current block.

Abstract: Input/output filter units for use in a graphics processing unit include a first buffer configured to store data received from, and output to, a first component of the graphics processing unit; a second buffer configured to store data received from, and output to, a second component of the graphics processing unit; a weight buffer configured to store filter weights; a filter bank configurable to perform any of a plurality of types of filtering on a set of input data, the plurality of types of filtering comprising one or more texture filtering types and one or more pixel filtering types; and control logic configured to cause the filter bank to: (i) perform one of the plurality of types of filtering on a set of data stored in one of the first and second buffers using a set of weights stored, and (ii) store the results of the filtering in one of the first and second buffers.

Abstract: A scaling unit (30) (quantization processing unit) quantizes a coding target image divided into blocks. A coefficient determination unit (47) (coefficient change unit) changes a coefficient value in a specific frequency range among quantization coefficients corresponding to respective sub-blocks calculated by the scaling unit (30) by quantization. Thus, the image coding device (10) determines a final position of a coefficient just by counting the number of appearances of non-zero coefficients, and thus corrects the quantization coefficients without correcting coding distortion by iterative operation.

Abstract: By the moving picture coding method and the moving picture decoding method, it is possible to improve coding efficiency. The moving picture coding apparatus includes a merge block candidate calculation unit that (i) specifies merge block candidates at merge mode, by using colpic information such as motion vectors and reference picture index values of neighbor blocks of a current block to be coded and a motion vector and the like of a collocated block of the current block which are stored in a colPic memory, and (ii) generates a combined merge block by using the merge block candidates.

Abstract: Various schemes for realizing efficient in-loop filtering are described, manifested in low latency and reduced hardware cost for an in-loop filter comprising at least two filtering stages. An apparatus receives pixel data of a current block of a picture and one or more neighboring blocks thereof, based on which the apparatus performs a filtering operation and generates a filtered block that includes completely filtered sub-blocks and partially filtered sub-blocks. The apparatus further outputs an output block that includes the completely filtered sub-blocks as well as a respective portion of each of the partially filtered sub-blocks, wherein the respective portion is adjacent to one of the completely filtered sub-blocks.

Abstract: An image coding method includes: deriving a candidate for a motion vector of a current block from a co-located motion vector; adding the candidate to a list; selecting the motion vector of the current block from the list; and coding the current block, wherein the deriving includes: deriving the candidate by a first derivation scheme in the case of determining that each of a current reference picture and a co-located reference picture is a long-term reference picture; and deriving the candidate by a second derivation scheme in the case of determining that each of the current reference picture and the co-located reference picture is a short-term reference picture.

Abstract: A method of video processing includes determining a target bitrate for a current video unit of a video that is based on a rate distortion function in which a rate portion is weighted using lambda, wherein lambda is a rational number and wherein lambda is an adaptively adjusted for each video unit of the video and performing a conversion between the current video unit and a bitstream of the video.

Abstract: A method for a video encoder includes steps of: receiving a series of input frames; performing at least one of intra-prediction and inter-prediction on the series of input frames for generating at least one of an intra frame (I-frame), a predictive frame (P-frame), and a key predictive frame (key P-frame); generating an encoded bitstream with respect to a first input frame determined as the I-frame among the series of input frames; and performing inter-prediction on a second input frame determined as a key P-frame among the series of input frames according to a first reference frame which is derived from the encoded bitstream with respect to the first input frame.

Abstract: A transcoding process may be performed in parallel, which may include different nodes processing different segments of a media file at different times. Different time slices of media files may have different properties, which may lead to errors when media files are encoded for later playback. Extracting metadata from frames of media files and evaluating the frames for discrepancies enables creation of a reconciliation manifest to correct discrepancies associated with the media file. As the transcoding process is performed, the reconciliation manifest may be reference to generate an output media file.

Abstract: Various embodiments of an automated adaptive bitrate (“ABR”) encoding system and method that encodes an input video into a set of encoded video streams for ABR delivery, also known as an ABR ladder. The automated ABR encoding system encodes the input video into an initial number of speculative encodings, based on respectively determined resolution and quality level settings for the individual speculative encodings. It then estimates quality scores for a plurality of potential output encodings based on respective output statistics of the speculative encodings. It selects a plurality of better quality output encodings from the plurality of potential output encodings based on the quality scores. It then encodes the input video a second time into the plurality of better quality output encodings. The automated ABR encoding system selects one or more output encodings from the plurality of better quality output encodings to include in the ABR ladder.

Abstract: The method for intra frame prediction allows for the recovery of some intra directional modes that are otherwise rendered useless due to the classical padding process. Directional modes are recovered by filling pixel locations in the prediction unit with samples from the portion of the unit that is determined to have samples available for use using a counterpart directional mode to the one that is useless. When it is determined that reference samples are missing for a particular prediction unit or portion thereof given a particular directional mode, a determination is made about whether reference samples along another portion of the prediction unit are available. The other portion is the side of the prediction unit at an opposite end of the particular directional mode.

Abstract: An image processing method includes extracting a first region in a first image by inputting the first image to a pretrained neural network, upscaling a resolution of the first region by performing neural network-based super resolution processing on the first region, and upscaling a resolution of a second region in the first image from which the first region is excluded by performing interpolation on the second region.

Abstract: Systems and methods are provided for cloud gaming. One system includes a plurality of computing resources in one or more data centers. The plurality of computing resources is configured to execute instances of games for client devices that are remote from the one or more data centers. Each instance for an executable game is associated with a processor, a graphics processing unit (GPU), and memory for storing video frames generated for the executable game. The video frames are compressed for video game streaming to one or more client devices. The executable game provides video and audio and receives input from said one or more client devices. The input is provided to control interactivity of the executable game during said video game streaming. The cloud gaming system uses said received input from said one or more client devices to drive instances of the executable game when executed by the computing resources of the one or more data centers.

Abstract: In one implementation, a method of encoding an image is performed at a device including one or more processors and non-transitory memory. The method includes determining a category of a spatial portion of an image based on a relation between a plurality of thresholds associated with a plurality of quantization scaling parameters and a bit rate of the spatial portion of the image at the plurality of quantization scaling parameters. The method includes quantizing the spatial portion of the image based on the categorization.

Abstract: Provided are a video encoding method and apparatus, an electronic device, and a computer-readable storage medium. The method includes: acquiring status information of each macroblock in an image to be encoded; dividing the image to be encoded into a plurality of status regions according to the status information of each macroblock; determining a quantizer parameter adjustment value of each of the plurality of status regions in the image to be encoded according to a preset quantizer parameter value table; acquiring a quantizer parameter encoding value of each macroblock in a reference frame image of the image to be encoded; determining a quantizer parameter encoding value of each macroblock in the image to be encoded; and compressing and encoding the image to be encoded.

Abstract: Systems and methods of adaptive streaming are discussed. Transcoded copies of a source stream may be aligned with one another such that the independently specified portions of each transcoded stream occur at the same locations within the content. These transcoded copies may be produced by one or more transcoders, whose outputs are synchronized by a delay adjuster. A fragmenter may use the synchronized and aligned streams to efficiently produce fragments suitable for use in adaptive streaming.

Abstract: Disclosed is user authentication. A user authentication method includes receiving a plurality of images including at least one object, extracting biological information from the plurality of images, performing user authentication based on a difference between the extracted biological information and biological information of a user stored in a memory, and updating a parameter of a learning model for the user authentication when a result of the execution of the user authentication satisfies a preset condition. The mobile terminal and the AI system of the present disclosure may be associated with an artificial intelligence module, a drone (or unmanned aerial vehicle (UAV)), a robot, an augmented reality (AR) device, a virtual reality (VR) device, a device related to 5G service, etc.

Abstract: A method of processing an image for improving image quality is provided. The method includes inputting an image into a first artificial neural network as an input variable to create a feature map and inputting an image into a second artificial neural network as an input variable to create an estimated class probability distribution map for each of frequency channels. Further, the method may comprise determining a class for each of the frequency channels on the basis of a probability distribution included in the estimated class probability distribution map, creating an estimated class map that includes a determined class, converting the estimated class map into an estimated frequency map, combining the estimated frequency map with the feature map to create a combined feature map, and inputting the combined feature map into a third artificial neural network as an input variable to create an output image.

Abstract: Aspects of the disclosure provide methods, apparatuses, and non-transitory computer-readable storage mediums for video encoding/decoding. An apparatus includes processing circuitry that partitions a current block of a current picture based on a geometric partitioning mode (GPM). The current block is partitioned into two partitions in the GPM mode. Each of the partitions is associated with a respective predictor. A weighting index for a sample of the current block is determined based on a position of the sample. A weighting factor is calculated based on the weighting index of the sample according to an equation that converts the weighting index to the weighting factor. The sample is encoded based on the weighting factor and the predictor corresponding to the sample.

Abstract: Systems, methods, and instrumentalities are disclosed relating to intra prediction of a video signal based on mode-dependent subsampling. A block of coefficients associated with a first sub block of a video block, one or more blocks of coefficients associated with one or more remaining sub blocks of the video block, and an indication of a prediction mode for the video block may be received. One or more interpolating techniques, a predicted first sub block, and the predicted sub blocks of the one or more remaining sub blocks may be determined. A reconstructed first sub block and one or more reconstructed remaining sub blocks may be generated. A reconstructed video block may be formed based on the prediction mode, the reconstructed first sub block, and the one or more reconstructed remaining sub blocks.

Abstract: Method and apparatus for constrained de-blocking filter are disclosed. One method receives input data related to a current block in a current picture at a video encoder side or a video bitstream determines a block boundary of the current block and sub-block boundaries inside the current block, wherein the current block is partitioned into a plurality of sub-blocks using sub-block mode prediction. The method then applies de-blocking process to a reconstructed current block corresponding to the current block to result in a current filtered-reconstructed block, wherein said applying the de-blocking process to the current block comprises applying the de-blocking process to the sub-block boundaries inside the current filtered-reconstructed block, and generates a filtered decoded picture including the current filtered-reconstructed block.

Abstract: According to the present invention, an image-encoding method comprises the following steps: receiving image information; generating a restored block for the current block based on the image information; and generating a finally restored block for the current block by applying an in-loop filter to the restored block on the basis of the image information. According to the present invention, image-encoding/decoding efficiency may be improved.

Abstract: A method for encoding complex-valued signals of a computer-generated hologram into a phase-modulating optical element for the reconstruction of a three-dimensional object, and to a computer program product for encoding complex-valued signals of a computer-generated hologram, and to a holographic display for the reconstruction of a three-dimensional object. The object is to reduce the effort on encoding a complex-valued spatial distribution by an iteration method on the basis of phase encoding, so that the computer-generated hologram resulting therefrom can be represented more rapidly and with the same or an improved reconstruction quality. In particular, the convergence during the iterative optimization is intended to be accelerated. This is achieved by a method in which degrees of freedom of the hologram plane as well as the reconstruction plane are used for optimizing the iteration method for rapid convergence and maximization of the diffraction efficiency in the signal range.

Abstract: A method and apparatus for indication of resource ports in a communication system, the method including: receiving at least one measurement resource from a second wireless communication node in a communication system; determining at least one overlapping resource between the at least one measurement resource and a first plurality of resource sets; and determining at least one muting resource set in the first plurality of resource sets, wherein the at least one muting resource set comprises the at least one overlapping resource.

Abstract: An image capture device for recording HDR (high dynamic range) image data obtained through image capture performs control so as to, when encoding HDR image data obtained by capturing an image with an image sensor, divide part of the HDR image data corresponding to a coding area to be encoded into a plurality of divided HDR image data, encode each of the plurality of divided HDR image data by using encoding means, and record the plurality of divided HDR image data that are encoded on a recording medium in a predetermined recording format.

Abstract: A method and device for encoding and a method and device for decoding a signal including encoded data representing an image sub-divided into blocks, and information representing a correction block and a residual block. For a current block of the image, a first pixel is encoded from a prediction value obtained for the first pixel from at least one pixel of a previously rebuilt block. The prediction is corrected using at least one value of a pixel of the correction block. At least one current pixel of the current block is encoded from a prediction value obtained for the current pixel from at least one previously corrected pixel of the current block. The prediction is corrected by using at least one value of a pixel of the correction block, delivering a prediction block for the current block. The residual block is computed from the current block and the predictive block.

Abstract: Sample data and metadata related to spatial regions in images may be received from a coded video signal. It is determined whether specific spatial regions in the images correspond to a specific region of luminance levels. In response to determining the specific spatial regions correspond to the specific region of luminance levels, signal processing and video compression operations are performed on sets of samples in the specific spatial regions. The signal processing and video compression operations are at least partially dependent on the specific region of luminance levels.

Abstract: An imaging system including an imaging device 501 and a recording server 502 communicatively connected to the imaging device 501, wherein the imaging device 501 includes an imaging unit 503 that generates a video with a plurality of resolution, a dividing unit 504 that performs a division process of dividing the video generated by the imaging unit 503 into one or a plurality of tile areas and generates a tile image, and a transmission unit 506 that transmits the video to the recording server 502, wherein the recording server 502 includes a division control unit 507 that outputs an instruction to change a division method for the division process to the imaging device according to a designation frequency of an area designated on the video transmitted from the imaging device 501.

Abstract: Still frame detection for single pass video data, including: determining that an average quantization parameter of a frame of video data falls below a quantization parameter threshold; determining whether an amount of skipped macroblocks in the frame meets a skipped macroblock threshold; and responsive to the amount of skipped macroblocks exceeding the skipped macroblock threshold, identifying the frame as a still frame.

Abstract: A method for decoding a video according to the present invention may comprise: determining an intra prediction mode of a current block, deriving reference samples from neighboring samples of the current block, obtaining a first prediction sample for the current block, based on the intra prediction mode and the reference samples, determining an offset for the first prediction sample, and obtaining a second prediction sample by applying the offset to the first prediction sample.

Abstract: A prediction method, apparatus, and a computer storage medium for decoding, the method includes: acquiring reference samples adjacent to at least one side of a decoding block; determining a reference point from the at least one side and determining reference sample positions to be selected corresponding to the at least one side according to a preset number of samples; selecting reference samples corresponding to the reference sample positions to be selected from the reference samples based on the reference sample positions to be selected; and performing prediction decoding on the decoding block based on the selected reference samples.

Abstract: A method for deriving a value for a first syntax element, Syntax_A. The method comprises determining whether Syntax_A is present in a bitstream. The method comprises, as a result of determining that Syntax_A is not present in the bitstream, deriving the value for Syntax_A to be equal to a first value, B, if a first condition is satisfied, or deriving the value for Syntax_A to be equal to a second value, C, if a second condition is satisfied.

Abstract: An image providing apparatus configured to generate, by using a first artificial intelligence (AI) network, AI metadata including class information and at least one class map, in which the class information includes at least one class corresponding to a type of an object among a plurality of predefined objects included in a first image and the at least one class map indicates a region corresponding to each class in the first image, generate an encoded image by encoding the first image, and output the encoded image and the AI metadata through the output interface.

Abstract: A video signal processing method comprises: a step for deriving an intra prediction mode of a current block; a step for constructing a reference sample around the current block; a step for generating a prediction sample of the current block by using the reference sample on the basis of the intra prediction mode; and a step for restoring the current block on the basis of the prediction sample. The step for generating the prediction sample may comprise: a step for setting a filter flag value which specifies a filter coefficient of an interpolation filter applied to the reference sample on the basis of the width and height of the current block; and a step for performing filtering on the reference sample by using the interpolation filter having the filter coefficient specified by the filter flag.

Abstract: An image encoding device and a method, and an image decoding device and a method that are designed to improve encoding efficiency in IntraBC. A screen is divided into four slices (Slices #0 through #3). In a case where reference to a different slice is prohibited, the range that can be referred to from the current CTU in Slice #2 is only the decoded portion in Slice #2, and therefore, any block in Slice #1 cannot be referred to, for example. In the case of the present technology, on the other hand, decoded different slices (Slice #0 and Slice #1) are included in the referable range, and accordingly, a block in Slice #1 can be referred to from the current CTU in Slice #2.

Abstract: An apparatus includes processing circuitry configured to decode coding information of a current block from a coded video bitstream. The coding information can indicate that a first prediction mode of the current block is one of a plurality screen content coding (SCC) tools. The processing circuitry can determine whether at least one loop filter associated with the current block is disabled based on at least one of the first prediction mode of the current block and a first quantization parameter (QP) of the current block. In response to the at least one loop filter being determined as disabled, the processing circuitry can reconstruct the current block without the at least one loop filter.

Abstract: A method and apparatus for reduction of reference data transfer and coding efficiency improvement. The method includes performing pre-analysis on a decimated version of an image, and utilizing the predictions of the pre-analysis to transfer smaller reference area.

Abstract: A computer-implemented method comprises receiving a first compressed representation of a texture map in a first compression format, wherein the first compressed representation has been compressed using a first compressor, and receiving an array of compression parameters for a second compressor, the array of compression parameters including one or more respective compression parameters for each of a plurality of pixel regions of the texture map. The method further comprises decompressing the first compressed representation of the texture map to obtain the texture map, and compressing, using the second compressor, the texture map to a second compressed representation in a second compression format, comprising compressing each of said plurality of pixel regions of the texture map in accordance with the respective one or more compression parameters.

Abstract: A system for processing gather and scatter instructions can implement a front-end subsystem, a back-end subsystem, or both. The front-end subsystem includes a prediction unit configured to determine a predicted quantity of coalesced memory access operations required by an instruction. A decode unit converts the instruction into a plurality of access operations based on the predicted quantity, and transmits the plurality of access operations and an indication of the predicted quantity to an issue queue. The back-end subsystem includes a load-store unit that receives a plurality of access operations corresponding to an instruction, determines a subset of the plurality of access operations that can be coalesced, and forms a coalesced memory access operation from the subset. A queue stores multiple memory addresses for a given load-store entry to provide for execution of coalesced memory accesses.

Abstract: Aspects of the disclosure include methods, apparatuses, and non-transitory computer-readable storage mediums for video encoding/decoding. An apparatus includes processing circuitry that determines reconstructed samples of a first color component in a filter support region of a current picture that is a part of a coded video sequence. The processing circuitry performs a filter process on the reconstructed samples of the first color component in the filter support region. A quantization step size of the filter process is separately set per one of a coding block, a video frame, and a video sequence. The processing circuitry reconstructs samples of a second color component in the filter support region based on an output value of the filter process. The second color component is different from the first color component.

Abstract: An encoded bitstream of entropy encoded video data is received by a video decoder. The encoded bitstream represents syntax elements of a sequence of coding blocks. The sequence of coding blocks is recovered by processing a bin sequences associated with each coding block in a processing pipeline, wherein a defined amount of time is allocated to process each coding block in the processing pipeline. The encoded bitstream is arithmetically decoded to produce each bin sequence. The arithmetic decoder is time-wise decoupled from the processing pipeline by storing a plurality of the bin sequences in a buffer memory.

Abstract: Techniques and tools for encoding enhancement layer video with quantization that varies spatially and/or between color channels are presented, along with corresponding decoding techniques and tools. For example, an encoding tool determines whether quantization varies spatially over a picture, and the tool also determines whether quantization varies between color channels in the picture. The tool signals quantization parameters for macroblocks in the picture in an encoded bit stream. In some implementations, to signal the quantization parameters, the tool predicts the quantization parameters, and the quantization parameters are signaled with reference to the predicted quantization parameters. A decoding tool receives the encoded bit stream, predicts the quantization parameters, and uses the signaled information to determine the quantization parameters for the macroblocks of the enhancement layer video. The decoding tool performs inverse quantization that can vary spatially and/or between color channels.

Abstract: The present disclosure provides embodiments for coding and decoding signs of transformation coefficients which is applicable, for instance, in image and/or video coding and decoding. In particular, a plurality of the signs are predicted and only a prediction error signal is embedded in the bitstream. The prediction error signal may have a distribution which can be efficiently coded with CABAC or another variable length (entropy) coding. In order to perform the prediction of the signs efficiently, the signs of a plurality of coefficients of a transformed image block are predicted based on a cost function including transformed difference between adjacent pixels neighboring the transformed image block and prediction of the adjacent pixels calculated based on a prediction signal of the image block.

Abstract: Systems and methods for compression and/or unification of statistical analysis system (SAS) data is provided. In one embodiment, a request to open a unified and compressed statistical analysis system (SAS) view file is received. The unified and compressed SAS data step view file including: an SAS data step view; compressed payload data to be used in the SAS data step view when decompressed; and a set of metadata describing characteristics of variables of the SAS data step view. Upon receiving the request, the compressed payload data is automatically decompressed, such that compressed payload data is decompressed and usable with the SAS data step view to render the SAS data step view and decompressed payload data on an electronic display of a client or host providing the request.

Abstract: Aspects for vector operations in neural network are described herein. The aspects may include a vector caching unit configured to store a first vector and a second vector, wherein the first vector includes one or more first elements and the second vector includes one or more second elements. The aspects may further include one or more adders and a combiner. The one or more adders may be configured to respectively add each of the first elements to a corresponding one of the second elements to generate one or more addition results. The combiner may be configured to combine a combiner configured to combine the one or more addition results into an output vector.

Abstract: Methods and systems for storing data include compressing data inflated from a first compression format into a second format using a processor and verifying contents of the data concurrently with compressing the data. Compression is aborted responsive to a failure of the content verification, but an output of the compression is stored to a tape drive until the compression is aborted. The tape drive is rolled back to a file start position after the compression is aborted and compression of any remaining uncompressed data is skipped after the compression is aborted. The data is stored to the tape drive after rolling the tape drive back.

Abstract: An input image is partitioned into a plurality of image regions based on color and color differences. The partitioning comprises assigning a color difference value to plurality of locations within the input image. The partitioning further comprises assigning each of the plurality of locations to an image region of the plurality of image regions, where the assigning occurs according to a particular order. The particular order is based at least in part on color difference values associated with the plurality of locations. The input image may comprise markup. Data representing at least a particular portion of the markup in the input image based on the partitioning is identified. Data representing at least the portion of the markup may be used in a visualization of a customizable product or a manufacturing control associated with a customizable product.