Abstract: This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.

Abstract: An example device includes memory configured to store the video data and one or more processors implemented in circuitry and communicatively coupled to the memory. The one or more processors are configured to determine at least one of a temporal candidate or a history-based candidate and determine at least one non-adjacent candidate, wherein the at least one non-adjacent candidate is from a unit that is not adjacent to a current prediction unit (PU). The one or more processors are configured to determine an advanced motion vector predictor (AMVP) candidate list including the at least one of the temporal candidate or the history-based candidate and the at least one non-adjacent candidate. The at least one non-adjacent candidate is added to the AMVP candidate list after the temporal candidate or before the history-based candidate. The one or more processors are configured to code the current PU based on the AMVP candidate list.

Abstract: The present disclosure relates to improvement on overlapped block motion compensation. A method for video processing comprises: determining, during a conversion between a current block and a bitstream representation of the current block, a motion vector for a first sub-block inside the current block; using overlapped block motion compensation (OBMC) mode to perform the conversion; wherein the OBMC mode uses intermediate prediction values of the first sub-block based on the motion vector of the first sub-block and prediction values of at least a second video unit that is neighboring the first sub-block to generate final prediction values for the first sub-block; wherein a sub-block size of the first sub-block is based on block size, block shape, motion information, or reference picture of the current block.

Abstract: A server device includes one or more processors. The processors receive a plurality of transmission data from a transmitting device. The processors divide the plurality of transmission data into first data and second data. The processors transmit the first data to an external server device that delivers transmission data to a receiving device. The processors store the second data in a storage. The processors receive a transmission request for the second data from the receiving device or the external server device. The processors transmit the second data to the external server device in response to the transmission request.

Abstract: Tracking-based motion deblurring via coded exposure is provided. Fast object tracking is useful for a variety of applications in surveillance, autonomous vehicles, and remote sensing. In particular, there is a need to have these algorithms embedded on specialized hardware, such as field-programmable gate arrays (FPGAs) or application-specific integrated circuits (ASICs), to ensure energy-efficient operation while saving on latency, bandwidth, and memory access/storage. In an exemplary aspect, an object tracker is used to track motion of one or more objects in a scene captured by an image sensor. The object tracker is coupled with coded exposure of the image sensor, which modulates photodiodes in the image sensor with a known exposure function (e.g., based on the object tracking). This allows for motion blur to be encoded in a characteristic manner in image data captured by the image sensor. Then, in post-processing, deblurring is performed using a computational algorithm.

Abstract: Methods and systems for canvas size scalability across the same or different bitstream layers of a video coded bitstream are described. Offset parameters for a conformance window, a reference region of interest (ROI) in a reference layer, and a current ROI in a current layer are received. The width and height of a current ROI and a reference ROI are computed based on the offset parameters and they are used to generate a width and height scaling factor to be used by a reference picture resampling unit to generate an output picture based on the current ROI and the reference ROI.

Abstract: An encoder determines, based on a width and a height of a block, whether or not to disable a prediction mode in which the block is split along a partitioning line defined by a distance and an angle and then prediction is performed; and encodes the block with the prediction mode disabled or not disabled according to a result of the determination on whether or not to disable the prediction mode. Here, the distance is the shortest distance between the center of the block and the partitioning line, and the angle is an angle representing a direction from the center of the block toward the partitioning line in the shortest distance. The encoder determines to disable the prediction mode when (i) a width-to-height ratio is at least 8 or (ii) a height-to-width ratio is at least 8.

Abstract: Welding headwear comprises one or more image sensors, processing circuitry, and a display. The image sensor(s) are operable to capture an image of an unpowered weld torch as the torch passes along a joint of a workpiece to be welded. The processing circuitry is operable to: determine, through processing of pixel data of the image, one or more welding parameters as the torch passes along the joint to be welded; generate, based on the one or more welding parameters, a simulated weld bead; and superimpose on the image, in real time as the torch passes along the joint, the simulated weld bead on the joint. The display is operable to present, in real time as the torch passes along the joint, the image with the simulated bead overlaid on it.

Abstract: A method includes performing a conversion between a video including at least one video picture and a bitstream of the video according to a rule, wherein the at least one video picture includes one or more slices and one or more subpictures, and wherein the rule specifies that an order of slice indices of the one or more slices in the at least one video picture is indicated responsive to a syntax element associated with the at least one picture indicative of whether a single slice is included per subpicture of the at least one video picture.

Abstract: The present invention is intended to permit both real-time display of a picture represented by a non-compressed video signal on a television and display of a picture represented by a compressed video signal at any desired time by simultaneously transmitting the compressed video signal and non-compressed video signal via one interface. An STB packetizes a compressed video signal, and multiplexes the compressed video signal and a blanking signal combined with a non-compressed video signal. Thus, both the video signals are transmitted simultaneously. A picture represented by the non-compressed video signal is displayed on a television in real time. The compressed video signal is stored in a storage medium incorporated in the television, read at any user's desired time, and decoded so that a picture represented by the compressed video signal can be viewed at the user's desired time.

Abstract: An encoder determines, based on a width and a height of a block, whether or not to disable a prediction mode in which the block is split along a partitioning line defined by a distance and an angle and then prediction is performed; and encodes the block with the prediction mode disabled or not disabled according to a result of the determination on whether or not to disable the prediction mode. Here, the distance is the shortest distance between the center of the block and the partitioning line, and the angle is an angle representing a direction from the center of the block toward the partitioning line in the shortest distance. The encoder determines to disable the prediction mode when (i) a width-to-height ratio is at least 8 or (ii) a height-to-width ratio is at least 8.

Abstract: A video image encoding device, in a first mode, variable-length-encodes a residual coefficient to generate a coefficient code string, outputs the coefficient code string and the header information in a state in which the header information is associated with the coefficient code string, in a second mode, directly uses a differential image as a coefficient code string without variable-length-encoding the differential image, and outputs the coefficient code string and the header information in a state in which the header information is associated with the coefficient code string.

Abstract: Embodiments are described which exploit a finding, according to which a higher compression rate or better rate/distortion ratio may be achieved by adopting or predicting second coding parameters used for encoding a second view of the multi-view signal from first coding parameters used in encoding a first view of the multi-view signal. In other words, the inventors found out that the redundancies between views of a multi-view signal are not restricted to the views themselves, such as the video information thereof, but that the coding parameters in parallelly encoding these views show similarities which may be exploited in order to further improve the coding rate.

Abstract: A method performed by a video encoder for encoding a current picture belonging to a temporal level identified by a temporal_id. The method includes determining a Reference Picture Set (RPS) for the current picture indicating reference pictures that are kept in a decoded picture buffer (DPB) when decoding the current picture, and when the current picture is a temporal switching point. The method further includes operating to ensure that the RPS of the current picture includes no picture having a temporal_id greater than or equal to the temporal_id of the current picture.

Abstract: Methods, systems, apparatuses for video processing are described. A method for processing video includes performing a conversion between a video and a bitstream of the video according to a format rule, and wherein the format rule specifies to include, in a general constraint syntax structure associated with the video, one or more general constraint flags indicating whether corresponding syntax elements are included in a sequence parameter set (SPS) and/or a picture parameter set (PPS) and/or a picture header (PH) and/or a slice header (SH) or to constrain values of the syntax elements in the SPS and/or the PPS and/or the PH and/or the SH.

Abstract: Aspects of the disclosure provide methods, apparatuses, and non-transitory computer-readable storage mediums for video encoding/decoding. In a method, whether an adaptive color transform (ACT) is enabled for a current block is determined. A maximum transform size is determined based on whether the ACT is enabled for the current block. Whether a subblock transform (SBT) is applied to the current block is determined based at least on the maximum transform size. Further, the SBT is performed on the current block based on the SBT being determined to be applied to the current block.

Abstract: An encoder determines, based on a width and a height of a block, whether or not to disable a prediction mode in which the block is split along a partitioning line defined by a distance and an angle and then prediction is performed; and encodes the block with the prediction mode disabled or not disabled according to a result of the determination on whether or not to disable the prediction mode. Here, the distance is the shortest distance between the center of the block and the partitioning line, and the angle is an angle representing a direction from the center of the block toward the partitioning line in the shortest distance. The encoder determines to disable the prediction mode when (i) a width-to-height ratio is at least 8 or (ii) a height-to-width ratio is at least 8.

Abstract: A method for encoding an image using intra prediction can include determining an intra prediction mode of a current block; generating a mode group indicator and a prediction mode index; constructing a most probable mode (MPM) group including three intra prediction modes determined using a left and an above intra prediction mode of the current block; determining whether all reference pixels of the current block are available; generating reference pixels if one or more reference pixels of the current block are unavailable; adaptively filtering the reference pixels based on the intra prediction mode and the size of the current block, wherein if the size of the current block is 4×4, the reference pixels are not filtered, and if the size of the current block is larger than 4×4, the number of intra prediction mode where the reference pixels are filtered increases as the current block becomes larger; generating the prediction block using the reference pixels.

Abstract: The disclosure relates to an artificial intelligence (AI) system that uses a machine learning algorithm and an application thereof. A method for controlling an electronic apparatus according to the disclosure includes receiving image data and information associated with a filter set that is applied to an artificial intelligence model for upscaling the image data from an external server; decoding the image data; upscaling the decoded image data using a first artificial intelligence model that is obtained based on the information associated with the filter set; and providing the upscaled image data for output.

Abstract: An encoder may generate, for each of a plurality of block vectors, an intra block compensated prediction of a block. The encoder may select, based on the intra block compensated predictions of the block, a block vector from the plurality of block vectors for the block. The encoder may determine affine transform parameters of the intra block compensated prediction for the block vector. The encoder may signal, in a bit stream, both of an indication of an affine transform of the intra block compensated prediction and the affine transform parameters based on a residual determined for the intra block compensated prediction generated for the block vector and a value of the affine transform parameters.