Abstract: A method of rate control of a display device includes receiving compressed stress data for a slice of a display, decompressing the compressed stress data to obtain reconstructed stress data for the slice, adding additional stress data to the reconstructed stress data to obtain updated stress data for the slice, encoding the updated stress data at a first precision level (pc) to generate first updated compressed stress data for the slice, in response to a size (bc) of the first updated compressed stress data for the slice of the display exceeding a size (bt) of a buffer, determining a second precision level (p) based on the first precision level (pc), a third precision level (ps) of the additional stress data, and a fourth precision level (pb) of the buffer, and encoding the updated stress data at the second precision level (p) to generate second updated compressed stress data.

Abstract: Innovations in adaptive encoding of screen content based on motion type are described. For example, a video encoder system receives a current picture of a video sequence. The video encoder system determines a current motion type for the video sequence and, based at least in part on the current motion type, sets one or more encoding parameters. Then, the video encoder system encodes the current picture according to the encoding parameter(s). The innovations can be used in real-time encoding scenarios when encoding screen content for a screen sharing application, desktop conferencing application, or other application. In some cases, the innovations allow a video encoder system to adapt compression to different characteristics of screen content at different times within the same video sequence.

Abstract: The present technology relates to an encoding device, an encoding method, a reproduction device, a reproduction method, and a program enabling each reproduction equipment to reproduce an appropriate content in a simplified manner. A content data decoding unit decodes encoded metadata and outputs zoom area information, which is included in metadata acquired as a result thereof, designating an area to be zoomed. A zoom area selecting unit selects one or a plurality of pieces of zoom area information from among the zoom area information. A video segmenting unit segments a zoom area represented by the selected zoom area information in a video based on video data and outputs zoom video data acquired as a result thereof. An audio converting unit performs an audio converting process according to the selected zoom area information for audio data and outputs zoom audio data acquired as a result thereof. The present technology can be applied to a reproduction device.

Abstract: Approaches for dynamically allocating compute capacity for processing a video stream. Video complexity information for two or more digital video streams actively being processed by one or more video encoders is determined at periodic intervals. Video complexity information describes the complexity of digital video carried by the digital video streams across a bounded number of consecutive digital frames which includes digital frames not yet processed by the one or more video encoders. A determination is made as to whether the compute capacity allocated for processing a particular digital video stream should be adjusted in some manner based on the determined video complexity information. The amount of compute capacity allocated for processing the particular digital video stream may be dynamically adjusted in response to maximizing a measure of optimal video quality calculated for the two or more digital video streams using, at least in part, the determined video complexity information.

Abstract: This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.

Abstract: This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.

Abstract: This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.

Abstract: Embodiments of the subject matter described herein relate to a wireless programmable media processing system. In the media processing system, a processing unit in a computing device generates a frame to be displayed based on a graphics content for an application running on the computing device. The frame to be displayed is then divided into a plurality of block groups which are compressed. The plurality of compressed block groups are sent to a graphics display device over a wireless link. In this manner, both the generation and the compression of the frame to be displayed may be completed at the same processing unit in the computing device, which avoids data copying and simplifies processing operations. Thereby, the data processing speed and efficiency is improved significantly.

Abstract: A method for processing video comprises storing, at a video data buffer, an input video frame data received from a source, causing the stored video frame data to be output from the video data buffer at an output video frame rate, and varying the output video frame rate based on a comparison of an amount of video frame data stored at the video data buffer to a threshold amount of frame data. The threshold amount of frame data may be based on a target total latency between capture of the input video frame data at the source and display of the stored video frame data output from the video data buffer.

Abstract: A system may receive a plurality of requests to record a plurality of programs. Based on these requests, resources may be provisioned for transcoding variable bit rate streams into constant bit rate streams. Resources may be provisioned based on assigning transcoding tasks to an existing set of deployed devices in which the transcoding tasks correspond to the plurality of requests. Resources may further be provisioned based on incrementally deploying an additional device to the existing set of deployed devices when the transcoding capacity reaches a certain level.

Abstract: A method, apparatus, device and medium for coding a video are provided. An implementation plan includes: determining an initial video frame structure based on a preset threshold for a B-frame number; in response to determining that the initial video frame structure meets a preset condition, shortening the initial video frame structure to obtain a candidate video frame structure set; determining a target video frame structure from the candidate video frame structure set; and performing video coding on video frames in a to-be-coded video frame sequence according to the target video frame structure.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for film-making using style transfer. One of the methods includes receiving an initial video comprising a sequence of initial video frames; receiving a selection of style images; for each initial video frame in the sequence of initial video frames, processing the initial video frame to generate a final video frame, the processing comprising: segmenting the initial video frame to generate a segmented video frame; generating a plurality of stylized video frames each according to a respective one of the style images; and generating a final video frame comprising, for each segment of the segmented video frame: determining a stylized video frame, extracting the respective segment from the determined stylized video frame, and inserting the extracted segment into the final video frame; and combining each generated final video frame in sequence to generate the final video.

Abstract: Techniques are described for pre-processing frames to apply a temporal filter. A P-frame may be temporally filtered based on neighboring reference frames. The temporal filter may be applied to blocks of the P-frame to improve alignment with dependent frames that are encoded based on blocks of the P-frame.

Abstract: A method of video encoding includes, prior to encoding a first tile of s plurality of tiles of a current picture, initializing a shared row buffer that is shared among multiple processor threads associated with the first tile. The method also includes encoding a first unit of a plurality of units in a first row of the first tile by a first processor thread and using a corresponding first HMVP buffer. The method also includes, when all of the plurality of blocks in the first unit have been encoded, copying contents of the first HMVP buffer into the shared row buffer, copying contents of the shared row buffer into a second HMVP buffer, starting encoding of a unit in a second row of the plurality of rows by the second processor thread using the second HMVP buffer, and resetting the first HMVP buffer.

Abstract: The present disclosure provides a video synthesis method, apparatus, computer device and computer-readable storage medium, which the method includes: acquiring a first video; capturing second video data photographed in real time; performing first encoding on the second video data to obtain an encoded video; synthesizing the first video and the encoded video to obtain synthesized video data; and performing second encoding on the synthesized video data to obtain a target video. By means of the method, there is less loss in the obtained target video frames and a relatively high definition of the video frames.

Abstract: Embodiments of a system and method for secure processing of image data are described. Image data included in image files may be encrypted and compressed in a single step using dynamically identified compression/encryption information such as code word tables.

Abstract: The present disclosure relates, in part, to spatially aware media that includes three-dimensional (3D) spatial information pertaining to a real-world space. The spatially aware media may map this 3D spatial information to media such as an image, for example, to provide 3D spatial context for the media. This may allow users to more flexibly and efficiently interact with virtual content in real-world spaces that are relevant to them. According to one embodiment, spatially aware media is augmented to provide an image of a real-world space overlaid with a render of a 3D model defined relative to the 3D spatial features of the real-world space. Before augmenting the spatially aware media, a recommended position for the 3D model relative to the 3D spatial features of the real-world space may be determined based on the 3D model and/or on the spatially aware media.

Abstract: Systems and methods are provided for encoding a multi-pixel caching scheme for lossless encoders. The systems and methods can include obtaining a sequence of pixels, determining repeating sub-sequences of the sequence of pixels consisting of a single repeated pixel and non-repeating sub-sequences of the sequence of pixels, responsive to the determination, encoding the repeating sub-sequences using a run-length of the repeated pixel and encoding the non-repeating sub-sequences using a multi-pixel cache, wherein the encoding using a multi-pixel cache comprises, encoding non-repeating sub-sequences stored in the multi-pixel cache as the location of the non-repeating sub-sequences in the multi-pixel cache, and encoding non-repeating sub-sequences not stored in the multi-pixel cache using the value of the pixels in the non-repeating sub-sequences.

Abstract: A method for processing a stream of images including the steps of obtaining coding information from the stream of images to determine one or more bitrate/distortion models representative of the bitrate/distortion relationship of the stream of images, determining a set of coding parameters arranged for use to encode a stream of images with the one or more bitrate/distortion models, reformulating the bitrate/distortion relationship into a decoupled relationship arranged to be applied to a subset of the stream of images, and using the decoupled relationship and the set of coding parameters to generate an adaptive quantization parameter for encoding the stream of images with the bitrate/distortion relationship.

Abstract: A computer-implemented method, a system, a video camera, and a server all for dynamically batching a video stream from a video camera. The method comprising the steps of: capturing, by the video camera, a video stream; identifying two or more intended subscribers of the video stream, said subscribers connected to the video camera via the packet-switched network; determining a sensitivity to latency for each subscriber; batching the video stream into a plurality of batches, wherein the size of each batch of the plurality of batches is based on the subscriber determined to be most sensitive to latency; and transmitting the plurality of batches of the video stream to each subscriber.

Abstract: Embodiments of the present disclosure relate to a computer-implemented method, a device, and a computer program product. A method includes: determining a first group of frames corresponding to a first scene and a second group of frames corresponding to a second scene different from the first scene in a reference video, respectively. The first group of frames and the second group of frames each have a first resolution. The method further includes determining a first model for the first scene and a second model for the second scene, respectively. The first model and the second model are respectively used to convert frames corresponding to the first scene and the second scene from the first resolution to a second resolution different from the first resolution. The method further includes training the first model and the second model using the first group of frames and the second group of frames, respectively.

Abstract: Dynamically allocating virtual or physical CPU cycles for use in processing a video stream. Video complexity information for two or more digital video streams actively being processed by one or more video encoders is determined at periodic intervals. Video complexity information describes the complexity of digital video carried by the digital video streams across a bounded number of consecutive digital frames which includes digital frames not yet processed by the one or more video encoders. A determination is made as to whether a number of CPU cycles allocated for processing a particular digital video stream should be adjusted based on the determined video complexity information. The number of CPU cycles allocated for processing the particular digital video stream may be dynamically adjusted by changing an amount of CPU cycles allocated to a virtual machine in which the stream is processed or by processing the stream in a different virtual machine.

Abstract: Data may be encoded to minimize distortion after decoding, but the quality required for presentation of the decoded data to a machine and the quality required for presentation to a human may be different. To accommodate different quality requirements, video data may be encoded to produce a first set of encoded data and a second set of encoded data, where the first set may be decoded for use by one of a machine consumer or a human consumer, and a combination of the first set and the second set may be decoded for use by the other of a machine consumer or a human consumer. The first and second set may be produced with a neural encoder and a neural decoder, and/or may be produced with the use of prediction and transform neural network modules. A human-targeted structure and a machine-targeted structure may produce the sets of encoded data.

Abstract: Various embodiments comprise systems, methods, and apparatus for processing a received video stream according to an embodiment comprises: identifying a number of repeated video frames within a sequence of N video frames within the video stream; determining, using a video frame quality assessment mechanism adapted to use repeated frames information, a motion adapted video quality metric (VQM) of the sequence of N video frames; and generating an alarm in response to the motion adapted VQM being less than a threshold level.

Abstract: Decoding a transform block includes decoding a first group of coefficients of the transform block using a first scan order. The first group includes of first coefficients of a first row along a first edge of the transform block and second coefficients of a first column that is along a second edge of the transform block. The first group is used to determine a second scan order for decoding a second group of coefficients of the transform block. The second group includes remaining coefficients of the transform block and does not include any coefficient of the first group. The second group is decoded using the second scan order.

Abstract: Several systems, methods and integrated circuits capable of reducing blocking artifacts in video data are disclosed. In an embodiment, a system for reducing blocking artifacts in video data includes a processing module and a deblocking module. The deblocking module comprises a luma deblocking filter and a chroma deblocking filter configured to filter an edge between adjacent blocks associated with the video data, where a block of the adjacent blocks corresponds to one of a prediction block and a transform block. The processing module is communicatively associated with the deblocking module and is operable to configure at least one filter coefficient corresponding to the chroma deblocking filter based on one or more filter coefficients corresponding to the luma deblocking filter. The processing module is further configured to cause the chroma deblocking filter to filter the edge between the adjacent blocks based on the configured at least one filter coefficient.

Abstract: An image processing apparatus for performing correction for each frame group including a predetermined number of frames into which video data is divided includes a decoding unit configured to obtain a corrected frame group by correcting a second frame group, which is a frame group continuous with a first frame group in time, using a feature quantity of the first frame group. The decoding unit performs the correction so that subjective image quality based on a relationship between the second frame group and a frame group subsequent to the second frame group in time is increased and so that a predetermined classifier classifies that a frame group in which the second frame group is concatenated with the frame group subsequent to the second frame group in time is the same as a frame group in which the corrected frame group is concatenated with a corrected frame group obtained by correcting the frame group subsequent to the second frame group in time.

Abstract: An example symbol-based watermark detection method disclosed herein includes, in response to a comparison of a first count of occurrences of a first potential symbol value corresponding to a first symbol within a watermark and a second count of occurrences of a second potential symbol value corresponding to the first symbol, (i) determining a first accumulated signal to noise ratio value corresponding to the occurrences of the first potential symbol value, (ii) determining a second accumulated signal to noise ratio value corresponding to the occurrences of the second potential symbol value, and (iii) selecting one of the first or the second potential symbol value having a greatest accumulated signal to noise ratio value as a likely symbol value for the first symbol. The example method also includes concatenating the likely symbol value with other likely symbol values corresponding to other symbols of the watermark to detect the watermark.

Abstract: Executing a deep neural network by obtaining, during deep neural network inference, a binary intermediate feature map in binary representation by converting a floating-point or fixed-point intermediate feature map into a binary vector using a first transformation module; generating a compressed feature map by compressing the binary intermediate feature map using a nonlinear dimensionality reduction layer; storing the compressed feature map into memory; reconstructing the binary intermediate feature map by decompressing the compressed feature map read from the memory using a reconstruction layer corresponding to the nonlinear dimensionality reduction layer; and converting the reconstructed binary intermediate feature map into a floating-point or fixed-point intermediate feature map using a second transformation module.

Abstract: Disclosed is an image processing apparatus that generate a plurality of reduced images with different reduction rates from an input image, applies predetermined processing to the reduced images, enlarges the reduced images into their respective original resolutions, and then composes the enlarged images into a composite image. The apparatus applies processing to the input image based on the composite image. The apparatus, depending on a setting, applies the processing to an input image based on the composite image generated from a previous input image.

Abstract: Innovations in control and use of chroma quantization parameter (“QP”) values that depend on luma QP values. More generally, the innovations relate to control and use of QP values for a secondary color component that depend on QP values for a primary color component. For example, during encoding, an encoder determines a QP index from a primary component QP and secondary component QP offset. The encoder maps the QP index to a secondary component QP, which has an extended range. The encoder outputs at least part of a bitstream including the encoded content. A corresponding decoder receives at least part of a bitstream including encoded content. During decoding, the decoder determines a QP index from a primary component QP and secondary component QP offset, then maps the QP index to a secondary component QP, which has an extended range.

Abstract: Techniques and tools for performing fading compensation in video processing applications are described. For example, during encoding, a video encoder performs fading compensation using fading parameters comprising a scaling parameter and a shifting parameter on one or more reference images. During decoding, a video decoder performs corresponding fading compensation on the one or more reference images.

Abstract: Provided are devices, computer-program products, and methods related to removing redundant data associated with frames. For example, a method can include storing a plurality of reference data sets in a reference database, where a reference data set is associated with a media segment. The method can further include receiving, by a server, cue data for a frame. The cue data includes a plurality of pixel data samples from the frame, and the frame is associated with an unidentified media segment. The method can further include identifying an absence of a pixel data sample from the cue data for the frame, and matching the cue data for the frame to a reference data set. The matching can include using a previous pixel data sample from a previous frame. The previous pixel data sample corresponds to the pixel data sample absent from the frame, and the reference data set is associated with a media segment. The method can further include determining the unidentified media segment is the media segment.

Abstract: Techniques and tools for performing fading compensation in video processing applications are described. For example, during encoding, a video encoder performs fading compensation using fading parameters comprising a scaling parameter and a shifting parameter on one or more reference images. During decoding, a video decoder performs corresponding fading compensation on the one or more reference images.

Abstract: This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.

Abstract: Systems, methods, and computer media are described for memory-efficient unarchiving. Data items can be archived and removed from primary data store over time. An archive block containing both a data item of interest and additional data items can be located. The data item of interest, as well as the additional data, can be loaded into a secondary data store. The data item of interest can then be extracted from the secondary data store and reloaded into the primary data store. The secondary data store can then be cleared. Memory-efficient unarchiving more efficiently uses computing resources and unarchives only the data that is needed.

Abstract: The disclosure is directed to a receiver. The receiver includes a video decoder and a frame throttle configured to receive a video sequence comprising a plurality of video frames. The frame throttle is further configured to drop one or more of the video frames from the video sequence before providing the video sequence to the video decoder.

Abstract: A method for encoding pictures within a groups of pictures using prediction, where a first reference picture from a group of pictures and a second reference pictures from the subsequent group of pictures are used in predicting pictures in the group of pictures associated with the first reference picture. A plurality of anchor pictures in the group of pictures associated with the first reference picture may be predicted using both the first and second reference pictures to ensure a smooth transition between different groups of pictures within a video frame.

Abstract: A method for accurately measuring flicker, by first determining an original value based on a difference between pixel values in corresponding locations in a first picture and a second picture. Next, a reconstructed value is determined, based on a difference between pixel values in corresponding locations in a reconstruction from an encoding of the first picture and a reconstruction from an encoding of the second picture. Then, a determination is made to include a comparison value, which is determined on a difference between the reconstructed value and the original value, in a measurement of flicker between the first picture and the second picture.

Abstract: A method, system and device are provided for pre-filtering device for filtering a video signal prior to digitally encoding. The method includes receiving at least one input picture and at least one reconstructed picture from an encoding process and performing an in-loop temporal filtering process using at least one input picture and at least one reconstructed picture from an encoding process to output a pre-filtered video signal for use in an encoding process. The result is enabling an encoding process to produce an output with increased temporal correlation between adjacent pictures regardless of the coding type, since the artifacts introduced by the encoding process are also considered by the process.