Abstract: A method for switching between a first lens and a second lens in an electronic device includes displaying, by the electronic device, a first frame showing a field of view (FOV) of the first lens; detecting, by the electronic device, an event that causes the electronic device to transition from displaying the first frame to displaying a second frame showing a FOV of the second lens; generating, by the electronic device and based on the detecting the event, at least one intermediate frame for transitioning from the first frame to the second frame; and switching, by the electronic device and based on the detecting the event, from the first lens to the second lens and displaying the second frame, wherein the at least one intermediate frame is displayed after the displaying the first frame and before the displaying the second frame while the switching is performed.

Abstract: The present disclosure relates to systems and methods for a multi-video stream transmission to a client terminal. The systems and methods may include obtaining a multi-video stream including a plurality of video streams, each video stream including multiple key frames characterized by a frame rate and a key frame interval. The systems and methods may include determining a delay time of an initial key frame for each video stream based on a plurality of frame rates and a plurality of key frame intervals of the plurality of video streams. The systems and methods may further include processing the plurality of video streams to determine a desired sending time of the initial key frame in the corresponding video streams based on the delay time of the initial key frame in each video stream. The systems and methods may further include transmitting the plurality of processed video streams to the client terminal.

Abstract: An image output device, an image receiving device, and an image transmission method are provided. The image transmission method includes the following. A source image is transformed into an augmented image by an image output device. The source image includes M source pixels and the augmented image includes N augmented pixels. The augmented image is received by an image receiving device. The augmented image is transformed into the source image. M is less than N.

Abstract: An idea used herein is to use the same function for the dependency of the context and the dependency of the symbolization parameter on previously coded/decoded transform coefficients. Using the same function—with varying function parameter—may even be used with respect to different transform block sizes and/or frequency portions of the transform blocks in case of the transform coefficients being spatially arranged in transform blocks. A further variant of this idea is to use the same function for the dependency of a symbolization parameter on previously coded/decoded transform coefficients for different sizes of the current transform coefficient's transform block, different information component types of the current transform coefficient's transform block and/or different frequency portions the current transform coefficient is located within the transform block.

Abstract: Proposed are a method and apparatus for evaluating the quality of an image, the method including obtaining blocks each having a predetermined size by splitting a target image for evaluating a quality and a reference image that is to be compared with the target image, determining sensitivity information and quality assessment information of each of the blocks by inputting the blocks to a video quality assessment network, and determining a final image quality assessment score of the target image by combining the pieces of quality assessment information of the blocks with each other, based on the pieces of sensitivity information of the blocks.

Abstract: Systems and methods for encoding and decoding neural network data is provided. A method includes: receiving a neural network representation (NNR) bitstream including a group of NNR units (GON) that represents an independent neural network with a topology, the GON including an NNR model parameter set unit, an NNR layer parameter set unit, an NNR topology unit, an NNR quantization unit, and an NNR compressed data unit; and reconstructing the independent neural network with the topology by decoding the GON.

Abstract: A computer-implemented method includes accessing a high dynamic range (HDR) media content item. Statistical analysis is performed to determine statistical information associated with the HDR media content item at each incremental portion of the HDR media content item. Metadata for each incremental portion of the HDR media content item is generated. A standard dynamic range (SDR) version of the content is derived using the HDR metadata. The metadata and an SDR version of the HDR media content item is transmitted to a storage service. The metadata and the SDR version are caused to be received at a display device. The SDR version is converted to HDR with a dynamic range bounded based on the metadata.

Abstract: Techniques and tools for reducing latency in video encoding and decoding by constraining latency due to reordering of video frames, and by indicating the constraint on frame reordering latency with one or more syntax elements that accompany encoded data for the video frames. For example, a real-time communication tool with a video encoder sets a syntax element that indicates a constraint on frame reordering latency, which is consistent with inter-frame dependencies between multiple frames of a video sequence, then outputs the syntax element. A corresponding real-time communication tool with a video decoder receives the syntax element that indicates the constraint on frame reordering latency, determines the constraint on frame reordering latency based on the syntax element, and uses the constraint on frame reordering latency to determine when a reconstructed frame is ready for output (in terms of output order).

Abstract: Techniques and tools for reducing latency in video encoding and decoding by constraining latency due to reordering of video frames, and by indicating the constraint on frame reordering latency with one or more syntax elements that accompany encoded data for the video frames. For example, a real-time communication tool with a video encoder sets a syntax element that indicates a constraint on frame reordering latency, which is consistent with inter-frame dependencies between multiple frames of a video sequence, then outputs the syntax element. A corresponding real-time communication tool with a video decoder receives the syntax element that indicates the constraint on frame reordering latency, determines the constraint on frame reordering latency based on the syntax element, and uses the constraint on frame reordering latency to determine when a reconstructed frame is ready for output (in terms of output order).

Abstract: Techniques and tools for reducing latency in video encoding and decoding by constraining latency due to reordering of video frames, and by indicating the constraint on frame reordering latency with one or more syntax elements that accompany encoded data for the video frames. For example, a real-time communication tool with a video encoder sets a syntax element that indicates a constraint on frame reordering latency, which is consistent with inter-frame dependencies between multiple frames of a video sequence, then outputs the syntax element. A corresponding real-time communication tool with a video decoder receives the syntax element that indicates the constraint on frame reordering latency, determines the constraint on frame reordering latency based on the syntax element, and uses the constraint on frame reordering latency to determine when a reconstructed frame is ready for output (in terms of output order).

Abstract: Techniques and tools for reducing latency in video encoding and decoding by constraining latency due to reordering of video frames, and by indicating the constraint on frame reordering latency with one or more syntax elements that accompany encoded data for the video frames. For example, a real-time communication tool with a video encoder sets a syntax element that indicates a constraint on frame reordering latency, which is consistent with inter-frame dependencies between multiple frames of a video sequence, then outputs the syntax element. A corresponding real-time communication tool with a video decoder receives the syntax element that indicates the constraint on frame reordering latency, determines the constraint on frame reordering latency based on the syntax element, and uses the constraint on frame reordering latency to determine when a reconstructed frame is ready for output (in terms of output order).

Abstract: The present technology relates to a decoding device and a decoding method, and an encoding device and an encoding method that enable images that configure a packed image to be reliably displayed when an encoded stream is decoded and displayed. A decoding unit decodes an encoded data, the encoded data being an encoded packed image in which a plurality of images is packed, and generates the packed image. A display control unit identifies the images that configure the packed image based on packing SEI preferentially used when the packed image is displayed. The present technology can be applied to a decoding device, for example.

Abstract: A computer system is provided that includes at least one processor configured to execute a host virtual machine configured to host a session with at least one client computer device. The host virtual machine includes an operating system having a multi-media framework for rendering media content. The at least one processor is further configured to execute a media application configured to access media content from a media source, process encoded media content from the media application using the multi-media framework, and execute a multi-media redirection module configured to intercept the encoded media content from being processed by a decoding module of the multi-media framework. The multi-media redirection module is configured to redirect the encoded media content to the at least one client computer device.

Abstract: A system and method for transmitting compressed video. A transmitter receives uncompressed video data from a video source, and compresses it using one or more reference frames. A receiver receives the compressed video data and decodes it, using the same reference frames, to form display data. The reference frames are stored in compressed form in both the transmitter and the receiver. Each frame of display data becomes a reference frame for the decoding of a subsequent frame.

Abstract: A computer system is provided that includes at least one processor configured to execute a host virtual machine configured to host a session with at least one client computer device. The at least one processor is further configured to execute a web browser application configured to access media content from a remote media source, receive encoded media content from the remote media source in a media container format, and execute a multi-media redirection module configured to intercept the encoded media content from being processed by a decoding module of the web browser application. The multi-media redirection module is configured to redirect the encoded media content to the at least one client computer device.

Abstract: A document production system may construct a document from fragments based on a theme associated with the document. The theme may contain section(s), each section having an access control list (ACL) associated therewith. The ACL may specify role-based user group(s) and permission(s) for the role-based user group(s). The system may evaluable rules applicable to the document. At least one rule may pertain to the ACL(s). The evaluation may include, at least in part, utilizing user login information received over a network from a client device. In constructing the document, the system may assemble the document in accordance with the rules and utilizing the fragments and meta information that describes the document. The system may render the document thus assembled utilizing the ACL, generate a view of the document, and communicate the view of the document over the network to the client device for presentation on the client device.

Abstract: A method performed by a decoder for decoding a bitstream comprising a picture parameter set, PPS, and a first set of slices. The method includes obtaining the picture parameter set. The method also includes decoding a syntax element included in the picture parameter set to obtain an indicator value. The decoder is configured such that if the indicator value is set to a first value then the decoder determines that a picture header included in the bitstream comprises a parameter value corresponding to a particular parameter, otherwise the decoder determines that each slice included in the first set of slices comprises a parameter value corresponding to the particular parameter. If the picture header comprises the parameter value corresponding to the particular parameter, then this parameter value is used to decode slice data of each slice included in the first set of slices.

Abstract: A method of video processing by a video processor includes receiving a first syntax element in a coded video bitstream. The first syntax element can be a high level syntax element and indicate whether a height of each of a plurality of pictures in a video sequence of the coded video bitstream is equal to or larger than a width of the respective picture in the video sequence of the coded video bitstream. The pictures in the video sequence of the coded video can be processed in an orientation that is determined according to the first syntax element indicating whether the height of each of the plurality of pictures in the video sequence of the coded video is guaranteed to be equal to or larger than the width of the respective picture in the video sequence.

Abstract: Devices, systems and methods related to digital video coding, and specifically, to management of syntax flags with respect chroma formats are described. In one representative aspect, the disclosed technology may be used to provide a method for video decoding. The method includes determining a chroma format associated with a region of a video and determining, based on the chroma format, whether one or more syntax flags applicable to the region of the video are included in a syntax structure of a coded representation of the video. The one or more syntax flags are indicative of a joint chroma residual coding step for representing the region in the coded representation. The method also includes generating one or more decoded video blocks of the region by parsing the coded representation according to a presence or an absence of the one or more syntax flags in the coded representation.

Abstract: A method of encoding a video bitstream implemented by a video encoder is disclosed. The method includes storing, in a memory of the video encoder, a set of less than five network abstraction layer (NAL) unit types available for video data; selecting, by a processor of the video encoder, a NAL unit type from the set of less than five NAL unit types for a picture from the video data; generating, by the processor of the video encoder, a video bitstream containing a NAL unit corresponding to the NAL unit type selected and containing an identifier identifying the NAL unit type selected; and transmitting, by a transmitter of the video encoder, the video bitstream toward a video decoder. A corresponding method of decoding the video bitstream is also disclosed.

Abstract: Disclosed embodiments provide techniques for multi-destination probabilistic data replication. Data transfer occurs over multiple time intervals. A data image to be transferred is divided into chunks. A manifest is created that lists each chunk and specifies an order, such that the data image can be reconstructed at its destination. The manifest is sent to the destination. The chunks may be sent to the destination, or to an aggregator site that then forwards the chunks to the destination. The chunks are reassembled at the destination based on information in the manifest. A probabilistic function is used to select an aggregator site based on an efficacy. The efficacy is based on a reward function that is computed for destinations for each time interval. A data transfer policy is periodically updated with a new efficacy value which is used for adjustment of the probabilistic function.

Abstract: A method of visual media processing includes determining, for a conversion between a current video block of visual media data and a bitstream representation of the current video block, a buffer that stores reference samples for prediction in an intra block copy mode; for a sample spatially located at location of the current video block relative to an upper-left position of a coding tree unit including the current video block and having a block vector, computing a corresponding reference in the buffer at a reference location, wherein the reference location is determined using the block vector and the location; and upon determining that the reference location lies outside the buffer, re-computing the reference location based at least in part on a location of the current video block relative to the coding tree unit including the current video block.

Abstract: Devices, systems and methods for video processing are described. In an exemplary aspect, a method for video processing includes encoding a video unit of a video as an encoded video unit; generating reconstruction samples from the encoded video unit; performing a clipping operation on the reconstruction samples, wherein a clipping parameter used in the clipping operation is a function of a clipping index and a bit-depth of the reconstruction samples or a bit-depth of samples of the video unit; applying a non-linear adaptive loop filter to an output of the clipping operation; and generating a coded representation of the video using the encoded video unit.

Abstract: The present application discloses an image processing method, apparatus, device and storage media. A specific implementation solution is: obtaining an original image and a noise-added image, where the noise-added image is an image of the original image after a noise is added, and a number of pixels with a noise in the original image is less than a preset number; encoding and decoding the original image and the noise-added image respectively, to obtain a first decoded image corresponding to the original image and a second decoded image corresponding to the noise-added image; obtaining a first PSNR between the first decoded image and the original image according to the original image and the first decoded image; obtaining a second PSNR between the second decoded image and the noise-added image according to the noise-added image and the second decoded image; and outputting the first PSNR and the second PSNR.

Abstract: A method of decoding a bitstream by an electronic device is provided. The electronic device receives the bitstream. In addition, the electronic device determines, from general constraints information in the bitstream, a maximum constraint indication used for determining a maximum value of a parameter indication included in a sequence parameter set of the bitstream. The maximum constraint indication does not impose a constraint on the maximum value of the parameter indication when the maximum constraint indication is equal to zero.

Abstract: Methods and devices for decoding a video stream are provided, a method includes storing previously decoded pictures of the video stream in a decoded picture buffer, including a plurality of first pictures of a same temporal sub-layer, the plurality of first pictures including at least one sub-layer reference picture for predicting a current picture of the video stream; identifying a network abstract layer (NAL) unit type of a picture of the plurality of first pictures; removing, based on the NAL unit type of the picture identified, the picture from the decoded picture buffer; and decoding the current picture using the decoded picture buffer. The decoding includes predicting the current picture using one or more of the at least one sub-layer reference picture that is stored within the decoded picture buffer, after removing the picture from the decoded picture buffer.

Abstract: Methods, systems, and devices for performing entropy coding for the palette escape symbol in palette mode coding and decoding are described. An example method for video processing includes performing a conversion between a video comprising one or more video regions comprising a current video block and a bitstream representation of the video, wherein the bitstream representation conforms to a format rule that the current video block is coded using a palette mode coding tool, wherein a binarization of an escape symbol for the current video block uses an exponential-Golomb (EG) code of order K, wherein K is a non-negative integer that is unequal to three, and wherein the palette mode coding tool represents the current video block using a palette of representative color values and wherein the escape symbol is used for a sample of the current video block coded without using the representative color values.

Abstract: A device may be configured to signal sequence parameter information according to one or more of the techniques described herein. The sequence parameter set information may include in its second byte a syntax element specifying a chroma sampling relative to a luma sampling and a syntax element specifies a luma coding tree block size of each coding tree unit.

Abstract: A method of video processing is provided to include: performing a conversion between a video comprising a video region having one or more luma blocks and one or more chroma blocks and a coded representation of the video according to a rule, wherein the rule specifies that use of an intra block copy (IBC) mode is available for the one or more luma blocks and the one or more chroma blocks having a block size M×N, for all values of M and N, where M and N are integers; wherein, using the IBC mode, a video block is coded using at least a block vector pointing to a video frame containing the video block.

Abstract: A document architecture system includes an intelligent document processing engine that can receive raw data streamed from external data source(s), analyze the raw data to identify triggering events, apply rules to the triggering events identified, break down the raw data accordingly, and generating messages in an internal format to represent the pieces of data without any formatting or layout information. The messages can be augmented with custom metadata and stored as fragments that reference, but that do not physically incorporate, the messages. The stored fragments can be used by the document process engine to intelligently render documents and versions thereof. The messages and fragments are in internal formats under control of the document architecture system. The renditions are in final formats that can be delivered, for instance, via an output connector to various output delivery channels.

Abstract: Audio splicing is rendered more effective by the use of one or more truncation unit packets inserted into the audio data stream so as to indicate to an audio decoder, for a predetermined access unit, an end portion of an audio frame with which the predetermined access unit is associated, as to be discarded in playout.

Abstract: Disclosed is an electronic apparatus. The electronic apparatus includes a processor configured to downscale an image using a trained first artificial intelligence (AI) model and to encode a downscaled image, and the processor is configured to control downscaling of the image based on quality information of the image obtained using a trained second AI model, and the second AI model may be trained using feature information of the image obtained from the first AI model.

Abstract: Video frames from a video are compressed into a single image or a single data structure that represents a unique visual flowprint or visual signature for a given activity being modeled from the video frames. The flowprint comprises a computed summary of the original pixel values associated with the video frames within the single image and the flowprint is specific to movements occurring within the video frames that are associated with the given activity. In an embodiment, the flowprint is provided as input to a machine-learning algorithm to allow the algorithm to perform object tracking and monitoring from the flowprint rather than from the video frames of the video, which substantially improves processor load and memory utilization on a device that executes the algorithm, and substantially improved responsiveness of the algorithm.

Abstract: An image decoding method performed by a decoding device according to the present disclosure comprises the steps of: receiving a bitstream containing at least one of segmentation information of a current picture and prediction information for a current block included in the current picture; deriving a first segmentation structure of the current picture, which is based on multiple tiles, on the basis of the segmentation information of the current picture including at least one of information of the number of width-parsing columns, information of the last width, information of the number of height-parsing rows, and information of the last height; deriving a block predicted for the current block, on the basis of the prediction information for the current block contained in one of the multiple tiles; and generating reconstruction samples for the current block on the basis of the predicted block.

Abstract: A method of visual media processing includes determining, for a conversion between a current video block of visual media data and a bitstream representation of the current video block, a buffer that stores reference samples for prediction in an intra block copy mode; for a sample spatially located at location of the current video block relative to an upper-left position of a coding tree unit including the current video block and having a block vector, computing a corresponding reference in the buffer at a reference location, wherein the reference location is determined using the block vector and the location; and upon determining that the reference location lies outside the buffer, re-computing the reference location based at least in part on a location of the current video block relative to the coding tree unit including the current video block.

Abstract: The disclosure relates to a method comprising: receiving, from a first network, a input signal conveying a plurality of audio and/or video channels; sending, on a second network, a first signal comprising a first digital stream conveying a first audio and/or video channel comprised in the input signal, the first signal comprising, for a second channel of said plurality of audio and/or video channels other than the first channel, and a second digital stream comprising an identifying information of the other second channel and requiring less bandwidth than a digital stream conveying the other second audio and/or video channel of the input signal.

Abstract: An example method can comprise receiving an encoding parameter associated with a first content transmission. The encoding parameter can indicate a level of complexity to encode the first content transmission. The method can comprise selecting, based on the encoding parameter, a second content transmission. The second content transmission can be encoded at a second bit rate that is different than a first bit rate of the first content transmission. The method can also comprise generating a third content transmission. The third content transmission can comprise the second content transmission.

Abstract: A method of decoding video data includes: receiving a buffering period message; parsing a first syntax element in the buffering period message, wherein the first syntax element plus one specifies a maximum number (M) of temporal sublayers for which coded picture buffer removal delay and coded picture buffer removal offset are indicated in the buffering period message; and parsing a second syntax element in the buffering period message, in a case that a value of the first syntax element is greater than a threshold value, wherein the second syntax element specifies whether decoded picture buffer output time offsets are present for temporal sublayer representations.

Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding and decoding. In some examples, an apparatus for video decoding includes processing circuitry. The processing circuitry decodes prediction information of a current block in a current picture from a coded video bitstream. The prediction information indicates an inter prediction mode for reconstructing the current block. The processing circuitry identifies a reference block for the current block where the reference block is one of a plurality of blocks in a motion vector compression unit (MVCU) that is already reconstructed. The processing circuitry further determines current motion information of the current block based on representative motion information for the MVCU and reconstructs at least one sample in the current block based on the current motion information.

Abstract: Systems and methods for multi-frame video frame interpolation. Higher-order motion modeling, such as cubic motion modeling, achieves predictions of intermediate optical flow between multiple interpolated frames, assisted by relaxation of the constraints imposed by the loss function used in initial optical flow estimation. A temporal pyramidal optical flow refinement module performs coarse-to-fine refinement of the optical flow maps used to generate the intermediate frames, focusing a proportionally greater amount of refinement attention to the optical flow maps for the high-error middle frames. A temporal pyramidal pixel refinement module performs coarse-to-fine refinement of the generated intermediate frames, focusing a proportionally greater amount of refinement attention to the high-error middle frames.

Abstract: Devices and techniques are generally described for encoding video data based on motion cues. In some examples, a first frame of image data representing a first view of a physical environment may be generated. The camera may be moved by a first amount in a first direction. A second frame of image data representing a second view of the physical environment may be generated. Intra-frame motion may be determined by subtracting a first vector representing movement of the camera by the first amount in the first direction from a second vector representing motion between the first frame and the second frame. Motion vector data representing motion between the first frame and the second frame may be calculated based on the intra-frame motion. An encoded representation of the second frame of image data may be generated and sent to a second device.

Abstract: A system and method are described for an online game service. One method includes receiving a request from a client device interacting with a game application. The request is received by a server of the online game service. Then, receiving a control signal from the client device in response to an input made when interacting with the game application. The control signal is transmitted over a communication channel between the client device and the server. Executing a game associated with the game application by the server to generate a video stream comprising a sequence of images. Compressing the sequence of images of the application in accordance with a compression process to generate a compressed sequence of images using a compression resource used by said server and at least one other server of said online game service.

Abstract: A system and method of transmitting respective audio streams to a plurality of end points, such as headphones, earphones, headsets, speakers, etc. is disclosed. Different audio streams are transmitted to each of the plurality of end points. The end points may be arranged to audibly output received audio streams, and so each end point may audibly output a respective different audio stream, i.e. the respective audio streams may be mutually different from each other.

Abstract: There is provided an image processing apparatus. A generating unit generates a plurality of composite images by repeatedly carrying out a compositing process that composites a plurality of parallax images according to a compositing ratio. The parallax images have parallax with respect to each other. A control unit carries out control so that the compositing ratio changes over time as the compositing process is repeated. A positioning unit positions the plurality of composite images so that a rotational center of viewpoint movement arising between the plurality of composite images due to the change over time in the compositing ratio moves in a depth direction.

Abstract: Media content coded using scalable coding techniques may be cached among a group of cache devices. Layered segments of the media content may be pre-loaded onto the cache devices, which may be located throughout a content distribution network, including a home network. The caching location of the media content may be determined based on multiple factors including a content preference associated with the group of cache devices and device capabilities. A cache controller may manage the caching of the media content.

Abstract: A method and apparatus for a low complexity transform unit partitioning structure for High Efficiency Video Coding (HEVC). The method includes determining prediction unit size of a coding unit, and setting the size of transform unit size of Y, U and V according to the prediction unit size of the coding unit.

Abstract: According to one aspect of the present disclosure, a decoder includes memory and a processor coupled to the memory. The processor is configured to split a current picture into tiles, generate a slice having a rectangular shape and located at a lower-right corner of the current picture, the slice including at least a part of a tile among the tiles, generate first information on a region of the slice with header information, the header information not including information identical to the first information, and decode the slice with the first information.

Abstract: Various embodiments of the present disclosure relate to a device and a method for processing point cloud data on the basis of PCC technology in a multimedia system. To this end, a bit stream according to point cloud compression may be generated, and the bit stream may be divided to generate access units by a plurality of type-specific data elements. The plurality of data elements may include at least one layer-specific shape data, at least one layer-specific texture data, auxiliary patch information, and occupancy information. The size of each of the plurality of access units may match a maximum transmission unit in a network.

Abstract: Techniques for processing videos are described herein. The disclosed techniques include obtaining coding time parameters of coded frames of a video, the coding time parameters comprising a first parameter indicative of a coding time period for coding each frame under a non-waiting state and a second parameter indicative of a total time period during which each frame is in a coding process; and determining a coding complexity parameter for a frame to be coded based on the coding time parameters, wherein the determining a coding complexity parameter further comprises determining whether the coding complexity parameter is downgraded based on the second parameter, and in response to a determination that the coding complexity parameter is not downgraded, determining that the coding complexity parameter is upgraded based on the first parameter.

Abstract: Aspects of the disclosure provide methods, apparatuses, and a non-transitory computer-readable medium for point cloud compression and decompression. In a method, syntax information of a bounding box of a point cloud is decoded from a coded bitstream. The syntax information indicates an octree partitioning structure for the bounding box of the point cloud. Whether the syntax information indicates that parallel decoding is to be performed on occupancy codes of nodes in a range of one or more partitioning depths in the octree partitioning structure is determined. The parallel decoding is performed on the occupancy codes of the nodes in response to the syntax information indicating that the parallel decoding is to be performed on the occupancy codes of the nodes in the range of the one or more partitioning depths in the octree partitioning structure. The bounding box is reconstructed based on the occupancy codes of the nodes.