Abstract: Disclosed are a system and a method for detecting a centroid of a complementary single pixel. The system includes a lens group, a single-pixel detector assembly, a Digital Micromirror Device (DMD) and an acquisition and processing unit. The acquisition and processing unit generates two-dimensional modulation matrices A and B which are loaded into the DMD; the lens group processes light reflected or transmitted from a target object, such that an image of the target object is imaged on the DMD; and the acquisition and processing unit is connected with data output ends of two single-pixel detectors in respective, to calculate the centroid of the target object. The DMD modulates an image signal of the target object according to modulation information A and B; the single-pixel detector assembly includes a first single-pixel detector and a second single-pixel detector.

Abstract: The present invention relates to a display device and a control method therefor, and involves the concept of controlling a display to reduce luminance from a default luminance to a first luminance for a first reduction time when brightness of a fixed area is maintained for a first predetermined time or more, and controlling the display to increase the luminance from the first luminance to the default luminance, when a set-top box receives, from an external device within a second predetermined time, a first signal for changing a screen from a first screen to a second screen.

Abstract: Embodiments of the present disclosure relate to a method, a device, and a computer program product for video compression. The method includes: segmenting, in response to one or more features of an object in a video having a periodic change, the video into a plurality of segments based on a cycle of the periodic change; and identifying focal regions in frames of the video that are associated with the object. The method further includes: compressing the video based on the plurality of segments and the focal regions. This solution provides a content-aware lightweight video compression solution that supports content-based video deduplication at multiple scales and breaks the spatio-temporal continuity constraint of video frames during compression, thus enabling more effective video compression.

Abstract: A transmission apparatus configured to mix, at a mixing rate, pixels of first video data with pixels of peripheral frames of the first video data and obtain second video data at a first frame rate. The mixing rate for each pixel of a frame of the first video data is based on a luminance value of the pixel. The second video data includes frames having a second frame rate lower than the first frame rate. The apparatus encodes the frames having the second frame rate to obtain a basic stream and encodes remaining frames of the second video data to obtain an extended stream, inserts information about the mixing rate into the basic stream and the extended stream in association with each frame, and transmits the basic stream and the extended stream into which the information about the mixing rate has been inserted.

Abstract: The present invention relates to an image encoding/decoding method and device, and the image encoding method or device according to an embodiment of the present invention may encode a position of a reference coefficient within a current transform block to be encoded, and encoding skip region information of a skip region selected on the basis of the position of the reference coefficient. The skip region information may represent whether or not coefficients within the skip region have an identical coefficient value.

Abstract: According to a method for Adaptive Loop Filter (ALF) processing of reconstructed video, multiple indicators are signaled in slice at an encoder side or parsed at a decoder side, where the multiple indicators are Adaptive Parameter Set (APS) indices associated with temporal ALF filter sets for the ALF processing. A current indicator is determined from the multiple indicators, where the current indicator is used to select a current ALF filter set. Filtered-reconstructed pixels are derived for the current block by applying the current ALF filter to the current block. In another method, if the ALF processing applied at a target sample requires an outside sample on other side of a target virtual boundary from the target sample, the outside sample is replaced by a padded sample.

Abstract: Techniques for signaling of sample adaptive offset (SAO) information that may reduce the coding rate for signaling such information in the compressed bit stream are provided. More specifically, techniques are provided that allow SAO information common to two or more of the color components to be signaled using one or more syntax elements (flags or indicators) representative of the common information. These techniques reduce the need to signal SAO information separately for each color component.

Abstract: Described is a method for compressing measurement data of a volume which comprises an object, wherein a digital representation of the object comprising a plurality of image information items of the object is generated by the measurement. The method comprises: providing an analysis specification for at least one predetermined region in the measurement volume; determining the measurement data in the measurement volume; defining a subset of the measurement data which corresponds to the at least one predetermined region of the analysis specification; selecting at least one compression rate for the subset on the basis of the analysis specification; selecting a first compression method for a remainder of the measurement data outside the subset, the first compression method having a compression rate; compressing the subset with the selected at least one compression rate, and compressing the remainder of the measurement data by way of the first compression method.

Abstract: The present application discloses an image optimization method and system based on artificial intelligence, comprising: performing image object recognition for a template image, and extracting and recording template information of the template image; identifying the number and categories of primary objects in a to-be-optimized image by using an image recognition algorithm of a neural network; performing matching in a template database for the to-be-optimized image according to a set matching condition and the recorded template information to obtain optimal template information; scaling the primary object in the to-be-optimized image according to layout information in the optimal template information; cropping and adjusting a background part of the to-be-optimized image according to resolution requirements of an output target image and a basic composition principle; combining an image of the processed primary object with a background image according to the layout information in the optimal template information

Abstract: An electronic device is provided that includes a first display and a second display. The electronic device also includes a processor configured to allocate a first set of resources to the first display and a second set of resources to the second display. The first set of resources is different from the second set of resources. Each of the first set of resources and the second set of resources includes one or more of at least one available hardware resource and at least one available software resource.

Abstract: A method for decoding video includes receiving a frame of the video that includes at least one slice and at least one time. Each of the at least one slice and the at least one tile are not all aligned with one another. Each of the at least one slice is characterized that it is decoded independently of the other the at least one slice. Each of the at least one tile is characterized that it is a rectangular region of the frame and having coding units for the decoding arranged in a raster scan order. The at least one tile of the frame are collectively arranged in a raster scan order of the frame.

Abstract: A method of video encoding includes determining that a coded video bitstream conforms to one of a Main 10 still picture profile or a Main 4:4:4 10 still picture profile and generating profile information that indicates that each of the image slices is to be intra coded and indicates the one of the Main 10 still picture profile or the Main 4:4:4 10 still picture profile. The method further includes constraining only one picture to be included in the coded video bitstream according to the one of the Main 10 still picture profile or the Main 4:4:4 10 still picture profile. The method also includes performing intra prediction on each of the image slices, and encoding the picture based on the intra prediction and according to the one of the Main 10 still picture profile or the Main 4:4:4 10 still picture profile to form the coded video bitstream.

Abstract: A method includes receiving a reference frame, determining, for a current block, a scaling constant; scaling a block of the reference frame according to the scaling constant, the block of the reference frame corresponding to the current block, and reconstructing pixel data of the current block and using the scaled block of the reference frame. Related apparatus, systems, techniques and articles are also described.

Abstract: A neural network deep learning data control apparatus includes: a memory; an encoding circuit configured to receive a data sequence, generate a compressed data sequence in which consecutive invalid bits in a bit string of the data sequence are compressed into a single bit of the compressed data sequence, generate a validity determination sequence indicating a valid bit and an invalid bit in a bit string of the compressed data sequence, and write the compressed data sequence and the validity determination sequence to the memory; and a decoding circuit configured to read the compressed data sequence and the validity determination sequence from the memory, and determine a bit in the bit string of the compressed data sequence set for transmission to a neural network circuit, based on the validity determination sequence, such that the neural network circuit omits an operation with respect to non-consecutive invalid bits.

Abstract: In one embodiment, a method includes receiving a rendered image, motion vector data, and a depth map corresponding to a current frame of a video stream generated by an application, calculating a current three-dimensional position corresponding to the current frame of an object presented in the rendered image using the depth map, calculating a past three-dimensional position of the object corresponding to a past frame using the motion vector data and the depth map, estimating a future three-dimensional position of the object corresponding to a future frame based on the past three-dimensional position and the current three-dimensional position of the object, and generating an extrapolated image corresponding to the future frame by reprojecting the object presented in the rendered image to a future viewpoint associated with the future frame using the future three-dimensional position of the object.

Abstract: Embodiments of the present application provide an image display method and apparatus, a device, and a storage medium. The method comprises: displaying a preceding image in a first display period, the preceding image comprising a video image sequence or a single image; superimposing a foreground target area of a succeeding image on an upper layer of the preceding image in a second display period for display, the succeeding image comprising a video image sequence or a single image; and displaying the succeeding image in a third display period. According to the method, a good playback effect can be achieved in scenarios where time variations are desired.

Abstract: A method for encoding a video stream for the provision of prunable video data, comprising identifying, in the video stream, a first event-generating occurrence in one or more frames of the video stream, and, in an encoder, using the event-generating occurrence to initiate a hierarchical branch extending from a base-layer when encoding the video stream.

Abstract: The image decoding method includes determining a context for use in a current block to be processed, from among a plurality of contexts, wherein in the determining: the context is determined under a condition that control parameters of a left block and an upper block are used, when the signal type is a first type; and the context is determined under a third condition that the control parameter of the upper block is not used and a hierarchical depth of a data unit to which the control parameter of the current block belongs is used, when the signal type is a third type, and the third type is one or more of (i) “merge_flag”, (ii) “ref_idx_I0” or “ref_idx_I1”, (iii) “inter_pred_flag”, (iv) “mvd_I0” or “mvd_I1”, (v) “intra_chroma_pred_mode”, (vi) “cbf_luma”, and (vii) “cbf_cb” or “cbf_cr”.

Abstract: A method of encoding a video stream for the provision of prunable video data, comprising: receiving, in an encoder, a video stream in which each image frame of the video stream is divided into a number of subviews, providing each subview with an assigned category based on a content of the particular subview, monitoring the evolution of category assigned for each subview, and encoding the video stream using a hierarchical P-frame encoding structure, in such manner that each change in category for a subview starts a new hierarchical P-frame structure.

Abstract: Devices, systems and methods for picture border coding are described. In a representative aspect, a method for processing picture includes segmenting a picture into one or multiple picture segments, determining that a first block of a picture segment covers at least one region that is outside a border of the picture segment, wherein a size of the first block is M×N pixels, selecting a second block of size K×L pixels, where (K?M and L<N) or (K<M and L?N), wherein the second block falls entirely within the picture segment and wherein the second block is used as a largest coding unit, a leaf coding block or a coding tree block; and processing, using a partition tree, the border of the picture segment, wherein the partition tree is based on the size of the second block.

Abstract: A video residual decoding apparatus includes a residual decoding circuit and a neighbor storage device. The residual decoding circuit applies residual decoding to a transform block, wherein the transform block is divided into M sub-blocks, M is a positive integer, and the M sub-blocks are processed by the residual decoding in a diagonal scan order. The neighbor storage device stores neighbor data that belong to neighboring sub-blocks and are referenced by the residual decoding of a current sub-block, wherein neighbor data belonging to a sub-block is derived from a residual decoding result of the sub-block, and a storage size of the neighbor storage device is not larger than a maximum data amount of neighbor data derived from residual decoding results of N sub-blocks, where N is a positive integer, and N is smaller than M.

Abstract: A system and method for providing quality control in immersive video during pausing of a video streaming session. In one embodiment, a paused video frame may comprise a plurality of mixed quality video tiles depending on user gaze vector information. Under pause control, the video quality of all tiles of the paused video frame is equalized such that it is of same value for all the video tiles, which may be the video quality of the tiles presented in a viewport of the client device. The paused video frame having the same quality tiles throughout is used as a replacement video frame, which is presented to the client device player for decoding and displaying instead of the mixed quality video frame while the streaming session is paused.

Abstract: The present disclosure provides methods and systems for motion compensation. The method can include: determining a plurality of intermediate interpolation coefficients of an interpolation filter, the determining of the plurality of intermediate interpolation coefficients being: based on positions of a plurality of integer samples respectively, and based on fractional reference positions of a plurality of fractional samples respectively; determining a plurality of integer interpolation coefficients of the interpolation filter by rounding the plurality of intermediate interpolation coefficients to a plurality of integers respectively; and applying the plurality of integer interpolation coefficients on a picture to perform motion compensation prediction.

Abstract: The present invention relates to a method for encoding and decoding a quantized matrix and an apparatus using same, the method for encoding a quantized matrix according to the present invention comprising the steps of: determining a quantization matrix to be used for quantization and quantizing; determining the prediction method used for the quantization of the quantization matrix; and encoding quantization matrix information on the basis of the determined prediction method, wherein the prediction method can be either a prediction method between coefficients in the quantization matrix or a duplicate of the quantization matrix.

Abstract: Provided are a stream reprocessing system on chip (SoC) and a method for operating the same is provided. The stream reprocessing system includes a plurality of processors including a central processing unit (CPU); a memory controller configured to receive a stream; and a stream reprocessor configured to perform reprocessing the stream, wherein the stream reprocessor includes: a control unit configured to determine whether to perform the reprocessing on the stream; a reprocessing unit configured to reprocess the stream based on receiving a command to perform the reprocessing on the stream from the control unit; and an output unit configured to transmit the reprocessed stream to a memory.

Abstract: A display apparatus is disclosed. The display apparatus includes a display panel configured to drive a frame of a first resolution at a first frame rate, a communication interface comprising circuitry configured to receive content, and a processor configured to, based on a frame rate of the received content being greater than the first frame rate, adjust the received content to a second resolution, and to control the display panel to display a content of the second resolution at a second frame rate, the second frame rate being greater than the first frame rate.

Abstract: A method for encoding a picture of a video sequence in a bit stream that constrains tile processing overhead is provided. The method includes computing a maximum tile rate for the video sequence, computing a maximum number of tiles for the picture based on the maximum tile rate, and encoding the picture wherein a number of tiles used to encode the picture is enforced to be no more than the maximum number of tiles.

Abstract: An image processing device 300, a non-transitory computer readable storage medium, a monitoring camera 200 and a method 100 of pre-processing images of a video stream before encoding the video stream are disclosed. The images are obtained S110, wherein the obtained images have a first resolution. The obtained images are subsampled S120 to intermediate images having a second resolution lower than the first resolution and lower than a third resolution. The intermediate images are upsampled S130 to output images having the third resolution, wherein the third resolution is the same for all images of the video stream.

Abstract: A communication system facilities low-latency, high-availability multipath streaming between terminals (e.g., mobile terminals) and a server platform. In an example application, a remote support service operating on the server platform provides remote teleoperation, monitoring, or data processing services to a mobile terminal embodied as a vehicle or robot utilizing a low latency communication link. The low latency link enables a remote operator to receive video or telemetry feeds, and timely monitor and respond to hazards in substantially real-time. The low latency communication link may be achieved even when the data streams are transmitted over public networks incorporating at least one wireless leg, and where individual connections have varying quality of service in terms of delivery latency due to congestion or stochastic packet losses. Assignment of data streams to particular communication channels may be made on an optimization model derived from a machine-learning process or simulation.

Abstract: An information processing apparatus includes a display control section that performs control for displaying a list of text information provided to a motion picture in a state where a location at which the text information is not provided is also selectable, and a playback section that plays back the motion picture from a playback time point corresponding to a location selected on the displayed list in a case of playing back the motion picture to which the text information is provided.

Abstract: A video encoding method includes (i) determining a current bit rate of a communication channel between a destination device and a source device that stores an input video frame, and (ii) generating a current reconstructed frame and an encoded bitstream at least in part via inter-frame coding of a current input video frame of a sequence of input video frames using a previously-generated reconstructed frame generated at least in part via inter-frame coding of a previous input video frame. The current reconstructed frame is a compressed version of the current input video frame. When both (i) a subsequent bit rate, determined after said inter-frame coding, is less than a threshold and (ii) the current bit rate exceeds the threshold, the method includes: (a) generating a downscaled reconstructed frame at least in part by downscaling the current reconstructed frame; and (b) appending the encoded bitstream with a bit sequence representing the downscaled reconstructed frame.

Abstract: Video or image capture device and method of operation of the capture device are described. One example method includes determining, for a video capture by a capture device, a capture orientation mode setting of the capture device, capturing a video using one of a first camera or a second camera based on the capture orientation mode and a current orientation of the capture device, wherein the video is in the capture orientation mode, and storing, after capturing, the video in a video file.

Abstract: Embodiments of the present disclosure include a video compression method, an electronic device, and a computer program product. In a video compression method provided by embodiments of the present disclosure, a video is segmented into multiple segments based on a first feature of an object extracted from the video, where the object has a first change in each of the multiple segments, and the first feature identifies a start state and an end state of the first change; the multiple segments are grouped based on a similarity of the first change of the object among the multiple segments; and the video is compressed based on the groups of the multiple segments. In this way, for a video with periodically repetitive content, the video is compressed by retaining a part of representative video segments, which can save storage space and network transmission resources and improve computation efficiency, thereby reducing computation cost.

Abstract: An image decoding method includes: dividing a current block into sub-blocks; deriving, for each sub-block, one or more prediction information candidates; obtaining an index; and decoding the current block using the prediction information candidate selected by the index.

Abstract: A method of de-blocking filtering a processed video is provided. The processed video includes a plurality of blocks and each block includes a plurality of sub-blocks. A current block of the plurality of blocks includes vertical edges and horizontal edges. The processed video further includes a set of control parameters and reconstructed pixels corresponding to the current block. A boundary strength index is estimated at the vertical edges and at the horizontal edges of the current block. The set of control parameters, the reconstructed pixels corresponding to the current block and partially filtered pixels corresponding to a set of adjacent sub-blocks are loaded. The vertical edges and the horizontal edges of the current block are filtered based on the boundary strength index and the set of control parameters such that a vertical edge of the current block is filtered before filtering at least one horizontal edge of the current block.

Abstract: Computer processor hardware receives zone information specifying multiple elements of a rendition of a signal belonging to a zone. The computer processor hardware also receives motion information associated with the zone. The motion information can be encoded to indicate to which corresponding element in a reference signal each of the multiple elements in the zone pertains. For each respective element in the zone as specified by the zone information, the computer processor hardware utilizes the motion information to derive a corresponding location value in the reference signal; the corresponding location value indicates a location in the reference signal to which the respective element pertains.

Abstract: An image postprocessor enhances the quality and detail of a rendered image by applying a photosite demosaicing technique directly to the pixels stored in the viewport of the rendered image. The image postprocessor detects a first subset of the viewport pixels having color values that deviate by more than a threshold amount from color values of a neighboring second subset of the viewport pixels. The image postprocessor maps the viewport pixels to a set of emulated photosites based on a position of each pixel in the viewport, and demosaics and/or interpolates the color values associated with a subset of the emulated photosites in order to generate new pixels for the gap. The image postprocessor replaces the first subset of pixels in the viewport with the new pixels, and presents a second visualization based on the modified pixels of the viewport.

Abstract: A media encoder for encoding a stream of media data blocks has an encoder pipeline including a sequence of processing modules for processing a stream of media data blocks, and a pipeline configurator configured effect a switch in the encoder pipeline from one or more first encode parameters to one or more second encode parameters. The first processing module of the pipeline can be configured to associate a trigger value with at least a first media data block processed at the first processing module in accordance with second encode parameters, the trigger value passing to subsequent modules so as to cause those modules to adopt the second encode parameters.

Abstract: Techniques for encoding image data are discussed. Image data containing multiple image frames can be received from an image sensor associated with a vehicle. A first image frame and a second image frame may be associated with a first data chunk. A first metadata associated with the first image frame can be identified. Additionally, a second metadata associated with the second image frame can be identified. The first data chunk can be created that includes the first image frame, the second image frame, the first metadata, and the second metadata. The first data chunk can be stored in a video container, where the video container can be indexed to access the first image frame with the first metadata or the second image frame with the second metadata.

Abstract: With an image coding method which allows reduction of processing loads, when pictures included in a video signal are classified into layers so as to belong to their respective layers, a picture that belongs to the second layer that is located in a range restricted according to the first layer to which a current picture to be coded that is one of the pictures belongs, is referred to as a reference picture for the current picture, and the current picture is coded based on the reference picture.

Abstract: An inference method, an inference device, and a display are provided. The method includes: receiving an input signal through a first inference device or a second inference device; performing a first inference operation according to the input signal through the first inference device to obtain first inference information; performing a second inference operation according to the input signal through the second inference device to obtain second inference information; and providing an output signal according to the input signal, the first inference information and the second inference information through the second inference device.

Abstract: A method of video processing includes determining, for a conversion between a block of a video and a bitstream representation of the video, whether a sample of the block is positioned within a distance from a boundary of the block to be a boundary sample for a filtering process according to a rule associated with a component identity of the block. The method also includes performing the conversion based on the determining.

Abstract: A system and method for managing data storage and data access with querying data in a distributed system without buffering the results on intermediate operations in disk storage.

Abstract: A system and method for providing quality control in immersive video during pausing of a video streaming session. In one embodiment, a paused video frame may comprise a plurality of mixed quality video tiles depending on user gaze vector information. Under pause control, the video quality of all tiles of the paused video frame is equalized such that it is of same value for all the video tiles, which may be the video quality of the tiles presented in a viewport of the client device. The paused video frame having the same quality tiles throughout is used as a replacement video frame, which is presented to the client device player for decoding and displaying instead of the mixed quality video frame while the streaming session is paused.

Abstract: In various embodiments, a codec comparison application independently encodes each source image included in a set of source images using a first encoding configuration to generate a first set of encoded images. The codec comparison application also independently encodes each source image included in the set of source images using a second encoding configuration to generate a second set of encoded images. For each encoded image in the first set of encoded images and each encoded image in the second set of encoded images, a visual quality score for a reconstructed source image derived from the encoded image falls within a tolerance of a target visual quality score.

Abstract: Aspects of the disclosure provide methods, apparatuses, and non-transitory computer-readable storage mediums for video encoding/decoding. An apparatus includes processing circuitry that decodes profile information for a plurality of image slices in prediction information of a coded video bitstream. The profile information includes profile identification information of a profile in which each of the image slices in the coded video bitstream is intra coded. The processing circuitry performs intra prediction on each of the image slices in the coded video bitstream. Further, the processing circuitry reconstructs at least one image picture based on the intra prediction.

Abstract: A method for encoding a picture of a video sequence in a bit stream that constrains tile processing overhead is provided. The method includes computing a maximum tile rate for the video sequence, computing a maximum number of tiles for the picture based on the maximum tile rate, and encoding the picture wherein a number of tiles used to encode the picture is enforced to be no more than the maximum number of tiles.

Abstract: Embodiments of the present invention provide systems, methods, and computer storage media for one-shot and few-shot image segmentation on classes of objects that were not represented during training. In some embodiments, a dual prediction scheme may be applied in which query and support masks are jointly predicted using a shared decoder, which aids in similarity propagation between the query and support features. Additionally or alternatively, foreground and background attentive fusion may be applied to utilize cues from foreground and background feature similarities between the query and support images. Finally, to prevent overfitting on class-conditional similarities across training classes, input channel averaging may be applied for the query image during training. Accordingly, the techniques described herein may be used to achieve state-of-the-art performance for both one-shot and few-shot segmentation tasks.

Abstract: An encoder includes: circuitry; and memory. Using the memory, the circuitry: performs, when a size of a current block to be subjected to transform processing is not a power of 2, complementary processing of adding a complementary region to the current block to cause the size to be a power of 2; performs transform processing on the current block which has been subjected to the complementary processing; performs inverse transform processing on the current block which has been subjected to the transform processing; and eliminates the complementary region included in the current block which has been subjected to the inverse transform processing.

Abstract: The disclosure relates to an image processing apparatus for compressing or decompressing a segment of an image, the segment being non-rectangular and comprising a plurality of pixels, each pixel comprising a pixel value, the pixel values of the plurality of pixels forming a pixel value vector, the apparatus comprising: a processor configured to compress the segment or configured to decompress the segment, wherein compressing the segment comprises computing a plurality of expansion coefficients by expanding the pixel value vector into a plurality of basis vectors, wherein the basis vectors are discrete approximations of solutions of a boundary value problem of the Helmholtz equation on the segment of the image; and wherein decompressing the segment comprises computing the pixel value vector by forming a linear combination of the basis vectors according to the plurality of expansion coefficients.