Abstract: A video encoding apparatus includes a first processor and at least two encoders. The first processor is configured to divide a sequence of video frames into M first groups of pictures (GOPs) and send the M first GOPs to the at least two encoders, M being an integer greater than 1. The at least two encoders are configured to perform parallel encoding on the received M first GOPs to obtain M groups of video encoded data and send the M groups of video encoded data to the first processor. The first processor is further configured to merge the M groups of video encoded data into a video data stream.

Abstract: An information processing apparatus includes processors configured to execute inference processing using a GPU on frames of a moving image through each application for each of a plurality of applications, acquire a first degree of similarity between a target frame and a frame at a time of execution of previous inference processing, acquire a second degree of similarity between the target frame and an immediately preceding frame that is executed after the previous inference processing, set a constraint on execution of inference processing for the target frame having a throughput larger than a certain value when a number of frames accumulated in a queue that is used for waiting for the execution of the inference processing and accumulates frames exceeds a certain number, and determine whether to execute the inference processing for the target frame based on the first degree, the second degree, and whether the constraint presents.

Abstract: Systems and methods herein describe a video compression system. The described systems and methods accesses a sequence of image frames from a first computing device, the sequence of image frames comprising a first image frame and a second image frame, detects a first set of keypoints for the first image frame, transmits the first image frame and the first set of keypoints to a second computing device, detects a second set of keypoints for the second image frame, transmits the second set of keypoints to the second computing device, causes an animated image to be displayed on the second computing device.

Abstract: Candidate encodes of a source video are produced using a plurality of encoding configurations. Quality of experience (QoE) scores for each of the candidate encodes are computed. The QoE scores of the plurality of candidate encodes are compared to determine a lowest bitrate encode that achieve a target QoE score. The lowest bitrate encode that achieve the target QoE score as an optimized output video is selected.

Abstract: A method for decoding an image enables to preserve artistic intent at the final rendering stage by adjusting the image to luminance characteristics of the content and of the presentation display that will display the image. Values representative of luminance of both the image and the display device are obtained. Parameters of a display adaptation function are adjusted according to these values and the adjusted display adaptation function is used to decode the image. In at least one embodiment, the adjusted display adaptation function relates to a tone mapping function. Corresponding apparatus implementing the method is also described.

Abstract: An electronic device includes a video encoding pipeline configured to encode source image data. The video encoding pipeline includes a first transcode engine and a second transcode engine. The electronic device also includes processing circuitry configured to determine a target throughput for a bin stream and determine whether to encode the bin stream using only the first transcode engine or both the first and second transcode engines based on the target throughput. The processing circuitry is also configured to cause only the first transcode engine to encode the bin stream or both the first and second transcode engines to encode the bin stream based on determining whether to encode the bin stream using only the first transcode engine or both the first and second transcode engines.

Abstract: An example disclosed system may include a hardware video encoding pipeline (HVEP), the HVEP that includes a prediction module that generates, using a primary prediction mode, a primary encode of a portion of a video stream, and using a secondary prediction mode, a secondary encode of the portion of the video stream. The HVEP may also include (1) a rate-distortion optimization (RDO) module that determines a primary cost associated with the primary encode and a secondary cost associated with the secondary encode, (2) a quality metric (QM) module that determines a primary QM associated with the primary encode and a secondary QM associated with the secondary encode, and (3) a decision module that selects, for an encoding of the video stream, at least one of the primary prediction mode and the secondary prediction mode based on the primary cost, the secondary cost, the primary QM, and the secondary QM.

Abstract: Techniques are described for optimizing and assigning video encoding ladders.

Abstract: Interpolation between explicitly signaled CPB (or HRD) parameters at selected bit rates is used to achieve a good compromise between CPB parameter transmission capacity and CPB parametrization effectiveness and may be, particularly, made in an effective manner.

Abstract: A video coder may determine a motion vector of a non-adjacent block of a current picture of the video data. The non-adjacent block is non-adjacent to a current block of the current picture. Furthermore, the video coder determines, based on the motion vector of the non-adjacent block, a motion vector predictor (MVP) for the current block. The video coder may determine a motion vector of the current block. The video coder may also determine a predictive block based on the motion vector of the current block.

Abstract: A stereo imaging system comprises an observation instrument having an image acquisition unit for detecting first image data and second image data, which can be combined for stereo observation. There is provided at least one position sensor for detecting an orientation of the instrument in relation to a position reference. There is provided a control device that is operable in a first representation mode and a second representation mode, depending on the orientation of the instrument. The control device is configured for outputting an image signal, which comprises a stereo signal that is based on the first image data and the second image data in the first representation mode, and a mono signal that is based on the first image data or the second image data in the second representation mode. The control device is configured to erect images that are output with the image signal in the second representation mode, depending on the orientation.

Abstract: The present invention relates to the performance of motion vector refinement in a search space for multi-reference inter-prediction. Two or more reference pictures are selected, one of those used for motion vector refinement. Based on an initial estimate of a motion vector to the reference picture for motion vector refinement, a search space in this reference image is constructed. Using template matching, the first motion vector is refined. The second motion vector to another reference picture is calculated using its initial estimate, the initial estimate of the first motion vector and the refined first motion vector.

Abstract: Techniques are described herein for processing video data. For instance, a process can include obtaining encoded video data. The process can include determining an intersection of values between values for a first termination byte of a first parcel of the encoded video data and values of a second termination byte of a second parcel of the encoded video data. The process can further include determining a joint termination byte for the first termination byte of the first parcel and the second termination byte of the second parcel. Values for the joint termination byte are based on the intersection of values. The process can include generating entropy coded data including the joint termination byte for the first parcel and the second parcel. The entropy coded data can be generated using arithmetic coding or binary coding.

Abstract: An object tracking apparatus, method and computer-readable medium for detecting an object from output information of sensors, tracking the object on a basis of a plurality of detection results, generating tracking information of the object represented in a common coordinate system, outputting the tracking information, and detecting the object on a basis of the tracking information.

Abstract: A pixel array includes octagon-shaped pixel sensors and a combination of visible light pixel sensors (e.g., red, green, and blue pixel sensors) and near infrared (NIR) pixel sensors. The color information obtained by the visible light pixel sensors and the luminance obtained by the NIR pixel sensors may be combined to increase the low-light performance of the pixel array, and to allow for low-light color images in low-light applications. The octagon-shaped pixel sensors may be interspersed in the pixel array with square-shaped pixel sensors to increase the utilization of space in the pixel array, and to allow for pixel sensors in the pixel array to be sized differently. The capability to accommodate different sizes of visible light pixel sensors and NIR pixel sensors permits the pixel array to be formed and/or configured to satisfy various performance parameters.

Abstract: In one embodiment, a computing system may access first alpha values associated with first pixels in a first pixel region of an image and determine a bit budget for encoding the first alpha values. The computing system may then select a first alpha-encoding mode for the first alpha values to reflect a determination that the first alpha values are all fully transparent or all fully opaque, and encode the first alpha values by storing the selected first alpha-encoding mode as part of a metadata without using the bit budget to encode the first alpha values individually. The computing system may then update a record of unallocated bits available for allocation based on the bit budget unused in the encoding of the first alpha values, and allocate, based on the record of unallocated bits, bits to encode a set of alpha values different from the first alpha values.

Abstract: Method and apparatus of video coding using decoder derived motion information based on bilateral matching or template matching are disclosed. According to one method, merge index for merge candidate group comprising bilateral matching merge candidate and/or template matching merge candidate are signalled using different codewords. According to another method, the first-stage MV or the first-stage MV pair is used as an only initial MV or MV pair or used as a central MV of search window for second-stage search. According to yet another method, after the reference template for a first reference list is found, the current template is modified for template search in the other reference list. According to yet another method, the sub-PU search is disabled for the template search. According to yet another method, block difference calculation is based on reduced bit depth during MV search associated with the decoder-side MV derivation process.

Abstract: There is provided an encoding device, an encoding method, a decoding device, and a decoding method capable of generating a more accurate three-dimensional model. A three-dimensional model generating unit generates three-dimensional model information representing a three-dimensional model of a subject on the basis of a plurality of captured images and active depth information, and a conversion processing unit converts the three-dimensional model represented by the three-dimensional model information into a plurality of two-dimensional images by projecting the three-dimensional model from a plurality of directions, and generates depth information representing a depth from an arbitrary viewpoint to the three-dimensional model by using the plurality of two-dimensional images. Then, transmit data including the plurality of two-dimensional images, the depth information, and the active depth information is transmitted to the decoding device.

Abstract: Disclosed herein is a system for providing a low-latency transmission between a client and a server. The client may be a thin client that leverages a codec to receive data transmissions from the server over a dedicated connection and need not require significant processing power. The client-server system has additional capabilities for reducing latency, including providing a view port for viewing portions of documents in a buffer cache and providing a method for blending image content by applying an alpha coefficient to separated red, blue, and green image components.

Abstract: A video encoder including a first buffer containing a plurality of data values defining a macroblock of pixels of a video frame. The video encoder also includes a second buffer and an entropy encoder coupled to the first and second buffers and configured to encode a macroblock based on another macroblock. The entropy encoder identifies a subset of the data values from the first buffer defining a given macroblock and copies the identified subset to the second buffer, the subset of data values being just those data values used by the entropy encoder when subsequently encoding another macroblock.