Abstract: A method of encoding data includes: receiving an input data set having an arbitrary size about a height dimension and a width dimension; padding the input data set according to a padding function selected from a set of padding functions, such that a data set having a desired size about the height dimension and the width dimension is obtained; generating an output data set by performing a discrete convolution on the obtained data set; and generating a signal providing information corresponding to the output data set and the selected padding function.

Abstract: A method for encoding a volumetric video content representative of a 3D scene is disclosed. The method comprises obtaining a reference viewing box and an intermediate viewing box defined within the 3D scene. For the reference viewing bounding box, the volumetric video reference subcontent is encoded as a central image and peripheral patches for parallax. For the intermediate viewing bounding box, the volumetric video intermediate sub-content is encoded as intermediate central patches which are differences between the intermediate central image and the reference central image.

Abstract: An automatic measuring system containing configurable integrated circuits is able to process information via captured images. The automatic measuring system includes a metering instrument, a camera, a recognition module, and a localization module. The metering instrument has at least one display for visually displaying a number and measures the amount of measurable substance or resources (i.e., electricity and water) consumed. The camera captures an image of the number representing at least a portion the amount of measurable substance. The recognition module is operable to generate a value in response to the image and the coordinates wherein the coordinates are used to decode the image via restoring captured image to the original readout counter value. The localization module is removably or remotely coupled to the camera and operable to generate the coordinates in accordance with the image captured by the camera.

Abstract: A system for implementation of region of interest-based streaming is disclosed. The system includes an image acquisition unit to capture a stream of images. The system also includes a connection interface including a video class extension module to provide coordinates corresponding to the region of interest of the stream of images. The connection interface includes a descriptor module to receive capabilities associated with the stream of images. The capabilities include an initial frame size, a predefined data format and a region of interest. The descriptor module streams the predefined data format by representing the predefined data format as a compressed data format thereby streaming the initial frame size dynamically in a single video stream format and a video frame configuration. The system includes a streaming application layer to analyze the initial frame size and the compressed data format based on the coordinates.

Abstract: A decoding method and apparatus are provided. A first candidate having a first motion vector that has been used to decode a first block, a first prediction direction that corresponds to the first motion vector, and a first reference picture index that identifies a first reference picture is derived. A second candidate having a second motion vector that has been used to decode a second block, a second prediction direction that corresponds to the second motion vector, and a second reference picture index that identifies a second reference picture is derived. When a total number of candidates is less than a maximum number, a third candidate is derived by combining the first motion vector and the first reference picture index for the first prediction direction of the first candidate and the second motion vector and the second reference picture index for the second prediction direction of the second candidate.

Abstract: A 3D image-capturing device that includes at least one camera that acquires a 2D image and distance information of an object, a monitor that displays the 2D image acquired by the camera, and at least one processor including hardware. The processor acquires a first area for which the distance information is not required in the 2D image displayed on the monitor, and sets an image-capturing condition so that the amount of distance information acquired by the camera in the acquired first area is less than or equal to a prescribed first threshold and the amount of distance information acquired by the camera in a second area, which is at least part of an area other than the first area, is greater than a prescribed second threshold that is larger than the first threshold.

Abstract: An imaging system is configured to use an array of time-of-flight (ToF) pixels to determine depth information using the ToF imaging method and/or the stereo imaging method. A light emitting component emits light to illuminate a scene and a light detecting component detects reflected light via the array of ToF pixels. A ToF pixel is configured to determine phase shift data based on a phase shift between the emitted light and the reflected light, as well as intensity data based on an amplitude of the reflected light. Multiple ToF pixels are shared by a single micro-lens. This enables multiple offset images to be generated using the intensity data measured by each ToF pixel. Accordingly, via a configuration in which multiple ToF pixels share a single micro-lens, depth information can be determined using both the ToF imaging method and the stereo imaging method.

Abstract: A method of decoding a coded video bitstream is provided. The method includes receiving a bitstream containing an external decoder refresh (EDR) picture and a list of pictures for the EDR picture. The list of pictures lists pictures referred to by entries in a first reference picture list, pictures referred to by entries in a second reference picture list, and external pictures in increasing decoding order. A difference between picture order count values for any two consecutive pictures in the list of pictures is greater than one half of a negative of maximum picture order count least significant bits and less than one half of the maximum picture order count least significant bits. The method further includes obtaining an external picture from the the external pictures referred to in the list of pictures and decoding the EDR picture using the external picture that was obtained.

Abstract: Aspects of the disclosure provide methods and apparatuses for video processing. In some examples, an apparatus for video processing includes processing circuitry. For example, processing circuitry determines a frame interval for a current block in a current frame within a sequence of frames. The frame interval indicates a group of frames in the sequence of frames with collocated blocks of the current block that satisfy an error metric requirement comparing to the current block. Further, the processing circuitry determines a replacement block based on the collocated blocks in the group of frames, and replaces the current block in the current frame with the replacement block.

Abstract: Systems and methods are provided for a compact eye-tracking camera assembly. The camera incorporates a lens and image sensor whose principal axis is parallel to the plane of the display surface, and a compound angle mirror configured to redirect incident IR light along the principal axis. The compound angle mirror has a first angle of approximately 45 degrees relative to a first axis, and a second angle of approximately 15-22 degrees (e.g., 18 degrees) relative to a second axis that is orthogonal to the first axis. The first and second axes are substantially parallel to the plane of the display surface.

Abstract: A device for restoring a degraded frame resulting from reconstruction of a source frame includes a processor that is configured to receive a compressed bitstream. The compressed bitstream includes a first projection parameter ? a second projection parameter ?, first restoration parameters comprising a first radius value, and second restoration parameters comprising a second radius value. The processor is further configured to restore at least a portion of the degraded frame using a projection operation that uses the first projection parameter ?, the second projection parameter ?, and at least two guide tiles.

Abstract: A vehicular vision system includes a first camera and a second camera. The system includes an electronic control unit (ECU) and a video display operable to display video images derived from frames of first image data captured by the first camera and frames of second image data captured by the second camera. Responsive to a view selection input selecting a view for the video display, the system (i) determines a first subset of pixels based on tracing rays from pixels of the video display the pixels of the first camera, and (ii) determines a second subset of pixels based on tracing rays from pixels of the video display to pixels of the second camera. The system buffers the first and second subset of pixels and generates display frames of image data using the buffered pixels. The system displays video images derived from the display frames of image data.

Abstract: This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.

Abstract: A two-pass encoding operation is implemented to encode one or more gaming frames into a game stream. The two-pass encoding operation includes a first encoding pass performed on a current frame. As a result of the first encoding pass, an estimated complexity for the current frame is determined. The resulting estimated complexity is then modulated according to a quality difference between reference frames used during the first pass encoding and a subsequent second pass encoding. Based on the modulated complexity, a quantization parameter is determined for the current frame that is then used to perform a second pass encoding on the current frame, resulting in an encoded frame. This encoded frame is then transmitted as part of a stream to a client system.

Abstract: This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.

Abstract: Methods and apparatus for video processing are described. The video processing may include video encoding, video decoding or video transcoding. One example video processing method includes performing a conversion between a video comprising a picture in a video unit and a bitstream of the video according to a format rule. The format rule specifies that, responsive to a width of a picture being equal to a maximum allowed picture width in the video unit and a height of the picture being equal to a maximum allowed picture height in the video unit, a conformance window flag in a picture parameter set corresponding to the picture is set to a zero value.

Abstract: This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.

Abstract: This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.

Abstract: Systems, apparatuses, and methods for performing machine learning content categorization leveraging video encoding pre-processing are disclosed. A system includes at least a motion vector unit and a machine learning (ML) engine. The motion vector unit pre-processes a frame to determine if there is temporal locality with previous frames. If the objects of the scene have not changed by a threshold amount, then the ML engine does not process the frame, saving computational resources that would typically be used. Otherwise, if there is a change of scene or other significant changes, then the ML engine is activated to process the frame. The ML engine can then generate a QP map and/or perform content categorization analysis on this frame and a subset of the other frames of the video sequence.

Abstract: The present disclosure relates to improvement on overlapped block motion compensation. A method for video processing comprises: determining, during a conversion between a current block and a bitstream representation of the current block, a motion vector for a first sub-block inside the current block; using overlapped block motion compensation (OBMC) mode to perform the conversion; wherein the OBMC mode uses intermediate prediction values of the first sub-block based on the motion vector of the first sub-block and prediction values of at least a second video unit that is neighboring the first sub-block to generate final prediction values for the first sub-block; wherein a sub-block size of the first sub-block is based on block size, block shape, motion information, or reference picture of the current block.