Abstract: A system that facilitates collecting data is described herein. The system includes a digital camera that is configured to capture images in a visible light spectrum and a near-infrared camera that is configured to capture near infrared images, wherein a field of view of the digital camera and the field of view of the near-infrared camera are substantially similar. The system further includes a trigger component that is configured to cause the digital camera and the near-infrared camera to capture images at a substantially similar point in time, and also includes a mounting mechanism that facilitates mounting the digital camera and the near-infrared camera to an automobile.

Abstract: This disclosure relates to video coding and more particularly to techniques for performing motion vector prediction. According to an aspect of an invention, a motion vector and a corresponding reference picture identifier for the motion vector are received; a reference picture corresponding to a second motion vector is determined based on the reference picture corresponding to the received motion vector and a current picture; a scaling value is determined based on the determined reference picture, the reference picture corresponding to the received motion vector, and the current picture; and the second motion vector is generated from the received motion vector by scaling with the scaling value.

Abstract: Apparatus and methods for video processing are described. An exemplary method for video processing includes: determining non-updated motion information associated with a current block; updating the non-updated motion information based on multiple decoder-side motion vector derivation (DMVD) methods to generate updated motion information for the current block; and performing, based on the updated motion information, a conversion between the current block and a bitstream representation of a video including the current block.

Abstract: A method and apparatus of video encoding video coding for a video encoder or decoder using Neural Network (NN) are disclosed. According to this method, the multiple frames in a video sequence comprises multiple segments, where each of the multiple segments comprises a set of frames. The NN (Neural Network) processing is applied to a target signal in one or more encoded frames of a target segment in the encoder side or to the target signal in one or more decoded frames of the target segment in the decoder side using one NN parameter set for the target segment. The target signal may correspond to reconstructed residual, reconstructed output, de-blocked output, SAO (sample adaptive offset) output, ALF (adaptive loop filter) output, or a combination thereof. In another embodiment, the NN processing is applied to a target signal only in one or more specific encoded or decoded frames.

Abstract: Exemplary video processing methods and apparatuses for encoding or decoding a current block by bi-directional prediction. Multiple weight sets are utilized for blending List 0 and List 1 predictors, and the selection among multiple weight sets may be implicitly determined based on video information. Each weight set is composed of multiple candidate weights, and one candidate weight is selected for the current block. A weight pair associated with the selected weight for the current block is used for weighted averaging List 0 and List 1 predictors of the current block to generate a final inter predictor. The video processing methods and apparatuses encode or decode the current block according to the final inter predictor of the current block.

Abstract: An image decoding method includes: acquiring, from a bitstream, luma weight L0 flag information indicating whether there is an L0 prediction-related weight factor and luma weight L1 flag information indicating whether there is an L1 prediction-related weight factor; determining to apply decoder-side motion vector refinement (DMVR) to an L0 motion vector and L1 motion vector for a current block, when the luma weight L0 flag information and the luma weight L1 flag information are both zero; when it has been determined to apply DMVR, deriving a refined L0 motion vector and a refined L1 motion vector by applying the DMVR to the current block; deriving prediction samples for the current block on the basis of L0 prediction using the refined L0 motion vector and L1 prediction using the refined L1 motion vector; and generating reconstruction samples for the current block on the basis of the prediction samples.

Abstract: According to the disclosure of the present document, in a subblock-based temporal motion vector prediction (sbTMVP), a position of a subblock for deriving a motion vector per subblock unit can be efficiently calculated, and thus video/image coding efficiency can be increased and hardware implementation can be simplified.

Abstract: The present disclosure provides methods and systems for executing a neural network. The method includes: receiving a plurality of input vectors of input data; generating, among the plurality of input vectors, an estimation value associated with a subset of an input vector based on a weight vector of the activation function; determining whether the estimation value associated with the subset of the input vector satisfies a threshold condition; and determining an output of the activation function based on the estimation value.

Abstract: A head-mounted display device interfaces with a blood processing machine. The display device has a frame for mounting on a person's head and configured to hold a lens in front of an eye of a wearer. The display device has a display, a wireless circuit configured to communicate with a network, a camera, and a processing circuit. The processing circuit retrieves instructions for servicing the blood processing machine and overlays indicators, text, highlighting and/or icons on the blood processing machine as seen from a field of view of the wearer based on the instructions. The wearer is thereby assisted in servicing the blood processing machine.

Abstract: A method of generating a prediction for an area of video data, comprises Receiving a rectangular video block including sample values, and for each sample included in the video block, generating a predictive sample value by averaging a horizontal interpolation and a vertical interpolation corresponding to the location of the sample within the video block.

Abstract: A method of processing video data includes determining, by processing circuitry, a plurality of neighboring samples for predicting a current block. The plurality of neighboring samples are arranged outside of a region of a current picture, the region comprising the current block, a row of samples adjacent to a top row of the current block, and a column of samples adjacent to a left column of the current block. The method further comprises deriving, by the processing circuitry, local illumination compensation information for the current block using the plurality of neighboring samples and generating, by the processing circuitry, a prediction block using the local illumination compensation information.

Abstract: A method, computer program, and computer system is provided for coding video data. Video data including (1) a first frame comprising a first current view and a first reference view and (2) a second frame comprising a second current view and a second reference view is received. A co-located block in the first reference view is identified for a current block in the first current view. A predicted offset vector is calculated based on the motion vector between the co-located block and its reference block in the second reference view. The video data is encoded/decoded based on the predicted offset vector.

Abstract: An imaging system is provided comprising: a memory storing instructions which, when executed by processing circuitry, cause the processing circuitry to perform operations comprising: determining multiple image regions of interest (ROIs) within a camera image plane that correspond to one or more three-dimensional (3D) world object images; determining multiple radar ROIs that correspond to one or more 3D world objects; determining 3D world distances corresponding to the radar ROIs; determining multiple co-registered ROI pairs by co-registering individual image ROIs with individual radar ROIs corresponding to common 3D world objects; adjusting one or more parameters associated with the camera, based upon the co-registered ROI pairs.

Abstract: An image decoding method according to the present invention can comprise the steps of: deriving merge candidates from neighboring blocks adjacent to a current block; generating a merge candidate list including the merge candidates, wherein the arrangement order of the merge candidates in the merge candidate list is determined on the basis of initial priorities; re-arranging the merge candidates included in the merge candidate list; decoding information for specifying at least one of the merge candidates included in the merge candidate list; and deriving motion information of the current block from a merge candidate corresponding to the information.

Abstract: A method of decoding a bitstream by an electronic device is provided. Encoded data is received for at least one image frame each including one or more regions. A first affine flag is determined from a first syntax structure associated with the at least one image frame when an affine mode including affine tools is enabled in the at least one image frame. A second affine flag is present in the first syntax structure when the first affine flag is equal to one. A third affine flag corresponding to one of the affine tools is present in a second syntax structure associated with a specific one of the one or more region when the second affine flag is equal to one. The specific region is reconstructed based on first candidate modes including the one of the affine tools when the third affine flag is equal to zero.

Abstract: Provided is a video decoding method including obtaining, from a bitstream, split information indicating whether a current block is to be split; when the split information does not indicate that the current block is to be split, decoding the current block according to encoding information about the current block; and when the split information indicates that the current block is to be split, splitting the current block into at least two lower blocks, obtaining encoding order information indicating an encoding order of the at least two lower blocks of the current block from the bitstream, determining a decoding order of the at least two lower blocks according to the encoding order information, and decoding the at least two lower blocks according to the decoding order.

Abstract: Systems and methods for detecting screen contents and adaptive enablement of screen content coding modes. Encoding mode decision may be made adaptive to include or exclude screen content coding (SCC) modes. In some embodiments, a screen content decision is based on one or more statistics characterizing a distribution of meaningful colors (e.g., chroma) and/or intensities (e.g., luma) determined for a population of pixels of an input picture. In some embodiments, a screen content decision is based on one or more statistics characterizing the pure flat area of an input picture and the area with extreme sharp edges. Pictures may be encoded according to a mode selection that is adaptive to the screen content decision, for example selecting between encoding modes that include SCC modes, or selecting between encoding modes that exclude SCC modes.

Abstract: A method and a device for encoding or decoding video data. It concerns more particularly the encoding according to a particular encoding mode using a decoder side motion vector derivation mode referenced as frame-rate up conversion mode or FRUC mode. In FRUC merge mode, the derivation process comprises a refinement step to increase the accuracy of the obtained motion vector at the sub-pixel level. This process involves the evaluation of different sub-pixel position around the obtained motion vector according to different patterns. The present invention has been devised to improve the known refinement step. It aims at improving the coding efficiency by considering the characteristics of the matching type and/or the signal inside the templates.

Abstract: An image encoding/decoding method and apparatus for performing representative sample-based intra prediction are provided. An image decoding method may comprise deriving an intra prediction mode of a current block, configuring a reference sample of the current block, and performing intra prediction for the current block based on the intra prediction mode and the reference sample, wherein the intra prediction is representative sample-based prediction.

Abstract: A method, computer program, and computer system is provided for video coding. Coded syntax elements corresponding to wrap-around padding process are decoded. At least one coded current picture is reconstructed using wrap-around padding process. The syntax elements indicate an offset value for wrap-around processing; or left and right padding width information. A flag indicates whether syntax elements corresponding to wrap-around padding process is present in parameter set. A pixel position for motion compensated prediction in a reference picture is determined by interpreting the syntax elements corresponding to wrap-around padding process with a clipping process.