Abstract: Devices, systems and methods for digital video coding, which includes an overlapped block motion compensation (OBMC) process based on temporal neighbors, are described. An exemplary method for video processing includes generating, based on a weighted sum of at least two temporary prediction blocks, a prediction block for a current video block, a first of the at least two temporary prediction blocks being based on a first motion information associated with the current video block, a second of the at least two temporary prediction blocks being based on a second motion information associated with at least one neighboring block of the current video block, and the at least one neighboring block including a temporally neighboring block, and performing, based on the prediction block, a conversion between the current video block and a bitstream representation of the current video block.

Abstract: An observation instrument has a shaft and an imaging unit, the imaging unit comprising an objective lens system and an electronic image sensor arranged for picking up an image generated by the objective lens system, the imaging unit being pivotably arranged in a distal end section of the shaft, a pivot axis of the imaging unit being transverse to a longitudinal axis of the distal end section of the shaft, wherein the image sensor is arranged substantially parallel to an optical axis of the objective lens system and the imaging unit comprises a deflection element for deflecting light exiting from an image end of the objective lens system to an image pick-up surface of the image sensor. The invention also relates to a video imager arrangement for an observation instrument.

Abstract: Embodiments disclose a real-time surgery method and apparatus for displaying a stereoscopic augmented view of a patient from a static or dynamic viewpoint of the surgeon, which employs real-time three-dimensional surface reconstruction for preoperative and intraoperative image registration. Stereoscopic cameras provide real-time images of the scene including the patient. A stereoscopic video display is used by the surgeon, who sees a graphical representation of the preoperative or intraoperative images blended with the video images in a stereoscopic manner through a see-through display.

Abstract: The present invention relates to a method for signaling image information and to a decoding method using same. The method for signaling image information according to the present invention comprises: a step of performing inter-prediction for a current picture; and a step of signaling information including the result of said inter-prediction and reference picture information indicating reference pictures usable in said inter prediction, wherein said reference picture information contains pieces of picture order count (POC) information of said usable reference pictures. The POC information of said usable reference pictures in said reference picture information is configured such that POCs for the pictures existing before said current picture in terms of a POC sequence are located at the front, and POCs for the pictures existing after said current picture in terms of a POC sequence are located following the POCs located at the front.

Abstract: A method of decoding an encoded video bitstream using at least one processor includes obtaining a coded video sequence from the encoded video bitstream; obtaining a first syntax element indicating a number of a plurality of layers included in the coded video sequence; obtaining a second syntax element indicating whether the plurality of layers included in the coded video sequence are all independent layers; based on the first syntax element indicating that the number of the plurality of layers is greater than one, and the second syntax element indicating that the plurality of layers are not all the independent layers, obtaining a third syntax element indicating an output mode; determining the output mode based on the third syntax element; determining one or more output layers from among the plurality of layers based on the determined output mode; and outputting the one or more output layers.

Abstract: Provided is an encoder including circuitry and memory coupled to the circuitry. A prediction mode for a current block is an affine mode, and in operation, the circuitry: derives a base motion vector which is a motion vector to be used in a prediction process for the current block, and is a motion vector at an affine-mode control point in the current block; derives a first motion vector different from the base motion vector; derives a motion vector difference based on a difference between the base motion vector and the first motion vector; determines whether the motion vector difference is greater than a threshold; if so, modifies a second motion vector different from the base motion vector and the first motion vector, and if not, does not modify the second motion vector; and encodes the current block using the second motion vector modified or the second motion vector not modified.

Abstract: Using the same image sensor to capture a two-dimensional (2D) image and three-dimensional (3D) depth measurements for a 3D object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor operates as a Time-to-Digital (TDC) converter to generate timestamps. A timestamp calibration circuit is provided on-board to record the propagation delay of each column of pixels in the pixel array and to provide necessary corrections to the timestamp values generated during 3D depth measurements.

Abstract: According to the disclosure of the present document, when the inter-prediction type of the current block indicates biprediction, weight index information for a candidate in a merge candidate list or sub-block merge candidate list can be derived, and coding efficiency can be raised.

Abstract: A moving picture coding apparatus includes an intra-inter prediction unit which calculates a second motion vector by performing a scaling process on a first motion vector of a temporally neighboring corresponding block, when selectively adding, to a list, a motion vector of each of one or more corresponding blocks each of which is either a block included in a current picture to be coded and spatially neighboring a current block to be coded or a block included in a picture other than the current picture and temporally neighboring the current block, determines whether the second motion vector has a magnitude that is within a predetermined magnitude or not within the predetermined magnitude, and adds the second motion vector to the list when the intra-inter prediction unit determines that the second motion vector has a magnitude that is within the predetermined magnitude range.

Abstract: A video coder performs a Most-Probable Mode (MPM) derivation process that derives one or more MPMs for a current block that is not coded using affine linear weighted intra prediction (ALWIP). As part of performing the MPM derivation process, the video coder determines whether a neighboring block of the current block is an ALWIP-coded neighboring block. Based on the neighboring block being an ALWIP-coded neighboring block, the video coder determines that a value of an intra prediction mode of the neighboring block is a value indicating a planar mode. The video coder codes the current block based on one of the MPMs for the current block.

Abstract: A method of video encoding includes determining whether a first block associated with a second block is to be predicted according to a block differential pulse code modulation (BDPCM) mode, and, in response to determining that the first block is to be predicted according to the BDPCM mode, associating the first block with an intra prediction mode value based on a BDPCM direction for the first block. The intra prediction mode value is selected from a plurality of intra prediction modes that include angular intra prediction modes. The method also includes determining an intra prediction mode value for the second block using the intra prediction mode value associated with the first block, and encoding the second block using the determined intra prediction mode value for the second block.

Abstract: An intelligent control method and system using a radar security camera are disclosed, wherein a target is detected by 360° radar sensing regardless of the rotation radius of a camera by using the security camera having a built-in radar, and the camera is enabled to track the target according to the moving direction and specific signs of the target after the target is identified as a person and a vehicle sequentially according to a decision priority order.

Abstract: Devices, systems and methods for the simplification of sub-block motion candidate lists for video coding are described. In a representative aspect, a method for video processing includes determining, for a conversion between a current block of a video and a bitstream representation of the video, one or more temporal motion vector prediction candidates for the current block and performing the conversion based on the one or more temporal motion vector prediction candidates. The one or more temporal motion vector prediction candidates are determined by identifying a first temporal adjacent block of the current block based on an initial motion vector, wherein the first temporal adjacent block includes invalid motion information, and examining additional temporal adjacent blocks of the current block to obtain the one or more temporal motion vector prediction candidates.

Abstract: Image rotation in an endoscopic laser mapping imaging system is described. A system includes an emitter for emitting pulses of electromagnetic radiation and an image sensor comprising a pixel array for sensing reflected electromagnetic radiation. The system includes a rotation sensor for detecting an angle of rotation of a lumen relative to a handpiece of an endoscope. The system is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter is a laser mapping pattern.

Abstract: Disclosed herein is a method of decoding an image. The method includes determining a prediction mode of a current block as a merge mode with motion vector difference (MMVD), deriving a merge candidate list of the current block, deriving a motion vector predictor of the current block using the merge candidate list, deriving a motion vector difference of the current block, and deriving a motion vector of the current block using the motion vector predictor and the motion vector difference. Only some of candidates in the merge candidate list are used to derive the motion vector predictor.

Abstract: An image decoding method according to the present invention includes: receiving information on a set of reference pictures for configuring a set of reference pictures of a current picture, wherein the information on the set of reference pictures includes the most significant bit (MSB) information that may calculate the MSB of the picture order count (POC) of a long-term reference picture relative to the current picture, and flag information that represents whether there is MSB information; and eliciting the set of reference pictures by using received MSB information when the flag information is 1, and performing marking on the reference picture, wherein the flag information may be 1 when a temporal sub-layer identifier is 0, and there is at least one POC value for which a remainder obtained by dividing by a maximum value MaxPicOrderCntLsb capable of being represented by the LSB is the same as the least significant bit (LSB) of the POC of the long-term reference picture, in a set of POCs of a previous picture

Abstract: Embodiments disclose a real-time surgery method and apparatus for displaying a stereoscopic augmented view of a patient from a static or dynamic viewpoint of the surgeon, which employs real-time three-dimensional surface reconstruction for preoperative and intraoperative image registration. Stereoscopic cameras provide real-time images of the scene including the patient. A stereoscopic video display is used by the surgeon, who sees a graphical representation of the preoperative or intraoperative images blended with the video images in a stereoscopic manner through a see-through display.

Abstract: Dynamic motion vector referencing is used to predict motion within video blocks. A motion trajectory is determined for a current frame including a video block to encode or decode based on a reference motion vector used for encoding or decoding one or more reference frames of the current frame. One or more temporal motion vector candidates are then determined for predicting motion within the video block based on the motion trajectory. A motion vector is selected from a motion vector candidate list including the one or more temporal motion vector candidates and used to generate a prediction block. The prediction block is then used to encode or decode the video block. The motion trajectory is based on an order of video frames indicated by frame offset values encoded to a bitstream. The motion vector candidate list may include one or more spatial motion vector candidates.

Abstract: An image decoding method comprises the steps of: determining whether or not an application condition of decoder-side motion vector refinement (DMVR) for applying motion vector refinement for a current block is satisfied; deriving a minimum sum of absolute differences (SAD) on the basis of L0 and L1 motion vectors of the current block if the application condition of the DMVR is satisfied; deriving refined L0 and L1 motion vectors of the current block based on the minimum SAD; deriving prediction samples of the current block based on the refined L0 and L1 motion vectors; and generating reconstructed samples of the current block based on the prediction samples. With respect to whether or not the application condition of the DMVR is satisfied, the application condition of the DMVR is determined to be satisfied if a prediction mode, in which inter-prediction and intra-prediction are combined, is not applied to the current block.

Abstract: Pupillometry systems for measuring pupillary characteristics of a patient are shown and described. The pupillometry systems include at least one camera, and a computer system in data communication with the at least one camera, the computer system having a processor and a non-transitory computer-readable storage medium. The non-transitory computer-readable storage medium includes computer-readable instructions for collecting and time stamping the image data, processing the raw image data in such a way as to bring the images into conformance with standardized image parameters, identifying and measuring the one or more pupils in the image data, processing the image data to produce measurement data of change in the one or more pupillary characteristics, calculating a standardized output of measurement data for the one or more pupillary characteristics, and providing a mechanism to share or store this information with other users via a computer network.