Abstract: A method in a rate adaptive system includes categorizing, by an encoder, a plurality of clusters of data in a segmented image into one of a plurality of categories corresponding to a different predetermined label with a predetermined priority level; vectorizing, by the encoder, the data to generate a sparse vector xi for its corresponding label; encoding, by the encoder, a plurality of the sparse vectors xi by multiplying a measurement matrix Ai(t) with the sparse vector xi to generate a set of encoded information yi; transmitting, by the encoder to the decoder, the plurality of sets of the encoded information yi in a prioritized order; decoding, by the decoder, the plurality of sets of encoded information yi to determine the plurality of the sparse vectors xi based on determining measurement matrix Ai(t); and uniting the plurality of the sparse vectors xi into a single image frame.

Abstract: A method of controlling one or more z-cameras from a set of cameras to obtain image streams capturing an object of interest; it includes receiving position data and object data corresponding to the object of interest; determining a subset of the one or more z-cameras having a zone of potential coverage comprising the object of interest; computing the relative position of the object of interest with respect to the center of the field of view of the z-camera; computing a zoom factor calculated by determining a narrowest field of view angle of the z-camera that encompasses the object of interest; and generating transmission commands for the subset of the one or more z-cameras based on the computed zoom factor.

Abstract: Apparatus for generating a two-dimensional illumination pattern of light beams, including: controller; a micromirror array; illuminator; collector; and a microlens array; wherein the controller is configured for tilting the micromirrors such that in the Fourier plane of the collector, intensity maxima of light collected by the collector can be generated, wherein the intensity maxima are each allocated to one of the microlenses, wherein from the respectively generated intensity maximum one of the light beams is generated by the respectively allocated microlens.

Abstract: A three-dimensional data encoding method of encoding three-dimensional points each having an attribute information item includes: classifying each of the three-dimensional points into any of layers including a first layer and a second layer; and arithmetic-encoding an attribute information item of a current three-dimensional point among the three-dimensional points with reference to a first encoding table when the current three-dimensional point is at the first layer, and with reference to a second encoding table not dependent on the first encoding table when the current three-dimensional point is at the second layer.

Abstract: A method for decoding an image according to the present invention may comprise the steps of: deriving a residual coefficient of a current block; dequantizing the residual coefficient; deriving a common residual signal by performing inverse transform of the dequantized residual coefficient; and deriving a first residual signal of a first chroma component and a second residual signal of a second chroma component on the basis of the common residual signal.

Abstract: Devices, systems and methods for digital video coding, which includes matrix-based intra prediction methods for video coding, are described. In a representative aspect, a method for video processing includes performing a conversion between a current video block of a video and a bitstream representation of the current video block using a matrix based intra prediction (MIP) mode in which a prediction block of the current video block is determined by performing, on previously coded samples of the video, a boundary downsampling operation, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation, where the performing the conversion includes deriving, according to a rule, boundary samples by applying a left bit shift operation or a right bit shift operation on a sum of at least one reference boundary sample, and where the rule determines whether to apply the left bit shift or the right bit shift operation.

Abstract: According to one embodiment, an electronic device includes one or more processors. The one or more processors obtain an image captured by a camera with a filter having a first area transmitting light of a first wavelength range and a second area transmitting light of a second wavelength range. The image includes a first color-component image based on the light of the first wavelength range and a second color-component image based on the light of the second wavelength range. The one or more processors notify a user of an effective area for calculation of depth information based on a bias of color information in the first color-component image and the second color-component image.

Abstract: A video decoder can be configured to determine a predicted luma quantization parameter (QP) for a luma component of a coding unit; receive, in the bitstream of encoded video data, first syntax indicating a luma delta QP value for the luma component; determine a QP value for the luma component based on the predicted luma QP and the luma delta QP value; determine a predicted chroma QP for a chroma component of the coding unit; receive, in the bitstream of encoded video data, second syntax indicating a chroma delta QP value for the chroma component of the coding unit; and determine a QP value for the chroma component of the coding unit based on the predicted chroma QP and the chroma delta QP value.

Abstract: An unmanned aerial vehicle (UAV) includes a fuselage, a gimbal-mounted turret having one or more degrees of freedom relative to the fuselage, a camera disposed in the gimbal-mounted turret for motion therewith in the one or more degrees of freedom, and a central video image processor disposed exteriorly of the gimbal-mounted turret, the central video image processor configured to receive and process image data from the camera.

Abstract: An image encoding device (1) includes a motion compensation predictor (109) configured to generate a prediction image corresponding to a target image by performing motion compensation prediction using a plurality of reference images, and an evaluator (111) configured to evaluate prediction accuracy of the prediction image for each image portion including one or more pixels by calculating a degree of similarity between the plurality of reference images for each image portion.

Abstract: The disclosure is directed to providing operator visibility through an object that occludes the view of the operator by using a HMD system in communication with one or more imaging devices. A method of doing so may include: using one or more imaging devices coupled to an exterior of an object to capture image data of a real-world environment surrounding the object: calculating an orientation of a HMD positioned in an interior of the object; using at least the calculated orientation of the HMD, synthesizing a FOV of the image data with a FOV of the HMD; and rendering the synthesized FOV of the image data to the HMD. In some instances, the captured image data is used to create a three-dimensional model of the real-world environment, and synthesizing the FOV of the image data includes synthesizing a FOV of the 3D model with the FOV of the HMD.

Abstract: The present disclosure provides systems and methods for medical imaging. The system may comprise an optical adapter. The optical adapter may comprise a housing that comprises (1) a first end configured to releasably couple to a scope and (2) a second end configured to releasably couple to a camera. The optical adapter may comprise an image sensor coupled to the housing. The optical adapter may comprise an optics assembly disposed in the housing. The optics assembly may be configured to (1) receive light signals that are reflected from a target site within a subject's body and transmitted through the scope, and (2) reflect a first portion of the light signals onto the image sensor while permitting a second portion of the light signals to pass through to the camera.

Abstract: A method for video processing is provided to include performing, for a conversion between a current video block of a video and a coded representation of the video, a motion information refinement process based on samples in a first domain or a second domain; and performing the conversion based on a result of the motion information refinement process, wherein, during the conversion, the samples are obtained for the current video block from a first prediction block in the first domain using an unrefined motion information, at least a second prediction block is generated in the second domain using a refined motion information used for determining a reconstruction block, and reconstructed samples of the current video block are generated based on the at least the second prediction block.

Abstract: Given a sequence of images in a first codeword representation, methods, processes, and systems are presented for image reshaping using rate distortion optimization, wherein reshaping allows the images to be coded in a second codeword representation which allows more efficient compression than using the first codeword representation. Syntax methods for signaling reshaping parameters are also presented.

Abstract: Transform-level partitioning of a prediction residual block is performed to improve compression efficiency of video data. During encoding, a prediction residual block is generated responsive to prediction-level partitioning performed against a video block, a transform block partition type to use is determined based on the prediction residual block, a non-recursive transform-level partitioning is performed against the prediction residual block according to the transform block partition type, and transform blocks generated as a result of the transform-level partitioning are encoded to a bitstream.

Abstract: Provided are a video picture component prediction method and apparatus, and a computer storage medium.

Abstract: An imaging system includes an image sensor and an image signal processor (ISP). The image sensor generates image data including a set of pixel values. The ISP defines a first subset of pixel values from the set of pixel values. The first subset of pixel values corresponds to at least one region of interest. The ISP defines a second subset of pixel values that is complementary to the first subset of pixel values. The ISP generates a first sub-image based on the second subset of pixel values. The ISP processes the first subset of pixel values to generate a second sub-image. Processing the first subset of pixel values includes at least one of changing a color of one or more pixel values from the first subset of pixel values and scaling the first subset of pixel values. The ISP merges the first and second sub-images to generate an output image.

Abstract: A gaze tracking system includes a contact lens, a photodetector element, a light conditioning element and electronics. The contact lens includes a fiducial having a position. The photodetector element receives a light signal from the fiducial and provides a photodetector output signal. The light signal provides a light intensity pattern at the photodetector. The optical conditioning element receives the light signal and provides a variation in the light intensity pattern on the photodetector in response to changes in the position of the fiducial. And the electronics process the photodetector output signal to calculate the position of the fiducial. A method includes detecting a light signal from a fiducial included in a contact lens, and tracking the contact lens by analyzing the light signal.

Abstract: An infrared imaging apparatus having thin film spatial filters in a stacked array to filter and collate light generated internally by the infrared imaging apparatus such that the light generated impacts a detection area of the imaging apparatus at or near a critical angle. The index of refraction of the detection area being subject to change when irradiated with infrared light such that the amount of light generated internally and reflected to a light detector attached to the imaging apparatus varies with the intensity of the irradiating infrared light.

Abstract: An encoder includes processing circuitry and a memory coupled to the processing circuitry. Using the memory, the processing circuitry is configured to: change values of pixels in a first block and a second block to filter a boundary between the first block and the second block, using clipping such that change amounts of the respective values do not exceed respective thresholds, the pixels in the first block and the second block being arranged along a line across the boundary. The pixels include type one pixels and type two pixels different from the type one pixels. The respective thresholds for the type one pixels in the first block and the second block are selected to be symmetrical or asymmetrical with respect to the boundary based on block sizes of the first block and the second block.