Abstract: A method of performing background light subtraction in an infra-red (IR) illuminated image depicting a scene, comprises: providing a rolling shutter image sensor; providing an IR light source configured to be turned on and off; changing an on-off status of the IR light source a plurality of times while capturing an image; capturing two or more image frames each image frame comprising: a first set of lines of pixels comprising image data captured with the IR light turned on; a second set of lines of pixels comprising image data captured with the IR light turned off; creating an IR-illuminated image; creating a non-IR-illuminated image; subtracting background light from the IR-illuminated image using pixel values in the non-IR-illuminated image.

Abstract: Provided are a color interpolation method and an image acquisition device for a multispectral filter array. The color interpolation method includes acquiring a raw multispectral image on the basis of a multispectral filter array, generating a guide image for color interpolation of the raw multispectral image, generating a difference image between the raw multispectral image and the guide image, generating a demosaiced difference image by performing color interpolation based on the difference image, and generating a demosaiced multispectral image based on the demosaiced difference image and the guide image.

Abstract: A video coding mechanism is disclosed. The mechanism includes receiving a bitstream comprising a slice and a plurality of adaptation parameter sets (APSs) including a plurality of APS types, wherein each APS includes an APS identifier (ID), and wherein APS IDs for the APS types are assigned in sequence over a plurality of different value spaces. The mechanism further includes decoding the slice using parameters from the plurality of APSs. The mechanism further includes forwarding the slice for display as part of a decoded video sequence.

Abstract: An electronic apparatus performs a method of decoding video data. The method includes receiving, from a video bitstream having a hierarchical structure, a first syntax element associated with a first level of the hierarchical structure, in accordance with a determination that the first syntax element indicates that a Cross-Component Sample Adaptive Offset (CCSAO) filter information is present in the first level, reconstructing, from the video bitstream, one or more regions under the first level jointly according to the CCSAO filter information, and in accordance with a determination that the first syntax element indicates that the CCSAO filter information is not present in the first level, reconstructing, from the video bitstream, the one or more regions separately according to the CCSAO filter information present in a second level of the hierarchical structure.

Abstract: An image sensor, including a photosensitive pixel array, a storage element, and a displacement processing element, is provided. The photosensitive pixel array includes a photosensitive pixel. The storage element is configured to store a first sensing result of the photosensitive pixel at a first time point. The displacement processing element is coupled to the storage element to receive the first sensing result. The displacement processing element is configured to generate displacement information, wherein an image frame with the displacement information is transmitted to the outside of the image sensor.

Abstract: Near infrared imaging is highly complementary to color imaging having a wide range of applications. For example, in health applications, the near infrared can provide biomolecular information on tissue that is not apparent under visual examination nor from the inspection of color images of tissue. Thus, there is utility in viewing both visible color and near infrared images in combination. Described herein are methods to perform visible and near infrared imaging as well as hybrid visible color and near infrared imaging with a single conventional color filter array RGB sensor. The methods automatically provide spatially co-registered color and near infrared images and the methods can be used as the basis for a multispectral or hyperspectral imaging system.

Abstract: An image decoding method according to the present document comprises the step of deriving modified transform coefficients, wherein the step of deriving the modified transform coefficients comprises the step of parsing an LFNST index on the basis of a variable indicating whether an ISP is applied to a current block or whether an effective coefficient is present in a DC component of the current block, according to the tree type of the current block, wherein the variable may be derived on the basis of an individual transform skip flag value for a color component of the current block.

Abstract: A video encoding method includes: based on at least one of first distortion aware information about a current encoding unit and second distortion aware information about a corresponding reference encoding unit, determining a first predicted value of the current encoding unit using at least one interpolation filter, wherein the at least one type of interpolation filter may include an artificial intelligence (AI) interpolation filter; and encoding the current encoding unit based on the first predicted value of the current encoding unit.

Abstract: An image coding/decoding method and device are provided. The image decoding method carried out by the image decoding device, according to the present disclosure, may comprise the steps of: determining the number of tiles in a current picture on the basis that the segmentation of the current picture is not restricted; on the basis that the number of tiles in the current picture is a plurality, acquiring from a bitstream, a first flag representing whether tile boundary filtering is available; and, on the basis of the value of the first flag, determining whether to carry out filtering for the boundaries of the tiles belonging to the current picture.

Abstract: Disclosed is a network-on-chip including a first data converter that receives first image data and second image data from at least one image sensor and encodes one image data among the first image data and the second image data, into first data, based on whether the first image data is identical to the second image data and a second data converter that receives non-image data from at least one non-image sensor and encodes the received non-image data into second data. The network-on-chip outputs the first data and the second data to transmit the first data and the second data to an external server at a burst length.

Abstract: A method of decoding video data from a bitstream, the bitstream comprising video data corresponding to multiple slices, wherein the video bitstream comprises a picture header; the method includes determining a coding mode for at least one slice; determining a set of syntax elements to be used for said coding mode from said picture header; and decoding said at least one slice using said determined syntax elements.

Abstract: The method for processing a matrix of pixels each containing an original red, green, blue, or infrared component, comprises at least one interpolation of an interpolated component different from the original component of a pixel of interest from the components of a group of pixels neighboring the pixel of interest. The interpolation comprises: a calculation of the sum of the components of reference pixels weighted by a respectively assigned weight, the reference pixels being pixels of the group having the same original component as the interpolated component, an evaluation of the spatial uniformity of an environment, within the group of each reference pixel, a calculation of the weights assigned to the reference pixels at values which are normalized and proportional to the respective spatial uniformity.

Abstract: Disclosed are methods and apparatuses for image data encoding/decoding. A method for decoding a 360-degree image includes the steps of: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; adding the generated prediction image to a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Therefore, the performance of image data compression can be improved.

Abstract: There is provided a depth information generating apparatus. A first generating unit generates first depth information on the basis of a plurality of viewpoint images which are obtained from first shooting and which have mutually-different viewpoints. A second generating unit generates second depth information for a captured image obtained from second shooting by correcting the first depth information so as to reflect a change in depth caused by a difference in a focal distance of the second shooting relative to the first shooting.

Abstract: An audio-visual system is shown and describe. The audio-visual system comprises a soundbar and a television monitor assembly. The television monitor assembly comprises a television monitor, a first support and a second support. The first support comprises a first base member and a first vertical member, and the second support comprises a second base member and a second vertical member. The television monitor assembly has one or more free-standing configurations in which the lengths of the first and second base members are substantially perpendicular to the front and rear surfaces of the television monitor and one or more wall-mounted configurations in which the lengths of the first and second base members are substantially parallel to the front rear surfaces of the television monitor. An audio visual system may be provided by attaching a soundbar to the first and second base members in the free-standing configurations.

Abstract: Surgical navigation systems and methods for tracking an object within an operating room involve a camera unit that houses a first stereoscopic sensing system and a second stereoscopic sensing system each comprising sensing elements adapted to sense light. A controller utilizes the first stereoscopic sensing system to sense light from the object and track the object according to a first resolution. The controller utilizes the second stereoscopic sensing system to sense light from the object and track the object according to a second resolution that is lower than the first resolution. The controller obtains data related to the object from the second stereoscopic sensing system and modifies control of the sensing elements of the first stereoscopic sensing system based on the obtained data related to the object.

Abstract: Disclosed are methods and apparatuses for image data encoding/decoding. A method for decoding a 360-degree image includes the steps of: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; adding the generated prediction image to a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Therefore, the performance of image data compression can be improved.

Abstract: PROF (Prediction Refinement with Optical Flow) and BDOF (Bi-directional Optical Flow) use the optical flow model to provide sample-wise motion compensation refinement. In one implementation, to calculate the spatial gradients in BDOF, an extended region is generated around a block to be coded. To simplify the computation, BDOF may use the same padding operations as in PROF, namely, a padding sample is copied from the nearest integer neighbor in the reference picture. BDOF and PROF can also be used together when sub-block based affine motion-compensated prediction is used. BDOF can be applied after PROF generates new prediction blocks, or BDOF can use the spatial gradients in the original prediction blocks to re-use the computations with PROF. In addition, BDOF and PROF operations can be combined, and the prediction adjustment will be directly based on the spatial gradients in the original prediction blocks.

Abstract: Disclosed are methods and apparatuses for image data encoding/decoding. A method for decoding a 360-degree image includes the steps of: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; adding the generated prediction image to a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format. Therefore, the performance of image data compression can be improved.

Abstract: A method of encoding an input signal is provided, the method comprising: quantizing a set of data based on temporal information associated with said set of data.