Abstract: A method for generating metadata pertaining to a RAW frame includes selecting an input frame from a captured RAW frame, a plurality of frames obtained by processing the captured RAW frame, and a scaled RAW frame, selecting identified salient regions in an output frame, constructed from the captured RAW frame, based on errors between regions of the input frame and a corresponding reconstruction of the region of the input frame from the identified salient regions in the output frame, obtaining a plurality of reconstructed frames, reconstructed from a plurality of blocks of each salient region, corresponding to a plurality of regions of the input frame, and generating metadata for reconstructing the captured RAW frame by encoding a plurality of errors between the plurality of reconstructed frames and corresponding plurality of regions of the input frame, and a reconstruction technique used for reconstructing the plurality of reconstructed frames.

Abstract: Example embodiments include a method and an electronic device for detecting and removing artifacts/degradations in media. Embodiments may detect artifacts and/or degradations in the media based on tag information indicating at least one artifact included in the media. The detection may be triggered automatically or manually. Embodiments may generate artifact/quality tag information associated with the media to indicate artifacts and/or degradations present in the media, and may store the artifact/quality tag information as metadata and/or in a database. Embodiments may identify, based on the artifact/quality tag information associated with the media, at least one artificial intelligence (AI)-based media processing model to be applied to the media to enhance the media. The at least one AI-based media processing model may be configured to enhance at least one artifact detected in the media. Embodiments may enhance the media by applying the at least one AI-based media enhancement model to the media.

Abstract: An electronic device is disclosed. The electronic device may comprise: an image sensor for acquiring raw image data corresponding to light of infrared band and visible light band, with respect to an external object; and a processor, wherein the processor is configured to: receive a request for acquiring the raw image data corresponding to the external object; on the basis of the request configured to be performed using a first function of the image sensor, generate an RGB image related to the external object by using first raw image data corresponding to the light of visible light band, obtained through the image sensor, and on the basis of the request configured to be performed using a second function of the image sensor, perform biometric authentication related to the external object by using second raw image data corresponding to the light of infrared band, obtained through the image sensor. In addition, various embodiments recognized through the specification are possible.

Abstract: An electronic device is disclosed. The electronic device may comprise: an image sensor for acquiring raw image data corresponding to light of infrared band and visible light band, with respect to an external object; and a processor, wherein the processor is configured to: receive a request for acquiring the raw image data corresponding to the external object; on the basis of the request configured to be performed using a first function of the image sensor, generate an RGB image related to the external object by using first raw image data corresponding to the light of visible light band, obtained through the image sensor, and on the basis of the request configured to be performed using a second function of the image sensor, perform biometric authentication related to the external object by using second raw image data corresponding to the light of infrared band, obtained through the image sensor. In addition, various embodiments recognized through the specification are possible.

Abstract: A system and a method for detecting light sources in a multi-illuminated environment using a composite red-green-blue-infrared (RGB-IR) sensor is provided. The method comprises detecting, by the composite RGB-IR sensor, a multi-illuminant area using a visible raw image and a near-infrared (NIR) raw image of a composite RGBIR image, dividing each of the visible raw image and the NIR raw image into a plurality of grid samples, extracting a plurality of illuminant features based on a green/NIR pixel ratio and a blue/NIR pixel ratio, estimating at least one illuminant feature for each grid sample by passing each grid sample through a convolution neural network (CNN) module using the extracted plurality of illuminant features, and smoothing each grid sample based on the estimated at least one illuminant feature.

Abstract: A method and an electronic device for producing a composite image are provided. The method includes receiving visible image data and near infrared (NIR) image data from a composite sensor, determining whether at least one portion of the NIR image data having a level of detail greater than or equal to a threshold, and generating a composite image by fusing the visible image data with the at least one portion of the NIR image data based on the determination and storing the composite image in a memory.

Abstract: A system and a method for detecting light sources in a multi-illuminated environment using a composite red-green-blue-infrared (RGB-IR) sensor is provided. The method comprises detecting, by the composite RGB-IR sensor, a multi-illuminant area using a visible raw image and a near-infrared (NIR) raw image of a composite RGBIR image, dividing each of the visible raw image and the NIR raw image into a plurality of grid samples, extracting a plurality of illuminant features based on a green/NIR pixel ratio and a blue/NIR pixel ratio, estimating at least one illuminant feature for each grid sample by passing each grid sample through a convolution neural network (CNN) module using the extracted plurality of illuminant features, and smoothing each grid sample based on the estimated at least one illuminant feature.

Abstract: A method and an electronic device for producing a composite image are provided. The method includes receiving visible image data and near infrared (NIR) image data from a composite sensor, determining whether at least one portion of the NIR image data having a level of detail greater than or equal to a threshold, and generating a composite image by fusing the visible image data with the at least one portion of the NIR image data based on the determination and storing the composite image in a memory.