Abstract: Row-by-row pixel read-out is executed concurrently within respective clusters of pixels of a pixel array, alternating the between descending and ascending progressions in the intra-cluster row readout sequence to reduce temporal skew between neighboring pixel rows in adjacent clusters.

Abstract: An imaging apparatus includes a light emitter, a pixel section, and a signal processor which calculates distance information of a subject. The pixel section includes a photoelectric converter, first and second read-out gates, and a plurality of charge accumulators including a first charge accumulator and a second charge accumulator. The first read-out gate is activated in a first period and deactivated in a second period. The second read-out gate is activated in the first period and the second period. The signal processor calculates the distance information based on a total amount of signal charges accumulated in the charge accumulators in the first period and the second period and a difference between an amount of signal charges accumulated in the second charge accumulator in the first period and the second period and an amount of the signal charge accumulated in the first charge accumulator in the first period.

Abstract: In a technique to assess the blurriness of an image, an image of a face is received, the image including a depiction of lips. A processing device determines a region of interest in the image, wherein the region of interest comprises an area inside of the lips. The processing device applies a focus operator to the pixels within the region of interest, and calculates a sharpness metric for the region of interest using an output of the focus operator. The processing device determines whether the sharpness metric satisfies a sharpness criterion, and one or more additional operations are performed responsive to determining that the sharpness metric satisfies the sharpness criterion.

Abstract: Disclosed in embodiments of the present application are a screen color gamut control method and apparatus, an electronic device, and a storage medium. The method comprises: displaying a control, the control being configured to control the screen to switch between different color gamut spaces; acquiring the state of the control, the state being used for representing the color gamut space to which the screen is controlled to switch; and adjusting the color gamut space of the screen to make same be switched to the color gamut space corresponding to the state of the control. By means of the present method, when the control is displayed, the color gamut space of the screen is adjusted by the control to switch the color gamut space to that corresponding to the state of the control, so that users can enjoy different color experiences, thereby improving user experience.

Abstract: Provided is an excellent robot device capable of preferably detecting difference between dirt and a scratch on a lens of a camera and difference between dirt and a scratch on a hand. A robot device detects a site in which there is the dirt or the scratch using an image of the hand taken by a camera as a reference image. Further, this determines whether the detected dirt or scratch is due to the lens of the camera or the hand by moving the hand. The robot device performs cleaning work assuming that the dirt is detected, and then this detects the difference between the dirt and the scratch depending on whether the dirt is removed.

Abstract: The present disclosure describes a method, apparatus, and storage medium for classifying a multimedia resource. The method includes obtaining a multimedia resource. extracting a plurality of features of the multimedia resource; clustering the plurality of features to obtain at least one cluster set, and determining cluster description information of each cluster set, the each cluster set comprising at least one feature of the multimedia resource; determining at least one piece of target feature description information of the multimedia resource based on the cluster description information of each cluster set, each piece of target feature description information being used for representing an association between one piece of cluster description information and the remaining cluster description information; and classifying the multimedia resource based on the at least one piece of target feature description information of the multimedia resource, to obtain a classification result of the multimedia resource.

Abstract: A teaching data correction device sets, for teaching data indicating an object area where an object of interest exists in a training image, a correction candidate area which is an area to be a correction candidate of the object area, the training image being used for learning. The teaching data correction device generates an output machine based on the correction candidate area, the output machine being learned to output, when an image is inputted thereto, an identification result or a regression result relating to the object of the interest. Then, the teaching data correction device updates the teaching data by the correction candidate area based on an accuracy of the output machine, the accuracy being calculated based on the identification result or the regression result outputted by the output machine.

Abstract: Embodiments of the disclosure provided herein generally relate to methods and video system components that have integrated background differentiation capabilities that allow for background replacement and/or background modification. In some embodiments, undesired portions of video data generated in a video environment are separated from desired portions of the video data by taking advantage of the illumination and decay of the intensity of electromagnetic radiation, provided from an illuminator, over a distance. Due to the decay of intensity with distance, the electromagnetic radiation reflected from the undesired background has a lower intensity when received by the sensor than the electromagnetic radiation reflected from the desired foreground. The difference in the detected intensity at the one or more wavelengths can then be used to separate and/or modify the undesired background from the desired foreground for use in a video feed.

Abstract: A system for visibility in an atmospheric suit includes a camera arranged to view an environment outside the atmospheric suit and a display device to display an image obtained by the camera. An input device obtains input from a wearer of the atmospheric suit. A controller changes a feature of the camera based on the input. The image obtained by the camera and displayed by the display device is modified based on the feature.

Abstract: An electronic device includes a device housing having a front side and a rear side, a first image capture device positioned on the front side, and a second image capture device positioned on the rear side. One or more processors of the electronic device cause, in response to user input received at a user interface requesting the second image capture device capture an image of an object, the first image capture device to capture another image of a user delivering the user input. The one or more processors then define an image orientation of the image of the object to be the same as another image orientation of the other image of the user.

Abstract: An image processing method, an electronic device, and a computer-readable storage medium are provided. The method includes: obtaining N images; determining a reference image in the N images; where the reference image is an image in which a target tilt-shift object has a sharpness greater than a preset threshold; obtaining tilt-shift parameters input by a user, where the tilt-shift parameters are used to indicate an azimuth of a target focal plane and a tilt-shift area range; determining, based on the tilt-shift parameters, to-be-composited image(s) in intersection with the target focal plane; and performing, based on focal lengths of the to-be-composited image(s) and the reference image, image composite on the N images to output a target tilt-shift image.

Abstract: Aspects of the present invention relate to methods and devices for receiving and presenting content. In an example method, content is received, the content to be delivered to a plurality of recipients. Each recipient of the plurality of recipients has a preference for a respective first physical location at which the content is to be presented on a display of a wearable head device associated with the recipient. A sender of the content has a preference for a second physical location at which the content is to be presented to the respective recipient of the plurality of recipients. A respective final physical location for the presentation of the content for the respective recipient of the plurality of recipients is identified. The respective final physical location is based on the respective recipient's preference and the sender's preference. It is determined whether the respective recipient is proximate to a zone associated with the respective final physical location.

Abstract: A camera mode to use for capturing an image or video is selected by estimating high dynamic range (HDR), motion, and light intensity with respect to a scene of the image or video to capture. An image capture device includes a HDR estimation unit to detect whether HDR is present in a scene of an image to capture, a motion estimation unit to determine whether motion is detected within the scene, and a light intensity estimation unit to determine whether a scene luminance for the scene meets a threshold. A mode selection unit selects a camera mode to use for capturing the image based on output of the HDR estimation unit, the motion estimation unit, and the light intensity estimation unit. An image sensor captures the image according to the selected camera mode.

Abstract: Provided are a method and device for image processing, a terminal device and a storage medium. The method includes: a high-brightness region is determined based on brightness of pixels in a first image, the brightness of the pixels in the high-brightness region being higher than the brightness of the pixels around the high-brightness region; a diffraction region in the first image is determined based on the high-brightness region, the diffraction region being an image region around the high-brightness region; and brightness of the diffraction region is reduced to obtain a second image. Through the method, after the brightness of the diffraction region is reduced, an overlap image formed by diffraction is alleviated, and the image is more real.

Abstract: Method and device for image frame selection are provided. A computing device can receive, from an image capture device, a plurality of frames including a capture frame. The computing device can determine a computer-selected frame of the plurality of frames. The computing device can receive, by way of a user interface, a selection of an option to view the capture frame. The computing device can, responsive to receiving the selection, provide, by way of the user interface, an animation between the capture frame and the computer-selected frame. The animation includes an interpolation of one or more frames captured between the capture frame and the computer-selected frame.

Abstract: Systems, apparatuses and interfaces and methods for implementing same including a mobile device having a camera system, where the systems, apparatuses, interfaces, and methods capture an image and embed the image into a background image selected from a group of background images generated by the systems, apparatuses, interfaces, and methods based on a location, a surroundings and an environment.

Abstract: In exemplary embodiments, methods and systems are provided for a digital flashlight for a vehicle. In another exemplary embodiment, a system is provided that includes a display of a vehicle; and a processor coupled to the display of the vehicle and a camera of the vehicle and configured to at least facilitate: obtaining a camera image frame via the camera of the vehicle; determining a first region of the camera image frame having a first brightness level; determining a second region of the camera image frame having a second brightness level that is greater than the first brightness level; and providing instructions to the display of the vehicle for displaying the first region with increased brightness that is based on the second brightness level.

Abstract: A method of simultaneous localization and mapping (SLAM) is provided to position a target object. Each of detected tracked objects in a surrounding environment of the target object is classified into a moving object or a static object based on data detected at different time points. The target object is then positioned without considering any of the tracked objects that are classified into a moving object.

Abstract: A method of using an optical TOF module to determine distance to an object. The method includes acquiring signals in the TOF module indicative of distance to the object, using a first algorithm to provide an output indicative of the distance to the object based on the acquired signals, using at least one second different algorithm to provide an output indicative of the distance to the object based on the acquired signals, and combining the outputs of the first and at least one second algorithms to obtain an improved estimate of the distance to the object. In some implementations, each of the first and at least one second algorithms further provides an output representing a respective confidence level indicative of how accurately distance to the object has been extracted by the particular algorithm.

Abstract: There is provided a method for capturing a sequence of image frames in a thermal camera having a microbolometer detector comprising: capturing a first sequence and a second sequence of image frames with a shutter of the thermal camera being in a closed state and an open state, respectively. While capturing each of the first and the second sequence, an integration time of the microbolometer detector is switched between a plurality of integration times according to one or more repetitions of a temporal pattern of integration times. The method further comprises correcting image frames in the second sequence that are captured when the integration time is switched to a particular position within the temporal pattern of integration times using image frames in the first sequence that are captured when the integration time is switched to the same particular position within the temporal pattern of integration times.

Abstract: An electronic device includes an image sensor configured to capture a target to generate first image data, and a processor configured to perform directional interpolation on a first area of the first image data to generate first partial image data, perform upscale on a second area of the first image data to generate second partial image data, and combine the first partial image data and the second partial image data to generate second image data.

Abstract: An image capturing apparatus comprises an interface configured to connect to an external apparatus, a transmitting unit configured to transmit image data to an external apparatus connected by the interface, a processing unit configured to encode the image data with a predetermined format, a determination unit configured to determine whether or not image data to be encoded by the processing unit includes decoding information for decoding the image data, and a control unit configured to switch, based on the determination result, between processing for transmitting image data encoded by the processing unit and the decoding information to the external apparatus and processing for transmitting an image file in which image data including the decoding information is encoded to the external apparatus.

Abstract: An image sensor integrated with a convolutional neural network computation circuit is provided. The image sensor includes: a pixel array including pixels divided into pixel groups, wherein each pixel converts a light signal into a PWM signal; a convolution computation circuit controlling a turn-on time of a corresponding weighted current according to the first PWM signal of each pixel, and accumulating the weighted currents into an integrated current; a comparison circuit converting the integrated current into a second PWM signal and comparing it with that of an adjacent pixel group to output a larger one; and a classification circuit quantizing the second PWM signal to a quantization value according to a weight of a node in a fully-connected layer corresponding to each pixel group, accumulating the quantization values of all pixel groups into a feature value, and comparing the feature value with a feature threshold to obtain a classification result.

Abstract: An image encoder configured to process a Bayer image generated by passing through a color filter of a Bayer pattern includes: a detector configured to read the Bayer image in units of blocks and search for, in the blocks, a target pixel to be compressed and a plurality of candidate pixels which are located adjacent to the target pixel; a flag generator configured to compare a first pixel value of the target pixel with second pixel values based on pixel values of the plurality of candidate pixels, identify a reference pixel based on a comparison result, and generate a flag indicating relative direction information between the target pixel and the reference pixel; and a compressor configured to encode information corresponding to a comparison method applied by the flag generator and the comparison result and output the encoded information as a bitstream together with the flag.

Abstract: An AR scenario-based gesture interaction method, a non-transitory computer-readable medium, and a wireless communication terminal. The method includes: collecting a RGB image, a depth image, and corresponding IMU data of a current frame; obtaining posture information and hand information of the current frame by processing the RGB image, the depth image, and the IMU data; obtaining three-dimensional point cloud information of a hand in a reference coordinate system by performing three-dimensional dense modeling based on the posture information and the hand information of the current frame; obtaining pose information of a virtual object in the reference coordinate system; and obtaining an occlusion relationship between the hand and the virtual object by rendering the hand and the virtual object based on the three-dimensional point cloud information of the hand, the pose information of the virtual object, and preset point cloud information of the virtual object in the reference coordinate system.

Abstract: In an example embodiment, an item listing process is run in an item listing application. Upon reaching a specified point in the item listing process, a camera application on the user device is triggered (or the camera directly accessed by the item listing application) to enable a user to capture images using the camera, wherein the triggering includes providing an overlay informing the user as to an angle at which to capture images from the camera.

Abstract: The present application discloses an image recognition method, apparatus, device, and a computer storage medium, which is related to a technical field of artificial intelligence, and in particular, to a technical field of image processing. The method includes: performing organ recognition on a human face image and marking positions of the human facial five sense organs in the human face image, obtaining a marked human face image; inputting the marked human face image into a backbone network model and performing feature extraction, obtaining defect features of the marked human face image outputted by different convolutional neural network levels of the backbone network model; and fusing the defect features of different levels that are located in a same area of the human face image, obtaining a defect recognition result of the human face image.

Abstract: An imaging element incorporates a reading portion that reads out captured image data at a first frame rate, a storage portion that stores the image data, a processing portion that processes the image data, and an output portion that outputs the processed image data at a second frame rate lower than the first frame rate. The reading portion reads out the image data of each of a plurality of frames in parallel. The storage portion stores, in parallel, each image data read out in parallel by the reading portion. The processing portion performs generation processing of generating output image data of one frame using the image data of each of the plurality of frames stored in the storage portion.

Abstract: The present disclosure provides a target tracking method and system, a readable storage medium, and a mobile platform. The method includes: obtaining a user's trigger operation on an operation button, and generating a trigger instruction based on the trigger operation to generate a candidate target box; displaying, based on the trigger operation, the candidate target box in a current frame of picture displayed on a display interface to correspond to the feature portion of the predetermined target; obtaining, based on the displayed candidate target box, a box selection operation performed by the user on the operation button, and generating a box selection instruction based on the box selection operation to generate a tracking target box, where the box selection instruction is used to determine that the candidate target boxes is a tracking target box; and tracking the target based on the tracking target box.

Abstract: The subject technology receives metadata corresponding to a respective media overlay, the metadata including information indicating that the respective media overlay is configured to be applied as an image processing operation during post-processing of image data during a post-capture stage. The subject technology selects the respective media overlay in response to the information indicating that the respective media overlay is configured to be applied as an image processing operation during post-processing of image data. The subject technology, based at least in part on a category indicator associated with the respective media overlay, populates a group of media overlays with at least the respective media overlay. The subject technology sends, to a client electronic device, second metadata including at least information related to the group of media overlays.

Abstract: A rotational image viewer for viewing an image on a mobile device having a display including a viewport. The image viewer monitors the orientation of the mobile device and enlarges/reduces the image responsive to the mobile device's orientation such that the viewport remains filled with at least a portion of the image (i.e., no letterboxing or pillarboxing within the viewport).

Abstract: An image pickup apparatus that is capable of picking up an image that effectively blurs a background easily. The image pickup apparatus including at least one processor and/or circuit configured to function as following units. A generation unit generates simulation images that simulate defocus states of background in cases that an object is picked up at different object distances based on a preliminary pickup image generated by picking up the background without including the object. A setting unit sets evaluation frames to the simulation images, respectively. A calculation unit calculates defocus-state evaluation values of the evaluation frames. A notification unit notifies of information about an object position at which the defocus state becomes optimal based on the defocus-state evaluation values.

Abstract: This disclosure relates to managing a feature point map. The managing can include adding feature points to the feature point map using feature points captured by multiple devices and/or by a single device at different times. The resulting feature point map may be referred to as a global feature point map, storing feature points from multiple feature point maps. The global feature point map may be stored in a global feature point database accessible by a server so that the server may provide the global feature point map to devices requesting feature point maps for particular locations. In such examples, the global feature point map may allow a user to localize in locations without having to scan for feature points in the locations. In this manner, the user can localize in locations in which the user has never previously visited.

Abstract: In a sky monitoring system, comprising an image sensor, a wide-angle lens, a microprocessor, and a memory unit, wherein the sky monitoring system is configured to take pictures of a sky scene, wherein the sky monitoring system is configured to subdivide each picture of the sky scene into a group of patches and to determine one luminance value for each patch, wherein the sky monitoring system is configured to calculate an output based on the luminance values of the patches, the image sensor, the wide-angle lens, the microprocessor and the memory unit are integrated into one single sky monitoring device thus making the sky monitoring system an embedded system.

Abstract: An image sensor has a plurality of pixels arranged in a row direction and in a column direction. Each pixel comprises a color filter that has a portion with a low transmissivity and a portion with a high transmissivity, and a photoelectric conversion element that includes a first photoelectric conversion cell which receives light transmitting through the portion with the low transmissivity of the color filter, and a second photoelectric conversion cell which receives light transmitting through the portion with the high transmissivity of the color filter. The plurality of pixels are arranged such that positions of the portions with the low transmissivity for pixels of one color are identical among the plurality of pixels, and the portions with the low transmissivity are positioned adjacent to each other between adjacent pixels of different colors in the row direction only.

Abstract: Systems and methods for extracting ground plane information directly from monocular images using self-supervised depth networks are disclosed. Self-supervised depth networks are used to generate a three-dimensional reconstruction of observed structures. From this reconstruction the system may generate surface normals. The surface normals can be calculated directly from depth maps in a way that is much less computationally expensive and accurate than surface normals extraction from standard LiDAR data. Surface normals facing substantially the same direction and facing upwards may be determined to reflect a ground plane.

Abstract: Embodiments of the present invention relate to the field of communications technologies, and provide a method for controlling a screen of a mobile terminal, and an apparatus, to resolve a prior-art problem of relatively low accuracy of controlling a screen of a mobile terminal to be turned on or turned off. The method includes: obtaining, by a mobile terminal, a current motion parameter of the mobile terminal, and determining whether the motion parameter meets a pick-up parameter threshold or a put-down parameter threshold; when the motion parameter meets the pick-up parameter threshold, determining that the mobile terminal is picked up; obtaining a sight line parameter of a user; and when it is determined that a visual center of the user is on a screen of the mobile terminal and the screen is in an off state, switching the screen to an on state.

Abstract: An image processing method includes: analyzing, by a white balance gain estimation circuit, a plurality of exposure frames with different exposures to generate a plurality of sets of white balance gain settings; combining the plurality of sets of white balance gain settings to generate a white balance gain table; applying the white balance gain table to the plurality of exposure frames to generate a plurality of white balance compensated frames; and generating a high dynamic range (HDR) frame by performing pixel fusion according to pixel data derived from the plurality of white balance compensated frames.

Abstract: A shooting method includes: obtaining a preview image collected by an image collection device; detecting a first relative distance and a first relative angle between a foreground of the preview image and the image collection device, and detecting a second relative distance and a second relative angle between a background of the preview image and the image collection device; determining a target shooting position of the image collection device based on the first relative distance, the first relative angle, the second relative distance and the second relative angle, wherein a picture obtained by shooting the foreground and the background at the target shooting position has a composition that matches with a set composition strategy; and displaying a prompt message about the target shooting position for prompting the image collection device to move to the target shooting position.

Abstract: An image capture apparatus that communicates with an image processing apparatus, transmits a plurality of RAW images acquired by continuous shooting by an image capturing unit to the image processing apparatus, receives an image in which a predetermined RAW image is developed or an extracted result of the predetermined RAW image from the image processing apparatus which extracts the predetermined RAW image that satisfies a predetermined condition from the plurality of RAW images received from the image capture apparatus, and, when a predetermined representative image among the plurality of RAW images acquired by the image capturing unit and a predetermined RAW image extracted by the image processing apparatus are different, determines whether to replace the predetermined representative image with the predetermined RAW image.

Abstract: An image capturing device in the present embodiment has a configuration that is provided with an image splitting unit 21 and an edge extracting unit 22 that acquire the edge component for each block image that has been divided from an image captured by an image sensor 10, a resolution controlling unit 23 that writes each block image into a frame memory 30 with a resolution in accordance with the amount of its edge component, an image enlarging unit 24 that reads out at least one block image that corresponds to a selected region from the frame memory 30 and enlarges the block image with a magnification in accordance with the size of the selected region, and an enlarged output unit 45 that outputs the enlarged block image that corresponds to the selected region that is supplied from the image enlarging unit 24.

Abstract: An imaging element includes a memory that stores first image data obtained by being captured by the imaging element and is incorporated in the imaging element, and a first processor that is configured to perform image data processing on the first image data and is incorporated in the imaging element. The first processor is configured to receive vibration information related to a vibration exerted on the imaging element within a frame output period defined by a first frame rate, and output second image data obtained by assigning the vibration information to a specific position set in the first image data within the frame output period.

Abstract: Systems and methods for adaptively determining a region of interest (ROI) are disclosed herein. An example device includes an imaging assembly and a controller. The imaging assembly captures image data comprising pixel data from a plurality of pixels. The controller calculates a contrast value for each pixel of the plurality of pixels, generates a histogram of contrast values, calculates an area under the curve of the histogram, and determines a contrast value threshold to delineate between high-contrast value pixels and low-contrast value pixels. The controller also identifies a ROI within the image data by locating a region within the image data that (i) satisfies a pre-determined size threshold and (ii) contains a largest number of high-contrast value pixels relative to all other regions that satisfy the pre-determined size threshold, and adjusts imaging parameters of the imaging assembly based on the ROI to capture at least one subsequent image.

Abstract: The present disclosure provides a method capable of switching display modes with a display screen having a plurality of pixels. The method includes: providing a selection interface on the display, wherein the selection interface provides a first display setting and a second display setting; determining whether the first display setting or the second display setting is selected, wherein when the first display setting is selected, the controller controls to display an image content with the plurality of pixels of the display; when the second display setting is selected, the plurality of pixels of the display are merged into a plurality of merges Pixel group to display image content.

Abstract: An image capture apparatus that comprises an image sensor that includes a pixel array in which a plurality of pixels are disposed in rows and columns and a plurality of column signal lines provided for each column of the pixels, is disclosed. The apparatus further comprises a first correction circuit and a second correction circuit that share application of correction of offset caused by a difference in column signal lines where the pixel signals are read out to.

Abstract: The present disclosure relates generally to remote touch detection. In some examples, a first electronic device obtains first image data and second image data about an input, and performs an operation based on the input in accordance with a determination that a set of one or more criteria is met based on the first image data and the second image data. In some examples, a first electronic device causes emission of infrared light by an infrared source of a second electronic device, obtains image data about an input, and performs an operation based on the input in accordance with a determination that a set of one or more criteria is met based on the image data.

Abstract: The disclosed computer-implemented method may include acquiring, from a client device within a real-world environment, information representative of the real-world environment, and transmitting the information representative of the real-world environment to a relocalization service. The method may further include receiving, from the relocalization service, (1) an anchor point that may include a mapped position within the real-world environment, and (2) a determined position within the real-world environment of a client device relative to the mapped position of the anchor point. The method may further include sending an identifier of the anchor point to an asset management service, and obtaining, from the asset management service, a digital asset. The method may further include presenting the digital asset at a position within an artificial environment relative to the mapped position of the anchor point. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A display apparatus includes an image display element, an eyepiece portion, an object window, and a reflection optical element disposed at a position between the eyepiece portion and the object window, the reflection optical element being configured to guide a picture displayed on the image display element to the eyepiece portion. The reflection optical element changes a state to a first state and a second state by changing a transmittance. In the first state, the picture displayed on the image display element is viewed via the eyepiece portion. In the second state, an image in which an image from the object window and an image displayed on the image display element are superimposed is viewed via the eyepiece portion.

Abstract: Disclosed is an image sensing device that includes an image sensor including a pixel array, the pixel array including arranged in a predetermined pattern a first group of pixels having a first color filter, a second group of pixels having a second color filter and a third group of pixels having a third color filter, and an image processor suitable for determining, based on pixel values outputted from the image sensor, whether a group having a minimum number of pixels among the first to third groups of pixels are supersaturated and correcting a pixel value of at least one supersaturated pixel according to a determination result.

Abstract: Dual-aperture digital cameras with auto-focus (AF) and related methods for obtaining a focused and, optionally optically stabilized color image of an object or scene. A dual-aperture camera includes a first sub-camera having a first optics bloc and a color image sensor for providing a color image, a second sub-camera having a second optics bloc and a clear image sensor for providing a luminance image, the first and second sub-cameras having substantially the same field of view, an AF mechanism coupled mechanically at least to the first optics bloc, and a camera controller coupled to the AF mechanism and to the two image sensors and configured to control the AF mechanism, to calculate a scaling difference and a sharpness difference between the color and luminance images, the scaling and sharpness differences being due to the AF mechanism, and to process the color and luminance images into a fused color image using the calculated differences.