Abstract: A device and method with object recognition is included. In one general aspect, an electronic device includes a camera sensor configured to capture a first image of a scene, the camera sensor is configured to perform at least one type of physical camera motion relative to the electronic device, the at least one type of physical camera motion includes rolling, panning, tilting, or zooming the camera sensor relative to the electronic device, and a processor configured to control the camera sensor to perform a physical motion of the physical camera motion type based on detecting an object in the first image, acquire a second image captured using the camera sensor as adjusted based on the performed physical motion, and recognize the object in the second image.

Abstract: A method and apparatus for detecting a liveness based on a phase difference are provided. The method includes generating a first phase image based on first visual information of a first phase, generating a second phase image based on second visual information of a second phase, generating a minimum map based on a disparity between the first phase image and the second phase image, and detecting a liveness based on the minimum map.

Abstract: Disclosed is a method and apparatus for adaptive tracking of a target object. The method includes method of tracking an object, the method including estimating a dynamic characteristic of an object in an input image based on frames of the input image, determining a size of a crop region for a current frame of the input image based on the dynamic characteristic of the object, generating a cropped image by cropping the current frame based on the size of the crop region, and generating a result of tracking the object for the current frame using the cropped image.

Abstract: A method and apparatus for detecting a liveness based on a phase difference are provided. The method includes generating a first phase image based on first visual information of a first phase, generating a second phase image based on second visual information of a second phase, generating a minimum map based on a disparity between the first phase image and the second phase image, and detecting a liveness based on the minimum map.

Abstract: A processor-implemented method with visual code processing includes generating a first image by capturing a first visual code, using an always on (AO) sensor module of an electronic device, detecting a first code image included in the first image and corresponding to the first visual code, using the AO sensor module, performing a first type decoding on the first code image, using the AO sensor module, waking up an application processor (AP) of the electronic device from a low-power state, based on a first decoding result of the first type decoding, and executing a first application of the electronic device corresponding to the first visual code, using the AP.

Abstract: An object classification method and apparatus are disclosed. The object classification method includes receiving an input image, storing first feature data extracted by a first feature extraction layer of a neural network configured to extract features of the input image, receiving second feature data from a second feature extraction layer which is an upper layer of the first feature extraction layer, generating merged feature data by merging the first feature data and the second feature data, and classifying an object in the input image based on the merged feature data.

Abstract: An image sensor includes: a motion detection circuit configured to detect a motion in image frames; and a micro control unit (MCU) configured to adjust at least a portion of a target frame among the image frames based on whether the motion is detected, and detect whether a target object is present based on the adjusted portion of the target frame.

Abstract: A processor-implemented method including generating a depth-aware feature of an image dependent on image features extracted from image data of the image and generating image data, representing information corresponding to one or more segmentations of the image, based on the depth-aware feature and a depth-aware representation, the depth-aware representation being depth-related information and visual-related information for the image.

Abstract: An apparatus and method for training a neural network model for classification without a teacher model are disclosed. The includes: selecting classes from a database comprising a set of classes; generating a mean feature group comprising mean features extracted from the selected classes; receiving a batch comprising input data and extracting, by the neural network model, a feature from the input data, wherein the neural network model is to be trained according to a mean feature set; determining a first similarity between the extracted feature and a mean feature corresponding to the input data; determining a second similarity comprising a self-similarity of the mean feature; and updating a parameter of the neural network model based on the first similarity and the second similarity.

Abstract: A processor-implemented method with target object tracking includes: setting a search area for a target object included in an input image based on a position of a first target box in a template image; selecting a network path from a plurality of network paths of a neural network model according to a resizing ratio of a size of another image that is input to the neural network model to a size of the search area; and tracking the target object by estimating a position of a second target box corresponding to the target object in the input image according to the selected network path.

Abstract: An apparatus with image segmentation includes: one or more processors configured to: obtain a second image based on a first segmentation label corresponding to a first image; generate a composite image by composing an image of an object corresponding to an object class of the first image among objects comprised by the second image with the first image; and train an image segmentation model based on the composite image, the first image, and the second image.

Abstract: A processor-implemented method with pose estimation includes: receiving an image, instance queries for object identification, and joint queries for joint identification; generating first heat maps associated with objects and second heat maps associated with joints in parallel based on the image, the instance queries, and the joint queries; and estimating respective joint information of a plurality of objects included in the image by combining the first heat maps and the second heat maps.

Abstract: A method, apparatus, and system with tracking are disclosed. The apparatus is configured to acquire a feature map of a template image, a color histogram of a foreground of the template image that has an object, and a color histogram of a background of the template image other than the foreground, acquire a feature score map, and a bounding box map corresponding to the feature score map, based on the feature map of the template image and a feature map of a search image, acquire a color score map based on the color histogram of the foreground, the color histogram of the background, and a color value of the search image, acquire a final score map, and a bounding box map corresponding to the final score map, based on the feature score map, the color score map, and the bounding box map, and output the corresponding bounding box.

Abstract: An image sensor includes: a motion detection circuit configured to detect a motion in image frames; and a micro control unit (MCU) configured to adjust at least a portion of a target frame among the image frames based on whether the motion is detected, and detect whether a target object is present based on the adjusted portion of the target frame.

Abstract: A processor-implemented method includes: obtaining a video feature of a video comprising a plurality of video frames; determining a target object representation of the video based on the video feature using a neural network; and generating a panorama segmentation result of the video based on the target object representation.

Abstract: An apparatus and method for processing an image are provided. The apparatus includes: one or more processors; memory storing instructions configured to, when executed by the one or more processors, cause the one or more processors to: detect objects in the image; determine region of interest (ROI) scores of the respective detected objects; determine whether to display icons for the respective objects based on the respective ROI scores; display an image processing user interface including at least a portion of the image and the icons; and receive an input selecting an icon from among the icons displayed with the user interface, and in response perform image processing based on the selected icon.

Abstract: An object classification method and apparatus are disclosed. The object classification method includes receiving an input image, storing first feature data extracted by a first feature extraction layer of a neural network configured to extract features of the input image, receiving second feature data from a second feature extraction layer which is an upper layer of the first feature extraction layer, generating merged feature data by merging the first feature data and the second feature data, and classifying an object in the input image based on the merged feature data.

Abstract: An apparatus includes one or more processors configured to generate a plurality of feature maps having respective different resolutions based on an input image; and update, for each of the plurality of transformer layers, respective position estimation information comprising first position information of a respective bounding box corresponding to one object query and second position information of respective key points corresponding to the one object query, wherein each of the plurality of transformer layers includes a self-attention model configured to generate respective intermediate data by performing self-attention on respective content information on a feature of the input image; and a cross-attention model configured to generate respective output data by performing cross-attention on respective one or more feature maps among the plurality of feature maps and the respective generated intermediate data.

Abstract: An object tracking apparatus is provided. The object tracking apparatus includes a processor configured to detect, from a first image frame, an amodal region including a first visible region in which a target object is visible and an occlusion region in which the target object is occluded, determine, based on the detected amodal region of the first image frame, that at least a partial region of a second image frame is a search region of the second image frame, the second image frame being temporally adjacent to the first image frame, and track the target object in the second image frame based on the determined search region.

Abstract: A method of generating a hyperlapse video includes: comparing a first reference point of a first image and a corresponding second reference point of a second image; based on the comparing, displaying a first user interface for matching the first reference point and second reference point; and determining whether to perform automatic shooting for the hyperlapse video based on whether the first reference point and the second reference point match.