Abstract: Systems and method for calibrating an imaging device are disclosed. A method is performed by a system including a processor communicatively coupled with an imaging device including an imaging-device element, an actuator coupled with the imaging-device element, and a digital-to-analog converter (DAC). The actuator is associated with predefined calibration data that causes the imaging device to achieve a performance characteristic. The method includes, in accordance with a determination that imaging-device recalibration criteria are satisfied, causing the DAC to provide the actuator a plurality of drive signals. Each drive signal of the plurality of drive signals causes the actuator to apply a respective force on the imaging-device element.

Abstract: The present application provides a clock detection method, a clock detection circuit, and an image sensor, wherein an first AND gate is receiving a first clock signal and an enable signal, a first capacitor is connected to a first switch element, and a second capacitor is connected between the first switch element and ground, the second switch element receives a preset voltage, and the second switch element is connected to the first switch element; a comparator is connected to the second switch element, and a preset voltage end, and an output end of the comparator is connected to a trigger; a trigger end of the trigger is receiving the first clock signal, and the reset end of the trigger is receiving the enable signal, to output a clock detection result signal. The present application enhances the user experience.

Abstract: The present application provides a counter readout circuit and control method, each counter unit is connected to a counter readout circuit. The first selector's first input end is connected to the corresponding counter unit, and the second input end is connected to the data output signal of the lower-level counter readout circuit. The control end of the first selector receives a first selection signal to select the first input end or the second input end. The output end of the first selector is connected to the input end of the first trigger, and the output end of the first trigger outputs the data output signal of the counter readout circuit. The trigger end of the first trigger is coupled to the second input end of the first selector of the higher-level counter readout circuit. The technical solution of this application can effectively reduce the power consumption of the image sensor.

Abstract: This disclosure is related to automatic generation of short clips based on a user input at a device including a camera. A method can include capturing image frames of a scene with the camera, selecting key frames from among the image frames by detecting targets in the scene and motion, applying, with processing logic that is remote from the device that includes the camera, a visual effect to the key frames, and recording an audio recording of the scene in a same time frame that the image frames are captured with the camera. The audio recording is recorded with a microphone of the device, and the method also includes generating an audio clip that matches the visual effect applied to the key frames and generating the short clip by combining the key frames having the visual effect applied and the audio clip.

Abstract: A computer-implemented method may include receiving a video stream with a plurality of frames, detecting an object within a selected frame of the video stream, decomposing the object within the selected frame into patches, associating a subset of the patches with candidate patches within a subsequent frame of the video stream, and determining, based at least in part on the locations of the candidate patches within the subsequent frame, the location of the object within the subsequent frame of the video stream. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: Systems and methods are provided for operating image modules via an artificial reality (AR) device. In various exemplary embodiments, an artificial reality device may initiate a first camera of the AR device to identify a picture region and may track at least one gaze via a second camera of the AR device or at least one gesture via the first camera. The AR device may be a head-mounted device, for example, including a plurality of inward and outward facing cameras. The AR device may determine a region of interest within the picture region based on the at least one tracked gaze or gesture and may focus on the region of interest via the first camera. The focusing operations may include at least one of an auto-exposure operation, an auto-focus operation, or a stabilizing operation.

Abstract: Devices, methods, and non-transitory program storage devices are disclosed to provide enhanced images in multi-camera systems, e.g., by using information from images captured by cameras with different properties in terms of optics and/or sensors. In one embodiment, the techniques comprise: obtaining a first image from a first image capture device, wherein the first image has a first field of view (FOV) and a first set of quality characteristics; obtaining a second image from a second image capture device, wherein the second image has a second FOV and a second set of quality characteristics, and wherein the second FOV partially overlaps the first FOV; obtaining a neural network that produces a modified second image having a modified second set of quality characteristics determined by the neural network attempting to match the first set of quality characteristics; and generating an output image based, at least in part, on the modified second image.

Abstract: Foreign lighting effects, such as lens flare, are very common in natural images. In a two-camera-system, the two images may be fused together to generate one image of a better quality. However, there are frequently different foreign light patterns in the two images that form the image pair, e.g., due to the difference in lens design, sensor and position, etc. Directly fusing such pairs of images will result in non-photorealistic images, with composed foreign light patterns from both images from the image pair. This disclosure describes a general foreign light mitigation scheme to detect all kinds of foreign light region mismatches. The detected foreign light mismatch regions may be deemphasized or excluded in the fusion step, in order to create a fused image that keeps a natural-looking foreign light pattern that is close to what was seen by the user of an image capture device during an image capture preview mode.

Abstract: A method is provided for detecting lesions in ultrasound images. The method includes acquiring ultrasound information, determining discriminative descriptors that describe the texture of a candidate lesion region, and classifying each of the discriminative descriptors as one of a top boundary pixel, a lesion interior pixel, a lower boundary pixel, or a normal tissue pixel. The method also includes determining a pattern of transitions between the classified discriminative descriptors, and classifying the candidate lesion region as a lesion or normal tissue based on the pattern of transitions between the classified discriminative descriptors.

Abstract: Image fusion techniques hide artifacts that can arise at seams between regions of different image quality. According to these techniques, image registration may be performed on multiple images having at least a portion of image content in common. A first image may be warped to a spatial domain of a second image based on the image registration. A fused image may be generated from a blend of the warped first image and the second image, wherein relative contributions of the warped first image and the second image are weighted according to a distribution pattern based on a size of a smaller of the pair of images. In this manner, contributions of the different images vary at seams that otherwise would appear.

Abstract: Systems, methods, and computer readable media to rapidly identify and track an arbitrary sized object through a temporal sequence of frames is described. The object being tracked may initially be identified via a specified or otherwise known region-of-interest (ROI). A portion of that ROI can be used to generate an initial or reference histogram and luminosity measure, metrics that may be used to identify the ROI in a subsequent frame. For a frame subsequent to the initial or reference frame, a series of putative ROIs (each having its own location and size) may be identified and the “best” of the identified ROIs selected. As used here, the term “best” simply means that the more similar two frames' histograms and luminosity measures are, the better one is with respect to the other.

Abstract: Foreign lighting effects, such as lens flare, are very common in natural images. In a two-camera-system, the two images may be fused together to generate one image of a better quality. However, there are frequently different foreign light patterns in the two images that form the image pair, e.g., due to the difference in lens design, sensor and position, etc. Directly fusing such pairs of images will result in non-photorealistic images, with composed foreign light patterns from both images from the image pair. This disclosure describes a general foreign light mitigation scheme to detect all kinds of foreign light region mismatches. The detected foreign light mismatch regions may be deemphasized or excluded in the fusion step, in order to create a fused image that keeps a natural-looking foreign light pattern that is close to what was seen by the user of an image capture device during an image capture preview mode.

Abstract: Techniques to identify and track a pre-identified region-of-interest (ROI) through a temporal sequence of frames/images are described. In general, a down-sampled color gradient (edge map) of an arbitrary sized ROI from a prior frame may be used to generate a small template. This initial template may be used to identify a region of a new or current frame that may be overscan and used to create a current frame's edge map. By comparing the prior frame's template to the current frame's edge map, a cost value or image may be found and used to identify the current frame's ROI center. The size of the current frame's ROI may be found by varying the size of putative new ROIs and testing for their congruence with the prior frame's template. Subsequent ROI's for subsequent frames may be identified to, effectively, track an arbitrarily sized ROI through a sequence of video frames.

Abstract: Techniques to permit a digital image capture device to stabilize a video stream in real-time (during video capture operations) are presented. In general, techniques are disclosed for stabilizing video images using an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. (Capturing a larger image than is displayed creates a buffer of pixels around the edge of an image; overscan is the term given to this buffer of pixels.) More particularly, techniques are disclosed for buffering an initial number of input frames so that a “current” frame can use motion data from both “past” and “future” frames to adjust the strength of a stabilization metric value so as to keep the current frame within its overscan. This look-ahead and look-behind capability permits a smoother stabilizing regime with fewer abrupt adjustments.

Abstract: Systems, methods, and computer readable media to rapidly identify and track an arbitrary sized object through a temporal sequence of frames is described. The object being tracked may initially be identified via a specified or otherwise known region-of-interest (ROI). A portion of that ROI can be used to generate an initial or reference histogram and luminosity measure, metrics that may be used to identify the ROI in a subsequent frame. For a frame subsequent to the initial or reference frame, a series of putative ROIs (each having its own location and size) may be identified and the “best” of the identified ROIs selected. As used here, the term “best” simply means that the more similar two frames' histograms and luminosity measures are, the better one is with respect to the other.

Abstract: Techniques to identify and track a pre-identified region-of-interest (ROI) through a temporal sequence of frames/images are described. In general, a down-sampled color gradient (edge map) of an arbitrary sized ROI from a prior frame may be used to generate a small template. This initial template may be used to identify a region of a new or current frame that may be overscan and used to create a current frame's edge map. By comparing the prior frame's template to the current frame's edge map, a cost value or image may be found and used to identify the current frame's ROI center. The size of the current frame's ROI may be found by varying the size of putative new ROIs and testing for their congruence with the prior frame's template. Subsequent ROI's for subsequent frames may be identified to, effectively, track an arbitrarily sized ROI through a sequence of video frames.

Abstract: Techniques to permit a digital image capture device to stabilize a video stream in real-time (during video capture operations) are presented. In general, techniques are disclosed for stabilizing video images using an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. (Capturing a larger image than is displayed creates a buffer of pixels around the edge of an image; overscan is the term given to this buffer of pixels.) More particularly, techniques are disclosed for buffering an initial number of input frames so that a “current” frame can use motion data from both “past” and “future” frames to adjust the strength of a stabilization metric value so as to keep the current frame within its overscan. This look-ahead and look-behind capability permits a smoother stabilizing regime with fewer abrupt adjustments.

Abstract: Techniques to permit a digital image capture device to stabilize a video stream in real-time (during video capture operations) are presented. In general, techniques are disclosed for stabilizing video images using an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. (Capturing a larger image than is displayed creates a buffer of pixels around the edge of an image; overscan is the term given to this buffer of pixels.) More particularly, techniques are disclosed for buffering an initial number of input frames so that a “current” frame can use motion data from both “past” and “future” frames to adjust the strength of a stabilization metric value so as to keep the current frame within its overscan. This look-ahead and look-behind capability permits a smoother stabilizing regime with fewer abrupt adjustments.

Abstract: A method is provided for detecting lesions in ultrasound images. The method includes acquiring an ultrasound image, generating a Fisher-tippett (FT) distribution-based edge feature map from the acquired ultrasound image, generating gradient concentration (GC) scores for pixels of the acquired ultrasound image using the FT distribution-based edge feature map, and identifying a candidate lesion region within the acquired ultrasound image based on the GC scores.

Abstract: Techniques to permit a digital image capture device to stabilize a video stream in real-time (during video capture operations) are presented. In general, techniques are disclosed for stabilizing video images using an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. (Capturing a larger image than is displayed creates a buffer of pixels around the edge of an image; overscan is the term given to this buffer of pixels.) More particularly, techniques are disclosed for buffering an initial number of input frames so that a “current” frame can use motion data from both “past” and “future” frames to adjust the strength of a stabilization metric value so as to keep the current frame within its overscan. This look-ahead and look-behind capability permits a smoother stabilizing regime with fewer abrupt adjustments.