AUTOMATIC EXPOSURE IMAGING SYSTEM AND METHOD
An automatic exposure (AE) imaging system includes an image sensor that captures an analog image; an analog-to-digital converter (ADC) that converts the analog image into a digital image; a single-frame image processor that processes the digital image; an exposure quantizer that generates a discrete number representing a determined exposure time according to an output of the single-frame image processor; a multi-exposure controller, under control of a motion-detect signal, generating a plurality of different exposure times in sequence in each frame period in a motion detection mode, and outputting the determined exposure time in a streaming mode; and a pixel controller coupled to receive an output of the multi-exposure controller, according to which the image sensor is controlled.
The present invention generally relates to an imaging system, and more particularly to an automatic exposure (AE) imaging system with motion detection.
2. Description of Related ArtCameras have been widely used for image/video based analysis to extract information. A lot of bandwidth and power, however, are required to transmit and process the captured image or video. In order to reduce the bandwidth and power, event-triggered cameras have been proposed to screen out redundant image or video such that only images or video containing information being of use are actually transmitted and processed. The information being of use may be identified, for example, whenever motion occurs.
In a worst scenario when brightness changes abruptly from dark to bright shortly before motion event is detected, conventional imaging system cannot successfully detect the motion for the reason that exposure time needs be gradually adjusted such that an appropriate exposure time can only be determined after the duration spanning several frame periods has elapsed. Therefore, the conventional imaging system cannot detect the motion in time, or even fails to detect the motion.
A need has thus arisen to propose a novel scheme capable of successfully and timely detecting motion even in a worst scenario when brightness changes abruptly from dark to bright shortly before motion occurs.
SUMMARY OF THE INVENTIONIn view of the foregoing, it is an object of the embodiment of the present invention to provide an automatic exposure (AE) imaging system and method with motion detection capable of timely and successfully detecting motion event.
According to one embodiment, an automatic exposure (AE) imaging system includes an image sensor, an analog-to-digital converter (ADC), a single-frame image processor, an exposure quantizer, a multi-exposure controller and a pixel controller. The image sensor captures an analog image, and the ADC converts the analog image into a digital image. The single-frame image processor processes the digital image. The exposure quantizer generates a discrete number representing a determined exposure time according to an output of the single-frame image processor. The multi-exposure controller, under control of a motion-detect signal, generates a plurality of different exposure times in sequence in each frame period in a motion detection mode, and outputs the determined exposure time in a streaming mode. The pixel controller is coupled to receive an output of the multi-exposure controller, according to which the image sensor is controlled.
In the embodiment, the system 100 may include an image sensor 11, such as an active-pixel sensor (APS), configured to capture an analog image. The system 100 of the embodiment may include an analog-to-digital converter (ADC) 12 coupled to receive the analog image and configured to convert the analog image into a digital image.
The system 100 may include a motion detector 13 coupled to receive the digital image, and configured to generate a motion-detect signal motion_d, which is asserted (e.g., logical high level) when motion event is detected, according to a preceding digital image and a current digital image. As exemplified in
According to one aspect of the embodiment, the system 100 may include a single-frame image processor 14 coupled to receive the digital image from the ADC 12, and configured to process one (or single) frame of the digital image in a frame period. To the contrary, the conventional imaging system uses a multi-frame image processor configured to process multiple frames of the digital image in multiple frame periods in order to decide a proper exposure time.
According to another aspect of the embodiment, the system 100 may include an exposure quantizer 15 configured to generate a discrete number (representing a determined exposure time or integration time) from a finite set of plural (e.g., four) discrete numbers (e.g., non-negative integers) (respectively representing different exposure times) according to an output of the single-frame image processor 14 and a predetermined value EV. For example, the exposure quantizer 15 may generate a discrete number from a finite set composed of discrete numbers 0, 1, 2 and 3. In the specification, the terms “exposure time” and “integration time” may be used interchangeably.
According to a further aspect of the embodiment, the system 100 may include a multi-exposure controller 16 coupled to receive the determined exposure time from the exposure quantizer 15 under control of the motion-detect signal motion_d.
The multi-exposure controller 16 may include a plurality of registers 163 configured to store different exposure times, respectively. For example, the plurality of registers 163 may include an exposure_0 register, an exposure_1 register, an exposure_2 register and an exposure_3 register. The multi-exposure controller 16 may include a second multiplexer (MUX) 164 (e.g., a 4-to-1 multiplexer) coupled to receive the exposure times (stored in the registers 163), one of which is controllably routed to an output of the second multiplexer 164. Specifically, the second multiplexer 164 may be controlled by the output of the first multiplexer 162.
According to the architecture shown in
Referring back to
In a worst scenario, in which brightness changes abruptly from dark to bright shortly before motion event is detected, the embodiment as set forth above can timely and successfully detect motion event due to fast exposure time determination (as shown in
Although specific embodiments have been illustrated and described, it will be appreciated by those skilled in the art that various modifications may be made without departing from the scope of the present invention, which is intended to be limited solely by the appended claims.
Claims
1. An automatic exposure (AE) imaging system, comprising:
- an image sensor that captures an analog image;
- an analog-to-digital converter (ADC) that converts the analog image into a digital image;
- a single-frame image processor that processes the digital image;
- an exposure quantizer that generates a discrete number representing a determined exposure time according to an output of the single-frame image processor;
- a multi-exposure controller, under control of a motion-detect signal, generating a plurality of different exposure times in sequence in each frame period in a motion detection mode, and outputting the determined exposure time in a streaming mode; and
- a pixel controller coupled to receive an output of the multi-exposure controller, according to which the image sensor is controlled;
- wherein the multi-exposure controller comprises:
- a counter that generates a count output;
- a first multiplexer coupled to receive the generated discrete number and the count output, one of which is controllably routed to an output of the first multiplexer;
- a plurality of registers that store said different exposure times respectively; and
- a second multiplexer coupled to receive said different exposure times, one of which is controllably routed to an output of the second multiplexer under control of the output of the first multiplexer.
2. The AE imaging system of claim 1, further comprising:
- a motion detector coupled to receive the digital image and configured to generate the motion-detect signal according to a preceding digital image and a current digital image;
- wherein the AE imaging system is in the streaming mode when the motion-detect signal is asserted, otherwise the AE imaging system is in the motion detection mode.
3. The AE imaging system of claim 1, wherein the exposure quantizer generates the discrete number further according to a predetermined value.
4. The AE imaging system of claim 3, wherein the exposure quantizer generates the discrete number representing an exposure time that is closest to the predetermined value as the determined exposure time.
5. (canceled)
6. The AE imaging system of claim 1, wherein the generated discrete number is routed to the output of the first multiplexer in the streaming mode, and the count output is routed to the output of the first multiplexer in the motion detection mode.
7. An automatic exposure (AE) imaging method, comprising:
- (a) capturing an analog image by an image sensor;
- (b) converting the analog image into a digital image;
- (c) performing a single-frame image step that processes the digital image;
- (d) generating a discrete number representing a determined exposure time according to an output of the single-frame image step;
- (e) generating a plurality of different exposure times in sequence in each frame period in a motion detection mode, and outputting the determined exposure time in a streaming mode, under control of a motion-detect signal; and
- (f) controlling the image sensor according to said different exposure times in the motion detection mode or according to the determined exposure time in the streaming mode;
- wherein the step (e) comprises:
- generating a count output;
- receiving the generated discrete number and the count output, one of which is first multiplexed as a first multiplex output;
- storing said different exposure times at a plurality of registers respectively; and
- receiving said different exposure times, one of which is second multiplexed as a second multiplex output under control of the first multiplex output.
8. The AE imaging method of claim 7, further comprising:
- generating the motion-detect signal according to a preceding digital image and a current digital image;
- wherein the AE imaging method is in the streaming mode when the motion-detect signal is asserted, otherwise the AE imaging method is in the motion detection mode.
9. The AE imaging method of claim 7, wherein the discrete number is generated further according to a predetermined value.
10. The AE imaging method of claim 9, wherein the discrete number representing an exposure time that is closest to the predetermined value is generated as the determined exposure time in the step (d).
11. (canceled)
12. The AE imaging method of claim 7, wherein the generated discrete number is first multiplexed as the first multiplex output in the streaming mode, and the count output is first multiplexed as the first multiplex output in the motion detection mode.
Type: Application
Filed: Dec 26, 2018
Publication Date: Jul 2, 2020
Inventor: Youngchul Sohn (Tainan City)
Application Number: 16/232,943