System And Method For Creating Composite Images By Utilizing An Imaging Device
A system and method for creating composite images by utilizing a camera comprises a cradle device that transports the camera across a target area during a scanning procedure that captures and stores image data. During the scanning procedure, a motion detector captures and provides scan motion data to a scanning manager from the camera. The scanning manager may then responsively utilize the scan motion data to accurately extract still frames corresponding to the target area from the captured image data at pre-determined time intervals. A stitching software program may then access and combine the still frames generated by the scanning manager to thereby create composite images.
Latest Sony Electronics Inc. Patents:
- Information processing device, information processing method, and computer program for side menus
- Information processing device, information processing method, and computer program
- Method and apparatus for a wireless home mesh network with network topology visualizer
- Methods and apparatuses for presenting content
- Video system demonstration
This application is a Continuation of U.S. Non-Provisional patent application Ser. No. 09/780,665, entitled “System And Method For Creating Still Images By Utilizing A Video Camera Device,” filed on Feb. 8, 2001, and also is a Continuation of U.S. Non-Provisional patent application Ser. No. 11/588,132, entitled “System And Method For Creating Still Images By Utilizing A Video Camera Device,” filed on Oct. 26, 2006, and also is a Continuation of U.S. Non-Provisional patent application Ser. No. 13/354,441, entitled “System And Method For Creating Still Images By Utilizing A Video Camera Device,” filed on Jan. 20, 2012. This application also relates to, and claims priority in, U.S. Provisional Patent Application Ser. No. 60/187,337, entitled “Video Stream Stitching,” filed on Mar. 6, 2000. The foregoing related applications are commonly assigned, and are hereby incorporated by reference.
BACKGROUND SECTION1. Field of the Invention
This invention relates generally to techniques for capturing visual information, and relates more particularly to a system and method for creating composite images by utilizing an imaging device.
2. Description of the Background Art
Implementing effective methods for capturing visual information is a significant consideration for designers and manufacturers of contemporary electronic devices. However, effectively capturing visual information by utilizing electronic devices may create substantial challenges for system designers. For example, enhanced demands for increased device functionality and performance may require more system processing power and require additional hardware resources. An increase in processing or hardware requirements may also result in a corresponding detrimental economic impact due to increased production costs and operational inefficiencies.
Furthermore, enhanced device capability to perform various advanced operations may provide additional benefits to a system user, but may also place increased demands on the control and management of various device components. For example, an enhanced electronic device that effectively captures, processes, and displays digital image data may benefit from an efficient implementation because of the large amount and complexity of the digital data involved.
Due to factors like the growing demands on system functionality, it is apparent that developing new techniques for capturing visual information is a matter of concern for related electronic technologies. Therefore, for all the foregoing reasons, developing effective systems for capturing visual information remains a significant consideration for designers, manufacturers, and users of contemporary electronic devices.
SUMMARYIn accordance with the present invention, a system and method are disclosed for creating composite images by utilizing a camera. In one embodiment, a selected target area may preferably be positioned on an appropriate surface for effective scanning by the camera. The target area may preferably include any desired photographic target. For example, the target area may include various physical objects, graphical images, documents, or geographic locations.
Any effective and appropriate support means may then accurately align the camera over the target area for transporting the camera along a fixed scanning track to thereby effectively scan the full length of the target area from a starting index location to an ending index location. The support means preferably supports the camera in a manner that permits the camera to maintain an unobstructed view of the target area along an optical path.
A system user may initiate the scanning procedure using any appropriate manual or automatic means. In response, the support means preferably begins to move down the scanning track, and the camera preferably begins scanning the target area to capture corresponding image data. In accordance with the present invention, a motion sensor simultaneously may capture and provide scan motion data, including one or more scan speeds, to the camera.
A scanning manager coupled to the camera may preferably then create an initial still frame from the captured image data. Then, at a pre-determined time interval, the scanning manager may preferably create a new current still frame from the captured image data. The scanning manager may then preferably determine an overlap region between the current still frame and the initial still frame.
Then, a stitching software program may preferably analyze and combine the image data in the foregoing overlap region to thereby produce a single composite still image from the current still frame and the initial still frame. Next, if the scanning procedure has not been completed, then the scanning manager preferably returns to sequentially generate one or more additional current still frames which may be combined by the stitching software program to create a composite still image of the target area.
The foregoing process is described as a reiterative procedure in which sequential pairs of still frames are generated and combined into a composite image. However, in alternate embodiments, the present invention may readily create a composite still image using various other sequences and techniques. For example, in certain embodiments, the present invention may generate and concurrently combine all still frames for a given target area in a single concurrent operation. In addition, the present invention may generate and concurrently combine discrete blocks of still frames corresponding to a given target area. The present invention therefore provides an improved a system and method for creating composite images by utilizing a camera device.
The present invention relates to an improvement in visual information capture techniques. The following description is presented to enable one of ordinary skill in the art to make and use the invention and is provided in the context of a patent application and its requirements. Various modifications to the disclosed embodiments will be readily apparent to those skilled in the art and the generic principles herein may be applied to other embodiments. Thus, the present invention is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features described herein.
The present invention comprises a system and method for creating still images by utilizing a camera, and preferably includes a cradle device that transports the camera across a target area during a scanning procedure to capture and store corresponding image data. During the scanning procedure, a motion detector preferably may capture and provide scan motion data to a scanning manager from the camera. The scanning manager may then responsively utilize the scan motion data to accurately extract still frames corresponding to the target area from the captured image data at pre-determined time intervals. A stitching software program may preferably then access and combine the still frames generated by the scanning manager to thereby create composite still images.
Referring now to
In the
In alternate embodiments, video camera 110 may readily include various other components in addition to, or instead of, those components discussed in conjunction with the
In the
Referring now to
In the
Referring now to
In the
Referring now to
In the
In the
In the
In the
In alternate embodiments, video data 422 may be configured as an series of key video frames that preferably may each be followed by a series of difference video frames that each only include those altered pixels that have changed from the key pixels in the corresponding key video frame. Video camera 110 may thus conserve substantial processing and memory resources by not encoding and handling reoccurring pixels in video data 422. A new key video frame may preferably occur when a predetermined key threshold of change is exceeded between those pixels from a current difference frame and the pixels from the preceding key video frame. The key video frames and difference video frames preferably are arranged in a contiguous sequence, and preferably reoccur at a periodic time interval, such as thirty frames per second.
In the
Referring now to
In the
In the
In alternate embodiments, scanning system 510 may be implemented using any other effective configuration. For example, video camera 110 may remain stationary, while target object 110 is moved past optical path 236. Motion sensor 516 may then provide scan motion data 424 corresponding to the moving target object 512. Alternately, a reflective device may be utilized to perform a scanning procedure for a stationary video camera 110 and a stationary target object 512, and scan motion data 424 may be generated based upon the motion of the foregoing reflective device. The functionality and utilization of scanning system 510 is further discussed below in conjunction with
Referring now to
In the
In accordance with the present invention, scanning manager 416 therefore preferably may generate each of the still frames 614 at a specific time interval that depends upon the scan speed of scanning system 510 and the length of still frames 614. In practice, scanning manager 416 may preferably obtain scan motion data 424, including one or more scan speeds, from motion sensor 516. Scanning manager 416 may then calculate the specific time interval and physical location during a scanning procedure at which video camera 110 captures the particular video data 422 corresponding to each of the still frames 614 in the
Referring now to
In the
In the
In the
Scan Speed=Non-Overlapped Scan Distance/Time Interval
where Non-Overlapped Scan Distance is a length of a non-overlapped region of a still frame 614 prior to a start of a next still frame 614, and Time Interval is a length of time required by cradle 514 to transport video camera 110 across the foregoing Non-Overlapped Scan Distance to a start of the next still frame 614. For example, in the
In the
Overlap Length=Still Frame Length−Non-Overlapped Scan Distance
where Overlap Length is a distance from a start of an overlap region to an end of the same overlap region. For example, in the
In the
A system user may thus select a shorter time interval for generating still frames 614 to thereby produce adjacent still images 614 with greater overlap regions. Stitching software program 418 may responsively utilize the duplicated video data in the overlap regions to generate improved photographic detail and greater resolution in the final composite still image. Conversely, a system user may select a longer time interval for generating still frames 614 to simplify and expedite the operation of scanning manager 416 and stitching software program 418.
The adjacent overlapping still frames 614 may thus be combined into a composite still image by utilizing stitching software program 418 or any other effective means, from either within video camera 110 or external to video camera 110. In certain embodiments of the present invention, scanning manager 416 and display manager 420 may present various types of user interfaces upon viewfinder 308 or elsewhere on video camera 110. For example, a “scan mode” indicator with various selected parameter indicia maybe displayed to indicate the current performance of a corresponding scanning procedure by video camera 110.
The
Referring now to
In the
In step 816, the system user may select any desired scanning parameters for performing the scanning procedure. For example, as discussed above in conjunction with
Next, in step 820, the system user may initiate the scanning procedure using any appropriate manual or automatic means. In response, scanning system 510 preferably begins scanning target area 512 and capturing image data 422. In accordance with the present invention, motion sensor 516 simultaneously may capture and provide scan motion data 424, including one or more scan speeds, to camera 110. In step 826, scanning manager 416 may preferably create an initial still frame 614 from the captured image data 422. Then, in step 828, at a pre-determined time interval, scanning manager 416 may preferably create a new current still frame 614 from the captured image data 422.
In step 832, either scanning manager 416 or stitching software program 418 may preferably determine an overlap region between the foregoing current still frame 614 and an immediately preceding still frame 614. In accordance with the present invention, scanning manager 416 or stitching software program 418 may utilize any effective technique to determine the overlap region, including the techniques discussed above in conjunction with
Then, in step 836, stitching software program 418 may preferably analyze and combine the image data 422 in the foregoing overlap region to thereby produce a single composite still image from the current still frame 614 and the immediately-preceding still frame 614. In step 840, scanning system 510 preferably determines whether the scanning procedure has been completed. In certain embodiments, a scan end index of scanning system 510 may indicate that the entire target object 512 has been scanned, and that the scanning procedure has therefore been completed. In the event that the scanning procedure has been completed, the
The
The invention has been explained above with reference to certain embodiments. Other embodiments will be apparent to those skilled in the art in light of this disclosure. For example, the present invention may readily be implemented using configurations and techniques other than those described in the embodiments above. Additionally, the present invention may effectively be used in conjunction with systems other than those described above. Therefore, these and other variations upon the discussed embodiments are intended to be covered by the present invention, which is limited only by the appended claims.
Claims
1. A system for creating a composite image of a target area by utilizing
- an imaging device, comprising: a scanning manager coupled to said imaging device for analyzing scan motion data from a scanning procedure that captures a frame sequence corresponding to said target area, said scanning manager extracting still frames from said frame sequence at a selectable time interval entered by a system user, said scanning manager responsively generating said composite image corresponding to said target area by utilizing image data and said scan motion data.
2. The system of claim 1 wherein a stitching software program processes said composite image, said stitching software program residing on said imaging device.
3. The system of claim 1 wherein said target area includes one of a document, a photographic image, a physical object, a graphics image, and a geographic location.
4. The system of claim 1 wherein a motion detector generates said scan motion data by monitoring movements of said imaging device during said scanning procedure, said scan motion data including a scan speed and a scan direction.
5. The system of claim 1 wherein said imaging device is initially positioned at a starting index of a scan path to allow said imaging device to frame said target area using a focus mechanism and a zoom mechanism.
6. The system of claim 5 wherein said system user enters scan parameters into said imaging device for performing said scanning procedure, said scan parameters including a scan speed control, a scan direction control, a still frame time interval control, a scan overlap control, and a scan resolution control.
7. The system of claim 6 wherein said imaging device generates an error warning on a user interface when said system user enters an invalid scan parameter, said invalid scan parameter including a negative overlap setting which would cause still images from said image data to be aligned in excess of a minimum adjacent still image overlap value.
8. The system of claim 5 wherein said imaging device moves along said scan path during said scanning procedure, said imaging device responsively beginning to capture and store image data that corresponds to said target area.
9. The system of claim 8 wherein a display manager in said imaging device displays an active scan mode indicator on a user interface of said imaging device during said scanning procedure, said active scan mode indicator displaying user settings for scan parameters including a scan speed, a scan direction, and said selectable time interval.
10. The system of claim 8 wherein said imaging device captures said image data, said imaging device storing said image data using a keyframe format in which a series of keyframes that contain said complete pixel set are separated by a series of difference frames which contain only altered pixels which are different from a corresponding one of said keyframes, each of said keyframes being generated when an altered pixel total exceeds a pre-determined threshold value.
11. The system of claim 8 wherein a motion detector captures scan motion data corresponding to movements of said imaging device, said motion detector providing said scan motion data to said scanning manager of said imaging device, said scan motion data including a scan speed and a scan direction.
12. The system of claim 11 wherein said motion detector generates said scan speed by monitoring a velocity sensor of said imaging device during said scanning procedure.
13. The system of claim 11 wherein said scan speed is expressed by a formula: where said Non-Overlapped Scan Distance is a length of a non-overlapped region of an immediately-preceding still frame prior to a start of a current still frame, and said Time Interval is a length of time required to transport said imaging device across said Non-Overlapped Scan Distance to said start of said current still frame.
- Scan Speed=Non-Overlapped Scan Distance/Time Interval
14. The system of claim 11 wherein said scanning manager extracts an initial still frame of said target area from said image data that is captured by said imaging device during said scanning procedure.
15. The system of claim 14 wherein said scanning manager extracts a current still frame of said target area from said image data at a pre-determined time interval during said scanning procedure.
16. The system of claim 15 wherein said scanning manager determines an overlap region between said initial still frame and said current still frame by referencing said scan motion data.
17. The system of claim 16 wherein said scanning manager calculates an overlap length for said overlap region according to a formula: where said Overlap Length is a distance from a start of said overlap region to an end of said overlap region, said Non-Overlapped Scan Distance is a length of a non-overlapped region of said initial still frame prior to a start of said current still frame, and Still Frame Length is a constant length of one of said still frames.
- Overlap Length=Still Frame Length−Non-Overlapped Scan Distance
18. The system of claim 16 wherein a stitching software program combines said image data in said overlap region between said initial still frame and said current still frame to provide greater image detail and increased image resolution, said stitching software program thereby generating said composite image of said target area from said initial still frame and said current still frame.
19. The system of claim 1 wherein said imaging device performs a concurrent combination procedure for concurrently combining a series of said still frames to generate said composite image.
20. The system of claim 1 wherein said scanning procedure is performed by a moving target area process in which said imaging device is stationary.
Type: Application
Filed: Sep 5, 2013
Publication Date: Feb 6, 2014
Applicants: Sony Electronics Inc. (Park Ridge, NJ), Sony Corporation (Tokyo)
Inventors: Clay Fisher (San Diego, CA), Eric Edwards (Kealakekua, HI), Michael Blasgen (Los Gatos, CA)
Application Number: 14/018,492
International Classification: H04N 5/232 (20060101);