SYSTEM AND METHOD FOR CROPPING AND ANNOTATING IMAGES ON A TOUCH SENSITIVE DISPLAY DEVICE
The present invention is a system and method for cropping and annotating images on a touch sensitive display device or other handheld device, including the following steps: (a) displaying an image of the image file to be cropped/annotated; (b) receiving an first input from a user designating a first point in the image defining a corner of a crop/annotation rectangle; (c) receiving a second input from the user designating a second point in the image defining an opposite corner of the crop/annotation rectangle; and (d) cropping and/or annotating the image from the first point to the second point of the crop/annotation rectangle. The present invention may be used in digital cameras, Apple iPhones®, hand-held devices that inspectors may use to annotate photographs taken to substantiate statements of problems found during industrial inspections, and in other purposes.
This application claims priority from provisional application Ser. No. 61/122,632, filed on Dec. 15, 2008, and entitled “A system, method and apparatus for inspections and compliance verification of industrial equipment using a handheld device,” the entirety of which is hereby incorporated by reference herein. This application is related to co-pending application Ser. No. 12/489,313, filed on Jun. 22, 2009, and entitled “A system and method for carrying out an inspection or maintenance operation with compliance tracking using a handheld device,” the entirety of which is hereby incorporated by reference herein.
FIELD OF THE INVENTIONThe present invention is generally related to user-interfaces for touch-sensitive displays. More specifically, the instant invention relates to a system and method for capturing, cropping, and annotating images on a touch sensitive display device or other handheld device.
BACKGROUND OF THE INVENTIONCropping and annotating images is important in graphic user interfaces (GUIs), both for manipulating images in graphics applications such as Adobe Photoshop®, Microsoft Paint®, and the like, and also for cropping and annotating images for insertion into textual documents such as Adobe Portable Document Format (PDF)®, Microsoft Word®, and the like.
Multiple end-use applications require cropping and annotating images, including reference manuals, encyclopedias, educational texts, inspection reports, and the like. For example, U.S. Ser. No. 12/489,313, filed on Jun. 22, 2009, entitled “A system and method for carrying out an inspection or maintenance operation with compliance tracking using a handheld device,” describes a method for carrying out an inspection on a piece of industrial equipment and generating inspection reports in the field. An inspector out in the field carrying out an inspection operation needs a convenient, quick, and accurate method to crop and annotate images taken in the field.
One prior method of image cropping and annotating is shown in
Applications of the present invention include digital cameras, digital video cameras, phones with built-in cameras, phones with built-in display devices, such as the Apple iPhone®, and the like. In general, the present invention may be used to provide a simple and convenient method to crop and annotate images in situations and locations where such ease is important and/or necessary.
For example, one concrete application of the present invention is related to supplying a convenient user interface for a handheld device used for industrial inspection and maintenance compliance systems, as described in related U.S. Ser. No. 12/489,313. The present invention allows an easy mechanism for on-site inspectors to quickly crop and annotate images in the field to substantiate problems found during an inspection.
One of ordinary skill in the art will find many useful applications of the present invention in which a convenient and easy way is needed to either crop or annotate images on a touch-sensitive display or other hand-held device.
It is against this background that various embodiments of the present invention were developed.
BRIEF SUMMARY OF THE INVENTIONThe present invention is a system and method for cropping and annotating images on a touch sensitive display device or other handheld device.
One embodiment of the present invention is a method for cropping images, including the steps of (a) displaying an image of the image file to be cropped; (b) receiving a first input from a user designating a first point in the image defining a corner of a crop rectangle, e.g., a lower left hand corner; (c) receiving a second input from the user designating a second point in the image defining the opposite corner of the crop rectangle, e.g. an upper right hand corner; and (d) cropping the image to the crop rectangle defined by the two corners when the second input is released.
Another embodiment of the present invention is the method described above also including the step of displaying on the image a location of the first point.
Another embodiment of the present invention is the method described above also including the step of displaying a rectangle corresponding to the crop rectangle of the image before cropping the image.
Another embodiment of the present invention is the method described above where if a user does not immediately release the second input, allowing the user to drag the second point to visually edit a shape and a size of the crop rectangle.
Another embodiment of the present invention is the method described above where if a user drags the second point near an edge of the displayed image, and the image is larger than the displayed portion, then scrolling the displayed portion to show area of the image in a direction of the dragged point.
Another embodiment of the present invention is the method described above also including the step of displaying the cropped image in the display area in place of the original image.
Another embodiment of the present invention is the method described above also including the step of scaling the cropped image to fill the entire display area.
Yet another embodiment of the present invention is a method of annotating an image (where annotating an image includes superimposing one or more geometrical shapes on top of the image), the method including the steps of (a) displaying an image of the image file to be annotated; (b) receiving a first input from a user designating a first point in the image defining a corner of an annotation rectangle, e.g. the lower left hand corner; (c) receiving a second input from the user designating an opposite corner of the annotation rectangle, e.g., the upper right hand corner; and (d) annotating the image in the annotation rectangle defined by the two corners when the second input is released.
Another embodiment of the present invention is the method described above also including the step of displaying on the image a location of the first point.
Another embodiment of the present invention is the method described above also including the step of displaying a shape corresponding to the annotation of the image before annotating the image.
Another embodiment of the present invention is the method described above where if a user does not immediately release the second input, allowing the user to drag the second point to visually show a shape and a size of the annotation area.
Another embodiment of the present invention is the method described above where if a user drags the second point near an edge of the displayed image, and the image is larger than the displayed portion, then scrolling the displayed portion to show area of the image in a direction of the dragged point.
Another embodiment of the present invention is the method described above also including the step of displaying the annotated image in the display area in place of the original image.
Another embodiment of the present invention is the method described above also including the step of receiving a third input representing a type of shape and a characteristic of the shape corresponding to the annotation.
Another embodiment of the present invention is the method described above where the shape is, but is not limited to, a line, a rectangle, an ellipse, or a circle. Another embodiment of the present invention is the method described above where the characteristics of the shape include, but is not limited to, a line type, a line width, and a line color.
The present invention also includes a related system by which the method of capturing, cropping, and annotating an image could be carried out. Such a system could be implemented as a computer system, embodied in a handheld device. The system may include integrated or separate hardware components for taking of media samples and means for receiving touch input.
The invention will be readily understood by the following detailed description in conjunction with the accompanying drawings, wherein like reference numerals designate like structural elements, and in which:
The present invention generally pertains to a system and method for capturing, cropping, and annotating images on a touch sensitive display or other handheld device.
The interface according to the principles of the present invention could have, but is not limited to, the following components. Any subsets of the following components are also within the scope of this invention. After a user captures an initial image, it is stored and displayed. No actions of the user will modify the initial image, allowing all edits to be undone or re-applied against the original image.
The user can choose to crop the image as follows:
-
- 1. The user can click once on a point in the image, displaying a point where the click occurred, and then click again at another point in the image;
- 2. A rectangle with the two clicks at opposite corners is displayed. When the user releases the second click, including immediately releasing it, this rectangle becomes the new crop rectangle;
- 3. If the user does not immediately release the second click, they can drag the point to visually edit the shape and size of the rectangle;
- 4. If the point is dragged near the edge of the displayed image and the image is larger than the displayed portion, then the displayed portion will scroll to show the areas in the direction of the dragged point; and
- 5. Once selected, the new crop rectangle becomes the area displayed. The image within the selected rectangle can be scaled to the size of the viewport.
The user can choose to annotate the image as follows:
-
- 1. The user can choose a type of an annotation shape (e.g., line, rectangle, ellipse), and characteristics of the annotation shape such as line type (e.g., dashed), line width, and line color, etc.;
- 2. The user can click once on a point in the image, displaying a point where the click occurred, and then click again at another point in the image;
- 3. An annotation shape of the appropriate type is displayed over the image with the two clicks at opposite corners of the shape's bounding rectangle. When the user releases the second click, including immediately releasing it, this shape and its location on the image are saved;
- 4. If the user does not immediately release the second click, they can drag the point to visually edit the shape and its size; and
- 5. If the point is dragged near the edge of the displayed image and the image is larger than the displayed portion, then the displayed portion will scroll to show the areas in the direction of the dragged point, and the portion of the shape in the displayed area will be shown.
The invention may be used in an industrial inspection compliance system with which various methods can be carried out to the effect of assisting in an inspection and providing the means for compliance verification of a proper inspection. For the purposes of the text describing this invention, an inspection may represent the process of checking a physical component for safety, security or business reasons, doing the same for compliance with industrial standards and guidelines, or a maintenance operation on a physical component for those same reasons. These methods can generally be best executed by a multi-function handheld device, carried to and used in the physical proximity of an inspection component by the inspector. Examples of multi-function handheld devices include the Apple iPhone®, the Psion Teklogix Workabout Pro®, the Motorola MC-75®, and the like, but the present invention is not limited to such devices as shown or described here. One embodiment of the inspection compliance method includes the steps of scanning unique machine-readable tags deployed at logical inspection points defined by the inspector, and assigning a timestamp to the scanning operation; taking media samples of logical inspection points defined by the inspector, and assigning a timestamp to the media sample capturing operation; reporting of sub-optimal conditions of the unique machine-readable tags deployed at logical inspection points if its condition warrants such a declaration; associating a media sample with a corresponding scan of a unique machine-readable tag; and annotating a media sample in such ways that substantiate statements of an industrial component passing inspection, or in such ways that substantiate statements of problems found with the industrial component. See U.S. Ser. No. 12/489,313 for more details of an example of an industrial inspection compliance system to which the present invention may be applied.
The invention is discussed below with reference to
In order to solve the inherent limitations in the prior art method described in
The process described in
Therefore, as shown in FIGS. 2 and 3A-3C, a user of the present invention may implement a crop operation with very little hand motion and very little input into the device, which is highly desirable, or even mandatory, when operating in the field, for example, during an inspection operation.
Now turning to annotation of images,
In order to solve the inherent limitations in the prior art method described in
The process described in
Therefore, as shown in FIGS. 5 and 6A-6C, a user of the present invention may implement an annotation operation with very little hand motion and very little input into the device, which is highly desirable, or even mandatory, when operating in the field, for example, during an inspection operation.
The result of the series of actions illustrated in
The illustrative user interface 800 is but one of many possible illustrative embodiments of the present invention. One of ordinary skill in the art would appreciate that any other configuration of objects in a user interface, as well as any possible extensions to the set of functions presented in the user interface 800, are all within the spirit and scope of the present invention.
The illustration shown in
While the methods disclosed herein have been described and shown with reference to particular operations performed in a particular order, it will be understood that these operations may be combined, sub-divided, or re-ordered to form equivalent methods without departing from the teachings of the present invention. Accordingly, unless specifically indicated herein, the order and grouping of the operations is not a limitation of the present invention.
While the invention has been particularly shown and described with reference to embodiments thereof, it will be understood by those skilled in the art that various other changes in the form and details may be made without departing from the spirit and scope of the invention.
Claims
1. A method for cropping an image file, comprising the steps of:
- displaying an image of the image file to be cropped in a display area;
- receiving a first input from a user designating a first point in the image defining a corner of a crop rectangle;
- receiving a second input from the user designating a second point in the image defining an opposite corner of the crop rectangle; and
- cropping the image to the crop rectangle defined by the first point and the second point to create a cropped image when the second input is released.
2. The method as recited in claim 1, further comprising:
- displaying on the image a location of the first point.
3. The method as recited in claim 1, further comprising:
- displaying a rectangle overlaid over the image corresponding to the crop rectangle before cropping the image.
4. The method as recited in claim 1, wherein if the user does not immediately release the second input, allowing the user to drag the second point to visually edit a shape and a size of the crop rectangle.
5. The method as recited in claim 1, wherein if the user drags the second point near an edge of a displayed portion and the image is larger than the displayed portion, then scrolling the displayed portion to show a portion of the image in a direction of the dragged point.
6. The method as recited in 1, further comprising:
- displaying the cropped image in the display area in place of the original image.
7. The method as recited in claim 6, further comprising:
- scaling the cropped image to fill the entire display area.
8. A method of annotating an image file, comprising the steps of:
- displaying an image of the image file to be annotated in a display area;
- receiving a first input from a user designating a first point in the image defining a corner of an annotation rectangle;
- receiving a second input from the user designating a second point in the image defining an opposite corner of the annotation rectangle; and
- annotating the image from the first point to the second point of the annotation rectangle to create an annotated image when the second input is released.
9. The method as recited in claim 8, further comprising:
- displaying on the image a location of the first point.
10. The method as recited in claim 8, further comprising:
- displaying a shape corresponding to the annotation rectangle of the image before annotating the image.
11. The method as recited in claim 8, wherein if the user does not immediately release the second input, allowing the user to drag the second point to visually show a shape and a size of the annotation rectangle.
12. The method as recited in claim 8, wherein if the user drags the second point near an edge of a displayed portion and the image is larger than the displayed portion, then scrolling the displayed portion to show a portion of the image in a direction of the dragged point.
13. The method as recited in 8, further comprising:
- displaying the annotated image in the display area in place of the original image.
14. The method as recited in claim 8, further comprising:
- receiving a third input representing a type of shape and a characteristic of the shape corresponding to the annotation rectangle.
15. The method as recited in claim 14, wherein the shape is selected from the group consisting of a line, a rectangle, an ellipse, and a circle.
16. The method as recited in claim 14, wherein the characteristic of the shape is selected from the group consisting of a line type, a line width, and a line color.
17. A touch-sensitive hand-held system having a capability of cropping and annotating an image file, comprising:
- at least one processor; and
- at least one or more memories, operatively coupled to the processor, and containing program code, which when executed causes the processor to execute a process comprising the steps of: displaying an image of the image file to be cropped or annotated in a display area; receiving a first input from a user designating a first point in the image defining a corner of a crop rectangle; receiving a second input from the user designating a second point in the image defining an opposite corner of the crop rectangle; cropping the image from the first point to the second point of the crop rectangle when the second input is released to form a cropped image; displaying the cropped image in the display area in place of the original image; receiving a third input from the user designating a third point in the cropped image defining a corner of an annotation rectangle; receiving a fourth input from the user designating a fourth point in the cropped image defining an opposite corner of the annotation rectangle; and annotating the cropped image from the third point to the fourth point of the annotation rectangle when the fourth input is released to form an annotated cropped image.
18. The system as recited in claim 17, further containing program code, which when executed causes the processor to execute a process further comprising the step of:
- displaying on the image a location of the first point and a location of the third point.
19. The system as recited in claim 17, further containing program code, which when executed causes the processor to execute a process further comprising the steps of:
- displaying a rectangle overlaid over the image corresponding to the crop rectangle before cropping the image; and
- displaying a shape overlaid over the image corresponding to the annotation rectangle before annotating the image.
20. The system as recited in claim 17, wherein if the user does not immediately release the second input or the fourth input, allowing the user to drag the second point or the fourth point to visually show a shape and a size of the crop rectangle or the annotation rectangle.
21. The system as recited in claim 17, wherein if the user drags the second point or the fourth point near an edge of a displayed portion and the image is larger than the displayed portion, then scrolling the displayed portion to show a portion of the image in a direction of the dragged point.
22. The system as recited in 17, further containing program code, which when executed causes the processor to execute a process further comprising the step of:
- displaying the annotated cropped image in the display area in place of the cropped image.
Type: Application
Filed: Jul 21, 2009
Publication Date: Jun 17, 2010
Inventors: Christopher Tossing (Waltham, MA), Marc Siegel (Boston, MA), Alberto Ho (Westford, MA)
Application Number: 12/507,039
International Classification: G09G 5/00 (20060101); G06T 11/20 (20060101);