PATTERNED SUBSTRATE FOR USE IN IMAGE-BASED CLASSIFICATION OF ROCK CUTTINGS
A method of producing an image of at least one rock cutting. The method can include forming or obtaining a substrate having a patterned top surface. The method can also include using the patterned top surface of the substrate to support at least one rock cutting, controlling an image acquisition system to acquire at least one image of the rock cutting for storage and subsequent image processing.
This application claims benefit of U.S. Provisional Patent Application Ser. No. 62/948,504 filed on Dec. 16, 2019, which is incorporated herein by reference in its entirety.
The present disclosure relates to methods and systems that acquire images of rock cuttings and process the images for automated classification of the rock cuttings.
The present disclosure describes new methods and systems that employ a substrate that supports rock cuttings during image acquisition and facilitates the processing of such images for automated classification of the rock cuttings. In embodiments, the substrate can include patterns (or a pattern of features) engraved or otherwise formed in a planar surface of material. The patterns can be formed by laser etching, printing or other deposition of a monolayer of close-packed nanoparticles or other suitable method. In embodiments, dithering algorithms (such as Stucki dithering, Floyd-Steinberg dithering and Jarvis dithering) can be used to define the patterns formed in the substrate. Furthermore, in embodiments, the patterned substrate can be blue in color in order to provide a blue background for the rock cuttings. The blue background is advantageous because rock cuttings of interest tend to have dissimilar color.
The methods and systems of the subject disclosure are especially suitable for automated image-based classification of rock cuttings, such as texture-based deep learning classification of rock cuttings. Extensive experimentation has shown that deep learning algorithms perform better if the training image samples have high magnification and sharp focus. Using the macro mode of image capture can achieve these properties. However, in practice, acquiring images of the rock cuttings with all the cuttings in focus is extremely difficult owing to the fact that macro photography has a shallow depth of field, and typical cutting sizes are few (2-5) times larger than the depth of field.
In order to address this problem, focus stacking (also referred to as focal plane merging) can be used to obtain sharp images of rock cutting mixtures. The proposed method employs the patterned substrate in conjunction with focus stacking and provides for improved results. The key advantages can be summarized as follows.
Systematic and reproduceable approach to automating focus stacking
Focus stacking can be used to capture a sharp image of rock cuttings with all the rock cuttings, including rock texture details, in focus. Focus stacking involves moving the plane of focus of the image acquisition system (e.g., camera with fixed or variable focus lens) over the subject rock cuttings in incremental steps. During each small movement, an image acquisition system is controlled to take an image or photo, working from top to bottom or reverse. The image acquisition system can include a camera (with fixed or variable focus lens) and a light source as shown in
Reduced refection and glare from the substrate
One of the limitations of a uniform (plain) substrate is that it reflects light at identical angles, potentially causing significant glare. On the other hand, the different planes and angles of the features created on the top surface of the patterned substrate can lead to light being reflected at a different angles. The scattered light provides much more favorable “diffuse reflection.”
Diffused (or less sharp) shadow of the target object
The proposed methods and systems of the present disclosure can aid in eliminating the need to perform shadow detection and removal as a costly image pre-processing step. It is important to note that a sharp or crisp shadow can compromise the performances of even the most advances deep learning models. While separating the shadow from a familiar object in an image is not difficult for human brain, it remains to be a challenging (and ill-posed) problem for computer vision. One can always propose and train a novel deep convolutional encoder-decoder model to remove the objectionable shadows by learning a map between image pairs with and without shadow. However, this step can be quite costly in terms of time budget and human effort required to train this model. In contrast, diffusing the sharp shadows makes our imaging technique robust to begin with, eliminating the need of identifying the shadow of cuttings. This is a significant advantage because edge detection is not the end goal in the first place. Instead, more effort can be devoted to design of deep learning automated classification algorithms.
To summarize, the methods and systems of the present disclosure can positively impact the whole data pipeline of automated classification of rock cuttings, including better focus stacking, no need for shadow detection, and better performance of deep learning methods. Such methods and systems are particular advantageous for automated image-based classification of heterogenous mixtures of rock cuttings.
Device 2500 is one example of a computing device or programmable device and is not intended to suggest any limitation as to scope of use or functionality of device 2500 and/or its possible architectures. For example, device 2500 can comprise one or more computing devices, programmable logic controllers (PLCs), etc.
Further, device 2500 should not be interpreted as having any dependency relating to one or a combination of components illustrated in device 2500. For example, device 2500 may include one or more of computers, such as a laptop computer, a desktop computer, a mainframe computer, etc., or any combination or accumulation thereof.
Device 2500 can also include a bus 2508 configured to allow various components and devices, such as processors 2502, memory 2504, and local data storage 2510, among other components, to communicate with each other.
Bus 2508 can include one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. Bus 2508 can also include wired and/or wireless buses.
Local data storage 2510 can include fixed media (e.g., RAM, ROM, a fixed hard drive, etc.) as well as removable media (e.g., a flash memory drive, a removable hard drive, optical disks, magnetic disks, and so forth).
One or more input/output (I/O) device(s) 2512 may also communicate via a user interface (UI) controller 2514, which may connect with I/O device(s) 2512 either directly or through bus 2508.
In one possible implementation, a network interface 2516 may communicate outside of device 2500 via a connected network.
A media drive/interface 2518 can accept removable tangible media 2520, such as flash drives, optical disks, removable hard drives, software products, etc. In one possible implementation, logic, computing instructions, and/or software programs comprising elements of module 2506 may reside on removable media 2520 readable by media drive/interface 2518. Various processes of the present disclosure or parts thereof can be implemented by instructions and/or software programs that are elements of module 2506. Such instructions and/or softwarte programs may reside on removable media 2520 readable by media drive/interface 2518 as is well known in the computing arts.
In one possible embodiment, input/output device(s) 2512 can allow a user (such as a human annotator) to enter commands and information to device 2500, and also allow information to be presented to the user and/or other components or devices. Examples of input device(s) 2512 include, for example, sensors, a keyboard, a cursor control device (e.g., a mouse), a microphone, a scanner, and any other input devices known in the art. Examples of output devices include a display device (e.g., a monitor or projector), speakers, a printer, a network card, and so on.
Various processes of the present disclosure may be described herein in the general context of software or program modules, or the techniques and modules may be implemented in pure computing hardware. Software generally includes routines, programs, objects, components, data structures, and so forth that perform particular tasks or implement particular abstract data types. An implementation of these modules and techniques may be stored on or transmitted across some form of tangible computer-readable media. Computer-readable media can be any available data storage medium or media that is tangible and can be accessed by a computing device. Computer readable media may thus comprise computer storage media. “Computer storage media” designates tangible media, and includes volatile and non-volatile, removable and non-removable tangible media implemented for storage of information such as computer readable instructions, data structures, program modules, or other data. Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other tangible medium which can be used to store the desired information, and which can be accessed by a computer. Some of the methods and processes described above, can be performed by a processor. The term “processor” should not be construed to limit the embodiments disclosed herein to any particular device type or system. The processor may include a computer system. The computer system may also include a computer processor (e.g., a microprocessor, microcontroller, digital signal processor, or general-purpose computer) for executing any of the methods and processes described above.
Some of the methods and processes described above, can be implemented as computer program logic for use with the computer processor. The computer program logic may be embodied in various forms, including a source code form or a computer executable form. Source code may include a series of computer program instructions in a variety of programming languages (e.g., an object code, an assembly language, or a high-level language such as C, C++, or JAVA). Such computer instructions can be stored in a non-transitory computer readable medium (e.g., memory) and executed by the computer processor. The computer instructions may be distributed in any form as a removable storage medium with accompanying printed or electronic documentation (e.g., shrink wrapped software), preloaded with a computer system (e.g., on system ROM or fixed disk), or distributed from a server or electronic bulletin board over a communication system (e.g., the Internet or World Wide Web).
Alternatively or additionally, the processor may include discrete electronic components coupled to a printed circuit board, integrated circuitry (e.g., Application Specific Integrated Circuits (ASIC)), and/or programmable logic devices (e.g., a Field Programmable Gate Arrays (FPGA)). Any of the methods and processes described above can be implemented using such logic devices.
In one or more embodiments, a system for producing an image of at least one rock cutting can include a substrate having a patterned top surface; and an image acquisition system configured to acquire at least one image of a rock cutting while using the patterned top surface of the substrate to support the rock cutting.
In one or more embodiments, the image acquisition system can include a camera with a fixed or variable focus lens and a light source.
In one or more embodiments, the image acquisition system can be configured to acquire a plurality of images of the rock cutting at different focus settings corresponding to different height levels across height of the rock cutting, wherein at least one of the focus settings corresponds to the plane of the top surface of the patterned substrate.
In one or more embodiments, the focus setting can correspond to the plane of the top surface of the patterned substrate focuses the image acquisition system on patterns formed in the patterned substrate.
In one or more embodiments, the focus setting can correspond to the plane of the top surface of the patterned substrate is determined manually or by automatic methods.
In one or more embodiments, a system for producing an image of at least one rock cutting can include a substrate having a patterned top surface; and an image acquisition system configured to acquire at least one image of a rock cutting while using the patterned top surface of the substrate to support the rock cutting, and a processor configured to register or store in electronic form the focus setting corresponding to the plane of the top surface of the patterned substrate for access and use in imaging at least one additional sample of rock cuttings.
In one or more embodiments, a system for producing an image of at least one rock cutting can include a substrate having a patterned top surface; and an image acquisition system configured to acquire at least one image of a rock cutting while using the patterned top surface of the substrate to support the rock cutting, and a processor configured to align and merge the plurality of images to produce a sharpened image of the rock cutting.
In one or more embodiments, the sharpened image of the rock cutting is used as input for automated image-based classification of rock cuttings (such as texture-based deep learning classification of rock cuttings).
In one or more embodiments, the sharpened image of the rock cutting is used as training data or observation data that is input for automated image-based classification of rock cuttings.
a system for producing an image of at least one rock cutting can include a substrate having a patterned top surface; and an image acquisition system configured to acquire at least one image of a rock cutting while using the patterned top surface of the substrate to support the rock cutting, wherein the patterned top surface of the substrate is formed by laser cutting, or by printing or other deposition of nanoparticles.
In one or more embodiments, a system for producing an image of at least one rock cutting can include a substrate having a patterned top surface; and an image acquisition system configured to acquire at least one image of a rock cutting while using the patterned top surface of the substrate to support the rock cutting, wherein the patterned top surface of the substrate is defined by a dithering algorithm (such as Stucki dithering, Floyd-Steinberg dithering, or Jarvis dithering).
In one or more embodiments, a system for producing an image of at least one rock cutting can include a substrate having a patterned top surface; and an image acquisition system configured to acquire at least one image of a rock cutting while using the patterned top surface of the substrate to support the rock cutting, wherein the patterned top surface of the substrate provides a blue background for the rock cutting.
In one or more embodiments, a system for producing an image of at least one rock cutting can include a substrate having a patterned top surface; and an image acquisition system configured to acquire at least one image of a rock cutting while using the patterned top surface of the substrate to support the rock cutting, wherein the system is configured to produce an image of a plurality or mixture of rock cuttings.
Although only a few example embodiments have been described in detail above, those skilled in the art will readily appreciate that many modifications are possible in the example embodiments without materially departing from this invention. Accordingly, all such modifications are intended to be included within the scope of this disclosure as defined in the following claims. In the claims, means-plus-function clauses are intended to cover the structures described herein as performing the recited function and not only structural equivalents, but also equivalent structures. Thus, although a nail and a screw may not be structural equivalents in that a nail employs a cylindrical surface to secure wooden parts together, whereas a screw employs a helical surface, in the environment of fastening wooden parts, a nail and a screw may be equivalent structures. It is the express intention of the applicant not to invoke 35 U.S.C. § 112, paragraph 6 for any limitations of any of the claims herein, except for those in which the claim expressly uses the words ‘means for’ together with an associated function.
There have been described and illustrated herein several embodiments of methods and systems for producing an image of one or more rock cuttings. While particular embodiments have been described, it is not intended that the invention be limited thereto, as it is intended that the invention be as broad in scope as the art will allow and that the specification be read likewise. It will therefore be appreciated by those skilled in the art that yet other modifications could be made to the provided invention without deviating from its spirit and scope as claimed.
Claims
1. A method of producing an image of at least one rock cutting, comprising:
- forming or obtaining a substrate having a patterned top surface; and
- while using the patterned top surface of the substrate to support at least one rock cutting, controlling an image acquisition system to acquire at least one image of the rock cutting for storage and subsequent image processing.
2. A method according to claim 1, wherein:
- the image acquisition system comprises a camera with a fixed or variable focus lens and a light source.
3. A method according to claim 1, further comprising:
- controlling the image acquisition system to acquire a plurality of images of the rock cutting at different focus settings corresponding to different height levels across height of the rock cutting, wherein at least one of the focus settings corresponds to the plane of the top surface of the patterned substrate.
4. A method according to claim 3, wherein:
- the focus setting corresponding to the plane of the top surface of the patterned substrate focuses the image acquisition system on patterns formed in the patterned substrate.
5. A method according to claim 3, wherein:
- the focus setting corresponding to the plane of the top surface of the patterned substrate is determined manually or by automatic methods.
6. A method according to claim 3, further comprising:
- registering or storing in electronic form the focus setting corresponding to the plane of the top surface of the patterned substrate for access and use in imaging at least one additional sample of rock cuttings.
7. A method according to claim 3, further comprising:
- aligning and merging the plurality of images to produce a sharpened image of the rock cutting.
8. A method according to claim 7, wherein:
- the sharpened image of the rock cutting is used as input for automated image-based classification of rock cuttings (such as texture-based deep learning classification of rock cuttings).
9. A method according to claim 7, wherein:
- the sharpened image of the rock cutting is used as training data or observation data that is input for automated image-based classification of rock cuttings.
10. A method according to claim 1, wherein:
- the patterned top surface of the substrate is formed by laser cutting, or by printing or other deposition of nanoparticles.
11. A method according to claim 1, wherein:
- the patterned top surface of the substrate is defined by a dithering algorithm (such as Stucki dithering, Floyd-Steinberg dithering, or Jarvis dithering).
12. A method according to claim 1, wherein:
- the patterned top surface provides a blue background for the rock cutting.
13. A method according to claim 1, which is configured to produce an image of a plurality or mixture of rock cuttings.
14. A system for producing an image of at least one rock cutting, comprising:
- a substrate having a patterned top surface; and
- an image acquisition system configured to acquire at least one image of a rock cutting while using the patterned top surface of the substrate to support the rock cutting.
Type: Application
Filed: Dec 15, 2020
Publication Date: Feb 2, 2023
Inventors: Richa Sharma (Cambridge, MA), Quincy K. Elias (Hyde Park, MA)
Application Number: 17/756,393