Abstract: Methods and apparatus for using a controllable filter, e.g., an liquid crystal panel, in front of a camera are described. The filter is controlled based on the luminosity of object in a scene being captured by the camera to reduce or eliminate luminosity related image defects such as flaring, blooming or ghosting. Multiple cameras and filters can be used to capture multiple images as part of a depth determination processes where pixel values captured by cameras at different locations are matched to determine the depth, e.g., distance from the camera or camera system to object in the environment. Pixel values are normalized in some embodiments based on the amount of filtering applied to a sensor region and sensor exposure time. The filtering allows for regional sensor exposure control at an individual camera even though the overall exposure time of the pixel sensors may be and often will be the same.

Abstract: A method of real-time plant selection and removal from a plant field including capturing a first image of a first section of the plant field, segmenting the first image into regions indicative of individual plants within the first section, selecting the optimal plants for retention from the first image based on the first image and the previously thinned plant field sections, sending instructions to the plant removal mechanism for removal of the plants corresponding to the unselected regions of the first image from the second section before the machine passes the unselected regions, and repeating the aforementioned steps for a second section of the plant field adjacent the first section in the direction of machine travel.

Abstract: A boom sprayer includes any number of components to treat plants as the boom sprayer travels through a plant field. The components take actions to treat plants or facilitate treating plants. The boom sprayer includes any number of sensors to measure the state of the boom sprayer as the boom sprayer treats plants. The boom sprayer includes a control system to generate actions for the components to treat plants in the field. The control system includes an agent executing a model that functions to improve the performance of the boom sprayer treating plants. Performance improvement can be measured by the sensors of the boom sprayer. The model is an artificial neural network that receives measurements as inputs and generates actions that improve performance as outputs. The artificial neural network is trained using actor-critic reinforcement learning techniques.

Abstract: A farming machine including a number of treatment mechanisms treats plants according to a treatment plan as the farming machine moves through the field. The control system of the farming machine executes a plant identification model configured to identify plants in the field for treatment. The control system generates a treatment map identifying which treatment mechanisms to actuate to treat the plants in the field. To generate a treatment map, the farming machine captures an image of plants, processes the image to identify plants, and generates a treatment map. The plant identification model can be a convolutional neural network having an input layer, an identification layer, and an output layer. The input layer has the dimensionality of the image, the identification layer has a greatly reduced dimensionality, and the output layer has the dimensionality of the treatment mechanisms.

Abstract: A system for plant parameter detection, including: a plant morphology sensor having a first field of view and configured to record a morphology measurement of a plant portion and an ambient environment adjacent the plant, a plant physiology sensor having a second field of view and configured to record a plant physiology parameter measurement of a plant portion and an ambient environment adjacent the plant, wherein the second field of view overlaps with the first field of view; a support statically coupling the plant morphology sensor to the physiology sensor, and a computing system configured to: identify a plant set of pixels within the physiology measurement based on the morphology measurement; determine physiology values for each pixel of the plant set of pixels; and extract a growth parameter based on the physiology values.

Abstract: Described are methods for identifying the in-field positions of plant features on a plant by plant basis. These positions are determined based on images captured as a vehicle (e.g., tractor, sprayer, etc.) including one or more cameras travels through the field along a row of crops. The in-field positions of the plant features are useful for a variety of purposes including, for example, generating three-dimensional data models of plants growing in the field, assessing plant growth and phenotypic features, determining what kinds of treatments to apply including both where to apply the treatments and how much, determining whether to remove weeds or other undesirable plants, and so on.

Abstract: A farming machine includes one or more image sensors for capturing an image as the farming machine moves through the field. A control system accesses an image captured by the one or more sensors and identifies a distance value associated with each pixel of the image. The distance value corresponds to a distance between a point and an object that the pixel represents. The control system classifies pixels in the image as crop, plant, ground, etc. based on the visual information in the pixels. The control system generates a labelled point cloud using the labels and depth information, and identifies features about the crops, plants, ground, etc. in the point cloud. The control system generates treatment actions based on any of the depth information, visual information, point cloud, and feature values. The control system actuates a treatment mechanism based on the classified pixels.

Abstract: A method for plant treatment, including: receiving a first measurement for a plant from a sensor as the sensor moves within a geographic area comprising a plurality of plants; in response to receipt of the first measurement and prior to receipt of a second measurement for a second plant of the plurality, determining a set of treatment mechanism operation parameters for the plant to optimize a geographic area output parameter based on the first measurement and historical measurements for the geographic area; determining an initial treatment parameter for the plant; and operating a treatment mechanism in a treatment mode based on the set of operating parameters in response to satisfaction of the initial treatment parameter.

Abstract: A method including: recording a first image of a first field region; automatically treating a plant within the first region in-situ based on the first image; automatically verifying the plant treatment with a second image of the first region; and automatically treating a second region concurrently with treatment verification.

Abstract: A treatment system for spraying treatment fluid onto plants in a field is described. The treatment system includes a highly configurable treatment mechanism including an array of nozzles and valve assemblies coupled into manifolds, and manifold assemblies. The manifolds of the manifold assemblies can be oriented in an open state or a nested state, the open state with no overlap between nozzles of adjacent manifolds and the nested state with overlap between nozzles of adjacent manifolds. The manifolds can have multiple configurations, examples of which include a tube manifold and an offset manifold. The nozzles of the system can have multiple configurations, examples of which include a tri-spray nozzle, a bar nozzle, a fan nozzle, and a deflected fan nozzle. The system can be controlled by a system controller which detects plant material and instructs a nozzle or combination of nozzles to spray treatment fluid.

Abstract: A treatment system for spraying treatment fluid onto plants in a field is described. The treatment system includes a configurable treatment mechanism including an array of nozzles and valve assemblies coupled into manifolds, and manifold assemblies. The nozzle comprises a nozzle housing and an insert assembly contained within the nozzle housing. When coupled, a top casing including a fluid inlet and a bottom casing including at least one fluid outlet form the nozzle housing. The insert assembly comprises at least one nozzle insert to fluidically couple the fluid inlet and the fluid outlets such that fluid entering from the fluid inlet exits the nozzle housing through the fluid outlets.

Abstract: A modular system includes a hub and a set of modules removably coupled to the hub. The modules are physically coupled to the frame relative to each other so that each module can operate with respect to a different row of a field. An individual module includes a sensor for capturing field measurement data of individual plants along a row as the modular system moves through the geographic region. An individual module further includes a treatment mechanism for applying a treatment to the individual plants of the row based on the field measurement data before the modular system passes by the individual plants. An individual module further includes a computing device that determines the treatment based on the field measurement data and communicates data to the hub. The hub is communicatively coupled to the modules, so that it may exchange data between the modules and with a remote computing system.

Abstract: A plant treatment platform uses a plant detection model to detect plants as the plant treatment platform travels through a field. The plant treatment platform receives image data from a camera that captures images of plants (e.g., crops or weeds) growing in the field. The plant treatment platform applies pre-processing functions to the image data to prepare the image data for processing by the plant detection model. For example, the plant treatment platform may reformat the image data, adjust the resolution or aspect ratio, or crop the image data. The plant treatment platform applies the plant detection model to the pre-processed image data to generate bounding boxes for the plants. The plant treatment platform then can apply treatment to the plants based on the output of the machine-learned model.

Abstract: A treatment system for spraying treatment fluid onto plants in a field is described. The treatment system includes a configurable treatment mechanism including an array of nozzles and valve assemblies coupled into manifolds, and manifold assemblies. The nozzle comprises a nozzle housing and an insert assembly contained within the nozzle housing. When coupled, a top casing including a fluid inlet and a bottom casing including at least one fluid outlet form the nozzle housing. The insert assembly comprises at least one nozzle insert to fluidically couple the fluid inlet and the fluid outlets such that fluid entering from the fluid inlet exits the nozzle housing through the fluid outlets.

Abstract: A method of real-time plant selection and removal from a plant field including capturing a first image of a first section of the plant field, segmenting the first image into regions indicative of individual plants within the first section, selecting the optimal plants for retention from the first image based on the first image and the previously thinned plant field sections, sending instructions to the plant removal mechanism for removal of the plants corresponding to the unselected regions of the first image from the second section before the machine passes the unselected regions, and repeating the aforementioned steps for a second section of the plant field adjacent the first section in the direction of machine travel.

Abstract: A technique for generating virtual models of plants in a field is described. Generally, this includes recording images of plants in-situ; generating point clouds from the images; generating skeleton segments from the point cloud; classifying a subset of skeleton segments as unique plant features using the images; and growing plant skeletons from skeleton segments classified as unique plant feature. The technique may be used to generate a virtual model of a single, real plant, a portion of a real plant field, and/or the entirety of the real plant field. The virtual model can be analyzed to determine or estimate a variety of individual plant or plant population parameters, which in turn can be used to identify potential treatments or thinning practices, or predict future values for yield, plant uniformity, or any other parameter can be determined from the projected results based on the virtual model.

Abstract: A plant treatment system automatically adjusts camera operation parameters for a camera used by the plant treatment system to identify and treat plants in a field. The plant treatment system can generate image segments of images received from the camera and classify the image segments based on whether the image segments represent plants. The plant treatment system determines whether each of the image segments is over- or under-exposed and adjusts the camera operation parameters for the camera based on the exposure classification of the image segments. Alternatively, the plant treatment system may use a plant detection model to identify plant pixels within an image that represent plants. The plant treatment system can then determine whether the identified plant pixels are over- or under-exposed and adjust the camera operation parameters accordingly.

Abstract: Described are methods for identifying the in-field positions of plant features on a plant by plant basis. These positions are determined based on images captured as a vehicle (e.g., tractor, sprayer, etc.) including one or more cameras travels through the field along a row of crops. The in-field positions of the plant features are useful for a variety of purposes including, for example, generating three-dimensional data models of plants growing in the field, assessing plant growth and phenotypic features, determining what kinds of treatments to apply including both where to apply the treatments and how much, determining whether to remove weeds or other undesirable plants, and so on.

Abstract: A plant treatment system automatically adjusts camera operation parameters for a camera used by the plant treatment system to identify and treat plants in a field. The plant treatment system can generate image segments of images received from the camera and classify the image segments based on whether the image segments represent plants. The plant treatment system determines whether each of the image segments is over- or under-exposed and adjusts the camera operation parameters for the camera based on the exposure classification of the image segments. Alternatively, the plant treatment system may use a plant detection model to identify plant pixels within an image that represent plants. The plant treatment system can then determine whether the identified plant pixels are over- or under-exposed and adjust the camera operation parameters accordingly.

Abstract: A technique for generating virtual models of plants in a field is described. Generally, this includes recording images of plants in-situ; generating point clouds from the images; generating skeleton segments from the point cloud; classifying a subset of skeleton segments as unique plant features using the images; and growing plant skeletons from skeleton segments classified as unique plant feature. The technique may be used to generate a virtual model of a single, real plant, a portion of a real plant field, and/or the entirety of the real plant field. The virtual model can be analyzed to determine or estimate a variety of individual plant or plant population parameters, which in turn can be used to identify potential treatments or thinning practices, or predict future values for yield, plant uniformity, or any other parameter can be determined from the projected results based on the virtual model.