Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for fish weight estimation based on fish tracks identified in images. In some implementations, a method includes obtaining images of fish enclosed in a fish enclosure, identifying fish tracks shown in the images of the fish, determining a quality score for each of the fish tracks, selecting a subset of the fish tracks based on the quality scores, determining a representative weight of the fish in the fish enclosure based on weights of the fish shown in the subset of the fish tracks, and outputting the representative weight for display or storage at a device connected to the one or more processors.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media for identification and re-identification of fish. In some implementations, first media representative of aquatic cargo is received. Second media based on the first media is generated, wherein a resolution of the second media is higher than a resolution of the first media. A cropped representation of the second media is generated. The cropped representation is provided to the machine learning model. In response to providing the cropped representation to the machine learning model, an embedding representing the cropped representation is generated using the machine learning model. The embedding is mapped to a high dimensional space. Data identifying the aquatic cargo is provided to a database, wherein the data identifying the aquatic cargo comprises an identifier of the aquatic cargo, the embedding, and a mapped region of the high dimensional space.

Abstract: Methods, systems, and apparatuses, including computer programs encoded on a computer-readable storage medium for estimating the shape, size, mass, and health of fish are described. A pair of stereo cameras may be utilized to obtain off-axis images of fish in a defined area. The images may be processed, enhanced, and combined. Object detection may be used to detect and track a fish in images. A pose estimator may be used to determine key points and features of the detected fish. Based on the key points, a model of the fish is generated that provides an estimate of the size and shape of the fish. A regression model or neural network model can be applied to the fish model to determine characteristics of the fish.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, that generate from a first pair and a second pair of images of livestock that are within an enclosure and that are taken at different times using a stereoscopic camera, at least two distance distributions of the aquatic livestock within the enclosure. The distance distributions can be used to determine a measure associated with an optical property of the water within the enclosure. A signal associated with the measure can be provided.

Abstract: In one aspect, there is provided a method that includes receiving, by a control system having (i) a first camera configured to obtain an image of a scene, (ii) a winch controller, and (iii) a feeding system configured to deliver a feed to aquaculture, instructions to initiate a calibration of the first camera, determining a calibration state of the first camera, determining a sequence of calibration steps based on the calibration state of the first camera, and executing the sequence of calibration steps to calibrate the first camera.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for escape detection and mitigation for aquaculture. In some implementations, a method includes obtaining one or more images that depict one or more fish within a population of fish that are located within an enclosure; providing, to one or more detection models configured to classify fish that are depicted within the images as likely being member or as likely not being member of a type of fish, the one or images; generating, as a result of providing the one or more images to the one or more detection models, a value that reflects a quantity of fish that are depicted in the images that are likely a member of the type of fish; and detecting a condition based at least on the value.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for the automated feeding of fish. In some implementations, a corresponding method may include obtaining meal configuration data including one or more parameters indicating a meal plan for feeding farmed fish; executing the meal plan based on the meal configuration data; receiving sensor data from one or more sensors during execution of the meal plan; and adjusting the execution of the meal plan based on the sensor data from the one or more sensors.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, that control devices in an aquaculture environment. One of the methods includes determining a particular objective for a robot that is operating in an aquaculture environment and determining one or more sensed conditions that are associated with the aquaculture environment. The particular objective is provided to an anti-fish-startling model evaluation engine that is configured to output actions, for a given objective, that accomplish the given objective while reducing a startling effect on nearby fish. Based on providing the particular objective to the anti-fish-startling model evaluation engine, one or more particular actions for accomplishing the particular objective are determined. The one or more particular actions are transmitted to another device.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for sensor data processing. The method may include the actions of obtaining sensor data regarding aquatic livestock over periods of time, where the sensor data is captured by at least one sensor at different depths, determining, for each of the periods of time, whether the sensor data captured at different depths during the period of time satisfy one or more evaluation criteria, generating an input data set that concatenates representations of the periods of time, providing the input data set to a machine-learning trained model, receiving, as an output from the machine-learning trained model, an indication of an action to be performed for the aquatic livestock, and initiating performance of the action for the aquatic livestock.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium that automatically performs actions in an aquaculture environment based on light sensed by underwater cameras. One of the methods includes obtaining images of a surface of water captured by a camera that faces upwards from a depth towards the surface of the water within an enclosure that encloses aquatic livestock. An ambient light metric is determined at the depth from the images of the surface of the water. A determination is made as to whether the camera satisfies one or more depth criteria. Based on determining that the depth of the camera satisfies the one or more depth criteria, it is determined that, based on the ambient light metric at the depth, one or more action criteria are satisfied, then initiating performance of an action to be performed for the aquatic livestock.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for escape detection and mitigation for aquaculture. In some implementations, a method includes obtaining one or more images that depict one or more fish within an enclosure; generating, as a result of providing the one or more images to multiple detection models, a value that reflects a quantity of fish that are depicted in the images that are likely a member of each different type of fish; detecting an error condition relating to a possible opening of the enclosure based at least on the value; and in response to detecting the error condition relating to the possible opening of the enclosure, initiating one or more mitigation actions relating to the possible opening.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for controlling an aquaculture feeding system are described. In some implementations, a method includes determining, using a feeding system controller, that a feeding system has transitioned from a first state to a second state, and based on the transition from the first to the second state providing, using the feeding system controller, instructions to a dosing system to set a feed rate of the dosing system, and providing, using the feeding system controller, instructions to a blower operatively coupled to the dosing system to set a flow rate of the blower.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-readable storage media, for automated camera positioning for feeding behavior monitoring. In some implementations, a system obtains an image of a scene, a spatial model that corresponds to a subfeeder, and calibration parameters of a camera, the system determines a size of the subfeeder in the image of the scene, the system selects an updated position of the camera relative to the subfeeder, the system provides the updated position of the camera relative to the subfeeder to a winch controller, and the system moves the camera to the updated position.

Abstract: Methods, systems, and apparatuses, including computer programs encoded on a computer-readable storage medium for estimating the shape, size, mass, and health of fish are described. A pair of stereo cameras may be utilized to obtain off-axis images of fish in a defined area. The images may be processed, enhanced, and combined. Object detection may be used to detect and track a fish in images. A pose estimator may be used to determine key points and features of the detected fish. Based on the key points, a model of the fish is generated that provides an estimate of the size and shape of the fish. A regression model or neural network model can be applied to the fish model to determine characteristics of the fish.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for visually detecting a halocline. In some implementations, a method includes moving a camera through different depths of water within a fish enclosure, capturing, at the different depths, images of fish, determining that changes in focus in the images correspond to changes in depth that the images were captured, and based on determining that the changes in focus in the images correspond to the changes in depths that the images were captured, detecting a halocline at a particular depth.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for visually detecting a halocline. In some implementations, a method includes moving a camera through different depths of water within a fish enclosure, capturing, at the different depths, images of fish, determining that changes in focus in the images correspond to changes in depth that the images were captured, and based on determining that the changes in focus in the images correspond to the changes in depths that the images were captured, detecting a halocline at a particular depth.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for controlling a camera to observe aquaculture feeding behavior. In some implementations, a method includes moving a camera to a first position, obtaining an image captured by the camera at the first position, determining a feeding observation mode, and based on the feeding observation mode and analysis of the image, determining a second position to move the camera.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for escape detection and mitigation for aquaculture. In some implementations, a method includes obtaining one or more images that depict one or more fish within an enclosure; generating, as a result of providing the one or more images to multiple detection models, a value that reflects a quantity of fish that are depicted in the images that are likely a member of each different type of fish; detecting an error condition relating to a possible opening of the enclosure based at least on the value; and in response to detecting the error condition relating to the possible opening of the enclosure, initiating one or more mitigation actions relating to the possible opening.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for fish weight estimation based on fish tracks identified in images.