Abstract: A deep learning system is used to predict crop characteristics from inputs that include crop variety features, environmental features, and field management features. The deep learning system includes domain-specific modules for each category of features. Some of the domain-specific modules are implemented as convolutional neural networks (CNN) while others are implemented as fully-connected neural networks. Interactions between different domains are captured with cross attention between respective embeddings. Embeddings from the multiple domain-specific modules are concatenated to create a deep neural network (DNN). The prediction generated by the DNN is a characteristic of the crop such as yield, height, or disease resistance. The DNN can be used to select a crop variety for planting in a field. For a crop that is planted, the DNN may be used to select a field management technique.