Abstract: A system for generating a differential diagnosis in a healthcare environment is presented. The system includes a receiver configured to receive one or more user inputs and generate a plurality of input streams. The system further includes a processor including a multi-stream neural network, a training module, and a differential diagnosis generator. The multi-stream neural network includes a plurality of feature extractor sub-networks and a combiner sub-network. The training module includes a feature optimizer configured to train each feature-extractor sub-network individually, and a combiner optimizer configured to train the plurality of feature extractor sub-networks and the combiner sub-network together. The training module is configured to alternate between the feature optimizer and the combiner optimizer until a training loss reaches a defined saturation value.