Abstract: Methods, systems, and computer-readable media for bi-modal understanding of natural language (NL) and artificial neural network architectures (NA), with reference to an example implementation framework entitled “ArchBERT”. A model and method of training the model for bi-modal understanding of NL and NA are described. The model trained in bi-modal understanding of NL and NA can be deployed to perform tasks such as processing NL to perform reasoning relating to NA, architectural question answering, architecture clone detection, bi-modal architecture clone detection, clone architecture search, and/or bi-modal clone architecture search.

Abstract: Methods, systems, and computer-readable media for bi-modal generation of natural language (NL) and artificial neural network architectures (NA), with reference to an example implementation framework entitled “ArchGenBERT”. A model and method of training the model for bi-modal generation of NL and NA are described. The model trained for bi-modal generation of NL and NA can be deployed to perform a number of useful tasks to assist with designing, describing, translating, and modifying neural network architectures.

Abstract: Method and system for predicting a label for an input sample. A first label is predicted for the input sample using a first machine learning (ML) model that has been trained to map samples to a first set of labels; If the first label satisfies prediction accuracy criteria it is outputted as the predicted label for the input sample; if the first label does not satisfy the prediction accuracy criteria, a second label is predicted for the input sample using a second ML model that has been trained to map samples to a second set of labels that includes the first set of labels and a set of additional labels, and the second label is outputted as the predicted label for the input sample.

Abstract: Methods, systems, and techniques for visual automatic transcription of music played on a musical keyboard instrument. The system receives a video input of the musical instrument being played. A transcribing application detects a keyboard section of a background frame of the video input by detecting a shape of the keyboard and the presence of keys in the shape. The keys are detected in the background image and the positional information and associated musical notes of each key is determined. A difference image is obtained by subtracting the background image from the current frame. A musical note is determined for the pressed key based on the positional information and associated musical notes of the keys in the background image.