Abstract: In some embodiments, a method receives a first sequence of inputs for processing via a sub-model of a plurality of sub-model. The plurality of sub-models are part of a main model. An input in the sequence of inputs is masked with a masked value to generate a second sequence of inputs. The method processes the second sequence of inputs using the sub-model to generate a sequence of features that correspond to the second sequence of inputs and processes the sequence of features to generate a first output. The first output is processed to generate a second output of the main model. The sub-model is trained based on a feature in the sequence of features that corresponds to the masked input and the second output.

Abstract: In some embodiments, a method receives a first sequence of inputs for processing via a sub-model of a plurality of sub-model. The plurality of sub-models are part of a main model. An input in the sequence of inputs is masked with a masked value to generate a second sequence of inputs. The method processes the second sequence of inputs using the sub-model to generate a sequence of features that correspond to the second sequence of inputs and processes the sequence of features to generate a first output. The first output is processed to generate a second output of the main model. The sub-model is trained based on a feature in the sequence of features that corresponds to the masked input and the second output.

Abstract: In some embodiments, a method receives a sequence of subsidiary features that are associated with a sequence of main features. A subsidiary feature provides subsidiary information for a main feature. A sequence of first weights for the sequence of subsidiary features is generates where a first weight in the sequence of first weights is generated based on a respective subsidiary feature. The method processes the sequence of first weights to generate a sequence of second weights. The processing uses relationships in the sequence of first weights to generate values of the second weights. The method uses the sequence of second weights to process the sequence of main features to generate an output for the sequence of main features.

Abstract: In some embodiments, a method receives a sequence of subsidiary features that are associated with a sequence of main features. A subsidiary feature provides subsidiary information for a main feature. A sequence of first weights for the sequence of subsidiary features is generates where a first weight in the sequence of first weights is generated based on a respective subsidiary feature. The method processes the sequence of first weights to generate a sequence of second weights. The processing uses relationships in the sequence of first weights to generate values of the second weights. The method uses the sequence of second weights to process the sequence of main features to generate an output for the sequence of main features.

Abstract: In some embodiments, a method receives a first sequence of inputs for processing via a sub-model of a plurality of sub-model. The plurality of sub-models are part of a main model. An input in the sequence of inputs is masked with a masked value to generate a second sequence of inputs. The method processes the second sequence of inputs using the sub-model to generate a sequence of features that correspond to the second sequence of inputs and processes the sequence of features to generate a first output. The first output is processed to generate a second output of the main model. The sub-model is trained based on a feature in the sequence of features that corresponds to the masked input and the second output.

Abstract: A Method and System to enable user related content preferences intelligently on a headphone is disclosed. The embodiments relate generally to the field of user related content preferences. The embodiments are directed at controlling the content preference data so that a music cortex functions as a data agency to provide the music devices, music applications and streaming services smarter choices and intelligent recommendations.