Abstract: A decentralized machine learning system is disclosed. The system includes one or more learning groups which include one or more learning nodes. The one or more learning groups are formed based on a decision for participation of the one or more learning nodes in decentralized learning via multiple selective node learning flags at a node level. The system also includes a platform server to perform multiple functions. The platform server includes one or more group managers to manage the one or more corresponding learning groups by providing authentication, authorization and harmonization between the one or more learning nodes. The platform server also includes a central connection manager to orchestrate communication among the one or more learning groups for harmonization of the decentralized learning based on a decision for participation of the one or more learning groups via multiple selective group learning flags at a group level.