Human–Machine Hybrid Federated Learning: Concept and Applications

Abstract

Federated learning (FL) has become a state-of-the-art technique for addressing data isolation and privacy problems. However, the traditional FL framework has limitations on lack of labeled data, adaptation to evolving environments and tasks, and insufficient generalization of the global model due to nonindependent and identically distributed (non-IID) data. These issues suggest that incorporating human knowledge and interaction into the FL workflow can be beneficial. Human–machine hybrid intelligence (HI) is an area that human abilities are considered to prompt the usability and robustness of the system by providing human domain knowledge. Combining FL and human–machine HI can fully utilize their benefits and complement each other perfectly. This article presents our vision of the next generation of FL, human–machine hybrid intelligent FL, namely HIFL, and this work first defines the concept of HIFL and proposes three patterns of collaboration for HIFL: 1) local HIFL (LocalHIFL); 2) separate HIFL (SeparateHIFL); and 3) cross HIFL (CrossHIFL). In each pattern, we survey methodologies and techniques that are utilized to address specific problems that occurred after adding human–machine collaboration in FL process. Besides, we exhibit some potential application scenarios, and provide several open challenges and opportunities contained in HIFL. This survey intends to provide a high-level summarization for improving FL by combining human–machine HI, and to motivate interested readers to consider approaches for designing effective FL approaches and ways of intelligence fusion according to their requirements.