FedML: A Research Library and Benchmark for Federated Machine Learning (2020-07-27T00:00:00.000000Z)

TL;DR

FedML is introduced, an open research library and benchmark that facilitates the development of new federated learning algorithms and fair performance comparisons and can provide an efficient and reproducible means of developing and evaluating algorithms for the Federated learning research community.

Abstract

Federated learning is a rapidly growing research field in the machine learning domain. Although considerable research efforts have been made, existing libraries cannot adequately support diverse algorithmic development (e.g., diverse topology and flexible message exchange), and inconsistent dataset and model usage in experiments make fair comparisons difficult. In this work, we introduce FedML, an open research library and benchmark that facilitates the development of new federated learning algorithms and fair performance comparisons. FedML supports three computing paradigms (distributed training, mobile on-device training, and standalone simulation) for users to conduct experiments in different system environments. FedML also promotes diverse algorithmic research with flexible and generic API design and reference baseline implementations. A curated and comprehensive benchmark dataset for the non-I.I.D setting aims at making a fair comparison. We believe FedML can provide an efficient and reproducible means of developing and evaluating algorithms for the federated learning research community. We maintain the source code, documents, and user community at this https URL.

Authors

Chaoyang He

4 papers

Songze Li

1 papers

Jinhyun So

1 papers

TL;DR

Abstract

Authors

References159 items

Mitigating Byzantine Attacks in Federated Learning

Secure Aggregation with Heterogeneous Quantization in Federated Learning

Group Knowledge Transfer: Collaborative Training of Large CNNs on the Edge

Group Knowledge Transfer: Federated Learning of Large CNNs at the Edge

Byzantine-Resilient Secure Federated Learning

Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimization

FetchSGD: Communication-Efficient Federated Learning with Sketching

Attack of the Tails: Yes, You Really Can Backdoor Federated Learning

Backdoor attacks and defenses in feature-partitioned collaborative learning

Coded Computing for Federated Learning at the Edge

Federated Learning with Compression: Unified Analysis and Sharp Guarantees

A Secure Federated Transfer Learning Framework

Artemis: tight convergence guarantees for bidirectional compression in Federated Learning

Federated Semi-Supervised Learning with Inter-Client Consistency

Federated Learning With Quantized Global Model Updates

Differentially-private Federated Neural Architecture Search

Robust Federated Recommendation System

Privacy-Preserving Technology to Help Millions of People: Federated Prediction Model for Stroke Prevention

Backdoor Attacks on Federated Meta-Learning

Federated Learning in Vehicular Networks

DarKnight: A Data Privacy Scheme for Training and Inference of Deep Neural Networks

Federated Recommendation System via Differential Privacy

Cloud-based Federated Boosting for Mobile Crowdsensing

DBA: Distributed Backdoor Attacks against Federated Learning

Federated Transfer Learning for EEG Signal Classification

Privacy in Deep Learning: A Survey

Federated learning with hierarchical clustering of local updates to improve training on non-IID data

A Framework for Evaluating Gradient Leakage Attacks in Federated Learning

Federated Learning with Only Positive Labels

FedNAS: Federated Deep Learning via Neural Architecture Search

Towards Non-I.I.D. and Invisible Data with FedNAS: Federated Deep Learning via Neural Architecture Search.

Asymmetrical Vertical Federated Learning

Towards Federated Learning in UAV-Enabled Internet of Vehicles: A Multi-Dimensional Contract-Matching Approach

Federated Multi-view Matrix Factorization for Personalized Recommendations

Enhancing Privacy via Hierarchical Federated Learning

Federated Learning Meets Contract Theory: Energy-Efficient Framework for Electric Vehicle Networks

From Local SGD to Local Fixed Point Methods for Federated Learning

An Overview of Federated Deep Learning Privacy Attacks and Defensive Strategies

MiLeNAS: Efficient Neural Architecture Search via Mixed-Level Reformulation

FedRec: Privacy-Preserving News Recommendation with Federated Learning

FedNER: Medical Named Entity Recognition with Federated Learning

FedNER: Privacy-preserving Medical Named Entity Recognition with Federated Learning

Privacy-Preserving Traffic Flow Prediction: A Federated Learning Approach

The future of digital health with federated learning

Federated Visual Classification with Real-World Data Distribution

FedLoc: Federated Learning Framework for Data-Driven Cooperative Localization and Location Data Processing

Practical Privacy Preserving POI Recommendation

Communication-Efficient Multimodal Split Learning for mmWave Received Power Prediction

Federating Recommendations Using Differentially Private Prototypes

Adaptive Federated Optimization

HFEL: Joint Edge Association and Resource Allocation for Cost-Efficient Hierarchical Federated Edge Learning

Acceleration for Compressed Gradient Descent in Distributed and Federated Optimization

FedCoin: A Peer-to-Peer Payment System for Federated Learning

Communication-Efficient Decentralized Learning with Sparsification and Adaptive Peer Selection

Federated pretraining and fine tuning of BERT using clinical notes from multiple silos

Personalized Federated Learning: A Meta-Learning Approach

Federated Learning with Matched Averaging

Neural Architecture Search over Decentralized Data

Federated Neural Architecture Search

Turbo-Aggregate: Breaking the Quadratic Aggregation Barrier in Secure Federated Learning

Multi-Participant Multi-Class Vertical Federated Learning

FedVision: An Online Visual Object Detection Platform Powered by Federated Learning

Exploiting Unlabeled Data in Smart Cities using Federated Learning

Robust Aggregation for Federated Learning

A Communication Efficient Collaborative Learning Framework for Distributed Features

Federated Learning

Advances and Open Problems in Federated Learning

PyTorch: An Imperative Style, High-Performance Deep Learning Library

A Quasi-Newton Method Based Vertical Federated Learning Framework for Logistic Regression

Federated Learning with Bayesian Differential Privacy

Parallel Distributed Logistic Regression for Vertical Federated Learning without Third-Party Coordinator

Can You Really Backdoor Federated Learning?

Generative Models for Effective ML on Private, Decentralized Datasets

HybridAlpha: An Efficient Approach for Privacy-Preserving Federated Learning

ADMSv2: A Modern Architecture for Transportation Data Management and Analysis

Secure and Efficient Federated Transfer Learning