FS-TFP/materials/paper_list/FL-NLP/README.md

Federated Learning for NLP

This list is constantly being updated. Feel free to contribute!

2023

Title	Venue	Link
Federated Nearest Neighbor Machine Translation	ICLR	pdf, code

2022

Title	Venue	Link
When Federated Learning Meets Pre-trained Language Models' Parameter-Efficient Tuning Methods	arXiv	pdf, code
FewFedWeight: Few-shot Federated Learning Framework across Multiple NLP Tasks	arXiv	pdf
Federated NLP in Few-shot Scenarios	arXiv	pdf
Collaborating Heterogeneous Natural Language Processing Tasks via Federated Learning	arXiv	pdf, code
Federated Neural Topic Models	arXiv	pdf, code
AUG-FedPrompt: Practical Few-shot Federated NLP with Data-augmented Prompts	arXiv	pdf
Federated Multilingual Models for Medical Transcript Analysis	arXiv	pdf
FedPC: Federated Learning for Language Generation with Personal and Context Preference Embeddings	arXiv	pdf
FedPrompt: Communication-Efficient and Privacy Preserving Prompt Tuning in Federated Learning	arXiv	pdf
Training Large-Vocabulary Neural Language Models by Private Federated Learning for Resource-Constrained Devices	arXiv	pdf
Fair NLP Models with Differentially Private Text Encoders	arXiv	pdf, code
FedQAS: Privacy-aware Machine Reading Comprehension with Federated Learning	arXiv	pdf, code
A Federated Approach to Predicting Emojis in Hindi Tweets	EMNLP	pdf, code
Backdoor Attacks in Federated Learning by Rare Embeddings and Gradient Ensembling	EMNLP	pdf
Dim-Krum: Backdoor-Resistant Federated Learning for NLP with Dimension-wise Krum-Based Aggregation	EMNLP Findings	pdf
Federated Continual Learning for Text Classification via Selective Inter-client Transfer	EMNLP Findings	pdf, code
Recovering Private Text in Federated Learning of Language Models	NeurIPS	pdf, code
Federated Learning with Noisy User Feedback	NAACL	pdf
Training Mixed-Domain Translation Models via Federated Learning	NAACL	pdf
Pretrained Models for Multilingual Federated Learning	NAACL	pdf, code
FedNLP: Benchmarking Federated Learning Methods for Natural Language Processing Tasks	NAACL Findings	pdf, code
Intrinsic Gradient Compression for Scalable and Efficient Federated Learning	ACL Workshop	pdf
Adaptive Differential Privacy for Language Model Training	ACL Workshop	pdf, code
Scaling Language Model Size in Cross-Device Federated Learning	ACL Workshop	pdf
ActPerFL: Active Personalized Federated Learning	ACL Workshop	pdf
Federated Non-negative Matrix Factorization for Short Texts Topic Modeling with Mutual Information	IJCNN	pdf
Federated Split BERT for Heterogeneous Text Classification	IJCNN	pdf
Federated Learning for Violence Incident Prediction in a Simulated Cross-institutional Psychiatric Setting	Expert Systems with Applications	pdf
FedBERT: When Federated Learning Meets Pre-Training	TIST	pdf
FedKC: Federated Knowledge Composition for Multilingual Natural Language Understanding	WWW	pdf

2021

Title	Venue	Link
FedMatch: Federated Learning Over Heterogeneous Question Answering Data	CIKM	pdf, code
Federated Chinese Word Segmentation with Global Character Associations	ACL Findings	pdf, code
Improving Federated Learning for Aspect-based Sentiment Analysis via Topic Memories	EMNLP	pdf, code
A Secure and Efficient Federated Learning Framework for NLP	EMNLP	pdf
Distantly Supervised Relation Extraction in Federated Settings	EMNLP Findings	pdf, code
Scaling Federated Learning for Fine-tuning of Large Language Models	arXiv	pdf

2020

Title	Venue	Link
FedED: Federated Learning via Ensemble Distillation for Medical Relation Extraction	EMNLP	pdf
Empirical Studies of Institutional Federated Learning For Natural Language Processing	EMNLP Findings	pdf
Federated Learning for Spoken Language Understanding	COLING	pdf
FedNER: Privacy-preserving Medical Named Entity Recognition with Federated Learning	arXiv	pdf
Federated Pretraining and Fine Tuning of BERT Using Clinical Notes from Multiple Silos	arXiv	pdf
Pretraining Federated Text Models for Next Word Prediction	arXiv	pdf, code

2019

Title	Venue	Link
Federated Learning of N-gram Language Models	CoNLL	pdf
Learning Private Neural Language Modeling with Attentive Aggregation	IJCNN	pdf
Federated Learning Of Out-Of-Vocabulary Words	arXiv	pdf
Federated Learning for Emoji Prediction in a Mobile Keyboard	arXiv	pdf

2018

Title	Venue	Link
Federated Learning for Mobile Keyboard Prediction	arXiv	pdf
Applied Federated Learning: Improving Google Keyboard Query Suggestions	arXiv	pdf