FedDC (Federated Learning via Local Drift Decoupling and Correction)
Algorithms AIMech:FedDcLocalDriftDecouplingAndCorrectionForNonIidFederatedLearning DRAFT
Aliases: FedDC, Federated Learning via Local Drift Decoupling and Correction, Local Drift Decoupling and Correction
A primal-dual drift-decoupling and gradient-correction federated learning algorithm (Gao et al. 2022, Section 4, Equations 3-8, Appendix B Algorithm 1 and Theorem 1) that introduces an auxiliary local drift variable h_i ~ w - theta_i for each client i to bridge the parameter gap between the global model w and the local model theta_i, training each active client on the three-term objective F_i(theta_i) = L_i(theta_i) + (alpha/2)*||theta_i - (w - h_i)||^2 + (1/(eta*K))*<theta_i, g_i - g> (Equation 4) where g_i = theta_i^K - theta_i^0 tracks the local epoch update drift and g = sum_i (|D_i|/|D|) g_i, updating h_i^+ = h_i - g_i^+ without extra backpropagation (Equation 6), and aggregating drift-corrected client parameters on the server via w^{t+1} = sum_{i in C_t} (|D_i|/|D|) (theta_i^+ + h_i^+) (Equation 7).
Identity Notes & Concept Scope
Distinct from SCAFFOLD (AIMech:ScaffoldStochasticControlledAveragingForFederatedLearning, Karimireddy et al. 2020), which only applies a linear control-variate gradient correction without decoupling the parameter-level gap w - theta_i via a shifted quadratic penalty (alpha/2)*||theta_i - (w - h_i)||^2 or aggregating theta_i^+ + h_i^+; and distinct from FedDyn (AIMech:FedDynDynamicRegularizationForFederatedLearning, Acar et al. 2021), which combines a linear historic-gradient term and unshifted quadratic (alpha/2)*||theta_i - w||^2 with server dual state h^t without a separate (1/(eta*K))*<theta_i, g_i - g> SCAFFOLD-style gradient-drift inner product.
Claims & Grounded Evidence
4 Claims
Mechanism
#r456-three-term-decoupled-drift-objective-and-corrected-aggregation-mechanism
Combines (1) empirical loss L_i(theta_i), (2) a drift-decoupled quadratic penalty (alpha/2)*||theta_i - (w - h_i)||^2 that constrains local parameter updates relative to the drift-compensated target w - h_i, and (3) a linear gradient-drift correction (1/(eta*K))*<theta_i, g_i - g> (Equation 4), followed by backpropagation-free drift tracking h_i^+ = h_i - g_i^+ (Equation 6) and drift-corrected global aggregation w^{t+1} = sum_{i in C_t} (|D_i|/|D|)*(theta_i^+ + h_i^+) (Equation 7).
Scope
#r456-strongly-convex-linear-and-nonconvex-convergence-scope
Establishes in Theorem 1 (Appendix C) that FedDC achieves O(log(1/epsilon)) linear convergence for mu-strongly convex L-smooth objectives and O(1/epsilon) convergence for general L-smooth non-convex objectives under partial client participation.
Limitation
#r456-stateful-client-drift-variables-and-communication-limitation
Requires clients to maintain persistent parameter-sized state vectors (h_i and g_i) across communication rounds, and in the naive partial-participation implementation doubles per-round parameter transmission unless the server caches each client's previous state.
Application
#r456-non-iid-federated-classification-and-partial-participation-application
Applied to non-IID and unbalanced federated learning across MNIST, Fashion-MNIST, EMNIST-L, CIFAR-10, CIFAR-100, Tiny-ImageNet, and synthetic heterogeneous benchmarks under low client participation ratios.
⚠️ Curated Limitations & Negative Results
- Requires stateful clients to store auxiliary parameter-sized drift variables h_i and g_i across rounds.
- Under very low client participation ratios without server-side state caching, stale h_i and g_i on rarely sampled clients can slow initial drift alignment.
Artificial Intelligence Ontology (AIO) Grounding
Mapped AIO Classes
| AIO Target Class | Mapping Relation | Mapping Rationale |
|---|---|---|
AIO:FederatedLearning
Federated Learning
|
narrow_match | FedDC is a federated learning algorithm that corrects non-IID client drift by decoupling local parameter drift via auxiliary variables h_i and gradient tracking g_i. |
Evidence Sources & Primary Literature
3 Sources| Source ID | Publication / Document | Type / Access | Reference & Checksum |
|---|---|---|---|
r456-primary-pdf
|
Liang Gao, Huazhu Fu, Li Li, Yingwen Chen, Ming Xu, Cheng-Zhong Xu
|
primary paper
full_text
|
ID: https://doi.org/10.1109/CVPR52688.2022.00987
sha256:8d463d0d4d5b…
|
r456-arxiv-abs
|
Liang Gao, Huazhu Fu, Li Li, Yingwen Chen, Ming Xu, Cheng-Zhong Xu
|
primary paper
abstract_only
|
ID: https://arxiv.org/abs/2203.11751
sha256:cdc3282809a3…
|
r456-metadata-cr
|
Liang Gao, Huazhu Fu, Li Li, Yingwen Chen, Ming Xu, Cheng-Zhong Xu
|
primary paper
abstract_only
|
ID: https://doi.org/10.1109/CVPR52688.2022.00987
sha256:3a0568e0f961…
|
Ontology & Grounding Topology
Open in interactive network graph →Curation Provenance
Curator: Antigravity
Method: ai_assisted
Model: Gemini
Created: 2026-10-19T08:59:00Z
Updated: 2026-10-19T08:59:00Z
Explore across X-Mech
Related computational & biological Mechs:
Embedding Map
Network Graph
ProteinTraitsMech (ESM-2 pLM)
DUFMech (Domain pLM)
TraitMech
CultureMech
All 14 X-Mech Repositories