AIMech AI

FedDC (Federated Learning via Local Drift Decoupling and Correction)

Algorithms AIMech:FedDcLocalDriftDecouplingAndCorrectionForNonIidFederatedLearning DRAFT
Aliases: FedDC, Federated Learning via Local Drift Decoupling and Correction, Local Drift Decoupling and Correction
A primal-dual drift-decoupling and gradient-correction federated learning algorithm (Gao et al. 2022, Section 4, Equations 3-8, Appendix B Algorithm 1 and Theorem 1) that introduces an auxiliary local drift variable h_i ~ w - theta_i for each client i to bridge the parameter gap between the global model w and the local model theta_i, training each active client on the three-term objective F_i(theta_i) = L_i(theta_i) + (alpha/2)*||theta_i - (w - h_i)||^2 + (1/(eta*K))*<theta_i, g_i - g> (Equation 4) where g_i = theta_i^K - theta_i^0 tracks the local epoch update drift and g = sum_i (|D_i|/|D|) g_i, updating h_i^+ = h_i - g_i^+ without extra backpropagation (Equation 6), and aggregating drift-corrected client parameters on the server via w^{t+1} = sum_{i in C_t} (|D_i|/|D|) (theta_i^+ + h_i^+) (Equation 7).
Identity Notes & Concept Scope Distinct from SCAFFOLD (AIMech:ScaffoldStochasticControlledAveragingForFederatedLearning, Karimireddy et al. 2020), which only applies a linear control-variate gradient correction without decoupling the parameter-level gap w - theta_i via a shifted quadratic penalty (alpha/2)*||theta_i - (w - h_i)||^2 or aggregating theta_i^+ + h_i^+; and distinct from FedDyn (AIMech:FedDynDynamicRegularizationForFederatedLearning, Acar et al. 2021), which combines a linear historic-gradient term and unshifted quadratic (alpha/2)*||theta_i - w||^2 with server dual state h^t without a separate (1/(eta*K))*<theta_i, g_i - g> SCAFFOLD-style gradient-drift inner product.

Claims & Grounded Evidence

4 Claims
Mechanism #r456-three-term-decoupled-drift-objective-and-corrected-aggregation-mechanism
Combines (1) empirical loss L_i(theta_i), (2) a drift-decoupled quadratic penalty (alpha/2)*||theta_i - (w - h_i)||^2 that constrains local parameter updates relative to the drift-compensated target w - h_i, and (3) a linear gradient-drift correction (1/(eta*K))*<theta_i, g_i - g> (Equation 4), followed by backpropagation-free drift tracking h_i^+ = h_i - g_i^+ (Equation 6) and drift-corrected global aggregation w^{t+1} = sum_{i in C_t} (|D_i|/|D|)*(theta_i^+ + h_i^+) (Equation 7).
Scope #r456-strongly-convex-linear-and-nonconvex-convergence-scope
Establishes in Theorem 1 (Appendix C) that FedDC achieves O(log(1/epsilon)) linear convergence for mu-strongly convex L-smooth objectives and O(1/epsilon) convergence for general L-smooth non-convex objectives under partial client participation.
Limitation #r456-stateful-client-drift-variables-and-communication-limitation
Requires clients to maintain persistent parameter-sized state vectors (h_i and g_i) across communication rounds, and in the naive partial-participation implementation doubles per-round parameter transmission unless the server caches each client's previous state.
Application #r456-non-iid-federated-classification-and-partial-participation-application
Applied to non-IID and unbalanced federated learning across MNIST, Fashion-MNIST, EMNIST-L, CIFAR-10, CIFAR-100, Tiny-ImageNet, and synthetic heterogeneous benchmarks under low client participation ratios.

⚠️ Curated Limitations & Negative Results

Artificial Intelligence Ontology (AIO) Grounding

Mapped AIO Classes
AIO Target Class Mapping Relation Mapping Rationale
AIO:FederatedLearning
Federated Learning
narrow_match FedDC is a federated learning algorithm that corrects non-IID client drift by decoupling local parameter drift via auxiliary variables h_i and gradient tracking g_i.

Evidence Sources & Primary Literature

3 Sources
Source ID Publication / Document Type / Access Reference & Checksum
r456-primary-pdf
Liang Gao, Huazhu Fu, Li Li, Yingwen Chen, Ming Xu, Cheng-Zhong Xu
primary paper
full_text
ID: https://doi.org/10.1109/CVPR52688.2022.00987
sha256:8d463d0d4d5b…
r456-arxiv-abs
Liang Gao, Huazhu Fu, Li Li, Yingwen Chen, Ming Xu, Cheng-Zhong Xu
primary paper
abstract_only
ID: https://arxiv.org/abs/2203.11751
sha256:cdc3282809a3…
r456-metadata-cr
Liang Gao, Huazhu Fu, Li Li, Yingwen Chen, Ming Xu, Cheng-Zhong Xu
primary paper
abstract_only
ID: https://doi.org/10.1109/CVPR52688.2022.00987
sha256:3a0568e0f961…

Ontology & Grounding Topology

Open in interactive network graph →
CONCEPT KIND Algorithms AIMech:FedDcLocalDriftDecouplingAndCorrectionForNonIidFederatedLearning FedDC (Federated... 4 claims · 3 sources AIO GROUNDING AIO:FederatedLearning (1)

Curation Provenance

Curator: Antigravity
Method: ai_assisted
Model: Gemini
Created: 2026-10-19T08:59:00Z
Updated: 2026-10-19T08:59:00Z
Source File: data/curated/FedDcLocalDriftDecouplingAndCorrectionForNonIidFederatedLearning.yaml · Schema: curated_concept.yaml

Explore across X-Mech

Related computational & biological Mechs: Embedding Map Network Graph ProteinTraitsMech (ESM-2 pLM) DUFMech (Domain pLM) TraitMech CultureMech All 14 X-Mech Repositories