Lagrange Coded Computing for Straggler-Resilient, Byzantine-Secure, and T-Private Distributed Polynomial Evaluation
Algorithms AIMech:LagrangeCodedComputingForResilientSecureAndPrivateDistributedLearning DRAFT
Aliases: Lagrange Coded Computing, LCC, Lagrange Polynomial Coded Distributed Computing
A universal algebraic coded distributed computing framework proposed by Yu, Li, Raviv, Mousavi Kalan, Soltanolkotabi, and Avestimehr (AISTATS 2019) that evaluates an arbitrary multivariate polynomial f of degree deg(f) across K dataset batches (X_1, ..., X_K) with T-collusion information-theoretic data privacy, S-straggler resiliency, and A-Byzantine adversary security by encoding the K data batches and T uniform random noise masks (Z_{K+1}, ..., Z_{K+T}) via a degree-(K+T-1) Lagrange interpolation polynomial u(z), evaluating f(u(alpha_i)) on N workers, and decoding f(X_1), ..., f(X_K) via Reed-Solomon polynomial interpolation whenever (K + T - 1) deg(f) + S + 2A + 1 <= N.
Identity Notes & Concept Scope
Distinct from Gradient Coding for Straggler-Resilient Distributed Optimization (AIMech:GradientCodingForStragglerResilientDistributedOptimization, which linearly encodes partial gradients computed on uncoded replicated data blocks without data privacy or general polynomial universality) and from DRACO (AIMech:DracoByzantineResilientDistributedTrainingViaRedundantGradients, which treats gradient evaluation as a black-box function requiring a 2A + 1 multiplicative redundancy factor rather than a 2A additive worker overhead). Lagrange Coded Computing / LCC (Yu et al., AISTATS 2019, PMLR 89:1215-1225 / arXiv:1806.00939, Section III-IV, Theorems 1-2, Equation 2, pp. 4-6) fixes K + T distinct interpolation nodes beta_1, ..., beta_{K+T} in F_q and constructs the degree-(K+T-1) Lagrange polynomial u(z) = sum_{j=1}^K X_j prod_{k != j} (z - beta_k)/(beta_j - beta_k) + sum_{j=K+1}^{K+T} Z_j prod_{k != j} (z - beta_k)/(beta_j - beta_k), assigning worker i the single coded share tilde{X}_i = u(alpha_i). Each worker computes tilde{Y}_i = f(tilde{X}_i) = f(u(alpha_i)), an evaluation of a composed polynomial of degree at most (K + T - 1) deg(f), enabling the master to recover {f(X_j) = f(u(beta_j))}_{j=1}^K from any N - S responding workers with up to A Byzantine errors whenever N >= (K + T - 1) deg(f) + S + 2A + 1.
Claims & Grounded Evidence
4 Claims
Mechanism
#lcc-lagrange-polynomial-data-encoding-and-reed-solomon-composition-decoding
LCC selects distinct field elements beta_1, ..., beta_{K+T} and alpha_1, ..., alpha_N (with {alpha_i} cap {beta_j}_{j=1}^K = empty when T > 0), encodes K dataset blocks and T uniform random masks via u(z) so worker i stores tilde{X}_i = u(alpha_i) (Equation 2), evaluates tilde{Y}_i = f(tilde{X}_i) locally, and decodes the degree-((K+T-1) deg(f)) composed polynomial f(u(z)) from N - S responses with up to A errors via Reed-Solomon syndrome decoding (Equation 4) to evaluate f(X_j) = f(u(beta_j)).
Scope
#lcc-optimal-resiliency-security-privacy-tradeoff-theorems
Theorem 1 and Lemma 2 prove that LCC is S-resilient, A-secure, and information-theoretically T-private (I(X; tilde{X}_T) = 0 for any |T| <= T via the MDS property of U^{bottom}) whenever (K + T - 1) deg(f) + S + 2A + 1 <= N, and Theorem 2 and Lemma 1 prove that LCC achieves the information-theoretically optimal recovery threshold R_{LCC}(N, K, f) + T deg(f) among all linear encoding schemes.
Limitation
#lcc-polynomial-degree-scaling-and-vandermonde-conditioning-limitation
LCC applies directly only to computations expressible or approximated as multivariate polynomials of moderate degree deg(f) because the required recovery threshold scales linearly with (K + T - 1) deg(f), and real-valued Lagrange interpolation can suffer numerical conditioning errors unless embedded into a finite field F_q.
Application
#lcc-distributed-least-squares-linear-regression-gradient-application
Applied to straggler-resilient distributed gradient descent for least-squares linear regression (evaluating the degree-2 polynomial f(bar{X}_k) = bar{X}_k bar{X}_k^T w with recovery threshold R_{LCC} = 2 ceil(n/r) - 1) on Amazon EC2 clusters, achieving 6.79x-13.43x speedup over uncoded execution and 2.36x-4.29x over Gradient Coding.
⚠️ Curated Limitations & Negative Results
- Requires the target computation f(X_i) to be a multivariate polynomial of bounded degree deg(f), as the recovery threshold (K + T - 1) deg(f) + S + 2A + 1 grows linearly with deg(f).
- Guaranteeing information-theoretic T-privacy requires embedding real-valued datasets into a finite field F_q and pre-distributing coded dataset shares across workers.
Artificial Intelligence Ontology (AIO) Grounding
Mapped AIO Classes
| AIO Target Class | Mapping Relation | Mapping Rationale |
|---|---|---|
AIO:LinearRegression
Linear Regression
|
related_match | AIO:LinearRegression is a primary distributed learning task accelerated by Lagrange Coded Computing via degree-2 polynomial gradient encoding. |
Evidence Sources & Primary Literature
3 Sources| Source ID | Publication / Document | Type / Access | Reference & Checksum |
|---|---|---|---|
r537-primary-pdf
|
Qian Yu, Songze Li, Netanel Raviv, Seyed Mohammadreza Mousavi Kalan, Mahdi Soltanolkotabi, A. Salman Avestimehr
|
primary paper
full_text
|
ID: https://dblp.org/rec/conf/aistats/YuLRKSA19.xml
sha256:23c525bbab09…
|
r537-arxiv-abs
|
Qian Yu, Songze Li, Netanel Raviv, Seyed Mohammadreza Mousavi Kalan, Mahdi Soltanolkotabi, A. Salman Avestimehr
|
primary paper
abstract_only
|
ID: https://arxiv.org/abs/1806.00939
sha256:98fbfcad5ed5…
|
r537-metadata-cr
|
Qian Yu, Songze Li, Netanel Raviv, Seyed Mohammadreza Mousavi Kalan, Mahdi Soltanolkotabi, A. Salman Avestimehr
|
primary paper
abstract_only
|
ID: https://dblp.org/rec/conf/aistats/YuLRKSA19.xml
sha256:df0fe629b7c2…
|
Ontology & Grounding Topology
Open in interactive network graph →Curation Provenance
Curator: Antigravity
Method: ai_assisted
Model: Gemini
Created: 2026-10-19T10:20:00Z
Updated: 2026-10-19T10:20:00Z
Explore across X-Mech
Related computational & biological Mechs:
Embedding Map
Network Graph
ProteinTraitsMech (ESM-2 pLM)
DUFMech (Domain pLM)
TraitMech
CultureMech
All 14 X-Mech Repositories