Separable Nonnegative Matrix Factorization and Robust-Loner Recovery
Algorithms AIMech:SeparableNonnegativeMatrixFactorizationAndRobustLonerRecovery DRAFT
Aliases: Separable NMF, Arora-Ge-Kannan-Moitra Separable NMF and Robust-Loner Algorithm, Anchor-Row Simplicial Nonnegative Matrix Factorization
Separable Nonnegative Matrix Factorization and Robust-Loner Recovery is a polynomial-time provable factorization framework introduced by Arora, Ge, Kannan, and Moitra (2012/2016) that circumvents the general NP-hardness of exact Nonnegative Matrix Factorization (NMF) M = A W (Theorem 3.1) by imposing the separability condition (Definition 5.1) on the first factor A in R_+^{n x r}. After normalizing the rows of M, A, and W to have unit l_1 norm, separability requires that for each latent basis index i in {1,...,r} there exists at least one canonical ('anchor') row j_i of A equal to the standard basis vector e_i^T, so that the r rows of W appear directly among the rows of M and every other row M^j = sum_{i=1}^r A_{j,i} W^i lies in the convex hull conv(W^1,...,W^r). When W is alpha-robust simplicial (each row W^i has l_1 distance at least alpha from conv({W^{i'} : i' != i}), Definition 5.6) and the observed matrix M' satisfies ||M'^j - M^j||_1 <= epsilon with 20 epsilon/alpha + 13 epsilon < alpha, the Robust-Loners algorithm identifies all r canonical rows via linear programming convex-hull tests at distance threshold d = 5 epsilon/alpha + 2 epsilon and clusters them to reconstruct A' W' within row-wise l_1 error 10 epsilon/alpha + 7 epsilon (Theorem 5.7).
Identity Notes & Concept Scope
Distinct from heuristic multiplicative update rules for NMF (`AIO:NonnegativeMatrixFactorization`) and FastAnchorWords / RecoverL2 word-co-occurrence topic modeling (AIMech:AnchorWordsAndRecoverL2TopicWordMatrixFactorization). Specifically captures the Arora-Ge-Kannan-Moitra (2012/2016) formalization of Separable NMF (Definition 5.1), the exact simplicial 'Loner' LP algorithm (Theorem 5.4 and Claim 5.5), the alpha-robust simplicial condition (Definition 5.6), the noisy Robust-Loners algorithm and error bound 10 epsilon/alpha + 7 epsilon (Theorem 5.7 and Claims 5.8-5.10), and the fixed-inner-dimension exact NMF algebraic decidability algorithm in time (nm)^{O(r^2 2^r)} (Theorem 4.1).
Claims & Grounded Evidence
3 Claims
Mechanism
#claim-01
Under row l_1-normalization where A is separable and W is simplicial (no row W^i lies in conv({W^{i'} : i' != i})), Claim 5.5 and Theorem 5.4 prove that a row M^j is an extreme vertex ('loner') outside the convex hull of all distinct rows {M^{i'} : M^{i'} != M^j} if and only if M^j equals one of the r basis rows W^i, reducing exact nonnegative matrix factorization to n linear programs.
Scope
#claim-02
When W is alpha-robust simplicial (Definition 5.6) and the perturbed rows M'^j satisfy ||M'^j - M^j||_1 <= epsilon with 20 epsilon/alpha + 13 epsilon < alpha, Claims 5.8-5.10 and Theorem 5.7 prove that defining a robust-loner as any row M'^j whose l_1 distance to conv({M'^i : ||M'^i - M'^j||_1 >= 5 epsilon/alpha + 2 epsilon}) exceeds 2 epsilon selects points exclusively within l_1 distance 5 epsilon/alpha + 2 epsilon of the true basis rows W^i and yields a polynomial-time factorization A' W' satisfying ||M'^j - (A' W')^j||_1 <= 10 epsilon/alpha + 7 epsilon for every row j.
Limitation
#claim-03
Without separability, general exact NMF is NP-hard when the inner dimension r scales with the matrix dimensions (Theorem 3.1, via reduction from 3SAT and Vavasis's Intermediate Simplex problem), and if all rows of A are strictly interior mixtures lacking canonical anchor rows, convex-hull extreme-point selection fails to recover the true basis vertices W^i.
⚠️ Curated Limitations & Negative Results
- Requires the separability assumption that each latent factor has at least one pure anchor row in A and that W is alpha-robust simplicial; solving O(n) linear programs over n variables can be computationally expensive on large vocabularies without greedy random-projection accelerations.
Artificial Intelligence Ontology (AIO) Grounding
Mapped AIO Classes
| AIO Target Class | Mapping Relation | Mapping Rationale |
|---|---|---|
AIO:DimensionalityReduction
Dimensionality Reduction
|
broad_match | Separable NMF is a structural sub-regime and provable polynomial-time algorithm for nonnegative low-rank matrix factorization and dimensionality reduction. |
AIO:UnsupervisedClustering
Unsupervised Clustering
|
related_match | Identifies canonical anchor rows and convex-hull extreme vertices for unsupervised topic and feature clustering. |
Evidence Sources & Primary Literature
3 Sources| Source ID | Publication / Document | Type / Access | Reference & Checksum |
|---|---|---|---|
r321-primary-pdf
|
Sanjeev Arora, Rong Ge, Ravindran Kannan, Ankur Moitra
|
primary paper
full_text
|
ID: https://doi.org/10.1137/130913869
sha256:1e7b97256746…
|
r321-arxiv-abs
|
Sanjeev Arora, Rong Ge, Ravindran Kannan, Ankur Moitra
|
primary paper
abstract_only
|
ID: https://arxiv.org/abs/1111.0952v1
sha256:dba2f527466f…
|
r321-metadata-cr
|
Sanjeev Arora, Rong Ge, Ravindran Kannan, Ankur Moitra
|
primary paper
abstract_only
|
ID: https://doi.org/10.1137/130913869
sha256:6162b0a7e145…
|
Ontology & Grounding Topology
Open in interactive network graph →Curation Provenance
Curator: Antigravity
Method: ai_assisted
Model: Gemini
Created: 2026-10-19T06:34:00Z
Updated: 2026-10-19T06:34:00Z
Explore across X-Mech
Related computational & biological Mechs:
Embedding Map
Network Graph
ProteinTraitsMech (ESM-2 pLM)
DUFMech (Domain pLM)
TraitMech
CultureMech
All 14 X-Mech Repositories