AIMech AI

Separable Nonnegative Matrix Factorization and Robust-Loner Recovery

Algorithms AIMech:SeparableNonnegativeMatrixFactorizationAndRobustLonerRecovery DRAFT
Aliases: Separable NMF, Arora-Ge-Kannan-Moitra Separable NMF and Robust-Loner Algorithm, Anchor-Row Simplicial Nonnegative Matrix Factorization
Separable Nonnegative Matrix Factorization and Robust-Loner Recovery is a polynomial-time provable factorization framework introduced by Arora, Ge, Kannan, and Moitra (2012/2016) that circumvents the general NP-hardness of exact Nonnegative Matrix Factorization (NMF) M = A W (Theorem 3.1) by imposing the separability condition (Definition 5.1) on the first factor A in R_+^{n x r}. After normalizing the rows of M, A, and W to have unit l_1 norm, separability requires that for each latent basis index i in {1,...,r} there exists at least one canonical ('anchor') row j_i of A equal to the standard basis vector e_i^T, so that the r rows of W appear directly among the rows of M and every other row M^j = sum_{i=1}^r A_{j,i} W^i lies in the convex hull conv(W^1,...,W^r). When W is alpha-robust simplicial (each row W^i has l_1 distance at least alpha from conv({W^{i'} : i' != i}), Definition 5.6) and the observed matrix M' satisfies ||M'^j - M^j||_1 <= epsilon with 20 epsilon/alpha + 13 epsilon < alpha, the Robust-Loners algorithm identifies all r canonical rows via linear programming convex-hull tests at distance threshold d = 5 epsilon/alpha + 2 epsilon and clusters them to reconstruct A' W' within row-wise l_1 error 10 epsilon/alpha + 7 epsilon (Theorem 5.7).
Identity Notes & Concept Scope Distinct from heuristic multiplicative update rules for NMF (`AIO:NonnegativeMatrixFactorization`) and FastAnchorWords / RecoverL2 word-co-occurrence topic modeling (AIMech:AnchorWordsAndRecoverL2TopicWordMatrixFactorization). Specifically captures the Arora-Ge-Kannan-Moitra (2012/2016) formalization of Separable NMF (Definition 5.1), the exact simplicial 'Loner' LP algorithm (Theorem 5.4 and Claim 5.5), the alpha-robust simplicial condition (Definition 5.6), the noisy Robust-Loners algorithm and error bound 10 epsilon/alpha + 7 epsilon (Theorem 5.7 and Claims 5.8-5.10), and the fixed-inner-dimension exact NMF algebraic decidability algorithm in time (nm)^{O(r^2 2^r)} (Theorem 4.1).

Claims & Grounded Evidence

3 Claims
Mechanism #claim-01
Under row l_1-normalization where A is separable and W is simplicial (no row W^i lies in conv({W^{i'} : i' != i})), Claim 5.5 and Theorem 5.4 prove that a row M^j is an extreme vertex ('loner') outside the convex hull of all distinct rows {M^{i'} : M^{i'} != M^j} if and only if M^j equals one of the r basis rows W^i, reducing exact nonnegative matrix factorization to n linear programs.
Scope #claim-02
When W is alpha-robust simplicial (Definition 5.6) and the perturbed rows M'^j satisfy ||M'^j - M^j||_1 <= epsilon with 20 epsilon/alpha + 13 epsilon < alpha, Claims 5.8-5.10 and Theorem 5.7 prove that defining a robust-loner as any row M'^j whose l_1 distance to conv({M'^i : ||M'^i - M'^j||_1 >= 5 epsilon/alpha + 2 epsilon}) exceeds 2 epsilon selects points exclusively within l_1 distance 5 epsilon/alpha + 2 epsilon of the true basis rows W^i and yields a polynomial-time factorization A' W' satisfying ||M'^j - (A' W')^j||_1 <= 10 epsilon/alpha + 7 epsilon for every row j.
Limitation #claim-03
Without separability, general exact NMF is NP-hard when the inner dimension r scales with the matrix dimensions (Theorem 3.1, via reduction from 3SAT and Vavasis's Intermediate Simplex problem), and if all rows of A are strictly interior mixtures lacking canonical anchor rows, convex-hull extreme-point selection fails to recover the true basis vertices W^i.

⚠️ Curated Limitations & Negative Results

Artificial Intelligence Ontology (AIO) Grounding

Mapped AIO Classes
AIO Target Class Mapping Relation Mapping Rationale
AIO:DimensionalityReduction
Dimensionality Reduction
broad_match Separable NMF is a structural sub-regime and provable polynomial-time algorithm for nonnegative low-rank matrix factorization and dimensionality reduction.
AIO:UnsupervisedClustering
Unsupervised Clustering
related_match Identifies canonical anchor rows and convex-hull extreme vertices for unsupervised topic and feature clustering.

Evidence Sources & Primary Literature

3 Sources
Source ID Publication / Document Type / Access Reference & Checksum
r321-primary-pdf
Sanjeev Arora, Rong Ge, Ravindran Kannan, Ankur Moitra
primary paper
full_text
ID: https://doi.org/10.1137/130913869
sha256:1e7b97256746…
r321-arxiv-abs
Sanjeev Arora, Rong Ge, Ravindran Kannan, Ankur Moitra
primary paper
abstract_only
ID: https://arxiv.org/abs/1111.0952v1
sha256:dba2f527466f…
r321-metadata-cr
Sanjeev Arora, Rong Ge, Ravindran Kannan, Ankur Moitra
primary paper
abstract_only
ID: https://doi.org/10.1137/130913869
sha256:6162b0a7e145…

Ontology & Grounding Topology

Open in interactive network graph →
CONCEPT KIND Algorithms AIMech:SeparableNonnegativeMatrixFactorizationAndRobustLonerRecovery Separable Nonnegative... 3 claims · 3 sources AIO GROUNDING AIO:DimensionalityReduction (2)

Curation Provenance

Curator: Antigravity
Method: ai_assisted
Model: Gemini
Created: 2026-10-19T06:34:00Z
Updated: 2026-10-19T06:34:00Z
Source File: data/curated/SeparableNonnegativeMatrixFactorizationAndRobustLonerRecovery.yaml · Schema: curated_concept.yaml

Explore across X-Mech

Related computational & biological Mechs: Embedding Map Network Graph ProteinTraitsMech (ESM-2 pLM) DUFMech (Domain pLM) TraitMech CultureMech All 14 X-Mech Repositories