AIMech AI

Relative-Error CUR Matrix Decomposition via Subspace Leverage Sampling

Algorithms AIMech:RelativeErrorCURMatrixDecompositionViaSubspaceLeverageSampling DRAFT
Aliases: Subspace-Sampling Relative-Error CX and CUR Matrix Decomposition, Drineas-Mahoney-Muthukrishnan Leverage-Score CUR Decomposition, Relative-Error Column-Row Skeleton Factorization
Relative-Error CUR Matrix Decomposition via Subspace Leverage Sampling is a randomized low-rank matrix factorization framework introduced by Drineas, Mahoney, and Muthukrishnan (2008) that approximates an arbitrary matrix A in R^{m x n} by actual columns C in R^{m x c} and actual rows R in R^{r x n} of A together with an explicit linking matrix U = W^+ in R^{c x r} so as to achieve a multiplicative (1 + epsilon) relative-error Frobenius norm guarantee ||A - C U R||_F <= (1 + epsilon)||A - A_k||_F. Rather than sampling columns proportionally to raw Euclidean column norms ||A^{(j)}||_2^2 (which permits only additive error bounds), Algorithm 1 samples c = O(k log k / epsilon^2) columns according to the normalized k-right-singular-subspace leverage scores p_j = (1/k)||(V_{A,k})_{(j)}||_2^2 (forming C = A S_C D_C and the optimal CX approximation P_C A = C (C^+ A)), and Algorithm 2 subsequently samples r = O(c log c / epsilon^2) rows of A and C concurrently according to the column-subspace leverage scores q_i = (1/c)||(U_C)_{(i)}||_2^2 of C, setting W = D_R S_R^T C and U = W^+. The analysis reduces column/row projection to generalized l_2 regression via Lemma 1 (Equations 26-27), proving that when sigma_k(S^T U_{A,k}) >= 1/sqrt(2), the rescaled sketch satisfies (S A_k)^+ = V_{A,k} Sigma_{A,k}^{-1} (S U_{A,k})^+ and rank(S A_k) = k.
Identity Notes & Concept Scope Distinct from Nyström Gram Matrix Low-Rank Approximation with Diagonal Sampling (`AIMech:NystromGramMatrixLowRankApproximationWithDiagonalSampling`), which applies only to symmetric positive semidefinite Gram matrices G and achieves additive error bounds proportional to sum_i G_{ii}^2, and from Principal Component Analysis (`AIO:PrincipalComponentAnalysis`), which represents A_k in dense orthogonal eigenbases that destroy sparsity and interpretability of original rows and columns. Specifically captures the Drineas-Mahoney-Muthukrishnan (2008) subspace leverage sampling probabilities p_j = (1/k)||(V_{A,k})_{(j)}||_2^2, the Lemma 1 pseudoinverse reduction to generalized l_2 regression, and the relative-error CX (Theorem 1) and CUR (Theorem 2) algorithms.

Claims & Grounded Evidence

3 Claims
Mechanism #claim-01
For any matrix A in R^{m x n} with rank-k SVD A_k = U_{A,k} Sigma_{A,k} V_{A,k}^T and row-sampling/rescaling matrix S = D S_0^T, Lemma 1 (Equations 26-27) proves that whenever sigma_k(S U_{A,k}) >= 1/sqrt(2), the sketched rank-k factor satisfies rank(S A_k) = k and the exact Moore-Penrose pseudoinverse factorization (S A_k)^+ = V_{A,k} Sigma_{A,k}^{-1} (S U_{A,k})^+, so the generalized regression solution Z_opt = (S B)^+ S A satisfies ||A - B Z_opt||_F <= (1 + epsilon)||A - A_k||_F.
Scope #claim-02
Theorem 1 and Theorem 2 prove that sampling c = O(k log k / epsilon^2) columns of A with probabilities p_j >= beta ||(V_{A,k})_{(j)}||_2^2 / k (where sum_{j=1}^n ||(V_{A,k})_{(j)}||_2^2 = k) yields ||A - C (C^+ A)||_F <= (1 + epsilon)||A - A_k||_F, and subsequently sampling r = O(c log c / epsilon^2) rows with probabilities q_i >= beta ||(U_C)_{(i)}||_2^2 / c and setting U = W^+ = (D_R S_R^T C)^+ yields ||A - C U R||_F <= (1 + epsilon)||A - A_k||_F with high probability, recovering A exactly (||A - C U R||_F = 0) whenever rank(A) <= k and the sampled subspace sketches have full rank k.
Limitation #claim-03
Computing the exact subspace leverage scores p_j = (1/k)||(V_{A,k})_{(j)}||_2^2 requires the top-k right singular subspace V_{A,k} of A (costing O(min(m,n) m n) via exact SVD), and replacing subspace leverage sampling by Euclidean column-norm sampling p_j = ||A^{(j)}||_2^2 / ||A||_F^2 fails to achieve relative error when a low-norm column carries an entire top-k singular direction while rank-1 high-norm columns dominate ||A||_F^2.

⚠️ Curated Limitations & Negative Results

Artificial Intelligence Ontology (AIO) Grounding

Mapped AIO Classes
AIO Target Class Mapping Relation Mapping Rationale
AIO:DimensionalityReduction
Dimensionality Reduction
narrow_match Constructs interpretable low-rank CX and CUR matrix factorizations from actual columns and rows of A with relative-error Frobenius guarantees.
AIO:PrincipalComponentAnalysis
Principal Component Analysis
related_match Uses the top-k singular subspace leverage scores of A_k to select actual columns and rows achieving (1+epsilon)||A - A_k||_F.

Evidence Sources & Primary Literature

3 Sources
Source ID Publication / Document Type / Access Reference & Checksum
r332-primary-pdf
Petros Drineas, Michael W. Mahoney, S. Muthukrishnan
primary paper
full_text
ID: https://doi.org/10.1137/07070471X
sha256:5fd13aef3a94…
r332-arxiv-abs
Petros Drineas, Michael W. Mahoney, S. Muthukrishnan
primary paper
abstract_only
ID: https://arxiv.org/abs/0708.3696
sha256:e33fe0139529…
r332-metadata-cr
Petros Drineas, Michael W. Mahoney, S. Muthukrishnan
primary paper
abstract_only
ID: https://doi.org/10.1137/07070471X
sha256:e4325ae94385…

Ontology & Grounding Topology

Open in interactive network graph →
CONCEPT KIND Algorithms AIMech:RelativeErrorCURMatrixDecompositionViaSubspaceLeverageSampling Relative-Error CUR... 3 claims · 3 sources AIO GROUNDING AIO:DimensionalityReduction (2)

Curation Provenance

Curator: Antigravity
Method: ai_assisted
Model: Gemini
Created: 2026-10-19T06:55:00Z
Updated: 2026-10-19T06:55:00Z
Source File: data/curated/RelativeErrorCURMatrixDecompositionViaSubspaceLeverageSampling.yaml · Schema: curated_concept.yaml

Explore across X-Mech

Related computational & biological Mechs: Embedding Map Network Graph ProteinTraitsMech (ESM-2 pLM) DUFMech (Domain pLM) TraitMech CultureMech All 14 X-Mech Repositories