AIMech AI

Nonnegative Matrix Factorization

Mathematical Methods AIMech:NonnegativeMatrixFactorization DRAFT
Aliases: NMF
A matrix-decomposition method that represents or approximates a nonnegative data matrix as the product of two entrywise nonnegative factor matrices, so each data column is expressed by additive nonnegative combinations of basis columns.
Identity Notes & Concept Scope The mathematical factorization is distinct from a particular fitting algorithm, trained dictionary or application. The separately represented Lee-Seung multiplicative updates optimize two specified objectives. Nonnegative factors need not be sparse, orthogonal or uniquely determined; this is not the exact sparse-coding identity in AIO or ordinary PCA. Non-negative and British factorisation spellings name the same method. Four candidate identities were compared against all 442 pinned AIO IDs, labels and scoped synonyms and 450 preceding native IDs, names and aliases, with no normalized match. Ignored/hidden full-checkout searches returned the same 106 matched-line set in each checkout after the prior merge. All matched excerpts from 76 files were read; they are discovery context, not existing concept records. The semantic search covered all pinned labels and scoped synonyms and returned 212 rows: 205 byte-equivalent prior readings and seven additional rows, all inspected. Twenty-three annotated AIO nodes with outgoing edges comprise 21 unchanged prior readings and two new inspections. Thirty contextual YAMLs, including seven native neighbors, comprise 25 unchanged prior readings and five complete new readings. This absence assessment is bounded to the pinned snapshot and inspected maintained corpus.

Claims & Grounded Evidence

3 Claims
Mechanism #factorization-scope
For V in the nonnegative n-by-m matrices, seek W of size n-by-r and H of size r-by-m with nonnegative entries and V approximately W H. Columns of W supply basis elements and columns of H their nonnegative coefficients. Choosing r below the data dimensions yields a compressed representation with product rank at most r, but small r is a modeling choice rather than a consequence of nonnegativity. Factors can be dense.
Scope #objectives-and-zeros
The inspected source fits either squared Frobenius error ||V-WH||_F^2 or generalized KL divergence sum_ij[V_ij log(V_ij/(WH)_ij)-V_ij+(WH)_ij]. The latter is a divergence between nonnegative arrays, not necessarily normalized probability distributions and not a symmetric distance. By continuity a zero V entry contributes the corresponding reconstruction, while a positive V entry with zero reconstruction gives infinite divergence. An observed zero contributes to these objectives; it is not automatically a missing value.
Limitation #identifiability
Nonnegativity supports additive representations but does not guarantee recovery of unique physical parts or causes. For any positive diagonal D, W D and D^(-1) H give the same reconstruction, and a common factor permutation also preserves it. The nonconvex joint fitting problem and chosen objective further affect the result. These algebraic ambiguities remain even when a factorization has small reconstruction error.

⚠️ Curated Limitations & Negative Results

Artificial Intelligence Ontology (AIO) Grounding

Mapped AIO Classes
AIO Target Class Mapping Relation Mapping Rationale
AIO:DimensionalityReduction
Dimensionality Reduction
related_match A low-rank NMF representation performs dimensionality reduction, a task-scoped AIO concept. The related mapping preserves the mathematical-method/task distinction and does not require every permitted factor size to reduce dimension.

Evidence Sources & Primary Literature

1 Source
Source ID Publication / Document Type / Access Reference & Checksum
method-source
Daniel D. Lee, H. Sebastian Seung
primary paper
full_text
ID: https://papers.nips.cc/paper_files/paper/2000/hash/f9d1152547c0bde01830b7e8bd60024c-Abstract.html
sha256:d943865213cb…

Curation Provenance

Curator: Codex
Method: ai_assisted
Model: GPT-6
Created: 2026-10-12T01:49:01Z
Updated: 2026-10-12T01:49:01Z
Source File: data/curated/NonnegativeMatrixFactorization.yaml