Multi-class N-pair loss
Mathematical Methods AIMech:MultiClassNPairLoss DRAFT
Aliases: N-pair-mc loss
A supervised metric-learning objective that averages a joint positive-versus-multiple-negative log-softmax loss across a batch of positive pairs drawn from distinct classes.
Identity Notes & Concept Scope
This is Sohn’s N-pair-mc objective, Equation (7), together with its distinct-class positive-pair batching. The source also uses unqualified N-pair loss for a family including N-pair-ovo, so that family name is not an exact alias of this member. Its per-anchor categorical form is shared with generic InfoNCE at dot-product scores, but the named supervised batching configuration is retained explicitly. It is not the full SimCLR procedure or NT-Xent’s cosine-temperature two-view construction. N-pair-ovo instead sums individual pairwise softplus terms. No normalized identity match was found across all 442 pinned AIO labels/scoped synonyms and 218 preceding native IDs/names/aliases. Word-delimited fixed-string searches of both full checkouts, including ignored and hidden files, returned 15 lines each in existing discovery/review context. Five neighboring native records and five exact AIO nodes with scoped synonyms and outgoing edges were inspected.
Claims & Grounded Evidence
1 Claim
Mechanism
#method
Take N>=2 classes and two examples (x_i,x_i+) from each class. Encode 2N examples to f_i and f_i+. The Equation (7) objective is L_mc=(1/N) sum_i log[1+sum_(j!=i) exp(f_i^T f_j+−f_i^T f_i+)]. Each anchor has its paired positive and N−1 negative candidates from the positive side of other classes. Sharing these candidates across anchors forms N tuplets using 2N forward embeddings. Equation (7) specifies one orientation; footnote 2 also mentions a symmetric loss that swaps the anchor/positive roles, without specifying its aggregation in that footnote. No explicit temperature or cosine normalization appears in this expression.
⚠️ Curated Limitations & Negative Results
- Use N positive pairs from N distinct classes; other positive-side examples must represent different classes for the stated objective. Pair sampling and class selection are part of this configuration, not interchangeable with arbitrary augmented-view negatives.
- The main paper uses embedding-norm regularization instead of a hard unit-length constraint. This record specifies the loss term; it does not prescribe a regularization coefficient, encoder, optimizer or full training schedule.
- No unconditional equivalence to a margin triplet hinge or an information lower bound is asserted. Objective shape and label-based batching do not establish downstream accuracy. No training or benchmark was reproduced.
- The proceedings Supplemental.zip inspected during retrieval contains a different paper by Steinhardt and Liang. It is not supporting evidence; this record relies on the inspected nine-page N-pair main paper.
Artificial Intelligence Ontology (AIO) Grounding
Mapped AIO Classes
| AIO Target Class | Mapping Relation | Mapping Rationale |
|---|---|---|
AIO:ContrastiveLearning
Contrastive Learning
|
related_match | The objective contrasts same-class positives with different-class negatives. The inspected AIO target explicitly describes a self-supervised deep-network approach, whereas this objective is supervised and mathematical. Their shared positive-versus-negative representation-learning mechanism supports a related association only, not an equivalence or subclass assertion. |
Evidence Sources & Primary Literature
1 Source| Source ID | Publication / Document | Type / Access | Reference & Checksum |
|---|---|---|---|
method-source
|
Kihyuk Sohn
|
primary paper
full_text
|
ID: https://papers.nips.cc/paper_files/paper/2016/hash/6b180037abbebea991d8b1232f8a8ca9-Abstract.html
sha256:83bee5d1a7ed…
|
Curation Provenance
Curator: Codex
Method: ai_assisted
Model: GPT-6
Created: 2026-10-11T09:32:03Z
Updated: 2026-10-11T09:33:28Z
Source File:
data/curated/MultiClassNPairLoss.yaml