Interpolation consistency training
Algorithms AIMech:InterpolationConsistencyTraining DRAFT
Aliases: ICT
A semi-supervised training procedure that encourages a student’s prediction at an interpolated pair of unlabeled inputs to match the same interpolation of predictions from a moving-average teacher, while also fitting labeled examples.
Identity Notes & Concept Scope
The original IJCAI2019 procedure uses interpolated unlabeled inputs and interpolated EMA-teacher probabilities. Mean Teacher compares perturbed versions of one input; MixUp interpolates observed targets; MixMatch builds sharpened guesses and a combined mixing pool. These are related components and procedures, not equivalent names. This record uses the five-author conference version and does not import theory claims from the later expanded seven-author version. No normalized identity match was found across all 442 pinned AIO labels/scoped synonyms and 234 preceding native IDs/names/aliases. Full-checkout fixed-string searches included ignored and hidden files in both worktree and main checkout, returning 21 lines in each from prior discovery and the related MixMatch record. Twelve exact AIO CLASS nodes, their scoped synonyms and outgoing edges, plus six neighboring native mechanisms were inspected. This absence assessment is bounded to the pinned snapshot and inspected semantic neighborhood.
Claims & Grounded Evidence
1 Claim
Mechanism
#method
For two sampled unlabeled minibatches, obtain fixed teacher predictions f_theta_prime(u_j) and f_theta_prime(u_k). Draw lambda from a distribution on [0,1], with Beta(a,a), a>0, used in the reported method. Form u_mix=lambda*u_j+(1−lambda)*u_k and q_mix=lambda*f_theta_prime(u_j)+(1−lambda)*f_theta_prime(u_k). Minimize labeled cross-entropy plus a ramped coefficient times a discrepancy between f_theta(u_mix) and q_mix; the experiments use mean squared error, while Equation1 allows a general discrepancy. Update the student from gradients with respect to theta, holding the teacher targets fixed. Algorithm1 explicitly computes these gradients, updates theta_prime←rho*theta_prime+(1−rho)*theta using the pre-step student, and then takes the student optimization step; this order differs from averaging the already-updated student. The displayed algorithm returns the student parameters. Although Algorithm1 and Figure2 display ordinary labeled cross-entropy, Section3.3 reports applying supervised MixUp to labeled examples in the experiments. This protocol choice is not silently substituted into the displayed core algorithm.
⚠️ Curated Limitations & Negative Results
- Low-density boundary motivation depends on cluster and interpolation assumptions and is not a universal guarantee that arbitrary input mixtures lie in low-density regions.
- Incorrect teacher targets can be propagated by interpolation; the EMA and consistency ramp do not establish target correctness.
- The published pre-step EMA order is recorded explicitly; initialization, normalization and alternative implementation scheduling require version-specific evidence.
- The paper’s general discrepancy and mixing distribution permit variants, but the cited experimental choices are MSE and a symmetric Beta distribution. No benchmark or implementation reproduction is claimed.
Artificial Intelligence Ontology (AIO) Grounding
Mapped AIO Classes
| AIO Target Class | Mapping Relation | Mapping Rationale |
|---|---|---|
AIO:Classification
Classification
|
related_match | This algorithm learns class predictions from labeled and unlabeled examples. The pinned target is a classification task under SupervisedLearning; the association is not an equivalence or an is-a assertion. |
AIO:MachineLearningTask
Machine Learning Task
|
related_match | This training algorithm realizes learning from data; the AIO target is a general learning task at a different abstraction level, so the relation is associative. |
Evidence Sources & Primary Literature
1 Source| Source ID | Publication / Document | Type / Access | Reference & Checksum |
|---|---|---|---|
method-source
|
Vikas Verma, Alex Lamb, Juho Kannala, Yoshua Bengio, David Lopez-Paz
|
primary paper
full_text
|
ID: doi:10.24963/ijcai.2019/504
sha256:38472ca4ef82…
|
Curation Provenance
Curator: Codex
Method: ai_assisted
Model: GPT-6
Created: 2026-10-11T10:22:43Z
Updated: 2026-10-11T10:22:43Z
Source File:
data/curated/InterpolationConsistencyTraining.yaml