Compositional spatial transformer
Layers & Modules AIMech:CompositionalSpatialTransformer DRAFT
A learnable image-alignment module that retains an original source image and accumulated warp state, samples that source under the current warp to predict an incremental transform, composes the increment with the state, and passes the source and updated geometry onward for later alignment or final sampling.
Identity Notes & Concept Scope
This record denotes the reusable c-STN alignment module in Lin and Lucey 2017 Figure 3: retain the original source image and accumulated warp, predict an increment from its current sample, and pass composed geometry onward. Cascading these modules is an application of the module; the record does not alternate its identity with a complete classifier or mandate untied predictors. The shared IC-STN recurrence is a related specialization with one-step/tied-cascade overlap, not a disjoint function class or universal exact alias. The earlier SpatialTransformer does not itself require this retained-state composition. At the actual clean cohort 338 base 5bca5a88c58998cc790594358d178fe828da1eea, the complete inventory contained 748 native and 442 pinned AIO records. Normalized IDs, local IDs, names, aliases and all scoped synonyms comprised 4761 field occurrences and 3640 distinct normalized values. The selected candidate probes had no collision; the sole normalized contextual hit was AIMech:SpatialTransformer. Four full-checkout searches included ignored and hidden files and returned 134/136/349/418 occurrences, grouped losslessly into 48 distinct contents. Root read all 48 contents, the provenance representatives/root sets and current relevant frontier objects. These hits are the existing SpatialTransformer record and its generated/review/history contexts, the carried IC-STN owner, or the separately pending PTN source context. All 909 main and 393 nested frontier objects were mechanically queried recursively. The actual inventory preserves the historical semantic research bytes, with only the three unrelated cohort 337 regularizers added to the earlier PTN snapshot. This is bounded snapshot/semantic-neighborhood evidence, not a global absence or saturation claim. Reuse owner 236 together with the distinct shared-recurrence record, preserving its later-analysis URL as historical context and identifying the 2017 CVPR paper separately as defining evidence. Source-agent 92 semantic rows, 13 complete frontier objects and 14 AIO nodes / 141 incident edges remain attributed; root read all 14 AIO contexts, complete current SpatialTransformer and the primary pages specified in its research acceptance. Qualified related Layer association only.
Claims & Grounded Evidence
5 Claims
Mechanism
#retained-source-and-geometric-state
The module receives an original source image I and current warp parameters p_in. Its geometric predictor uses the source sampled under the current warp to estimate an update delta p. The module carries the original source and updated warp state onward, rather than replacing the source with the preceding cropped or resampled output. A later stage can therefore sample original pixels outside an earlier intermediate crop, provided those pixels are present in the retained source.
Mechanism
#explicit-affine-left-composition
For the displayed affine convention, p=(p1,p2,p3,p4,p5,p6) determines M(p)=[[1+p1,p2,p3],[p4,1+p5,p6],[0,0,1]]. The module composes the update as M(p_out)=M(delta p) M(p_in). Writing these affine matrices as linear blocks A with translations b gives A_out=A_delta A_in and b_out=A_delta b_in+b_delta. This is composition of coordinate transformations, not addition of the six parameter vectors.
Mechanism
#differentiable-composition-partials
The source supplies derivatives of p_out with respect to p_in while holding delta p fixed, and with respect to delta p while holding p_in fixed. In the six-parameter order of Equation 9, these are A_delta tensor-product I_3 and blockdiag(M(p_in)^T,M(p_in)^T), respectively. They agree with the displayed left-composition rule and allow gradients through the composition operation. They are fixed-argument partials, not the full state derivative through the learned predictor and image sampler.
Scope
#reusable-module-with-cascade-use
Several compositional modules can be concatenated into an alignment cascade while retaining the source image and passing accumulated geometry between stages. The module definition does not require either distinct or shared predictor parameters. Reusing one predictor at all steps gives the IC-STN recurrent specialization; a finite cascade with separate predictors is another use of the module. The source identifies a one-step compositional model with a one-step IC-STN.
Scope
#learned-alignment-with-downstream-objective
The predictor can be learned through the warp-and-composition graph together with a downstream objective. The source describes linear, fully connected and convolutional predictor configurations, using geometric-parameter error for its planar alignment experiment and joint alignment/classification configurations elsewhere. The module is not defined by one fixed classifier, one predictor architecture or the classical Lucas–Kanade least-squares objective.
⚠️ Curated Limitations & Negative Results
- The affine coordinate convention and multiplication order are part of the stated mechanism. Composing singular affine matrices is algebraically possible, but interpreting a warp as invertible requires a nonsingular, suitably conditioned linear part. Equation 9 imposes no determinant constraint by itself. The homography experiments additionally require nonzero homogeneous denominators on the sampled domain; the affine Equation 11 does not specify homography derivatives. An incremental inverse, when required by a chosen interpretation, is not obtained by simply negating all six parameters.
- Retaining the original image prevents information loss caused by repeatedly replacing it with intermediate cropped or interpolated outputs. It does not recover pixels absent from the original source, physical occlusion or lost resolution. Intermediate samples for the predictors still occur. Finite grids, out-of-range sampling, interpolation, aliasing and numerical error remain relevant; exact matrix composition does not imply exact raster preservation.
- Equation 11 contains correct composition partials. If C(p,delta) is the composition and delta=f(warp(I,p)), the full state derivative is C_p+C_delta Df D_p[warp(I,p)] where differentiable. The identity term in a partial alone gives no arbitrary-horizon gradient guarantee. For 0<epsilon<1, constant incremental linear parts (1−epsilon)I or (1+epsilon)I produce direct gradient magnitudes (1−epsilon)^K or (1+epsilon)^K; these isotropic examples still have condition number one. Anisotropic scales can instead worsen conditioning. These are bounded hand constructions, not reports about trained-model failure or author-code backpropagation.
- Differentiable or subdifferentiable sampling enables optimization but does not imply smoothness at all interpolation knots and boundaries. The displayed composition partials must be combined with the predictor and sampler derivatives and their domain conventions. No padding, subgradient, coordinate-range or singular-transform handling is verified at implementation level.
- A learned linear predictor can share the algebraic form of a classical alignment regressor without equaling a particular template-Jacobian pseudoinverse or minimizing the same objective. The source’s LK/SDM analogy, residual-gradient explanation and selected empirical results do not establish universal solver equivalence, monotone descent, convergence or accuracy and computational advantages. This record denotes the Figure 3 reusable module; cascade usage does not silently change its identity into a whole classifier or require untied weights.
- Evidence is the exact nine-page official CVPR 2017 proceedings PDF. The acquired CVF page numbering and Crossref IEEE numbering differ and are explicitly separated; no exact publication day or preprint byte identity is asserted. The official supplementary ZIP returned HTTP 404, so no supplementary content is claimed. Historical source inspection did not include author code or full original LK, IC-LK and SDM papers, and did not execute training or reproduce benchmarks. No implementation-level coordinate normalization, padding, device behavior or numerical accuracy is certified.
Artificial Intelligence Ontology (AIO) Grounding
Mapped AIO Classes
| AIO Target Class | Mapping Relation | Mapping Rationale |
|---|---|---|
AIO:Layer
Layer
|
related_match | The reusable alignment module receives source/state information, transforms the geometric state and passes information onward, supporting a qualified relation to the pinned Layer class. That broad class does not identify this particular geometry-preserving construction. The relation is neither exact equivalence nor a claim that a complete alignment cascade or classifier is one primitive layer. |
Evidence Sources & Primary Literature
1 Source| Source ID | Publication / Document | Type / Access | Reference & Checksum |
|---|---|---|---|
lin2017
|
Chen-Hsuan Lin, Simon Lucey
|
primary paper
full_text
|
ID: 10.1109/CVPR.2017.242
sha256:b9c660a8bcc8…
|
Curation Provenance
Curator: Codex
Method: ai_assisted
Model: GPT-6
Created: 2026-10-15T09:56:01Z
Updated: 2026-10-15T09:56:01Z
Source File:
data/curated/CompositionalSpatialTransformer.yaml