AIMech AI

Self-Normalized Heteroscedastic LASSO Optimal Instrumental Variables and Weak-Identification Sup-Score Inference

Algorithms AIMech:SelfNormalizedHeteroscedasticLassoOptimalInstrumentalVariablesAndWeakIdentificationSupScoreInference DRAFT
Aliases: Self-Normalized Heteroscedastic LASSO and Post-LASSO for Optimal Instruments, BCCH Sparse Optimal Instrumental Variables and Sup-Score Test, Iterative Self-Normalized Penalty Loading LASSO and Post-LASSO IV, High-Dimensional Weak-Identification Sup-Score and Inverse LASSO Inference
A high-dimensional sparse instrumental variable (IV) estimation and inference framework (introduced by Alexandre Belloni, Daniel Chen, Victor Chernozhukov, and Christian Hansen in 2012) that estimates the conditional expectation $D(z_i) = \mathbb{E}[d_i \mid z_i]$ of endogenous regressors $d_i$ given $p \gg n$ dictionary instruments $f_i = (f_{i1}, \dots, f_{ip})'$ under heteroscedastic and non-Gaussian first-stage disturbances $\zeta_i = d_i - D(z_i)$ via LASSO and Post-LASSO with iterative self-normalized moderate-deviation penalty loadings $\widehat{\gamma}_j = \sqrt{\mathbb{E}_n[f_{ij}^2 \widehat{\zeta}_i^2]}$ and $\lambda = 2c\sqrt{n}\Phi^{-1}(1 - \gamma/(2p))$ ($c > 1$, Algorithm A.1). Grounded in Jing, Shao, and Wang's (2003) self-normalized moderate deviation theorem (Lemma 5), the score-calibrated loadings control the maximal heteroscedastic score $\max_{1 \le j \le p} |\sqrt{n}\mathbb{E}_n[f_{ij}\zeta_i]| / \sqrt{\mathbb{E}_n[f_{ij}^2\zeta_i^2]} \le \Phi^{-1}(1 - \gamma/(2p))$ without Gaussianity or homoscedasticity, delivering near-oracle first-stage rates $\|\widehat{D}_i - D_i\|_{2,n} = O_P(\sqrt{s\log(p \vee n)/n})$ (Theorem 1), semiparametrically efficient structural IV estimation $\sqrt{n}(\widehat{\alpha}^* - \alpha_0) \to_d \mathcal{N}(0, \Omega_0)$ under $s^2\log^2(p \vee n)/n \to 0$ (Theorems 2-4), and weak-identification-robust confidence regions via the Sup-Score test statistic $\widehat{S}(\alpha) = \max_{1 \le j \le p} \frac{|\sqrt{n}\mathbb{E}_n[(y_i - d_i'\alpha)f_{ij}]|}{\sqrt{\mathbb{E}_n[(y_i - d_i'\alpha)^2 f_{ij}^2]}}$ and its exact dual Inverse LASSO null-solution equivalence $\widehat{S}(\alpha) \le \Lambda \iff \widehat{\beta}_{\mathrm{IL}}(\alpha; 2\Lambda\sqrt{n}) = 0$ (Section 3.5, Eqs. 3.17-3.19).
Identity Notes & Concept Scope Resolved against all 442 pinned AIO concepts and 660 maintained AIMech concepts. Distinct from `AIMech:DoubleDebiasedMachineLearningAndNeymanOrthogonalCrossFitting` (Chernozhukov et al. 2018, which introduces general cross-fitted Neyman-orthogonal scores for arbitrary black-box ML learners rather than Belloni et al.'s 2012 iterative self-normalized heteroscedastic penalty loadings $\widehat{\gamma}_j = \sqrt{\mathbb{E}_n[f_{ij}^2 \widehat{\zeta}_i^2]}$, Post-LASSO optimal instrument construction with additional instruments $I_i$, or weak-identification-robust Sup-Score / Inverse LASSO inference), distinct from `AIMech:SquareRootLassoPivotalConicSparseRegression` (Belloni, Chernozhukov, & Wang 2011, which eliminates homoscedastic noise scale $\sigma$ via conic root-MSE loss rather than predictor-specific heteroscedastic self-normalized loadings $\widehat{\gamma}_j$), and distinct from `AIMech:L1PenalizedAndPostPenalizedQuantileRegressionProcessInHighDimensionalSparseModels` (Belloni & Chernozhukov 2011, which uses distribution-free conditional quantile rankscores).

Claims & Grounded Evidence

3 Claims
Mechanism #self-normalized-moderate-deviation-heteroscedastic-loadings-and-first-stage-oracle-rates
Under conditional heteroscedasticity and non-Gaussian disturbances $\zeta_i = d_i - D(z_i)$ with bounded third moments $\max_j (\bar{\mathbb{E}}[|f_{ij}\zeta_i|^3])^{1/3} / (\bar{\mathbb{E}}[f_{ij}^2\zeta_i^2])^{1/2} \le K_n$ and $K_n^3 \log^{3/2}(p \vee n) \le \delta_n \sqrt{n}$, Jing, Shao, and Wang's (2003) self-normalized moderate deviation lemma (Lemma 5, Eq. A.8, p. 41) guarantees $\mathbb{P}\left(\max_{1 \le j \le p} \frac{|\sqrt{n}\mathbb{E}_n[f_{ij}\zeta_i]|}{\sqrt{\mathbb{E}_n[f_{ij}^2\zeta_i^2]}} > \Phi^{-1}(1 - \gamma/(2p))\right) \le \gamma(1 + o(1))$. Algorithm A.1's iterative refinement of data-driven loadings $\widehat{\gamma}_j^{(k)} = \sqrt{\mathbb{E}_n[f_{ij}^2(d_i - f_i'\widehat{\beta}^{(k)})^2]}$ from initial demeaned loadings $\widehat{\gamma}_j^{(0)} = \sqrt{\mathbb{E}_n[f_{ij}^2(d_i - \bar{d})^2]}$ achieves asymptotically valid loading bounds $l \overset{P}{\to} 1 \overset{P}{\leftarrow} u$ ($l\gamma_j^0 \le \widehat{\gamma}_j \le u\gamma_j^0$, Lemma 12, p. 44), and under the restricted eigenvalue condition $\kappa_{\bar{c}} > 0$ and sparse eigenvalue bounds $\phi_{\min}(m) > 0$, both LASSO and Post-LASSO (incorporating up to $k_n$ additional instruments $I_i$) satisfy $\|\widehat{D}_i - D_i\|_{2,n} \lesssim_P \frac{c\sqrt{s\log(p \vee n)/n}}{(1-a)\kappa_{\bar{c}}} + \sqrt{\frac{k_n\log(p \vee n)}{n\phi_{\min}(k_n + \widehat{s})}} + c_s$ with sparsity $\widehat{s} = |\widehat{T}| \lesssim_P s$ (Theorem 1, Eqs. 3.10-3.11, p. 17; Lemmas 6-8, pp. 42-43).
Mechanism #semiparametric-efficiency-and-root-n-asymptotic-normality-under-s-squared-sparsity
When the structural parameter $\alpha_0 \in \mathbb{R}^{k_d}$ in $y_i = d_i'\alpha_0 + \epsilon_i$ ($\mathbb{E}[\epsilon_i \mid z_i] = 0$) is strongly identified ($\lambda_{\min}(\mathbb{E}[D_i D_i']) \ge \mu_0 > 0$) and the sparsity index satisfies $\frac{s^2\log^2(p \vee n)}{n} \to 0$ with approximation error $c_s \lesssim \sqrt{s/n}$, the cross-term $\sqrt{n}\mathbb{E}_n[(\widehat{D}_i - D_i)\epsilon_i]$ is $o_P(1)$ because Cauchy-Schwarz and the self-normalized score bound yield $|\sqrt{n}\mathbb{E}_n[(f_i'\widehat{\beta} - D_i)\epsilon_i]| \le \|\widehat{\beta} - \beta_{0n}\|_1 \max_j |\sqrt{n}\mathbb{E}_n[f_{ij}\epsilon_i]| + |\sqrt{n}\mathbb{E}_n[r_i\epsilon_i]| = O_P(\sqrt{s^2\log^2(p \vee n)/n}) = o_P(1)$ (Appendix E, Step 2, p. 55). Consequently, the IV estimator $\widehat{\alpha} = (\mathbb{E}_n[\widehat{D}_i d_i'])^{-1}\mathbb{E}_n[\widehat{D}_i y_i]$ is asymptotically equivalent to the infeasible oracle optimal-instrument estimator and satisfies $\Omega_n^{-1/2}\sqrt{n}(\widehat{\alpha} - \alpha_0) \to_d \mathcal{N}(0, I)$ with consistent plug-in sandwich variance $\widehat{\Omega}_n$ (Theorem 2, Eq. 3.12, p. 19; Theorems 3-4, pp. 21-22).
Mechanism #weak-identification-robust-sup-score-test-and-inverse-lasso-duality
Without assuming strong identification or instrument sparsity, testing $H_0 : \alpha = \alpha_0$ under $\mathbb{E}[(y_i - d_i'\alpha_0)f_{ij}] = 0$ ($1 \le j \le p$) via the self-normalized Sup-Score statistic $\widehat{S}(\alpha) = \max_{1 \le j \le p} \frac{|\sqrt{n}\mathbb{E}_n[(y_i - d_i'\alpha)f_{ij}]|}{\sqrt{\mathbb{E}_n[(y_i - d_i'\alpha)^2 f_{ij}^2]}}$ with critical value $\Lambda_{1-\gamma} = c\Phi^{-1}(1 - \gamma/(2p))$ ($c > 1$) yields confidence regions $\mathcal{C}_{1-\gamma} = \{\alpha : \widehat{S}(\alpha) \le \Lambda_{1-\gamma}\}$ with uniform asymptotic coverage $\liminf_{n \to \infty} \mathbb{P}(\alpha_0 \in \mathcal{C}_{1-\gamma}) \ge 1 - \gamma$ even when instruments are arbitrarily weak or unidentified (Section 3.5, Eqs. 3.17-3.18, pp. 23-24). Moreover, by the KKT conditions of LASSO regressions of the structural residual $y_i - d_i'\alpha$ on $f_i$ with residual-self-normalized loadings $\widehat{\gamma}_j(\alpha) = \sqrt{\mathbb{E}_n[(y_i - d_i'\alpha)^2 f_{ij}^2]}$ and penalty $\lambda = 2\Lambda_{1-\gamma}\sqrt{n}$, $\widehat{S}(\alpha) \le \Lambda_{1-\gamma}$ holds if and only if the Inverse LASSO solution is identically zero ($\widehat{\beta}_{\mathrm{IL}}(\alpha) = 0$, Eq. 3.19, p. 25).

⚠️ Curated Limitations & Negative Results

Artificial Intelligence Ontology (AIO) Grounding

Mapped AIO Classes
AIO Target Class Mapping Relation Mapping Rationale
AIO:LassoRegression
Lasso Regression
related_match Equips LASSO and Post-LASSO with iterative self-normalized heteroscedastic penalty loadings for high-dimensional optimal instrument estimation and Inverse LASSO weak-IV inference.
AIO:LinearRegression
Linear Regression
broad_match Estimates linear instrumental variable structural models with high-dimensional sparse first-stage conditional expectations.

Evidence Sources & Primary Literature

3 Sources
Source ID Publication / Document Type / Access Reference & Checksum
bcch2012-iv-pdf
Alexandre Belloni, Daniel Chen, Victor Chernozhukov, Christian Hansen
primary paper
full_text
ID: https://doi.org/10.3982/ECTA9626
sha256:4430646f1db8…
bcch2012-iv-abs
Alexandre Belloni, Daniel Chen, Victor Chernozhukov, Christian Hansen
primary paper
abstract_only
ID: https://arxiv.org/abs/1010.4345
sha256:a9c223262c80…
bcch2012-iv-crossref
Alexandre Belloni, Daniel Chen, Victor Chernozhukov, Christian Hansen
primary paper
abstract_only
ID: https://doi.org/10.3982/ECTA9626
sha256:4138bfa25e81…

Ontology & Grounding Topology

Open in interactive network graph →
CONCEPT KIND Algorithms AIMech:SelfNormalizedHeteroscedasticLassoOptimalInstrumentalVariablesAndWeakIdentificationSupScoreInference Self-Normalized... 3 claims · 3 sources AIO GROUNDING AIO:LassoRegression (2)

Curation Provenance

Curator: Antigravity
Method: ai_assisted
Model: Gemini
Created: 2026-10-19T04:00:00Z
Updated: 2026-10-19T04:00:00Z
Source File: data/curated/SelfNormalizedHeteroscedasticLassoOptimalInstrumentalVariablesAndWeakIdentificationSupScoreInference.yaml · Schema: curated_concept.yaml

Explore across X-Mech

Related computational & biological Mechs: Embedding Map Network Graph ProteinTraitsMech (ESM-2 pLM) DUFMech (Domain pLM) TraitMech CultureMech All 14 X-Mech Repositories