Statistical Methodology
Double Descent in High-dimensional Linear Discriminant Analysis
Yonghe Lu, Han Lin Shang, Yanrong Yang et al. (+1 more)
The double-descent phenomenon observed in modern machine learning models has challenged the classical bias-variance trade-off by showing that prediction error can decrease again as model complexity exceeds the interpolation threshold. Although this phenomenon has been extensively studied for deep neural networks and other high-capacity models, its implications for classical statistical methods remain less well understood. In this paper, we investigate double descent in linear discriminant analysis (LDA), a fundamental classification method for binary classification. Using random
matrix theory, we derive the asymptotic misclassification risk of LDA in the high-dimensional regime where the dimension (p) and sample size (n) satisfy (p/n \to \gamma). Specifically, we obtain an explicit asymptotic expression for the LDA risk with a general population covariance
matrix when (\gamma \in (0,1)), and for the Moore-Penrose pseudo-inverse LDA classifier under an isotropic covariance model when (\gamma \in (1,\infty)). Together, these results provide a complete characterization of the double-descent risk curve of LDA across both the under- and over-parameterized regimes. Simulation studies and experiments on the ARCENE cancer classification
dataset demonstrate close agreement with the theoretical predictions.
Read the full abstract ▾
All authors Yonghe Lu, Han Lin Shang, Yanrong Yang, Kehan Zhao
Machine Learning (Statistics) · Cross-listed from cs.LG
Pay Only for Disagreement: Certified No-Regression Verdicts for Model Updates with Matching Label-Complexity Bounds
Vishnu Bindu Balachandran
Every production model is updated, by retraining, fine-tuning, quantization, or a silent vendor swap, and each update risks being worse than what it replaced. We formalize update promotion as certified paired risk-difference
auditing. Our starting point is a support identity: the risk difference between two models lives on the inputs where they disagree, observable without labels. We build DISCERN, a sequential two-tier protocol. A zero-label tier certifies benign updates whose disagreement rate is below tolerance from unlabeled traffic alone. An audited tier labels only sampled disagreements through an anytime-valid confidence sequence, valid at every stopping time and under any label-routing rule, even an
adversarial judge. We prove finite-sample validity and matching label-complexity bounds of order rho^2/eps^2 at the rate level, so exploiting free disagreement provably saves a factor 1/rho over any pairing-blind auditor, and the guarantee composes across an unbounded sequence of promotions from one error budget. Across 14,000+ replayed audit streams over 785 update pairs, including LoRA fine-tunes of
language models up to 1.4B parameters, miscoverage is 0.0002 (nominal 5%), power 0.986 with zero false alarms, and 56% of benign updates certify with zero labels. Each audit emits a machine-checkable evidence record for post-
market monitoring.
Read the full abstract ▾
Statistics Applications
Bayesian Quantile-Based Correction and Synthesis of Hydrologic Products
Antonio De Leon, Raquel Prado and Bruno Sansó
River-flow
forecasting requires predictive distributions that remain informative in both routine and extreme conditions. We develop a
Bayesian quantile-based correction-and-synthesis framework built on Dynamic
Quantile Linear Models (DQLMs). The framework links U.S. Geological Survey (USGS) observations, retrospective products, and ensemble forecast products through a shared latent
quantile process, learns dynamic discrepancies for each external source, and combines
quantile-specific posterior predictions into a single predictive distribution. We also adapt variational Bayes inference to the extended dynamic
quantile linear model using Laplace–Delta approximations for non-conjugate parameters. The methodology is illustrated using daily flow for the San Lorenzo River together with products from the European Centre for Medium-Range Weather Forecasts (ECMWF) Global Flood Awareness System (GloFAS) and the National Oceanic and Atmospheric Administration (NOAA) National Weather Service (NWS), with emphasis on medium-range
forecasting and uncertainty quantification across multiple
quantile levels.
Read the full abstract ▾
Statistical Methodology · Cross-listed from cs.LG
External Clustering Validation by the Homogeneity-Parsimony Trade-off
Andreas Tiffeau-Mayer
Scalar metrics are often used to evaluate clusterings against known classes, but they can obscure a fundamental trade-off: clusterings should be informative about class labels while avoiding unnecessary fragmentation. Here we describe normalized scores of cluster homogeneity and parsimony that quantify this trade-off. These scores build on the information bottleneck principle, modified to not reward lossy compression. We show by example and mathematical proof that our definitions of these scores have the intuitive property of varying monotonically under cluster refinement in contrast to related proposals. Extending the information-theoretic framework beyond Shannon
entropies, we furthermore derive set-matching and pair-based counterparts of the homogeneity and parsimony scores. These unify commonly used evaluation criteria and show that, in the pair-based setting, the homogeneity-parsimony trade-off recovers the receiver operating characteristic of binary classifiers. We demonstrate the framework's utility for feature selection and
algorithm comparison, illustrating how considering scores jointly can clarify clustering operating points and identify Pareto-optimal solutions.
Read the full abstract ▾
Statistics Applications · Cross-listed from physics.chem-ph
Importance-Sampling Estimation of Gaussian Molecular Shape Overlap: Exact Union Volumes and Confidence-Bounded Virtual Screening
Egor I. Tuzharov, Alexandra V. Bochenkova and Yury Maximov
Gaussian descriptions of molecular shape underpin 3D shape-based virtual screening, but existing methods evaluate Gaussian overlap analytically. The widely used first-order approximation is fast but systematically overestimates overlap, whereas the exact molecular volume requires a combinatorial inclusion-exclusion expansion. We introduce the first
stochastic estimator of Gaussian shape overlap: an unbiased Monte Carlo method that importance-samples directly from a molecule's Gaussian mixture. The
estimator reproduces analytic overlap without bias and extends to the exact union volume of all inclusion-exclusion orders with O(N) cost per sample. On drug-like molecules, the union
estimator matches high-resolution grid quadrature with a mean relative error of 0.07 percent, while the first-order approximation overestimates the true union volume by 3.4x on average. The
estimator provides analytic standard errors, enabling confidence-bounded screening that reduces sampling by 94 percent while preserving ranking. Implemented in JAX, it is fully differentiable and supports gradient-based rigid
alignment on CPU, GPU, and TPU. On the DUD-E and LIT-PCBA
benchmarks, the method achieves shape-only enrichment comparable to existing single-conformer approaches while additionally providing unbiased absolute volumes and uncertainty estimates.
Read the full abstract ▾
Statistical Methodology
Twoblock clustering trees with coskewness-based dimension reduction: recovering piecewise multivariate linear regimes
Sven Serneels
The twoblock clustering tree (\tbtree) is introduced as a highly interpretable regression tree for multivariate responses. Twoblock trees are deterministic decision trees that have local multivariate linear models as their leaves and use dense or sparse twoblock dimension reduction as local leaf models and in the
impurity. The resulting models are both computationally efficient and can be highly interpretable. The
estimator's primary aim is an interpretable, regime-aligned piecewise-linear description of the data, with predictive competitiveness retained as a constraint through a split/leaf decoupling. Beyond proposing the decision tree
estimator itself, this paper also introduces an
estimator for the twoblock dimension reduced space based on maximizing coskewness, which facilitates identification of non-normal clusters in the data. The tree inherently produces a set of local linear models and is therefore apt to recover piecewise linear regimes, which is illustrated in a simulation. However, two real-world data examples illustrate that twoblock trees are also capable of modeling more complexly nonlinear dependencies and can perform on par with black-box modeling techniques, such as random forests. At each point, both the twoblock models that generate the splits, as well as the ones in the leaves, can be inspected and interpreted.
Read the full abstract ▾
Statistical Methodology
Local permutation tests for conditional independence: an adaptive binning perspective
David Chen, Rohan Hore and Rina Foygel Barber
In this work, we study the problem of testing conditional independence between random variables $X$ and $Y$ given a confounder $Z$. The local permutation test (LPT) offers a principled approach to this problem by partitioning the $Z$-space into pre-specified bins, and permuting the $X$ and $Y$ data within each bin, to assess the significance of an observed test statistic. However, when the partitions are pre-fixed, the resulting partition can be poorly balanced, as some bins may contain most of the samples while others contain only a few. This motivates the use of data-adaptive binning strategies, such as equisized bins with a fixed (typically small) number of points. We study this natural and practically important extension of LPT, providing finite-sample bounds on the Type I error for an arbitrary test statistic, providing stronger validity results than previously known. We also show that LPT attains power comparable to the oracle likelihood ratio tests derived from the Neyman-Pearson lemma. Within a linear confounder model class, we further analyze the effect of bin size and demonstrate that constant bin sizes can match the performance of partitions with growing bin-size. These results, further supported by extensive numerical simulations, position the proposed data-adaptive strategy as both practically implementable and statistically efficient.
Read the full abstract ▾
Statistical Methodology
Conformal Prediction for Regression with Clipped Outcomes
Matteo Sesia and Vladimir Svetnik
We study conformal prediction for regression using calibration data with outcomes that are doubly censored (clipped) at known fixed thresholds. We show that existing methods are unsatisfactory in this setting, as they yield intervals that may have higher marginal coverage than desired and yet lose conditional coverage precisely for the easier-to-predict cases whose outcomes are typically fully observed. This reveals that marginal coverage, the usual target of conformal prediction, may not be the ideal goal under clipping. We address this challenge by introducing a new nonconformity score and calibration methods at both ends of this trade-off: one for tight marginal coverage, and a two-step method that prioritizes conditional coverage. We characterize their finite-sample coverage and oracle-like asymptotic behavior under suitable consistency of the underlying model, and we compare them to more direct adaptations of existing approaches.
Read the full abstract ▾
Statistical Methodology
The Well-Tempered Likelihood: Honest Confidence Intervals for Misspecified Models
Benjamin Nachman and Jesse Thaler
Likelihood-based inference in particle physics, and in the physical sciences more broadly, relies on the assumption that the model accurately describes the data. When the model is misspecified, though, standard confidence intervals shrink to zero width with increasing data, producing overconfident and potentially misleading constraints. We propose the well-tempered likelihood, which divides the likelihood-ratio test statistic by a goodness-of-fit (GOF) statistic evaluated at the best-fit point. Under correct specification, the GOF is $\mathcal{O}(1)$ and standard inference is recovered. Under misspecification, both the likelihood and the GOF scale as $\mathcal{O}(N)$ for $N$ data points, so their ratio remains $\mathcal{O}(1)$ and the resulting well-tempered confidence interval self-limits at a floor determined by the model's inadequacy, essentially reducing the effective sample size. In other words, all models are correct, as long as your
dataset is small enough. We present binned and unbinned formulations of the well-tempered likelihood—the latter based on a classifier two-sample test—and demonstrate our method on a Gaussian example and on a measurement of the strong coupling constant using synthetic electron-positron collisions.
Read the full abstract ▾
Statistics Applications · Cross-listed from math.PR
High Minima of Gaussian Processes: Overshoots and Minimizer Locations
Enkelejd Hashorva and Svyatoslav Novikov
Let $X(t)$, $t\in K$, be a centred Gaussian process with continuous sample paths on a compact metric space $K$, and let $M=\min_{t\in K}X(t)$. Let $\sigma_*^2$ denote the minimum covariance energy associated with $X$, and assume that $\sigma_*^2>0$. Motivated by the results of \cite{chakrabarty2018asymptotic} for smooth Gaussian processes, we show that, conditionally on $M>u$, the scaled overshoot $u(M-u)$ converges, as $u\to\infty$, to an exponential random variable with mean $\sigma_*^2$. Moreover, every weak subsequential limit of the conditional law of a measurable minimizer of $X$ is an optimal covariance-energy measure. In particular, if this measure is unique, then the conditional law converges weakly to it. The results are illustrated by stationary Gaussian processes, fractional Brownian motion, and fractional Brownian sheet.
Read the full abstract ▾
Statistical Methodology
A Bayesian Framework for Extrapolative Emulation of Spatially Gridded Simulation Data
Kelly R. Moran, Ky Potter, Chris Danly et al. (+1 more)
We propose a
Bayesian emulator for extrapolating spatially gridded simulation output across resolution. The method treats each pixel as following a nonlinear resolution-response curve, while linking pixels through Gaussian process priors on the curve parameters to preserve spatial structure and quantify uncertainty. In synthetic experiments designed to mimic resolution-dependent bias, the approach recovers the high-resolution target with competitive or improved accuracy relative to several alternative emulators, particularly in lower-information settings, while maintaining near-nominal interpolative coverage. We also illustrate the method on a radiation-hydrodynamics example from Cassio, where it is used to extrapolate a derived wave-front diagnostic beyond the finest observed simulation. These results suggest that spatially regularized resolution extrapolation can provide a useful statistical tool for studying high-fidelity behavior when direct simulation is expensive.
Read the full abstract ▾
All authors Kelly R. Moran, Ky Potter, Chris Danly, Christopher L. Fryer
Statistical Methodology · Cross-listed from cs.LG
CEDAR: Causal Edge Discovery for Autoregressive Processes
Mohammad Fesanghary
We propose CEDAR (Causal Edge Discovery for Autoregressive Processes), a constraint-based method for lagged causal edge discovery in sparse autoregressive time series. CEDAR screens candidate cross-variable lags using AR(1)-residualized, U-centered distance correlation, then applies two targeted conditional-independence tests per significant cross-variable lag candidate and accepts at most one lag per ordered pair. A stable MCI
pruning step removes indirect edges, and optional deterministic C-nodes adjust for specified trend-like nonstationarity. In sparse regimes where few lags survive screening, CEDAR requires $O(d^2)$ CI tests after screening while retaining edge-level interpretability. CEDAR is most effective when data are scarce and variables exhibit lag-1 self-dynamics; methods with richer conditioning sets become preferable as $T$ grows or when higher-order autoregressive or simultaneous multi-lag effects are common.
Read the full abstract ▾
Machine Learning (Statistics) · Cross-listed from cs.LG
When Does Recurrence Become an Algorithm? Convergence Selection in Weight-Tied Looped Transformers
Tong Zhang, Junhao Hu, Yun Peng et al. (+1 more)
When does a weight-tied looped
transformer – one block applied T times – implement an actual
algorithm? We answer with four findings from controlled populations on group word problems. (1) The budget law: free training installs a linear computation frontier, a mechanism that solves v positions per loop, whose speed is priced by the training contract: v ~ n_train/T_train (exponent 0.98 +/- 0.04, R^2=0.99), exactly unity under T=n training. SGD selects a frontier matching the minimum the contract demands; granting more test-time loops than ever trained rescues late positions at fixed input length, yielding a principled halting rule T* = ceil(n / v-hat). (2) Architecture prior, not expressivity, picks the
algorithm: standard-depth
transformers learn parallel scans on this family; weight tying flips the selection to the serial frontier, even when positional addressing for a log-depth scan is supplied. At matched depth and parameters, untied models extrapolate worst and fail to learn A5 at all. (3) The walls are not where
circuit complexity says: NC1-completeness costs nothing (A5 generalizes fully), while group order does (S5's 120x120 operator deadlocks joint learning) – and an operator-first curriculum dissolves the wall in every seed. (4) Mechanisms are portable, not mandatable: warm-starting across budget contracts transfers the
algorithm in every seed, re-pricing its speed, while imposing seriality through the input schedule fails where free training succeeds. These results are invisible to standard instruments, which provably saturate at the fixed points trained loops converge to. We introduce a head instrument, the convergence-time scaling tau(n,i), validate it causally via damage cones whose slope reproduces v, and show in-distribution head measurements predict out-of-distribution fate where tail metrics do not. Results replicate on the public easy-to-hard
benchmark.
Read the full abstract ▾
All authors Tong Zhang, Junhao Hu, Yun Peng, Tao Xie
Machine Learning (Statistics)
SPECTRA: State-Space Exogenous Context and Temporal-Frequency Resolution Architecture for Probabilistic Energy Forecasting
Hang Ye, Xinyan Jiang, Yuedong Shi et al. (+5 more)
Modern power systems increasingly require probabilistic forecasts amid interacting uncertainties from renewable intermittency, flexible demand,
market volatility, and weather-dependent generation. However, existing methods often treat multi-scale decomposition, exogenous-variable
alignment, and probabilistic output as separate steps, obscuring how predictable structures and uncertainty-bearing fluctuations jointly shape the forecast distribution. This paper proposes a state-space exogenous-context and temporal-frequency resolution architecture for general probabilistic energy
forecasting. Its central premise is that trend-periodic components primarily determine the baseline trajectory, whereas high-frequency residuals and external perturbations govern the spread and asymmetry of forecast uncertainty. Accordingly, the architecture adaptively separates deterministic and residual streams, aligns exogenous context with both, refines the deterministic backbone through multi-resolution spectral-temporal state-space modeling, and estimates ordered
quantile boundaries from their complementary representations. Experiments on load, price,
solar, and wind
forecasting achieve the best continuous ranked probability score in 14 of 18 settings, reducing average CRPS by 5.74% and upper-tail
quantile risk by 7.27% over the strongest baselines. These results support deterministic-
stochastic separation as an effective design principle for general probabilistic energy
forecasting.
Read the full abstract ▾
All authors Hang Ye, Xinyan Jiang, Yuedong Shi, Yangxin Zhu, Jianming Wei, Tian Zheng, Xiaoying Zheng, Yongxin Zhu
Statistics Theory · Cross-listed from cs.LG
Fisher Widths: Local Learning Geometry and Anisotropic Recovery
Vu Khac Ky
We study Gaussian-width complexity on statistical
manifolds through a pair of functionals: the primal Fisher width $w_G(T) = w(G^{1/2}T)$, induced by the Fisher metric, and the inverse-Fisher width $w_{G^{-1}}(T) = w(G^{-1/2}T)$, induced by the inverse Fisher metric. The two widths play complementary statistical roles. On the learning side, the Fisher width measures the size of local parameter fluctuations in the geometry induced by the Fisher information. For Fisher-regular losses, we prove that the scale \(w_G(H_r)/\sqrt n\) is attained on sufficiently small Fisher balls. On the recovery side, the inverse-Fisher width captures the effect of anisotropic Gaussian measurements whose covariance is determined by the inverse Fisher information. For sparse recovery, the resulting geometry depends not only on sparsity but also on the position of the active coordinates in the Fisher spectrum. We obtain a two-sided estimate for the corresponding statistical dimension, together with support-sensitive recovery estimates and a natural ordering of supports with different
curvature profiles. Finally, we establish a sharp relation between the primal and inverse-Fisher widths. On any common compact coordinate set $T$, they satisfy \[ w_G(T)w_{G^{-1}}(T)\geq w(T)^2. \] Thus, Fisher anisotropy may transfer complexity from one geometry to the other, but cannot reduce both widths relative to the Euclidean scale.
Read the full abstract ▾
Statistical Methodology
Restricted nonlinear shrinkage of high-dimensional residual covariance matrices in multivariate regressions
Hamid Karamikabir and Mohammad Arashi
We study estimation of the p*p residual scatter (shape)
matrix in a high-dimensional multivariate linear regression, where p and n grow proportionally. When the coefficient
matrix obeys a known linear restriction of rank q < d, as in multivariate analysis of variance, growth-curve models, and reduced-rank regression, the restricted fit leaves additional residual degrees of freedom that sharpen estimation of the shape
matrix. To accommodate heavy-tailed errors, we work with independent elliptically distributed rows under a mild scale condition, a finite second moment on the radii, which is far weaker than the usual sub-Gaussian assumptions and covers every multivariate-t law with more than two degrees of freedom. Shrinking the restricted residual sample covariance directly is unsound here, since its limiting spectrum depends on the radial distribution. We instead shrink a scale-invariant scatter of the restricted residuals, whose spectrum is distribution-free over the elliptical family and obeys the same limiting law as under Gaussian errors, at a smaller effective aspect ratio. The resulting
estimator attains the rotation-equivariant oracle and is asymptotically optimal within that class, and a Stein-type combination with the unrestricted
estimator dominates it while remaining safe under misspecification. We further correct for the case in which the restriction is itself selected from the data. Simulations, a growth-curve experiment, and two real-data analyses illustrate the results.
Read the full abstract ▾
Statistics Theory · Cross-listed from math.OC
Lipschitzian SLLNs for random functions
Lai Tian and Johannes O. Royset
We prove strong laws of large numbers for random functions in the Lipschitz pseudometric. Our results hold under either a topological or a model-theoretic condition, with the latter encompassing functions jointly definable in o-minimal structures but extending substantially beyond this class. Applications include uniform convergence of limiting and Clarke subdifferentials and finite-sample identification of solutions. Consequently, we identify broad classes of functions for which the failure phenomena revealed by our previous negative results [Tian and Royset, arXiv:2511.16568, 2025] do not occur.
Read the full abstract ▾
Statistics Theory · Cross-listed from math.PR
Embedding martingale diffusions as binary posteriors in sequential inference
Steven Campbell and Karl Kristian Engelund
Posterior probabilities are bounded martingales, but this fact alone does not identify the experiment that generates them. We show that every time-homogeneous martingale
diffusion on $[0,1]$ with strictly positive $C^1$
volatility on the interior and absorbing endpoints, which we call an autonomous win-martingale, can be realized as the
Bayesian posterior of an explicit binary sequential experiment observed through a scalar
diffusion. Conversely, in a general binary
diffusion experiment, the current time and observation are jointly sufficient for the hidden state precisely when the difference between the signal drifts under the two hypotheses satisfies a Riccati equation. Equivalently, this holds when the likelihood ratio is generated by a Doob $h$-transform associated with a positive space-time harmonic function for the null dynamics. Within this class, when that function is spatially harmonic, the posterior is an autonomous martingale. Outside this harmonic case, autonomy forces the drift difference to be constant, recovering the classical two-state Shiryaev-Wonham filter from binary testing. These results give concrete sequential inference interpretations to a broad class of bounded martingale
diffusions, including absorbed Brownian motion, the Wright-Fisher
diffusion, and the Aldous martingale of the "most exciting game."
Read the full abstract ▾
Machine Learning (Statistics)
Adaptive deep nonparametric regression from dependent data under covariate shift
William Kengne and Ehud Mossa Ockegna
Covariate shift often occurs because, in many real applications, the source and the target observations may be generated from different distributions. In this case, the standard metric under the source distribution is not appropriate. This paper considers deep neural network
estimators for nonparametric
quantile and Huber regression under
covariate shift and from dependent observations. We deal with a generalized Bernstein-type inequality that is satisfied by many classical models, including i.i.d. observations, $\phi$-mixing, strong mixing, and $\mathcal{C}$-mixing processes. To perform the
covariate shift phenomenon, we propose a sparse-penalized deep neural network (SPDNN)
estimator that takes into account the discrepancy between the source and target distributions of the data. When the density ratio (between the source and target distributions of the
covariate) is unknown, a two steps pre-training procedure is carried out: the first step is devoted to the construction of a least squares SPDNN
estimator of the density ratio; which is used in the second step to perform a pre-training reweighted SPDNN
estimator of the regression function. For both the
quantile and the Huber regression, non-asymptotic error bounds of the proposed SPDNN
estimators are established in the class of Hölder smooth functions. These
estimators can adaptively attain (up to a logarithmic factor) the minimax optimal convergence rate from i.i.d. data as well as from several classical time series models.
Read the full abstract ▾
Machine Learning (Statistics)
Adaptive Bayesian Online Learning via Expert Aggregation
Jungbin Jun and Ilsang Ohn
Bayesian online learning promises uncertainty-aware prediction on data streams, but its performance hinges on inferential choices, including learning rates, prior distributions and variational families, which are usually fixed before seeing the stream. We address this by treating
Bayesian update rules as experts and aggregating the
Bayesian experts according to sequential predictive losses. We prove that the resulting aggregate competes with the best expert in hindsight at an aggregation cost determined by how each expert's per-round performance is evaluated. We instantiate the framework in online conformal inference and Gaussian process regression. The conformal inference application yields a smoothed
Bayesian counterpart of adaptive conformal inference with long-run randomized coverage, while the Gaussian process application gives an oracle inequality in cumulative predictive Kullback-Leibler risk and adaptation to unknown Hölder smoothness up to logarithmic factors. Experiments show that the aggregate tracks strong experts without oracle expert selection.
Read the full abstract ▾
Machine Learning (Statistics)
Statistical Inference for Rank Allocation in Low-Rank Adaptation
Yihang Gao and Vincent Y. F. Tan
Low-rank adaptation (LoRA) has become a widely used parameter-efficient fine-tuning method for large
language models. Since different modules and layers may contribute unequally to downstream adaptation, allocating rank resources under a fixed parameter budget is an important problem for balancing efficiency, expressiveness, and generalization. Existing adaptive rank methods address this problem mainly through carefully designed importance scores constructed from gradient-derived sensitivity and uncertainty measures, without an explicit statistical interpretation. In this paper, we formulate LoRA rank allocation as a statistical hypothesis testing problem and propose StatLoRA, a statistical inference-based rank allocation method. StatLoRA associates each LoRA component with a test statistic and uses estimated p-values to determine which components should be retained or pruned under a prescribed rank budget. The proposed testing procedure is supported by our central limit theory for
stochastic optimizer trajectories. In particular, we establish asymptotic normality for a broad class of commonly used optimizers in deep learning, including AdamW, and derive the corresponding asymptotic distributions for the proposed component scores used in hypothesis testing. We evaluate StatLoRA on LoRA fine-tuning of DeBERTaV3-base, BART-Large, and Qwen2.5-7B across natural
language understanding, natural
language generation, and question answering tasks. Experiments show that StatLoRA achieves comparable or better performance than vanilla LoRA, AdaLoRA, and IGU-LoRA under matched rank budgets. Sensitivity analyses and empirical diagnostics further support the stability of the proposed hypothesis-testing-based allocation rule and provide empirical evidence for the asymptotic theory of component scores.
Read the full abstract ▾
Machine Learning (Statistics) · Cross-listed from q-fin.PR
Quantum Kernels and the Cross-Section of Stock Returns: Anatomy of a Vanishing Advantage
Junchi Shen
Do
quantum kernels improve cross-sectional stock return prediction? We run a controlled horse race on the Chinese A-share
market in which a
quantum fidelity kernel, a projected
quantum kernel, and a classical RBF control share identical training subsamples, solver, and tuning budgets, so that only the kernel is exchanged. On the main evaluation – a point-in-time universe and 170 walk-forward windows (2012-2025) – no
quantum advantage exists: the fidelity kernel is indistinguishable from its RBF control ($\Delta$IC $=+0.005$, $p=0.42$), and a $2\times2$ design crossing kernel type with training budget (a Nystrom extension to the full ~38,000-observation windows) shows
quantum kernels matching, but never beating, equal-budget linear models; after family-wise correction no pairwise difference among eleven models is significant, with point estimates favoring penalized linear regressions throughout. We then document how the opposite conclusion arises: a 60-window evaluation on a universe screened with full-sample information makes the same
quantum kernel appear dominant on stability criteria and significantly better than neural baselines. Interaction characteristics from the anomalies literature help nothing,
quantum or classical; a widened bandwidth grid reveals an interior optimum rather than the near-classical endpoint a coarse grid suggests; and the
geometric difference, while large throughout ($g \gg 1$), does not predict out-of-sample gains ($\rho=-0.20$). We propose protocol standards – kernel-swap controls, budget-equalized comparisons, point-in-time universes, and multiplicity-robust inference – for empirical claims of
quantum advantage in finance.
Read the full abstract ▾