Statistics Theory
Stochastic Inversion of Multivariate Uniform-Distribution-Preserving Transformations
Alexander J. McNeil and Johanna G. Nešlehová
A multivariate transformation of the unit cube with component transformations that are piecewise continuously differentiable and uniform distribution preserving (udp) is considered. A
stochastic inverse transformation is defined using randomization to overcome the non-injective nature of the udp transformations. The inverse transformation preserves the uniform margins of a random vector distributed according to a copula and yields different copulas for different randomizations. A copula density transformation result for the multivariate
stochastic inverse is proved and illustrated in the bivariate case.
Read the full abstract ▾
Statistical Methodology
Recovering Latent Structures after Variational Bayesian Variable Selection: Fit Assessment and Factor-Number Selection in Partially Exploratory Factor Analysis
Jinsong Chen and Yi Jin
In partially exploratory factor analysis (PEFA), the loading structure and factor numbers are weakly specified. The regularized variational approximation for partially confirmatory factor analysis (PCFA VA) recovers this structure via
Bayesian variable selection, using spike and slab priors to assign inclusion probabilities to unspecified loadings. This research introduces a post selection assessment framework for this approach. We convert converged solutions into covariance models using either hard selection (thresholding probabilities into a sparse pattern) or soft selection (retaining them as weights for effective parameter counts). We derive the resulting degrees of freedom, absolute fit diagnostics (RMSEA, SRMR, CFI, TLI), and relative criteria (AIC, BIC, ELBO). To determine factor numbers, we propose a scale free gain rule with a sustained drop guard. Simulations show absolute indices successfully track loading recovery and flag under factoring. While raw criteria over factor, our gain rule accurately recovers true dimensionality, with the ELBO variant proving most robust. Finally, a 100 item PID 5 example demonstrates that our model fits better than a confirmatory 25 facet model and concordantly recovers major structures across disjoint specifications.
Read the full abstract ▾
Statistical Methodology · Cross-listed from cs.CL
From Text to Parameters: Predicting Item Parameters from Embedding Regularization with Reliability and Design Ceilings
Shi-Ting Chen and Jinsong Chen
Newly developed items must ordinarily be field tested before their psychometric properties are known, creating a cold start problem for item calibration. Predicting item parameters from features is a long standing measurement problem dating back to the Linear Logistic Test Model; modern text
embeddings now automate the design
matrices traditionally specified by hand. We propose an evaluation framework combining regularized regression on item text
embeddings, repeated cross validated R squared reported with its resampling standard deviation, and two performance upper bounds: a reliability ceiling derived from parameter standard errors, and a design ceiling derived from simulation based power calibration. Applying this framework to a mathematics item bank (EEDI) and a medical licensure
benchmark (BEA 2024), we find that item difficulty is highly predictable from text (repeated cross validated R squared = 0.53, or about 57% of its reliability ceiling), whereas discrimination and pseudo guessing appear less predictable. However, evaluating these results against our ceilings reveals that this apparent hierarchy stems from target reliability rather than text signal strength: text uniformly recovers 57 to 63% of the reliable variance across difficulty targets, whereas the 3PL pseudo guessing parameter has a reliability ceiling near zero, making it an unviable target at current precision. On BEA,
embedding based regression matches leaderboard RMSE despite explaining almost no variance, highlighting the critical need for scale free metrics and explicit ceilings in benchmarking. Finally, we show that a single train and test split can inflate apparent accuracy by 0.1 to 0.15 in R squared, underscoring the necessity of repeated cross validation for calibration support applications and future
benchmark construction.
Read the full abstract ▾
Statistics Applications
Which Regularized Propensity-Score and Doubly Robust Methods Are Best Calibrated When Exposures or Outcomes Are Rare? A Plasmode Study of Proxy-Based Confounding Adjustment
M. Ehsan Karim and Wanqing Hu
Purpose. Confounding adjustment in health-care database studies screens large proxy libraries where events per variable are low, straining standard propensity score (PS) methods, and many regularized variable-selection strategies exist (outcome-adaptive LASSO [OAL], group LASSO/GLiDeR, highly adaptive LASSO [HAL]). Yet few comparisons have varied exposure prevalence within such a selection menu, and none pairs it with doubly robust estimation, compute accounting, and a null-RD truth anchor. Methods. We conducted a plasmode simulation anchored on National Health and Nutrition Examination Survey data (2013-2018; 25 investigator-specified
covariates, 142 prescription-derived proxies), comparing ten pipelines combining these strategies with inverse probability of treatment weighting (IPTW) and targeted maximum likelihood estimation (TMLE). Three scenarios were evaluated under a known null (true risk difference, RD = 0): frequent, rare-exposure, and rare-outcome. We report bias, standard error (SE), relative error, 95% coverage, and runtime. Results. HAL (G-Computation) had near-zero bias but highly concentrated estimates, giving near-unity coverage and large relative error (106-186%). OAL (IPTW), GLiDeR, and HAL (TMLE) were best calibrated, whereas the regularized-LASSO TMLE pipelines under-covered modestly (91-93%) in the rare scenarios. Under rare exposure, LASSO-IPTW had the largest bias and inflated SE and over-covered (conservatively), problems that TMLE removed. On real data, methods agreed (RD approximately 0.07-0.085). Runtimes spanned <1 s to >16 h. Conclusions. Under a null
benchmark, pairing outcome-aware selection (OAL, GLiDeR) or doubly robust estimation (TMLE) with regularized models best balanced bias, calibration, and robustness to rarity. The rare-exposure arm exposed the largest gaps; method choice should weigh the prioritized metric against compute.
Read the full abstract ▾
Machine Learning (Statistics) · Cross-listed from cs.LG
Eigenbasis-Independent Learnable Spectral Positional Encodings for Directed Graphs via Hermitian Block Krylov Subspaces
Jiaqing Xie and Yuxin Wang
Spectral positional encodings (PEs) for directed graphs face two obstacles:
magnetic Laplacians require an $O(n^3)$ Hermitian eigendecomposition per potential, and their complex eigenvectors are defined only up to
unitary gauge, which prior work handles with basis-invariant architectures. We propose learnable spectral PEs of the form $h_\theta(A_q)\,R$, where $A_q$ is a normalized
magnetic operator, $h_\theta$ a learnable scalar spectral response, and $R$ a block of random probes. Because the PE is a
matrix function of the operator, it is gauge-invariant by construction. We compute it in a Hermitian block Krylov subspace from sparse
matrix–vector products only, prove that $k = O(\log(1/\varepsilon))$ block steps suffice uniformly over heat–resolvent response families, and give a covering-number argument for why low-dimensional structured families generalize where free per-
eigenvalue weights overfit. On a directed SBM whose symmetrization is uninformative by construction, direction-blind PEs stay at chance while
magnetic Krylov PEs converge to the exact-eigendecomposition oracle as the depth grows. The same probes yield gauge-invariant pairwise features with $1/\sqrt{s}$ Monte-Carlo error, and the undirected $q{=}0$ case improves heterophilous
benchmarks over no-PE and
polynomial baselines.
Read the full abstract ▾
Machine Learning (Statistics) · Cross-listed from math.PR
Local large deviations for linear-region growth in random piecewise-linear networks
Recep Özkan and Christian Hirsch
We study a random compositional model for the growth of affine regions in deep piecewise-linear networks. The model is generated by i.i.d.\ perturbations of the symmetric height-one tent map, and the main observable is the number \(N_n\) of affine pieces after \(n\) layers. We prove the existence of a submultiplicative pressure for \(N_n\), yielding exponential upper bounds for both tails of \(n^{-1}\log N_n\). The same argument applies to abstract submultiplicative complexity observables and gives higher-dimensional extensions for convex-polytopal affine-cover counts and worst-line affine-piece counts. Since the true branch count has no matching supermultiplicative inequality, lower bounds require a separate certified construction. We introduce a finite-state defect process that records branches whose future splitting can be guaranteed, and use bridge words to obtain constructive upper-tail lower bounds. In a uniformly favorable small-noise regime, this process is governed by a companion
matrix whose Perron root tends to \(2\), implying eventual exclusion of lower tails below \(\log 2-\xi\).
Read the full abstract ▾
Machine Learning (Statistics)
Tensorized algorithms and scalable filtering methods for hidden Markov and factorial hidden Markov models
Roxana Barrios and Ioannis Sgouralis
A common method for the representation and analysis of time-series data is the hidden Markov model (HMM), where each observation is associated with a hidden state that evolves over time. However, many real-world systems are influenced by multiple independent factors, which are more naturally represented by factorial hidden Markov models (fHMM), where several hidden Markov chains jointly generate the observed data. Although an fHMM provides a richer and more realistic representation of many real-world systems, it can be reformulated as an equivalent HMM, but with a significantly larger state-space, leading to a severe increase in computational cost. In particular, the forward filtering
algorithm, which is central to evaluation, decoding, and estimation tasks, becomes prohibitively expensive even for small systems. This work focuses on developing scalable methods for time-series analysis using tensor
algebra to exploit the multidimensional structure of fHMM directly, without constructing intermediate HMM representations. Our novel filtering approach significantly improves computational performance and enables the efficient analysis of large systems and
datasets, extending the scope of fHMM and providing a practical framework for data intensive applications.
Read the full abstract ▾
Statistics Theory
A Study on Cumulative Residual Extropy of Linear Consecutive k-out-of-n:G Systems
Aman Pandey and Chanchal Kundu
In this article, we investigate the cumulative residual extropy associated with linear consecutive k-out-of-n:G systems, which play an important role in reliability theory and engineering applications. We first derive explicit expressions for the proposed measure and examine the behavior of cumulative residual extropy under a variety of
stochastic orderings. In addition, several bounds and meaningful results of the characterization are established. Moreover, we also introduced the dynamic version of the cumulative residual extropy and explored the relationship between the proposed dynamic version and the mean residual life function. Fromaninferentialperspective, wedevelopanonparametricestimationprocedure for the cumulative residual extropy and establish the corresponding consistency properties of the
estimator. The finite-sample performance of the proposed
estimator is further investigated through extensive Monte Carlo simulation studies under different parametric settings and validated through a real
dataset.
Read the full abstract ▾
Statistics Applications
Multi-Trigger Crypto CAT Bonds with On-Chain Settlement: Valuation and Optimal Design
Yue Wang, Yijia Li, Maochao Xu et al. (+1 more)
Cryptocurrencies have experienced repeated large-scale losses from protocol exploits and exchange breaches, exposing insurers and investors to severe operational risks. This paper develops an
equilibrium pricing framework for catastrophe bonds tailored to the cryptocurrency ecosystem. We introduce a double-trigger structure that jointly captures short-term catastrophic shocks and longer-term systemic deterioration. To model the multi-risk environment, we incorporate dual dependence, combining dependence across triggers with multivariate dependence among financial risk factors through vine copulas. Beyond expected prices, we characterize the full distribution of discounted cash flows and return rates, enabling risk-sensitive metrics such as Value-at-Risk and Tail Value-at-Risk. Furthermore, we propose an on-chain settlement architecture where calibrated payout functions are embedded directly into smart contracts. This design eliminates basis risk associated with settlement delays and minimizes the agency costs inherent in traditional intermediation. Our results demonstrate that multi-trigger crypto CAT bonds offer a statistically robust and economically efficient vehicle for transferring systemic digital asset risks to capital
markets.
Read the full abstract ▾
All authors Yue Wang, Yijia Li, Maochao Xu, Xianyue Li
Statistical Methodology
Compensator-based inference for signal detection under unknown background: the binned data case
Aritra Banerjee and Sara Algeri
The problem of signal detection under an unknown background can be framed as one of inferring the weight of a mixture model with one misspecified component. Banerjee and Algeri (2026) show that, for this problem, the conservativeness of the inference is entirely determined by one single parameter, called the compensator. They demonstrate that, when the data are independent and identically distributed, an inferential approach based on the compensator circumvents the need to estimate the density of the misspecified component and the associated challenges. The main purpose of this manuscript is to broaden the scope of such an approach and extend it to the case in which, as is often encountered in modern experiments in physics and astronomy, the data consist of Poisson counts observed over a large number of bins.
Read the full abstract ▾
Statistical Methodology
Transfer Learning for Linear Discriminant Analysis with a Shared Classification Signal
Yonghan Zhang, Yimeng Fan, Wenya Luo et al. (+1 more)
This paper studies transfer learning for linear discriminant analysis in high-dimensional two-class classification. We consider one target domain and several source domains, where the mean difference in each domain is decomposed into a deterministic common component and a domain-specific random deviation. The common component represents a shared classification signal across domains, while the random deviation captures domain-specific heterogeneity. Under spiked covariance models, we derive deterministic limits for the target-domain Gaussian-calibrated error of weighted transfer classifiers under both homogeneous and heterogeneous covariance settings. These limits quantify the effects of the shared signal, domain-specific variation, dimension-to-sample-size ratios, and spike structures on transfer performance. They further lead to oracle transfer weights and consistent data-driven plug-in
estimators. We also characterize the intercept bias induced by unbalanced target-domain class sample sizes and provide an asymptotically optimal correction.
Read the full abstract ▾
All authors Yonghan Zhang, Yimeng Fan, Wenya Luo, Jiang Hu
Machine Learning (Statistics) · Cross-listed from math.OC
Mathematical methods of reinforcement learning
Denis Belomestny, Alexander Gasnikov, Egor Gladin et al. (+5 more)
Reinforcement learning (RL) is increasingly grounded in tools from probability, optimization, and operator theory. This survey organizes the mathematical structures that underpin the design and analysis of modern
algorithms in RL. We begin from Markov decision processes (MDPs) and the Bellman operators, emphasizing contraction mappings, monotonicity, and fixed-point theory that yield convergence guarantees and rates for value and policy iteration, and temporal-difference schemes. We then develop the optimization perspective:
stochastic approximation and martingale methods, convex duality and the role of regularization linking mirror/proximal methods. Function approximation is treated through linear and non-linear settings, covering stabilization, error decomposition, and sample-complexity via concentration inequalities for dependent data and mixing processes. We further cover off-policy evaluation/learning, constrained RL and constrained MDPs (CMDPs). Throughout we unify algorithmic templates under common operator and variational lenses, highlighting both finite-sample bounds and asymptotic results. Our presentation is intended to provide a unified mathematical entry point for researchers in probability, optimization, and statistics interested in reinforcement learning.
Read the full abstract ▾
All authors Denis Belomestny, Alexander Gasnikov, Egor Gladin, Alexey Naumov, Artemy Rubtsov, Yuri Sapronov, Daniil Tiapkin, Nikita Yudin
Statistics Applications
A Hierarchical Multilevel Inference Framework for Structural Cardiovascular Risk Modeling: County-Scale Analysis of Cardiovascular Mortality in Ohio and Pennsylvania (1999-2020)
Christopher Blaszczak-Boxe, Jose Perez-Chavez, Sium Gebremeriam et al. (+3 more)
Cardiovascular mortality is shaped by interacting demographic, environmental, and structural processes operating across multiple spatial scales. Conventional epidemiologic analyses often rely on aggregate summaries or single-model formulations that obscure hierarchical variation and contextual heterogeneity. We present a reproducible multilevel statistical inference framework integrating Normal (age-adjusted), Poisson (count-based), and population-offset Poisson models to quantify cardiovascular mortality across nested geographic units while separating demographic effects from structural variation. The framework was applied to county-level mortality data from Ohio and Pennsylvania (1999-2020) using MLwiN hierarchical models for seven cardiovascular disease (CVD) subtypes. Fixed effects included year, sex, race, PM2.5, and O3, while county-level random intercepts captured spatial heterogeneity. Complete model equations are provided in the Supplementary Material. The framework reveals complementary perspectives on cardiovascular risk unavailable from a single model. Age-adjusted mortality declined more rapidly in Pennsylvania than Ohio, whereas Poisson models identified post-2010 stagnation or reversal for several CVD subtypes. Black populations experienced elevated mortality risks, males exhibited higher mortality than females, and PM2.5 showed stronger associations with ischemic and hypertensive mortality in Pennsylvania. Population-offset models reduced unexplained variance while preserving county-level structural disparities. Beyond cardiovascular epidemiology, this work introduces a generalizable hierarchical statistical framework for structurally nested health systems. The methodology provides a scalable foundation for disease surveillance, environmental health assessment, health equity research, reproducible statistical analysis, and AI-assisted scientific inference.
Read the full abstract ▾
All authors Christopher Blaszczak-Boxe, Jose Perez-Chavez, Sium Gebremeriam, King-Fai Li, Yuk L. Yung, Mohammad Russel
Statistical Methodology
Causal Inference for Case Studies in Behavioral Health
Shane Sparkes
We present a framework for causal inference in behavioral health case studies – and observational N=1 settings more generally – under unmeasured confounding. The framework rests on a class of causal estimands, termed $\Omega$ estimands, defined as contrasts of functions of an outcome variable's support rather than its distribution. Because such estimands do not depend on how probability is distributed over supports, they are insensitive to the confounding that limits other methods. We prove that, in a structural causal model, the observational and interventional supports of an outcome coincide under a single assumption – positivity – without any requirement that confounders be known, measured, or adjusted for. Two optional conditions extend the framework: one licensing a client's recalled baseline as a stand-in for sparsely measured baseline periods, and one connecting support contrasts to conventional mean contrasts through an expected-average identity. We adopt a subjectivist (de Finetti) interpretation of probability and situate the framework within mandates for measurement-based care. A case study of cognitive behavioral therapy for anxiety illustrates an elementary approach a provider can use.
Read the full abstract ▾
Statistics Applications
Learning Item Embeddings and Hyperparameters for IRT Calibration via Monte Carlo EM
James Sharpnack and Kai-Ling Lo
High-stakes computerized adaptive tests (CATs) must continually calibrate new items in their item bank. When an item is new, few responses are available, so item parameter estimates – and thus test scores – are poor. Item features and explanatory item response theory (IRT) models mitigate this by folding item content into calibration. Neural IRT models, whose item parameters are neural-net outputs, are powerful, but tuning hyperparameters and architectures in real time while a CAT is scoring is impractical and threatens validity. We propose a pre-launch step that fits a neural net to produce low-dimensional item
embeddings, so the production system can use a simple linear explanatory IRT model on top of them. We use a neural parameterization of the 3-parameter logistic (3PL) model in which a feature network maps each item's content features to a representation $h_j = z(x_j) \in \mathbb{R}^d$, from which the discrimination and difficulty $(a,b)$ follow generalized linear forms; the guessing parameter $c$ is fixed to a global constant to avoid identifiability issues. The feature network and latent abilities $\theta$ are fit jointly via Monte Carlo Expectation-Maximization (MCEM), with no separate ability-estimation or pre-calibration stage. Using an item-split protocol that holds out entire items to simulate feature-only evaluation, we apply this to two Duolingo English Test practice task types – yes/no vocabulary and vocabulary-in-context – searching over feature sets, architectures, and dimensions $d$. A shallow two-layer ReLU network with $d=6$ and hand-engineered scalar features matches or beats larger architectures on held-out items for both. This is a first step toward a compact, content-derived item
embedding for the Scalable Parametric Item Calibration Engine (SPICE), the fully
Bayesian engine at the core of the S2A3 adaptive-testing system.
Read the full abstract ▾
Machine Learning (Statistics)
Finding a stationary point of a stochastic convex problem
Felipe Areces, John Duchi and Malo Sommers
We consider the problem of finding stationary points for
stochastic convex optimization problems. Rather than surrogates to stationarity, such as a proximity-to-stationarity guarantee or small gradient of the Moreau envelope, we ask for a stronger notion: that the subdifferential of the objective actually contains a small element. This criterion is non-trivial, because subdifferentials of convex functions fail to converge uniformly, even in arbitrarily small neighborhoods of the optimum. Our convergence guarantees rely on dimension theory to decompose the graph of the subdifferential of a convex function, showing how
stochastic sampling preserves "pieces" of these graphs, and allowing effective application of proximal-point-like methods.
Read the full abstract ▾
Machine Learning (Statistics) · Cross-listed from cs.LG
Best-Arm Identification with Generative Proxy
Tianyi Ma, Hanzhang Qin, Ruihao Zhu et al. (+1 more)
Best-arm identification is a canonical model for data-driven decision-making, but in many applications each reward observation is costly. Motivated by the growing availability of cheap predictions from machine learning and large
language models, we study fixed-confidence best-arm identification in which each costly reward pull is paired with a cheap but correlated proxy score. The marginal mean of the proxy can be estimated offline and is treated as known, whereas its correlation $\rho$ with the reward, which governs how much the proxy helps, is unknown and must be learned online in pair with real rewards. We show that a control-variate adjustment turns this model into a heteroscedastic identification problem whose oracle sample complexity improves by residual variance $1-\rho^2$. The central difficulty is that the correlation must be learned from the same costly samples that identification consumes online, and that a plug-in estimate of the residual variance is anti-conservative and can compromise correctness. We propose PROBE (PRoxy OLS for Best-arm Exploration), a phase-elimination
algorithm that directly maintains an upper certificate on the residual variance with an ordinary least squares fit, whose exact chi-square law keeps the certificate valid regardless of the unknown correlation. We prove that PROBE is $\delta$-PAC and attains the known-correlation oracle sample complexity up to a constant multiplicative factor and a constant additive calibration cost. The guarantee extends to the $(\epsilon,\delta)$-PAC setting under minimal changes to the
algorithm. Numerical experiments on synthetic instances and on an auto-loan pricing replay with large
language model and tabular proxies confirm that the sample savings of PROBE scale with the strength of the reward-proxy correlation, exactly as the theory predicts.
Read the full abstract ▾
All authors Tianyi Ma, Hanzhang Qin, Ruihao Zhu, Jierui Zuo
Statistics Theory
Gaussian comparison above the median
Colin B. Fogarty
We prove a Gaussian comparison inequality for closed convex sets with reference probability at least 1/2. For centered Gaussian vectors whose covariance
matrices are ordered in the Loewner sense, the smaller covariance law assigns at least as much probability as the larger covariance law to every closed convex set with measure at least 1/2 under the larger covariance. More generally, we show that convolving a nondegenerate Gaussian law with any independent centrally symmetric distribution cannot increase the probability of a closed convex set when the convolved probability is at least 1/2. This provides a one-sided analogue of Anderson's
Theorem for Gaussian measures. As a statistical application, the result justifies one-sided and order-restricted inference using conservative covariance
estimators at significance levels below 1/2 for test statistics whose acceptance regions are closed and convex but not necessarily symmetric.
Read the full abstract ▾