Machine Learning (Statistics) · Cross-listed from cs.CY
From Prediction to Explainable Provider Behavior Profiles for Fraud, Waste, and Abuse Review
Yubin Park and Evan Brociner
Claims data can show that provider behavior changed but cannot by itself explain why. Fraud, waste, and abuse (FWA) review requires identifying material behavior, locating the codes and dollars driving it, and testing plausible explanations. Forecast residuals conflate growth, service-line shifts, code maintenance, and incomplete observation with potentially concerning behavior. We instead formulate provider review as a descriptive representation problem: observed amount $y_{ijt}=s_{it}p_{ijt}$, where $s_{it}$ is provider scale and $p_{ijt}$ is procedure composition. The profile records scale history, effective-dated code lineage, clinical-family shares, first-use events, billing context, and Medicare-versus-client differences. An optional rank-32 nonnegative factorization of procedure co-occurrence adds a fixed semantic geometry for similarity and
retrieval. The profile surfaces evidence for review without inferring intent or adjudicating FWA, and is one engine within Falcon's broader review system. In a ten-quarter proprietary Medicare Carrier and DME build (1.27 million providers; 9.2 million provider-quarter profiles through 2026~Q2), the semantic dictionary covers 3,641 procedures and raises recall at 10 from 36.0% to 44.4%; for high-cost rare events, recall at 50 is 56.1% versus zero for popularity. Under the governed eligibility contract, 414,093 providers enter the national review population, with 81.8% and 90.8% remaining eligible across adjacent quarters. Replication across eight client panels preserves 86.9–95.2% amount-weighted semantic coverage. Transparent descriptions thus form the core, with learned representations adding optional semantic context.
Read the full abstract ▾
Statistics Theory · Cross-listed from math.LO
Human and AI-generated texts between modal logic and statistics
Simone Cuconato and Donato Ferrari
We read the geometry of semantic neighbourhood graphs as modal logic and give that reading a statistical form, in order to make precise the structural difference between human and machine-generated text. Texts are the worlds of a finite frame whose accessibility is the $k$-nearest-neighbour relation of a
transformer embedding, and the
symmetry, transitivity, Euclideanity and seriality frequencies of the two subcorpora are shown to be degrees of validation of the modal axioms $\mathsf{B}$, $\mathsf{4}$, $\mathsf{5}$, $\mathsf{D}$. Each degree is at once the proportion of instances of a rule that the subframe licenses in Negri's labelled calculus $\mathsf{G3.K}$ and a plug-in estimate of a population probability. A
prompt-balanced comparison finds consistently higher artificial degrees for $\mathsf{4}$ and $\mathsf{5}$. We add a degree of groundedness and of situatedness, and recast the licensing reading in Cuconato's one-sided sequent-style tableaux, where each degree becomes a rate of set membership.
Read the full abstract ▾
Statistics Applications
Projection, Memory, and the Validity of Scalar Early-Warning Signals: A Schur–Volterra Theory with an AMOC Application
Mauricio Herrera-Marín
Early-warning signals are usually computed from one or a few observables, although the underlying dynamics are high dimensional. Projection creates a structural ambiguity: the same scalar record may reflect spectral loss of stability, hidden-state
memory, nonnormal amplification, a turning point of a physical balance, or a combination of these. We develop a unified operator theory that makes these alternatives explicit. For a resolved-hidden block linearization we derive exact Volterra reductions, finite and diffusive Markovian liftings, and a Schur-resolvent factorization of the stability problem, distinguishing three notions of
memory: realized pathwise, structural Schur return, and finite-horizon projected. A covariance
theorem gives sufficient conditions for a scalar to inherit critical slowing down from a real multiplier approaching the unit circle: spectral separation, bounded eigenvector conditioning, observability of the critical mode,
stochastic excitation of that mode, and quasi-stationary forcing. We then prove failure mechanisms: a critical mode can be invisible or unexcited; an oscillatory crossing need not raise lag-one correlation; a nonnormal family can produce diverging scalar variance with a fixed stable spectrum; a physics-based turning point need not coincide with a spectral boundary; and finite-horizon data cannot identify long
memory uniquely. The theory is illustrated with a 4400-year CESM AMOC hysteresis experiment. EOF1 alone detects altered susceptibility, but EOF1-EOF2 is the smallest resolved space revealing changed Schur return and projected
memory after recovery; F_ovS reaches its minimum 26 years before collapse while the modal margin does not decrease toward zero: the two diagnostics probe complementary mechanisms. The application is mechanistic and single-trajectory; no validated early-warning signal is claimed.
Read the full abstract ▾
Statistical Methodology
Backward Bayesian Outcome Weighted Learning
Emmanuel M. Rockwell, Michael R. Kosorok and Nikki L. B. Freeman
A central objective of precision medicine is learning optimal dynamic treatment regimes (DTRs) from data. Classification-based methods, like outcome weighted learning (OWL) for single-stage and backward OWL (BOWL) for multi-stage problems, leverage machine learning to directly learn optimal DTRs. However, these methods lack a natural way to quantify uncertainty in treatment decisions at the individual level. In this paper, we extend
Bayesian OWL, a
Bayesian reformulation of OWL, to the multi-stage setting. We call this method backward
Bayesian outcome weighted learning (BBOWL). Like BOWL, our method directly learns an optimal DTR via backward induction, and unlike existing methods, our approach propagates uncertainty backward through the DTR learning process and provides uncertainty quantification of individualized treatment recommendations. We present a theoretical justification of BBOWL and verify its performance via a simulation study.
Read the full abstract ▾
Machine Learning (Statistics) · Cross-listed from cs.LG
Agentic Bayesian Optimization through Surrogate-Augmented Autoresearch
Paul Brunzema, Louis Tiao, Nhat Le et al. (+3 more)
Bayesian optimization (BO) has become the standard tool for sample-efficient optimization and owes its efficiency to uncertainty-aware search driven by generic statistical priors. Richer domain priors can improve BO in principle, but encoding them through tailored kernels or problem structure is difficult and rarely done in practice. LLMs can help sidestep this difficulty by making informal priors from natural
language, code, and documentation directly available to the optimizer. However, existing LLM-based BO methods either insert the LLM into a fixed role (surrogate, acquisition proxy, or configuration interface) or hand it broad control, sacrificing the systematic exploration that makes BO reliable. We introduce agentic
Bayesian optimization: a paradigm in which an LLM
agent is the central decision maker in the BO loop while a
Bayesian backend provides the uncertainty-aware optimization substrate. The
agent configures the problem, queries the backend, selects and commits evaluations, and can revise the optimization strategy during the run by tightening bounds, switching acquisition functions, proposing targeted evaluations, or even reframing the problem following new instructions or observed evidence. We instantiate this idea in Sara, a surrogate-augmented autoresearch
agent, and lenz, a modular BoTorch-based backend that the
agent can inspect and modify through a structured interface. Across synthetic and real-world
benchmarks, Sara preserves the reliability of state-of-the-art BO without prior knowledge, outperforms LLM-based baselines, and uses natural-
language priors to improve beyond standard BO. We further demonstrate the practical value of agentic BO in dynamic settings, where Sara reconfigures the full optimization problem on the fly as requirements change, a capability not previously available in standard BO.
Read the full abstract ▾
All authors Paul Brunzema, Louis Tiao, Nhat Le, Kevin De Angeli, Yao Xuan, Djordje Gligorijevic
Statistical Methodology
Multi-output Orthogonal Gaussian Processes for Noisy Simulator Outputs
Evan C. Barnett and Moses Y.-H. Chan
Computer simulations can model physical processes but are often too expensive to produce enough runs for calibration, sensitivity analysis, prediction, and uncertainty quantification. As a result, statistical surrogates are frequently used as cheaper alternatives that can be trained on a small number of simulation runs. Gaussian processes (GP) are well-suited as surrogates, as they provide flexible, nonlinear regression and closed-form uncertainty quantification. However, standard GPs are insufficient replacements for more complex simulators, such as
stochastic or multi-output simulators. In addition, typical GPs also struggle to separate fitted regression coefficients from residual process variation. We introduce multi-output orthogonal Gaussian process (MOOGP) to tackle the problems mentioned above. This paper has three main contributions: (i) a definition of orthogonality for multi-output Gaussian processes, (ii) a construction that enforces orthogonality by conditioning each covariance function, and (iii) a structured likelihood formulation that significantly improves computational scaling. In a trend-recovery illustrative example, MOOGP recovers the true trend while the non-orthogonalized counterpart fails to do so, to the extent it reverses the sign of the trend. Numerical experiments and an application in heavy-ion collision simulations further demonstrate the interpretability and predictive advantage of MOOGP.
Read the full abstract ▾
Statistical Methodology
Extensions in Semiparametric Geostatistical Models
Maíra Soalheiro, Marcos Oliveira Prates, Victor Hugo Lachos et al. (+1 more)
In spatial statistics, the incorrect selection of an appropriate covariance function may lead to inference errors and confidence underestimation. Motivated by such restrictions, we introduce and evaluate a flexible semiparametric approach for estimating spatial covariance functions based on Bernstein
polynomials. The proposed formulation is general and applicable to classes of models that incorporate latent spatial effects in georeferenced data, such as Spatial Generalized Linear Mixed Models. Empirical validation was conducted via Monte Carlo simulations, and model fitting was performed using
Bayesian inference via Markov chain Monte Carlo. Simulated scenarios demonstrated the model's ability to recover structural covariance configurations with low bias and high parameter precision. The practical applicability of the methodology was tested using real abundance data for American Robin (Turdus migratorius) from the North American Breeding Bird Survey. The proposed model, featuring a Negative Binomial structure, yielded satisfactory results, efficiently capturing the overdispersion inherent in the count data. The estimated range parameter of 381.48 km revealed that the species' spatial dependence operates at a regional scale, suggesting that unobserved ecological processes act homogeneously within this radius of environmental influence. Additionally, predictive validation using an independent sample (n_pred = 34) demonstrated the model's strong generalization capability via
Bayesian Kriging, producing point projections that closely matched observed values and well-calibrated prediction intervals. It is concluded that the proposed approach represents a robust methodological advancement, establishing itself as a flexible and efficient tool.
Read the full abstract ▾
All authors Maíra Soalheiro, Marcos Oliveira Prates, Victor Hugo Lachos, Fábio Nogueira Demarqui
Machine Learning (Statistics)
A reproducible and extensible framework for benchmarking competing risks survival models
Begoña B. Sierra, Colin McLean, Peter S. Hall et al. (+2 more)
A wide range of statistical and machine learning methods have been proposed for survival analysis with competing risks, where the occurrence of one event (i.e., cancer death) precludes the occurrence of other events (i.e., cardiovascular disease death). Despite these methodological advances, their systematic evaluation and adoption are limited by the lack of comprehensive, reproducible and extensible benchmarking frameworks. We developed an open-source benchmarking framework for competing risks models that enables their systematic comparison across multiple
datasets under different aspects of performance; calibration, discrimination, overall prediction error and clinical utility. We additionally introduce an extension of SHAP for competing risks, allowing model-agnostic interpretability of
covariates contributions over time. All our code is publicly available via GitHub:https://github.com/BBolosSierra/CompRisksBenchmark
Read the full abstract ▾
All authors Begoña B. Sierra, Colin McLean, Peter S. Hall, Sarah Friedrich-Welz, Catalina A. Vallejos
Statistical Methodology
Bridging extrinsic and intrinsic variable importance
Yucheng Zhao and Brian D. Williamson
Variable importance may describe either intrinsic predictive information in a population or extrinsic importance for a fitted prediction rule. Quantifying the uncertainty in variable importance estimates is critical for interpretation. Methods for estimating intrinsic variable importance (we will refer to these as VIMP) and the minipatch leave-one-
covariate-out procedure (MPLOCO) target intrinsic and extrinsic importance, respectively, and provide methods for computing standard errors. These two approaches have a shared structure, comparing prediction performance with and without features, but the relationship between them has not been formally characterized. We establish conditions under which the two perspectives align. Under squared-error loss, if the fitted full and reduced learners converge to their oracle counterparts sufficiently fast, then MPLOCO is asymptotically equivalent to VIMP. We provide further conditions extending this result to general loss functions and formalize grouped MPLOCO for potentially overlapping feature groups. Through simulations, we show that VIMP and MPLOCO agree most closely when the fitted learner is well aligned with the data-generating mechanism. In a high-dimensional grouped simulation, both procedures identified the signal-containing groups. In an analysis of HIV-1 VRC01 neutralization sensitivity, both methods placed the same three biologically relevant feature groups among their highest-ranked groups. These results clarify when intrinsic and extrinsic importance can be interpreted similarly and when they provide complementary information.
Read the full abstract ▾
Statistics Theory
Regularized-Likelihood Deconvolution with Posterior-Density Reconstruction
Marco Di Marzio, Stefania Fensore, Chiara Passamonti et al. (+1 more)
Density deconvolution is an ill-posed inverse problem because recovering the latent density amplifies high-frequency variation in the observed data. We propose a two-stage likelihood procedure. The first
estimator maximizes the convolution likelihood over a regularized Gaussian-mixture sieve; the second treats this fit as an empirical prior and averages the fitted conditional latent densities. Under fixed-model misspecification, the
estimators generally have different population targets. For bounded local multiplicative perturbations of the latent density, the population posterior map is locally contractive in chi-square divergence under identifiable convolution. Under correct finite-dimensional specification, however, reconstruction adds a nonnegative first-order variance component. For growing sieves, we separate observed-domain estimation, inverse stability, and posterior empirical variation. We derive explicit rates under Gaussian error and recover the classical ordinary-smooth exponent, up to logarithmic factors, with a constructive verification for Laplace error. Simulations and a Framingham blood-pressure application provide empirical performance evidences.
Read the full abstract ▾
All authors Marco Di Marzio, Stefania Fensore, Chiara Passamonti, Serena Pulcini
Statistical Methodology
An Optimal False Discovery Rate Controlling Procedure for Changepoint Detection
Louis Davis and Guenther Walther
We consider the problem of detecting and localizing a growing number of changepoints in a sequence of independent observations. We propose a new method, Lean Bonferroni Detection - False Discovery Rate (LBD-FDR), which produces a set of localized regions in the data sequence where, in expectation, a high proportion of them contain a changepoint. LBD-FDR guarantees control of the false discovery rate in a wide range of distributional settings, including the challenging case of independent non-parametric and heavy-tailed data. For independent Gaussian sequences, we derive conditions on changepoint arrangements where the method consistently detects all changepoints with a large enough signal while simultaneously being unaffected by those that are undetectable, and we show that LBD-FDR obtains the optimal detection constant in certain regimes. Moreover, we derive the settings where our method is more powerful than the minimax optimal Type I error controlling method. We finally develop a computationally feasible
algorithm for the LBD-FDR and compare it in simulation to five existing procedures.
Read the full abstract ▾
Statistics Theory
On the Asymptotics of Item Selection in Multidimensional Computerized Adaptive Testing
Seungwon Lee and Xiaoou Li
We study Fisher-information-based item-selection rules for multidimensional computerized adaptive testing (MCAT) with intentional and nuisance abilities. Although such rules are widely used, rigorous asymptotic theory for the coupled dynamics of adaptive selection and latent-trait estimation remains limited. We consider a weighted A-optimality criterion that prioritizes intentional abilities while controlling accuracy in nuisance dimensions. For the multidimensional two-parameter logistic model, we first establish asymptotic optimality under an item-type reuse regime: paired with the maximum likelihood
estimator, the weighted A-optimal rule attains the minimum asymptotic weighted mean squared error. We then prove consistency and asymptotic normality of the maximum likelihood
estimator and express its asymptotic weighted mean squared error through a limiting Fisher information
matrix. We also extend the analysis to the operational setting in which each item is administered at most once. These results justify normal approximations and information-based standard errors in MCAT. A simulation study examines finite-sample behavior at practical test lengths and shows favorable weighted mean squared error, with item-selection patterns consistent with the predicted limiting behavior.
Read the full abstract ▾
Statistical Methodology · Cross-listed from econ.EM
A Nonparametric Test for Cross-Unit Spillovers
Margherita Comola, Camila Comunello and Abhimanyu Gupta
Cross-unit dependence is pervasive in empirical applications and complicates econometric inference, especially when spillovers operate in nonlinear ways. We propose a novel nonparametric test for cross-unit spillovers that may operate through peers' attributes, peers' outcomes, or both. The test is straightforward to implement, as it requires only estimation under the null hypothesis of no cross-unit spillovers, and is shown to have a convenient asymptotic standard normal distribution. It is also versatile, accommodating data generated by a wide range of interaction structures. We present four empirical illustrations showing that the proposed test can yield substantively different conclusions about the presence of cross-unit spillovers than existing approaches.
Read the full abstract ▾
Statistics Theory
Differentially Private Nonparametric Modal Learning with Applications to Regression and Clustering
Arkajyoti Bhattacharjee and Arnab Auddy
Density modes provide a localized and interpretable summary of
multimodal distributions, but their estimation under rigorous differential
privacy constraints remains largely unexplored. We study differentially private recovery of density modes for multivariate distributions under local smoothness,
curvature, and separation conditions. We propose DP-GRAMS, a mean-shift inspired method that performs noisy ascent on a differentially private score
estimator. Assuming the density belongs locally to a Hölder class with smoothness parameter $\beta > 2$, our score
estimator uses bias-reducing higher-order kernels, and then enforces
privacy in the gradient ascent steps via gradient clipping and calibrated Gaussian noise. A private initialization scheme combines a density-aware utility with a suppression rule and, with $k\asymp M\log n$ draws over a public $h_{\mathrm{DAP}}$-grid and suppression radius $\rho_{\mathrm{init}}\asymp (\log n)^{-1/d}$, achieves high-probability coverage of the modal basins by successively suppressing selected local neighborhoods in competitive regions, while correlated noise across multiple starts enables joint release under a single $(\varepsilon,\delta)$-differential
privacy guarantee. We prove that all population modes are recovered with high probability and establish asymptotic error rates of the form $O\!\left((\tfrac{\log n}{n})^{\frac{2(\beta-1)}{d+2\beta}}\right) + O\!\left((\tfrac{\mathrm{polylog}(n,\delta)}{n^2\varepsilon^2})^{\frac{\beta-1}{d+\beta}}\right)$. We also provide minimax lower bounds for private mode estimation, and show that our
estimators are nearly optimal, up to a logarithmic factor in the MSE. We present two natural extensions: DP-PMS, a private modal-regression method, and DP-GRAMS-C, a clustering pipeline. Extensive experiments on synthetic and real data demonstrate favorable
privacy-utility trade-offs relative to common baselines.
Read the full abstract ▾
Statistical Methodology
Marginal generalized raking with parametric working models
Brian D Williamson, Runjia Zou, Thomas Lumley et al. (+2 more)
Generalized raking (GR) was originally developed in the survey statistics literature to incorporate auxiliary information in estimation. Recently, it has been used in the biostatistical and epidemiological literature to estimate regression coefficients in parametric models in cases with missing data, including missing data by design (e.g., two-phase studies). In the regression parameter context, the optimal GR
estimator has been shown to be equivalent to the optimal augmented inverse probability weighted
estimator. In this paper, we generalize the influence function-based theory for GR to marginal estimands; we call our approach marginal generalized raking. We contrast our approach to a procedure that marginalizes a conditional GR
estimator of regression parameters; while the former approach is doubly robust, i.e. is consistent if either the missing-data model or the optimal raking variable is estimated consistently, our proposed approach is multiply robust, allowing either the outcome regression or treatment propensity score to also be misspecified. We compare the approaches in both fully-synthetic simulations and in an application using data from an observational cohort of persons living with HIV.
Read the full abstract ▾
All authors Brian D Williamson, Runjia Zou, Thomas Lumley, Bryan E Shepherd, Pamela A Shaw
Statistics Theory
Joint parameters estimation in cubic tensor model
Sumit Mukherjee, Arnab Sen and Qiang Wu
We study joint parameter estimation from a single observation in high-dimensional Gibbs measures with cubic tensor interactions, motivated by dense ERGMs, arithmetic-progression models, and inhomogeneous random hypergraphs. Focusing on the maximum pseudolikelihood
estimator, we give checkable conditions for joint consistency and asymptotic ill-conditioning. For the edge-triangle ERGM, pseudolikelihood is ill-conditioned in the
ferromagnetic regime with nonnegative field, but consistent in a sufficiently strong
antiferromagnetic regime. For the edge-three-
star ERGM, it is ill-conditioned for all inverse temperatures and external fields. We also study consistency for arithmetic-progression, and inhomogeneous hypergraph models. Our proofs develop nonlinear large-deviation and mean-field approximation tools for cubic tensor Gibbs measures, which have scope for broad applications.
Read the full abstract ▾
Machine Learning (Statistics) · Cross-listed from cs.LG
When Does On-Policy Interaction Help? Representational Tradeoffs in Value-Based Imitation Learning
Luca Viano, Antoine Moulin, Audrey Huang et al. (+3 more)
Imitation learning (IL)—training an
agent to replicate expert behavior from demonstrations—underpins applications from robotics to
language model training. Standard approaches such as Behavior Cloning (BC) are known to suffer from compounding errors and performance plateaus, particularly when the learner cannot perfectly represent the expert's policy (as is typical, e.g., in
distillation). Two interventions are widely understood empirically to improve performance: querying the expert interactively along the learner's own trajectories, and using value function estimation en route to generating a policy rather than directly fitting the expert's full action distribution. We investigate the nature of these improvements and their potentially surprising interplay. Our main finding is that expert interaction relaxes the representational demands on the learner: one only needs a model capable of realizing the expert's value function, bypassing the (often stricter) requirement of realizing the expert's policy itself. Concretely, we introduce OVI, an interactive on-policy IL
algorithm that is statistically efficient whenever the learner can represent the expert's value function and computationally efficient given access to a linear maximization oracle. We complement this with a negative result showing that interaction is necessary. Namely, without stronger assumptions beyond expert-value realizability alone, any offline IL
algorithm must scale with the complexity of the expert policy class. Our findings bear out empirically. OVI outperforms offline policy-based (BC), interactive policy-based (DAgger), and offline value-based IL methods, with the largest gains when the learner network is substantially less expressive than the expert's.
Read the full abstract ▾
All authors Luca Viano, Antoine Moulin, Audrey Huang, Volkan Cevher, Philip Amortila, Dylan J. Foster
Machine Learning (Statistics) · Cross-listed from cond-mat.dis-nn
Exponential Capacity in Multilayer Hetero-Associative Neural Networks
Elena Agliari, Adriano Barra, Andrea Ladiana et al. (+1 more)
Exponential Hopfield networks store a number of patterns that grows exponentially with the number of
neurons, and in their classical formulation they are auto-associative: they complete a corrupted copy of a
memory into the
memory itself. Many of the tasks one wants such a network to perform are instead hetero-associative, mapping a cue to a different target. We introduce and analyse an exponential neural network of $L$ layers of $N$ binary
neurons, each layer carrying its own
dataset, whose energy is an exponential of the product of the per-layer Mattis overlaps, so that it is minimised precisely when every layer retrieves the pattern of the same index; the stored association must be a surjective function of the cue, and we show why nothing else can be stored at all. A cavity/signal-to-noise analysis, made exact at leading order by a large-deviation evaluation of the noise, shows that the aligned hetero-associative state is a fixed point of the zero-temperature dynamics up to a number of stored patterns $P_c\sim e^{N\rho_L}$, exponential in the layer size, with an explicit rate $\rho_L$ that grows like $L\log 2$; enlarging the basins of attraction lowers the rate but never destroys its exponential character. Comparing the theory with structured data we find that the exponential capacity and the predicted basins survive correlated, many-to-one patterns: the network is a near-perfect content-addressable
memory. The same closed forms describe, without refitting, a synthetic
manifold, real T-
cell-receptor/epitope triples and natural-
language intent data, so the mechanism is domain-universal. Generalisation to unseen cues, though significantly above chance, stays below memorisation, and it is the geometry of the encoding, rather than the data domain, that sets how far above chance it reaches. In this family, exponential storage and strong generalisation are distinct capabilities.
Read the full abstract ▾
All authors Elena Agliari, Adriano Barra, Andrea Ladiana, Andrea Lepre
Statistics Theory · Cross-listed from econ.EM
Robust Instrumental Variables: Sharp Rates and Inference under Adversarial Contamination
Anders Bredahl Kock and David Preinerstorfer
Because 2SLS is built from sample averages, a small number of observations can have a disproportionate effect on estimates and inference. We introduce W-2SLS, a simple drop-in robustification that replaces these averages by
quantile-winsorized means. We analyze W-2SLS under
adversarial contamination, which permits both the identities and the reported values of the contaminated observations to depend on the realized clean sample and therefore accommodates targeted or strategic manipulation. Under finite $m$-th moments, W-2SLS attains the minimax-sharp rate $\eta_{n}^{1-\frac1m}+n^{-1/2}$, where $\eta_n$ is the fraction of observations that may be altered. Matching lower bounds identify the exact contamination thresholds for uniform consistency, root-$n$ estimation, and centered Gaussian inference with the same first-order law as clean-sample 2SLS. When $\sqrt{n}\eta_{n}^{1-\frac1m}\to 0$ robustness is first-order free. We also construct feasible heteroskedasticity-robust inference and a winsorized Anderson–Rubin test valid under weak identification and
adversarial contamination. Finally, even without contamination, ordinary 2SLS can have poor uniform finite-sample concentration, whereas W-2SLS admits confidence-calibrated sub-Gaussian deviation guarantees.
Read the full abstract ▾
Statistical Methodology
Multiple type I error concepts for clinical trials with overlapping populations
Remi Luschei and Werner Brannath
The population-wise error rate (PWER) was introduced as a more liberal alternative to the family-wise error rate (FWER) for clinical trials with multiple, overlapping patient populations. These trials are particularly relevant in personalized medicine, which aims to find therapies tailored to specific patient subgroups. By controlling an average multiple type I error probability over all population strata, the PWER can substantially improve statistical power. However, one disadvantage of this concept is that the error probability for a given population can strongly depend on the presence or absence of other populations included in the analysis. To address this issue, we propose two modifications of the PWER that enforce individual error control either for all target populations, or for all possible unions of target populations. We call these approaches the PWER over the populations (PWER-P) and the PWER over population unions (PWER-U). We investigate the properties of these new error rates and compare them with the PWER and FWER in terms of type I error control and power.
Read the full abstract ▾
Machine Learning (Statistics) · Cross-listed from cs.LG
TerraNova: A Foundation Model for the Anthropocene
Carlos Rodriguez-Pardo and Massimo Tavoni
A defining problem of the Anthropocene is to model the physical Earth and human societies as one coupled system, yet no learned representation spans their observational breadth. We argue the obstacle is
geometric: the physical Earth is measured as continuous fields that ignore political borders, whereas societies are reported for administrative units. Earth-system foundation models serve the first geometry; coupling it to the second has required lossy averaging over borders. We introduce TerraNova, a foundation model trained on 1,024 physical and societal records in their native geometries: 512 gridded Earth-system fields and 512 national indicators. Dedicated encoders represent location, country, time and task, cross-modal
transformers fuse them into a shared spatiotemporal state, and a hypernetwork generates a per-query decoder whose evidential head returns a predictive distribution. Two contrastive objectives couple the representation: a population-weighted
alignment between each country and coordinates in its territory, and one to pretrained geospatial
embeddings carrying image-derived semantics. Read out through that decoder, the representation is competitive with purpose-built geospatial encoders while spanning axes they do not represent (time, oceans and uncertainty) and supporting country-level capabilities. The frozen backbone reconstructs dense fields from sparse observations and adapts to unseen variables in minutes on consumer hardware.
Read the full abstract ▾
Statistics Theory
Adversarially robust multiple testing in high dimensions
Anders Bredahl Kock and David Preinerstorfer
Robust multiple testing procedures for assessing equality restrictions on the coordinates of high-dimensional mean vectors are proposed. Our procedures are based on
quantile-winsorization techniques, approximately control the familywise error rate (strongly) under
adversarial contamination, and allow the number of hypotheses to grow exponentially with sample size, despite requiring only slightly more than two moments. Technically, our one-sample results build on recent Gaussian approximation inequalities for the distribution of high-dimensional
quantile-winsorized means, whereas our two-sample results are based on extensions thereof, which we develop here and which could be of some interest in their own right.
Read the full abstract ▾
Statistics Theory
Asymptotic Minimax Estimation under Global-Local Priors
Rhitankar Bandyopadhyay and Malay Ghosh
Global-local priors, often also referred to as shrinkage priors, have proved to be a very effective tool for the analysis of high dimensional data under sparsity. Asymptotic theoretical properties of such priors, studied under various scenarios, are now available in the literature. However, to our knowledge, theoretical guarantees of such priors provided so far, involve the assumption of known sample variance. The present paper relaxes this assumption, and carries out the analysis with a prior assigned to the error variance as well. In the process, some new tail bounds for shrinkage factors are developed, and these results are then utilized in providing asymptotic minimax rates for the posterior means of the parameters of interest.
Read the full abstract ▾
Machine Learning (Statistics)
Analytical and Bootstrap Confidence Intervals for Double Machine Learning: Simulation Studies and an Application to Rural-Urban Differences in Obesity Prevalence
Haozheng Xu, Siyuan Ma and Qingyan Xiang
Double Machine Learning (DML) is a popular approach for treatment effect estimation in various settings, which allows a wide range of flexible machine learning methods to be used for nuisance parameter estimation while preserving valid inference. In practice, however, applied researchers must choose among many machine learning
algorithms for nuisance models, and the impact of this choice on the variance estimation of DML is not well characterized. We conduct a comprehensive simulation study to compare the coverage probability of DML confidence intervals across different machine learning
algorithms. In this study, we compare (1) analytical confidence intervals derived by DML theory versus (2) bootstrap confidence interval. We use a set of learners including ordinary least squares, LASSO, Random Forest, LightGBM, and Neural Networks under different data generation settings. We evaluate the performance across difference settings by bias, confidence interval width, and most importantly, coverage probability. Our results show substantial variability in coverage performance across analytical and bootstrap confidence intervals, highlighting that learner choice plays a critical role in reliable DML inference. Surprisingly, we find that in many settings, when sample size increases, the coverage probability of both DML analytical and bootstrap confidence interval decreases. We further investigate coverage probabilities using a real
dataset on rural urban differences among U.S. counties. The real data analysis discovers that (1) the model performance still varies by the learner choices and (2) greater rurality has a statistically significant increasing effect on county level obesity prevalence.
Read the full abstract ▾
Statistical Methodology
Longitudinal Adaptive Experimental Design for Learning Multiple Target Estimands with Semiparametric Efficient Inference
Wenxin Zhang and Mark van der Laan
Adaptive designs are increasingly used in clinical trials and digital experiments to improve estimation efficiency by updating treatment randomization probabilities as data accumulate. While most existing work focuses on settings with a single-stage treatment, adaptive designs for longitudinal studies with multi-stage, time-varying treatments remain relatively underexplored. In this work, we develop a general semiparametric efficiency framework for designing longitudinal adaptive experiments to optimize the estimation efficiency of a broad class of target estimands of interest. An efficiency-oriented design criterion is proposed to accommodate both single-estimand targets and joint optimization across multiple estimands. We demonstrate that optimal randomization at earlier stages depends on later-stage allocations, yielding a backward-recursive strategy for deriving the oracle design, and propose a longitudinal adaptive design to sequentially learn and target the oracle design using accumulating data. We further develop an adaptive-design-likelihood-based longitudinal targeted maximum likelihood
estimator (ADL-LTMLE) for asymptotically normal and semiparametric efficient estimation of statistical estimands from dependent data collected from adaptive experiments, without relying on parametric model assumptions. Applying the framework to time-to-treatment-initiation effects that compare initiating treatment at a given stage with delaying initiation until a subsequent stage, we show that designs optimized for a particular stage-specific effect can substantially compromise estimation efficiency for effects defined at other stages, highlighting the design trade-offs addressed by our framework. Simulation studies show the proposed design and estimation approaches achieve substantial variance reductions relative to non-adaptive designs, with performance close to that of the oracle design.
Read the full abstract ▾
Statistical Methodology
Predicting Bot Vulnerability from Posting Trajectories: Censored Functional Regression under Informative Sampling
Jake Koerner, Ana-Maria Staicu, Caitrin Murphy et al. (+4 more)
In this manuscript, we propose a novel framework for Scalar-on Censored Informative-design Functional Regression or SoCIFR. This setting is increasingly common in modern longitudinal and digital data applications but remains underdeveloped in functional data literature. We first discuss estimation and prediction in SoCIFR and extend the methodology to accommodate a matched case-control design. The proposed methodology is further generalized to handle multiple functional predictors, allowing for both censored and uncensored trajectories, observed under informative or non-informative sampling designs. Through simulation studies, we assess the performance of the proposed methods under various data-generating scenarios. We apply the methods to the motivating application for predicting user susceptibility to automated ("bot") interactions at increasing future time horizons based on social media behavioral trajectories observed over fixed time windows.
Read the full abstract ▾
All authors Jake Koerner, Ana-Maria Staicu, Caitrin Murphy, Eric Laber, Mihai Nicola, William Rand, Zakaria Babutsidze
Machine Learning (Statistics)
The Greedy Advantage in Finite-Horizon Bandits
Kai Zhou, Michael Lingzhi Li and Kai Wang
Organizations increasingly rely on sequential experimentation to improve decision-making. While the multi-armed bandit literature has developed
algorithms with strong asymptotic regret guarantees, many practical applications operate over finite and externally imposed horizons. Motivated by the finite-horizon setting, we develop a class of regularized greedy
algorithms for multi-armed Bernoulli bandits. We derive the first finite-horizon regret envelopes for regularized greedy bandits, showing that finite-horizon regret decomposes into transient exploration costs and a suboptimal convergence term that decays exponentially with the regularization strength. This characterization yields principled calibration rules for the regularization parameters and, as a limiting case, sharper regret guarantees for the classical greedy policy. Across extensive numerical experiments, calibrated regularized greedy policies consistently match or outperform state-of-the-art
algorithms. These results suggest that regularized greedy policies can provide an effective approach for finite-horizon bandit problems.
Read the full abstract ▾