Peer Revenue Returns subject to peer review

Papers

Fresh from arXiv, typeset properly. Highlighted words trade on the market.

Statistics

stat Watch Statistics (sign in to use)

Saturday 1 August

Statistics Theory

Exact detection threshold of the packing test

Using Poisson approximation techniques, we derive the detection threshold of the packing test in \cite{Jiang13} when testing spherical uniformity under high-dimensional Fisher–von Mises–Langevin (FvML) and Watson alternatives. Our result rigorously confirms the empirical observation that the packing test is strictly suboptimal for testing uniformity in these two popular models. In the high-dimensional FvML model, its detection threshold is precisely \(\kappa=\Theta\lb p^{3/4}/(\log n)^{1/4}\rb\). In the high-dimensional Watson model, its detection threshold is \(p-2\kappa=\Theta(\sqrt{p\log n})\), or equivalently \(\kappa=p/2-\Theta(\sqrt{p\log n})\). The non-null limiting distributions of the packing test under these two models are derived. We show that the limiting scalings of the largest squared inner product undergo a discontinuous phase transition in the Watson model, whereas no analogous phenomenon occurs in the FvML model.
Read the full abstract

Statistical Computation

Efficient Variance Estimation for the Polytomous Discrimination Index

Evaluating diagnostic accuracy for multi-category outcomes remains a significant challenge, primarily due to computational limitations in existing performance metrics. The Polytomous Discrimination Index (PDI) has emerged as an order-agnostic solution suitable for nominal classifications. However, its broader adoption has been constrained by the lack of efficient implementation, especially for its variance estimation, which typically would require computationally intensive bootstrapping procedures. In this work, we address this limitation by proposing a novel asymptotic variance estimator for the PDI. Our method integrates classical $U$-statistic theory with recent advances in combinatorics, offering a scalable and theoretically grounded alternative. To assess the performance of the proposed approach, we conduct extensive simulation studies and observe remarkable gain in computing time. We further apply our method to a real-world brain image analysis where deep neural networks are used as a diagnostic tool. We can efficiently report the accuracy of the neural networks with different depth specifications.
Read the full abstract

All authors Qunqiang Feng, Taozheng Jia, Pan Liu, Ben Van Calster, Jialiang Li

Statistical Methodology

Debiased inference for proximal dose-response function

We study nonparametric inference for a continuous-treatment causal dose-response curve and its first derivative under unmeasured confounding, using treatment- and outcome-inducing proxies. We establish a proximal doubly robust pseudo-outcome whose conditional mean given treatment equals the dose-response curve whenever either bridge function is correctly specified. Their (smoothed) efficient influence function representations lead to cross-fitted local-polynomial estimators with explicit smoothing-bias correction. We establish pointwise and finite-dimensional asymptotic normality and oracle uniform Gaussian approximations over compact interior treatment intervals, allowing mean-squared-error-optimal bandwidths without undersmoothing. The derivative inference reuses the estimated bridges and the same form of bandwidth-dependent nuisance-rate conditions, evaluated at the bandwidth rate appropriate for derivative estimation, without requiring derivative-specific bridge estimation. Employing cross-fitting accommodates flexible bridge estimators under product convergence rate conditions without entropy restrictions. We further develop tests against fixed-dimensional parametric dose-response null hypotheses, including constancy, linearity, and quadratic specifications, and derive their limiting distributions under the null and local alternatives, together with practical bootstrap procedures. We also develop practical bandwidth selectors, pointwise confidence intervals, and simultaneous confidence bands for each causal estimand. Extensive simulations and a data analysis, presented in the appendix, demonstrate the finite-sample performance of the proposed methods under latent confounding and multiple proxies.
Read the full abstract

Friday 31 July

Machine Learning (Statistics) · Cross-listed from cs.CY

From Prediction to Explainable Provider Behavior Profiles for Fraud, Waste, and Abuse Review

Claims data can show that provider behavior changed but cannot by itself explain why. Fraud, waste, and abuse (FWA) review requires identifying material behavior, locating the codes and dollars driving it, and testing plausible explanations. Forecast residuals conflate growth, service-line shifts, code maintenance, and incomplete observation with potentially concerning behavior. We instead formulate provider review as a descriptive representation problem: observed amount $y_{ijt}=s_{it}p_{ijt}$, where $s_{it}$ is provider scale and $p_{ijt}$ is procedure composition. The profile records scale history, effective-dated code lineage, clinical-family shares, first-use events, billing context, and Medicare-versus-client differences. An optional rank-32 nonnegative factorization of procedure co-occurrence adds a fixed semantic geometry for similarity and retrieval. The profile surfaces evidence for review without inferring intent or adjudicating FWA, and is one engine within Falcon's broader review system. In a ten-quarter proprietary Medicare Carrier and DME build (1.27 million providers; 9.2 million provider-quarter profiles through 2026~Q2), the semantic dictionary covers 3,641 procedures and raises recall at 10 from 36.0% to 44.4%; for high-cost rare events, recall at 50 is 56.1% versus zero for popularity. Under the governed eligibility contract, 414,093 providers enter the national review population, with 81.8% and 90.8% remaining eligible across adjacent quarters. Replication across eight client panels preserves 86.9–95.2% amount-weighted semantic coverage. Transparent descriptions thus form the core, with learned representations adding optional semantic context.
Read the full abstract

Statistics Theory · Cross-listed from math.LO

Human and AI-generated texts between modal logic and statistics

We read the geometry of semantic neighbourhood graphs as modal logic and give that reading a statistical form, in order to make precise the structural difference between human and machine-generated text. Texts are the worlds of a finite frame whose accessibility is the $k$-nearest-neighbour relation of a transformer embedding, and the symmetry, transitivity, Euclideanity and seriality frequencies of the two subcorpora are shown to be degrees of validation of the modal axioms $\mathsf{B}$, $\mathsf{4}$, $\mathsf{5}$, $\mathsf{D}$. Each degree is at once the proportion of instances of a rule that the subframe licenses in Negri's labelled calculus $\mathsf{G3.K}$ and a plug-in estimate of a population probability. A prompt-balanced comparison finds consistently higher artificial degrees for $\mathsf{4}$ and $\mathsf{5}$. We add a degree of groundedness and of situatedness, and recast the licensing reading in Cuconato's one-sided sequent-style tableaux, where each degree becomes a rate of set membership.
Read the full abstract

Statistics Applications

Projection, Memory, and the Validity of Scalar Early-Warning Signals: A Schur–Volterra Theory with an AMOC Application

Early-warning signals are usually computed from one or a few observables, although the underlying dynamics are high dimensional. Projection creates a structural ambiguity: the same scalar record may reflect spectral loss of stability, hidden-state memory, nonnormal amplification, a turning point of a physical balance, or a combination of these. We develop a unified operator theory that makes these alternatives explicit. For a resolved-hidden block linearization we derive exact Volterra reductions, finite and diffusive Markovian liftings, and a Schur-resolvent factorization of the stability problem, distinguishing three notions of memory: realized pathwise, structural Schur return, and finite-horizon projected. A covariance theorem gives sufficient conditions for a scalar to inherit critical slowing down from a real multiplier approaching the unit circle: spectral separation, bounded eigenvector conditioning, observability of the critical mode, stochastic excitation of that mode, and quasi-stationary forcing. We then prove failure mechanisms: a critical mode can be invisible or unexcited; an oscillatory crossing need not raise lag-one correlation; a nonnormal family can produce diverging scalar variance with a fixed stable spectrum; a physics-based turning point need not coincide with a spectral boundary; and finite-horizon data cannot identify long memory uniquely. The theory is illustrated with a 4400-year CESM AMOC hysteresis experiment. EOF1 alone detects altered susceptibility, but EOF1-EOF2 is the smallest resolved space revealing changed Schur return and projected memory after recovery; F_ovS reaches its minimum 26 years before collapse while the modal margin does not decrease toward zero: the two diagnostics probe complementary mechanisms. The application is mechanistic and single-trajectory; no validated early-warning signal is claimed.
Read the full abstract

Statistical Methodology

Backward Bayesian Outcome Weighted Learning

A central objective of precision medicine is learning optimal dynamic treatment regimes (DTRs) from data. Classification-based methods, like outcome weighted learning (OWL) for single-stage and backward OWL (BOWL) for multi-stage problems, leverage machine learning to directly learn optimal DTRs. However, these methods lack a natural way to quantify uncertainty in treatment decisions at the individual level. In this paper, we extend Bayesian OWL, a Bayesian reformulation of OWL, to the multi-stage setting. We call this method backward Bayesian outcome weighted learning (BBOWL). Like BOWL, our method directly learns an optimal DTR via backward induction, and unlike existing methods, our approach propagates uncertainty backward through the DTR learning process and provides uncertainty quantification of individualized treatment recommendations. We present a theoretical justification of BBOWL and verify its performance via a simulation study.
Read the full abstract

Machine Learning (Statistics) · Cross-listed from cs.LG

Agentic Bayesian Optimization through Surrogate-Augmented Autoresearch

Bayesian optimization (BO) has become the standard tool for sample-efficient optimization and owes its efficiency to uncertainty-aware search driven by generic statistical priors. Richer domain priors can improve BO in principle, but encoding them through tailored kernels or problem structure is difficult and rarely done in practice. LLMs can help sidestep this difficulty by making informal priors from natural language, code, and documentation directly available to the optimizer. However, existing LLM-based BO methods either insert the LLM into a fixed role (surrogate, acquisition proxy, or configuration interface) or hand it broad control, sacrificing the systematic exploration that makes BO reliable. We introduce agentic Bayesian optimization: a paradigm in which an LLM agent is the central decision maker in the BO loop while a Bayesian backend provides the uncertainty-aware optimization substrate. The agent configures the problem, queries the backend, selects and commits evaluations, and can revise the optimization strategy during the run by tightening bounds, switching acquisition functions, proposing targeted evaluations, or even reframing the problem following new instructions or observed evidence. We instantiate this idea in Sara, a surrogate-augmented autoresearch agent, and lenz, a modular BoTorch-based backend that the agent can inspect and modify through a structured interface. Across synthetic and real-world benchmarks, Sara preserves the reliability of state-of-the-art BO without prior knowledge, outperforms LLM-based baselines, and uses natural-language priors to improve beyond standard BO. We further demonstrate the practical value of agentic BO in dynamic settings, where Sara reconfigures the full optimization problem on the fly as requirements change, a capability not previously available in standard BO.
Read the full abstract

All authors Paul Brunzema, Louis Tiao, Nhat Le, Kevin De Angeli, Yao Xuan, Djordje Gligorijevic

Statistical Methodology

Multi-output Orthogonal Gaussian Processes for Noisy Simulator Outputs

Computer simulations can model physical processes but are often too expensive to produce enough runs for calibration, sensitivity analysis, prediction, and uncertainty quantification. As a result, statistical surrogates are frequently used as cheaper alternatives that can be trained on a small number of simulation runs. Gaussian processes (GP) are well-suited as surrogates, as they provide flexible, nonlinear regression and closed-form uncertainty quantification. However, standard GPs are insufficient replacements for more complex simulators, such as stochastic or multi-output simulators. In addition, typical GPs also struggle to separate fitted regression coefficients from residual process variation. We introduce multi-output orthogonal Gaussian process (MOOGP) to tackle the problems mentioned above. This paper has three main contributions: (i) a definition of orthogonality for multi-output Gaussian processes, (ii) a construction that enforces orthogonality by conditioning each covariance function, and (iii) a structured likelihood formulation that significantly improves computational scaling. In a trend-recovery illustrative example, MOOGP recovers the true trend while the non-orthogonalized counterpart fails to do so, to the extent it reverses the sign of the trend. Numerical experiments and an application in heavy-ion collision simulations further demonstrate the interpretability and predictive advantage of MOOGP.
Read the full abstract

Statistical Methodology

Extensions in Semiparametric Geostatistical Models

In spatial statistics, the incorrect selection of an appropriate covariance function may lead to inference errors and confidence underestimation. Motivated by such restrictions, we introduce and evaluate a flexible semiparametric approach for estimating spatial covariance functions based on Bernstein polynomials. The proposed formulation is general and applicable to classes of models that incorporate latent spatial effects in georeferenced data, such as Spatial Generalized Linear Mixed Models. Empirical validation was conducted via Monte Carlo simulations, and model fitting was performed using Bayesian inference via Markov chain Monte Carlo. Simulated scenarios demonstrated the model's ability to recover structural covariance configurations with low bias and high parameter precision. The practical applicability of the methodology was tested using real abundance data for American Robin (Turdus migratorius) from the North American Breeding Bird Survey. The proposed model, featuring a Negative Binomial structure, yielded satisfactory results, efficiently capturing the overdispersion inherent in the count data. The estimated range parameter of 381.48 km revealed that the species' spatial dependence operates at a regional scale, suggesting that unobserved ecological processes act homogeneously within this radius of environmental influence. Additionally, predictive validation using an independent sample (n_pred = 34) demonstrated the model's strong generalization capability via Bayesian Kriging, producing point projections that closely matched observed values and well-calibrated prediction intervals. It is concluded that the proposed approach represents a robust methodological advancement, establishing itself as a flexible and efficient tool.
Read the full abstract

All authors Maíra Soalheiro, Marcos Oliveira Prates, Victor Hugo Lachos, Fábio Nogueira Demarqui

Machine Learning (Statistics)

A reproducible and extensible framework for benchmarking competing risks survival models

A wide range of statistical and machine learning methods have been proposed for survival analysis with competing risks, where the occurrence of one event (i.e., cancer death) precludes the occurrence of other events (i.e., cardiovascular disease death). Despite these methodological advances, their systematic evaluation and adoption are limited by the lack of comprehensive, reproducible and extensible benchmarking frameworks. We developed an open-source benchmarking framework for competing risks models that enables their systematic comparison across multiple datasets under different aspects of performance; calibration, discrimination, overall prediction error and clinical utility. We additionally introduce an extension of SHAP for competing risks, allowing model-agnostic interpretability of covariates contributions over time. All our code is publicly available via GitHub:https://github.com/BBolosSierra/CompRisksBenchmark
Read the full abstract

All authors Begoña B. Sierra, Colin McLean, Peter S. Hall, Sarah Friedrich-Welz, Catalina A. Vallejos

Statistical Methodology

Bridging extrinsic and intrinsic variable importance

Variable importance may describe either intrinsic predictive information in a population or extrinsic importance for a fitted prediction rule. Quantifying the uncertainty in variable importance estimates is critical for interpretation. Methods for estimating intrinsic variable importance (we will refer to these as VIMP) and the minipatch leave-one-covariate-out procedure (MPLOCO) target intrinsic and extrinsic importance, respectively, and provide methods for computing standard errors. These two approaches have a shared structure, comparing prediction performance with and without features, but the relationship between them has not been formally characterized. We establish conditions under which the two perspectives align. Under squared-error loss, if the fitted full and reduced learners converge to their oracle counterparts sufficiently fast, then MPLOCO is asymptotically equivalent to VIMP. We provide further conditions extending this result to general loss functions and formalize grouped MPLOCO for potentially overlapping feature groups. Through simulations, we show that VIMP and MPLOCO agree most closely when the fitted learner is well aligned with the data-generating mechanism. In a high-dimensional grouped simulation, both procedures identified the signal-containing groups. In an analysis of HIV-1 VRC01 neutralization sensitivity, both methods placed the same three biologically relevant feature groups among their highest-ranked groups. These results clarify when intrinsic and extrinsic importance can be interpreted similarly and when they provide complementary information.
Read the full abstract

Statistics Theory

Regularized-Likelihood Deconvolution with Posterior-Density Reconstruction

Density deconvolution is an ill-posed inverse problem because recovering the latent density amplifies high-frequency variation in the observed data. We propose a two-stage likelihood procedure. The first estimator maximizes the convolution likelihood over a regularized Gaussian-mixture sieve; the second treats this fit as an empirical prior and averages the fitted conditional latent densities. Under fixed-model misspecification, the estimators generally have different population targets. For bounded local multiplicative perturbations of the latent density, the population posterior map is locally contractive in chi-square divergence under identifiable convolution. Under correct finite-dimensional specification, however, reconstruction adds a nonnegative first-order variance component. For growing sieves, we separate observed-domain estimation, inverse stability, and posterior empirical variation. We derive explicit rates under Gaussian error and recover the classical ordinary-smooth exponent, up to logarithmic factors, with a constructive verification for Laplace error. Simulations and a Framingham blood-pressure application provide empirical performance evidences.
Read the full abstract

All authors Marco Di Marzio, Stefania Fensore, Chiara Passamonti, Serena Pulcini

Statistical Methodology

An Optimal False Discovery Rate Controlling Procedure for Changepoint Detection

We consider the problem of detecting and localizing a growing number of changepoints in a sequence of independent observations. We propose a new method, Lean Bonferroni Detection - False Discovery Rate (LBD-FDR), which produces a set of localized regions in the data sequence where, in expectation, a high proportion of them contain a changepoint. LBD-FDR guarantees control of the false discovery rate in a wide range of distributional settings, including the challenging case of independent non-parametric and heavy-tailed data. For independent Gaussian sequences, we derive conditions on changepoint arrangements where the method consistently detects all changepoints with a large enough signal while simultaneously being unaffected by those that are undetectable, and we show that LBD-FDR obtains the optimal detection constant in certain regimes. Moreover, we derive the settings where our method is more powerful than the minimax optimal Type I error controlling method. We finally develop a computationally feasible algorithm for the LBD-FDR and compare it in simulation to five existing procedures.
Read the full abstract

Statistics Theory

On the Asymptotics of Item Selection in Multidimensional Computerized Adaptive Testing

We study Fisher-information-based item-selection rules for multidimensional computerized adaptive testing (MCAT) with intentional and nuisance abilities. Although such rules are widely used, rigorous asymptotic theory for the coupled dynamics of adaptive selection and latent-trait estimation remains limited. We consider a weighted A-optimality criterion that prioritizes intentional abilities while controlling accuracy in nuisance dimensions. For the multidimensional two-parameter logistic model, we first establish asymptotic optimality under an item-type reuse regime: paired with the maximum likelihood estimator, the weighted A-optimal rule attains the minimum asymptotic weighted mean squared error. We then prove consistency and asymptotic normality of the maximum likelihood estimator and express its asymptotic weighted mean squared error through a limiting Fisher information matrix. We also extend the analysis to the operational setting in which each item is administered at most once. These results justify normal approximations and information-based standard errors in MCAT. A simulation study examines finite-sample behavior at practical test lengths and shows favorable weighted mean squared error, with item-selection patterns consistent with the predicted limiting behavior.
Read the full abstract

Statistical Methodology · Cross-listed from econ.EM

A Nonparametric Test for Cross-Unit Spillovers

Cross-unit dependence is pervasive in empirical applications and complicates econometric inference, especially when spillovers operate in nonlinear ways. We propose a novel nonparametric test for cross-unit spillovers that may operate through peers' attributes, peers' outcomes, or both. The test is straightforward to implement, as it requires only estimation under the null hypothesis of no cross-unit spillovers, and is shown to have a convenient asymptotic standard normal distribution. It is also versatile, accommodating data generated by a wide range of interaction structures. We present four empirical illustrations showing that the proposed test can yield substantively different conclusions about the presence of cross-unit spillovers than existing approaches.
Read the full abstract

Statistics Theory

Differentially Private Nonparametric Modal Learning with Applications to Regression and Clustering

Density modes provide a localized and interpretable summary of multimodal distributions, but their estimation under rigorous differential privacy constraints remains largely unexplored. We study differentially private recovery of density modes for multivariate distributions under local smoothness, curvature, and separation conditions. We propose DP-GRAMS, a mean-shift inspired method that performs noisy ascent on a differentially private score estimator. Assuming the density belongs locally to a Hölder class with smoothness parameter $\beta > 2$, our score estimator uses bias-reducing higher-order kernels, and then enforces privacy in the gradient ascent steps via gradient clipping and calibrated Gaussian noise. A private initialization scheme combines a density-aware utility with a suppression rule and, with $k\asymp M\log n$ draws over a public $h_{\mathrm{DAP}}$-grid and suppression radius $\rho_{\mathrm{init}}\asymp (\log n)^{-1/d}$, achieves high-probability coverage of the modal basins by successively suppressing selected local neighborhoods in competitive regions, while correlated noise across multiple starts enables joint release under a single $(\varepsilon,\delta)$-differential privacy guarantee. We prove that all population modes are recovered with high probability and establish asymptotic error rates of the form $O\!\left((\tfrac{\log n}{n})^{\frac{2(\beta-1)}{d+2\beta}}\right) + O\!\left((\tfrac{\mathrm{polylog}(n,\delta)}{n^2\varepsilon^2})^{\frac{\beta-1}{d+\beta}}\right)$. We also provide minimax lower bounds for private mode estimation, and show that our estimators are nearly optimal, up to a logarithmic factor in the MSE. We present two natural extensions: DP-PMS, a private modal-regression method, and DP-GRAMS-C, a clustering pipeline. Extensive experiments on synthetic and real data demonstrate favorable privacy-utility trade-offs relative to common baselines.
Read the full abstract

Statistical Methodology

Marginal generalized raking with parametric working models

Generalized raking (GR) was originally developed in the survey statistics literature to incorporate auxiliary information in estimation. Recently, it has been used in the biostatistical and epidemiological literature to estimate regression coefficients in parametric models in cases with missing data, including missing data by design (e.g., two-phase studies). In the regression parameter context, the optimal GR estimator has been shown to be equivalent to the optimal augmented inverse probability weighted estimator. In this paper, we generalize the influence function-based theory for GR to marginal estimands; we call our approach marginal generalized raking. We contrast our approach to a procedure that marginalizes a conditional GR estimator of regression parameters; while the former approach is doubly robust, i.e. is consistent if either the missing-data model or the optimal raking variable is estimated consistently, our proposed approach is multiply robust, allowing either the outcome regression or treatment propensity score to also be misspecified. We compare the approaches in both fully-synthetic simulations and in an application using data from an observational cohort of persons living with HIV.
Read the full abstract

All authors Brian D Williamson, Runjia Zou, Thomas Lumley, Bryan E Shepherd, Pamela A Shaw

Statistics Theory

Joint parameters estimation in cubic tensor model

We study joint parameter estimation from a single observation in high-dimensional Gibbs measures with cubic tensor interactions, motivated by dense ERGMs, arithmetic-progression models, and inhomogeneous random hypergraphs. Focusing on the maximum pseudolikelihood estimator, we give checkable conditions for joint consistency and asymptotic ill-conditioning. For the edge-triangle ERGM, pseudolikelihood is ill-conditioned in the ferromagnetic regime with nonnegative field, but consistent in a sufficiently strong antiferromagnetic regime. For the edge-three-star ERGM, it is ill-conditioned for all inverse temperatures and external fields. We also study consistency for arithmetic-progression, and inhomogeneous hypergraph models. Our proofs develop nonlinear large-deviation and mean-field approximation tools for cubic tensor Gibbs measures, which have scope for broad applications.
Read the full abstract

Machine Learning (Statistics) · Cross-listed from cs.LG

When Does On-Policy Interaction Help? Representational Tradeoffs in Value-Based Imitation Learning

Imitation learning (IL)—training an agent to replicate expert behavior from demonstrations—underpins applications from robotics to language model training. Standard approaches such as Behavior Cloning (BC) are known to suffer from compounding errors and performance plateaus, particularly when the learner cannot perfectly represent the expert's policy (as is typical, e.g., in distillation). Two interventions are widely understood empirically to improve performance: querying the expert interactively along the learner's own trajectories, and using value function estimation en route to generating a policy rather than directly fitting the expert's full action distribution. We investigate the nature of these improvements and their potentially surprising interplay. Our main finding is that expert interaction relaxes the representational demands on the learner: one only needs a model capable of realizing the expert's value function, bypassing the (often stricter) requirement of realizing the expert's policy itself. Concretely, we introduce OVI, an interactive on-policy IL algorithm that is statistically efficient whenever the learner can represent the expert's value function and computationally efficient given access to a linear maximization oracle. We complement this with a negative result showing that interaction is necessary. Namely, without stronger assumptions beyond expert-value realizability alone, any offline IL algorithm must scale with the complexity of the expert policy class. Our findings bear out empirically. OVI outperforms offline policy-based (BC), interactive policy-based (DAgger), and offline value-based IL methods, with the largest gains when the learner network is substantially less expressive than the expert's.
Read the full abstract

All authors Luca Viano, Antoine Moulin, Audrey Huang, Volkan Cevher, Philip Amortila, Dylan J. Foster

Machine Learning (Statistics) · Cross-listed from cond-mat.dis-nn

Exponential Capacity in Multilayer Hetero-Associative Neural Networks

Exponential Hopfield networks store a number of patterns that grows exponentially with the number of neurons, and in their classical formulation they are auto-associative: they complete a corrupted copy of a memory into the memory itself. Many of the tasks one wants such a network to perform are instead hetero-associative, mapping a cue to a different target. We introduce and analyse an exponential neural network of $L$ layers of $N$ binary neurons, each layer carrying its own dataset, whose energy is an exponential of the product of the per-layer Mattis overlaps, so that it is minimised precisely when every layer retrieves the pattern of the same index; the stored association must be a surjective function of the cue, and we show why nothing else can be stored at all. A cavity/signal-to-noise analysis, made exact at leading order by a large-deviation evaluation of the noise, shows that the aligned hetero-associative state is a fixed point of the zero-temperature dynamics up to a number of stored patterns $P_c\sim e^{N\rho_L}$, exponential in the layer size, with an explicit rate $\rho_L$ that grows like $L\log 2$; enlarging the basins of attraction lowers the rate but never destroys its exponential character. Comparing the theory with structured data we find that the exponential capacity and the predicted basins survive correlated, many-to-one patterns: the network is a near-perfect content-addressable memory. The same closed forms describe, without refitting, a synthetic manifold, real T-cell-receptor/epitope triples and natural-language intent data, so the mechanism is domain-universal. Generalisation to unseen cues, though significantly above chance, stays below memorisation, and it is the geometry of the encoding, rather than the data domain, that sets how far above chance it reaches. In this family, exponential storage and strong generalisation are distinct capabilities.
Read the full abstract

All authors Elena Agliari, Adriano Barra, Andrea Ladiana, Andrea Lepre

Statistics Theory · Cross-listed from econ.EM

Robust Instrumental Variables: Sharp Rates and Inference under Adversarial Contamination

Because 2SLS is built from sample averages, a small number of observations can have a disproportionate effect on estimates and inference. We introduce W-2SLS, a simple drop-in robustification that replaces these averages by quantile-winsorized means. We analyze W-2SLS under adversarial contamination, which permits both the identities and the reported values of the contaminated observations to depend on the realized clean sample and therefore accommodates targeted or strategic manipulation. Under finite $m$-th moments, W-2SLS attains the minimax-sharp rate $\eta_{n}^{1-\frac1m}+n^{-1/2}$, where $\eta_n$ is the fraction of observations that may be altered. Matching lower bounds identify the exact contamination thresholds for uniform consistency, root-$n$ estimation, and centered Gaussian inference with the same first-order law as clean-sample 2SLS. When $\sqrt{n}\eta_{n}^{1-\frac1m}\to 0$ robustness is first-order free. We also construct feasible heteroskedasticity-robust inference and a winsorized Anderson–Rubin test valid under weak identification and adversarial contamination. Finally, even without contamination, ordinary 2SLS can have poor uniform finite-sample concentration, whereas W-2SLS admits confidence-calibrated sub-Gaussian deviation guarantees.
Read the full abstract

Statistical Methodology

Multiple type I error concepts for clinical trials with overlapping populations

The population-wise error rate (PWER) was introduced as a more liberal alternative to the family-wise error rate (FWER) for clinical trials with multiple, overlapping patient populations. These trials are particularly relevant in personalized medicine, which aims to find therapies tailored to specific patient subgroups. By controlling an average multiple type I error probability over all population strata, the PWER can substantially improve statistical power. However, one disadvantage of this concept is that the error probability for a given population can strongly depend on the presence or absence of other populations included in the analysis. To address this issue, we propose two modifications of the PWER that enforce individual error control either for all target populations, or for all possible unions of target populations. We call these approaches the PWER over the populations (PWER-P) and the PWER over population unions (PWER-U). We investigate the properties of these new error rates and compare them with the PWER and FWER in terms of type I error control and power.
Read the full abstract

Machine Learning (Statistics) · Cross-listed from cs.LG

TerraNova: A Foundation Model for the Anthropocene

A defining problem of the Anthropocene is to model the physical Earth and human societies as one coupled system, yet no learned representation spans their observational breadth. We argue the obstacle is geometric: the physical Earth is measured as continuous fields that ignore political borders, whereas societies are reported for administrative units. Earth-system foundation models serve the first geometry; coupling it to the second has required lossy averaging over borders. We introduce TerraNova, a foundation model trained on 1,024 physical and societal records in their native geometries: 512 gridded Earth-system fields and 512 national indicators. Dedicated encoders represent location, country, time and task, cross-modal transformers fuse them into a shared spatiotemporal state, and a hypernetwork generates a per-query decoder whose evidential head returns a predictive distribution. Two contrastive objectives couple the representation: a population-weighted alignment between each country and coordinates in its territory, and one to pretrained geospatial embeddings carrying image-derived semantics. Read out through that decoder, the representation is competitive with purpose-built geospatial encoders while spanning axes they do not represent (time, oceans and uncertainty) and supporting country-level capabilities. The frozen backbone reconstructs dense fields from sparse observations and adapts to unseen variables in minutes on consumer hardware.
Read the full abstract

Statistics Theory

Adversarially robust multiple testing in high dimensions

Robust multiple testing procedures for assessing equality restrictions on the coordinates of high-dimensional mean vectors are proposed. Our procedures are based on quantile-winsorization techniques, approximately control the familywise error rate (strongly) under adversarial contamination, and allow the number of hypotheses to grow exponentially with sample size, despite requiring only slightly more than two moments. Technically, our one-sample results build on recent Gaussian approximation inequalities for the distribution of high-dimensional quantile-winsorized means, whereas our two-sample results are based on extensions thereof, which we develop here and which could be of some interest in their own right.
Read the full abstract

Statistics Theory

Asymptotic Minimax Estimation under Global-Local Priors

Global-local priors, often also referred to as shrinkage priors, have proved to be a very effective tool for the analysis of high dimensional data under sparsity. Asymptotic theoretical properties of such priors, studied under various scenarios, are now available in the literature. However, to our knowledge, theoretical guarantees of such priors provided so far, involve the assumption of known sample variance. The present paper relaxes this assumption, and carries out the analysis with a prior assigned to the error variance as well. In the process, some new tail bounds for shrinkage factors are developed, and these results are then utilized in providing asymptotic minimax rates for the posterior means of the parameters of interest.
Read the full abstract

Machine Learning (Statistics)

Analytical and Bootstrap Confidence Intervals for Double Machine Learning: Simulation Studies and an Application to Rural-Urban Differences in Obesity Prevalence

Double Machine Learning (DML) is a popular approach for treatment effect estimation in various settings, which allows a wide range of flexible machine learning methods to be used for nuisance parameter estimation while preserving valid inference. In practice, however, applied researchers must choose among many machine learning algorithms for nuisance models, and the impact of this choice on the variance estimation of DML is not well characterized. We conduct a comprehensive simulation study to compare the coverage probability of DML confidence intervals across different machine learning algorithms. In this study, we compare (1) analytical confidence intervals derived by DML theory versus (2) bootstrap confidence interval. We use a set of learners including ordinary least squares, LASSO, Random Forest, LightGBM, and Neural Networks under different data generation settings. We evaluate the performance across difference settings by bias, confidence interval width, and most importantly, coverage probability. Our results show substantial variability in coverage performance across analytical and bootstrap confidence intervals, highlighting that learner choice plays a critical role in reliable DML inference. Surprisingly, we find that in many settings, when sample size increases, the coverage probability of both DML analytical and bootstrap confidence interval decreases. We further investigate coverage probabilities using a real dataset on rural urban differences among U.S. counties. The real data analysis discovers that (1) the model performance still varies by the learner choices and (2) greater rurality has a statistically significant increasing effect on county level obesity prevalence.
Read the full abstract

Statistical Methodology

Longitudinal Adaptive Experimental Design for Learning Multiple Target Estimands with Semiparametric Efficient Inference

Adaptive designs are increasingly used in clinical trials and digital experiments to improve estimation efficiency by updating treatment randomization probabilities as data accumulate. While most existing work focuses on settings with a single-stage treatment, adaptive designs for longitudinal studies with multi-stage, time-varying treatments remain relatively underexplored. In this work, we develop a general semiparametric efficiency framework for designing longitudinal adaptive experiments to optimize the estimation efficiency of a broad class of target estimands of interest. An efficiency-oriented design criterion is proposed to accommodate both single-estimand targets and joint optimization across multiple estimands. We demonstrate that optimal randomization at earlier stages depends on later-stage allocations, yielding a backward-recursive strategy for deriving the oracle design, and propose a longitudinal adaptive design to sequentially learn and target the oracle design using accumulating data. We further develop an adaptive-design-likelihood-based longitudinal targeted maximum likelihood estimator (ADL-LTMLE) for asymptotically normal and semiparametric efficient estimation of statistical estimands from dependent data collected from adaptive experiments, without relying on parametric model assumptions. Applying the framework to time-to-treatment-initiation effects that compare initiating treatment at a given stage with delaying initiation until a subsequent stage, we show that designs optimized for a particular stage-specific effect can substantially compromise estimation efficiency for effects defined at other stages, highlighting the design trade-offs addressed by our framework. Simulation studies show the proposed design and estimation approaches achieve substantial variance reductions relative to non-adaptive designs, with performance close to that of the oracle design.
Read the full abstract

Statistical Methodology

Predicting Bot Vulnerability from Posting Trajectories: Censored Functional Regression under Informative Sampling

In this manuscript, we propose a novel framework for Scalar-on Censored Informative-design Functional Regression or SoCIFR. This setting is increasingly common in modern longitudinal and digital data applications but remains underdeveloped in functional data literature. We first discuss estimation and prediction in SoCIFR and extend the methodology to accommodate a matched case-control design. The proposed methodology is further generalized to handle multiple functional predictors, allowing for both censored and uncensored trajectories, observed under informative or non-informative sampling designs. Through simulation studies, we assess the performance of the proposed methods under various data-generating scenarios. We apply the methods to the motivating application for predicting user susceptibility to automated ("bot") interactions at increasing future time horizons based on social media behavioral trajectories observed over fixed time windows.
Read the full abstract

All authors Jake Koerner, Ana-Maria Staicu, Caitrin Murphy, Eric Laber, Mihai Nicola, William Rand, Zakaria Babutsidze

Machine Learning (Statistics)

The Greedy Advantage in Finite-Horizon Bandits

Organizations increasingly rely on sequential experimentation to improve decision-making. While the multi-armed bandit literature has developed algorithms with strong asymptotic regret guarantees, many practical applications operate over finite and externally imposed horizons. Motivated by the finite-horizon setting, we develop a class of regularized greedy algorithms for multi-armed Bernoulli bandits. We derive the first finite-horizon regret envelopes for regularized greedy bandits, showing that finite-horizon regret decomposes into transient exploration costs and a suboptimal convergence term that decays exponentially with the regularization strength. This characterization yields principled calibration rules for the regularization parameters and, as a limiting case, sharper regret guarantees for the classical greedy policy. Across extensive numerical experiments, calibrated regularized greedy policies consistently match or outperform state-of-the-art algorithms. These results suggest that regularized greedy policies can provide an effective approach for finite-horizon bandit problems.
Read the full abstract