Peer Revenue Fully funded

Papers

Fresh from arXiv, typeset properly. Highlighted words trade on the market.

Statistics

stat Watch Statistics (sign in to use)

Tuesday 8 September

Statistical Methodology

Cursive: The Trace from the Curse of Dimensionality

Modern data are increasingly high-dimensional or non-Euclidean. As dimension grows, new statistical patterns can emerge in the relations among observations, while a conventional statistical summary may fail to retain the signal they carry. This paper names and organizes a research program around this observation, calling it Cursive. Cursive asks which relational information is lost when the summary is formed and how the analysis should be redesigned around that information. The canonical example is the generalized edge-count test, which keeps the two within-sample edge counts whose opposing deviations can cancel in the classical between-sample count. This paper traces how the same design question has led to task-specific methods built from graphs, graph-based ranks, kernels, and dissimilarity profiles for testing, change-point detection, covariate-balance assessment, clustering, classification, and generative-model evaluation.
Read the full abstract

Machine Learning (Statistics) · Cross-listed from cs.LG

AlphaRJM: Reward-Jump Memory for Stochastic Return-Guided Alpha Discovery

Formulaic alpha discovery is a pool-dependent symbolic search problem in which informative feedback is observed primarily when a complete expression is evaluated. This delayed feedback creates two coupled difficulties: the retained alpha pool does not preserve the full history of realized evaluation feedback, and the value of an intermediate construction action is uncertain because its consequence depends on the formula eventually completed. We introduce AlphaRJM, which addresses these difficulties through Reward-Jump Memory, an event-driven latent state that remains fixed during token construction and updates only at terminal evaluation events using the realized pool reward and evaluation outcome, and an action-conditioned SDE return critic that represents future discounted discovery returns with stochastic particles. The particles guide action selection through their mean and uncertainty and are learned using a distributional Bellman objective combining energy-distance matching, mean calibration, and jump regularization. Empirically, AlphaRJM delivers strong and stable gains across multiple equity universes, forecasting horizons, and random seeds, while ablations confirm the complementary roles of persistent evaluation history, stochastic return modeling, and distributional supervision.
Read the full abstract

Statistical Methodology

Instability in Patient Clustering: A Multiverse Analysis of Unsupervised Clustering in the CENTER-TBI cohort

Understanding patient heterogeneity is key to improving prognostic modeling in traumatic brain injury (TBI). Unsupervised clustering is widely used to explore patterns in patient characteristics that may define subgroups. However, it involves a multitude of decisions, including the choice of algorithm, the distance metric, and the method used to determine the "optimal" number of clusters. The aim of this study is to investigate how these choices influence the resulting clustering solution. We analyzed data from 4,509 patients enrolled in the Collaborative European NeuroTrauma Effectiveness Research in TBI (CENTER-TBI) study. K-medoids, agglomerative, and spectral clustering were applied in a complete 3 X 2 X 2 factorial design, in combination with Euclidean or Gower's distances, and silhouette score or gap statistic to choose the number of clusters. We investigated the agreement of clustering solutions with UpSet Plots and stability with the (adjusted) Rand index. Comparisons were made both across approaches using the original dataset and within approaches using bootstrap resampling. Clustering results varied substantially depending on the analysis choices. The number of suggested clusters varied widely, from one to twenty-five. Adjusted Rand indices confirmed low concordance between methods. Moreover, none of the clustering solutions demonstrated discriminatory performance comparable to a supervised logistic regression model in classifying patient recovery illustrating the limited usefulness of clustering for this purpose. The high instability in clustering results compromises interpretability and underscores that such solutions should not be blindly interpreted as underlying structure.
Read the full abstract

All authors Sean R E A Bagcik, Aneeta Merlin Chacko, Ewout W Steyerberg, Maarten van Smeden, Andrew I R Maas, Erik van Zwet, Nicole S Erler

Machine Learning (Statistics)

Non-Adaptive 1-Bit Mean Estimation: Minimax Rates and the Sample-Interval Tradeoff

We study distributed one-dimensional mean estimation under a 1-bit communication constraint. Each agent observes one sample, drawn independently from an unknown distribution, and returns a single bit in response to a query $Q: \mathbb{R}\to\{0,1\}$ chosen by a central learner. The distribution has mean in $[-\lambda,\lambda]$ and $k$-th central moment at most $\sigma^k$, for a fixed $k>1$. The order-optimal two-stage protocol of Lau and Scarlett uses responses from the first batch to choose the second-batch queries, motivating the question of whether this single round of interaction is necessary. We answer this negatively: for every $k>1$, a non-adaptive protocol attains the adaptive 1-bit minimax rate (and concurrent works reached the same conclusion via different strategies). We further determine the minimax sample complexity among non-adaptive 1-bit estimators when every one-set $Q^{-1}(1)$ is restricted to a union of at most $s$ intervals. Relative to unrestricted non-adaptive 1-bit querying, this constraint adds a term of order $(\lambda\sigma/(s\varepsilon^2))\log(1/\delta)$, giving the full tradeoff between sample complexity and interval complexity to within $k$-dependent constant factors. As a corollary, we identify, order-wise, the minimum interval budget needed to retain the unrestricted 1-bit minimax sample rate.
Read the full abstract

Statistical Methodology

Evaluating Efficiency of Platform Trials Under Delayed Outcomes Using Treatment Throughput

Background: Platform trials improve efficiency by enabling early stopping of ineffective arms, shared controls, and addition of new treatments without compromising statistical properties. However, delays in observing primary outcomes may reduce these benefits. Investigators must either pause recruitment, delaying identification of effective treatments, or continue recruitment, potentially enrolling participants who cannot benefit from interim decisions. We assess the impact of outcome delay on platform trial efficiency using a novel metric. Methods: We propose Expected Throughput (ET), defined as the expected number of treatment arms evaluated per 1000 participants. ET accounts for participants recruited while awaiting outcomes. We consider a multi-stage sequential design for each treatment arm and assess ET across different outcome delays, assuming uniform patient accrual. Results: Outcome delays substantially reduce platform trial efficiency, with the impact dependent on recruitment rate and delay length. At a recruitment rate of 10 patients per month, severe losses occur when delays exceed 12 months. When outcome delay exceeds two-thirds of the time required to recruit a single arm, substantially fewer treatment arms are evaluated than anticipated. Conclusion: Outcome delay can markedly reduce platform trial efficiency. Recruitment rates and expected outcome delays should therefore be considered during trial planning.
Read the full abstract

Machine Learning (Statistics) · Cross-listed from math.OC

The Exact Time-Uniform Rate Frontier for Stochastic Gradient Descent on Smooth Convex Objectives

We study the time-uniform convergence of the raw iterate of standard stochastic gradient descent (SGD) for unconstrained smooth convex objectives. We prove that, under standard noise assumptions, the time-uniform convergence rate gets arbitrarily close to $\sqrt{\log n / n}$ but never reaches it. More specifically, we prove that for every positive, eventually nondecreasing sequence $h$ satisfying $h(n) = o(\sqrt{n})$, a bound of order $h(n)/\sqrt{n}$, holding simultaneously for all $n$ with probability at least $1-\alpha$ and uniformly over the problem class, is achievable if and only if \[ \sum_{j = 1}^{\infty} \frac{1}{h(2^j)^2} < \infty. \] The constructive sufficiency result follows from a dyadic horizon-free schedule together with an additive conditional-restart inequality. The necessity counterpart applies to every deterministic nonnegative schedule and holds even for a one-dimensional analytic smooth convex objective with Gaussian noise.
Read the full abstract

Statistical Methodology

Transfer Learning with Heterogeneous Feature Spaces in Linear Regression

Transfer learning improves target-task performance by leveraging related source data. Most methods assume shared feature spaces, yet in many applications, each source observes only a subset of target covariates. Classical imputation fails here due to block missingness, and standard imputation matrices are not optimized for target parameter estimation. We study low- and high-dimensional linear regression and propose Heterogeneous Importance Weighting (HIW). Our method aligns feature spaces via projection-based imputation and transfers information through sample-selected importance weighting. This framework accommodates diverse projection matrices to construct target-oriented imputation. We develop a classification-based procedure with pseudo-responses to estimate conditional error densities for the weights. We establish entry-wise and global convergence rates for the estimator, with numerical and real-data studies demonstrating its effectiveness.
Read the full abstract

Statistical Methodology

Nonparametric framework for the definition, adaptive detection and probabilistic interpretation of outliers

Outlier detection is a fundamental challenge in data processing, with critical implications for robustness across statistical modeling, machine learning and exploratory data analysis. However, existing proposals rarely offer a universal, domain-agnostic definition of an outlier, often relying on heuristic trimming quotas that lack a statistical interpretation. To address this, we propose a nonparametric framework built on a pseudo-isolation outlier score. This score enables a formal, probabilistic definition of an anomaly tied to a false-alarm rate $\alpha$, which extends into a rigorous geometric classification of internal and external outliers. We show that this mechanism seamlessly embeds into any objective-based clustering framework to identify cluster-specific outliers. Here, we integrate it into $K$-means to create ODK-means. The inferential capabilities and topological properties of this framework are explored both theoretically through formal propositions and empirically through extensive simulations and methodological tutorials, highlighting the practical actionability and intuitive appeal of the proposed outlier detection logic.
Read the full abstract

Statistical Methodology

Structure-based Transfer Learning

Transfer learning improves estimation in a target study using information from related sources. Classical transfer learning is typically data-based, requiring access to the source data or to a model fitted on them. Neither is available in many modern studies, as both are often proprietary or unreported. What can be transferred instead is structure: summarized information derived from a source, such as the supports of predictors, which is available and interpretable without access to the source data or model. The prevalence of the Large Language Model (LLM) provides a rich source of such structure information. However, data-based transfer learning can not well utilize it as accessing the data and model of the LLM is often infeasible. In this paper, we propose a novel transfer learning framework based on structure. In particular, we focus on linear model and aim to use supports generated by multiple agents, such as LLM, to improve estimation in the target study. Our procedure maps each support into the target parameter space, aggregates the results with data-driven weights, and applies a sparse correction against inaccurate supports. We establish nonasymptotic guarantees: the estimator improves on the target-only Lasso when the supports are informative and never does worse otherwise. Simulations and a gene-expression application confirm both properties.
Read the full abstract

Statistics Theory

Statistical Inference for Additive Monotone Models under the Fixed Lattice Design

We study statistical inference for least squares estimators (LSEs) in additive monotone models under a general fixed lattice design. We establish joint limiting distributions for the LSEs and show that the estimators of different additive components are asymptotically independent. The form of the limiting distribution of each component is determined by how fast the number of design points along the corresponding coordinate grows relative to the total sample size n. Apart from this growth rate, the limit depends only on the noise level and, in the non-Gaussian regimes, on the local derivative of the component. In particular, the limit does not depend on the dimension of the model. When the number of design points along a coordinate grows faster than n^(1/3), we construct tuning-free pointwise confidence intervals based on a pivotal limiting distribution, and we validate the theory in numerical simulations. We further show that the block-size normalization underlying these intervals fails to be pivotal at the critical growth rate n^(1/3). We also prove a switching lemma, of independent interest, that simplifies the derivation of limiting distributions in isotonic regression.
Read the full abstract

Statistical Methodology

Bayesian Group Testing Regression with a Shape-Free Dilution Curve

Group testing pools specimens to cut the cost of screening, but pooling positive specimens with negative ones lowers assay sensitivity, so that the sensitivity of a pooled test depends on how many of its members are positive. Regression models for group testing accommodate this dilution effect through submodels that fix a one-parameter shape for that dependence. We propose BADGER (Bayesian Analysis of Dilution in Group tEsting Regression), a regression model incorporating a shape-free dilution curve. The pooled sensitivity is modeled as a nondecreasing function represented by nonnegative increments with a Dirichlet prior, so that the parametric submodels become special cases. By an appropriate augmentation, every full conditional of BADGER is in closed form and inference is carried out by an exact Gibbs sampler. The evidence for dilution is measured by a Bayes factor computed from the posterior draws. We validate the BADGER model through simulation studies across different dilution shapes, prevalences and pool sizes. We further illustrate the method on hepatitis E serology from a national health survey.
Read the full abstract

Statistics Theory

Nonparametric Inference for Cumulative Residual Mathai–Haubold Entropy of order $\alpha$

In this paper, we study the properties of cumulative residual Mathai–Haubold entropy of order $\alpha$. A dynamic version of this entropy measure is then proposed, and its properties are examined within the framework of reliability modeling. We show that the dynamic cumulative residual Mathai–Haubold entropy of order $\alpha$ uniquely determines the survival function. Characterization results for the exponential and generalized Pareto distributions are derived using the proposed measure. Furthermore, we develop nonparametric estimators for the cumulative residual Mathai–Haubold entropy and its dynamic counterpart of order $\alpha$, based on the kernel estimation of the survival function. The performance of these estimators is evaluated through a Monte Carlo simulation study. Finally, the practical relevance of the proposed dynamic estimator is illustrated using two real data; failure-time data from aircraft windshields and failure-time data from 40 randomly selected mechanical switches.
Read the full abstract

All authors Anija C.R, Smitha, S., Sudheesh, K. Kattumannil

Statistics Theory

A note on a local entropy condition in the Wasserstein space

Entropy conditions are widely used in empirical-process analyses to establish asymptotic properties of M-estimators. In regression problems with responses taking values in a general metric space, a commonly imposed condition requires the entropy integral associated with a shrinking ball centered at the target object to remain uniformly bounded as the ball radius tends to zero. We show that this condition generally fails in the quadratic Wasserstein space of univariate probability distributions supported on a compact interval. Specifically, when the target object is a strictly increasing and absolutely continuous distribution function whose derivative is bounded away from zero and infinity, the corresponding entropy integral diverges as the ball radius tends to zero. The same divergence persists even when the ambient space is restricted to the class of distribution functions satisfying fixed uniform two-sided Lipschitz bounds. These results indicate that different asymptotic analyses are required for the quadratic Wasserstein space.
Read the full abstract

Statistics Applications · Cross-listed from physics.ao-ph

GCMagicc v1: a fast generative emulator for multivariate climate-impact ensembles

Projecting the impacts of climate change requires large ensembles of climate variables that match historical observations, align with the warming ranges assessed by the IPCC, and can efficiently run new future emissions scenarios, including the newest generation of climate model scenarios (CMIP7) and pathways consistent with countries' Paris Agreement pledges. Generating such ensembles at the scale needed for impact studies is normally computationally prohibitive. We close this gap with GCMagicc, a hybrid model that pairs a simple physical climate model with machine learning to generate ensembles of 10 climate variables at the resolution of full-scale Earth system models, without relying on GPU resources or retraining for new scenarios. Trained on 32 CMIP6 Earth system models and observational/reanalysis data, GCMagicc complements rather than replaces Earth system models. We apply it to a range of future pathways: the canonical SSP scenarios of the latest IPCC report (1.2-6.1{\deg}C warming, min-max across scenarios of 5-95 percentile ranges), current policies (2.3-4.0{\deg}C), national pledges under the Paris Agreement (1.5-3.3{\deg}C) and the CMIP7 range from the 'VL' to 'H' scenarios (1.2-4.2{\deg}C), releasing a large public dataset. As an illustration, we perform an attribution analysis of the severe 2025 Iranian drought using GCMagicc ensembles, with three CMIP6 large ensembles for comparison, with and without anthropogenic forcings. The results suggest a strong anthropogenic signal: a median probability of drought at least as severe as observed of 29% with anthropogenic forcing, and zero under natural-forcing-only simulations. In the future, drought conditions are projected to materially worsen, amplifying the potential for agricultural and food security impacts and geopolitical conflicts that use water scarcity as a weapon. GCMagicc data is available at https://gcmagicc.org.
Read the full abstract

All authors Nicolai Meinshausen, Malte Meinshausen, Jared Lewis, Zebedee Nicholls, Sarah Schöngart, Alister Self, Xinwei Shen, Karla Spiller, Elisabeth Vogel

Statistical Methodology · Cross-listed from cs.LG

Geographically Regularized AUC-Maximizing Personalized Federated Learning

Accurate diagnostic and risk-prediction models are important for supporting clinical decision-making during infectious disease outbreaks. However, privacy and governance requirements may restrict patient-level data sharing across healthcare institutions, and data distributions often vary. Moreover, AUC is widely used to evaluate discriminative performance, motivating its direct optimization in model development. We propose geographically regularized AUC-maximizing personalized federated learning (GrAUC-PFL), which directly optimizes a smooth pairwise AUC surrogate to learn personalized models while keeping patient-level data local and accounting for institutional heterogeneity. Graph-based regularization encourages geographically neighboring institutions to have similar coefficient vectors while retaining a personalized models. Simulations and a real-data application suggest improved discriminative performance, particularly when geographically neighboring institutions have similar data-generating characteristics.
Read the full abstract

Statistical Methodology · Cross-listed from econ.EM

Designing Spatial Treatments

Spatial treatments are interventions assigned to locations potentially distinct from those of the responding units. We study their optimal design under a general model in which a unit's response diminishes with distance to a treated site. Our estimand of interest is an “uncontaminated” effect equal to the average impact of a single intervention site over all hypothetical sites. We propose a novel design based on a Matérn point process which separates treatments by a distance of at least $r$. A larger choice of $r$ reduces bias by separating interventions but increases variance by reducing their numerosity. We choose $r$ to maximize the rate of convergence of a Horvitz-Thompson estimator and prove that this is minimax rate-optimal. We provide weak conditions under which the estimator is asymptotically normal and propose a variance estimator.
Read the full abstract

Statistics Theory · Cross-listed from math.PR

Radial Marchenko-Pastur laws: projection characterizations and rigidity

Let \(R_p=\|x_p\|^2/p\Rightarrow \nu\) and \(p/N\to c\in(0,\infty)\). We prove that the radial quadratic-form condition (RQC), requiring energy in deterministic subspaces to follow the parent radius, is equivalent to the following spectral property: for one fixed \(\alpha\in(0,1)\), every deterministic rank-\(\lfloor \alpha p\rfloor\) projected covariance has empirical spectral distribution converging to \(\mu_{c\alpha,\nu}\). The radius law \(\nu\) may have arbitrary tails; no moment assumptions, conditional isotropy, or independence between radius and direction are required. We also show that the radius law can be recovered from the projected spectral limits when their common limit has finite second moment and subspaces of vanishing relative dimension carry vanishing normalized energy, again without moment assumptions on the original vectors. A finite-sample inverse estimate bounds quadratic-form defects by bounded tests of expected projected spectra. The converse argument combines angular symmetrization and fantope rigidity with a determinant comparison between radial column deletion and spectral trimming. A cancellation of the deleted radial factors makes the comparison error depend only on the deleted fraction, rather than on the magnitudes of the deleted radii.
Read the full abstract

Machine Learning (Statistics)

Distribution-free inference on the number of changepoints

Suppose we are given an ordered sequence of independent data whose distribution changes $K$ times at unknown locations, for some unknown $K \geq 0$. In this paper, we study the problem of performing distribution-free inference on $K$. First, we show an impossibility result: any distribution-free upper confidence bound on $K$ must be trivial and uninformative. Then, using conformal $p$-values, and under only the assumption that the data segments induced by the changepoints are exchangeable (within themselves) and mutually independent, we construct a finite-sample valid lower confidence bound on $K$, which we call the Conformal LOwer bound on Changepoint Count (CLOCC). We show that CLOCC is the only feasible way to provide a lower bound on $K$ under the stated assumptions, a property we refer to as its universality. We provide practical guidelines for choosing score functions that yield efficient and tight lower bounds. We evaluate CLOCC in several synthetic and real-data experiments, where it provides informative lower bounds on $K$, demonstrating its practical applicability.
Read the full abstract

Statistical Methodology

Multi-Objective Composite Longitudinal Biomarker Scores for Improved Cancer Risk Assessment

Repeated blood-based biomarker measurements can improve cancer risk assessment by capturing longitudinal changes missed by single-time-point analyses. Parametric Empirical Bayes (PEB) incorporates prior measurements to estimate individualized reference values, but existing implementations do not account for the time between measurements and rely on predefined panels with fixed combination rules. We developed improved Parametric Empirical Bayes (iPEB), which accounts for the intervals between serial measurements, adjusts for covariates, and performs feature selection and optimized biomarker combination. iPEB optimizes biomarker weights for specific clinical objectives, such as maximizing sensitivity at a prespecified specificity or diagnostic lead time. We evaluated iPEB through simulations and a real-world application using six protein biomarkers (pro-SFTPB, CEA, CA125, CYFRA 21-1, osteopontin, and HE4) from a case-control study nested within the Prostate, Lung, Colorectal, and Ovarian (PLCO) Cancer Screening Trial. The analysis included 324 lung cancer cases and 1,674 controls with at least two serial measurements; six centers were used for model development and four for independent validation. Optimized for sensitivity at 99% specificity, iPEB achieved 24.2% sensitivity in the independent test set, compared with 18.2% for conventional PEB applied to the same four-marker panel. Optimized instead for lead time, iPEB added approximately 50 days of lead time at that stringent operating point. iPEB improved lung cancer risk assessment in independent PLCO data, supporting objective-driven optimization of longitudinal biomarkers for early detection.
Read the full abstract

All authors Bitan Sarkar, Ana Maria Kenney, James P. Long, Johannes F. Fahrmann, Samir Hanash, Kim-Anh Do, Ehsan Irajizad

Machine Learning (Statistics) · Cross-listed from cond-mat.stat-mech

Speed Limit for Information Acquisition in Stochastic Learning Dynamics

Neural networks acquire internal representations through learning. In this work, we formulate stochastic gradient descent (SGD) as a Markovian stochastic process and derive a Fisher-information flow speed limit that bounds the rate at which trainable parameters can acquire information about latent variables in the data-generating process. The resulting inequality decomposes the information flow into drift and noise contributions, thereby quantifying the roles of deterministic learning forces and SGD-induced fluctuations from an information-theoretic perspective. We verify the bound in analytically tractable basis-function linear regression, where the information budget predicted by the bound reproduces the ordering and characteristic time scales with which different latent variables are encoded in the learned parameters. These results establish Fisher-information speed limits as a quantitative framework for diagnosing when and how different aspects of the data-generating mechanism are acquired during stochastic learning.
Read the full abstract

Statistical Methodology

Multicollinearity-agnostic feature screening for non-Euclidean responses: a factor adjusted approach

In high-dimensional settings, multicollinearity is a pervasive issue that can substantially impair the performance of feature screening methods based on marginal Fréchet regression. Feature screening for non-Euclidean responses becomes unreliable when ultrahigh-dimensional predictors suffer from multicollinearity, because feature-specific signals may be masked by shared latent factors. To mitigate this effect, we propose a Factor adjusted Fréchet sure independence screening procedure. The method first recovers latent common factors from the predictors and then evaluates each feature by the incremental Fréchet coefficient of determination contributed by its idiosyncratic component beyond the common factors. Under regularity conditions, we establish uniform approximation rates for the feasible screening utilities and prove the sure screening and sure ranking properties. Extensive numerical experiments provide compelling empirical support for the validity and effectiveness of our approach, particularly in scenarios with highly correlated covariates. We further illustrate the practical performance of our method through two representative non-Euclidean datasets: the ADNI dataset and the mortality dataset, both with distribution-valued responses.
Read the full abstract

All authors Moshu Xu, Leheng Cai, Yanmei Shi, Xu Guo, Qirui Hu

Statistical Computation

Optimal Slice-Adaptive Tuning of Hybrid Slice Sampling

Slice sampling is a Markov chain Monte Carlo algorithm that draws its next state uniformly from a "slice"—a super-level set of the target density function—at each iteration, thereby providing automatic local adaptivity to the scale of the target. In practice the exact slice is not known, so general-purpose implementations use an approximate slice that is grown from a starting interval of length $w>0$, with a computational cost that depends on $w$. This work presents an analysis of the average per-iteration number of target density evaluations, as a function of $w$, of hybrid slice sampling with various slice-finding schemes for targets with contiguous slices. The paper uses the results of the analysis to develop automated, slice-adaptive tuning schemes along with suboptimality bounds and asymptotic convergence guarantees. Simulations demonstrate that the tuning schemes reliably yield near-optimal slice-adaptive tuning with essentially no dependence on the initial setting of $w$.
Read the full abstract

Machine Learning (Statistics) · Cross-listed from cs.LG

GPU-Enabled Large-Scale Optimization Using Randomized Linear Algebra

This paper introduces rlaopt, a PyTorch-based package for large-scale optimization and scientific computing using randomized numerical linear algebra (RandNLA). Despite substantial progress in RandNLA-based algorithms, few implementations combine GPU acceleration with a simple interface for specifying optimization problems. rlaopt addresses this gap by providing GPU-enabled solvers for positive-definite linear systems and convex empirical risk minimization with constraints and regularizers. These solvers use RandNLA to accelerate conjugate gradient (NystromPCG), operator splitting (NysADMM), and stochastic gradient methods (SAPPHIRE). Moreover, rlaopt includes a modeling language that lets users specify problems using natural mathematical syntax. rlaopt automatically checks compatibility with the selected solver and performs the required problem decomposition. The solvers also support differentiation through their iterations, enabling applications such as hyperparameter tuning. Experiments on ridge regression, bounded multinomial logistic regression, and bounded elastic net identify when randomized preconditioning improves performance and demonstrate substantial speedups from GPU execution. The package is open-source under an Apache license, with source code at https://github.com/udellgroup/rlaopt and version 0.1.0 available on PyPI.
Read the full abstract

All authors Pratik Rathore, Zachary Frangella, Parth Nobel, Xuning Hu, Madeleine Udell

Statistical Methodology

Nonparametric heterogeneous causal mediation with orthogonal machine learning

Causal mediation analysis decomposes the total effect of an intervention on an outcome into a direct pathway and an indirect pathway transmitted through a mediator, but standard methods typically summarize these pathways using population average effects. In many applications, however, the indirect effect may vary substantially across individual profiles. We propose an orthogonal statistical learning framework for estimating heterogeneous causal mediation effects conditional on individual characteristics. The method constructs a class of weighted Neyman orthogonal losses motivated by influence function representations of weighted population average effects. These losses directly target conditional mediation estimands whose minimizers are locally insensitive to nuisance estimation errors. We implement the resulting learners under a two-stage meta-learning framework with regularized linear sieves as second-stage smoothers, and introduce a combination of targeted learning and orthogonal learning designed to improve stability when mediator density ratios are unstable. We establish $L^2$ and uniform limit theory and develop pointwise and uniform confidence bands. Simulation studies show that the proposed orthogonal learners reduce the mean integrated squared error by more than $50\%$ compared with existing model-based methods and provide computationally efficient inference in nonlinear settings. The CARDIA, PSACR, and STAR analyses reveal heterogeneous mediated effects across cardiometabolic, psychological, and educational settings.
Read the full abstract

All authors Jiaqi Tong, Yi Zhao, Bhramar Mukherjee, Fan Li

Monday 7 September

Statistics Applications · Cross-listed from cs.CV

Multi-View Structure-from-Motion Enables Oriented Projective Shape Analysis in Three Dimensions

Projective shape analysis provides a geometric framework for studying landmark configurations in digital images acquired by pinhole cameras. In the classical projective shape (PS) model, three-dimensional configurations ($k$-ads) are represented as points in $(\mathrm{RP}^3)^q$, $q = k - 5$. A nonparametric test is developed in Patrangenaru et al. [12], for this framework, to determine whether an object matches a design blueprint, with each configuration reconstructed from a single uncalibrated stereo pair. Such two-view reconstructions are identified only up to a 3D projective transformation, which may reverse orientation, so that the sign-blind PS summary was the only available, before oriented projective shape (OPS) was recently considered. Multi-view Structure-from-Motion (SfM) technology removes this obstruction: its bundle adjustment is identified up to an orientation-preserving projective transformation. In this paper we revisit a well-cited three-cube object, from Patrangenaru et al. [12], with $n = 8$ SfM reconstructions built in Agisoft Metashape Professional 2.3.0, and validate our implementation by reproducing the published stereo construction from the original data. This allows us to perform what is to the best of our knowledge the first three-dimensional OPS analysis, compute its extrinsic total-variance index and perform statistical inference in this novel setting. Due to the high concentration of SfM data, the OPS index is asymptotically one-half the PS index, a structural consequence of concentration rather than a property of the object. Here our blueprint hypothesis is not rejected for any of the $q = 14$ non-frame landmarks, while the SfM reconstructions are about 26 times more concentrated than the stereo ones, a substantial gain in reconstruction precision. Sample-size, photograph-count, and frame-ordering analyses support the robustness of these conclusions.
Read the full abstract

Statistics Applications

Pre-game paired-comparison modeling of professional League of Legends map outcomes

We build and evaluate a pre-game win-probability forecaster for individual maps (“games”) in professional League of Legends (LoL). The proposed model is a one-stage logistic regression fit end-to-end on the win/loss log-loss: each team's exponentially-weighted moving average of past same-side results, a ridge-shrunk stable strength that is the maximum-a-posteriori estimate of a logistic mixed model, and a first-pick draft covariate, natively calibrated out of sample (walk-forward slope $0.995$). It augments a purely dynamic Bradley–Terry specification with stable team strengths. A second, independently built two-stage composite mixed model under restricted maximum likelihood (REML) and best linear unbiased prediction (BLUP) shrinkage, with Platt calibration, serves as the strongest rival the authors could build. On $5{,}135$ games across six regional leagues and three international events (2024–2026), under paired per-game Diebold–Mariano inference, the two architectures are statistically indistinguishable on every protocol and window (global holdout $0.2230$ vs.\ $0.2257$; walk-forward $0.2207$ vs.\ $0.2215$), so the simpler model is preferred on parsimony, not accuracy; both improve on the classical dynamic benchmark ($0.2351$) by a clear margin and on the static fits ($0.2301$/$0.2268$) more modestly. Against Polymarket on $928$ matched maps, the forecasts are statistically indistinguishable from the market on its own per-game contracts, with a modest market edge concentrated on cross-region Worlds and series-decider maps.
Read the full abstract

Statistical Methodology

Bayesian Matrix-Valued Graphs for Context-Dependent Multivariate Relationships

Many scientific graphs attach several variables to each node, so a single scalar edge weight cannot describe direction-dependent interactions. We model each edge by a symmetric positive-definite (SPD) matrix and infer a posterior over matrix-valued graph geometries, which we call the Bayesian matrix-valued graph (BMVG). We ask how these interactions reconfigure across contexts: how large the change is and which multivariate directions strengthen or weaken. The geodesic distance induced by the affine-invariant Riemannian metric (AIRM) quantifies deformation magnitude and generalized eigenvalues resolve its signed directions.Against fused graphical lasso, Bayesian multiple-GGM, and common principal components, BMVG is competitive on global precision recovery while retaining identifiable matrix-valued edge structure and accurately recovering edge-level deformation directions. In controlled known-truth experiments, it resolves structural change with increasing sample size, including orientation changes that leave ordinary eigenvalues unchanged. In one year of Bay Area weather data, the geometry of 12-hour change reconfigures spatial coupling about as much as whole seasons differ. In TCGA-BRCA, estrogen-receptor (ER)-associated reconfiguration concentrates on specific gene-module pairs and persists under graph-scaffold sparsification and removal of subgroup mean differences. These results establish posterior matrix-valued edge geometry as a unified framework for quantifying and interpreting context-dependent multivariate reconfiguration.
Read the full abstract

Statistical Methodology

Risk-Aware Goal-Oriented Bayesian Optimal Experimental Design

Traditional Bayesian optimal experimental design (OED) selects measurements that best inform a model's parameters. However, such measurements can be suboptimal for downstream predictions. Goal-oriented OED targets the prediction directly. However, the existing goal-oriented criteria value all reductions in predictive uncertainty equally, with no way to prioritize rare, high-consequence outcomes. In this article, we develop a risk-aware framework that composes risk at three levels, each generalizing an ingredient of classical $I$- and $G$-optimal design: a deviation measure of the posterior predictive uncertainty (generalizing the predictive variance), a risk measure across the prediction domain (interpolating $I$-optimal averaging and $G$-optimal worst-case selection), and a risk measure over datasets (generalizing the expectation). We generate each level from a regret function in the risk quadrangle, so that one triple specifies a practitioner's risk preference. We relax the design to continuous weights on the unit simplex and construct a nested-quadrature estimator that is differentiable in the design variable. This enables solving the optimal design problem with gradient-based methods, avoiding a combinatorial search over candidate designs. For a linear-Gaussian lognormal model and a nonlinear extension, we derive closed-form objectives. These give exact references against which we verify that the estimator converges. We demonstrate this framework for finding optimal sensor placements in an inverse problem governed by an advection-diffusion equation. We find that the risk-aware designs substantially outperform the expected-information-gain baseline, which is statistically indistinguishable from a random allocation.
Read the full abstract

All authors John D. Jakeman, Rebekah White, Bart van Bloemen Waanders, Drew P. Kouri, Alen Alexanderian

Statistics Theory · Cross-listed from cs.LG

Sharp Structure-Agnostic Minimax Risk for Partial Linear Models

We characterize the sharp structure-agnostic minimax risk for coefficient estimation in the partial linear model when the outcome and treatment nuisances are learned by two distinct black-box learners, which resolves the open problem in double machine learning posed by Gu (2025). For each nuisance \(q\in\{\mu,\pi\}\), we characterize the available learner by an approximation-error budget \(a_q\) and a stochastic-error budget \(s_q\), with the latter controlled through localized Rademacher complexity. Writing \(\mathcal E_n\) for the minimax mean-squared error, we show that \[\mathcal E_n\asymp1\wedge\left\{\frac1n+\left(a_\mu a_\pi+\min\left\{a_\pi s_\mu+s_\pi^2,\,a_\mu s_\pi+s_\mu^2\right\}\right)^2\right\}.\] The main new ingredient is a novel lower bound for the general two-learner problem. Our proof constructs four finite-mixture testing experiments using orthogonal code functions. Across these experiments, the hidden perturbations are placed outside both learner classes, outside only the treatment learner class, outside only the outcome learner class, or inside both learner classes. These four configurations capture, respectively, the interaction between the two approximation errors, the two asymmetric interactions between one learner's approximation error and the other learner's learning error, and the joint estimation difficulty of learning both nuisances. Combining the four resulting lower bounds yields the displayed rate, which matches the latest upper bound in Gu (2026). Our result shows that standard double machine learning can overstate the intrinsic difficulty of target estimation and provides a target-specific principle for learner selection: approximation error and stochastic complexity must be jointly balanced across the two nuisance learners rather than optimized separately.
Read the full abstract

Statistics Applications · Cross-listed from cs.AI

When Can LLM Digital Twins Reduce Human Measurement? From Behavioral Fidelity to Statistical Substitutability

LLM-based digital twins promise to reduce repeated human data collection by generating person- specific responses, yet existing evaluations provide little evidence about whether they can reduce human measurement while preserving valid inference. To address this, we introduce statistical substitutability, an inferential criterion that evaluates the extent to which twin predictions can reduce human measurement for a particular estimand while preserving valid inference. We develop a framework, grounded in mixed-subject and prediction-powered inference, that evaluates statistical substitutability along four dimensions: aggregate fidelity, paired respondent-level signal, finite-sample human-label recovery, and stability across populations. Across two empirical evaluations spanning behavioral experiments, multiple models, and alternative respondent representations, we find that digital twins can reproduce average human effects while providing little information about which individuals differ from those averages. Newer models and richer respondent information improve some dimensions of performance but do not reliably translate into human-data savings. Human calibration can reduce aggregate prediction error, yet limited labeled samples often fail to produce stable precision gains. Importantly, these findings demonstrate that behavioral fidelity is neither necessary nor sufficient for statistical substitutability. More broadly, they suggest that AI-generated evidence should be evaluated based on its ability to support valid scientific inference rather than its ability to reproduce human outcomes alone. Digital twins should therefore be judged for confirmatory use by whether they reduce uncertainty about human quantities, not merely by whether they reproduce human means, distributions, or effects.
Read the full abstract

All authors Steven Wang, Kyle Hunt, Shaojie Tang, Kenneth Joseph