Statistical Methodology
Stable Causal Estimation with Optimal Transport
Yidan Xu, Yixin Wang and XuanLong Nguyen
In observational studies, the overlap assumption, also called positivity, is frequently strained in practice. Limited overlap destabilizes widely used
estimators such as inverse propensity weighting (IPW), whose variance depends on density ratios that explode as propensity scores approach zero or one. To address this challenge, we propose the Stable Transport
Estimator (STE), an optimal transport-based approach for estimating average causal effects when overlap holds but strict overlap fails. Unlike IPW, the variance of STE contains no density-ratio factor; it is governed by the transport map itself and stays finite under bounded moments, even when density ratios diverge. By replacing reweighting with a geometry-aware transport map, STE constructs stable counterfactual comparisons without requiring density estimation or propensity score modeling. STE further extends to settings where the overlap condition is violated: when
covariate supports overlap only partially, a linear interpolation transport map enables principled extrapolation with explicit bias-variance trade-offs. We establish consistency, asymptotic normality, and a variance characterization that makes explicit the contribution of the estimated transport map to the asymptotic variance. Across synthetic and real
datasets, STE demonstrates improved robustness, reduced bias, and markedly more stable variance compared to existing
estimators.
Read the full abstract ▾
Statistical Methodology
Precision follows the decision: how well an acceptance probability is known for mean-spread release rules
Remus Osan
Many release rules accept a lot when a statistic built from the sample mean and standard deviation stays within a limit, and the probability that a process passes such a rule can be computed exactly for a broad class of parent distributions. This paper asks how well that probability is itself known once the parent has been estimated. Under a stated reference posterior the answer is an interval, narrow where a lot clearly passes or fails and wide where it is contested. In ninety-eight published content-uniformity lots that position, not the sample size, sets the width: among the forty-eight lots assayed at the same ten units, and so equally informed about the spread, the $95\%$ interval runs from essentially zero width to $0.96$. With the operating point held fixed while test and estimation sample grow together, the interval narrows only slowly, the contraction of the posterior being offset by the steepening of the operating characteristic; a calibrated study at the sample sizes of $1207$ occupational exposure assessments shows the same under a half-plane rule. For a pure-spread rule under a Normal parent the interval has an exact chi-square form in the plug-in value and the two sample sizes, extending to the mean-spread wedge with a measured residual and containing Bergum's lower bound as one endpoint. With the parent's posterior formed from the same published summaries through the evaluator's own likelihood, the qualitative pattern survives but shape moves both endpoints and width: on the same lots a strong right skew lowers the pessimistic endpoint by up to a fifth and widens the interval by up to $0.22$. At the content-uniformity operating point studied, under a Normal parent, the symmetric error bar in standard use puts the lower endpoint $0.21$ too high and returns an upper endpoint above one, even with the full posterior covariance.
Read the full abstract ▾
Statistical Methodology
Closed forms all the way up: the sample variance of four observations
Remus Osan
The distribution function $F(y)=\Pr(S^2\le y)$ of the sample variance $S^2$ of four independent observations is elementary on its entire support for every
polynomial parent density on $[0,1]$ (without loss of generality), and we give it in finite closed form for the uniform, Beta$(2,1)$ and Beta$(2,2)$ parents. The support splits at $y = 1/6$, $2/9$ and $1/4$, with the ceiling at $1/3$, all fixed by geometry: in coordinates aligned with the cube diagonal the event $S^2\le y$ is a ball of radius $\sqrt{3y}$, the cube projects to a rhombic dodecahedron, and these are the levels at which the ball reaches its faces, edges and two kinds of vertices. The divergence
theorem reduces every moment of the clipped ball to integrals along circular arcs, so each regime closes in algebraic functions of $\sqrt{y}$ and inverse trigonometric functions. For the uniform parent the only non-obvious constant is $K_g = 12\sqrt2\arctan\sqrt2$, proportional to the mean width of the cuboctahedron; the Beta constants are rational expressions in $\pi$, $\sqrt2$, $\sqrt3$ and $\arctan\sqrt2$, as in the uniform case. At $n = 4$ the normal-theory $\chi^2$ recipe used in acceptance testing misplaces the $99$th percentile of $S^2$ by $50\%$ for the uniform parent. For three observations,
polynomial parents also give elementary closed forms (arXiv:2609.25333), but two elementary cases in a row do not guarantee a third, and we make no claim beyond $n = 4$.
Read the full abstract ▾
Statistical Methodology
A Cosine-Projection Framework for Choosing Among Cox HR, D-RMST, and Average-Hazard Tests in Survival Trials
Xiang Meng, Lu Tian and Hajime Uno
The log-rank/Cox hazard-ratio test remains the standard approach for the primary analysis of randomized trials with time-to-event endpoints and is fully efficient under proportional hazards (PH). Two model-free alternatives that have recently gained
attention are the difference in restricted mean survival time (D-RMST), a contrast on the time scale, and the more recently proposed ratio of average hazards (RAH), a contrast on the rate scale. Simulation studies suggest that the RAH-based test can outperform both under delayed treatment effects, but its efficiency has not been characterized analytically, and no unified framework explains how censoring and accrual affect the efficiency ordering among these tests. We show that all three statistics share a weighted-log-rank representation and derive their asymptotic relative efficiencies under local alternatives, including the first analytic efficiency results for the RAH-based test. Geometrically, each test defines a direction in a function space and the anticipated treatment effect defines a signal direction. A test's efficiency relative to the oracle test equals the squared cosine of the angle between these directions, so the asymptotic relative efficiency of any two tests is a ratio of squared cosines. Because censoring and accrual enter through an information weight, the framework shows how design choices can alter, and even reverse, the efficiency ordering. We illustrate the framework using the CheckMate 057 immunotherapy trial and corroborate the theoretical results through simulations spanning proportional- and non-proportional-hazards settings.
Read the full abstract ▾
Statistical Methodology · Cross-listed from math.ST
Energy-Guided Learning for Heat Equation with Noisy Source: Optimal Estimation and Generalization Bounds
Zixiang Zhou, Xiaohui Chen and Shanghua Teng
Data and the governing partial differential equations (PDEs) of continuous-time dynamical systems provide rich structure for statistical learning. A central challenge is how to integrate data with PDE constraints in a principled way to improve generalization. In this paper, we characterize the statistical estimation and generalization properties of learning solutions to the heat equation with a noisy source function from finite, randomly sampled data. We first derive a novel variational formulation, which we characterize as the minimizer of loss function for an energy regularized and ellipticity debiased Sobolev regression. By formulating the learning task as a supervised problem over space-time domains under physically meaningful norms, our approach goes beyond the traditional supervised learning framework by effectively leveraging auxiliary data—samples of the source function of the heat equation—to design a physics-informed energy regularization. Our analysis reveals that learning in linear parabolic PDEs exhibits intrinsic anisotropy between spatial and temporal regularity, in sharp contrast to the static elliptic problems, leading to fundamentally different estimation and generalization behaviors. Specifically, we derive non-asymptotically rate-optimal estimation errors, as well as generalization error, which explicitly capture the interplay among temporal sampling, spatial resolution, and solution smoothness. Our numerical experiments demonstrate substantial orders of magnitude of reduction in testing errors against various physics-informed neural network methods on various parabolic and
hyperbolic PDEs.
Read the full abstract ▾
Statistical Methodology · Cross-listed from stat.AP
A model-assisted design for phase I oncology drug combination trials incorporating backfill
Connor Celum and Evan M. Bagley
Historically, phase I oncology trials were designed with the focus to find the highest tolerable dose. However, given the FDA's acknowledgment that the highest tolerable dose might not be the dose which is optimal biologically, there is an increased emphasis the development of designs that explore the dose-toxicity and dose-efficacy relationship. Backfill designs have emerged as a popular response to address this need by allocating participants to doses deemed safe while awaiting participants outcomes. Previous designs have explored how to assign participants to doses in backfill designs in a rigorous manner while providing simplicity and performance (a class of designs known as model-assisted) for single
agents. Still, a research gap exists in the lack of model-assisted backfill designs for drug combinations. Frequently, the combinations two of cancer
agents are explored in phase I trials, with the goal of identifying the highest tolerable combination. This paper incorporates and extends methodology based on previous model-assisted backfill designs to provide clinicians with a simple-to-use backfill design for phase I drug combination trials.
Read the full abstract ▾
Statistical Methodology
Rate-Based Causal Discovery for Heavy-Tailed Models
Vishal Routh
In many complex systems, such as river networks and financial
markets, extreme events propagate from causes to their effects, and the largest observations carry the most information about the underlying causal structure. Existing methods for causal discovery in extremes, however, are tailored to specific mechanisms, such as linear or max-linear models. This work develops causal discovery for heavy-tailed homogeneous structural causal models, a flexible class that contains linear, max-linear and norm-type mechanisms, which may differ from node to node. In these models, the causal structure is encoded by ancestral impulse responses, which measure how a shock at one node is transmitted to its descendants. We propose the extremal minimum ratio
estimator of these responses, which uses only observations in which the potential cause is extreme. The
estimator is consistent under regular variation alone, and we derive its exact rates of convergence and limiting distributions, which depend on both the causal relation and the type of mechanism. Building on these rates, we construct consistent
estimators of the causal order and of the full set of ancestral relations, using a threshold that adapts to the data and requires no knowledge of the tail index. The method is illustrated on simulated data and on river discharges in the upper Danube basin.
Read the full abstract ▾
Statistical Methodology · Cross-listed from math.ST
Recurrent Barycenter Encoder: Prediction, Simulation and Applications to Time Series Analysis
Javier I Almarza
This dissertation has two parts. In the first part we theoretically develop a framework that extends the optimal transport barycenter problem from independent data with observed
covariates to processes whose relevant
covariate is their own history. Given a stationary
stochastic process, our framework shows there exists an invertible transport map that extracts from it an iid component whose distribution is the barycenter of the conditional distributions of the input process on its own past. This extracted iid sequence thus captures the innovation or noise component of the process that is not explained by the process's own past. In the second part of this thesis we implement an effective
algorithm to solve this problem and test it against synthetic data generated with some well-known models in time series analysis for which the solution is known in closed-form. We then show how this method can be applied to build a predictive sampler for such processes, and assess the accuracy of this predictive sampler both with the aforementioned synthetic data and with real-world time series such as the S&P 500 and Bitcoin 4-hour returns, and the daily records of the North Atlantic Oscillation index from the NOAA Physical Sciences Laboratory. Finally, we demonstrate an application of the sampler to path simulation with a well-known time series model.
Read the full abstract ▾
Statistical Methodology
Bayesian adaptive design for neural recruitment curves
Vishweshwar Tyagi, Saihari S. Dukkipati, Daniel Twili et al. (+4 more)
Nonlinear response models remain ubiquitous across disciplines with recruitment curves describing muscle response to neural stimulation. Conventional acquisition methods typically rely on static uniform sampling, requiring many stimuli, while adaptive threshold-hunting designs such as ML-PEST forfeit accurate characterization of the overall curve. We present a
Bayesian adaptive design that uses posterior uncertainty over curve parameters to propose stimuli that maximize information gain across the full recruitment curve. We additionally implement a focused acquisition method that can target arbitrary subset of curve parameters, which we use to evaluate and interpret our design. In simulations, our design outperforms uniform sampling in recovering threshold while matching ML-PEST, and outperforms ML-PEST in predictive curve accuracy while matching uniform. It likewise matches our threshold-focused acquisition, suggesting our design doesn't trade off threshold estimation for recovering the curve. We further show data collected using our design yields greater power when detecting a change in threshold in intervention studies. Our design proposes the next stimulus within 5 seconds, making it feasible for transcranial
magnetic stimulation (TMS) experiments. Finally, we validate our design in TMS experiments and provide a library for Python, called onMEP, for online acquisition of neural recruitment curves.
Read the full abstract ▾
All authors Vishweshwar Tyagi, Saihari S. Dukkipati, Daniel Twili, Jonas M. Mikhaeil, Andrew Gelman, Jason B. Carmel, James R. McIntosh
Statistical Methodology
An Algebraic Approach to Constrained K-means Clustering
Hiroki Oohori, Kentaro Fukushima and Michio Yamamoto
Clustering is typically performed using only object features, although additional information about relationships between objects may be available and can be incorporated through constraints. Among these, pairwise constraints require two objects to belong to the same cluster or to different clusters. Several extensions of the k-means
algorithm accommodate such constraints, but they sometimes fail to find a feasible assignment or incur high computational cost. Motivated by these limitations, we propose an algebraic approach to k-means clustering with pairwise constraints. The
algorithm simplifies the constraints using Gröbner bases before optimization, improving the efficiency of cluster assignment. It can also detect whether the constraint set has a feasible assignment before optimization. Comparative experiments with existing
algorithms showed that the proposed
algorithm achieved comparable or better clustering quality at a lower computational cost, particularly when the numbers of constraints and clusters were small.
Read the full abstract ▾
Statistical Methodology
Comparing randomized trials
Yu-Han Chiu and Issa J. Dahabreh
Disagreements between randomized trials that address the same causal question pose challenges for the interpretation and synthesis of evidence. We sketch a causal framework for comparing the results of randomized trials that explicitly accommodates the possibility of trial engagement effects. Using counterfactual outcomes defined under joint interventions on treatment assignment and trial-related actions, we compare trial-native treatment effects with the effects transported from one trial to the population of another in a common target population. We show that standard conditions for transporting treatment effects across trial populations are not sufficient to guarantee agreement between transported and trial-native effects. Agreement additionally requires conditions governing how trial-related actions affect outcome across studies - for example, absence of trial engagement effects, equivalence of such effects across trials, or lack of interaction between trial engagement and treatment assignment. Our framework clarifies potential sources of disagreement across trials and extends existing approaches to study comparison to settings in which trial engagement effects may be present.
Read the full abstract ▾
Statistical Methodology
An Unscented PrO Kalman Filter
Dan Kean, Zheyang Shen and Chris. J. Oates
Predictively-oriented (PrO) filtering for state-space models was proposed in Shen et al. [2026] as a promising route to avoiding over-confident inferences in settings where either the dynamical model, the measurement model, or both, could be misspecified. Our focus is on nonlinear state-space models, where the local linearisation used to construct the PrO filter in Shen et al. [2026] deteriorates as nonlinearities enter either the dynamical model or the measurement model. Our proposed solution is based on unscented transforms, an established tool from classical filtering which provides a more accurate mechanism to propagate Gaussian uncertainty through a nonlinear functional, and which includes the cubature rule as a special case. We introduce two variants: replacing the linearisation in the predict step alone, which we call UKF-PrO, has a computational cost comparable to the existing PrO filter; replacing it in the update step as well, UKF-PrO+, requires a substantially more expensive joint optimisation. Performance is empirically assessed on the Lorenz96 model under conditions of increasing difficulty, in which the state-space model is systematically misspecified; we find that UKF-PrO with the parameters of the cubature Kalman filter offers consistent improvements, which become substantial under strong nonlinearity, whereas the default unscented parameters are unreliable, and that the full update-step extension with the same parameters does not justify its additional cost.
Read the full abstract ▾
Statistical Methodology
The price of a weak shadow variable: inference under nonignorable missingness as relevance vanishes
Michael Bücker
When an outcome is missing not at random, identification is commonly restored by a shadow variable: a
covariate that predicts the outcome but is excluded from the response mechanism. The literature treats the first requirement, relevance, as a yes-or-no condition. We make it continuous, parametrizing it by a scalar that scales the shadow variable's entire contribution to the moment conditions, and ask what inference costs as that scalar vanishes. One functional of the inverse weight governs the answer. We characterize it exactly, show that it fixes the effective sample size, and use it to sharpen the rates of the
estimator that avoids the weight. The characterization is concrete. Whether the functional saturates or diverges turns not on boundedness of the outcome but on whether the tilting variable has an atom at its essential supremum: a binary outcome saturates, a uniform one does not. It also bounds how far a scanned set reaches, and that reach grows only as the square root of the logarithm of the sample size, so a thousandfold increase buys one unit of tilt while the set to be scanned widens without limit.
Read the full abstract ▾
Statistical Methodology · Cross-listed from q-bio.QM
Bayesian Uncertainty Quantification of Breast-Cancer Pathology AI Agreement under Reader- and Annotation-Condition-Dependent Reference Labels
Hammed A. Olayinka
Human reference labels used to evaluate medical AI can vary across readers and annotation workflows. We quantified agreement of a fixed pathology AI system with a future qualified reader without treating inferred consensus as error-free biological truth. Linked Evaluation and Unbiased NuCLS multirater data were analyzed using a fixed external HoVer-Net decision vector. The selected frame contained 1,144 anchors, 52 fields of view, five slides/patients, and five primary readers. The target was fixed-AI agreement with a future reader, with descriptive contrast $\Delta=\theta_E-\theta_U$. Analyses included raw agreement and iMRMC
benchmarks, reader-only and shared-detectability
Bayesian models, structural sensitivities,
adversarial simulations, and predictive assessment. Among 5,188 reader-anchor pairs observed in both conditions, 19.62% changed AI-agreement state, while raw agreement was 0.5466 in Unbiased and 0.5473 in Evaluation. The reader-only model gave $\Delta=-0.0008$ (95% CrI, $-0.0033$ to $0.0008$), and the shared-detectability model gave $\Delta\approx0$ ($-0.0140$ to $0.0127$). Across structural perturbations, absolute agreement ranged from 0.420 to 0.646 in Unbiased and 0.409 to 0.640 in Evaluation. Frozen
adversarial simulations met the comparative-stability criterion (median $R=0.295$; 14/16 model-scenario
cells had $R<1$). Held-out-AI prediction supported shared predictive information, but varied by slide composition. The Evaluation-minus-Unbiased contrast was comparatively stable, whereas absolute agreement was structurally sensitive. These findings do not establish equivalence, causal assistance effects, biological accuracy, or new-patient transportability. Evaluations using variable human references should report reader population, selected frame, observation mechanism, and structural sensitivity.
Read the full abstract ▾
Statistical Methodology
Cointegrated Regressors: Where Folded Concave Penalties Go Beyond LASSO
Hongqi Chen, Chengwang Liao, Ziwei Mei et al. (+1 more)
LASSO is one of the most popular regularization methods for high-dimensional regression models. While cointegration is common in practical applications of predictive regressions with many regressors, the convex penalty of LASSO overly suppresses the coefficients of cointegrated regressors and therefore fails to deliver consistent parameter estimation. We employ folded concave penalties (FCP), including the well-known SCAD and MCP, to address this issue. Using FCP, we establish two asymptotic results: (i) a local oracle property for the penalized regression, and (ii) a global oracle property for regressions with a penalty-level constraint. In particular, the latter guarantees a global solution that consistently estimates the true coefficients and enjoys oracle prediction performance. Simulation studies and an application to predicting the euro area unemployment rate show that FCP improves variable selection and out-of-sample prediction relative to LASSO.
Read the full abstract ▾
All authors Hongqi Chen, Chengwang Liao, Ziwei Mei, Zhentao Shi
Statistical Methodology
Identification and Estimation of Treatment Effects from Network Data with Confounded Social Links
Licheng Liu
In observational network data, the adoption of a treatment and the formation of social ties often depend on the same characteristics that affect outcomes. We propose a generalized propensity score for each unit's effective treatment, built from a model for treatment assignment and a dyadic model for network formation, which may include latent node heterogeneity. The score is marginalized over the network given
covariates rather than conditioned on the realized network, and the estimand is a population effect: the average effect of an exposure level for a unit drawn from the population of units and networks. We relate this estimand to those of methods that condition on the realized network and show what marginalizing costs and buys. It requires network formation to be unconfounded given observed
covariates, a stronger assumption than unconfoundedness of treatment given the network. In exchange, it defines effects at exposure levels that poorly connected units cannot reach, and at levels every unit can reach it gives an
estimator whose asymptotic variance is no larger than the network-conditional one. We combine the score with an augmented inverse probability weighting
estimator, prove asymptotic normality as the number of networks grows with bounded network size, discuss what carries over to a single large sparse network, and apply the method to the effect of a political communication technology on political participation in Uganda.
Read the full abstract ▾
Statistical Methodology
Copula Active Subspaces II: Error Decomposition, A Posteriori Estimation, and Sharpness of the Bounds
Joshua Chen and Peter Jan van Leeuwen
The Copula Active Subspaces (CAS) method of Part I estimates a non-Gaussian observation-noise density $\pi_{\boldsymbol{n}}$ from residual samples. Its KL divergence $\mathcal{D}_{\mathrm{KL}}(\pi_{\boldsymbol{n}}\,\|\,\widehat\pi_{\boldsymbol{n}})$ admits an exact decomposition into marginal, projection and reduced-density terms and bounds the posterior KL divergence averaged over the true predictive distribution. We derive a priori bounds for these terms, together with estimates or bounds from residual samples. Weighted nearest-neighbour
entropy estimates are used for the marginal and reduced-density terms, with asymptotic standard errors in exact rank coordinates. For the projection error, the score is fitted on one subsample, and its mean squared magnitude outside the retained subspace is estimated on the other. Corrections for score and rank-transform errors then give a theoretical upper bound with probability at least $1-\delta$. Tests on three known noise laws in dimension $d=20$ use the estimated rank transform. In $11$ of $12$ combinations of example and sample size, the sum of the two estimated terms and the trace bound exceeds the reference divergence after averaging over the estimated models. In these tests, score-estimation error is the largest contribution to looseness. The overestimate from the Gaussian log-Sobolev inequality alone is at most a factor of $1.98$.
Read the full abstract ▾