Peer Revenue Publish or profit

Papers

Fresh from arXiv, typeset properly. Highlighted words trade on the market.

Statistics Statistical Methodology

stat.ME Watch Statistical Methodology (sign in to use)

Tuesday 22 September

Statistical Methodology

Should the pharmaceutical industry consider using high-order autoregressive models when modelling panel data?

Longitudinal data, often in the form of panel data, are commonly encountered in the pharmaceutical industry. However it is not always possible to fit an unstructured covariance matrix when using the Mixed Model for Repeated Measures (MMRM). Here we argue that high-order autoregressive models provide a useful framework when more general correlation structures, such as the unstructured and/or Toeplitz, are unfeasible. The autoregressive model of order one is often suggested but, in our experience, higher orders are seldom considered. We present the case for using autoregressive models, with potentially high orders, as a flexible framework to model correlations in panel data, when more general structures are hard to identify.
Read the full abstract

All authors Dan Jackson, Fanni Zhang, Abdul-Azeez Ganiyu, Rose Baker

Statistical Methodology

A non-parametric estimator for excess recurrent events

Measuring disease burden is an important part of both public health research and health economics. Some measures of disease burden, such as hospitalisations, are made up of recurrent events. Assessing what events are related to a particular disease is however non-trivial. We extend the notion of relative survival to recurrent events by developing a novel non-parametric estimator. The estimator combines data from some cohort with aggregated population level data to estimate the number of excess recurrent events. Using empirical process theory, we show that the estimator converges weakly to a mean zero Gaussian process under mild regularity conditions, and provide a consistent estimator for the covariance function. We also evaluate the finite sample properties of the estimator through simulations and provide a practical example using data from Swedish patients with rectal cancer.
Read the full abstract

All authors Jonatan Hedberg, Ola Hössjer, Caroline Nordenwall, Therese M-L Andersson, Elisavet Syriopoulou

Statistical Methodology

A Geometry-Aware Framework for Clustering Cylindrical Data

Cylindrical data pair an angle with a linear measurement. Clustering that ignores the periodicity of the angle breaks up groups lying across its origin. We formulate the K-means algorithm for a generic distance on the cylinder and instantiate it with the chordal distance of the ambient space and the geodesic distance along the surface, so that the two versions differ in the metric alone. Centroids are exact Frechet means computed with known tools: the mean direction for the chord, the circular Frechet mean for the arc. Seeded by K-means++, the algorithm converges in finitely many iterations at a cost comparable to classical K-means. Over an extensive empirical analysis on simulated data, Euclidean K-means is never meaningfully better and breaks down when clusters cross the origin; the two versions agree for concentrated angles, the chord incidentally prevailing only when the angle is uninformative; a model-based cylindrical mixture is the most variable method but describes elongated, correlated clusters better. In hue-value color image quantization, the cylindrical versions performs better on object detection based on color segmentation; on wind direction and nitrogen oxides data they recover two pollution regimes that Euclidean K-means cuts apart.
Read the full abstract

Statistical Methodology · Cross-listed from econ.EM

Target alignment, dilution and forecast selection when cross-sectional forecasts share a common target

Forecasters often score the same units per date against one standardized realized outcome. We show that every standardized forecast splits exactly into a component aligned with this common target and a component uncorrelated with it. Three consequences follow: forecast-error correlation largely mirrors forecast correlation and is therefore a poor measure of diversity; an equally weighted combination beats a no-information forecast only when average alignment is large relative to the combination's dispersion; and the gain from adding a forecaster separates into genuine improvement and mere dilution, which equal-weight admission can mistakenly reward. We develop a cautious selection rule, study it in simulations, and apply it to language-model forecasts of US equity rankings and mechanical signals ranking exchange-traded funds. Selection removes most dilution losses, but no combination beats the no-information forecast.
Read the full abstract

Statistical Methodology · Cross-listed from cs.LG

Beyond Scalar Sensitivity: Activation-Aware Mixed-Precision LLM Quantization with Cross-Layer Refinement

Mixed-precision weight quantization is commonly formulated as a Multiple-Choice Knapsack Problem (MCKP), yet existing solvers rely on scalar sensitivity proxies that collapse each weight matrix's Hessian into a single number and treat every module independently. We prove that even the optimal scalar proxy incurs multiplicative distortion up to $\sqrt{\kappa(\mathbf{A})\kappa(\mathbf{B})}$ relative to the full activation-aware quadratic, where $\kappa(\mathbf{A})$ and $\kappa(\mathbf{B})$ denote the condition numbers of the input- and output-side Hessian factors. This bound varies from $10^1$ to $10^{13}$ for typical LLM modules, making inter-module sensitivity ranking unreliable. To address these limitations, we propose Cross-layer Activation-aware Sensitivity Allocation (CASA), a two-phase method. In Stage 1, the scalar proxy is replaced by an activation-aware metric derived from the Kronecker-factored Hessian, reducing the MCKP to a form whose continuous relaxation admits a closed-form solution. In Stage 2, a cross-layer-aware local search evaluates bit-width updates using the end-to-end model loss. Experiments on multiple LLMs across different bit budgets show that CASA achieves lower perplexity than the latest scalar-proxy baselines, especially at ultra-low bit-widths ($<3$ bits per weight). Moreover, the performance gain in zero-shot accuracy tracks the per-model average condition-number over modules, confirming the distortion bound as a practical indicator of scalar-proxy failure.
Read the full abstract

Statistical Methodology · Cross-listed from math.PR

A Functional Central Limit Theorem for Locally Stationary Time Series in Banach Spaces

A functional central limit theorem for locally stationary time series taking values in a separable Banach space $B$ is established. The result does not require type-2 or cotype assumptions and therefore covers spaces central to functional data analysis, including $C([0,1])$ and $L^p([0,1])$. Under moment conditions, summable physical dependence coefficients, and a bracketing entropy condition controlling the infinite-dimensional tails, the centered and rescaled partial sum process converges weakly in $D([0,1],B)$. The limit is a centered $B$-valued Gaussian process whose covariance is given by the integral of the local long-run covariance, interpreted as an element of the projective tensor product. We also obtain a stochastic integral representation with respect to a cylindrical Brownian motion, connecting the Banach-space limit to the familiar scalar locally stationary structure. As an application, we derive a self-normalized CUSUM procedure for detecting changes in the mean of linear projections of Banach-valued observations, yielding a pivotal asymptotic null distribution. The finite-sample behavior is illustrated through Monte Carlo experiments and exploratory applications to EEG recordings and daily temperature curves. Examples based on the Faber-Schauder system in $C([0,1])$ and on a $p$-Laplacian model in $W^{1,p}_0([0,1])$ demonstrate how the entropy condition can be verified.
Read the full abstract

Statistical Methodology

Grouped Semi-Supervised Estimation of Two-Sample Functionals via Single-Index Conditional Imputation

Estimating two-sample comparison functionals within heterogeneous groups is challenging when outcomes are observed only for a small labelled subset while covariates are widely available. We develop semi-supervised estimation of group-specific two-sample comparison functionals and their prespecified aggregates. The proposed estimator combines single-index conditional imputation from labelled cross-arm pairs with averaging over all available covariate pairs. To handle index-score densities that may vanish at attainable endpoints, we use centred stabilization, with a smooth stabilizer in the profile criterion and a shrinking lower truncation of the kernel denominator (the hard floor) in the point estimator. The outer average retains all covariate pairs. Under a correctly specified single-index conditional-mean model and the stated regularity conditions, we establish consistency and asymptotic normality for bounded comparison functionals. A four-role original-observation influence representation accounts for sample overlap and identifies the variance component that unlabelled covariates can reduce relative to supervised estimation. We further establish conditional validity of observation-level multinomial perturbation resampling with complete refitting and shared labelled counts, distinguishing ideal variance consistency from finite-replicate variance estimation. Simulations show small bias and lower mean squared error than supervised estimation across the point-estimation settings, together with near-nominal coverage in the perturbation experiment. A descriptive NHANES 2011-2018 illustration comparing serum creatinine by hypertension history across age groups yields point estimates similar to their supervised counterparts and smaller semi-supervised standard errors for all reported comparisons.
Read the full abstract

Statistical Methodology

The Critical Line Algorithm and the Constrained LASSO: One Curve, Two Literatures

Many statistical procedures compute an entire solution path rather than a single estimator. For one class the path is piecewise linear, traced corner to corner by an active-set homotopy. Two of its members coincide exactly: under $\Sigma=X^\top X$ and $\mu=X^\top y$ the gross-exposure-constrained mean–variance program and the constrained LASSO trace the same piecewise-linear curve, and they keep doing so under arbitrary linear equality and inequality constraints. Which parameter is swept, a leverage budget or a return tilt, is not a choice the curve notices: under a homogeneous mandate the two sweeps differ by a scalar. A mandate that holds the portfolio invested costs a radial rescaling instead, and the efficient frontier is that curve rescaled; its corners pass unnoticed because the frontier is continuously differentiable where they fall. We give the map between the two parametrisations and the single way it degenerates. That mean–variance selection and the LASSO instantiate one parametric quadratic program is prior art (Gärtner, Jaggi and Maria, 2012). The Critical Line Algorithm itself lies off that route, and the correspondence established here is new. The identity is one of curves, not of statistical experiments. The map between the parametrisations is computed from the data, so the geometry of the path transfers while quantities averaged over the response do not. We cross that boundary deliberately and give the degrees of freedom of the constrained fit under arbitrary linear constraints. In the long-only, fully invested case it is the expected number of holdings away from a bound, less one.
Read the full abstract

Statistical Methodology

High-Dimensional Two-Sample Inference via Marginal Likelihood-Ratio Rank Statistics

We develop a rank-based framework for high-dimensional two-sample testing that detects marginal distributional differences beyond means and variances. Three marginal likelihood-ratio statistics generate SUM tests for widespread differences, MAX tests for concentrated departures, and Cauchy combinations for unknown signal sparsity. The procedures retain all pooled ranks and impose no moment conditions on continuous margins. For unequal but comparable sample sizes and dimension growing polynomially with their total, we establish normal limits for the studentized SUM statistics and Gumbel limits for the normalized MAX statistics under weak Gaussian-copula dependence. Their within-family asymptotic independence yields standard Cauchy limits for the combinations. The integrated maxima require family-specific centering corrections that accommodate interior, critical, and boundary regimes. Consistency is established under shrinking marginal and aggregate signals, with Cauchy combinations retaining MAX or SUM consistency on specified sparse and dense alternative classes. Simulations examine location, scale, and shape changes, including alternatives preserving the first two moments. Applications to acoustic measurements from a Parkinson's cohort and leukemia gene-expression data illustrate the complementary benefits of SUM and MAX aggregation.
Read the full abstract

Statistical Methodology · Cross-listed from math.DS

Identifiable Uniqueness of Impulsively Forced, Inert, and Stabilized Body Trajectories

An unusual object in the sky raises two related questions: what kind of object it is and what physical process drives its motion. Departures from a gravity-only trajectory can provide evidence, but the same apparent acceleration may be generated by distinct dynamical mechanisms. We formulate this as an identification problem and establish conditions for identifiable uniqueness among three reference classes: inert dynamics, impulsive forcing, and active stabilization such as a controlled spacecraft. The distinction rests on how each class responds to disturbances. Although different mechanisms can produce similar average trajectories, the specified reference models imply different stochastic responses around those trajectories. We show when these differences uniquely determine the dynamical class from the observed trajectory and when several classes remain observationally compatible.
Read the full abstract

Monday 21 September

Statistical Methodology · Cross-listed from stat.ML

PICPIs: Prediction-Interval-Conditional Prediction Intervals

A classical question in statistics is which observable quantities to condition on when drawing inferences about unobservable targets. For conformal prediction in nonparametric uncertainty quantification, standard marginal validity offers limited resolution at the prediction values on which decisions are based, and fully conditional guarantees with respect to the covariates are provably unattainable. We address this gap by introducing a prediction-based conditioning framework that we refer to as Prediction-Interval-Conditional Prediction Intervals (PICPIs). Formally, a PICPI is an interval $I$ satisfying a self-consistency condition: $$\mathbb{E} [Y \mid p(X) \in I] \in I,$$ for predictive model $p$, contextual covariate $X$, and outcome $Y$. Thus, an interval simultaneously defines a stratum of prediction values and certifies that the mean outcome in that stratum lies in the same interval. This self-consistency condition yields data-adaptive strata without altering the original prediction. Such intervals can be constructed using practical algorithms. Under regularity of the prediction distribution, the constructed intervals cover all but an arbitrarily small fraction of prediction values and have widths that decrease at rate $n^{-1/3}$, up to logarithmic factors and the prediction error. Moreover, identifying these locally calibrated intervals can, in turn, inform downstream decision-making. We derive inference procedures for PICPIs in probabilistic prediction and multi-class classification, accompanied by theoretical guarantees. Empirical results are provided that compare PICPIs with existing interval-based baselines.
Read the full abstract

All authors Xuelin Yang, Baihe Huang, Yilong Hou, Guido Imbens, Michael I. Jordan

Statistical Methodology · Cross-listed from cs.LG

Concept Drift from a Causal Perspective

Concept drift is a common phenomenon in real-world data streams, in which changes in the data-generating distribution can degrade predictive model performance. Most existing definitions characterize drift as changes in the joint distribution $P(\mathbf{x}, y)$, without distinguishing which component of the data-generating process has changed. In this work, we introduce a causal perspective on concept drift based on Structural Causal Models (SCMs). We propose a taxonomy that categorizes drift events by their causal origin, including changes in exogenous variables, endogenous mechanisms, confounders, and target-generating processes. Building on this framework, we develop an SCM-based data stream generator that simulates controlled mechanism-level drift events. Our experiments empirically characterize the distributional effects of each drift type and show that drifts with different causal origins induce distinct patterns of distribution shift and predictive behavior. Furthermore, by integrating causal discovery methods, we use our framework to construct data streams grounded in real-world dependency structures, enabling more realistic and informative evaluation scenarios. We also demonstrate that leveraging the generated data can improve downstream performance. These results highlight the importance of accounting for causal structure when studying and evaluating adaptive learning methods, and establish a foundation for causally-aware evaluation in non-stationary environments.
Read the full abstract

All authors Eduardo V. L. Barboza, Jean Paul Barddal, Robert Sabourin, Rafael M. O. Cruz

Statistical Methodology

Closed forms and open obstructions: the sample variance of three observations

The exact distribution of the sample variance for $n=3$ is known since Rietz (1931) for the uniform parent, and Royen (2007, 2008) gave a Fourier series for any bounded continuous parent. Neither settles which parents admit a finite closed form, nor which special functions it forces. In coordinates aligned with the cube diagonal the variance constraint becomes a cylinder and the cube cross-section a polygon with $S_3$ symmetry, hexagonal over the central band of the diagonal and triangular near either corner; the CDF is the volume of their intersection, the parent density entering as a weight. A closure hierarchy is then organized by the minimal function class containing the parent density: polynomial parents on any bounded interval always close in elementary terms, a theorem for the whole class; in the negative direction a single explicit parent already suffices, and for a rational one we prove the CDF is not elementary, the obstruction being an irreducible dilogarithmic part. Beyond those two theorems the hierarchy is a set of example-specific obstructions rather than a classification: for an algebraic parent the radial first-kind differential is shown non-elementary on a genus-two curve, and the exponential row is a conjecture supported by the Bessel structure of its radial integral. For the uniform parent we obtain a two-piece formula bifurcating at $Y=1/4$, where the variance disk first circumscribes the hexagonal cross-section at the cube center. For the singular arcsine parent we derive both endpoint laws in closed form and give a six-term approximation accurate to about $10^{-3}$, an accuracy Royen's universal series reaches at about a hundred terms.
Read the full abstract

Statistical Methodology

The Informational Content in Lepto-Variance and Its Relation to Higher Moments

Lepto-regression is defined as the machine learning process of constructing a Regression Tree of a target feature on itself. It is a novel, model-free method potentially revealing information on important sample structure properties. But it is yet not clear what the informational content of lepto-variance is and how it is related to other well-known statistics of a sample. One significant finding is that 58% of the historical US stock return variability is 1-bit lepto-variance that can not be explained by any financial factor. The central question investigated in this paper is to use small normal N(0, 1) drawn samples to explore how the 1-bit sample lepto-variance and lepto-ratio relate to sample variance, skewness and excess kurtosis. Using a large sample simulation, the lepto ratio of a normal is found to converge to 36.3%. For smaller normally distributed simulated N(0, 1) samples, while lepto-variance itself is highly correlated to sample variance, lepto-variance as a fraction of total variance is highly correlated to excess kurtosis. Both lepto-variance and lepto-ratio are orthogonal to sample skew. Another finding is that while lepto-ratio is strongly correlated to lepto-variance it remains orthogonal to sample variance.
Read the full abstract

Statistical Methodology

Calibration Count Reuse: Validity Does Not Determine Efficiency

Calibration count reuse raises separate validity and efficiency questions. We give a validity criterion for general count-dependent nonconformity scores: transferring one count from another class to the scored class must not improve its conformity. A leave-self-out full conformal reference proves the criterion without requiring normalization or preservation of same-class score order. For a common separable transformation, universal exchangeable validity is equivalent to being nondecreasing in the count, provided $K\alpha \geq 1$; normalized multiplicative weights obey the complementary nonincreasing condition. Additive penalties are covered under the stated information restrictions. Efficiency has no parallel ordering: two iid constructions make the same valid rule improve or worsen expected size at unchanged coverage. An expanded 55-rule study finds no resolved advantage from selected live-count rules over uniform weights. Image studies identify undercoverage under iid resampling, including at numerical convergence. Separately, execution of the released Conf-OT pipeline on its DTD and Aircraft benchmark subsets produces near-nominal median coverage under fixed stratified counts. The native results are reported separately from the iid analyses, without treating a benchmark observation as a universal guarantee. The findings separate validity, classifier confidence, numerical convergence, and population-specific efficiency.
Read the full abstract

Statistical Methodology

Bounding the Risk Difference Bias Given Incomplete Parameters for Externally Adjusting Uncontrolled Confounding

Bias due to uncontrolled confounding can be analyzed using several external adjustment formulas. Like other bias expressions, the risk difference bias formula involving an uncontrolled polytomous confounder requires only three externally obtainable parameters: confounder prevalences among the exposed and unexposed and the confounder-outcome risk difference. This paper presents two-parameter bounds on the risk difference bias expression when only one of the three required bias parameters is unavailable. Each bound is sharp over the full range of the unknown parameter. Some numerical examples with graphs are provided.
Read the full abstract

Statistical Methodology

Selective Inference for CART with Binary Outcomes

Binary classification trees select subgroups using the same outcomes later used to assess their differences. We develop finite-sample conditional tests of a common success probability within a parent selected by deterministic Gini CART. The construction retains all eligible cutpoints and conditions on the selected split, its ancestor path, the parent success total, and outside outcomes. The resulting uniform label fiber gives an exact count distribution, while a reversible parallel Monte Carlo construction yields super-uniform inclusive and exactly uniform tie-randomized p-values for any prespecified finite run budget. Within a two-child constant-risk model, the selected count law is an exponential family with information equal to its conditional count variance. We separate information loss from computational limitations and exhibit a selected fiber disconnected under single-label swaps. Simulations with 200 or 400 observations, ten independent or correlated predictors, and trees of depth three show conservative inclusive tests and nontrivial power for large risk differences. At 400 observations and a generating risk difference of 0.4, randomized rejection conditional on reaching the prespecified third-level target is 51–71%, while selection followed by rejection occurs in 11–21% of datasets. Smaller signals remain difficult to detect, and a representative fivefold increase in computation gives little power improvement. The guarantee concerns parent homogeneity, or equality of two constant child risks, and does not cover equality of heterogeneous regional averages.
Read the full abstract

Statistical Methodology

Structured Screen-and-Select for Ultra-High-Dimensional Variable Selection

Ultra-high-dimensional data, with p far exceeding n, are common in genomics and biomedical research. Marginal screening can miss active predictors with weak marginal signals, especially under strong predictor correlation. We develop Structured Screen-and-Select Variable Selection (S3VS), an iterative framework that combines outcome-based screening with correlation-based local predictor sets. At each iteration, S3VS identifies leading variables, forms local sets through predictor associations, applies a model-specific selector, aggregates selected and nonselected variables, and updates the candidate set and, when appropriate, the outcome representation. The framework allows flexible leading-variable, local-set, and aggregation rules, with implementations for linear, generalized linear, accelerated failure-time, and Cox models. For a specified one-step linear configuration, we establish sure screening under conditions on proxy coverage, correlation separation, within-set retention, and active-preserving aggregation. Simulations compare full and first-iteration S3VS with one-pass SIS procedures in linear, logistic, and Cox settings. S3VS can improve variable recovery or prediction when correlated predictors provide useful proxy information, although gains depend on predictor structure and selector choice. In ovarian-cancer data, full S3VS with clinical variables showed the strongest internal discrimination and early prediction, whereas SIS–Cox–LASSO with clinical variables showed the strongest external discrimination. Neither molecular approach consistently reduced prediction error, and no gene was selected in all five outer folds. S3VS provides a flexible framework for exploiting predictor dependence before model-specific selection. The method is implemented in the CRAN R package S3VS.
Read the full abstract

Statistical Methodology · Cross-listed from q-bio.PE

Phylogenetic Inference and the Stickiness of Fréchet Means, via Precise Asymptotics of an Embedded Random Walk

A well-known phenomenon in statistical analyses of populations of phylogenetic trees in the Billera-Holmes-Vogtmann space is that the topology of the Fréchet mean tree can contain multifurcations (i.e., internal nodes with more than two children), which raises the practical question of whether this reflects a population-level branching structure (hard polytomy) or merely sampling variability in the data (soft polytomy). This is an instance of the more general phenomenon of "stickiness" in non-Euclidean statistics, whereby the sample Fréchet mean in certain non-positively curved stratified spaces becomes permanently trapped in a lower-dimensional stratum. In this work, we identify a particular multidimensional random walk embedded within the Fréchet mean process, and we show that the time at which stickiness occurs is determined by the largest last-passage time above zero of the coordinates of this random walk. Using this representation, we develop a fully nonparametric procedure for estimating the probability that trifurcations in a sample Fréchet mean tree will bifurcate at some future time if more observations are collected. Lastly, we apply our methodology to a problem in phylogenetics where we consider whether an observed trifurcation in the species tree of primates, glires, and tree shrews is genuinely trifurcated at the population level.
Read the full abstract

Statistical Methodology

On the use of meaningful score regions to interpret treatment effects on continuous clinical outcome assessments

Clinical outcome assessments (COAs), such as patient-reported outcomes (PROs), are faced with an interpretability issue due to a variety of score metrics being employed. Therefore, evidence linking COA scores to interpretable patient experiences is necessary to judge the extent to which the results of COA-based clinical trial endpoints are meaningful. The fourth Patient-Focused Drug Development guidance, published in draft form by the FDA in 2023, proposes the use of meaningful score regions (MSRs) to divide COA scores into more easily interpretable categories (e.g. severity-based MSRs of 'none', 'mild', 'moderate' and 'severe'). A recommendation is to compare the magnitude of estimated treatment effects for continuous COA scores (e.g. the difference in mean change from baseline between two treatment groups) to the maximum MSR width. In this article we explore this recommendation further, through historical evidence and simulations, and conclude that using the maximum MSR width as a benchmark may fail to detect meaningful treatment effects in practice. We suggest alternative approaches to evaluate treatment effects against MSRs, describing the expected outcome within each arm in terms of the probabilities of MSR membership.
Read the full abstract

Statistical Methodology · Cross-listed from stat.CO

Bayesian Calibration with Functional Outputs Using Elastic Partial Matching

Calibrating a simulation model involves estimating its parameters by comparing model outputs with experimental data, so that simulation results faithfully reproduce the experimental observations. When the outputs are functions of time, there are multiple ways to quantify the discrepancy between experimental and simulated curves. A recent approach based on elastic functional data analysis decomposes a functional output into two components: a function temporally aligned to a template, and the corresponding warping function. This decomposition splits the problem into two independent calibration tasks, thereby addressing functional misalignment. However, it assumes that experimental and simulated curves share the same temporal support, an assumption often violated in practice when initial or end times are themselves uncertain or depend on the calibration parameters. In this work, we reinterpret the decomposition step as an approximation to a more general Bayesian calibration problem that incorporates an error term on the time axis. This perspective allows us to naturally extend the framework to a broader family of time warpings with varying initial or end times, using partial elastic alignment. We illustrate the method on a synthetic test case, comparing it with existing Bayesian calibration methods and demonstrating improved surrogate performance and error modeling. We then apply the proposed approach to the calibration of an equation of state (a thermodynamic equation relating the state variables of a material).
Read the full abstract

All authors Paul Casteras, Julien Bect, Josselin Garnier, Gwenaël Salin

Statistical Methodology

Statistical Depth for Interval Data: A Closeness-Based Approach and Its Applications

With the rapid development of technology, interval data have been increasingly widely used in various fields, as they can effectively carry information on measurement uncertainty and original variability. Reasonable ranking and outlier screening of interval data are crucial for exploring their value, and statistical depth theory is an important tool to achieve this goal. Existing statistical depth methods are mostly defined for ordinary point-valued data, which are difficult to adapt to the characteristics of interval data and cannot meet the needs of their ranking and outlier detection. Therefore, this paper proposes a statistical depth suitable for interval data and conducts relevant application verification.
Read the full abstract

Statistical Methodology · Cross-listed from stat.AP

Overcoming Model Misspecification in Bayesian Inference of Molecular Signalling Networks

Bayesian inference of molecular signalling networks usually relies on tractability of the marginal likelihood, enabling the set of possible networks to be efficiently explored. As such, linear models with independent errors and conjugate priors are routinely used. However, the dynamics of molecular signalling are nonlinear, and relevant confounders are often unobserved; failure to account for these complexities will almost certainly lead to over-confident inferences in the standard Bayesian framework. To confront this reality, we develop a post-Bayesian approach to inference of molecular signalling networks, guided by the principle that uncertainty should not vanish when the statistical model is misspecified, even in the infinite-data limit. Technically, we extend the predictively-oriented (PrO) posterior of McLatchie et al. (2025) to the setting of latent variable models, empirically investigating the properties of PrO posteriors in the challenging network inference context.
Read the full abstract

All authors Yinghan Li, Heishiro Kanagawa, Francesca Romana Crucinio, Matthew A. Fisher, Chris. J. Oates

Statistical Methodology

Filtering and Smoothing with Score-Driven Models

Score-driven models are, by construction, purely predictive filters. When such models are read as filters for an underlying latent process, rather than as data generating processes, this is a restriction rather than a feature, because the contemporaneous and the future observations also carry information on the current state. Starting from the observation that the Kalman filter and smoother recursions for linear Gaussian models can be written in terms of the score of the conditional log-likelihood, and that the predictive step then takes the form of a score-driven recursion, we generalize score-driven models along this direction by deriving an update filter and a smoother, which exploit the contemporaneous observation and the whole sample respectively, together with the corresponding conditional variances. In extensive Monte Carlo analyses the update filter lowers the mean square error of the predictive filter by 3.5% to 8.8%, and the smoother by 32% to 44%, with the ordering holding in every replication; confidence bands built on the associated conditional variances attain their nominal coverage, whereas bands that ignore filtering uncertainty capture less than a third of it. Empirically, we demonstrate the benefits of employing score-driven models as filters rather than as purely predictive processes, showing that the resulting smoothed estimates align more closely with realized quantities than their predictive counterparts.
Read the full abstract

All authors Giuseppe Buccheri, Giacomo Bormetti, Fulvio Corsi, Fabrizio Lillo

Statistical Methodology

Tensor Completion using Subspace Information

Tensor completion has attracted significant attention in both applications and theoretical research. Under standard uniform sampling, existing polynomial-time guarantees generally require more observations than the number of degree of freedom, motivating the study of a possible statistical-to-computational gap in highly missing regimes. Fortunately, in many practical scenarios, side information is available, which can provide valuable insights to mitigate these challenges. In this paper, we introduce an algorithm called Tensor Completion using Subspace Information (TCSI) that incorporates side information through an estimated subspace. Our approach first extracts the subspace from the available side information and then reformulates tensor completion as a matrix regression problem. We provide a theoretical analysis showing that, when accurate subspace information is available, the required sample complexity is reduced to nearly linear order in the uncoupled ambient dimensions, removing the coupled-mode dimension from the leading term. Leveraging the estimated subspace information, we obtain a less stringent sufficient signal-to-noise ratio requirement than those in several existing passive-uniform-sampling guarantees. Under additional mild conditions, we obtain a sharper statistical error bound. Our theoretical findings are supported by numerical simulations. We apply TCSI to the reconstruction of global Total Electron Content (TEC) maps and observe lower reconstruction errors than the compared methods in our experiments.
Read the full abstract

Statistical Methodology

Conformalized Safe Feasible Sets in Uncertain Decision Systems

Safety-critical decision systems often require a downstream optimizer to choose from an unknown feasible set determined by an unobserved label $Y$. Given a context $X$, the goal is to construct a safe subset $D(X)$ contained in the oracle feasible set $A(X,Y)$ with probability at least $1-\alpha$. Existing conformal approaches typically construct a prediction set of the unobserved label $Y$ and retain decisions that are safe for every value in this set. Although valid, this requires a stronger intermediate event than set inclusion. We propose Directed Inclusion Safety Calibration (DISC), a conformal framework that directly controls the probability of this inclusion event by reducing its verification to a scalar critical-inclusion score. Given a pretrained nested family of candidate feasible sets, DISC assigns each labeled observation the smallest nestedness level at which the corresponding subset is contained in $A(X,Y)$, and constructs the safe feasible set using an empirical quantile at test-time. With data exchangeability, this yields a finite-sample, distribution-free inclusion guarantee. Under two practical set families, we show that DISC produces a safe feasible set containing that obtained by the corresponding calibration baseline. We further develop optimization-based score computation and decision-aware procedures for learning subset families. Experiments across continuous and structured decision problems show that DISC achieves the target inclusion guarantee while producing larger feasible regions.
Read the full abstract

All authors Yajie Bao, Yinjie Min, Haojie Ren, Changliang Zou

Statistical Methodology

A Three-Way Testing Framework for Quantifying Epistemic Calibration Uncertainty in SBI

Current experimental scientists increasingly rely on simulation-based inference (SBI) to invert complex models with intractable likelihoods. A primary goal in these settings is to obtain credible regions with valid coverage. While recent model-agnostic conformal calibration methods have succeeded in constructing credible sets with prescribed local Bayesian coverage, their approximate nature introduces inherent epistemic uncertainty in the calibration process. In this work, we propose a novel tool for diagnosing calibration uncertainty. Our approach is based on a simple three-way hypothesis testing procedure. We demonstrate how this tool can be used to effectively assess necessary simulation budgets for calibration sets and analyze the epistemic uncertainty associated with cutoff estimation.
Read the full abstract

Statistical Methodology · Cross-listed from stat.AP

Transporting summary measures of relative effects from randomised trials to the treated patient population: an application to breast cancer endocrine therapy

Randomised trials often report relative treatment effects, such as risk ratios and hazard ratios, for trial populations. Clinical decision-making, however, often benefits from estimates of absolute treatment effects in the population eligible for treatment. Trial participants may not represent this target population well, and restrictions on access to individual participant trial data can further complicate absolute effect estimation. Routine care data are often representative of the target population but may be subject to uncontrolled confounding. We consider estimation of the average treatment effect on the treated (ATT), an absolute measure, by combining a representative sample of treated routine care patients with summary measures (i.e., estimated risk or hazard ratios) from either a randomised trial or a meta-analysis of trials. Under marginal or conditional transportability assumptions, the ATT is shown to be identifiable. The implications of collapsibility of the effect measure on transportability are discussed, and plug-in estimators of the ATT are presented. Simulation studies are used to assess finite sample performance of the estimators in a range of settings. The proposed methods are applied to estimate the ATT of endocrine therapy on 15-year breast cancer mortality using results from a meta-analysis of randomised trials and England's National Disease Registration Service.
Read the full abstract

All authors Bonnie E. Shook-Sa, Paul N. Zivich, Carolyn Taylor, David Dodwell, Jake Probert, Sarah C Darby, Paul McGale

Statistical Methodology

Quantifying Long-Range Dependence in Object-Valued Time Series

Object-valued time series, including distributions, covariance matrices, networks, and compositions, lack the linear structure required by conventional autocovariance-based definitions of long memory. We develop an intrinsic framework for defining and estimating long memory in metric spaces of negative type. An isometric embedding yields a centered Hilbert-valued process, and the trace of its lag-covariance operator provides a signed, additive measure of temporal dependence. Crucially, this trace equals the difference between the marginal mean pairwise distance and expected lagged distance, so the framework and its estimators use only distances between the original objects. We define the memory parameter through the nonsummable decay of this trace and show that it coincides with the usual parameter in Hilbert-valued settings. Estimation uses Bartlett aggregates of distance-based lag measures. Estimating the common marginal distance from the same dependent sample induces a common-centering bias in these aggregates. We derive its finite-sample form and propose iterated block-difference corrections, log-ratio and multi-bandwidth log-slope estimators, and a localized self-consistency refinement. We establish consistency, document substantial bias reduction in simulations, and find long-memory evidence in foreign-exchange return distributions and U.S. electricity-generation compositions.
Read the full abstract

Statistical Methodology · Cross-listed from stat.ML

Model-Agnostic Feature Selection via LOCO-Guided Adaptive Minipatch Sampling

Black-box machine learning models increasingly deliver strong predictions, but extracting useful information from them, such as a set of important features, remains challenging. Existing model-agnostic methods primarily estimate feature importance or conduct inference on it rather than directly selecting features, whereas many feature selection methods are model-specific or rely on the model-X assumption. We introduce LOCO-guided Adaptive Minipatch Sampling (LAMPS), a model-agnostic ensemble framework that uses any black-box regression algorithm as its base learner to select features important for predicting the response. The base learner need only produce predictions and need not perform feature selection itself. LAMPS operates within a minipatch ensemble framework that subsamples both observations and features, allowing leave-one-covariate-out (LOCO) feature importance scores to be easily computed. It adaptively concentrates minipatch sampling on features with high LOCO scores while maintaining exploration. The resulting sampling probabilities rapidly separate signal from noise features after a few iterations, enabling selection through simple thresholding. We establish that LAMPS achieves exact feature selection in high-dimensional settings, provided that the base predictive models are sufficiently well trained on average. Extensive experiments on synthetic and real data show that LAMPS outperforms state-of-the-art feature selection methods, with particularly strong performance in the presence of correlated features.
Read the full abstract