Peer Revenue Fully funded

Papers

Fresh from arXiv, typeset properly. Highlighted words trade on the market.

Statistics Statistical Methodology

stat.ME Watch Statistical Methodology (sign in to use)

Tuesday 8 September

Statistical Methodology · Cross-listed from physics.soc-ph

Identifiability of Latent Space Network Models on Anisotropic Thurston Geometries

A latent space network model places the nodes in a metric space and lets the probability of a tie decrease with distance. In a space of constant curvature, pairwise distances determine the positions up to an isometry. In the products and in the three remaining three-dimensional model geometries they do not. We study the three geometries that are neither of constant curvature nor products: the Heisenberg group, the solvable group and the universal cover of the unit tangent bundle of the hyperbolic plane. We ask what one network identifies about positions in them and when their geometry is detectable. Two anchors remove the isometry ambiguity. Small configurations are not determined by their distances, and generic local identification holds beyond a finite threshold, certified in the Heisenberg group. We derive the posterior on the quotient by the isometry group. For small configurations, the divergence to the nearest product or constant-curvature competitor is the stress component of the curvature difference and vanishes at high order in the scale; undirected ties therefore detect the geometry only in large networks with large enclosed areas. Directed ties expose it at first order: in the two twisted geometries, asymmetric preferences circulate around triangles in proportion to enclosed area, which no additive ranking produces. On dense competitive-game counter networks, the coupled model beats rankings on every geometry, degree-corrected rankings and free antisymmetric terms. A Euclidean model with the same coupled term matches it, so the gain is the coupling of similarity and circulation through shared coordinates. An additive-and-multiplicative-effects model predicts better still.
Read the full abstract

Statistical Methodology · Cross-listed from math.ST

Sieve Estimation of Optimal Transport Maps from Paired Data in Gaussian Spaces

We study the estimation of infinite-dimensional optimal transport maps from noisy paired observations. The population map pushes a Gaussian reference measure forward to a target probability measure on a function space and takes the Cameron–Martin gradient form $T=I+\nabla_{\mathcal H}\phi$. Our estimator uses cylindrical gradient sieves based on finitely many Cameron–Martin coordinates, thereby reducing the problem to finite-dimensional empirical risk minimization. A local nonasymptotic oracle inequality separates cylindrical approximation and statistical estimation errors while accounting for the conditioning of the parametrization. The approximation analysis relies on regularity conditions governing coordinate decay and dependence on omitted input coordinates. For diagonal Gaussian and nonlinear block-interaction classes, we derive matching upper and lower bounds that establish the minimax rate $N^{-s/(2s+1)}$ in expected norm, where $s$ measures weighted coordinate regularity. We further analyze a continuous two-groups model with Gaussian–Laplace mixtures and derive a prediction-risk bound for the resulting transport-map estimator.
Read the full abstract

Statistical Methodology · Cross-listed from math.NA

Quadratic Point Estimate Method for Uncertainty Quantification with Dependent Non-Gaussian Inputs

As an extension of the Point Estimate Method (PEM) to evaluate probabilistic moments of quantities of interest (QoI) in general $n$-dimensional spaces, the Quadratic Point Estimate Method (QPEM) has been recently developed. This new method is defined to fully represent up to fifth-order input moments in the Gaussian space, providing general analytical expressions for sample locations and weights, without requiring any numerical optimization. The QPEM can significantly improve the estimation accuracy of the output QoI moments, in relation to PEM-based methods whose numbers of sigma points grow linearly with the problem dimension, while at the same time having an affordable and competitive computational cost up to a considerable number of dimensions. The QPEM is further enhanced in this work by enabling copula integration into the framework, which enables effective modeling of the joint input probability density function by estimating marginals and the dependence structure of the involved random variables. The validity and efficient performance of the copula-based QPEM are showcased against numerous other sampling methods in various examples considering two practical scenarios: (i) when the joint dependence structure can be inferred from data, and (ii) when only marginal distributions and correlation matrices are known.
Read the full abstract

Statistical Methodology

Covariate Adjustment in Randomized Experiments: A Unified Framework for Decision and Practice

Should researchers adjust for covariates in randomized experiments, and if so, how? The literature offers three distinct prescriptions: do not adjust because randomization guarantees unbiasedness; adjust for outcome-prognostic covariates to improve precision; or adjust for covariates imbalanced between treatment arms. These competing prescriptions create confusion and uncertainty. We develop a unified framework for decision and practice. Given available information, we show that the optimal correction is what we call ex-post bias. The only relevant criterion for adjustment is prognosticity for ex-post bias; neither raw covariate imbalance nor outcome prognosticity is sufficient by itself. We also show that correcting imbalance and improving precision are two sides of the same decision problem. We develop two estimation approaches, one of which recovers familiar adjustment estimators and provides a new theoretical justification for them. Simulations compare alternative covariate-selection and adjustment strategies. Overall, our framework provides a unified foundation for covariate adjustment in randomized experiments.
Read the full abstract

Statistical Methodology

Linearly Constrained Generalized Linear Models with Applications in Origin-Destination Estimation

We show that data censored by linear constraints can be fit within the generalized linear model (GLM) framework, recovering the expected latent counts together with their uncertainty in a single Fisher-scoring procedure. Our motivating application is origin-destination (OD) estimation in transportation studies, where the latent data are the OD trip demands and constraints are either origin and destination marginal counts per zone, as in OD matrix estimation, or observed link counts, as in network tomography. Casting the problem as a linearly constrained GLM lets us treat, within one model, three features that arise routinely in practice: unmatched constraints, trip predictors such as costs, and prior information such as diagonal dominance and seed counts. We demonstrate the methodology in synthetic and small scale studies and in a larger case study based on simulated data from the BO4Mob study.
Read the full abstract

Statistical Methodology · Cross-listed from cs.IT

On Weighted Mathai-Haubold Entropy Measures

In this paper, we propose weighted Mathai-Haubold entropy along with their residual and past versions and study their properties. We develop aging classes based on the weighted Mathai-Haubold residual and past entropy measures. Also, some inequalities related to the three proposed measures are discussed. Non-parametric estimators of the proposed measures are introduced and their properties are investigated. Performance of this estimator is evaluated by means of bias and mean squared error using Monte-Carlo simulations.
Read the full abstract

Statistical Methodology · Cross-listed from stat.AP

Bayesian palaeoclimate reconstruction from zero-inflated count-compositional pollen data: A case study of Lago Grande di Monticchio in southern Italy

Bayesian palaeoclimate reconstruction from fossil pollen counts relies on a modern pollen-climate calibration data set to infer the pollen-climate relationships used to reconstruct past climates. While geographically large calibration data sets improve coverage of climate space and reduce unreliable extrapolation, they also introduce substantial heterogeneity, structural zeros, and complex pollen-climate relationships. We propose a Bayesian modular framework for palaeoclimate reconstruction from count-compositional pollen data that addresses these challenges, and provides coherent uncertainty quantification. The framework employs the zero-and-$N$-inflated multinomial logistic-normal distribution to describe the compositional pollen counts coupled with Bayesian additive regression tree priors to model the nonlinear effects and interactions among the climate covariates. Inference is formulated through a cut posterior distribution that modularises the analysis into forward and reconstruction modules. The forward module is fitted once using a large modern calibration data set and its posterior uncertainty is subsequently propagated to reconstruct climate variables from fossil pollen counts. For the reconstruction module, we develop and compare three inverse posterior sampling schemes. Simulation studies and empirical validation on the modern data set demonstrate that a combination of sampling importance resampling with a multiple imputation technique and a continuous uniform prior over the domain of the modern climate variables achieves the best predictive performance, with well-calibrated uncertainty quantification for the climate reconstruction. In our motivating case study, we further illustrate the proposed methodology by reconstructing a three-dimensional climate vector from fossil pollen records collected at Lago Grande di Monticchio in southern Italy.
Read the full abstract

All authors André F. B. Menezes, Andrew C. Parnell, Brian Huntley, Keefe Murphy

Statistical Methodology

A Closed-Form Estimator and Diagnostic Battery for Anchor-Judge Error Correlation, Under a Single-Common-Factor Model

When an external reference set (an anchor) is used to decompose an LLM-judge panel's error into a quality signal and a shared common-mode error, standard practice assumes the anchor is uncontaminated: its error uncorrelated with the judges' shared error. We study when that assumption can be dropped and replaced by an estimate. Under a single-common-factor model, >=2 judges and >=2 anchors point-identify the quality variance, the common-mode variance, and each anchor's contamination correlation rho_k in closed form, with an exact per-anchor-pair failure boundary; a designated clean-anchor estimator, by contrast, reports a contaminated companion anchor as fully clean once its trusted anchor is itself contaminated. Because the single-common-factor assumption is itself untestable, the estimator ships gated behind a calibrated diagnostic battery (judge-covariance dispersion; over-identification; a family-block test from judge metadata, with a family-blocked estimator that removes family-level shared-residual bias exactly), bootstrap confidence intervals with measured coverage, and a weak-identification screen. A proposition maps which violations bias rho_k, in which direction, and which evade detection. For ordinal scores we show an identification hierarchy: with all variables ordinal, rho_k is not identified at any number of anchors; with ordinal judges and >=3 continuous anchors it is, and we give an estimator for that case. On real data the validation is asymmetric, and we say so plainly: the diagnostics are validated in the rejecting direction (both real panels we test are correctly rejected by the model-adequacy pre-test), while the estimator is validated in simulation and stress-tested semi-synthetically under oracle calibration; no real panel has yet passed the pre-test, and the pre-test exists precisely to say so. All results replay offline from shipped, checksummed artifacts.
Read the full abstract

Statistical Methodology · Cross-listed from stat.AP

Dynamic Latent Space Modeling of Inhomogeneous Poisson Network Processes with Applications to International Relations

We study continuous-time relational event data, where time-stamped dyadic interactions reflect both individual node propensities and evolving relational proximity. We propose a dynamic latent space model for inhomogeneous Poisson processes, where event intensities depend on node-specific activity parameters and time-varying latent distances modeled via flexible B-splines. We prove model identifiability by decoupling baseline activity from latent position, ensuring high interaction volumes do not warp the spatial map. For scalability, we develop a minibatch stochastic gradient algorithm with stable initialization and geometric anchoring, alongside an effective-degrees-of-freedom BIC for tuning model complexity. Simulations confirm accurate parameter recovery and out-of-sample prediction. Applied to cooperative diplomatic events among 60 major economies (1995–2022), the model uncovers shifting patterns of international cooperation and isolates mobile geopolitical actors from stationary institutional anchors.
Read the full abstract

Statistical Methodology · Cross-listed from math.ST

Improved Variance Estimation in Homoskedastic Nonparametric Random-Design Regression via a Two-Scale Approach

We study estimation of a constant conditional variance $\sigma^2$ in nonparametric regression with a $d$-dimensional random design. This is an important problem, and similar questions arise in causal inference. The regression function is $\beta_b$-Hölder smooth, the design density is $\beta_g$-Hölder smooth and bounded above and away from zero, and we consider the nonparametric regime $\beta_b>1$ and $d>4\beta_b$. Set $\beta_g^\star=\beta_b(1-4\beta_b/d)/\{1+2\beta_b/d+8(\beta_b/d)^2\}$. We give an estimator whose mean squared error is upper bounded by $Cn^{-4(\beta_b+1)/(d+4)}$ in the low-regularity regime when $0<\beta_g\leq\beta_g^\star$. The low-regularity branch is based on a new two-scale construction: the covariate space is partitioned into cells, the local polynomial trend is projected out within each suitable cell, and the squared normalized contrast from one eligible close pair per cell is averaged across cells. In the high regularity regime when $\beta_g>\beta_g^\star$, a higher-order influence function estimator of Robins, Li, Tchetgen Tchetgen, and van der Vaart (2008) provides the rate $Cn^{-8\beta_b/(d+4\beta_b)}$. We also give an all-pairs ridge extension, which achieves the same two-scale rate, and evaluate the methods alongside a range of existing estimators in simulations.
Read the full abstract

All authors Edgar Dobriban, Rajarshi Mukherjee, James M. Robins, Zixiao Wang

Statistical Methodology

Cursive: The Trace from the Curse of Dimensionality

Modern data are increasingly high-dimensional or non-Euclidean. As dimension grows, new statistical patterns can emerge in the relations among observations, while a conventional statistical summary may fail to retain the signal they carry. This paper names and organizes a research program around this observation, calling it Cursive. Cursive asks which relational information is lost when the summary is formed and how the analysis should be redesigned around that information. The canonical example is the generalized edge-count test, which keeps the two within-sample edge counts whose opposing deviations can cancel in the classical between-sample count. This paper traces how the same design question has led to task-specific methods built from graphs, graph-based ranks, kernels, and dissimilarity profiles for testing, change-point detection, covariate-balance assessment, clustering, classification, and generative-model evaluation.
Read the full abstract

Statistical Methodology

Instability in Patient Clustering: A Multiverse Analysis of Unsupervised Clustering in the CENTER-TBI cohort

Understanding patient heterogeneity is key to improving prognostic modeling in traumatic brain injury (TBI). Unsupervised clustering is widely used to explore patterns in patient characteristics that may define subgroups. However, it involves a multitude of decisions, including the choice of algorithm, the distance metric, and the method used to determine the "optimal" number of clusters. The aim of this study is to investigate how these choices influence the resulting clustering solution. We analyzed data from 4,509 patients enrolled in the Collaborative European NeuroTrauma Effectiveness Research in TBI (CENTER-TBI) study. K-medoids, agglomerative, and spectral clustering were applied in a complete 3 X 2 X 2 factorial design, in combination with Euclidean or Gower's distances, and silhouette score or gap statistic to choose the number of clusters. We investigated the agreement of clustering solutions with UpSet Plots and stability with the (adjusted) Rand index. Comparisons were made both across approaches using the original dataset and within approaches using bootstrap resampling. Clustering results varied substantially depending on the analysis choices. The number of suggested clusters varied widely, from one to twenty-five. Adjusted Rand indices confirmed low concordance between methods. Moreover, none of the clustering solutions demonstrated discriminatory performance comparable to a supervised logistic regression model in classifying patient recovery illustrating the limited usefulness of clustering for this purpose. The high instability in clustering results compromises interpretability and underscores that such solutions should not be blindly interpreted as underlying structure.
Read the full abstract

All authors Sean R E A Bagcik, Aneeta Merlin Chacko, Ewout W Steyerberg, Maarten van Smeden, Andrew I R Maas, Erik van Zwet, Nicole S Erler

Statistical Methodology

Evaluating Efficiency of Platform Trials Under Delayed Outcomes Using Treatment Throughput

Background: Platform trials improve efficiency by enabling early stopping of ineffective arms, shared controls, and addition of new treatments without compromising statistical properties. However, delays in observing primary outcomes may reduce these benefits. Investigators must either pause recruitment, delaying identification of effective treatments, or continue recruitment, potentially enrolling participants who cannot benefit from interim decisions. We assess the impact of outcome delay on platform trial efficiency using a novel metric. Methods: We propose Expected Throughput (ET), defined as the expected number of treatment arms evaluated per 1000 participants. ET accounts for participants recruited while awaiting outcomes. We consider a multi-stage sequential design for each treatment arm and assess ET across different outcome delays, assuming uniform patient accrual. Results: Outcome delays substantially reduce platform trial efficiency, with the impact dependent on recruitment rate and delay length. At a recruitment rate of 10 patients per month, severe losses occur when delays exceed 12 months. When outcome delay exceeds two-thirds of the time required to recruit a single arm, substantially fewer treatment arms are evaluated than anticipated. Conclusion: Outcome delay can markedly reduce platform trial efficiency. Recruitment rates and expected outcome delays should therefore be considered during trial planning.
Read the full abstract

Statistical Methodology

Transfer Learning with Heterogeneous Feature Spaces in Linear Regression

Transfer learning improves target-task performance by leveraging related source data. Most methods assume shared feature spaces, yet in many applications, each source observes only a subset of target covariates. Classical imputation fails here due to block missingness, and standard imputation matrices are not optimized for target parameter estimation. We study low- and high-dimensional linear regression and propose Heterogeneous Importance Weighting (HIW). Our method aligns feature spaces via projection-based imputation and transfers information through sample-selected importance weighting. This framework accommodates diverse projection matrices to construct target-oriented imputation. We develop a classification-based procedure with pseudo-responses to estimate conditional error densities for the weights. We establish entry-wise and global convergence rates for the estimator, with numerical and real-data studies demonstrating its effectiveness.
Read the full abstract

Statistical Methodology

Nonparametric framework for the definition, adaptive detection and probabilistic interpretation of outliers

Outlier detection is a fundamental challenge in data processing, with critical implications for robustness across statistical modeling, machine learning and exploratory data analysis. However, existing proposals rarely offer a universal, domain-agnostic definition of an outlier, often relying on heuristic trimming quotas that lack a statistical interpretation. To address this, we propose a nonparametric framework built on a pseudo-isolation outlier score. This score enables a formal, probabilistic definition of an anomaly tied to a false-alarm rate $\alpha$, which extends into a rigorous geometric classification of internal and external outliers. We show that this mechanism seamlessly embeds into any objective-based clustering framework to identify cluster-specific outliers. Here, we integrate it into $K$-means to create ODK-means. The inferential capabilities and topological properties of this framework are explored both theoretically through formal propositions and empirically through extensive simulations and methodological tutorials, highlighting the practical actionability and intuitive appeal of the proposed outlier detection logic.
Read the full abstract

Statistical Methodology

Structure-based Transfer Learning

Transfer learning improves estimation in a target study using information from related sources. Classical transfer learning is typically data-based, requiring access to the source data or to a model fitted on them. Neither is available in many modern studies, as both are often proprietary or unreported. What can be transferred instead is structure: summarized information derived from a source, such as the supports of predictors, which is available and interpretable without access to the source data or model. The prevalence of the Large Language Model (LLM) provides a rich source of such structure information. However, data-based transfer learning can not well utilize it as accessing the data and model of the LLM is often infeasible. In this paper, we propose a novel transfer learning framework based on structure. In particular, we focus on linear model and aim to use supports generated by multiple agents, such as LLM, to improve estimation in the target study. Our procedure maps each support into the target parameter space, aggregates the results with data-driven weights, and applies a sparse correction against inaccurate supports. We establish nonasymptotic guarantees: the estimator improves on the target-only Lasso when the supports are informative and never does worse otherwise. Simulations and a gene-expression application confirm both properties.
Read the full abstract

Statistical Methodology · Cross-listed from math.ST

Statistical Inference for Additive Monotone Models under the Fixed Lattice Design

We study statistical inference for least squares estimators (LSEs) in additive monotone models under a general fixed lattice design. We establish joint limiting distributions for the LSEs and show that the estimators of different additive components are asymptotically independent. The form of the limiting distribution of each component is determined by how fast the number of design points along the corresponding coordinate grows relative to the total sample size n. Apart from this growth rate, the limit depends only on the noise level and, in the non-Gaussian regimes, on the local derivative of the component. In particular, the limit does not depend on the dimension of the model. When the number of design points along a coordinate grows faster than n^(1/3), we construct tuning-free pointwise confidence intervals based on a pivotal limiting distribution, and we validate the theory in numerical simulations. We further show that the block-size normalization underlying these intervals fails to be pivotal at the critical growth rate n^(1/3). We also prove a switching lemma, of independent interest, that simplifies the derivation of limiting distributions in isotonic regression.
Read the full abstract

Statistical Methodology

Bayesian Group Testing Regression with a Shape-Free Dilution Curve

Group testing pools specimens to cut the cost of screening, but pooling positive specimens with negative ones lowers assay sensitivity, so that the sensitivity of a pooled test depends on how many of its members are positive. Regression models for group testing accommodate this dilution effect through submodels that fix a one-parameter shape for that dependence. We propose BADGER (Bayesian Analysis of Dilution in Group tEsting Regression), a regression model incorporating a shape-free dilution curve. The pooled sensitivity is modeled as a nondecreasing function represented by nonnegative increments with a Dirichlet prior, so that the parametric submodels become special cases. By an appropriate augmentation, every full conditional of BADGER is in closed form and inference is carried out by an exact Gibbs sampler. The evidence for dilution is measured by a Bayes factor computed from the posterior draws. We validate the BADGER model through simulation studies across different dilution shapes, prevalences and pool sizes. We further illustrate the method on hepatitis E serology from a national health survey.
Read the full abstract

Statistical Methodology · Cross-listed from math.ST

Nonparametric Inference for Cumulative Residual Mathai–Haubold Entropy of order $\alpha$

In this paper, we study the properties of cumulative residual Mathai–Haubold entropy of order $\alpha$. A dynamic version of this entropy measure is then proposed, and its properties are examined within the framework of reliability modeling. We show that the dynamic cumulative residual Mathai–Haubold entropy of order $\alpha$ uniquely determines the survival function. Characterization results for the exponential and generalized Pareto distributions are derived using the proposed measure. Furthermore, we develop nonparametric estimators for the cumulative residual Mathai–Haubold entropy and its dynamic counterpart of order $\alpha$, based on the kernel estimation of the survival function. The performance of these estimators is evaluated through a Monte Carlo simulation study. Finally, the practical relevance of the proposed dynamic estimator is illustrated using two real data; failure-time data from aircraft windshields and failure-time data from 40 randomly selected mechanical switches.
Read the full abstract

All authors Anija C.R, Smitha, S., Sudheesh, K. Kattumannil

Statistical Methodology · Cross-listed from cs.LG

Geographically Regularized AUC-Maximizing Personalized Federated Learning

Accurate diagnostic and risk-prediction models are important for supporting clinical decision-making during infectious disease outbreaks. However, privacy and governance requirements may restrict patient-level data sharing across healthcare institutions, and data distributions often vary. Moreover, AUC is widely used to evaluate discriminative performance, motivating its direct optimization in model development. We propose geographically regularized AUC-maximizing personalized federated learning (GrAUC-PFL), which directly optimizes a smooth pairwise AUC surrogate to learn personalized models while keeping patient-level data local and accounting for institutional heterogeneity. Graph-based regularization encourages geographically neighboring institutions to have similar coefficient vectors while retaining a personalized models. Simulations and a real-data application suggest improved discriminative performance, particularly when geographically neighboring institutions have similar data-generating characteristics.
Read the full abstract

Statistical Methodology · Cross-listed from econ.EM

Designing Spatial Treatments

Spatial treatments are interventions assigned to locations potentially distinct from those of the responding units. We study their optimal design under a general model in which a unit's response diminishes with distance to a treated site. Our estimand of interest is an “uncontaminated” effect equal to the average impact of a single intervention site over all hypothetical sites. We propose a novel design based on a Matérn point process which separates treatments by a distance of at least $r$. A larger choice of $r$ reduces bias by separating interventions but increases variance by reducing their numerosity. We choose $r$ to maximize the rate of convergence of a Horvitz-Thompson estimator and prove that this is minimax rate-optimal. We provide weak conditions under which the estimator is asymptotically normal and propose a variance estimator.
Read the full abstract

Statistical Methodology · Cross-listed from stat.ML

Distribution-free inference on the number of changepoints

Suppose we are given an ordered sequence of independent data whose distribution changes $K$ times at unknown locations, for some unknown $K \geq 0$. In this paper, we study the problem of performing distribution-free inference on $K$. First, we show an impossibility result: any distribution-free upper confidence bound on $K$ must be trivial and uninformative. Then, using conformal $p$-values, and under only the assumption that the data segments induced by the changepoints are exchangeable (within themselves) and mutually independent, we construct a finite-sample valid lower confidence bound on $K$, which we call the Conformal LOwer bound on Changepoint Count (CLOCC). We show that CLOCC is the only feasible way to provide a lower bound on $K$ under the stated assumptions, a property we refer to as its universality. We provide practical guidelines for choosing score functions that yield efficient and tight lower bounds. We evaluate CLOCC in several synthetic and real-data experiments, where it provides informative lower bounds on $K$, demonstrating its practical applicability.
Read the full abstract

Statistical Methodology

Multi-Objective Composite Longitudinal Biomarker Scores for Improved Cancer Risk Assessment

Repeated blood-based biomarker measurements can improve cancer risk assessment by capturing longitudinal changes missed by single-time-point analyses. Parametric Empirical Bayes (PEB) incorporates prior measurements to estimate individualized reference values, but existing implementations do not account for the time between measurements and rely on predefined panels with fixed combination rules. We developed improved Parametric Empirical Bayes (iPEB), which accounts for the intervals between serial measurements, adjusts for covariates, and performs feature selection and optimized biomarker combination. iPEB optimizes biomarker weights for specific clinical objectives, such as maximizing sensitivity at a prespecified specificity or diagnostic lead time. We evaluated iPEB through simulations and a real-world application using six protein biomarkers (pro-SFTPB, CEA, CA125, CYFRA 21-1, osteopontin, and HE4) from a case-control study nested within the Prostate, Lung, Colorectal, and Ovarian (PLCO) Cancer Screening Trial. The analysis included 324 lung cancer cases and 1,674 controls with at least two serial measurements; six centers were used for model development and four for independent validation. Optimized for sensitivity at 99% specificity, iPEB achieved 24.2% sensitivity in the independent test set, compared with 18.2% for conventional PEB applied to the same four-marker panel. Optimized instead for lead time, iPEB added approximately 50 days of lead time at that stringent operating point. iPEB improved lung cancer risk assessment in independent PLCO data, supporting objective-driven optimization of longitudinal biomarkers for early detection.
Read the full abstract

All authors Bitan Sarkar, Ana Maria Kenney, James P. Long, Johannes F. Fahrmann, Samir Hanash, Kim-Anh Do, Ehsan Irajizad

Statistical Methodology

Multicollinearity-agnostic feature screening for non-Euclidean responses: a factor adjusted approach

In high-dimensional settings, multicollinearity is a pervasive issue that can substantially impair the performance of feature screening methods based on marginal Fréchet regression. Feature screening for non-Euclidean responses becomes unreliable when ultrahigh-dimensional predictors suffer from multicollinearity, because feature-specific signals may be masked by shared latent factors. To mitigate this effect, we propose a Factor adjusted Fréchet sure independence screening procedure. The method first recovers latent common factors from the predictors and then evaluates each feature by the incremental Fréchet coefficient of determination contributed by its idiosyncratic component beyond the common factors. Under regularity conditions, we establish uniform approximation rates for the feasible screening utilities and prove the sure screening and sure ranking properties. Extensive numerical experiments provide compelling empirical support for the validity and effectiveness of our approach, particularly in scenarios with highly correlated covariates. We further illustrate the practical performance of our method through two representative non-Euclidean datasets: the ADNI dataset and the mortality dataset, both with distribution-valued responses.
Read the full abstract

All authors Moshu Xu, Leheng Cai, Yanmei Shi, Xu Guo, Qirui Hu

Statistical Methodology

Nonparametric heterogeneous causal mediation with orthogonal machine learning

Causal mediation analysis decomposes the total effect of an intervention on an outcome into a direct pathway and an indirect pathway transmitted through a mediator, but standard methods typically summarize these pathways using population average effects. In many applications, however, the indirect effect may vary substantially across individual profiles. We propose an orthogonal statistical learning framework for estimating heterogeneous causal mediation effects conditional on individual characteristics. The method constructs a class of weighted Neyman orthogonal losses motivated by influence function representations of weighted population average effects. These losses directly target conditional mediation estimands whose minimizers are locally insensitive to nuisance estimation errors. We implement the resulting learners under a two-stage meta-learning framework with regularized linear sieves as second-stage smoothers, and introduce a combination of targeted learning and orthogonal learning designed to improve stability when mediator density ratios are unstable. We establish $L^2$ and uniform limit theory and develop pointwise and uniform confidence bands. Simulation studies show that the proposed orthogonal learners reduce the mean integrated squared error by more than $50\%$ compared with existing model-based methods and provide computationally efficient inference in nonlinear settings. The CARDIA, PSACR, and STAR analyses reveal heterogeneous mediated effects across cardiometabolic, psychological, and educational settings.
Read the full abstract

All authors Jiaqi Tong, Yi Zhao, Bhramar Mukherjee, Fan Li

Monday 7 September

Statistical Methodology

Bayesian Matrix-Valued Graphs for Context-Dependent Multivariate Relationships

Many scientific graphs attach several variables to each node, so a single scalar edge weight cannot describe direction-dependent interactions. We model each edge by a symmetric positive-definite (SPD) matrix and infer a posterior over matrix-valued graph geometries, which we call the Bayesian matrix-valued graph (BMVG). We ask how these interactions reconfigure across contexts: how large the change is and which multivariate directions strengthen or weaken. The geodesic distance induced by the affine-invariant Riemannian metric (AIRM) quantifies deformation magnitude and generalized eigenvalues resolve its signed directions.Against fused graphical lasso, Bayesian multiple-GGM, and common principal components, BMVG is competitive on global precision recovery while retaining identifiable matrix-valued edge structure and accurately recovering edge-level deformation directions. In controlled known-truth experiments, it resolves structural change with increasing sample size, including orientation changes that leave ordinary eigenvalues unchanged. In one year of Bay Area weather data, the geometry of 12-hour change reconfigures spatial coupling about as much as whole seasons differ. In TCGA-BRCA, estrogen-receptor (ER)-associated reconfiguration concentrates on specific gene-module pairs and persists under graph-scaffold sparsification and removal of subgroup mean differences. These results establish posterior matrix-valued edge geometry as a unified framework for quantifying and interpreting context-dependent multivariate reconfiguration.
Read the full abstract

Statistical Methodology

Risk-Aware Goal-Oriented Bayesian Optimal Experimental Design

Traditional Bayesian optimal experimental design (OED) selects measurements that best inform a model's parameters. However, such measurements can be suboptimal for downstream predictions. Goal-oriented OED targets the prediction directly. However, the existing goal-oriented criteria value all reductions in predictive uncertainty equally, with no way to prioritize rare, high-consequence outcomes. In this article, we develop a risk-aware framework that composes risk at three levels, each generalizing an ingredient of classical $I$- and $G$-optimal design: a deviation measure of the posterior predictive uncertainty (generalizing the predictive variance), a risk measure across the prediction domain (interpolating $I$-optimal averaging and $G$-optimal worst-case selection), and a risk measure over datasets (generalizing the expectation). We generate each level from a regret function in the risk quadrangle, so that one triple specifies a practitioner's risk preference. We relax the design to continuous weights on the unit simplex and construct a nested-quadrature estimator that is differentiable in the design variable. This enables solving the optimal design problem with gradient-based methods, avoiding a combinatorial search over candidate designs. For a linear-Gaussian lognormal model and a nonlinear extension, we derive closed-form objectives. These give exact references against which we verify that the estimator converges. We demonstrate this framework for finding optimal sensor placements in an inverse problem governed by an advection-diffusion equation. We find that the risk-aware designs substantially outperform the expected-information-gain baseline, which is statistically indistinguishable from a random allocation.
Read the full abstract

All authors John D. Jakeman, Rebekah White, Bart van Bloemen Waanders, Drew P. Kouri, Alen Alexanderian

Statistical Methodology · Cross-listed from stat.ML

The Role of Uncertainty in Assessing the Fairness of Machine Learning Models

Machine learning models are widely used in clinical applications, social media, law enforcement and critical infrastructure. Verifying whether their outputs are biased against disadvantaged groups or individuals is crucial to ensuring they are fair and allowing their use in such settings. A rigorous risk assessment of possible fairness violations requires quantifying the uncertainty associated with selecting and estimating such models. Yet, this is rarely done in the literature, which focuses on identifying a single model with a suitable trade-off between predictive accuracy and fairness. In this paper, we move beyond point estimation and discuss frequentist and Bayesian approaches to uncertainty quantification for fair machine learning, with practical examples and implications for simulated and real data.
Read the full abstract

Statistical Methodology

Retrospective Causal Attribution under Case-Control Sampling

The probability of necessity PN quantifies the probability that an exposed individual who experienced an outcome would not have experienced it in the absence of exposure. Case-control studies are an important resource for investigating etiologic questions, but their sampling design can introduce selection bias and complicate the statistical inference for PN.In this paper, we develop a nonparametric framework for identification and efficient estimation of PN under case-control sampling. With an externally supplied population outcome prevalence, we derive an exact identification formula that identifies PN under standard causal assumptions and monotonicity and yields a valid lower bound without monotonicity. For rare outcomes, we derive a more tractable approximation that requires no external prevalence information and prove that its approximation error vanishes at the order of the population outcome prevalence. We further establish the semiparametric efficiency theory for the exact and approximate functionals, propose asymptotically efficient estimators, and construct confidence intervals for the corresponding targets. The proposed approach has potential applications in biomedical and epidemiological studies where causal attribution is investigated using retrospective data.
Read the full abstract

All authors Zijian Sui, Hong Zhang, Jinfeng Xu, Min Zeng

Statistical Methodology

Modeling Brain MRI Using Persistent Homology and Multilevel Functional Data Analysis

Persistent homology provides a multiscale representation of biomedical images by capturing higher-order topological features that reflect their underlying structural organization. However, the resulting topological summaries are typically used as predictors or features for classification and group comparisons rather than treated as primary variables of interest. We construct a generalized multilevel functional framework for analyzing persistent-homology summaries as longitudinal functional responses in repeated three-dimensional structural magnetic resonance imaging (MRI). Specifically, we represent topological features using Betti curves and model these curves as count-valued functional responses. A negative-binomial distribution accommodates the discrete and potentially overdispersed nature of Betti counts, while the multilevel formulation accounts for the dependence induced by repeated measurements and separates between-subject and within-subject sources of functional variation. Functional principal component analysis further evaluates the dominant modes of variation at each level. A Bayesian approach is used for joint estimation of the functional regression and multilevel functional principal components. We apply this modeling framework to longitudinal structural MRI data from the OASIS-2 study to investigate associations between brain topology and demographic and clinical characteristics, including age, gender, follow-up time, and dementia severity. The results demonstrate that the framework can capture covariate-associated variation across the filtration continuum while evaluating distinct sources and patterns of longitudinal variation across homology dimensions.
Read the full abstract