Statistical Methodology · Cross-listed from physics.soc-ph
Identifiability of Latent Space Network Models on Anisotropic Thurston Geometries
Marios Papamichalis and Regina Ruane
A latent space network model places the nodes in a metric space and lets the probability of a tie decrease with distance. In a space of constant
curvature, pairwise distances determine the positions up to an isometry. In the products and in the three remaining three-dimensional model geometries they do not. We study the three geometries that are neither of constant
curvature nor products: the Heisenberg group, the solvable group and the universal cover of the unit tangent bundle of the
hyperbolic plane. We ask what one network identifies about positions in them and when their geometry is detectable. Two anchors remove the isometry ambiguity. Small configurations are not determined by their distances, and generic local identification holds beyond a finite threshold, certified in the Heisenberg group. We derive the posterior on the quotient by the isometry group. For small configurations, the divergence to the nearest product or constant-
curvature competitor is the stress component of the
curvature difference and vanishes at high order in the scale; undirected ties therefore detect the geometry only in large networks with large enclosed areas. Directed ties expose it at first order: in the two twisted geometries, asymmetric preferences circulate around triangles in proportion to enclosed area, which no additive ranking produces. On dense competitive-game counter networks, the coupled model beats rankings on every geometry, degree-corrected rankings and free antisymmetric terms. A Euclidean model with the same coupled term matches it, so the gain is the coupling of similarity and circulation through shared coordinates. An additive-and-multiplicative-effects model predicts better still.
Read the full abstract ▾
Statistical Methodology · Cross-listed from math.ST
Sieve Estimation of Optimal Transport Maps from Paired Data in Gaussian Spaces
Xin Jin, Kit Chan and Riddhi Pratim Ghosh
We study the estimation of infinite-dimensional optimal transport maps from noisy paired observations. The population map pushes a Gaussian reference measure forward to a target probability measure on a function space and takes the Cameron–Martin gradient form $T=I+\nabla_{\mathcal H}\phi$. Our
estimator uses cylindrical gradient sieves based on finitely many Cameron–Martin coordinates, thereby reducing the problem to finite-dimensional empirical risk minimization. A local nonasymptotic oracle inequality separates cylindrical approximation and statistical estimation errors while accounting for the conditioning of the parametrization. The approximation analysis relies on regularity conditions governing coordinate decay and dependence on omitted input coordinates. For diagonal Gaussian and nonlinear block-interaction classes, we derive matching upper and lower bounds that establish the minimax rate $N^{-s/(2s+1)}$ in expected norm, where $s$ measures weighted coordinate regularity. We further analyze a continuous two-groups model with Gaussian–Laplace mixtures and derive a prediction-risk bound for the resulting transport-map
estimator.
Read the full abstract ▾
Statistical Methodology · Cross-listed from math.NA
Quadratic Point Estimate Method for Uncertainty Quantification with Dependent Non-Gaussian Inputs
Minhyeok Ko and Konstantinos G. Papakonstantinou
As an extension of the Point Estimate Method (PEM) to evaluate probabilistic moments of quantities of interest (QoI) in general $n$-dimensional spaces, the Quadratic Point Estimate Method (QPEM) has been recently developed. This new method is defined to fully represent up to fifth-order input moments in the Gaussian space, providing general analytical expressions for sample locations and weights, without requiring any numerical optimization. The QPEM can significantly improve the estimation accuracy of the output QoI moments, in relation to PEM-based methods whose numbers of sigma points grow linearly with the problem dimension, while at the same time having an affordable and competitive computational cost up to a considerable number of dimensions. The QPEM is further enhanced in this work by enabling copula integration into the framework, which enables effective modeling of the joint input probability density function by estimating marginals and the dependence structure of the involved random variables. The validity and efficient performance of the copula-based QPEM are showcased against numerous other sampling methods in various examples considering two practical scenarios: (i) when the joint dependence structure can be inferred from data, and (ii) when only marginal distributions and correlation
matrices are known.
Read the full abstract ▾
Statistical Methodology
Covariate Adjustment in Randomized Experiments: A Unified Framework for Decision and Practice
Jiawei Fu and Donald P. Green
Should researchers adjust for
covariates in randomized experiments, and if so, how? The literature offers three distinct prescriptions: do not adjust because randomization guarantees unbiasedness; adjust for outcome-prognostic
covariates to improve precision; or adjust for
covariates imbalanced between treatment arms. These competing prescriptions create confusion and uncertainty. We develop a unified framework for decision and practice. Given available information, we show that the optimal correction is what we call ex-post bias. The only relevant criterion for adjustment is prognosticity for ex-post bias; neither raw
covariate imbalance nor outcome prognosticity is sufficient by itself. We also show that correcting imbalance and improving precision are two sides of the same decision problem. We develop two estimation approaches, one of which recovers familiar adjustment
estimators and provides a new theoretical justification for them. Simulations compare alternative
covariate-selection and adjustment strategies. Overall, our framework provides a unified foundation for
covariate adjustment in randomized experiments.
Read the full abstract ▾
Statistical Methodology
Linearly Constrained Generalized Linear Models with Applications in Origin-Destination Estimation
Likun Chou and Luis Carvalho
We show that data censored by linear constraints can be fit within the generalized linear model (GLM) framework, recovering the expected latent counts together with their uncertainty in a single Fisher-scoring procedure. Our motivating application is origin-destination (OD) estimation in transportation studies, where the latent data are the OD trip demands and constraints are either origin and destination marginal counts per zone, as in OD
matrix estimation, or observed link counts, as in network
tomography. Casting the problem as a linearly constrained GLM lets us treat, within one model, three features that arise routinely in practice: unmatched constraints, trip predictors such as costs, and prior information such as diagonal dominance and seed counts. We demonstrate the methodology in synthetic and small scale studies and in a larger case study based on simulated data from the BO4Mob study.
Read the full abstract ▾
Statistical Methodology · Cross-listed from cs.IT
On Weighted Mathai-Haubold Entropy Measures
Oindrali Das and Siddhartha Chakraborty
In this paper, we propose weighted Mathai-Haubold
entropy along with their residual and past versions and study their properties. We develop aging classes based on the weighted Mathai-Haubold residual and past
entropy measures. Also, some inequalities related to the three proposed measures are discussed. Non-parametric
estimators of the proposed measures are introduced and their properties are investigated. Performance of this
estimator is evaluated by means of bias and mean squared error using Monte-Carlo simulations.
Read the full abstract ▾
Statistical Methodology · Cross-listed from stat.AP
Bayesian palaeoclimate reconstruction from zero-inflated count-compositional pollen data: A case study of Lago Grande di Monticchio in southern Italy
André F. B. Menezes, Andrew C. Parnell, Brian Huntley et al. (+1 more)
Bayesian palaeoclimate reconstruction from fossil pollen counts relies on a modern pollen-
climate calibration data set to infer the pollen-
climate relationships used to reconstruct past climates. While geographically large calibration data sets improve coverage of
climate space and reduce unreliable extrapolation, they also introduce substantial heterogeneity, structural zeros, and complex pollen-
climate relationships. We propose a
Bayesian modular framework for palaeoclimate reconstruction from count-compositional pollen data that addresses these challenges, and provides coherent uncertainty quantification. The framework employs the zero-and-$N$-inflated multinomial logistic-normal distribution to describe the compositional pollen counts coupled with
Bayesian additive regression tree priors to model the nonlinear effects and interactions among the
climate covariates. Inference is formulated through a cut posterior distribution that modularises the analysis into forward and reconstruction modules. The forward module is fitted once using a large modern calibration data set and its posterior uncertainty is subsequently propagated to reconstruct
climate variables from fossil pollen counts. For the reconstruction module, we develop and compare three inverse posterior sampling schemes. Simulation studies and empirical validation on the modern data set demonstrate that a combination of sampling importance resampling with a multiple imputation technique and a continuous uniform prior over the domain of the modern
climate variables achieves the best predictive performance, with well-calibrated uncertainty quantification for the
climate reconstruction. In our motivating case study, we further illustrate the proposed methodology by reconstructing a three-dimensional
climate vector from fossil pollen records collected at Lago Grande di Monticchio in southern Italy.
Read the full abstract ▾
All authors André F. B. Menezes, Andrew C. Parnell, Brian Huntley, Keefe Murphy
Statistical Methodology
A Closed-Form Estimator and Diagnostic Battery for Anchor-Judge Error Correlation, Under a Single-Common-Factor Model
Veerendra Kumar Sunkavalli
When an external reference set (an anchor) is used to decompose an LLM-judge panel's error into a quality signal and a shared common-mode error, standard practice assumes the anchor is uncontaminated: its error uncorrelated with the judges' shared error. We study when that assumption can be dropped and replaced by an estimate. Under a single-common-factor model, >=2 judges and >=2 anchors point-identify the quality variance, the common-mode variance, and each anchor's contamination correlation rho_k in closed form, with an exact per-anchor-pair failure boundary; a designated clean-anchor
estimator, by contrast, reports a contaminated companion anchor as fully clean once its trusted anchor is itself contaminated. Because the single-common-factor assumption is itself untestable, the
estimator ships gated behind a calibrated diagnostic battery (judge-covariance dispersion; over-identification; a family-block test from judge metadata, with a family-blocked
estimator that removes family-level shared-residual bias exactly), bootstrap confidence intervals with measured coverage, and a weak-identification screen. A proposition maps which violations bias rho_k, in which direction, and which evade detection. For ordinal scores we show an identification hierarchy: with all variables ordinal, rho_k is not identified at any number of anchors; with ordinal judges and >=3 continuous anchors it is, and we give an
estimator for that case. On real data the validation is asymmetric, and we say so plainly: the diagnostics are validated in the rejecting direction (both real panels we test are correctly rejected by the model-adequacy pre-test), while the
estimator is validated in simulation and stress-tested semi-synthetically under oracle calibration; no real panel has yet passed the pre-test, and the pre-test exists precisely to say so. All results replay offline from shipped, checksummed artifacts.
Read the full abstract ▾
Statistical Methodology · Cross-listed from stat.AP
Dynamic Latent Space Modeling of Inhomogeneous Poisson Network Processes with Applications to International Relations
Jie Jian, Jiguo Cao and Owen G. Ward
We study continuous-time relational event data, where time-stamped dyadic interactions reflect both individual node propensities and evolving relational proximity. We propose a dynamic latent space model for inhomogeneous Poisson processes, where event intensities depend on node-specific activity parameters and time-varying latent distances modeled via flexible B-splines. We prove model identifiability by decoupling baseline activity from latent position, ensuring high interaction volumes do not warp the spatial map. For scalability, we develop a minibatch
stochastic gradient
algorithm with stable initialization and
geometric anchoring, alongside an effective-degrees-of-freedom BIC for tuning model complexity. Simulations confirm accurate parameter recovery and out-of-sample prediction. Applied to cooperative diplomatic events among 60 major economies (1995–2022), the model uncovers shifting patterns of international cooperation and isolates mobile geopolitical actors from stationary institutional anchors.
Read the full abstract ▾
Statistical Methodology · Cross-listed from math.ST
Improved Variance Estimation in Homoskedastic Nonparametric Random-Design Regression via a Two-Scale Approach
Edgar Dobriban, Rajarshi Mukherjee, James M. Robins et al. (+1 more)
We study estimation of a constant conditional variance $\sigma^2$ in nonparametric regression with a $d$-dimensional random design. This is an important problem, and similar questions arise in causal inference. The regression function is $\beta_b$-Hölder smooth, the design density is $\beta_g$-Hölder smooth and bounded above and away from zero, and we consider the nonparametric regime $\beta_b>1$ and $d>4\beta_b$. Set $\beta_g^\star=\beta_b(1-4\beta_b/d)/\{1+2\beta_b/d+8(\beta_b/d)^2\}$. We give an
estimator whose mean squared error is upper bounded by $Cn^{-4(\beta_b+1)/(d+4)}$ in the low-regularity regime when $0<\beta_g\leq\beta_g^\star$. The low-regularity branch is based on a new two-scale construction: the
covariate space is partitioned into
cells, the local
polynomial trend is projected out within each suitable
cell, and the squared normalized contrast from one eligible close pair per
cell is averaged across
cells. In the high regularity regime when $\beta_g>\beta_g^\star$, a higher-order influence function
estimator of Robins, Li, Tchetgen Tchetgen, and van der Vaart (2008) provides the rate $Cn^{-8\beta_b/(d+4\beta_b)}$. We also give an all-pairs ridge extension, which achieves the same two-scale rate, and evaluate the methods alongside a range of existing
estimators in simulations.
Read the full abstract ▾
All authors Edgar Dobriban, Rajarshi Mukherjee, James M. Robins, Zixiao Wang
Statistical Methodology
Cursive: The Trace from the Curse of Dimensionality
Hao Chen
Modern data are increasingly high-dimensional or non-Euclidean. As dimension grows, new statistical patterns can emerge in the relations among observations, while a conventional statistical summary may fail to retain the signal they carry. This paper names and organizes a research program around this observation, calling it Cursive. Cursive asks which relational information is lost when the summary is formed and how the analysis should be redesigned around that information. The canonical example is the generalized edge-count test, which keeps the two within-sample edge counts whose opposing deviations can cancel in the classical between-sample count. This paper traces how the same design question has led to task-specific methods built from graphs, graph-based ranks, kernels, and dissimilarity profiles for testing, change-point detection,
covariate-balance assessment, clustering, classification, and generative-model evaluation.
Read the full abstract ▾
Statistical Methodology
Instability in Patient Clustering: A Multiverse Analysis of Unsupervised Clustering in the CENTER-TBI cohort
Sean R E A Bagcik, Aneeta Merlin Chacko, Ewout W Steyerberg et al. (+4 more)
Understanding patient heterogeneity is key to improving prognostic modeling in traumatic
brain injury (TBI). Unsupervised clustering is widely used to explore patterns in patient characteristics that may define subgroups. However, it involves a multitude of decisions, including the choice of
algorithm, the distance metric, and the method used to determine the "optimal" number of clusters. The aim of this study is to investigate how these choices influence the resulting clustering solution. We analyzed data from 4,509 patients enrolled in the Collaborative European NeuroTrauma Effectiveness Research in TBI (CENTER-TBI) study. K-medoids, agglomerative, and spectral clustering were applied in a complete 3 X 2 X 2 factorial design, in combination with Euclidean or Gower's distances, and silhouette score or gap statistic to choose the number of clusters. We investigated the agreement of clustering solutions with UpSet Plots and stability with the (adjusted) Rand index. Comparisons were made both across approaches using the original
dataset and within approaches using bootstrap resampling. Clustering results varied substantially depending on the analysis choices. The number of suggested clusters varied widely, from one to twenty-five. Adjusted Rand indices confirmed low concordance between methods. Moreover, none of the clustering solutions demonstrated discriminatory performance comparable to a supervised logistic regression model in classifying patient recovery illustrating the limited usefulness of clustering for this purpose. The high instability in clustering results compromises interpretability and underscores that such solutions should not be blindly interpreted as underlying structure.
Read the full abstract ▾
All authors Sean R E A Bagcik, Aneeta Merlin Chacko, Ewout W Steyerberg, Maarten van Smeden, Andrew I R Maas, Erik van Zwet, Nicole S Erler
Statistical Methodology
Evaluating Efficiency of Platform Trials Under Delayed Outcomes Using Treatment Throughput
Aritra Mukherjee and James M. S. Wason
Background: Platform trials improve efficiency by enabling early stopping of ineffective arms, shared controls, and addition of new treatments without compromising statistical properties. However, delays in observing primary outcomes may reduce these benefits. Investigators must either pause recruitment, delaying identification of effective treatments, or continue recruitment, potentially enrolling participants who cannot benefit from interim decisions. We assess the impact of outcome delay on platform trial efficiency using a novel metric. Methods: We propose Expected Throughput (ET), defined as the expected number of treatment arms evaluated per 1000 participants. ET accounts for participants recruited while awaiting outcomes. We consider a multi-stage sequential design for each treatment arm and assess ET across different outcome delays, assuming uniform patient accrual. Results: Outcome delays substantially reduce platform trial efficiency, with the impact dependent on recruitment rate and delay length. At a recruitment rate of 10 patients per month, severe losses occur when delays exceed 12 months. When outcome delay exceeds two-thirds of the time required to recruit a single arm, substantially fewer treatment arms are evaluated than anticipated. Conclusion: Outcome delay can markedly reduce platform trial efficiency. Recruitment rates and expected outcome delays should therefore be considered during trial planning.
Read the full abstract ▾
Statistical Methodology
Transfer Learning with Heterogeneous Feature Spaces in Linear Regression
Zejing Zheng, Rui Huang and Junlong Zhao
Transfer learning improves target-task performance by leveraging related source data. Most methods assume shared feature spaces, yet in many applications, each source observes only a subset of target
covariates. Classical imputation fails here due to block missingness, and standard imputation
matrices are not optimized for target parameter estimation. We study low- and high-dimensional linear regression and propose Heterogeneous Importance Weighting (HIW). Our method aligns feature spaces via projection-based imputation and transfers information through sample-selected importance weighting. This framework accommodates diverse projection
matrices to construct target-oriented imputation. We develop a classification-based procedure with pseudo-responses to estimate conditional error densities for the weights. We establish entry-wise and global convergence rates for the
estimator, with numerical and real-data studies demonstrating its effectiveness.
Read the full abstract ▾
Statistical Methodology
Nonparametric framework for the definition, adaptive detection and probabilistic interpretation of outliers
Tiziano Iannaccio and Maurizio Vichi
Outlier detection is a fundamental challenge in data processing, with critical implications for robustness across statistical modeling, machine learning and exploratory data analysis. However, existing proposals rarely offer a universal, domain-agnostic definition of an outlier, often relying on heuristic trimming quotas that lack a statistical interpretation. To address this, we propose a nonparametric framework built on a pseudo-isolation outlier score. This score enables a formal, probabilistic definition of an anomaly tied to a false-alarm rate $\alpha$, which extends into a rigorous
geometric classification of internal and external outliers. We show that this mechanism seamlessly embeds into any objective-based clustering framework to identify cluster-specific outliers. Here, we integrate it into $K$-means to create ODK-means. The inferential capabilities and topological properties of this framework are explored both theoretically through formal propositions and empirically through extensive simulations and methodological tutorials, highlighting the practical actionability and intuitive appeal of the proposed outlier detection logic.
Read the full abstract ▾
Statistical Methodology
Structure-based Transfer Learning
Ho Yi Alexis Ho, Xinzhou Guo and Shuoxun Xu
Transfer learning improves estimation in a target study using information from related sources. Classical transfer learning is typically data-based, requiring access to the source data or to a model fitted on them. Neither is available in many modern studies, as both are often proprietary or unreported. What can be transferred instead is structure: summarized information derived from a source, such as the supports of predictors, which is available and interpretable without access to the source data or model. The prevalence of the Large
Language Model (LLM) provides a rich source of such structure information. However, data-based transfer learning can not well utilize it as accessing the data and model of the LLM is often infeasible. In this paper, we propose a novel transfer learning framework based on structure. In particular, we focus on linear model and aim to use supports generated by multiple
agents, such as LLM, to improve estimation in the target study. Our procedure maps each support into the target parameter space, aggregates the results with data-driven weights, and applies a sparse correction against inaccurate supports. We establish nonasymptotic guarantees: the
estimator improves on the target-only Lasso when the supports are informative and never does worse otherwise. Simulations and a gene-expression application confirm both properties.
Read the full abstract ▾
Statistical Methodology · Cross-listed from math.ST
Statistical Inference for Additive Monotone Models under the Fixed Lattice Design
Huachen Ren
We study statistical inference for least squares
estimators (LSEs) in additive monotone models under a general fixed
lattice design. We establish joint limiting distributions for the LSEs and show that the
estimators of different additive components are asymptotically independent. The form of the limiting distribution of each component is determined by how fast the number of design points along the corresponding coordinate grows relative to the total sample size n. Apart from this growth rate, the limit depends only on the noise level and, in the non-Gaussian regimes, on the local derivative of the component. In particular, the limit does not depend on the dimension of the model. When the number of design points along a coordinate grows faster than n^(1/3), we construct tuning-free pointwise confidence intervals based on a pivotal limiting distribution, and we validate the theory in numerical simulations. We further show that the block-size normalization underlying these intervals fails to be pivotal at the critical growth rate n^(1/3). We also prove a switching lemma, of independent interest, that simplifies the derivation of limiting distributions in isotonic regression.
Read the full abstract ▾
Statistical Methodology
Bayesian Group Testing Regression with a Shape-Free Dilution Curve
Chun-Hao Yang and Wei-Yan Hong
Group testing pools specimens to cut the cost of screening, but pooling positive specimens with negative ones lowers assay sensitivity, so that the sensitivity of a pooled test depends on how many of its members are positive. Regression models for group testing accommodate this dilution effect through submodels that fix a one-parameter shape for that dependence. We propose BADGER (
Bayesian Analysis of Dilution in Group tEsting Regression), a regression model incorporating a shape-free dilution curve. The pooled sensitivity is modeled as a nondecreasing function represented by nonnegative increments with a Dirichlet prior, so that the parametric submodels become special cases. By an appropriate augmentation, every full conditional of BADGER is in closed form and inference is carried out by an exact Gibbs sampler. The evidence for dilution is measured by a Bayes factor computed from the posterior draws. We validate the BADGER model through simulation studies across different dilution shapes, prevalences and pool sizes. We further illustrate the method on hepatitis E serology from a national health survey.
Read the full abstract ▾
Statistical Methodology · Cross-listed from math.ST
Nonparametric Inference for Cumulative Residual Mathai–Haubold Entropy of order $\alpha$
Anija C.R, Smitha, S. et al. (+2 more)
In this paper, we study the properties of cumulative residual Mathai–Haubold
entropy of order $\alpha$. A dynamic version of this
entropy measure is then proposed, and its properties are examined within the framework of reliability modeling. We show that the dynamic cumulative residual Mathai–Haubold
entropy of order $\alpha$ uniquely determines the survival function. Characterization results for the exponential and generalized Pareto distributions are derived using the proposed measure. Furthermore, we develop nonparametric
estimators for the cumulative residual Mathai–Haubold
entropy and its dynamic counterpart of order $\alpha$, based on the kernel estimation of the survival function. The performance of these
estimators is evaluated through a Monte Carlo simulation study. Finally, the practical relevance of the proposed dynamic
estimator is illustrated using two real data; failure-time data from aircraft windshields and failure-time data from 40 randomly selected mechanical switches.
Read the full abstract ▾
All authors Anija C.R, Smitha, S., Sudheesh, K. Kattumannil
Statistical Methodology · Cross-listed from cs.LG
Geographically Regularized AUC-Maximizing Personalized Federated Learning
Mayu Hiraishi, Kensuke Tanioka and Toshio Shimokawa
Accurate diagnostic and risk-prediction models are important for supporting clinical decision-making during infectious disease outbreaks. However,
privacy and governance requirements may restrict patient-level data sharing across healthcare institutions, and data distributions often vary. Moreover, AUC is widely used to evaluate discriminative performance, motivating its direct optimization in model development. We propose geographically regularized AUC-maximizing personalized
federated learning (GrAUC-PFL), which directly optimizes a smooth pairwise AUC surrogate to learn personalized models while keeping patient-level data local and accounting for institutional heterogeneity. Graph-based regularization encourages geographically neighboring institutions to have similar coefficient vectors while retaining a personalized models. Simulations and a real-data application suggest improved discriminative performance, particularly when geographically neighboring institutions have similar data-generating characteristics.
Read the full abstract ▾
Statistical Methodology · Cross-listed from econ.EM
Designing Spatial Treatments
Stefan Faridani and Michael P. Leung
Spatial treatments are interventions assigned to locations potentially distinct from those of the responding units. We study their optimal design under a general model in which a unit's response diminishes with distance to a treated site. Our estimand of interest is an “uncontaminated” effect equal to the average impact of a single intervention site over all hypothetical sites. We propose a novel design based on a Matérn point process which separates treatments by a distance of at least $r$. A larger choice of $r$ reduces bias by separating interventions but increases variance by reducing their numerosity. We choose $r$ to maximize the rate of convergence of a Horvitz-Thompson
estimator and prove that this is minimax rate-optimal. We provide weak conditions under which the
estimator is asymptotically normal and propose a variance
estimator.
Read the full abstract ▾
Statistical Methodology · Cross-listed from stat.ML
Distribution-free inference on the number of changepoints
Rohan Hore and Aaditya Ramdas
Suppose we are given an ordered sequence of independent data whose distribution changes $K$ times at unknown locations, for some unknown $K \geq 0$. In this paper, we study the problem of performing distribution-free inference on $K$. First, we show an impossibility result: any distribution-free upper confidence bound on $K$ must be trivial and uninformative. Then, using conformal $p$-values, and under only the assumption that the data segments induced by the changepoints are exchangeable (within themselves) and mutually independent, we construct a finite-sample valid lower confidence bound on $K$, which we call the Conformal LOwer bound on Changepoint Count (CLOCC). We show that CLOCC is the only feasible way to provide a lower bound on $K$ under the stated assumptions, a property we refer to as its universality. We provide practical guidelines for choosing score functions that yield efficient and tight lower bounds. We evaluate CLOCC in several synthetic and real-data experiments, where it provides informative lower bounds on $K$, demonstrating its practical applicability.
Read the full abstract ▾
Statistical Methodology
Multi-Objective Composite Longitudinal Biomarker Scores for Improved Cancer Risk Assessment
Bitan Sarkar, Ana Maria Kenney, James P. Long et al. (+4 more)
Repeated blood-based biomarker measurements can improve cancer risk assessment by capturing longitudinal changes missed by single-time-point analyses. Parametric Empirical Bayes (PEB) incorporates prior measurements to estimate individualized reference values, but existing implementations do not account for the time between measurements and rely on predefined panels with fixed combination rules. We developed improved Parametric Empirical Bayes (iPEB), which accounts for the intervals between serial measurements, adjusts for
covariates, and performs feature selection and optimized biomarker combination. iPEB optimizes biomarker weights for specific clinical objectives, such as maximizing sensitivity at a prespecified specificity or diagnostic lead time. We evaluated iPEB through simulations and a real-world application using six
protein biomarkers (pro-SFTPB, CEA, CA125, CYFRA 21-1, osteopontin, and HE4) from a case-control study nested within the Prostate, Lung, Colorectal, and Ovarian (PLCO) Cancer Screening Trial. The analysis included 324 lung cancer cases and 1,674 controls with at least two serial measurements; six centers were used for model development and four for independent validation. Optimized for sensitivity at 99% specificity, iPEB achieved 24.2% sensitivity in the independent test set, compared with 18.2% for conventional PEB applied to the same four-marker panel. Optimized instead for lead time, iPEB added approximately 50 days of lead time at that stringent operating point. iPEB improved lung cancer risk assessment in independent PLCO data, supporting objective-driven optimization of longitudinal biomarkers for early detection.
Read the full abstract ▾
All authors Bitan Sarkar, Ana Maria Kenney, James P. Long, Johannes F. Fahrmann, Samir Hanash, Kim-Anh Do, Ehsan Irajizad
Statistical Methodology
Multicollinearity-agnostic feature screening for non-Euclidean responses: a factor adjusted approach
Moshu Xu, Leheng Cai, Yanmei Shi et al. (+2 more)
In high-dimensional settings, multicollinearity is a pervasive issue that can substantially impair the performance of feature screening methods based on marginal Fréchet regression. Feature screening for non-Euclidean responses becomes unreliable when ultrahigh-dimensional predictors suffer from multicollinearity, because feature-specific signals may be masked by shared latent factors. To mitigate this effect, we propose a Factor adjusted Fréchet sure independence screening procedure. The method first recovers latent common factors from the predictors and then evaluates each feature by the incremental Fréchet coefficient of determination contributed by its idiosyncratic component beyond the common factors. Under regularity conditions, we establish uniform approximation rates for the feasible screening utilities and prove the sure screening and sure ranking properties. Extensive numerical experiments provide compelling empirical support for the validity and effectiveness of our approach, particularly in scenarios with highly correlated
covariates. We further illustrate the practical performance of our method through two representative non-Euclidean
datasets: the ADNI
dataset and the mortality
dataset, both with distribution-valued responses.
Read the full abstract ▾
All authors Moshu Xu, Leheng Cai, Yanmei Shi, Xu Guo, Qirui Hu
Statistical Methodology
Nonparametric heterogeneous causal mediation with orthogonal machine learning
Jiaqi Tong, Yi Zhao, Bhramar Mukherjee et al. (+1 more)
Causal mediation analysis decomposes the total effect of an intervention on an outcome into a direct pathway and an indirect pathway transmitted through a mediator, but standard methods typically summarize these pathways using population average effects. In many applications, however, the indirect effect may vary substantially across individual profiles. We propose an orthogonal statistical learning framework for estimating heterogeneous causal mediation effects conditional on individual characteristics. The method constructs a class of weighted Neyman orthogonal losses motivated by influence function representations of weighted population average effects. These losses directly target conditional mediation estimands whose minimizers are locally insensitive to nuisance estimation errors. We implement the resulting learners under a two-stage meta-learning framework with regularized linear sieves as second-stage smoothers, and introduce a combination of targeted learning and orthogonal learning designed to improve stability when mediator density ratios are unstable. We establish $L^2$ and uniform limit theory and develop pointwise and uniform confidence bands. Simulation studies show that the proposed orthogonal learners reduce the mean integrated squared error by more than $50\%$ compared with existing model-based methods and provide computationally efficient inference in nonlinear settings. The CARDIA, PSACR, and
STAR analyses reveal heterogeneous mediated effects across cardiometabolic, psychological, and educational settings.
Read the full abstract ▾
All authors Jiaqi Tong, Yi Zhao, Bhramar Mukherjee, Fan Li