Statistical Methodology
Cursive: The Trace from the Curse of Dimensionality
Hao Chen
Modern data are increasingly high-dimensional or non-Euclidean. As dimension grows, new statistical patterns can emerge in the relations among observations, while a conventional statistical summary may fail to retain the signal they carry. This paper names and organizes a research program around this observation, calling it Cursive. Cursive asks which relational information is lost when the summary is formed and how the analysis should be redesigned around that information. The canonical example is the generalized edge-count test, which keeps the two within-sample edge counts whose opposing deviations can cancel in the classical between-sample count. This paper traces how the same design question has led to task-specific methods built from graphs, graph-based ranks, kernels, and dissimilarity profiles for testing, change-point detection,
covariate-balance assessment, clustering, classification, and generative-model evaluation.
Read the full abstract ▾
Machine Learning (Statistics) · Cross-listed from cs.LG
AlphaRJM: Reward-Jump Memory for Stochastic Return-Guided Alpha Discovery
Sayan Dhan and Selvaraju Natarajan
Formulaic alpha discovery is a pool-dependent symbolic search problem in which informative feedback is observed primarily when a complete expression is evaluated. This delayed feedback creates two coupled difficulties: the retained alpha pool does not preserve the full history of realized evaluation feedback, and the value of an intermediate construction action is uncertain because its consequence depends on the formula eventually completed. We introduce AlphaRJM, which addresses these difficulties through Reward-Jump
Memory, an event-driven latent state that remains fixed during
token construction and updates only at terminal evaluation events using the realized pool reward and evaluation outcome, and an action-conditioned SDE return critic that represents future discounted discovery returns with
stochastic particles. The particles guide action selection through their mean and uncertainty and are learned using a distributional Bellman objective combining energy-distance matching, mean calibration, and jump regularization. Empirically, AlphaRJM delivers strong and stable gains across multiple equity universes, forecasting horizons, and random seeds, while ablations confirm the complementary roles of persistent evaluation history,
stochastic return modeling, and distributional supervision.
Read the full abstract ▾
Statistical Methodology
Instability in Patient Clustering: A Multiverse Analysis of Unsupervised Clustering in the CENTER-TBI cohort
Sean R E A Bagcik, Aneeta Merlin Chacko, Ewout W Steyerberg et al. (+4 more)
Understanding patient heterogeneity is key to improving prognostic modeling in traumatic
brain injury (TBI). Unsupervised clustering is widely used to explore patterns in patient characteristics that may define subgroups. However, it involves a multitude of decisions, including the choice of
algorithm, the distance metric, and the method used to determine the "optimal" number of clusters. The aim of this study is to investigate how these choices influence the resulting clustering solution. We analyzed data from 4,509 patients enrolled in the Collaborative European NeuroTrauma Effectiveness Research in TBI (CENTER-TBI) study. K-medoids, agglomerative, and spectral clustering were applied in a complete 3 X 2 X 2 factorial design, in combination with Euclidean or Gower's distances, and silhouette score or gap statistic to choose the number of clusters. We investigated the agreement of clustering solutions with UpSet Plots and stability with the (adjusted) Rand index. Comparisons were made both across approaches using the original
dataset and within approaches using bootstrap resampling. Clustering results varied substantially depending on the analysis choices. The number of suggested clusters varied widely, from one to twenty-five. Adjusted Rand indices confirmed low concordance between methods. Moreover, none of the clustering solutions demonstrated discriminatory performance comparable to a supervised logistic regression model in classifying patient recovery illustrating the limited usefulness of clustering for this purpose. The high instability in clustering results compromises interpretability and underscores that such solutions should not be blindly interpreted as underlying structure.
Read the full abstract ▾
All authors Sean R E A Bagcik, Aneeta Merlin Chacko, Ewout W Steyerberg, Maarten van Smeden, Andrew I R Maas, Erik van Zwet, Nicole S Erler
Machine Learning (Statistics)
Non-Adaptive 1-Bit Mean Estimation: Minimax Rates and the Sample-Interval Tradeoff
Ivan Lau and Jonathan Scarlett
We study distributed one-dimensional mean estimation under a 1-bit communication constraint. Each
agent observes one sample, drawn independently from an unknown distribution, and returns a single bit in response to a query $Q: \mathbb{R}\to\{0,1\}$ chosen by a central learner. The distribution has mean in $[-\lambda,\lambda]$ and $k$-th central moment at most $\sigma^k$, for a fixed $k>1$. The order-optimal two-stage protocol of Lau and Scarlett uses responses from the first batch to choose the second-batch queries, motivating the question of whether this single round of interaction is necessary. We answer this negatively: for every $k>1$, a non-adaptive protocol attains the adaptive 1-bit minimax rate (and concurrent works reached the same conclusion via different strategies). We further determine the minimax sample complexity among non-adaptive 1-bit
estimators when every one-set $Q^{-1}(1)$ is restricted to a union of at most $s$ intervals. Relative to unrestricted non-adaptive 1-bit querying, this constraint adds a term of order $(\lambda\sigma/(s\varepsilon^2))\log(1/\delta)$, giving the full tradeoff between sample complexity and interval complexity to within $k$-dependent constant factors. As a corollary, we identify, order-wise, the minimum interval budget needed to retain the unrestricted 1-bit minimax sample rate.
Read the full abstract ▾
Statistical Methodology
Evaluating Efficiency of Platform Trials Under Delayed Outcomes Using Treatment Throughput
Aritra Mukherjee and James M. S. Wason
Background: Platform trials improve efficiency by enabling early stopping of ineffective arms, shared controls, and addition of new treatments without compromising statistical properties. However, delays in observing primary outcomes may reduce these benefits. Investigators must either pause recruitment, delaying identification of effective treatments, or continue recruitment, potentially enrolling participants who cannot benefit from interim decisions. We assess the impact of outcome delay on platform trial efficiency using a novel metric. Methods: We propose Expected Throughput (ET), defined as the expected number of treatment arms evaluated per 1000 participants. ET accounts for participants recruited while awaiting outcomes. We consider a multi-stage sequential design for each treatment arm and assess ET across different outcome delays, assuming uniform patient accrual. Results: Outcome delays substantially reduce platform trial efficiency, with the impact dependent on recruitment rate and delay length. At a recruitment rate of 10 patients per month, severe losses occur when delays exceed 12 months. When outcome delay exceeds two-thirds of the time required to recruit a single arm, substantially fewer treatment arms are evaluated than anticipated. Conclusion: Outcome delay can markedly reduce platform trial efficiency. Recruitment rates and expected outcome delays should therefore be considered during trial planning.
Read the full abstract ▾
Machine Learning (Statistics) · Cross-listed from math.OC
The Exact Time-Uniform Rate Frontier for Stochastic Gradient Descent on Smooth Convex Objectives
Ruijie Li, Kang Chen and Tianyu Wang
We study the time-uniform convergence of the raw iterate of standard
stochastic gradient descent (SGD) for unconstrained smooth convex objectives. We prove that, under standard noise assumptions, the time-uniform convergence rate gets arbitrarily close to $\sqrt{\log n / n}$ but never reaches it. More specifically, we prove that for every positive, eventually nondecreasing sequence $h$ satisfying $h(n) = o(\sqrt{n})$, a bound of order $h(n)/\sqrt{n}$, holding simultaneously for all $n$ with probability at least $1-\alpha$ and uniformly over the problem class, is achievable if and only if \[ \sum_{j = 1}^{\infty} \frac{1}{h(2^j)^2} < \infty. \] The constructive sufficiency result follows from a dyadic horizon-free schedule together with an additive conditional-restart inequality. The necessity counterpart applies to every deterministic nonnegative schedule and holds even for a one-dimensional analytic smooth convex objective with Gaussian noise.
Read the full abstract ▾
Statistical Methodology
Transfer Learning with Heterogeneous Feature Spaces in Linear Regression
Zejing Zheng, Rui Huang and Junlong Zhao
Transfer learning improves target-task performance by leveraging related source data. Most methods assume shared feature spaces, yet in many applications, each source observes only a subset of target
covariates. Classical imputation fails here due to block missingness, and standard imputation
matrices are not optimized for target parameter estimation. We study low- and high-dimensional linear regression and propose Heterogeneous Importance Weighting (HIW). Our method aligns feature spaces via projection-based imputation and transfers information through sample-selected importance weighting. This framework accommodates diverse projection
matrices to construct target-oriented imputation. We develop a classification-based procedure with pseudo-responses to estimate conditional error densities for the weights. We establish entry-wise and global convergence rates for the
estimator, with numerical and real-data studies demonstrating its effectiveness.
Read the full abstract ▾
Statistical Methodology
Nonparametric framework for the definition, adaptive detection and probabilistic interpretation of outliers
Tiziano Iannaccio and Maurizio Vichi
Outlier detection is a fundamental challenge in data processing, with critical implications for robustness across statistical modeling, machine learning and exploratory data analysis. However, existing proposals rarely offer a universal, domain-agnostic definition of an outlier, often relying on heuristic trimming quotas that lack a statistical interpretation. To address this, we propose a nonparametric framework built on a pseudo-isolation outlier score. This score enables a formal, probabilistic definition of an anomaly tied to a false-alarm rate $\alpha$, which extends into a rigorous
geometric classification of internal and external outliers. We show that this mechanism seamlessly embeds into any objective-based clustering framework to identify cluster-specific outliers. Here, we integrate it into $K$-means to create ODK-means. The inferential capabilities and topological properties of this framework are explored both theoretically through formal propositions and empirically through extensive simulations and methodological tutorials, highlighting the practical actionability and intuitive appeal of the proposed outlier detection logic.
Read the full abstract ▾
Statistical Methodology
Structure-based Transfer Learning
Ho Yi Alexis Ho, Xinzhou Guo and Shuoxun Xu
Transfer learning improves estimation in a target study using information from related sources. Classical transfer learning is typically data-based, requiring access to the source data or to a model fitted on them. Neither is available in many modern studies, as both are often proprietary or unreported. What can be transferred instead is structure: summarized information derived from a source, such as the supports of predictors, which is available and interpretable without access to the source data or model. The prevalence of the Large
Language Model (LLM) provides a rich source of such structure information. However, data-based transfer learning can not well utilize it as accessing the data and model of the LLM is often infeasible. In this paper, we propose a novel transfer learning framework based on structure. In particular, we focus on linear model and aim to use supports generated by multiple
agents, such as LLM, to improve estimation in the target study. Our procedure maps each support into the target parameter space, aggregates the results with data-driven weights, and applies a sparse correction against inaccurate supports. We establish nonasymptotic guarantees: the
estimator improves on the target-only Lasso when the supports are informative and never does worse otherwise. Simulations and a gene-expression application confirm both properties.
Read the full abstract ▾
Statistics Theory
Statistical Inference for Additive Monotone Models under the Fixed Lattice Design
Huachen Ren
We study statistical inference for least squares
estimators (LSEs) in additive monotone models under a general fixed
lattice design. We establish joint limiting distributions for the LSEs and show that the
estimators of different additive components are asymptotically independent. The form of the limiting distribution of each component is determined by how fast the number of design points along the corresponding coordinate grows relative to the total sample size n. Apart from this growth rate, the limit depends only on the noise level and, in the non-Gaussian regimes, on the local derivative of the component. In particular, the limit does not depend on the dimension of the model. When the number of design points along a coordinate grows faster than n^(1/3), we construct tuning-free pointwise confidence intervals based on a pivotal limiting distribution, and we validate the theory in numerical simulations. We further show that the block-size normalization underlying these intervals fails to be pivotal at the critical growth rate n^(1/3). We also prove a switching lemma, of independent interest, that simplifies the derivation of limiting distributions in isotonic regression.
Read the full abstract ▾
Statistical Methodology
Bayesian Group Testing Regression with a Shape-Free Dilution Curve
Chun-Hao Yang and Wei-Yan Hong
Group testing pools specimens to cut the cost of screening, but pooling positive specimens with negative ones lowers assay sensitivity, so that the sensitivity of a pooled test depends on how many of its members are positive. Regression models for group testing accommodate this dilution effect through submodels that fix a one-parameter shape for that dependence. We propose BADGER (
Bayesian Analysis of Dilution in Group tEsting Regression), a regression model incorporating a shape-free dilution curve. The pooled sensitivity is modeled as a nondecreasing function represented by nonnegative increments with a Dirichlet prior, so that the parametric submodels become special cases. By an appropriate augmentation, every full conditional of BADGER is in closed form and inference is carried out by an exact Gibbs sampler. The evidence for dilution is measured by a Bayes factor computed from the posterior draws. We validate the BADGER model through simulation studies across different dilution shapes, prevalences and pool sizes. We further illustrate the method on hepatitis E serology from a national health survey.
Read the full abstract ▾
Statistics Theory
Nonparametric Inference for Cumulative Residual Mathai–Haubold Entropy of order $\alpha$
Anija C.R, Smitha, S. et al. (+2 more)
In this paper, we study the properties of cumulative residual Mathai–Haubold
entropy of order $\alpha$. A dynamic version of this
entropy measure is then proposed, and its properties are examined within the framework of reliability modeling. We show that the dynamic cumulative residual Mathai–Haubold
entropy of order $\alpha$ uniquely determines the survival function. Characterization results for the exponential and generalized Pareto distributions are derived using the proposed measure. Furthermore, we develop nonparametric
estimators for the cumulative residual Mathai–Haubold
entropy and its dynamic counterpart of order $\alpha$, based on the kernel estimation of the survival function. The performance of these
estimators is evaluated through a Monte Carlo simulation study. Finally, the practical relevance of the proposed dynamic
estimator is illustrated using two real data; failure-time data from aircraft windshields and failure-time data from 40 randomly selected mechanical switches.
Read the full abstract ▾
All authors Anija C.R, Smitha, S., Sudheesh, K. Kattumannil
Statistics Theory
A note on a local entropy condition in the Wasserstein space
Chang Jun Im, Jeong Min Jeon and Byeong U. Park
Entropy conditions are widely used in empirical-process analyses to establish asymptotic properties of M-
estimators. In regression problems with responses taking values in a general metric space, a commonly imposed condition requires the
entropy integral associated with a shrinking ball centered at the target object to remain uniformly bounded as the ball radius tends to zero. We show that this condition generally fails in the quadratic Wasserstein space of univariate probability distributions supported on a compact interval. Specifically, when the target object is a strictly increasing and absolutely continuous distribution function whose derivative is bounded away from zero and infinity, the corresponding
entropy integral diverges as the ball radius tends to zero. The same divergence persists even when the ambient space is restricted to the class of distribution functions satisfying fixed uniform two-sided Lipschitz bounds. These results indicate that different asymptotic analyses are required for the quadratic Wasserstein space.
Read the full abstract ▾
Statistics Applications · Cross-listed from physics.ao-ph
GCMagicc v1: a fast generative emulator for multivariate climate-impact ensembles
Nicolai Meinshausen, Malte Meinshausen, Jared Lewis et al. (+6 more)
Projecting the impacts of
climate change requires large ensembles of
climate variables that match historical observations, align with the warming ranges assessed by the IPCC, and can efficiently run new future emissions scenarios, including the newest generation of
climate model scenarios (CMIP7) and pathways consistent with countries' Paris Agreement pledges. Generating such ensembles at the scale needed for impact studies is normally computationally prohibitive. We close this gap with GCMagicc, a hybrid model that pairs a simple physical
climate model with machine learning to generate ensembles of 10
climate variables at the resolution of full-scale Earth system models, without relying on GPU resources or retraining for new scenarios. Trained on 32 CMIP6 Earth system models and observational/reanalysis data, GCMagicc complements rather than replaces Earth system models. We apply it to a range of future pathways: the canonical SSP scenarios of the latest IPCC report (1.2-6.1{\deg}C warming, min-max across scenarios of 5-95 percentile ranges), current policies (2.3-4.0{\deg}C), national pledges under the Paris Agreement (1.5-3.3{\deg}C) and the CMIP7 range from the 'VL' to 'H' scenarios (1.2-4.2{\deg}C), releasing a large public
dataset. As an illustration, we perform an attribution analysis of the severe 2025 Iranian drought using GCMagicc ensembles, with three CMIP6 large ensembles for comparison, with and without anthropogenic forcings. The results suggest a strong anthropogenic signal: a median probability of drought at least as severe as observed of 29% with anthropogenic forcing, and zero under natural-forcing-only simulations. In the future, drought conditions are projected to materially worsen, amplifying the potential for agricultural and food security impacts and geopolitical conflicts that use water scarcity as a weapon. GCMagicc data is available at https://gcmagicc.org.
Read the full abstract ▾
All authors Nicolai Meinshausen, Malte Meinshausen, Jared Lewis, Zebedee Nicholls, Sarah Schöngart, Alister Self, Xinwei Shen, Karla Spiller, Elisabeth Vogel
Statistical Methodology · Cross-listed from cs.LG
Geographically Regularized AUC-Maximizing Personalized Federated Learning
Mayu Hiraishi, Kensuke Tanioka and Toshio Shimokawa
Accurate diagnostic and risk-prediction models are important for supporting clinical decision-making during infectious disease outbreaks. However,
privacy and governance requirements may restrict patient-level data sharing across healthcare institutions, and data distributions often vary. Moreover, AUC is widely used to evaluate discriminative performance, motivating its direct optimization in model development. We propose geographically regularized AUC-maximizing personalized
federated learning (GrAUC-PFL), which directly optimizes a smooth pairwise AUC surrogate to learn personalized models while keeping patient-level data local and accounting for institutional heterogeneity. Graph-based regularization encourages geographically neighboring institutions to have similar coefficient vectors while retaining a personalized models. Simulations and a real-data application suggest improved discriminative performance, particularly when geographically neighboring institutions have similar data-generating characteristics.
Read the full abstract ▾
Statistical Methodology · Cross-listed from econ.EM
Designing Spatial Treatments
Stefan Faridani and Michael P. Leung
Spatial treatments are interventions assigned to locations potentially distinct from those of the responding units. We study their optimal design under a general model in which a unit's response diminishes with distance to a treated site. Our estimand of interest is an “uncontaminated” effect equal to the average impact of a single intervention site over all hypothetical sites. We propose a novel design based on a Matérn point process which separates treatments by a distance of at least $r$. A larger choice of $r$ reduces bias by separating interventions but increases variance by reducing their numerosity. We choose $r$ to maximize the rate of convergence of a Horvitz-Thompson
estimator and prove that this is minimax rate-optimal. We provide weak conditions under which the
estimator is asymptotically normal and propose a variance
estimator.
Read the full abstract ▾
Statistics Theory · Cross-listed from math.PR
Radial Marchenko-Pastur laws: projection characterizations and rigidity
Xiaohui Xie
Let \(R_p=\|x_p\|^2/p\Rightarrow \nu\) and \(p/N\to c\in(0,\infty)\). We prove that the radial quadratic-form condition (RQC), requiring energy in deterministic subspaces to follow the parent radius, is equivalent to the following spectral property: for one fixed \(\alpha\in(0,1)\), every deterministic rank-\(\lfloor \alpha p\rfloor\) projected covariance has empirical spectral distribution converging to \(\mu_{c\alpha,\nu}\). The radius law \(\nu\) may have arbitrary tails; no moment assumptions, conditional isotropy, or independence between radius and direction are required. We also show that the radius law can be recovered from the projected spectral limits when their common limit has finite second moment and subspaces of vanishing relative dimension carry vanishing normalized energy, again without moment assumptions on the original vectors. A finite-sample inverse estimate bounds quadratic-form defects by bounded tests of expected projected spectra. The converse argument combines angular symmetrization and fantope rigidity with a determinant comparison between radial column deletion and spectral trimming. A cancellation of the deleted radial factors makes the comparison error depend only on the deleted fraction, rather than on the magnitudes of the deleted radii.
Read the full abstract ▾
Machine Learning (Statistics)
Distribution-free inference on the number of changepoints
Rohan Hore and Aaditya Ramdas
Suppose we are given an ordered sequence of independent data whose distribution changes $K$ times at unknown locations, for some unknown $K \geq 0$. In this paper, we study the problem of performing distribution-free inference on $K$. First, we show an impossibility result: any distribution-free upper confidence bound on $K$ must be trivial and uninformative. Then, using conformal $p$-values, and under only the assumption that the data segments induced by the changepoints are exchangeable (within themselves) and mutually independent, we construct a finite-sample valid lower confidence bound on $K$, which we call the Conformal LOwer bound on Changepoint Count (CLOCC). We show that CLOCC is the only feasible way to provide a lower bound on $K$ under the stated assumptions, a property we refer to as its universality. We provide practical guidelines for choosing score functions that yield efficient and tight lower bounds. We evaluate CLOCC in several synthetic and real-data experiments, where it provides informative lower bounds on $K$, demonstrating its practical applicability.
Read the full abstract ▾
Statistical Methodology
Multi-Objective Composite Longitudinal Biomarker Scores for Improved Cancer Risk Assessment
Bitan Sarkar, Ana Maria Kenney, James P. Long et al. (+4 more)
Repeated blood-based biomarker measurements can improve cancer risk assessment by capturing longitudinal changes missed by single-time-point analyses. Parametric Empirical Bayes (PEB) incorporates prior measurements to estimate individualized reference values, but existing implementations do not account for the time between measurements and rely on predefined panels with fixed combination rules. We developed improved Parametric Empirical Bayes (iPEB), which accounts for the intervals between serial measurements, adjusts for
covariates, and performs feature selection and optimized biomarker combination. iPEB optimizes biomarker weights for specific clinical objectives, such as maximizing sensitivity at a prespecified specificity or diagnostic lead time. We evaluated iPEB through simulations and a real-world application using six
protein biomarkers (pro-SFTPB, CEA, CA125, CYFRA 21-1, osteopontin, and HE4) from a case-control study nested within the Prostate, Lung, Colorectal, and Ovarian (PLCO) Cancer Screening Trial. The analysis included 324 lung cancer cases and 1,674 controls with at least two serial measurements; six centers were used for model development and four for independent validation. Optimized for sensitivity at 99% specificity, iPEB achieved 24.2% sensitivity in the independent test set, compared with 18.2% for conventional PEB applied to the same four-marker panel. Optimized instead for lead time, iPEB added approximately 50 days of lead time at that stringent operating point. iPEB improved lung cancer risk assessment in independent PLCO data, supporting objective-driven optimization of longitudinal biomarkers for early detection.
Read the full abstract ▾
All authors Bitan Sarkar, Ana Maria Kenney, James P. Long, Johannes F. Fahrmann, Samir Hanash, Kim-Anh Do, Ehsan Irajizad
Machine Learning (Statistics) · Cross-listed from cond-mat.stat-mech
Speed Limit for Information Acquisition in Stochastic Learning Dynamics
Shuta Kobayashi and Andreas Dechant
Neural networks acquire internal representations through learning. In this work, we formulate
stochastic gradient descent (SGD) as a Markovian
stochastic process and derive a Fisher-information flow speed limit that bounds the rate at which trainable parameters can acquire information about latent variables in the data-generating process. The resulting inequality decomposes the information flow into drift and noise contributions, thereby quantifying the roles of deterministic learning forces and SGD-induced fluctuations from an information-theoretic perspective. We verify the bound in analytically tractable basis-function linear regression, where the information budget predicted by the bound reproduces the ordering and characteristic time scales with which different latent variables are encoded in the learned parameters. These results establish Fisher-information speed limits as a quantitative framework for diagnosing when and how different aspects of the data-generating mechanism are acquired during
stochastic learning.
Read the full abstract ▾
Statistical Methodology
Multicollinearity-agnostic feature screening for non-Euclidean responses: a factor adjusted approach
Moshu Xu, Leheng Cai, Yanmei Shi et al. (+2 more)
In high-dimensional settings, multicollinearity is a pervasive issue that can substantially impair the performance of feature screening methods based on marginal Fréchet regression. Feature screening for non-Euclidean responses becomes unreliable when ultrahigh-dimensional predictors suffer from multicollinearity, because feature-specific signals may be masked by shared latent factors. To mitigate this effect, we propose a Factor adjusted Fréchet sure independence screening procedure. The method first recovers latent common factors from the predictors and then evaluates each feature by the incremental Fréchet coefficient of determination contributed by its idiosyncratic component beyond the common factors. Under regularity conditions, we establish uniform approximation rates for the feasible screening utilities and prove the sure screening and sure ranking properties. Extensive numerical experiments provide compelling empirical support for the validity and effectiveness of our approach, particularly in scenarios with highly correlated
covariates. We further illustrate the practical performance of our method through two representative non-Euclidean
datasets: the ADNI
dataset and the mortality
dataset, both with distribution-valued responses.
Read the full abstract ▾
All authors Moshu Xu, Leheng Cai, Yanmei Shi, Xu Guo, Qirui Hu
Statistical Computation
Optimal Slice-Adaptive Tuning of Hybrid Slice Sampling
Trevor Campbell
Slice sampling is a Markov chain Monte Carlo
algorithm that draws its next state uniformly from a "slice"—a super-level set of the target density function—at each iteration, thereby providing automatic local adaptivity to the scale of the target. In practice the exact slice is not known, so general-purpose implementations use an approximate slice that is grown from a starting interval of length $w>0$, with a computational cost that depends on $w$. This work presents an analysis of the average per-iteration number of target density evaluations, as a function of $w$, of hybrid slice sampling with various slice-finding schemes for targets with contiguous slices. The paper uses the results of the analysis to develop automated, slice-adaptive tuning schemes along with suboptimality bounds and asymptotic convergence guarantees. Simulations demonstrate that the tuning schemes reliably yield near-optimal slice-adaptive tuning with essentially no dependence on the initial setting of $w$.
Read the full abstract ▾
Machine Learning (Statistics) · Cross-listed from cs.LG
GPU-Enabled Large-Scale Optimization Using Randomized Linear Algebra
Pratik Rathore, Zachary Frangella, Parth Nobel et al. (+2 more)
This paper introduces rlaopt, a PyTorch-based package for large-scale optimization and scientific computing using randomized numerical linear
algebra (RandNLA). Despite substantial progress in RandNLA-based
algorithms, few implementations combine GPU acceleration with a simple interface for specifying optimization problems. rlaopt addresses this gap by providing GPU-enabled solvers for positive-definite linear systems and convex empirical risk minimization with constraints and regularizers. These solvers use RandNLA to accelerate conjugate gradient (NystromPCG), operator splitting (NysADMM), and
stochastic gradient methods (SAPPHIRE). Moreover, rlaopt includes a modeling
language that lets users specify problems using natural mathematical syntax. rlaopt automatically checks compatibility with the selected solver and performs the required problem decomposition. The solvers also support differentiation through their iterations, enabling applications such as hyperparameter tuning. Experiments on ridge regression, bounded multinomial logistic regression, and bounded elastic net identify when randomized preconditioning improves performance and demonstrate substantial speedups from GPU execution. The package is open-source under an Apache license, with source code at https://github.com/udellgroup/rlaopt and version 0.1.0 available on PyPI.
Read the full abstract ▾
All authors Pratik Rathore, Zachary Frangella, Parth Nobel, Xuning Hu, Madeleine Udell
Statistical Methodology
Nonparametric heterogeneous causal mediation with orthogonal machine learning
Jiaqi Tong, Yi Zhao, Bhramar Mukherjee et al. (+1 more)
Causal mediation analysis decomposes the total effect of an intervention on an outcome into a direct pathway and an indirect pathway transmitted through a mediator, but standard methods typically summarize these pathways using population average effects. In many applications, however, the indirect effect may vary substantially across individual profiles. We propose an orthogonal statistical learning framework for estimating heterogeneous causal mediation effects conditional on individual characteristics. The method constructs a class of weighted Neyman orthogonal losses motivated by influence function representations of weighted population average effects. These losses directly target conditional mediation estimands whose minimizers are locally insensitive to nuisance estimation errors. We implement the resulting learners under a two-stage meta-learning framework with regularized linear sieves as second-stage smoothers, and introduce a combination of targeted learning and orthogonal learning designed to improve stability when mediator density ratios are unstable. We establish $L^2$ and uniform limit theory and develop pointwise and uniform confidence bands. Simulation studies show that the proposed orthogonal learners reduce the mean integrated squared error by more than $50\%$ compared with existing model-based methods and provide computationally efficient inference in nonlinear settings. The CARDIA, PSACR, and
STAR analyses reveal heterogeneous mediated effects across cardiometabolic, psychological, and educational settings.
Read the full abstract ▾
All authors Jiaqi Tong, Yi Zhao, Bhramar Mukherjee, Fan Li