Peer Revenue Impact factor: volatile

Papers

Fresh from arXiv, typeset properly. Highlighted words trade on the market.

Statistics

stat Watch Statistics (sign in to use)

Thursday 27 August

Other Statistics

Algorithms for optimizing model-based incomplete block designs

Because of time limitations or participation burden, the treatments in an experimental design can be too large for a single subject. Instead of addressing this using combinatorial incomplete block designs, we propose a model-based approach that optimizes model parameters. This offers distinct advantages: it incorporates subject-specific covariates to tailor treatment allocation to individual characteristics, allows for varying block sizes, and eliminates the equal-treatment replication requirement. Despite these benefits, model-based approaches are limited by a lack of software and prohibitively large search spaces, making exact optimization computationally intractable. Therefore, we present local search heuristic algorithms and compare them to existing methods. We evaluate first- and best-improvement algorithms, simulated annealing (SA), threshold accepting (TA), and two novel algorithms utilizing directional derivatives (dd) to guide exchanges. Serving as discrete versions of continuous gradient-based methods, these dd algorithms take smaller steps and avoid flat regions by prioritizing large-difference dd exchanges. Our broadly applicable approach uses item calibration in achievement tests as a comparative example to evaluate objective values and computational times. Results demonstrate that for larger problems, the dd algorithms achieve near-optimal solutions significantly faster than SA and TA. Due to computational efficiency, our algorithms offer a highly appealing approach for practical applications.
Read the full abstract

Statistics Theory

How far can symmetry help? Phase transitions and symmetry selection in sparse functional data analysis

In sparse functional data analysis, where $n$ curves are each observed at $m$ random points, the covariance surface undergoes a sharp phase transition: if the covariance has smoothness $\beta$, the risk drops from the two-dimensional nonparametric rate to the parametric rate $n^{-1}$ once $m$ exceeds $m^*_n \asymp n^{1/(2\beta)}$. We determine what a symmetry of the domain does to that transition. A cyclic group of order $q$ preserving process and design displaces the threshold to $n^{1/(2\beta)}q^{-1/2}$; the exponent is a square root because symmetry acts on the number of usable pairs, which enters the variance quadratically, while the parametric floor is untouched by group averaging. The displacement saturates: once the orbit is finer than the bandwidth the reduction factor is $\min(q,c_K/h)$, by Poisson summation and positive definiteness of the kernel autocorrelation, and beyond that point the rate collapses to the one-dimensional nonparametric rate. Hence no rotation symmetry, even the full circle group, lowers the threshold below $n^{1/(4\beta)}$; this floor is attained from above by our estimator and from below, up to a polynomial factor, by our lower bounds. Symmetry thus takes one halfway on a logarithmic scale from the classical threshold to constant sampling. The uniform lower bound rests on a positivity-preserving packing of the stationary sub-class; closing the gap is left open. If the symmetry is only approximate, the risk acquires an approximation term and the design plane splits into three regimes, one unreachable by additional sampling; the symmetry spectrum governing it is explicit in Fourier coordinates, and a hold-out procedure selects the symmetry level with leading constant one below saturation and within an absolute constant beyond. All laws above are confirmed numerically. Reparametrisation of the domain, by contrast, leaves the threshold unchanged.
Read the full abstract

Machine Learning (Statistics)

Representation Measurements Under Function-Preserving Reparameterizations

Hidden coordinates are not uniquely determined by a language model's input–output function, so representation-derived measurements should be invariant to function-preserving changes of basis. This study shows that column-permutation parallel analysis violates function-preserving reparameterization invariance because its reference distribution and selected component count can change while the model function and observed covariance spectrum remain fixed. More generally, a data-internal reference procedure cannot simultaneously preserve every coordinate marginal, remain orthogonally equivariant, and remove cross-coordinate covariance. Empirically, across five models, three retrieval domains, and 75 transformations, median component-count disagreement is 0.79 and median fixed-threshold decision disagreement is 0.26. A centering-only control isolates the reference-driven effect, with 1,141 of 1,200 component counts changing despite an unchanged observed spectrum, whereas independent parallel analysis seeds change none of the corresponding decisions. By contrast, orthogonally invariant comparator scores remain numerically stable with similar held-out discrimination. Together, these results show that parallel analysis-derived component counts and decisions can reflect hidden-coordinate choice rather than a well-defined property of the model.
Read the full abstract

Machine Learning (Statistics)

Why not to use the Gaussian kernel

Kernels measure similarity or correlation in tasks such as regression and classification. The Gaussian kernel, other names of which include squared exponential and radial basis function kernel, is one of the most popular in Gaussian process regression. We argue that the Gaussian kernel is best avoided and should never be used as a default. The argument rests on two results demonstrating that the Gaussian kernel is extremely brittle. First, the Gaussian kernel gives rise to a conditional variance that is unrealistically small. If the variance is used to quantify predictive uncertainty, catastrophic overconfidence is almost inevitable. Second, a small variance goes hand in hand with numerical ill-conditioning, so that to use the Gaussian kernel in practice requires tricks such as nugget terms that effectively modify the underlying regression or classification model. These problems are caused by the unnatural smoothness of the Gaussian kernel, a fact we are far from the first to take notice of. The problem is not the Gaussian form itself but the analyticity of the kernel: Our argument is more broadly that analytic kernels are best avoided. For stationary kernels analyticity is essentially equivalent to an exponential decay of the spectral density.
Read the full abstract

Machine Learning (Statistics) · Cross-listed from cs.LG

Alignment Matters Inside and Out in Equivariant Graph Flow Matching

Graphs are invariant under node permutations, motivating permutation-equivariant architectures in generative models. In flow matching, however, symmetry also affects the source-target coupling: one must choose both which graphs to pair and which node representatives to align. We study these two forms of alignment, termed outer and inner alignment, and their effect on equivariant graph flow matching. We connect inner alignment to transport on the graph quotient space, whose Euclidean quotient metric coincides with Gromov-Monge distance, and show that quotient couplings admit aligned representative lifts while symmetrization yields equivariant flow-matching minimizers, including for categorical endpoints. In practice, we compare random augmentation, permutation-blind minibatch optimal transport, approximate Gromov-Wasserstein alignment, and combinations of inner and outer alignment. Across continuous graph and molecular generation, alignment can substantially simplify trajectories and improve few-step generation, while its benefits depend on the alignment and computational budget. Our results highlight that effective graph flow matching benefits from alignment both inside and across graph pairs.
Read the full abstract

Statistical Methodology

A Bayesian Longitudinal Model for Imputing Item-Level Missing Data in Trial-Based Economic Evaluations

Trial-based economic evaluations are widely used to assess the cost-effectiveness of healthcare interventions and inform decision-making. Cost and effectiveness outcomes are typically collected using multi-item questionnaires administered at multiple time points, and are often subject to item-level missingness. In principle, imputation (i.e., replacing missing value with estimated or substituted values) should be performed at the item level to fully exploit available information. However, this is rarely implemented in practice due to several statistical challenges, including the longitudinal data structure, cross-item dependence, heterogeneous missingness patterns, and the mixture of skewed cost and count data. In this paper, we develop a Bayesian longitudinal model for imputing item-level missing data in trial-based economic evaluations that accommodates these complexities within a unified framework. The approach combines a transition-model formulation for longitudinal dependence with flexible distributional assumptions and explicit modelling of cross-item relationships, allowing item-level responses of different types to be coherently modelled over time. Motivated by a real-world trial, we demonstrate the flexibility and practical applicability of the proposed approach. We further discuss how the model can be extended to settings where data may be missing not at random.
Read the full abstract

Statistics Applications

Climate Physics Dynamic Matching

Deep generative models such as flow matching and diffusion models have shown potential for learning complex dynamical systems, but typically act as black boxes that neglect underlying physical structure, while physics-based models governed by partial differential equations are often incomplete due to missing source terms, or uncertain parametrisations. We present Climate Physics Dynamic Matching (ClimPhyDM), a variational simulation-free dynamics informed framework for weather forecasting that combines an advection-type physics prior with data-driven components in a variational framework. % to capture the stochasticity and multi-modality of unresolved atmospheric dynamics. On the ERA5 benchmark at hourly (42-hour) and monthly (5-month) resolutions, ClimPhyDM outperforms ClimODE, and GB-DM, keeping the lower error at extended horizon, indicating improved temporal stability and resistance to error accumulation, while its simulation-free paradigm also enables training on a single modest 12 GB consumer GPU.
Read the full abstract

Machine Learning (Statistics) · Cross-listed from cs.LG

Contact Geometry and Covariance Deficits in Volume-Sampled Least Squares

We classify when ordinary fixed-size volume sampling followed by unweighted least squares attains its sharp coefficient-covariance ceiling on a fixed design. For a real whitened design without coloops and a fixed positive-loss residual, the contact space is unchanged at every strict-interior sample size. Its possible nonzero values form a finite orthogonal family: each maximal parallel class of normalized Naimark-complement rows determines a deletion nullspace of dimension one less than the class size. A single residual attains an entire query precisely when the query range lies in one class space. The proof starts from two-sided Loewner comparison of every normalized covariance deficit with an explicit leave-one-out operator, using supported omission moments and reverse deletion. Residual augmentation provides resolvent and second-moment upper bounds, while complement geometry yields query-specific margins, angular concentration, local alignment, and a multi-output energy obstruction. Exact families give closed-form margins and covariances, exhibit support-boundary jumps, and approach the ceiling despite a uniformly positive geometric margin. Finally, the same moment identities give upper and lower bounds on expected fixed-query squared-loss excess. The subset draw is the only randomness; all support and endpoint restrictions are explicit.
Read the full abstract

2608.26877 · 27 Aug · 55 pages. Revised title and substantially reorganized theoretical exposition. Includes contact-space and whole-query classification, all-size leave-one-out covariance-deficit comparisons, quantitative contact geometry, and query-risk bounds, with proofs, exact constructions, and ancillary exact-arithmetic checks

Statistical Methodology

Expected Shortfall Model Averaging

Expected shortfall (ES) is widely used to measure tail risk in finance and economics, but its prediction is challenging due to non-elicitability and model uncertainty. This paper proposes a two-stage cross-validation model averaging method for ES forecasting. In the first stage, conditional value-at-risk is estimated using quantile model averaging. In the second stage, a transformed response is constructed and mean squared error-based model averaging is applied to estimate ES. We establish theoretical properties of the proposed method under both correct specification and model misspecification, showing consistency of the estimators and asymptotic optimality of the forecasting risk. Simulation studies and empirical applications to U.S. stock return and macroeconomic GDP growth data show that the proposed approach provides accurate and stable ES forecasts and is computationally efficient.
Read the full abstract

Machine Learning (Statistics)

Incremental Recommendation via Causal Models

Recommendation impressions are a finite resource, hence delivering a recommendation to a user who would discover the content organically yields no incremental value and displaces other recommendations that could. We address this by extending an existing production recommendation model to a causal architecture using holdback data that is already collected as part of routine experimentation infrastructure, requiring no new data collection. A central challenge is that attribution windows differ between treated and holdback observations: treated users are attributed a stream within a short direct-response window, while holdback users are attributed organic streams over a multi-day window. This mismatch makes naive treatment-effect subtraction invalid. We resolve this with a dual-threshold targeting policy that delivers a recommendation only when the probability of a treated stream is high and the probability of organic stream is low. In a production-scale A/B test on millions of Spotify users, this policy reduces recommendation impressions by 7% with no statistically significant reduction in overall recommended content consumption. We further show that joint training with holdback data improves calibration of the treated head relative to the production baseline, and argue this can be taken as evidence that causal models learn more generalisable representations than models trained on observational data alone.
Read the full abstract

All authors Athanasios Vlontzos, David Gustafsson, Michael O'Riordan, Ciarán M. Gilligan-Lee

Statistics Applications

Integrating Network Psychometrics and LLMs: The Ising-Embeddings-Model applied to Reliability Auditing

Scoring consistency for constructed-response items in large-scale assessments is typically estimated through double-scoring, which uses small samples and assumes independence among responses. We present an integrated framework combining network psychometrics with the Linguistic-Integrated Reliability Audit (LiRA) via a modified Ising model. The model defines a joint distribution over binary correctness labels with pairwise interactions set to the cosine similarity of sentence embeddings and a global bias parameter for item difficulty. LiRA's weighted majority voting over semantic neighborhoods is shown to approximate the conditional logistic distributions of this Ising model. The parametric framework supports benchmark score generation, uncertainty quantification, and missing label imputation; parameters are estimated by maximum pseudo-likelihood. The approach uses the full dataset without requiring extensive double-scoring, accounts for semantic dependencies, and provides diagnostics for rater inconsistencies. The integration of LiRA's scalable methodology with a probabilistic graphical model offers a comprehensive tool for reliability assessment in international assessments such as PIRLS, PISA, and TIMSS.
Read the full abstract

Statistics Theory · Cross-listed from cs.LG

Beyond Client Averaging: A Client-Independent Second-Order Stationary-Bias Component in Stochastic SCAFFOLD

Existing constant-step analysis of stochastic \Scaf{} identifies a leading $O(\gamma/N)$ stationary mean bias and shows that higher-order bias can persist as the client count increases, but does not identify the first client-independent contribution at coefficient level. For full-participation stochastic \Scaf{} with one-dimensional homogeneous clients, fixed local-step count $H$, and bounded additive gradient noise, we prove, uniformly over $N\ge2$, $$ \begin{aligned} \mathbb{E}_{\pi_{\gamma,N,H}}[x]-x^\star ={}& -\frac{f'''(x^\star)\sigma^2}{4f''(x^\star)^2}\frac{\gamma}{N}\\ &- \frac{f'''(x^\star)\sigma^2}{12f''(x^\star)} \frac{(H-1)(5H-1)}{H}\gamma^2 +O_H\!\left(\frac{\gamma^2}{N}+\gamma^3\right). \end{aligned} $$ Hence client averaging suppresses the leading $O(\gamma/N)$ bias but does not remove the client-independent $O(\gamma^2)$ component when its coefficient is nonzero. The mechanism is indirect: although the direct control contribution cancels pathwise in the linear global average, the controls still alter within-round local trajectories and their second moments. Fresh gradient noise and persistent control fluctuations therefore generate local second-moment corrections that nonquadratic curvature converts into stationary mean bias. The coefficient vanishes for quadratic objectives. Numerical experiments are consistent with the predicted coefficient, its persistence as client count increases, and the stated joint remainder. The result is restricted to the one-dimensional homogeneous fixed-$H$ setting.
Read the full abstract

Statistical Methodology

Uncertainty quantification for expectation-calibrated predictions

The existing literature on model calibration focuses mainly on classification and probabilistic prediction. In this work, we address calibrated point predictions for the conditional mean. Although existing impossibility results preclude exact out-of-sample calibrated predictions, we develop calibrated confidence intervals that provide uncertainty quantification around such predictions. Our results come with distribution-free theoretical guarantees and are applicable in model-agnostic, finite-sample settings under exchangeability by leveraging conformal prediction. Calibrated confidence intervals rely on a general underlying binning scheme. We present two examples of such a binning scheme, one based on a data-independent partition and the other on isotonic regression. Under structural assumptions, we prove that calibrated confidence intervals based on isotonic regression come with strong asymptotic consistency properties and have an asymptotically vanishing width. We illustrate the empirical performance of our methods by applying them first in a simulated setting and then to a highly imbalanced insurance dataset.
Read the full abstract

Machine Learning (Statistics) · Cross-listed from cs.CL

Which Metrics Save the Most Human Annotation? Prediction-Powered Evaluation and Meta-Evaluation

Across various non-verifiable tasks, human evaluation is reliable but expensive, while automatic metrics are more scalable but often biased. Building on prediction-powered inference (PPI), we propose prediction-powered evaluation, a framework that combines limited human judgments with large-scale automatic scores to obtain data-efficient system comparisons that are provably unbiased. We develop parametric and non-parametric procedures, analyze the efficiency trade-off between paired and unpaired designs, and validate the framework on six WMT datasets. We further introduce the Prediction-Powered Saving Ratio (PPSR), a meta-metric that measures how much human annotation an automatic metric can save when used within prediction-powered evaluation. PPSR directly targets metric utility for prediction-powered evaluation and yields more discriminative and stable metric rankings than existing system-level meta-metrics. Overall, our new paradigm reframes automatic metrics as tools for reducing human annotation cost rather than replacing human judgment, and applies broadly to non-verifiable tasks.
Read the full abstract

Machine Learning (Statistics)

A Unified Descriptive-Complexity Framework for Model Selection under Correlated Designs

Model selection becomes particularly challenging under strong predictor dependence and model-class uncertainty, especially when there are exponentially many models. We propose a Descriptive-Complexity Information Criterion (DCIC) that regularizes large candidate model collections through Kraft-admissible code lengths. Under sub-Weibull noise, we establish selection consistency through approximation-error separation without relying on RIP-type conditions, together with nonasymptotic oracle risk bounds that remain valid under model misspecification. The same coding principle places heterogeneous classes on a common complexity scale at a small additional class-identification cost. This extension yields class–model recovery under suitable identifiability conditions and risk adaptation across classes. We further develop a complexity-guided search path that makes the computation–statistics trade-off explicit. Large penalties yield polynomial-size retained search regions with high probability, whereas smaller penalties sharpen the oracle risk benchmark. Numerical experiments illustrate stable support recovery and favorable estimation performance under strong dependence and model-class uncertainty.
Read the full abstract

Statistical Methodology

On efficiency gains via augmenting a tiny sample with a massive auxiliary sample

In this paper, we study the problem of augmenting a tiny target sample with a massive auxiliary sample. Utilizing Tukey's factorization, there are two popular approaches: the inverse probability weight (IPW) and the full-likelihood (FL) methods. We show that the IPW approach suffers from the limited target sample problem while the FL method may estimate some model parameters at the rate of the massive auxiliary sample size, a phenomenon we call full efficiency gain. We study the theory behind the full efficiency gain for exponential families and mixtures of exponential families. We also study the efficiency gain for the IPW method under a nonparametric procedure and show how it can achieve a parametric rate of the target sample size. As a side note, we also discuss how one may use FL to train neural network models simultaneously for both the target distribution and the odds model.
Read the full abstract

Statistical Methodology

Analyzing Within-Subject Experiments: Identification, Testing, and Sensitivity

Recent work encourages political scientists to move from post-only toward within-subject designs for improved precision from repeated measurements. We formalize a potential-outcomes framework for two-period within-subject designs that allows for unequal allocation and heterogeneous treatment and carryover effects. We characterize the pooled estimator and evaluate the carryover test used to justify pooling. We find: first, pooling identifies the average treatment effect only when the gap in the average carryover effects is zero across the two treatment sequences. The unit-clustered standard error for the pooled estimator is identical to its design-based counterpart. Second, under mild conditions, the carryover test has strictly less power than the average-treatment-effect test with post-only data. The resulting two-step procedure, which pools only after a nonrejected test, produces confidence intervals that typically undercover. When the gap is zero, undercoverage occurs if and only if pooling is more efficient than post-only analysis, precisely when the within-subject design is worthwhile. When the gap is nonzero, undercoverage is typical unless the gap or sample size is large. Third, we derive a sensitivity analysis and find published conclusions robust to plausible carryover gaps. We therefore endorse within-subject designs but recommend justifying a zero carryover gap substantively and reporting sensitivity to departures.
Read the full abstract

Machine Learning (Statistics) · Cross-listed from cs.LG

VGAS: Variance-Reduced Guidance and Adaptive Selection for Training-Free Reward Alignment in Discrete Diffusion

Masked discrete diffusion models perform strongly on text, code, and biological sequences, but their training objective rewards only naturalness, and retraining the generator for every new reward is expensive. Inference-time steering of a frozen model either guides the sampler by the reward gradient or searches over several trajectories, and recent samplers combine the two. Such combinations are assembled as pipelines that leave three choices at their defaults: a guidance estimate resting on one Gumbel draw per sample, a reward tilting placed without reference to the distribution the combination then targets, and a selection temperature held fixed although the spread of per-step rewards drifts. We identify that distribution and settle the three choices against it. We therefore propose Variance-reduced Guidance and Adaptive Selection (VGAS), a simple yet effective inference-time framework that reduces the variance of the guidance estimate for both reward types, applies the reward tilting in the clean-token logits, where the pretrained schedule is preserved, and sets the selection temperature per step. Across regulatory DNA, protein and small-molecule benchmarks, VGAS attains the best training-free reward and matches or surpasses a reward-fine-tuned generator.
Read the full abstract

Statistical Methodology

A Unified Adaptive Enrichment Design for Power Enhancement

Randomized controlled trials (RCTs) are the gold standard for evaluating treatment effects, but fixed eligibility criteria and enrollment decisions can be inefficient, especially when treatment effects vary across patient subpopulations. Adaptive enrichment trials update enrollment using interim data to improve efficiency. Enrichment methods are developed for two settings: prespecified subgroups, and continuous covariates where enrollment is guided by a learned cutoff. Many enrichment designs adopt discontinuous rules that favor one single subgroup, which may induce "winner's curse" bias if final estimation does not account for the data-dependent enrollment decision and require additional bias correction. We propose a unified framework that bridges these settings by formulating enrichment as a regularized optimization over the enrolled covariate distribution. In a two-stage design, Stage 2 selects an enrollment mixture by maximizing a power objective while penalizing deviation from a prespecified baseline target population through a Kullback-Leibler divergence term, providing a smooth alternative to pick-the-winner rules; the same formulation extends naturally to optimizing enrollment over continuous covariates. The resulting estimand is the average treatment effect in the trial population induced by the data-adaptive enrollment rule, so uncertainty quantification must account for randomness in learning the optimal enrollment rule, in addition to outcome estimation. We derive an influence-function representation for the estimated optimal enrollment rule and account for it in the final estimator, yielding an explicit asymptotic variance decomposition into decision uncertainty and outcome-estimation uncertainty. Simulations demonstrate improved power relative to conventional enrichment approaches while substantially reducing winner's curse bias in treatment effect estimation.
Read the full abstract

All authors Junzhe Shao, Aibo Gong, Juan Shen, Waverly Wei

Statistical Methodology

Tight differencing in spectral density estimation with centrosymmetric kernels

Mean-robust estimation of spectral density and long-run variance is crucial for many statistical inference procedures. However, existing methods often degrade when serially dependent data exhibit volatile, time-varying trends, or sudden jumps, particularly in small samples. While differencing and kernel averaging are standard tools for achieving mean robustness and consistency, they are not inherently compatible. Combining them can compromise optimality. Specifically, tight differencing, an operation of taking small-lag differences to enhance local de-trending, introduces strong correlations that distort the high-order properties of kernel-averaged estimators. To resolve this incompatibility, we introduce a novel class of centrosymmetric kernels explicitly designed to integrate with tight differencing. We demonstrate that the optimal tight difference sequence for serially dependent data differs from classical sequences designed for independent data. Notably, these proposed optimal sequences are data-independent and can be applied directly without pre-fitting. Finally, the proposed estimators are demonstrated to be useful across various statistical inference tasks, including tests for stationarity and white noise.
Read the full abstract

Machine Learning (Statistics) · Cross-listed from cs.DS

Hadamard Flattening and Gaussian Pooling Sketch for Least Squares with Coordinate-wise Guarantee

Randomized sketch-and-solve algorithms accelerate overconstrained $\ell_2$ regression by replacing the input with a smaller problem. Standard subspace embeddings guarantee that the cost of the regression is nearly preserved, but coordinate-wise accuracy of the solution is more delicate: we want the solution vector itself to be close to the optimal solution in $\ell_\infty$ norm. In particular, we want to find a vector $x'\in \mathbb{R}^d$ such that $\|x'-x^*\|_\infty\leq \frac{\epsilon}{\sqrt d}\cdot \|Ax^\star-b\|_2\cdot \|A^\dagger\|_{\rm op}$. Price, Song and Woodruff initiated the study of this problem and showed that the subsampled randomized Hadamard transform (SRHT) with $O(\epsilon^{-2} d^{1+\Theta(\sqrt{\log\log n/\log d})})$ rows achieves this guarantee. A subsequent work of Song, Ye, Yin and Zhang claimed to improve the row count to $O(\epsilon^{-2}d\log^3 n)$. Unfortunately, their proof relies on an independence assumption that does not hold in general, and we exhibit an explicit instance on which it fails. To achieve a truly nearly-linear-in-$d$ row count, we introduce a new fast, dense randomized transform, which combines a randomized Hadamard flattening, a random permutation, and balanced, disjoint Gaussian pooling. Conditioned on the Hadamard-and-permutation stage, the sketched problem becomes an exact Gaussian regression in which the noise is independent of the entire sketched design; this conditional independence is exactly what the earlier argument was missing. Our sketch yields the $\ell_\infty$ guarantee with $m=O(\epsilon^{-2}d\log d)$ rows, uses one Hadamard pass with a padded internal dimension $N=\widetilde{O}(n+\epsilon^{-2}d^3)$, and is efficient to apply: the sketched pair $(SA, Sb)$ can be computed in $O(Nd\log N)=\widetilde{O}(nd+\epsilon^{-2}d^4)$ time.
Read the full abstract

Statistics Theory

Posterior Consistency for Recovering Initial States in Nonlinear Subdiffusion Equations

We study the Bayesian recovery of the initial state in a semilinear time-fractional subdiffusion equation from noisy random space-time point observations. A rescaled Gaussian prior based on a Whittle–Matérn process is assigned to the unknown initial condition. We prove that the solution has \(\dot H^3\)-regularity when the nonlinearity satisfies a Lipschitz condition in the Sobolev norm. We then establish posterior contraction rates for the prediction error in the \(L^2\)-norm and for the parameter in Sobolev norms. The rates are polynomial in the sample size, with exponent depending on the prior smoothness and the spatial dimension. Moreover, we prove a minimax lower bound by constructing a wavelet-packing set and controlling the Kullback–Leibler divergences.
Read the full abstract

Statistical Methodology

Frequentist prediction intervals for random-effects meta-analysis via confidence-distribution propagation

Prediction intervals are increasingly recommended in random-effects meta-analysis because they describe the range of true effects expected in a future study or setting. Conventional frequentist intervals can have inadequate finite-sample coverage because uncertainty in the between-study variance is not fully propagated. We propose a confidence-distribution propagation method that carries uncertainty through the random-effects hierarchy. The method samples the between-study variance from a confidence distribution obtained by inverting the exact distribution of Cochran's Q and, conditional on each draw, samples the average effect from its corresponding normal confidence distribution before generating a future true effect. Prediction limits are empirical quantiles of the resulting Monte Carlo distribution. Across the scenarios examined, the proposed method improved or maintained coverage relative to existing frequentist intervals, including the Nagashima-Noma-Furukawa confidence-distribution bootstrap, with generally modest increases in expected width. The same Monte Carlo sample also yields confidence intervals for the average effect and heterogeneity measures. The method is implemented in the R package cdmeta available at CRAN (https://doi.org/10.32614/CRAN.package.cdmeta).
Read the full abstract

Statistics Theory · Cross-listed from econ.EM

Inference for High-Dimensional Network Data

We develop a novel method of inference for network-dependent high-dimensional random vectors. Dependence is characterized via a functional dependence measure based on graph distance, allowing the approximation theory to capture the interaction between the decay of dependence and the growth of network neighborhoods. We establish Gaussian approximation results for the maximum norm under finite-moment and sub-Weibull conditions, providing explicit conditions under which the dimension may increase with the network size. We also propose a high-dimensional network HAC covariance estimator and establish its convergence properties, yielding a feasible procedure for simultaneous inference. Simulation studies demonstrate favorable finite-sample performance of the proposed method. We apply the procedure to study how spillover effects vary with an index of network homophily by constructing confidence bands for the conditional spillover-effect function. The application reveals heterogeneity and local significance that would be obscured by conventional low-dimensional inference.
Read the full abstract

Machine Learning (Statistics) · Cross-listed from cs.LG

Algorithmic Principles For Multiclass Learning Are Hard To Come By: Limits of Regularization and Proper Learning

Two of the most fundamental questions in statistical learning theory are the following: which prediction problems are learnable, and how should they be learned? For the former, elegant answers often take the form of combinatorial dimensions. The latter question, however, has proved considerably more elusive: all known general-purpose multiclass learners rely on intricate orientations of exponentially large one-inclusion structures, and familiar algorithmic principles such as proper learning and regularization remain poorly understood. Motivated by prior work, we ask whether learning reduces to proper learning—possibly over a larger hypothesis class—and whether proper or improper multiclass learning can ultimately be captured by suitable regularizers. Our primary results answer both questions negatively, resolving three open problems from prior work. First, we exhibit a learnable multiclass problem that cannot be embedded in any properly learnable class, meaning learning cannot be reduced to proper learning by enlarging the hypothesis class. Second, we demonstrate that proper learning can require training error and characterize this phenomenon precisely: every properly learnable class admits a proper learner making $o(m)$ errors on samples of size $m$, but every prescribed sublinear scale $a_m=o(m)$ is necessary for some properly learnable problem. Third, regularization is not a general learner: we exhibit a properly learnable class that cannot be learned by any Structural Risk Minimization (SRM) learner, and a learnable class that cannot be learned by any local regularizer. We complement these impossibility results with a positive theory that gives two sufficient conditions for SRM learnability and characterizes SRM representability through integrability of revealed preferences.
Read the full abstract

All authors Julian Asilis, Shaddin Dughmi, Vatsal Sharan, Alec Sun, Shang-Hua Teng, Chang Wang

Statistical Methodology

Wavelet-Based Bayesian Hierarchical Modeling with Regularized Horseshoe Priors for Spatially Correlated Functional Data

Environmental monitoring networks increasingly record pollutant levels as curves observed over time at fixed stations. Yet, exposure and risk assessment often require predicting these curves, with their uncertainty, at unmonitored locations. Conventional smooth-basis methods for such spatially correlated functional data, including spline-based kriging, tend to over-smooth acute, high-frequency episodes such as pollution peaks. We propose a parsimonious wavelet-based Bayesian hierarchical model that anchors a single, shared Matérn correlation matrix at each resolution level, avoiding the parameter inflation of coefficient-specific spatial processes. Adaptive sparsity is enforced through a spatially informed regularized horseshoe prior, allowing the model to borrow strength across neighboring locations. At the same time, a non-centered parameterization ensures stable inference under the No-U-Turn Sampler. In simulation studies across distinct signal-to-noise regimes, incorporating spatial dependence substantially stabilizes reconstruction under severe noise relative to strictly independent models. Applied to PM$_{10}$ concentrations from Mexico City and benchmarked against ordinary kriging for functional data and a hierarchical Bayesian wavelet alternative, the model captures acute pollution events and, beyond improving point prediction, delivers sharper and better-calibrated credible intervals at unobserved locations.
Read the full abstract

Machine Learning (Statistics) · Cross-listed from math.PR

Explicit Bounds on the Entropy of Piecewise Hölder Graphon Models

We study the entropy of random graphs generated by piecewise Hölder continuous graphons. We first present a result on the rate of convergence of the normalized entropy as the size of the graph grows. The core ideas of the proof are described, with the detailed proof provided in the appendix. From this result, we then derive quantitative bounds on the entropy for the stochastic block model and random geometric graph model. These bounds provide explicit formulae rather than asymptotic statements which have been found previously.
Read the full abstract

Machine Learning (Statistics) · Cross-listed from cs.LG

Bayesian methods and Markov chain Monte Carlo algorithms for curve reconstruction and point cloud data analysis

Point-cloud data routinely captured by modern imaging and sensor technologies provide detailed geometric descriptions of objects and environments, but their analysis is hindered by large data volumes, localization noise, and missing information. In addition, existing point-cloud reconstruction pipelines typically return a single best-fit structure without uncertainty quantification. We introduce a fully Bayesian framework for representing point-cloud data and reconstructing closed curves, in which observed points are modeled as noisy perturbations of latent locations constrained to lie on the underlying curve that is regularized by a non-parametric prior. Posterior inference in our framework is carried out using a series of Markov chain Monte Carlo samplers tailored to point-cloud characteristics. Numerical experiments, including synthetic examples and real-world LiDAR datasets, show accurate reconstructions and quantified uncertainty over the recovered curves.
Read the full abstract

Statistical Methodology

Power and Sample Size Calculations for Hybrid Controlled Trials

Hybrid controlled trials (HCTs) augment randomized controls with external controls (ECs) to address practical challenges in randomized controlled trials (RCTs) and improve statistical power in settings such as rare diseases, oncology, and pediatrics. However, prospective sample-size determination is challenging because the required RCT sample size depends on the comparability of ECs with RCT controls, which are unavailable at the planning stage. We propose a 5+3 design for HCT sample-size determination based on an inverse probability weighting estimator of the average treatment effect. The framework uses five conventional RCT design parameters and three additional scalar parameters characterizing EC comparability: the number of outcome-drift-free ECs, an overlap coefficient for the covariate distributions of the RCT and ECs, and a correlation coefficient linking the sampling mechanism to the control potential outcome. We establish the asymptotic distribution of the estimator and prove that its variance is determined by these design parameters under the proposed working models, yielding sample-size calculations for both continuous and binary outcomes. Simulation studies evaluate finite-sample performance, and a real clinical application illustrates its practical use. The method is implemented in the hctdesign R package.
Read the full abstract

Machine Learning (Statistics) · Cross-listed from q-fin.RM

DTD-VAE: Disentangled Temporal Dependencies VAE for Credit Risk Prediction

Evaluating customer creditworthiness is crucial for retail banking operations, as it impacts marketing strategies, customer relationship management, and credit risk control. Traditional methods often struggle to capture complex temporal dependencies and extract pertinent information from customer data, crucial for accurate risk assessment. Specifically, they fail to differentiate between temporal patterns indicative of credit risk and those reflecting general customer behavior or preferences, leading to suboptimal risk predictions. In this study, we introduce the Disentangled Temporal Dependencies Variational Autoencoder (DTD-VAE), an advancement over conventional VAE, designed to disentangle temporal dependencies and distinguish credit risk-related features from past customer preferences. The feature inference module of the DTD-VAE incorporates an autoregressive temporal dependency learning mechanism that adeptly captures the temporal dependencies among latent variables, enriching the model's comprehension of the inherent data structure. Furthermore, the feature generative module utilizes an element-wise gating mechanism that assigns independent weights to each dimension of the expert models, enabling a finer-grained disentanglement of latent variables, particularly those relevant to credit risk prediction. Extensive experiments on six real-world datasets demonstrate that the proposed framework consistently outperforms existing methods, achieving performance gains of 3.2%-4.86% in ROC-AUC and 6.41%-9.71% in Accuracy Ratio.
Read the full abstract

All authors Xiaobo Guo, Lu-an Dong, Yanbo Wang, Peng Zhang, Cai Zhi, Youru Li