Statistical Methodology · Cross-listed from stat.ML
Prediction-Powered Smoothing and Validation for Disaggregated AI Evaluation
Sho Kawano, Zehang Richard Li and Paul A. Parker
Evaluating an AI system requires disaggregated assessment, as performance varies across domains such as
benchmark task types or conversation types in deployed
agents. Exhaustive testing is expensive, so evaluation rests on a sample of labeled units. We treat the evaluation set as a finite population and seek accurate point and interval estimates of each domain mean. Direct
estimators, including prediction-powered inference (PPI), use only a domain's own labels and are imprecise where labels are few. Small area estimation addresses this problem, and we build on it to develop an integrated workflow for estimation and validation. For estimation, we propose prediction-powered smoothing (PP-S), a
Bayesian model fit to each domain's prediction-powered estimate, with an extension that borrows strength across a reporting taxonomy (PP-TS). For validation, we derive a new, approximately unbiased design-based cross-validation score for choosing among direct and smoothed
estimators. We study a curated
benchmark with verifiable grading and deployed
agent traffic graded by humans, each with every outcome observed. In both, the proposed
estimators improve on the direct
estimators in point and interval estimation, with near-nominal coverage. At the same sampling budget, our score selects as well as an independent validation sample does and estimates the selected
estimator's error far more accurately.
Read the full abstract ▾
Statistical Methodology · Cross-listed from math.ST
Instance-Optimal Adaptive Location Estimation via Multiscale Mid-Summaries
Qiaosen Wang and Chao Gao
Location estimation exhibits markedly different finite-sample behavior across noise distributions: regular families typically yield root-\(n\) rates, whereas compactly supported laws may admit faster, boundary-driven rates. We question whether a single
estimator, without knowledge of the density's shape, can adapt to the instance-wise optimal estimation rate, as an oracle that knows the underlying location family can. For a known location family with symmetric log-concave noise density \(f\), the optimal location estimation error with sample size \(n\) under failure probability \(\delta\) is known to be Le Cam's two-point rate: \[ \sup\left\{r>0:\mathsf{H}^2\left(f_0, f_{2r}\right)\lesssim \frac{\log(1/\delta)}{n}\right\}. \] When the location family is unknown, we propose a shape-agnostic
estimator that attains this oracle
benchmark simultaneously over all symmetric unimodal densities with non-decreasing hazard rates, a class strictly broader than symmetric log-concave distributions. We establish that the Hellinger-driven two-point rate can be characterized solely by a multiscale function of dyadic
quantile gaps. This new structural connection between Hellinger divergence and
quantile geometry motivates a simple estimation procedure that aggregates sample mid-summaries with carefully designed data-dependent weights. The resulting
estimator is finite-sample instance-optimal and runs in only \(O(\log(n))\) time on sorted samples.
Read the full abstract ▾
Statistical Methodology · Cross-listed from math.ST
Robust Multi-Task Learning for Principal Component Analysis
Dali Liu and Haolei Weng
Principal component analysis (PCA) is a fundamental tool for learning low-dimensional structure from high-dimensional data. When data are collected from multiple sources, the underlying task distributions may exhibit unknown degrees of similarity, with some tasks potentially arising from arbitrary distributions. We propose new multi-task PCA procedures that exploit similarity structure across tasks to improve eigenspace estimation while remaining robust to outlier tasks. We establish non-asymptotic convergence rates and show that the proposed procedures attain minimax optimal rates in a range of regimes. One of the procedures builds on the
matrix-depth notion of Chen, Gao, and Ren (2018) and can achieve the optimal dependence of the estimation error on the proportion of outlier tasks, addressing a key challenge in robust multi-task learning. Extensive simulations and real-data analyses demonstrate the effectiveness of the proposed methods.
Read the full abstract ▾
Statistical Methodology · Cross-listed from stat.CO
Hankel–Christoffel–Nevai Screening for Bayesian Inverse Problems
Zhiliang Deng and Xiaomei Yang
Likelihood evaluation in
Bayesian inverse problems often requires a forward-model solve. We study candidate screening using a likelihood-weighted prior moment
matrix and two associated scores: a Christoffel ratio and a Nevai
polynomial average. A finite pilot supplies likelihood information that is reused to rank further prior candidates. We connect finite-pilot
matrix error, quantitative Legendre localization, and fixed-budget posterior-mass regret. Conditional likelihoods distinguish feature loss from
polynomial and sampling errors, and a filtered Gaussian construction permits controlled feature selection and localization. In a nonlinear function-coefficient PDE, equal-budget comparisons separate methods using scalar likelihoods from surrogates using forward outputs. The Christoffel ratio outperforms the tested direct likelihood regressions, but forward-response surrogates capture more posterior mass at small retention budgets. Independent-pilot tests and reference resampling quantify two distinct sources of uncertainty. Controlled Gaussian experiments illustrate finite-filter truncation and the benefit of selecting relevant features. These results identify when moment geometry provides useful screening information, without asserting universal superiority over surrogate models or an exact posterior sampling method.
Read the full abstract ▾
Statistical Methodology · Cross-listed from cs.LG
Epidemiological Causal Graph Identification: Challenges, Identifiability and Algorithms
Sambit Mishra, Yingying Wang, Christine K. Johnson et al. (+1 more)
Causal discovery from observational data is fundamental to statistics and machine learning, yet determining causal direction without interventions necessitates structural assumptions. Existing identifiability research primarily focuses on continuous variables under additive noise models, often neglecting mixed
datasets containing ordinal scales, counts, and continuous measurements. This paper investigates causal discovery in Directed Acyclic Graphs (DAGs) where nodes follow either an ordinal distribution (via an ordered logit model) or a regular one-parameter exponential family distribution. We prove that the edge direction between an ordinal and an exponential family node is distributionally identifiable for generic parameter values. Our findings generalize previous Ordinal-Poisson results to the broader exponential family. Computationally, we introduce a score-based exhaustive search and a masked continuous optimization framework using DAGMA for larger graphs. Numerical results validate the theory, recovering edge orientations within a Markov equivalence class that are unidentifiable under classical structural equation models.
Read the full abstract ▾
All authors Sambit Mishra, Yingying Wang, Christine K. Johnson, Urbashi Mitra
Statistical Methodology
Sampling-Based Batch Sequential Design by Stein Variational Gradient Descent
Penghui Fu, Xiaoxian Ding, Chunlin Ji et al. (+2 more)
Many real-world experimental design problems require a batch of experimental runs across stages, in which multiple points are selected and evaluated at each stage. However, most work in the design literature is focused on fully sequential (point-by-point) methods. This paper proposes a sampling-based framework to systematically convert a fully sequential method to a batch sequential method. In particular, Stein variational gradient descent (SVGD) is adapted to efficiently sample a batch of points from a properly constructed target distribution while balancing the individual utility and the batch diversity. We address challenges that arise in using SVGD for experimental designs, including constrained design regions and near-uniform target distributions. We apply the proposed method to obtain batch versions of the state-of-the-art fully sequential methods, and demonstrate their performance through extensive numerical studies.
Read the full abstract ▾
All authors Penghui Fu, Xiaoxian Ding, Chunlin Ji, Jianhua Z. Huang, C. F. Jeff Wu
Statistical Methodology
Efficient computation of mixture confidence sequences in generalized linear models
Claudia Di Caterina, Luigi Pace, Alessandra Salvan et al. (+1 more)
Classical confidence intervals, when repeatedly obtained on accumulating data at different sample sizes, produce contradictory inferences with high probability. We propose a simple and efficient strategy for computing, instead, mixture confidence sequences for regression coefficients in generalized linear models under this sequential framework. Simulations demonstrate the computational convenience of our approach and the importance of drawing inferential conclusions based on these anytime-valid tools when observations become available in batches over time. The usefulness of the proposed procedure is also shown in the analysis of streaming data from the American National Automotive Sampling System.
Read the full abstract ▾
All authors Claudia Di Caterina, Luigi Pace, Alessandra Salvan, Nicola Sartori
Statistical Methodology
Gaussian Boundary Inference in a Hypergeometric Heavy-Tailed Family
Steve Lawford
This paper develops inference for a Gaussian-nested hypergeometric family of distribution functions. The family \[ G_c(z) = \frac12 + z\,\frac{\Gamma(c-1/2)}{2\sqrt2\,\Gamma(c)}\,{}_1F_1\!\left(\frac12;c;-\frac{z^2}{2}\right),\quad c\ge\frac32, \] contains the standard normal distribution at the boundary $c=3/2$. Away from the boundary, the density has algebraic tail behaviour $g_c(z)\sim(c-3/2)|z|^{-3}$, so the parameter $c$ indexes a directed heavy-tailed deformation of the Gaussian law. The distribution also admits an equivalent beta-precision normal scale-mixture representation, in which the Gaussian boundary corresponds to degenerate unit precision. I establish the admissibility of the hypergeometric family, derive minimum-distance
estimators, and obtain both regular interior asymptotics and nonstandard boundary asymptotics under the normal null. The standardised fit-improvement statistic converges to the mixture distribution $\tfrac12\delta_0+\tfrac12\chi_1^2$. I extend the theory to plug-in location-scale procedures, including a robust median/IQR version. Simulations document accurate null size and directed power against heavy-tailed alternatives. An application to daily S&P 500 returns, both unconditionally and after GARCH(1,1) filtering, illustrates the empirical implications for tail fitting and risk
quantiles, and documents that GARCH filtering substantially reduces but does not eliminate the symmetric heavy-tailed departure detected by the test.
Read the full abstract ▾
Statistical Methodology
Exponential Smoothing for Time Series of Random Objects
Takuo Matsubara, Peiwen Jiang, Wilson Ye Chen et al. (+1 more)
Time series of random objects, such as covariance
matrices, probability distributions, and functional data, call for forecasting methods that do not rely on standard arithmetic operations. We introduce geodesic exponential smoothing, a generalization of exponential smoothing to time series in Hadamard spaces: the forecast level moves a fixed fraction of the way along the geodesic toward each new observation. The smoothing parameter is estimated by minimizing the average squared distance between observations and their forecasts. We further introduce an innovations mechanism under which each observation has conditional Fréchet mean equal to the current level, providing the metric-space analog of the innovations state-space model. In contrast to autoregressive models for object-valued time series, the framework involves a single scalar parameter, assumes no stationarity, and updates online in constant time per observation. Under this mechanism, we establish sample-path properties of the generative process via the quasilinearization available in Hadamard spaces, and prove almost-sure consistency of the smoothing-parameter
estimator. Three real-data applications, spanning covariance-
matrix, distributional, and functional time series, assess the forecasting performance of the method against structurally heavier alternatives.
Read the full abstract ▾
All authors Takuo Matsubara, Peiwen Jiang, Wilson Ye Chen, Minh-Ngoc Tran
Statistical Methodology
Identification and Estimation of Causal Estimands with Missing Not at Random Data
Faria Rauf Ria, Tarikul Islam and Mahbub A.H.M. Latif
Missing not at random (MNAR) data pose significant challenges for causal inference, particularly when both confounders and the outcome are partially observed. Without additional assumptions beyond those required for causal inference, causal estimands are generally not identifiable under MNAR mechanisms. This paper first develops identification results for the causal estimand, the average treatment effect, under several plausible MNAR mechanisms using completeness conditions, and proposes an estimation approach based on the Expectation-Maximization (EM)
algorithm. We further extend this identification and estimation framework to mediation analysis, enabling the estimation of natural direct and indirect effects under MNAR mechanisms. Through extensive simulation studies, we compare the proposed method with two widely used approaches for handling missing data, complete-case analysis and multiple imputation. The results show that the proposed method yields substantially lower bias under the considered MNAR mechanisms. Finally, we apply the proposed approach to NHANES data to estimate the causal effect of education on depression, with health condition as the mediator.
Read the full abstract ▾
Statistical Methodology
Noise-adjusted turnover in estimated networks
Sultan Amed and Sayantan Banerjee
Economic networks are often estimated separately over two periods, and changes in their edge sets are interpreted as structural rewiring. Since both networks are estimated, observed turnover also reflects graph-selection error. We study the two-snapshot Hamming-turnover functional under a homogeneous edge-misclassification model. With known sensitivity and specificity and conditional independence of the estimated edge indicators across periods, latent turnover admits a closed-form unbiased adjustment based only on observed turnover and the two estimated graph sizes. We then examine the effects of sparsity, calibration error and dependence across periods. When the number of true links is proportional to $p$, a false-positive probability of order $p^{-1}$ generates expected spurious turnover of order $p$. An error of the same order in calibrating the false-positive probability can likewise leave order-$p$ bias after adjustment. We also derive the bias induced by cross-period dependence and give sufficient conditions for consistency relative to network size. Numerical results illustrate the finite-sample implications.
Read the full abstract ▾
Statistical Methodology
Parameter Estimation for the Mixed Fractional Merton Jump Diffusion Model with EM Algorithm
Chidiogo Joy Agboeke, Hamidreza Maleki Almani, Dario Gasbarra et al. (+2 more)
This paper proposes an Expectation–Maximization
algorithm with Metropolis–Hastings sampling for parameter estimation in a Mixed Fractional Merton Jump
Diffusion model. The model combines fractional Brownian motion to capture long-range dependence with a compound Poisson jump process to describe abrupt movements in financial returns. The latent jump process is inferred during the E-step using Markov Chain Monte Carlo sampling, while the M-step updates the model parameters by maximizing the expected complete-data likelihood. The consistency and asymptotic normality of the proposed
estimator are established under suitable regularity conditions. The methodology is applied to the Helsinki Stock Index (OMXH25). The proposed estimation framework provides a reliable and computationally efficient approach for modeling financial time series exhibiting both long-
memory dependence and jump behavior.
Read the full abstract ▾
All authors Chidiogo Joy Agboeke, Hamidreza Maleki Almani, Dario Gasbarra, Foad Shokrollahi, Tommi Sottinen
Statistical Methodology
A Bayesian Bi-Directional Splitting Framework for Variable Selection in Large Datasets
Aaron Coats, Vinny Davies and Mayetri Gupta
Modern tabular
datasets are becoming increasingly large, both in the number of samples and
covariates, posing significant challenges for
Bayesian variable selection due to the resulting computational burden. While there is extensive literature on scaling
Bayesian inference to large numbers of observations or high-dimensional
covariate spaces, comparatively little work addresses scalable
Bayesian variable selection when both dimensions are large simultaneously in a practical setting. This paper presents a novel
Bayesian variable selection framework for efficiently analysing data with a large number of both rows and columns. The proposed framework operates via a divide-and-conquer approach, splitting data into batches along both directions and analysing each batch independently in parallel, after which the results are combined together in a two-phase consensus procedure. Experiments demonstrate the computational gains while retaining strong variable selection performance, successfully identifying relevant signals in noisy, high-dimensional settings despite the loss of information induced by data splitting. Practical guidelines are also provided, including recommendations for tuning parameter choices and effective data partitioning strategies, followed by a real application to an H3N2 influenza
dataset.
Read the full abstract ▾
Statistical Methodology
Gain-function optimisation of graphical multiple testing procedures for confirmatory clinical trials
Alexander D. V. Spiers, Michael J. Grayling, Graham M. Wheeler et al. (+1 more)
Graphical multiple testing procedures are a flexible and transparent way to control the family-wise error rate when a confirmatory trial pursues several label claims, but they leave open the question of which graph to use. In practice sponsors often fall back on fixed-sequence or Holm procedures that may poorly reflect what the trial is actually trying to achieve. We propose to instead choose the graph that maximises an explicit gain function, which states what each possible set of rejected hypotheses is worth to the sponsor: typically nothing until a regulatory hurdle is cleared, then an incremental amount for each further claim. Conventional power criteria are recovered as special cases, and because the search is confined to graphical procedures, family-wise error rate control holds whichever graph is selected. We set out a structured procedure for eliciting the gain function from the clinical, commercial, and regulatory members of a trial team. The proposed framework also handles uncertainty in the treatment effects and correlations assumed at the design stage, by averaging performance over their plausible values rather than fixing a single assumption. For group sequential designs, we describe how it can further reward early claims. Five examples, drawn from real and hypothetical pharmaceutical trials, show that the best graph depends on how trial success is defined, how uncertain the design assumptions are, and, in a group sequential setting, when claims can be established.
Read the full abstract ▾
All authors Alexander D. V. Spiers, Michael J. Grayling, Graham M. Wheeler, Adrian P. Mander
Statistical Methodology
Multi-Absorbing Phase-Type Distributions for Right-Censored Competing Risks Data
Zhihao Qiao, Budhi Surya, Azam Asanjarani et al. (+1 more)
Phase-type (PH) distributions are versatile semi-parametric models for lifetime duration and can be used in survival and reliability analysis. In this paper we put forward methods and software for using PH distributions in a competing-risks model. The resulting multi-absorbing phase-type (MAPH) distribution records both the time until absorption and its cause. After formulating basic properties of this family, we develop an EM
algorithm for parameter inference from exact event-time/cause observations and independently right-censored observations. For a censored subject, the E-step conditions on survival up to the censoring time and imputes both the latent transient path and its eventual cause of absorption; closed-form cause-resolved sufficient-statistic expectations are obtained from
matrix exponentials. We illustrate applications and numerical properties and describe two accompanying Julia packages, in which both the exact-event and the censored E-step are implemented. Applied to intensive-care length-of-stay data in full, censored records included, the method attains a higher likelihood than the phase-type competing-risks fit previously published for those data.
Read the full abstract ▾
All authors Zhihao Qiao, Budhi Surya, Azam Asanjarani, Yoni Nazarathy
Statistical Methodology
Mutual Information as a Tool for Optimal Classification: Application to Identifying Rapid-Responding Behaviour
Santeri Holopainen, Jari Metsämuuronen, Mikko-Jussi Laakso et al. (+1 more)
Existing methods for identifying rapid-responding behaviour in large-scale assessments require parametric assumptions about the population. In this study, we propose a novel, non-parametric, mutual information-based framework of methods as an alternative. The methods within this framework compute the mutual information of the observed responses and discretised response times and maximise the information gain to determine a threshold that differentiates rapid responses from engaged responses. The only difference between the methods is the number of categories in the relevant variables. We present three methods explicitly. The first method uses response correctness and binarised response times. The second method uses correctness and categorises time into three groups. The third method uses raw responses and binarised times. We applied these methods to mathematics achievement data collected through the Programme for International Student Assessment in 2022. Furthermore, we examined the behaviour and usability of the first method in certain realistic conditions at the population and realised levels. The results indicated that the proposed framework is a viable alternative for identifying rapid responses. The framework's novelty lies in its non-parametric nature and its ability to utilise raw responses instead of correctness. Finally, we discuss some possible future research directions on this topic.
Read the full abstract ▾
All authors Santeri Holopainen, Jari Metsämuuronen, Mikko-Jussi Laakso, Janne V. Kujala
Statistical Methodology
Matrix Graphical Model Via Joint Estimation of Partial Correlations
Hyewon Kim and Seongoh Park
Matrix graphical models aim to characterize conditional dependence structures in
matrix-variate data under a separable covariance assumption. In this framework, the precision
matrix is decomposed as a Kronecker product, enabling separate modeling of undirected graphs across row and column domains. Existing methods have been developed for this problem, including likelihood-based approaches and regression-based procedures for graph estimation. Likelihood-based methods estimate precision
matrices directly and recover graph structures indirectly, whereas regression-based approaches directly target estimating edges among variables, thus outperforming the former. However, existing regression-based methods are based on multiple penalized regression problems, which naturally yields asymmetry in estimated graphs and computational difficulty in selecting tuning parameters. To address the limitations, we propose a joint estimation of partial correlations in
matrix graphical models. The proposed method estimates all partial correlations simultaneously within a unified optimization framework, thereby preserving
symmetry and easing the pain of selecting the best models. Numerical studies demonstrate that the proposed method improves graph recovery performance compared to existing approaches. We also analyze
protein expression data collected from patients with pulmonary tuberculosis, measured repeatedly at multiple time points, where the proposed method compares
protein networks between two groups of patients and recovers the temporal dependence structure.
Read the full abstract ▾
Statistical Methodology
Federated multiple testing with quantized p-values under family-wise error control
Prasanjit Dubey and Xiaoming Huo
Several institutions test one family of hypotheses under family-wise error control but cannot pool their data, so each site releases only a quantized report of its p-value for each hypothesis, such as whether the p-value is significant. The report's resolution is the number of values it can take. We quantify the power lost to such reports relative to the most powerful centralized procedure given all p-values (the oracle), with reports and combining rule chosen optimally. A report from which the p-value can be recovered loses no power, so the loss is due to compression, not decentralization. Under the stated regularity and power-objective conditions, every finite resolution loses power, and the optimal loss decays as the inverse square of the resolution: equal-width intervals attain this order, and no partition into as many
cells improves it. In two-site Beta examples, optimized one-bit reports are nearly lossless for a single hypothesis but lose several times as much power for two. At level 0.05 with two Beta(1,2) hypotheses, optimally combined three-bit equal-width reports retain 99.2% of oracle power. We give the power-optimal combining rule for given reports, and a rule using only their exactly known null distribution, valid under arbitrary dependence across hypotheses.
Read the full abstract ▾
Statistical Methodology
Heterogeneity-calibrated Byzantine-robust distributed composite quantile regression
Xiaofei Wu and Jian Qing Shi
We study sparse composite
quantile regression (CQR) for distributed data with heterogeneous honest sites and Byzantine workers. Honest sites share a common slope but may differ in their
covariate distributions, error laws, and
quantile intercepts. The proposed heterogeneity-calibrated robust CQR (HC-RCQR) profiles local intercepts and calibrates scores using an approximate inverse profile Hessian. Honest workers transmit the resulting vectors, whereas Byzantine workers may send arbitrary vectors. The server updates the estimate by coordinatewise trimming and soft thresholding. A scalar example shows how unequal honest-site
curvatures allow intermediate Byzantine reports to survive trimming and how ideal calibration reduces their possible effect. We also establish nonidentification of the mean of unrestricted honest-site slopes when fault identities are unknown. Under suitable conditions, we establish conditional contraction and support-recovery guarantees. The bound separates score offset, sampling fluctuation, contamination, calibration error, and the Newton remainder. Simulations and a bike-demand study examine performance under heterogeneous data and
adversarial messages.
Read the full abstract ▾
Statistical Methodology
Selective Inference in Growth Curve Models
Haochen Lei, Qian Zhang and Hongyuan Cao
Growth curve models are widely used in psychological research, and variable selection can help identify baseline characteristics associated with longitudinal heterogeneity. However, conventional inference after data-driven variable selection can be invalid because the same outcome data are used for both selection and inference. We develop a data-fission framework for post-selection inference in growth-curve models that separates the information used for selection and inference while retaining all participants in both stages through the addition and subtraction of Gaussian noise. The framework accommodates flexible variable-selection procedures and targets covariance-weighted linear projection parameters in the selected working model. It provides exact inference when the covariance structure is known, and we establish asymptotic validity under suitable regularity conditions when the covariance structure is estimated. Simulations show that the proposed method provides valid inference and improves efficiency over subject-level data splitting, whereas naïve post-selection inference can be biased. An application to the Longitudinal Study of American Youth illustrates the proposed framework.
Read the full abstract ▾
Statistical Methodology
Oracle high-dimensional $M$-estimation using smooth reparameterization for sparsity
Yoichi Nishiyama
This paper establishes a unified non-linear regularization framework for high-dimensional $M$-estimation, encompassing both linear models and Cox's proportional hazards models. Rather than relying on traditional additive non-convex penalties, the proposed paradigm embeds sparsity directly into the transformation for the physical parameter $\theta=\phi(\beta)$ using a smooth ($C^2$) component-wise "ReParametrization map for Sparsity (RePS)" $\phi$, and the penalty term is $\lambda \Vert \beta \Vert_1$ rather than $\lambda \Vert \theta \Vert_1$. This structural formulation dynamically adapts to local parameter scales, suppressing high-dimensional noise while simultaneously recovering unbiased oracle asymptotic normality under the large-sample limit. Through the Primal-Dual Witness method, we establish a unified oracle equivalence for both model classes under a liberated micro-penalty scaling regime $\lambda \ll n^{-1/2}$, accommodating model-specific structures such as the shift-invariance in survival analysis. Extensive Monte Carlo simulations demonstrate that the proposed framework consistently achieves superior false-positive control and high 95% confidence interval coverage in high-dimensional linear models, while also delivering performance comparable or superior in all aspects to state-of-the-art methods like SCAD and MCP in proportional hazards models.
Read the full abstract ▾
Statistical Methodology
Vector Vine Copula Models for Multivariate Longitudinal Data
Michael Stanley Smith and Lin Deng
Multivariate longitudinal data may exhibit non-Gaussian margins, nonlinear dynamics, and response vectors with composition that varies across waves. To account for these features, we introduce a vector drawable vine (VD-vine) copula that extends conventional drawable vine copulas from scalar to vector-valued nodes. Here, the response vector at each wave forms a multivariate marginal, and serial dependence is captured through a sequence of linking vector copulas. We establish that the VD-vine is itself a vector copula and reduces to a conventional drawable vine for scalar nodes. Recursive forward and backward conditional transports are derived that enable efficient likelihood evaluation and predictive simulation, with parsimonious reductions under finite-order Markov and stationary restrictions. Unconstrained parameterizations for Gaussian and FGM linking vector copulas, flexible multivariate marginals, and
Bayesian variational inference provide a practical implementation. Simulations show improved predictive accuracy when the marginals are asymmetric and serial dependence is multivariate, with little loss under a correctly specified Gaussian panel vector autoregression. In an eight-wave Australian panel of 1,093 individuals with varying response vectors, the full VD-vine delivers the best cross-validated distributional forecasts among the models considered, establishing the benefit of capturing asymmetry and nonlinear dependence.
Read the full abstract ▾
Statistical Methodology · Cross-listed from cs.LG
Compressed Active Subspaces for Scalable Bayesian Inference
Thomas Flynn, Sanket Jantre, Byung-Jun Yoon et al. (+1 more)
Active subspace methods provide a framework for quantifying predictive uncertainty in high-dimensional models by identifying and performing inference along parameter directions that have the greatest influence on the model output. However, the construction of active subspaces requires storing many full-dimensional model gradients, which becomes prohibitive as model size increases. We address this limitation by proposing Compressed Active Subspaces (CAS), a scalable approach that first maps the model parameters to a compressed space using a structured isometric
embedding and then constructs the active subspace within this reduced parameterization. Our approach substantially reduces the
memory required for active subspace construction and enables
Bayesian inference for large models where standard active subspace methods become impractical. We demonstrate the scalability of CAS on neural networks of increasing size while maintaining predictive performance and robust uncertainty estimates.
Read the full abstract ▾
All authors Thomas Flynn, Sanket Jantre, Byung-Jun Yoon, Kibaek Kim
Statistical Methodology
Spatial Aggregation of ROC and Precision-Recall Curves
Romain Pic, Zhongwei Zhang, Sebastian Engelke et al. (+1 more)
Receiver Operating Characteristic (ROC) and Precision-Recall (PR) curves are widely used to assess the discrimination ability of forecasts for binary events, such as threshold exceedances or warnings of extreme events. In weather forecasting, forecasts are provided as spatial fields, yielding location-wise ROC and PR curves that are often aggregated to facilitate comparison. However, the effect of the aggregation strategy on performance assessment remains poorly understood. We investigate how different aggregation strategies for ROC and PR curves affect the assessment of discrimination ability. In particular, we identify conditions under which aggregation strategies satisfy two desirable properties for fair comparison: preservation of dominance between forecasts and preservation of concavity or achievability of the curves. We obtain sufficient conditions and propose two strategies satisfying them. They are compared with existing strategies from the literature, and we analyze their properties and highlight potential pitfalls that may lead to misleading interpretations. Based on these findings, we provide practical guidelines for the interpretation of aggregated ROC and PR curves. The proposed framework is illustrated with AI-based global weather forecasts, showing how different aggregation strategies can yield different rankings of competing forecasts.
Read the full abstract ▾
All authors Romain Pic, Zhongwei Zhang, Sebastian Engelke, Johanna Ziegel