Peer Revenue Publish or profit

Papers

Fresh from arXiv, typeset properly. Highlighted words trade on the market.

Mathematics Statistics Theory

math.ST Watch Statistics Theory (sign in to use)

Wednesday 5 August

Statistics Theory · Cross-listed from econ.EM

Algorithm-Driven SVARs: Navigating the Wilderness of Big Data

Every SVAR result is conditional on two choices: the restrictions that identify the shock and the variables on which they operate. The literature disciplines the first; the second is chosen by hand. We develop a Bayesian methodology that constructs information sets, uses an out-of-sample criterion, and retains the largest system it admits. Under recursive identification, output rises with housing production rather than household credit alone. For monetary policy, an anchor-free joint Bayesian proxy SVAR with multiple instruments strengthens the credit spread channel. A core system augmented with the selected corporate spread identifies expected default risk as a potent transmission margin.
Read the full abstract

Statistics Theory

A Design-Based Minimax Theory for Network Experiments

Network experiments are used throughout the social and medical sciences to investigate causal effects under the presence of interference. While a large body of work has developed improved statistical procedures, the fundamental limits of statistical estimation in these settings is less well understood. In this paper, we develop and investigate a design-based theory of minimax risk for network experiments under an arbitrary neighborhood interference model. Our notion of minimax risk describes the optimal precision among all statistical procedures for investigating a particular causal effect on the observed interference network. We show that the minimax risk is a function of the corresponding conflict graph, which captures inherent unobservability of estimand-relevant potential outcomes given the observed interference network. Our main contribution is a series of upper and lower bounds on the minimax rate in terms of local and global connectivity properties of the conflict graph. To illustrate their utility, we apply these general results to obtain minimax analyses for two commonly studied effects: the direct treatment effect and global average treatment effect.
Read the full abstract

Statistics Theory · Cross-listed from math.PR

A Sharper Hoeffding Bound for Weighted Sums of Exchangeable Random Variables

We prove a Hoeffding-type moment generating function bound for weighted sums of bounded exchangeable random variables centered by their finite-population average. The bound reduces the excess inflation above one in a recent weighted exchangeable Hoeffding inequality from order $(\log N)/N$ to the rate-optimal order $1/N$, with an explicit constant. The proof reduces the problem to Hamming slices, identifies two-level extremizers for the relevant symmetric variational problem, and applies a hypergeometric martingale bound. We also give a lower bound showing that an excess inflation of order $1/N$ is unavoidable.
Read the full abstract

Statistics Theory · Cross-listed from stat.ME

Nonparametric Goodness-of-fit Testing under Covariate Shift

This paper develops procedures for nonparametric goodness-of-fit testing under covariate shift, where labelled data are drawn from a source population but goodness-of-fit is evaluated for a target population. The distribution mismatch is quantified by either a bounded moment condition or a sub-exponential tail condition on the target-to-source density ratio. Our method combines truncated importance-weighting kernel ridge regression with a multiplier bootstrap to construct confidence sets for the regression function. The truncation stabilizes the importance- weighting kernel ridge regression as well as the bootstrap calibration, making our approach applicable even when the density ratio has heavy tails. We prove nonasymptotic validity and sharpness of the resulting confidence sets under suitable operator compatibility conditions, and establish explicit error rates for coverage probability under specific conditions on the target- to-source density ratio and on the spectral decay of the kernel integral operator. Numerical experiments corroborate our theoretical findings.
Read the full abstract

Statistics Theory

Exchangeable Testing Against an Unknown Benchmark

We generate infinite binary exchangeable sequences by sequential comparison of data points against a latent benchmark. Assuming a prior distribution of the benchmark rank \(R_0\) within an unobserved group, we set up the Bayesian machinery that determines the posterior distribution of the running rank \(R_n\) in purely combinatorial terms. This yields an explicitly computable predictive probability of winning against the benchmark. The normalised running rank converges to a latent strength variable \(X\) with polynomial density, possibly Beta-tilted. Some min-max tournaments lead to particularly simple multiplicative formulae for predictive probabilities related to priors that generalise the Topp–Leone distribution; for that class we analyse the asymptotics of the associated fixed-\(n\) up-down Markov chains. The limiting diffusion has the classical Wright–Fisher variance but a nonlinear drift expressed explicitly via the prior density of the benchmark. Mixtures of Beta densities are classical objects in the theory of exchangeable sequences. The contribution of the present work is the combinatorial rank-based updating mechanism and the resulting explicit predictive laws for sequential testing against an unknown benchmark.
Read the full abstract

Statistics Theory · Cross-listed from math.PR

Strong Convergence for a General Class of Random Matrix Models

Let \(X_{1,n},\ldots,X_{d,n}\) be \(n\times n\) random matrices built from independent i.i.d. entry arrays, with centered entries, normalized by \(n^{-1/2}\). We prove that, if every entry law has finite fourth moment, then this tuple converges almost surely strongly in \(*\)-distribution to a free circular family with the matching variances. Equivalently, normalized traces and operator norms converge for every fixed noncommutative \(*\)-polynomial, including polynomials with fixed matrix coefficients. No assumption is imposed on the pseudo-variances of the complex entries. The bounded-entry argument applies the spectrum and moment universality estimates of Brailovskaya and van Handel to all self-adjoint linear pencils. The matching Gaussian pencils are reduced to independent Wigner matrices and identified by Anderson's strong convergence theorem. A fixed-level centered truncation, followed by the Bai–Yin norm bound, transfers the result to finite fourth moments.
Read the full abstract

Statistics Theory · Cross-listed from stat.ME

Constructing Large Orthogonal Minimally Aliased Response Surface Designs Through Enumeration and Combination of Weighing Designs

Advances in automation and high-throughput experimentation have enabled larger and more complex studies involving many factors and tests, creating a growing demand for computationally effective design construction methods. Efficient experimental design remains a key challenge in this context, creating a need for frameworks that can generate large experiments while preserving orthogonality and minimal aliasing. Unlike existing approaches which struggle with scalability, this work introduces an algorithmic framework for constructing large Orthogonal Minimally Aliased Response Surface (OMARS) designs by enumerating and combining weighing designs, three-level matrices with orthogonal columns and a fixed number of non-zero entries per column. Complete enumerations of weighing designs are achieved for designs with up to 24 tests, covering multiple numbers of factors and weights corresponding to two or three zeros per factor. In addition, a validated partial enumeration procedure and a combination method extend the catalog to substantially larger designs. The combination method enables the construction of OMARS designs for any test size that is a multiple of selected base sizes. This paper thus provides the methodology for generating large catalogs of high-quality OMARS designs, well-suited for high-dimensional screening and response-surface modelling in complex industrial and scientific experiments.
Read the full abstract

Statistics Theory

Debiasing the Lasso under Weaker Tail Assumptions

We consider the problem of high-dimensional inference with the lasso estimator. Different methods including 'double selection' techniques and multiple versions of the 'debiased lasso' have been proposed for this task with noticeable success. However, most guarantees assume strong hypotheses on the underlying data process and the errors in the linear regression model, such as subgaussian designs and independence between errors and the data itself. We show that 'standardizing' one's dataset – a natural procedure in practical penalized regression – leads to the same results under much weaker hypotheses, paying only a small price for not assuming light tails. The key technical point allowed by this step is exploiting the concentration properties of self-normalized processes. Importantly, we prove our results for two different methods closely related to the 'debiased lasso'. The second method performs valid inference even for a misspecified linear model, under mild sparsity conditions similar to the 'double selection' literature.
Read the full abstract

Statistics Theory

Consistent community recovery in stochastic block Ornstein-Uhlenbeck processes

We propose the stochastic block Ornstein-Uhlenbeck (SBOU) process, a continuous-time multivariate model in which the drift matrix encodes a latent group structure among its components. Our main contribution is a community-detection algorithm whose misclassification proportion converges to zero in a regime combining infill, long-span, and high-dimensional asymptotics. To our knowledge, this is the first consistency result of this kind for latent group recovery in a discretely observed continuous-time multivariate model. As a key intermediate result, we establish consistency of the discretely observed maximum likelihood estimator of the drift matrix in the same regime, thereby extending the high-dimensional Lévy-driven Ornstein-Uhlenbeck literature. For practical implementation, we develop a feasible model-selection procedure for estimating the support of the drift matrix, which enables data-driven selection of the number of latent groups. The SBOU framework can be viewed as a continuous-time generalisation of the discrete-time stochastic-block VAR model, allowing for both positive and negative dynamic interactions between groups as opposed to only positive. We illustrate the methodology on the RE-Europe wind-capacity dataset and recover a country-level grouping consistent with the geographic benchmark.
Read the full abstract

Statistics Theory

Optimal minimization of an unknown function in a nonparametric multivariate regression model thanks to a dimension reduction approach

In this paper, we propose a novel approach for estimating the minimum of a smooth function and its location from observations corresponding to a multivariate regression function depending a priori on d variables but actually only on r < d active variables and corrupted by some additional noise. Our method consists of two steps: The rst one is a variable selection approach which is used for identifying the r active variables on which f depends and the second one consists in estimating the minimum of the function and its location. The estimation of the minimizers is obtained by using a projected gradient descent where the gradient is estimated using a local polynomial approximation of the regression function limited to its active variables obtained in the rst step. The estimation of the minimum is obtained by evaluating the estimator of the regression function using a local polynomial approach at the estimator of one of the minimizers previously obtained. We establish non asymptotic upper bounds for the quadratic risk of the estimators of the minimizers and of the minimum and prove that they reach the optimal rate that could be expected as if the active variables were known beforehand up to a factor smaller than a power of a logarithmic term.
Read the full abstract

Statistics Theory

Fixed-Point Characterisations of Extremal Distributions under Partial Distributional Constraints

We present a methodological framework for solving robust inference problems with partially specified distributions over measurable subsets of a parameter space. Partial specifications define a set of admissible distributions. The goal is to determine extremal values (over these admissible distributions) for statistical quantities, where these quantities—these objective functions—are ratios of expectations of analytic functions, continuous functions, piecewise continuous functions, and uniform limits of piecewise continuous functions. We show that extremal values are approached by sequences of admissible distributions, whose limiting extremal distributions are characterised by fixed-point conditions on their support locations. This characterises where extremal distributions place probability mass and yields a practical computational framework for solving the corresponding optimisation problems. We establish convergence and asymptotic properties of the resulting extremal distributions and extremal objective function values. This work extends robust inference methods (e.g. robust Bayesian inference) by combining extremal-distribution reduction, fixed-point characterisation, and approximation-based analysis within a unified framework.
Read the full abstract

Tuesday 4 August

Statistics Theory · Cross-listed from econ.EM

Counterexamples and Sufficient Conditions: Comments on "Optimally-Transported Generalized Method of Moments"

We comment on the optimally-transported generalized method of moments (OTGMM) estimator proposed by Schennach & Starck (2026a) and give counterexamples to Theorems 2-6 under their stated assumptions. First, the assumptions used in the small-error analysis are insufficient for consistency in Theorem 2 and asymptotic normality in Theorem 3. Next, we consider the large-error analysis, in which Theorem 4 states that the OTGMM estimator is equivalent to a GMM estimator with modified moments. We show that in a scalar model, Theorem 4 selects a value that differs from the unique OTGMM minimizer and violates the OTGMM sample moment restriction. In an overidentified model satisfying the assumptions used in Theorems 5 and 6, the first component of the Lagrange multiplier has different probability limits under the OTGMM estimator and the GMM estimator with modified moments. Under misspecification, the population value selected by OTGMM depends on the transport metric and on which variables may be adjusted. We give a sufficient condition under which solutions of the modified moment equations also solve the original constrained problem at a given parameter value, and separate conditions for consistency and asymptotic normality of the OTGMM estimator. We also show that Assumption 16 does not imply the matrix bound used in the supplemental proofs and replace Assumption 16 with a matrix condition that yields the bound.
Read the full abstract

Statistics Theory · Cross-listed from cs.LG

Sample Complexity of Multicalibration for Multilevel Properties

Calibration requires a predictor to be unbiased after conditioning on its own predictions. Multicalibration asks for this guarantee simultaneously across a collection of groups. Many prediction tasks ask for several related features of the same conditional outcome distribution: variance is defined relative to the mean, skewness relative to both mean and variance, and conditional value at risk relative to a quantile. We study multicalibration for a sequence of $k$ properties in which each property is identifiable once the preceding properties are fixed. This framework includes Bayes pairs but does not require the properties to arise from a single loss. For every fixed $k\ge2$, we establish matching upper and lower sample-complexity bounds up to logarithmic factors under regularity conditions. Even with only polylogarithmically many binary groups, achieving multicalibration error $\varepsilon$ requires $\widetilde{\Omega}(\varepsilon^{-(k+2)})$ samples. Conversely, for any finite group family $\mathcal G$, we give a randomized learner using $O(\varepsilon^{-(k+2)}+\varepsilon^{-2}\log|\mathcal G|)$ samples. Thus the sample complexity is $\widetilde{\Theta}(\varepsilon^{-(k+2)})$ for polynomial-size group families. We instantiate the theory for three canonical examples.
Read the full abstract

All authors Jiuyao Lu, Krishnakumar Balasubramanian, Aleksandr Podkopaev, Shiva Prasad Kasiviswanathan

Statistics Theory

Multimodal Alignment Through Joint Kernel Entropic Gromov–Wasserstein Optimal Transport

We study the problem of aligning data from multiple modalities into a shared representation space, focusing on settings where strong pretrained unimodal encoders are available but cross-modal paired data are scarce. We propose a structure-preserving alignment framework, joint kernel entropic Gromov–Wasserstein Optimal Transport (JK-EGW), which maps multiple modalities into a common latent space by minimizing a quadratic optimal transport objective. JK-EGW leverages fine-grained similarity relationships within and across modalities to construct a global affinity kernel instead of relying on raw feature-space distances. Our framework naturally provides explicit control over the geometry and distribution of the latent embedding. On the theory side, we establish parametric sample complexity rate of $n^{-1/2}$, matching the corresponding rates for standard, entropic and Gromov–Wasserstein optimal transport. On the algorithmic side, we derive a scalable alternating procedure to solve JK-EGW with entropic optimal transport (EOT) updates through a low-rank kernel approximation and a variational lifting. This lifting scheme effectively relieves the burden of a quadratic objective, and allowing us to take the advantage of existing EOT solvers. Empirically, we focus on post-hoc alignment of embeddings from pretrained encoders in data-scarce regimes, and show that our proposed method achieves improved multimodal retrieval performance compared to existing alignment baselines.
Read the full abstract

Statistics Theory · Cross-listed from math.PR

Correlation Matrices in High Dimensions: Volume, Spectrum, and Extremes

The set of $n\times n$ correlation matrices, known as the elliptope, has volume decaying at the super-exponential rate $\exp\{-\tfrac14 n^2\log n\}$. We characterize where this vanishing volume concentrates. A uniform draw is entrywise close to the identity yet globally far from it and nearly singular. Its maximum absolute correlation is of order $\sqrt{\log n/n}$, its Frobenius distance is asymptotic to $\sqrt n$, its empirical spectral distribution converges to the Marchenko-Pastur law with ratio one, and its smallest eigenvalue has the exact $\operatorname{Beta}(1,d)$ distribution, where $d=n(n-1)/2$, and is therefore of order $n^{-2}$. Distinct off-diagonal entries are exactly pairwise independent under every $\operatorname{LKJ}(\eta)$ law, which yields a Chen-Stein proof of the extreme-correlation point-process limit for the whole LKJ family and an $O(n^{-1})$ total-variation bound for finite-dimensional exceedance counts relative to Poisson laws with their exact finite-$n$ means. Finally, for a bounded, centered i.i.d. off-diagonal perturbation of any correlation matrix, the nearest-correlation projection removes a fraction of the squared perturbation that tends to one and recovers the original matrix in average squared error per entry.
Read the full abstract

Statistics Theory

Topological Clustering via Sliced Wasserstien Kernels

Topological data analysis (TDA) uses topological techniques to extract meaningful shape-based information from complex datasets. Clustering is a central problem in data analysis, and there has been considerable recent interest in understanding how TDA can inform it. Existing approaches either cluster persistence diagrams directly under Wasserstein-type distances, which is computationally expensive, or use vector representations of diagrams. We propose a kernel $k$-means algorithm built on a convex combination of sliced Wasserstein (SW) kernels, one for each homology under consideration. Unlike other vector representations of persistence diagrams, the SW kernel is both stable and discriminative with respect to the $1$-Wasserstein distance. The method outperforms the baselines on two benchmark datasets and remains competitive on a third synthetic dataset, while being computationally efficient. It also outperforms both a single SW kernel on the union of all homology groups and an SW kernel computed directly on the point clouds. The convex combination assigns an interpretable weight to each $q$-homology kernel. We further validate that the weights identify the discriminating homology.
Read the full abstract

Statistics Theory · Cross-listed from stat.ME

Confidence Horizons

Anytime-valid inference enables analysts to continuously monitor their data and stop experiments early. However, the majority of these methods incur a certain conservativeness by remaining valid on infinite time horizons. In practice, a bound on the horizon may be imposed due to budgetary, practical, or ethical constraints. In this paper, we ask the question: "Is it possible to obtain sharper large-sample anytime-valid inference by forgoing validity beyond some finite time horizon?". We provide a positive answer to this question by proposing a family of statistical objects that we call "confidence horizons". These objects can be viewed as large-sample confidence sequences on bounded time horizons, or alternatively as group sequential repeated confidence intervals with a maximal number of interim peeking times. We make explicit connections to the group sequential boundaries of Pocock [1977], O'Brien–Fleming [1979], and Wang–Tsiatis [1987]. We derive closed-form distribution functions of certain statistics which can be used to calculate the asymptotic quantiles of confidence horizons exactly, sidestepping the repeated integration typically employed in group sequential methods. We illustrate the use of confidence horizons for treatment effect estimation in sequentially randomized experiments under adaptive Neyman allocation.
Read the full abstract

Statistics Theory · Cross-listed from econ.EM

Identification and Information after Nuisance Projection

Empirical work often removes fixed effects, latent factors, or high-dimensional controls before estimating structural relationships. These transformations reduce confounding but may also remove identifying variation. We study linear panel IV after one equation-compatible nuisance projection under two-way dependence. The projected Jacobian determines which structural directions remain visible; the projected-score law determines their precision; and, on Gaussian fixed-rank strata, they combine in a Projected Information Matrix. We derive weak-identification limits with dimension-specific information accumulation, feasible factor-transfer conditions, identification-robust tests, bootstrap procedures for non-Gaussian interaction limits, and inference for the projected spectrum, rank, subspaces, and information matrix. Simulations show that a raw first-stage statistic above 500 can support the wrong sign while projected diagnostics reveal weak valid information. In an international monetary application, common projection substantially attenuates apparent foreign-output persistence, while Gaussian-reference Anderson–Rubin sets remain unbounded. Identification should therefore be assessed after nuisance removal.
Read the full abstract

Statistics Theory

Ranked spreadness and sample-based testing

In this note, we introduce the notion of ranked spreadness, a strengthening of the usual spread condition in which the elements of each member can be ordered so that their one-coordinate marginals decay geometrically with their rank. This additional structure removes the dependence on the maximum set size in random-containment estimates. We prove width-free hitting and weighted-concentration theorems for ranked-spread set systems, together with an elementary kernel-extraction theorem showing that ranked spreadness arises naturally in arbitrary distributions on small sets. Our main application is to the simulation of nonadaptive property testers by sample-based testers. If a one-sided tester has average query complexity $d$ and rejects every far input with probability at least $\delta$, then, for every integer $c>d/\delta$, it admits a one-sided sample-based simulation with expected sample complexity $O_{d,\delta,|\Sigma|}\bigl(n^{1-1/c}\bigr)$. More generally, if positive inputs are rejected with probability at most $\gamma$ and far inputs with probability at least $\delta>\gamma$, the same conclusion holds for every $c>d/(\delta-\gamma)$. In particular, for constant-query nonadaptive testers we obtain an exponent $1-\Theta(1/q)$, matching, up to the dependence on the rejection gap, the exponent conjectured by Fischer, Lachish, and Vasudev.
Read the full abstract

Statistics Theory · Cross-listed from math.PR

A Direct Route to Markov Chain Convergence via Asymptotic Equivalence with the Target

For a Markov kernel $T$ with an invariant probability measure $\pi$, we give a self-contained proof of the Markov chain convergence theorem via a criterion called asymptotic equivalence with the target. It assumes two parts about the Lebesgue decompositions of $T^n_x$ and $\pi$ for every starting point $x$: 1.) asymptotic absolute continuity: the singular mass $\mathrm{sing}(T^n_x \mid \pi)$ tends to $0$; and, 2.) asymptotic domination of the target: the singular mass $\mathrm{sing}(\pi \mid T^n_x)$ tends to $0$, as $n \to \infty$. Assuming a jointly measurable density for the absolutely continuous part of each iterate $T^n$ w.r.t. $\pi$, this criterion is sufficient and necessary for convergence. A positive minorant density version of it is verified in three cases: i.) $T$ has a positive transition density w.r.t. $\pi$; ii.) $T$ consists of an absolutely continuous part with positive transition density together with an atom at the starting point, which covers the Metropolis-Hastings algorithm; iii.) the transition density is positive only after a finite number of steps that may depend on the starting point $x$. To demonstrate our general criterion, we investigate the Gibbs sampler with random scan and the parallel tempering algorithm. Furthermore, we show that in all mentioned settings Birkhoff's ergodic theorem applies, so as to obtain the strong law of large numbers. Throughout this paper, neither irreducibility, nor aperiodicity, nor recurrence, nor couplings, nor splitting constructions, nor small sets are used. In all results, the state space is a general measurable space with no structure beyond a $\sigma$-algebra. That joint measurability is assumed of the Markov kernel, not of the space; countable generation supplies it. None of the theorems proved here is new; what is offered is a short route to a single, widely applicable Markov chain convergence criterion.
Read the full abstract

Statistics Theory · Cross-listed from math.PR

On the geometry of weak convergence without total variation convergence

We study some geometric consequences of the discrepancy between weak and total variation convergence of probability measures. We consider a sequence of probability measures on $\mathbb R^d$, admitting densities with respect to the Lebesgue measure, that converge weakly to a limiting measure but stay bounded away from it in total variation distance. We show that the sets on which the sequence passes from below to above the limiting density must grow unboundedly in perimeter, as measured by the $(d-1)$-dimensional Hausdorff measure. Moreover, this growth persists within a fixed compact set, so that it must reflect an increase in the geometric complexity of these sets rather than only an unbounded expansion in ambient space. We further provide a sufficient condition under which the number of connected components of the sets diverges, recovering a behavior that is closely reminiscent of the one-dimensional case, in which the number of oscillations of the sequence of densities around the limit grows without bound. We also show that this condition cannot be dispensed with in general, by means of an explicit sequence of measures in the plane whose passing sets remain connected in a single component at every stage while growing in length and complexity. Another sequence, built from cosine oscillations, illustrates the complementary behavior, in which the number of components diverges.
Read the full abstract

Statistics Theory

As Good as it Gets: Bounds for Oracle Time-Varying Treatment Strategies

Much causal inference research is focused on methods for optimizing dynamic treatment regimes (Murphy, 2003; Robins, 2004; Schulte et al., 2015), which are rules for deciding which treatments should be assigned and when based on evolving history. There is a certain optimism underlying this endeavor that with enough tinkering we might realize consequential improvements. Another strand of research, previously confined to the point exposure setting, considers bounds on how well any individualized treatment rule could possibly do. Here, we extend to the time-varying setting sharp bounds on the performance of an oracle strategy that selects the best treatment regime for each subject based on their unobserved potential outcomes or `response type'. For binary outcomes, the lower bound (assuming higher is better) is simply the expected outcome attained by the optimal treatment regime based on observed history. For continuous outcomes, the lower bound may strictly exceed the maximal observed covariate based value. In the continuous setting, we also consider bounds on the CDF of oracle continuous potential outcomes.
Read the full abstract

Statistics Theory

A Proof of the Convergence a Lipschitz Upper Confidence Bound

This document presents a proof of the estimation of a lipschitz parameter by constructing a consistent lower confidence bound through hypothesis test inversion. We prove that as the number of design points grows to infinity, the test correctly identifies any underestimated Lipschitz constant with asymptotic probability 1. The convergence proofs rely on a Uniform Law of Large Numbers and analyze discrepancy metrics under both bounded and unbounded replication sampling.
Read the full abstract

Monday 3 August

Statistics Theory · Cross-listed from econ.EM

Bandwidth-Free Inference for Recursive Nonlinear Impulse Response Functions

Recursive nonlinear impulse responses require an estimated innovation law whenever the impact shock is normalized by innovation ranks and future innovations are integrated out. The closest semiparametric recursive construction in the literature estimates the relevant innovation quantile functions smoothly and discusses a direct empirical-residual implementation without developing its complete first-order inference theory. We tackle this gap in a finite-dimensional nonlinear structural autoregression with unrestricted continuous marginal innovation distributions and a fixed normal-rank shock. Our estimator replaces each innovation quantile function with the empirical quantile of generated structural residuals and iterates the same structural transition. For any fixed collection of responses, we establish a joint \sqrt{T} asymptotic linear representation with four components: direct transition estimation, the effect of transition estimation on residual order statistics, ordinary innovation-quantile estimation, and the shifted impact quantile. After projection through the recursion, the quantile terms admit a residual-rank-and-spacing representation, yielding feasible inference without innovation-density estimation or quantile smoothing. We then characterize the propagated bias from smoothing, establish validity of a full recursive residual bootstrap, and derive the additional covariance contribution from a finite number of simulated paths, providing bandwidth-free inference for the empirical-residual version of the same normal-rank response used in the smooth recursive construction.
Read the full abstract

Statistics Theory · Cross-listed from stat.ME

Calibrated Bayesian Inference for Stochastic Intervention Effects

Causal inference increasingly extends beyond classical causal effects defined by deterministic treatment assignments, such as the average treatment effect, to stochastic intervention effects that can weaken positivity requirements and offer greater policy relevance. Nonparametric Bayesian models are attractive for estimating these effects due to their flexibility and inherent uncertainty propagation, but this posterior uncertainty need not be well calibrated for the causal effect of interest. We develop a simple post-processing correction that can be applied to posterior samples without changing the prior or fitting algorithm. We prove that, for a broad class of stochastic interventions, the corrected posterior yields asymptotically efficient inference and credible intervals with asymptotically valid frequentist coverage; formally, it satisfies a semiparametric Bernstein-von Mises theorem. The theory covers interventions specified independently of the observed treatment process, as well as interventions that modify it, including incremental propensity score interventions and a new power-tilt intervention. A central contribution is new theory for SoftBART, including conditions under which this flexible tree-based Bayesian model supports calibrated Bayesian inference for stochastic intervention effects. In simulations, the correction reduces bias and improves coverage relative to the uncorrected Bayesian analysis while remaining competitive with frequentist alternatives. We illustrate the method by estimating how expected LDL cholesterol would change under hypothetical increases or decreases in the odds of receiving statin therapy.
Read the full abstract

Statistics Theory

Spectral clustering of network time series via the sample covariance matrix

Spectral clustering for community detection is analysed in multivariate time series models whose dependence structure is determined by an unobserved stochastic blockmodel. We establish that spectral clustering of the sample covariance matrix achieves exact recovery of the underlying communities. The recovery rates depend explicitly on the network size, sample length, block separation, and degree of data dependence. This demonstrates that exact community recovery under a stochastic blockmodel is possible even when the adjacency matrix is unobserved. Our theory provides extensions of both classical and fine-grained matrix perturbation theory to the setting of dependent data, which may be of independent interest.
Read the full abstract

All authors Brendan Martin, Joshua Agterberg, Mihai Cucuringu, Alessandra Luati, Francesco Sanna Passino

Statistics Theory

Survival Isotonic Distributional Regression

We introduce Survival-IDR (S-IDR), a nonparametric estimator of conditional survival distributions under order restrictions, extending Isotonic Distributional Regression (IDR; Henzi et al., 2021) to right-censored outcomes. S-IDR has no tuning parameters and accommodates continuous, discrete, and partially ordered covariates. We first study the direct Kaplan-Meier adaptation of IDR: it is uniformly consistent at the minimax rate, but only when the conditional outcomes are hazard-rate ordered. We trace this restriction to the Kaplan-Meier estimator's failure to satisfy the Cauchy mean value property on non-i.i.d. samples, and use the diagnosis to construct S-IDR. The S-IDR estimator is uniformly consistent under only stochastic dominance of the conditional outcomes, attains the minimax rate when the smoothness of the conditional CDFs is known, and admits a known cross-threshold PAVA acceleration. We further embed S-IDR in a distributional single-index framework on a benchmark suite, and apply it in a case study that validates the MELD score used for liver-transplant wait list management. Accompanying R, Python and Rust packages are available at https://github.com/AlexanderHenzi/isodistrreg.
Read the full abstract

All authors Martin Bladt, Alexander Henzi, Bram van den Heuvel, Johanna Ziegel

Statistics Theory

Proper-score observation-driven filters: local geometry, estimation, and continuous-time limits

Observation-driven filters typically use likelihood-score updates, corresponding to the logarithmic scoring rule. We generalise these updates to negative parameter derivatives of differentiable proper scoring rules, under a declared working family and predictable scaling. The rule determines the conditional risk projection and tail response, scaling converts its derivative into the update, and the autoregressive component determines the composite dynamic centre. Locally, risk curvature and scaling govern mean reversion, while the variance of the scaled innovation governs update noise. Under correct specification, unscaled curvature and score variance coincide for the log score by the information identity, but generally differ for other proper rules. For static parameters, we establish consistency and asymptotic normality under explicit stability and fixed-tuning conditions. In high-frequency scale models, centred updates converge to diffusions, whereas non-centred updates follow deterministic mean flows. For time-varying rule-specific projections, the local tracking error admits an Ornstein-Uhlenbeck approximation up to a stopping time, allowing correlated update and target shocks. Simulations and an international-equity application illustrate how criterion choice affects robustness, adaptation, variance-forecast loss, value-at-risk calibration and probability-integral-transform diagnostics. Predictive density and updating criterion are distinct design choices whose relative performance depends on the target and disturbance.
Read the full abstract

Statistics Theory · Cross-listed from cs.IT

Tight Information Complexity of the Coin Problem in the Broadcast Model

We study distributed testing of $\mathrm{Ber}(\alpha)$ versus $\mathrm{Ber}(\beta)$ in the broadcast, or shared-blackboard, model. For protocols with constant advantage, we characterise up to universal constant factors the information complexity under either hypothesis for every pair $\beta<\alpha$. The characterisation shows that the two information costs can be quite different and identifies three parameter regimes, with optimal protocols based respectively on clean samples, a noisy binary symmetric channel, and an asymmetric $Z$-channel. The lower bounds rely on a novel mixed Hellinger–Jensen–Shannon inequality that may be of independent interest. We also characterise the constant-advantage information complexity of testing arbitrary discrete distributions via an optimisation problem over channels, and show that binary-output channels suffice. We obtain bounds for bounded likelihood-ratio distributions, and give general upper bounds in terms of $\chi^2$ divergence. As applications, we recover the broadcast-model set-disjointness lower bound, and derive stronger lower bounds in the multi-pass streaming setting for some problems considered in prior work.
Read the full abstract

Statistics Theory · Cross-listed from stat.ME

DAIF: A Data-Driven Intermediate Fusion Framework for Multimodal Supervised Learning via Approximate Message Passing

Multimodal supervised learning seeks to leverage multiple heterogeneous data sources to improve predictive performance. A central challenge is determining the fusion granularity across modalities: over-integration may amplify noise while under-integration fails to exploit cross-modal dependence. Existing approaches rely on pre-specified fusion architectures, from early to late fusion, that may not adapt to the underlying dependence structure among modalities. We propose DAIF, a data adaptive intermediate fusion framework that combines random matrix theory and non-parametric dependence measures to learn fusion structure directly from data. We operate under a Bayesian multimodal factor model where the prior on the latent factors determines the cross-modal dependence. Our method clusters modalities based on estimated intermodal dependence, then performs clusterwise empirical Bayes estimation of the priors. These estimated priors are used to construct denoisers within an approximate message passing (AMP) framework, yielding denoised low-dimensional features that borrow strength across related modalities while preserving modality-specific signal. The resulting embeddings are used for downstream supervised prediction. We evaluate the framework through simulations under varying dependence structures and signal regimes, comparing against several benchmark methods, and demonstrate its practical utility on two multimodal datasets, namely a trimodal TEA-seq dataset (Swanson et al., 2021) and TCGA-BRCA dataset (Goldman et al., 2020). In the first example, we predict the expression level of a T-cell differentiation marker protein and in the second case we analyze patient survival prediction based on multimodal information. Our method competes with or outperforms the state-of-the-art techniques in both prediction problems, demonstrating its versatility across diverse supervised learning tasks.
Read the full abstract

All authors Sagnik Nandy, Samriddha Lahiry, Pragya Sur, Subhabrata Sen