Statistics Theory
Entropy-Based Goodness-of-Fit Tests for Generalized $\kappa$ -Gaussian Distributions
Mehmet Siddik Cadirci and Konstantinos Zografos
We introduce this class of multivariate Kappa-Gaussian distributions by maximizing a type of Kaniadakis $\kappa$
entropy subject to certain first- and second-moment constraints. This differs slightly from the approach of Rényi and Tsallis, because the $\kappa$-
entropy arises from a relativity-consistent deformation of the exponential and logarithmic functions and yields a family of distributions whose tails follow a power law, a family that actually reverts to the standard Gaussian distribution as $\kappa \to 0$. We then create a $k$-nearest-neighbor (NN)
estimator for $\kappa$-
entropy and describe it using the difference between two NN functionals involving sums of powers. Next, we establish $L^2$-consistency and asymptotic normality, using the well-known subadditive Euclidean functional and moment expansion framework for NN
entropy estimators. Furthermore, using a scaling identity for the $\kappa$-exponential, we derive a closed-form formula for the
entropy of the $\kappa$-Gaussian distribution itself. From this, we determine the exact threshold value $\kappa < 2/(m+2)$ at which the distribution preserves finite variance; this is analogous to the “degrees of freedom $>2$” condition in the Student's-$t$ distribution. With these components, we construct a non-parametric goodness-of-fit test and then verify it through simulations. Finally, we mention the Sharma–Mittal
entropy, which combines the Rényi and Tsallis
entropies as a natural direction for future work.
Read the full abstract ▾
Statistics Theory · Cross-listed from cs.LO
Decoupling Evidence Sources in Paraconsistent Logic: A Generalized PAL2v Framework for Educational Assessment
Arthur Nakamura, David Drummond, Welbert Pereira et al. (+2 more)
Paraconsistent Annotated Logic with two values (PAL2v) annotates a proposition with a pair $(\mu,\lambda)$ of degrees of favorable and unfavorable evidence, drawn from a bilattice whose four extreme points are the values of Belnap and Dunn. In applications, however, the second coordinate is almost always taken to be the complement of the first, and several such annotations are then fused. We show that this practice determines the sign of the degree of contradiction in advance, independently of the data: for aggregation functions $F$ and $G$ the fused degree of contradiction equals $F-G^{d}$, where $G^{d}$ is the De Morgan dual of $G$, so that it vanishes identically when the two are dual, and has a constant sign otherwise. In particular the componentwise minimum used throughout the literature yields only consistent annotations, and the conjunction of annotated logic only exact ones; five of the twelve logical states, contradiction among them, are essentially unreachable by construction. We also give a decision procedure for the twelve states that is provably total, in place of the inequality lists in current use, which assign two states to about half of the non-extreme region. We then propose a construction in which the two coordinates are computed from disjoint families of evidence, show that every logical state is attainable. Educational assessment provides a natural instance, since summative and formative instruments are institutionally distinct: mapping examinations to $\mu$ and disengagement to $\lambda$ makes the degree of contradiction equal to the gap between what a student demonstrates and what that student invests. Simulations over three cohort profiles illustrate the classification.
Read the full abstract ▾
All authors Arthur Nakamura, David Drummond, Welbert Pereira, Gustavo Lahr, Kaique Matias de Andrade Roberto
Statistics Theory
Central limit theorems and bootstrap for sparse regularized multimarginal optimal transport and barycenters
Pengtao Li, Alberto González-Sanz and Xiaohui Chen
Wasserstein barycenters are a fundamental tool for the analysis of distribution-valued data, but their computation and statistical analysis become challenging in high-dimensional and multi-sample settings. The unregularized barycenter problem is computationally demanding and suffers severely from the curse of dimensionality, making regularization essential in many applications. While regularized optimal transport methods are widely used, approaches based on entropic penalization tend to overspread mass and may blur the
geometric structure of the solution. Motivated by barycenter estimation, we propose a more general methodology based on sparse regularized multimarginal optimal transport (RMOT). Our formulation creates sparse transport plans and is designed to avoid this overspreading effect. We establish consistency, central limit
theorems, and bootstrap validity for the optimal potentials and couplings for the empirical RMOT problem. Specializing to sparse regularized barycenters, our results yield a uniform weak limit and bootstrap consistency. Numerical simulations show that sparsity plays a fundamental role in preserving the structure of the solution and avoiding the overspreading behavior typical of entropic regularization.
Read the full abstract ▾
Statistics Theory · Cross-listed from math.PR
The anisotropic local law for sample covariance matrices under quadratic-form concentration
Renyuan Ma and Theodor Misiakiewicz
We study sample covariance
matrices $K = \frac{1}{N} \sum_{i=1}^N \mathbf{x}_i \mathbf{x}_i^* \in \mathbb{R}^{n \times n}$ in the proportional regime $n \asymp N$. The columns $ \mathbf{x}_1, \ldots, \mathbf{x}_N \in \mathbb{R}^n$ are independent and centered, with common covariance $\mathbb{E} \mathbf{x}_i \mathbf{x}_i^* = \Sigma$, but may otherwise have strongly and nonlinearly dependent coordinates. Assuming only that quadratic forms of the columns concentrate uniformly at the optimal rate $| \mathbf{x}_i^* A \mathbf{x}_i - \mathrm{Tr} \Sigma A | \prec \| A \|_F$, together with
polynomial norm moments and a standard nondegeneracy condition on $\Sigma$, we prove the optimal anisotropic local law: on regular spectral domains, uniformly down to spectral scales $\eta:= \mathrm{Im}\, z \geq N^{-1 + \tau}$, \[ \big| \langle \mathbf{u} , \big( (K-z)^{-1} - (-zI_n-z\widetilde m_0(z)\Sigma \big)^{-1} \big) \mathbf{v} \> \big| \prec \sqrt{\frac{\mathrm{Im}\, \widetilde m_0 (z)}{N\eta}} + \frac{1}{N\eta} \] for all deterministic unit vectors $ \mathbf{u}, \mathbf{v} \in \mathbb{C}^n$, where $\widetilde m_0(z)$ is the Stieltjes transform of the deformed Marchenko-Pastur law. This removes the higher-cumulant tensor assumption of Fan, Ma, Paquette, and Wang (2026), thereby answering the question raised in their work. The result applies, among other examples, to every centered log-concave column distribution with bounded, nondegenerate covariance, nonlinear tilts of Gaussian vectors, deep random features, and a high-temperature spherical 4-
spin model for which the cumulant assumption is known to fail.
Read the full abstract ▾
Statistics Theory
MiNCE: Nonparametric, Strongly Consistent Confidence Envelopes for Band-Limited Functions and their Smoothed Spectra
Balázs Csanád Csáji and Bálint Horváth
Minimum-norm confidence envelope strategies offer a nonparametric approach to constructing nonasymptotic, simultaneous confidence regions for band-limited functions, exploiting the theory of Reproducing Kernel
Hilbert Spaces (RKHS). While the finite-sample coverage guarantees of these envelopes have been established, their consistency has not been analyzed so far. In this paper, we study this construction, here termed the Minimum-Norm Confidence Envelope (MiNCE) framework, and establish the strong uniform consistency of the resulting bands, both for noise-free and noisy observation models, under mild assumptions on the measurement noises. We further extend this formulation to the frequency domain, deriving nonasymptotic, simultaneous, strongly uniformly consistent confidence bands for the smoothed spectra. Numerical experiments in nonparametric regression and spectral estimation empirically confirm our theoretical results, illustrating the contraction of the confidence envelopes toward the target function as the sample size increases.
Read the full abstract ▾
Statistics Theory · Cross-listed from cs.IT
On the Sequential Test and Distributed Detection
Earnest Akofor
We present a simple definition of stopping time and its role in the formulation of sequential tests for both centralized and distributed detection, providing a straightforward procedure for obtaining optimal decision rules. Upper bounds for optimal stopping time are derived and numerically shown to possess certain qualitative features expected of the optimal stopping time. The results are extended to any distributed detection network in the form of an acyclic directed graph.
Read the full abstract ▾
Statistics Theory
Sieve Estimation of Optimal Transport Maps from Paired Data in Gaussian Spaces
Xin Jin, Kit Chan and Riddhi Pratim Ghosh
We study the estimation of infinite-dimensional optimal transport maps from noisy paired observations. The population map pushes a Gaussian reference measure forward to a target probability measure on a function space and takes the Cameron–Martin gradient form $T=I+\nabla_{\mathcal H}\phi$. Our
estimator uses cylindrical gradient sieves based on finitely many Cameron–Martin coordinates, thereby reducing the problem to finite-dimensional empirical risk minimization. A local nonasymptotic oracle inequality separates cylindrical approximation and statistical estimation errors while accounting for the conditioning of the parametrization. The approximation analysis relies on regularity conditions governing coordinate decay and dependence on omitted input coordinates. For diagonal Gaussian and nonlinear block-interaction classes, we derive matching upper and lower bounds that establish the minimax rate $N^{-s/(2s+1)}$ in expected norm, where $s$ measures weighted coordinate regularity. We further analyze a continuous two-groups model with Gaussian–Laplace mixtures and derive a prediction-risk bound for the resulting transport-map
estimator.
Read the full abstract ▾
Statistics Theory · Cross-listed from math.NA
Quadratic Point Estimate Method for Uncertainty Quantification with Dependent Non-Gaussian Inputs
Minhyeok Ko and Konstantinos G. Papakonstantinou
As an extension of the Point Estimate Method (PEM) to evaluate probabilistic moments of quantities of interest (QoI) in general $n$-dimensional spaces, the Quadratic Point Estimate Method (QPEM) has been recently developed. This new method is defined to fully represent up to fifth-order input moments in the Gaussian space, providing general analytical expressions for sample locations and weights, without requiring any numerical optimization. The QPEM can significantly improve the estimation accuracy of the output QoI moments, in relation to PEM-based methods whose numbers of sigma points grow linearly with the problem dimension, while at the same time having an affordable and competitive computational cost up to a considerable number of dimensions. The QPEM is further enhanced in this work by enabling copula integration into the framework, which enables effective modeling of the joint input probability density function by estimating marginals and the dependence structure of the involved random variables. The validity and efficient performance of the copula-based QPEM are showcased against numerous other sampling methods in various examples considering two practical scenarios: (i) when the joint dependence structure can be inferred from data, and (ii) when only marginal distributions and correlation
matrices are known.
Read the full abstract ▾
Statistics Theory · Cross-listed from cs.DS
High-Magnetization Sampling at Low Temperatures: Ising Models and Bayesian Sparse Linear Regression
Syamantak Kumar, Purnamrita Sarkar, Kevin Tian et al. (+1 more)
Sparsity is a powerful structural resource in optimization and statistics. We develop frameworks for leveraging sparsity in sampling problems over the Hamming slice $\mathcal{X}_k^d:=\{\mathbf{x}\in\{\pm 1\}^d:|\{i:\mathbf{x}_i=1\}|=k\}$, in high-dimensional regimes where $k\ll d$ (i.e., where $\mathcal{X}_k^d$ is highly magnetized). We use our frameworks to design improved samplers for canonical problems in the study of Ising models and
Bayesian sparse linear regression. Our first main result considers the Sherrington–Kirkpatrick (SK) model restricted to fixed-magnetization slices $\mathcal{X}_k^d$. We give a
polynomial-time sampler for fixed-magnetization SK models at any inverse temperature $\beta>0$, under arbitrary external fields, provided that $k\le c_\beta d$ for an appropriate constant $c_\beta$. By combining this result with an annealing strategy for estimating normalizing constants, we obtain
polynomial-time samplers for the SK model at arbitrarily low temperatures under a sufficiently strong external field of strength $h$. In the large-$\beta$ limit, our framework permits sampling at field strengths within constant factors of the Almeida–Thouless line delineating the replica-symmetric and replica-
symmetry-breaking regions ([dAT78]), improving polynomially over the field strength $h(\beta)$ required by the recent work of [BAR26]. Our second main result concerns the measurement complexity of
polynomial-time
Bayesian sparse linear regression. Recent work by [KSTZ25] shows how to sample from the canonical Gaussian spike-and-slab posterior with expected sparsity $k$, at any signal-to-noise ratio, given $n\gtrsim k^3\log^3 d$ Gaussian measurements. We improve this requirement to $n\gtrsim k^{3/2}\log^2 d+k\log^3 d$, using a common sparsity-aware framework underlying both our results.
Read the full abstract ▾
All authors Syamantak Kumar, Purnamrita Sarkar, Kevin Tian, Yusong Zhu
Statistics Theory
Risk Equivalence between RKHS Regression and Sequence Models for Lipschitz Spectral Algorithms
Yicheng Li, Yuqian Cheng, Zhuo Chen et al. (+1 more)
Kernel spectral
algorithms are often summarized by convergence rates, which hide how their risk depends jointly on regularization, noise, the population spectrum, target coefficients, and the chosen filter. Gaussian sequence models arise as a simplified but characteristic setting for studying the interplay of these factors, where the kernel spectral
algorithm corresponds to a coordinatewise shrinkage
estimator. Under mild assumptions, we show that the risk of a kernel spectral
estimator is asymptotically equivalent to that of the corresponding Gaussian sequence model
estimator with the same filter. The explicit sequence model risk then yields a full characterization of the risk of kernel spectral
algorithms in terms of the population spectrum, target coefficients, and filter. We establish this equivalence for a broad class of spectral filters, covering kernel ridge regression, generalized ridge regression, iterated kernel ridge regression, gradient flow, stable gradient descent, smoothed spectral cutoff, spectral clipping, and Pinsker shrinkage. Our risk equivalence not only holds in the classical fixed-dimensional regime but also applies to the high dimensional regime where the input dimension scales with the sample size. As applications, our risk equivalence recovers the minimax upper rates, and establishes the exact Pinsker constant in RKHS regression.
Read the full abstract ▾
All authors Yicheng Li, Yuqian Cheng, Zhuo Chen, Qian Lin
Statistics Theory
Improved Variance Estimation in Homoskedastic Nonparametric Random-Design Regression via a Two-Scale Approach
Edgar Dobriban, Rajarshi Mukherjee, James M. Robins et al. (+1 more)
We study estimation of a constant conditional variance $\sigma^2$ in nonparametric regression with a $d$-dimensional random design. This is an important problem, and similar questions arise in causal inference. The regression function is $\beta_b$-Hölder smooth, the design density is $\beta_g$-Hölder smooth and bounded above and away from zero, and we consider the nonparametric regime $\beta_b>1$ and $d>4\beta_b$. Set $\beta_g^\star=\beta_b(1-4\beta_b/d)/\{1+2\beta_b/d+8(\beta_b/d)^2\}$. We give an
estimator whose mean squared error is upper bounded by $Cn^{-4(\beta_b+1)/(d+4)}$ in the low-regularity regime when $0<\beta_g\leq\beta_g^\star$. The low-regularity branch is based on a new two-scale construction: the
covariate space is partitioned into
cells, the local
polynomial trend is projected out within each suitable
cell, and the squared normalized contrast from one eligible close pair per
cell is averaged across
cells. In the high regularity regime when $\beta_g>\beta_g^\star$, a higher-order influence function
estimator of Robins, Li, Tchetgen Tchetgen, and van der Vaart (2008) provides the rate $Cn^{-8\beta_b/(d+4\beta_b)}$. We also give an all-pairs ridge extension, which achieves the same two-scale rate, and evaluate the methods alongside a range of existing
estimators in simulations.
Read the full abstract ▾
All authors Edgar Dobriban, Rajarshi Mukherjee, James M. Robins, Zixiao Wang
Statistics Theory · Cross-listed from quant-ph
Uniqueness, Cramér-Rao Efficiency and Concentration Bounds for Quantum U-Statistics
Ayanava Dasgupta, Naqueeb Ahmad Warsi and Premanshu Chatterjee
We study unbiased estimation of scalar-valued
polynomial functionals of
quantum states from independent copies. We establish an equivalence between the first-order marginal of a permutation-invariant finite-copy observable and the functional gradient. We then prove that, among unbiased permutation-invariant
estimators, the
quantum U-statistic is the unique extension to an arbitrary number of copies. We further derive a universal variance expansion in which the leading $1/n$ term is determined by the variance of the functional gradient, while higher-order contributions are of order $O(1/n^2)$. This leading variance coincides with the multiparameter
quantum Cramér–Rao limit, establishing asymptotic efficiency of
quantum U-statistics. We also characterize the higher-order scaling at points where the variance of the first-order gradient vanishes. As an application, we analyze the Bures $\chi^2$-divergence and show that a spectral lower bound on the reference state is sufficient but not necessary for bounded-variance estimation. Beyond asymptotic variance, we establish variance-sensitive exponential concentration bounds, deriving a closed-form Bernstein-type inequality to capture finite-sample tail behaviour, and establish the Moderate Deviation Principle to characterize the intermediate asymptotic regime.
Read the full abstract ▾
Statistics Theory · Cross-listed from stat.ML
Non-Adaptive 1-Bit Mean Estimation: Minimax Rates and the Sample-Interval Tradeoff
Ivan Lau and Jonathan Scarlett
We study distributed one-dimensional mean estimation under a 1-bit communication constraint. Each
agent observes one sample, drawn independently from an unknown distribution, and returns a single bit in response to a query $Q: \mathbb{R}\to\{0,1\}$ chosen by a central learner. The distribution has mean in $[-\lambda,\lambda]$ and $k$-th central moment at most $\sigma^k$, for a fixed $k>1$. The order-optimal two-stage protocol of Lau and Scarlett uses responses from the first batch to choose the second-batch queries, motivating the question of whether this single round of interaction is necessary. We answer this negatively: for every $k>1$, a non-adaptive protocol attains the adaptive 1-bit minimax rate (and concurrent works reached the same conclusion via different strategies). We further determine the minimax sample complexity among non-adaptive 1-bit
estimators when every one-set $Q^{-1}(1)$ is restricted to a union of at most $s$ intervals. Relative to unrestricted non-adaptive 1-bit querying, this constraint adds a term of order $(\lambda\sigma/(s\varepsilon^2))\log(1/\delta)$, giving the full tradeoff between sample complexity and interval complexity to within $k$-dependent constant factors. As a corollary, we identify, order-wise, the minimum interval budget needed to retain the unrestricted 1-bit minimax sample rate.
Read the full abstract ▾
Statistics Theory
Statistical Inference for Additive Monotone Models under the Fixed Lattice Design
Huachen Ren
We study statistical inference for least squares
estimators (LSEs) in additive monotone models under a general fixed
lattice design. We establish joint limiting distributions for the LSEs and show that the
estimators of different additive components are asymptotically independent. The form of the limiting distribution of each component is determined by how fast the number of design points along the corresponding coordinate grows relative to the total sample size n. Apart from this growth rate, the limit depends only on the noise level and, in the non-Gaussian regimes, on the local derivative of the component. In particular, the limit does not depend on the dimension of the model. When the number of design points along a coordinate grows faster than n^(1/3), we construct tuning-free pointwise confidence intervals based on a pivotal limiting distribution, and we validate the theory in numerical simulations. We further show that the block-size normalization underlying these intervals fails to be pivotal at the critical growth rate n^(1/3). We also prove a switching lemma, of independent interest, that simplifies the derivation of limiting distributions in isotonic regression.
Read the full abstract ▾