Information Theory · Cross-listed from math.PR
Thinning Operation via the Poisson-Föllmer Process
Ioannis Kavvadias
We give an alternative proof of Yu's Thinning Lemma and of the Law of Thin Numbers using a
stochastic variational formula for the relative
entropy. We show that this approach yields new convergence rates for the Law of Thin Numbers, complementing and extending previously known results.
Read the full abstract ▾
Information Theory · Cross-listed from math.AG
Hulls, linear equivalence, and weighted superelliptic codes
Jurgen Mezinaj and Tanush Shaska
The containment of the code of the meet $G\wedge A$ in the hull and the identity $G\vee A-D=K-G\wedge A$ exchanging meet and join are known; imposing that $G\wedge A$ be principal constructs algebraic geometry codes with one-dimensional hull. We turn that construction into a measurement. For arbitrary divisors $G$ and $A$ we compute $C_L(D,G)\cap C_L(D,A)$ exactly: it is the code of the meet together with an excess $\varepsilon(G,A)$, canonically their quotient and a subquotient of $H^1(\mathcal O(G\wedge A))$. So $\varepsilon$ vanishes exactly when the meet is non-special; otherwise it certifies that $K-G\wedge A$ is linearly equivalent to an effective divisor, at degree zero the vanishing of a single class in the Picard group: the hull detects a linear equivalence rather than being built from one. For superelliptic curves $y^n=f(x)$ both sides can be computed: their weighted plane models in $\mathbb P^2_{(1,n/c,d/c)}$, $c=\gcd(n,d)$, identify codes $C_s$ of weighted forms of degree $s$ with those of $sD_\infty$ and turn hulls into
lattice counts. The range on which $\varepsilon$ is blind is an explicit interval of degrees, where $\dim\operatorname{Hull}(C_s)=c\mu(s)-n\delta+1-g_X$, $\mu(s)=\min\{s,M-s\}$, depends only on its affine-point count. Outside it the meet and join are invariant under $s\mapsto M-s$ while $\varepsilon$ is not, so every asymmetry of the hull profile is excess and the threshold in $s$ refines the divisor class: two totally split curves of genus two, over $\mathbb F_7$ and over $\mathbb F_{11}$, present the same class at the same pair of degrees and are separated by the profile alone. If $0\leq\deg(G\wedge A)\leq2g_X-2$ the hull is at most $g_X+1$, so it is large only where it is blind, and over a
prime field, under an explicit inequality on $(n,d,q)$, its maximum over the family is $\ell(\lfloor M/2\rfloor D_\infty)$, attained exactly on the totally split locus.
Read the full abstract ▾
Information Theory
Tight Information Complexity of the Coin Problem in the Broadcast Model
Hadi Kazemi and Varun Jog
We study distributed testing of $\mathrm{Ber}(\alpha)$ versus $\mathrm{Ber}(\beta)$ in the broadcast, or shared-blackboard, model. For protocols with constant advantage, we characterise up to universal constant factors the information complexity under either hypothesis for every pair $\beta<\alpha$. The characterisation shows that the two information costs can be quite different and identifies three parameter regimes, with optimal protocols based respectively on clean samples, a noisy binary symmetric channel, and an asymmetric $Z$-channel. The lower bounds rely on a novel mixed Hellinger–Jensen–Shannon inequality that may be of independent interest. We also characterise the constant-advantage information complexity of testing arbitrary discrete distributions via an optimisation problem over channels, and show that binary-output channels suffice. We obtain bounds for bounded likelihood-ratio distributions, and give general upper bounds in terms of $\chi^2$ divergence. As applications, we recover the broadcast-model set-disjointness lower bound, and derive stronger lower bounds in the multi-pass streaming setting for some problems considered in prior work.
Read the full abstract ▾
Information Theory
Speculative Successive Cancellation Decoding of Polar Codes
Ryan Seah, Marvin Rübenacke and Warren J. Gross
Polar codes achieve channel capacity as block length increases, but this asymptotic advantage comes at the cost of decoding speed: the conventional successive cancellation (SC)
algorithm is inherently sequential, which limits its practicality for high-throughput applications. This work addresses that limitation by introducing the Speculative Successive-Cancellation (Spec-SC) framework, which incorporates speculative execution into the SC decoding process. While node-based decoders with special nodes enable partial parallelism for specific, predefined structures, Spec-SC extends this capability by permitting parallel execution in general nodes that do not match any special-node pattern. A built-in verification mechanism ensures that this speculation does not compromise decoding correctness. Simulation results show that Spec-SC achieves identical BER and FER performance to standard SC decoding, while reducing the average number of sequentially traversed nodes by up to $69\%$ for a polar code of length $N=4096$. These results demonstrate that Spec-SC enables additional
algorithm-level parallelism beyond what special-node approaches alone can achieve, paving the way for speculative hardware decoder implementations.
Read the full abstract ▾
Information Theory · Cross-listed from quant-ph
A Unified Complexity Framework for Quantum Property Testing
Qisheng Wang
We develop a unified framework for analyzing the complexity of
quantum property testing through functionals of the form $\mathcal{L}_{\phi}(\rho) = \operatorname{tr}(\phi(d\rho))/d$, where $\rho$ is an unknown $d$-dimensional
quantum state and $\phi$ is a given function. A master
theorem is established that derives sample complexity lower bounds for estimating $\mathcal{L}_\phi(\rho)$ from properties of $\phi$, combining Haar-random moment encoding with moment matching and best
polynomial approximation. Corresponding query complexity lower bounds follow from
quantum sample-to-query lifting. The framework yields nearly tight bounds for a broad class of problems, including
entropy estimation (von Neumann, Rényi, and Tsallis), closeness estimation (trace distance and Uhlmann fidelity), spectrum estimation, rank testing (operator rank, Schmidt rank, and
matrix product states). Combined with known upper bounds, these results resolve several open problems and establish the optimality of 31
quantum algorithms since 2015, up to polylogarithmic factors.
Read the full abstract ▾
Information Theory · Cross-listed from cs.GT
House-monotone multi-level apportionment has logarithmic quota discrepancy
Lav R. Varshney
Multi-level apportionment allocates integer seats through a hierarchy of groups. Schmidt-Kraepelin, Suksompong, and Wijaya proved that, at every fixed house size, lower and upper quota can be satisfied simultaneously; they also constructed house-monotone rules satisfying either quota separately. They left open whether one rule can satisfy lower quota, upper quota, and house monotonicity together, even when quota is required only relative to the root. We give a negative answer. For a full binary comb with $D$ equally entitled leaves, every house-monotone allocation sequence induces a sequence of seat recipients. Quota for the nested comb groups would force every grid-aligned prefix discrepancy to be below one. A midpoint
embedding then bounds the full interval discrepancy by this quantity plus $1/2$, contradicting Schmidt's logarithmic lower bound. Conversely, a binary van der Corput seat schedule has comb-prefix error at most $\log D/(3\log 2)+1$. Thus the optimal worst-case error on the comb is $\Theta(\log D)$, and for sufficiently large finite $D$ no house-monotone quota rule exists. The proof isolates a static–dynamic gap: each house size admits a quota-feasible allocation, but the feasible allocations cannot be embedded into one monotone path. In quantization
language, the result characterizes the order of the embedded-quantization penalty for progressive one-hot rounding on the comb.
Read the full abstract ▾
Information Theory · Cross-listed from stat.ML
Interaction Is Not Necessary for Order-Optimal 1-Bit Mean Estimation
Jiachen Hu and Han Zhong
This paper is concerned with one-bit mean estimation, where each independent sample is represented by a single binary message. We consider distributions on $\mathbb{R}$ with mean in $[-\lambda,\lambda]$ and absolute $k$-th central moment at most $\sigma^k$, where $k>1$ is fixed. For this class, previous work attained the optimal sample complexity for general queries using a two-stage protocol. The first stage localizes the mean. The second-stage queries are chosen after localization and refine the estimate around the decoded center. We show that this interaction can be avoided by constructing a randomized fully non-adaptive protocol that fixes all queries before observing the data and matches the optimal adaptive sample complexity. For target accuracy $\epsilon$ and confidence $1-\delta$, its sample complexity scales as \[ \log\frac{\lambda}{\sigma} + \begin{cases} (\sigma/\epsilon)^2\log(1/\delta), & k>2,\\ (\sigma/\epsilon)^2\log(\sigma/\epsilon)\log(1/\delta), & k=2,\\ (\sigma/\epsilon)^{k/(k-1)}\log(1/\delta), & 1<k<2, \end{cases} \] up to constants depending only on $k$. In the range covered by the known lower bound, this rate is minimax optimal even among fully adaptive protocols. This gives a negative answer to the COLT 2026 open problem asking whether interaction is necessary for order-optimal one-bit mean estimation with general queries \citep[Open Problem~1]{lau2026open}.
Read the full abstract ▾
Information Theory · Cross-listed from math.ST
Beyond Modern Asymptotics for Log-Likelihood Ratios in Logistic Regression
Hugo Chardon, Reese Pathak and Nikita Zhivotovskiy
We characterize the finite sample behavior of the log-likelihood ratio statistic in binary logistic regression, uniformly over both the design and the target parameter. For $n\geq d\geq 3$, we determine, up to universal constants, its worst case $(1-\delta)$
quantile over all fixed collections of design vectors and all target parameters: \[ d\log\left(\frac{e n}{d}\right)+\log\left(\frac{1}{\delta}\right). \] This is a nonasymptotic analogue of the Wilks $\chi^2_d$ phenomenon and requires no regularity assumptions on the design. The low dimensional cases exhibit unusual behavior. The worst case
quantile in dimension $d=2$ is sharply of order \[ \log\log\log n+\log\left(\frac{1}{\delta}\right). \] The worst case
quantile in dimension $d=1$ is of order $\log(1/\delta)$, with no dependence on $n$. Finally, i.i.d. Gaussian design vectors recover the classical Wilks scale. In the regime $n\gtrsim d+\log(1/\delta)$, we prove the sharp bound \[ d+\log\left(\frac{1}{\delta}\right). \] Unlike existing asymptotic results, our bounds are uniform over the target parameter, which may depend on $n$, $d$, and $\delta$.
Read the full abstract ▾
Information Theory
PhaseLift for Coded Diffraction Patterns: Optimal Sampling Rate
Gao Huang and Song Li
Recovering a complex-valued signal from coded diffraction patterns, namely the
Fourier intensities obtained after modulating the signal with a collection of masks, is a fundamental structured phase
retrieval problem arising in diffraction imaging and related applications. Despite its practical importance, the theoretical analysis of this structured framework remains scarce. In the standard random mask model, the optimal sampling rate achievable by computationally tractable recovery methods has remained open. In this paper, we establish the optimal sampling rate for the PhaseLift feasibility program. More precisely, PhaseLift achieves exact recovery of an unknown signal $\pmb{x}_0\in\mathbb{C}^n$, up to a global phase, from $\mathcal{O}(\log n)$ random masks, with polynomially decaying failure probability. Since $\Omega(\log n)$ masks are necessary to identify certain signals under the erasure mask ensemble, our result thereby achieves the optimal mask complexity. Equivalently, PhaseLift attains the optimal total sampling rate of $m=\mathcal{O}( n\log n)$ scalar intensity measurements. The proof is based on an approximate dual certificate construction via a refined golfing scheme that combines adaptive mask allocation with a dimension-independent truncation threshold.
Read the full abstract ▾
Information Theory
Minimum Distances of Binary Goppa Codes and Constructions with Prescribed Alternating Automorphism Groups
Tianni He, Kangquan Li and Longjiang Qu
Goppa codes are a well-known class of linear codes with important applications in cryptography. Determining the minimum distance of Goppa codes and constructing Goppa codes with prescribed automorphism groups are both meaningful and challenging problems in coding theory. In this paper, we first study the minimum distance of binary separable Goppa codes. For the two classes $g(X)=f(X^t)$ and $g(X)=A(X)h(\phi(X))$, we give criteria for attaining the designed distance and derive several infinite families whose minimum distances are determined. We then construct binary Goppa codes and their related codes with $A_4$ or $A_5$ automorphism groups. These constructions also naturally yield binary quasi-cyclic Goppa codes and their related codes. Moreover, by applying the minimum-distance criteria developed above, we determine the parameters of one class of the constructed $A_4$-invariant Goppa codes.
Read the full abstract ▾
Information Theory · Cross-listed from cond-mat.dis-nn
Bayesian Inference with Structured Signal: Static Replica Symmetry Breaking on the Nishimori Line in the Planted Spin Glass
Andrea Vincenzo Dell'Abate and Louise Budzynski
A common assumption in theoretical models of
Bayesian inference is that the signal has i.i.d. components. To study the effect of correlations in the signal prior, we consider a minimal model: the planted
spin glass on random regular graphs, where the signal is sampled from an Ising model with coupling $\kappa$. Depending on the phase of the prior, we find that adding structure in the signal can either help or hinder inference. In the paramagnetic regime, correlations in the signal lower the reconstruction threshold, so that weaker signal strength is sufficient for recovery. In the ferromagnetic regime, the prior alone already enables partial recovery, and we identify the threshold above which the observations provide additional information. When the prior itself is in a replica
symmetry breaking (RSB) phase, we detect a static RSB transition in the posterior under Nishimori conditions. This provides an example where a non-separable, correlated prior leads to static RSB in a Bayes-optimal inference problem. We discuss the consequences of this glassy phase for algorithmic performance, in particular for Belief Propagation.
Read the full abstract ▾
Information Theory
A Spatio-Temporal Model for Information Freshness in Massive Random Access
Andrea Munari, Alessandro Buratto, Federico Chiariotti et al. (+2 more)
Massive connectivity, a key building block of 5G, is expected to play an important role in the next generation of wireless systems, and its expected requirements are being revolutionized through the modeling of the information dynamics related to the vast numbers of Internet of things (IoT) devices. Motivated by this, the present paper introduces a model that captures the spatio-temporal nature of freshness of information sent via random access channel policies from an extremely large set of IoT devices via simple scalar parameters, i.e., the probability of success and accuracy of received updates. There are many information freshness metrics, starting from the age of information (AoI), all of which are proxies for the actual application performance, characterized over the temporal dimension. Our model adds the spatial dimension to this picture, observing that sensors distributed over the same area may have a strong correlation, and information from multiple close-by sensors may improve the overall accuracy of the receiver. We focus on characterizing the uncertainty of the receiver, expressed through the conditional
entropy, considering a network of partially reliable, spatially distributed sensors observing the same process and reporting their measurements over a slotted ALOHA channel. We consider a simple forgetful receiver and a more complete model which accounts for the full history of past observations, deriving their performance, and optimizing the transmission probability of nodes to minimize the expected uncertainty.
Read the full abstract ▾
All authors Andrea Munari, Alessandro Buratto, Federico Chiariotti, Leonardo Badia, Petar Popovski
Information Theory
Open-Loop Transmission with Discrete Blocklengths: Characterization of AoI-Optimal Schedules
Mojan Wegener and Eduard A. Jorswieck
In this paper, we consider a general status update system, consisting of a source at which a physical process is monitored and a receiver. For transmission of status updates, a discrete set of blocklength error probability tuples is available. A typical example is a communication system with a fixed set of modulation and coding schemes. We assume that no feedback channel for acknowledgments exists and thus investigate the problem of constructing deterministic schedules for the status updating system. The average Age of Information (AoI) and average exponential AoI are appropriate performance metrics to capture the freshness of information. Interestingly, a static blocklength is shown to be suboptimal in general. While for the average AoI the gains that can be achieved by using a non-trivial periodic schedule are relatively small, they are significant for the average exponential AoI. Motivated by this, we prove conditions for single-blocklength optimality when two blocklengths are available. To achieve this, we use a Dinkelbach-like approach to reformulate the problem as an infinite-state transient average-cost Markov Decision Process and apply careful bounding techniques to derive the optimality conditions. As a converse, we analyze stationary randomized policies to certify the parameter regions where a non-trivial deterministic schedule outperforms the best constant schedule. Extensions to the case with more than two transmission lengths are provided. Numerical results show that the derived conditions cover a large portion of the parameter space and suggest that the optimality conditions for a constant schedule with the shorter blocklength, while sufficient, may also be necessary. As an example, we apply the results to the problem of age-optimal transmission with a small LDPC codebook, which illustrates the practical applicability.
Read the full abstract ▾
Information Theory
CARNet: Channel-Adaptive Receiver Network for Robust NextG Communications
Chao Jiang, Zhuo Xu and Yongli Yan
Neural receivers have been recognized as a promising paradigm for the next-generation (NextG) communications. However, due to the reliance on a static network optimized for specific channel conditions, their generalization capability across diverse scenarios remains a significant challenge. To address this issue, this paper proposes a novel channel-adaptive neural receiver network (CARNet) based on the mixture-of-experts (MoE) framework. The proposed architecture employs multiple expert networks together with an efficient routing mechanism to enable signal detection in various scenarios. The experts are constructed via stacked ResNet blocks and specialize in robust signal detection within specific channel conditions, while the routing mechanism incorporates a lightweight representation learning module, which projects the coarse channel estimate into a low-dimensional latent
embedding. The learned
embedding characterizes task-relevant channel conditions and provides efficient guidance for accurate expert selection. Link-level simulation experiments demonstrate that the proposed CARNet achieves superior performance across diverse channel conditions.
Read the full abstract ▾
Information Theory
Movable Subarray-Aided ISAC in Hybrid Near-Far Field Channels
Ruiqi Liu, Yuanshuo Gang, Honghao Wang et al. (+1 more)
This letter investigates an integrated sensing and communication (
ISAC) system aided by movable subarrays (MSAs) using a hybrid near-far field channel model. The sensing target and communication users are assumed to lie in the near field of the overall MSA aperture but in the far-field region of each subarray. Accordingly, a hybrid near-far field channel model is established, and the equivalent Fisher information
matrix and Cramér-Rao bound (CRB) for joint range, elevation, and azimuth estimation are derived. The transmit beamforming
matrix and subarray positions are jointly optimized to minimize the trace CRB subject to minimum communication signal-to-interference-plus-noise ratio (SINR), maximum transmit power and subarray movement constraints. An alternating optimization
algorithm is developed combining iterative rank-one-penalized semidefinite relaxation with projected finite-difference block descent and backtracking. Numerical results show that the hybrid-field model closely matches the spherical-wave model, while MSAs substantially reduce the CRB.
Read the full abstract ▾
All authors Ruiqi Liu, Yuanshuo Gang, Honghao Wang, Tianqi Mao
Information Theory · Cross-listed from eess.SP
Deterministic DTFT Interpolation for Joint Frequency and Chirp-Rate Estimation: Cell-Uniform Efficiency and Threshold Analysis
Miaomiao Wei, Jianjun Li, Yang Wang et al. (+3 more)
Joint frequency and chirp-rate estimation for a noisy chirp signal arises in radar, sonar, and burst satellite communications. Conventional
estimators combine a coarse grid search with fine interpolation; accuracy degrades at the edges of the residual
cell (the edge effect) and below the breakdown SNR (the threshold effect). We present a deterministic two-stage
estimator that controls both failure modes uniformly over the residual
cell. The
estimator combines a time-centered, zero-padded dechirp-FFT acquisition bank with alternating selectable-$p$ amplitude-interpolation refinements on DTFT samples at fractional bins; in the centered frame, the frequency-chirp-rate cross-term of the Fisher information vanishes. The paper derives a mean-squared-error and threshold characterization over the full SNR range, in closed form except for one calibrated scalar (an effective
cell count), to our knowledge the first for the joint problem: the breakdown threshold is governed by the
cell count, and its
cell-position dependence is dominated by the scalloping loss of the coarse FFT, which the padding bounds at 0.4 dB. An asymptotic uniformity analysis over the
cell, including its corners, gives fixed-point variance ratios of $1.003$ and $0.998$, analytically free of the residual. A closed-form bias analysis under a cubic phase mismatch shows the centered chirp-rate estimate is insensitive to first order. Monte Carlo experiments at $N=256$ (validated at $N=32$-$512$) measure frequency- and chirp-rate-axis efficiencies with median $1.03$ and worst case $1.07$ over $144$
cell positions at $-5$ dB. Threshold predictions hold within $1.0$ dB on four configurations not used in the calibration. The dechirp-FFT bank is fully parallel, and each of the four refinement iterations evaluates three DTFT samples per axis; under fixed operating conditions, per-estimate latency is constant at $O(N\log N)$ cost.
Read the full abstract ▾
All authors Miaomiao Wei, Jianjun Li, Yang Wang, Huaiyuan Chen, Lulu Gao, Hang Liu
Information Theory
Linear network codes for vector-linear network function computation over three-layer networks
Min Xu and Gennian Ge
We study vector-linear function computation over three-layer networks with a fixed target function and a fixed source-access pattern. We develop a support-constrained row-space framework that represents a linear computing code by a global row space. This space must contain the target row space and be generated by rows satisfying the local support-constraints of the network. We prove that this representation is equivalent to the existence of a linear computing code. For any prescribed global row space, we give a necessary and sufficient condition for its realization and determine the minimum uniform communication load at the middle nodes. The condition is expressed in terms of the ranks of the local subspaces supported on the source-access sets. It separates the exact local realization problem from the outer problem of designing the global row space and yields a variational characterization of the linear computing capacity. We then apply the framework to MDS targets over cyclic networks. We identify when the target row space alone is sufficient and when auxiliary rows are required. We determine the capacity in the dense regime and in the sparse regime whenever the cut-set bound is integral. For the remaining sparse parameters, we give a general linear construction whose achievable rate equals the integer part of the cut-set bound.
Read the full abstract ▾
Information Theory · Cross-listed from stat.ML
Finite-Probe Total-Variation Certificates for Finite-Basis Drifting Models
Sam Andersson and Ricky Molén
Drifting objectives compare a target and model distribution through a vector field observed noisily at finitely many locations. We ask what distributional conclusion such a frozen measurement system warrants. For integrable antisymmetric interactions and absolutely continuous laws in a declared finite density basis, the unnormalized sampled numerator satisfies $\operatorname{vec}(V_X)=Mc$, where $c$ is an antisymmetric mismatch and $M$ is probe-dependent. This identity yields an a posteriori total-variation (TV) upper confidence bound accounting for held-out field noise, estimated-operator error, and externally validated $L^1$ residual radii around normalized density approximants in the span; a nonpositive observability margin returns the trivial TV bound and abstains. The audit recomputes this numerator from held-out samples; a normalized drift statistic requires a separate joint numerator–denominator analysis. For Gaussian-RBF interactions, a global envelope supports distribution-free and empirical-Bernstein radii without truncation, with companion bounds for the Laplace similarity in the original drifting objective. We characterize random-probe observability by a population Gram
matrix, identify rank and
symmetry degeneracies, and prove large-bandwidth collapse toward mean matching. Synthetic studies exercise Gaussian and Laplace numerators, separately prespecified bounded-vector and variance-adaptive radii, Monte Carlo-calibrated operators, nonzero residual radii around normalized finite-basis approximants, outward-rounded observability bounds, and designed abstention. A joint basis-size/dimension stress path extends evaluation through $m=8$. The result is a conditional diagnostic for a finite density class, or for normalized finite-basis density approximants with external residual radii, not a universal guarantee from small training drift.
Read the full abstract ▾