Peer Revenue Publish or profit

Papers

Fresh from arXiv, typeset properly. Highlighted words trade on the market.

Computer Science Information Theory

cs.IT Watch Information Theory (sign in to use)

Wednesday 9 September

Information Theory

Revisiting the Weight Spectrum of the Affine Grassmann Code $C^{\mathbb{A}}(2,m)$

Affine Grassmann codes, introduced by Beelen, Ghorpade and Høholdt, are linear codes over $\mathbb{F}_q$ obtained by evaluating linear combinations of minors of a generic matrix. The weight spectrum of the affine Grassmann code $C^{\mathbb{A}}(2,m)$ was determined by Piñero and Singh via a case analysis on the rank of an associated alternating matrix. We give an independent and more streamlined derivation, valid for all $m\ge4$ and every prime power $q$, in which each codeword is written in a compact matrix form and its Hamming weight is expressed through a single closed formula involving two explicit affine subspaces and their intersection.
Read the full abstract

Information Theory

Frame-Coded Legged Locomotion over Noisy Terrain

Open-loop multilegged locomotion over rough terrain has been interpreted as matter transport over a noisy channel: leg-ground interactions are discrete basic active contacts, terrain deletes or perturbs those contacts, and spatial redundancy concentrates the resulting thrust and arrival time. That construction is repetition-like because every module carries the same scalar locomotion task. It consequently provides neither a positive task rate nor a decoder that changes with the surviving contact set. Here we formulate locomotion instead as a quantized finite-frame expansion with erasures. A d-dimensional body-level command is mapped into N>d heterogeneous local contact commands. Rough terrain erases or corrupts frame coefficients, while a contact-gated compliant morphology physically realizes the weighted active-subframe decoder. For a linear-Gaussian model, mechanical equilibrium is exactly the posterior mean, tangent stiffness is posterior precision, and mechanical compliance is posterior covariance. Equal-norm Parseval frames are shown to be minimax optimal against one missing contact, two-contact robustness is governed by frame coherence, and a harmonic frame gives a directly realizable gait family. For independently surviving contacts of probability q, random Gaussian gait frames admit exact reconstruction at every analog dimension rate R<q, with a binomial reliability exponent, whereas recovery of arbitrary commands is impossible for R>q. Residual contact noise yields an asymptotic per-mode amplification 1/(q-R) and a vanishing mechanical stiffness margin at the threshold. An information-locomotion inequality and an exact incremental-redundancy rule direct the next gait component toward the softest task-relevant unresolved mode. The resulting analog frame-coding theorem establishes a finite relative redundancy and converse as part of a fundamental limit theory of legged locomotion.
Read the full abstract

Information Theory · Cross-listed from quant-ph

Haar-Bayesian Pure-State Prediction under Relative-Entropy Loss: Arbitrary-Effect Reduction and Global Optimality

We study Haar-Bayesian prediction of one unmeasured copy of an unknown finite-dimensional pure quantum state after an arbitrary collective measurement on $n$ observed copies. Performance is evaluated by quantum relative entropy. For a fixed measurement, the Bayes predictive state is the posterior mean and the optimized conditional loss is its entropy. We then optimize the measurement over all POVMs on the symmetric subspace. For every nonzero positive effect $E$, the corresponding posterior predictive state is $\mu_E=(I+n\rho_E)/(n+d)$, where $\rho_E$ is the normalized one-particle marginal of $E$. Since a pure spectrum majorizes every density-operator spectrum, this identity gives an outcome-wise entropy lower bound. Coherent rank-one effects attain the bound, and their Haar orbit yields the highest-weight covariant POVM. Hence this POVM is globally Bayes optimal over all collective measurements and, by covariance, globally minimax. Its exact risk is $h_d((n+1)/(n+d))$, where $h_d(r)=-r\log r-(1-r)\log((1-r)/(d-1))$. The same arbitrary-effect reduction shows that the highest-weight POVM also maximizes the joint overlap between the latent pure state and its posterior predictive state, equivalently the mean posterior purity, with optimum $((n+1)^2+d-1)/(n+d)^2$.
Read the full abstract

Information Theory

On the Evolution of the Capacity-Achieving Input Support for the Amplitude-Constrained AWGN Channel

We consider an additive white Gaussian noise channel subject to a peak-amplitude constraint and study how the support of the capacity-achieving input distribution (CAID) evolves as the amplitude constraint $A$ varies. Although the CAID is known to be unique, symmetric, discrete, and finitely supported, the structure of its support transitions has remained largely unresolved. We show that the origin is the only possible degenerate support point and the only possible inactive contact point of the KKT function. We then establish continuity properties of the optimal distribution and the KKT function and prove that every nonzero support point is locally stable: under small changes in $A$, it persists as a unique nearby atom whose location and probability mass vary continuously. Combining these results, we prove that, locally, the support cardinality at a nearby amplitude is either unchanged or larger by one and that any such increase can occur only at the origin. Consequently, all local changes in support cardinality are confined to the origin: locally, the only possible transition mechanisms are the appearance or disappearance of the point at the origin and the splitting or merging of the origin into a symmetric pair.
Read the full abstract

Information Theory

The kernel-block rank profile and a complete classification of $\mathbb{Z}_2\mathbb{Z}_4\mathbb{Z}_8$-linear Hadamard codes

The $\mathbb{Z}_2\mathbb{Z}_4\mathbb{Z}_8$-additive codes are subgroups of $\mathbb{Z}_2^{\alpha_1}\times\mathbb{Z}_4^{\alpha_2}\times\mathbb{Z}_8^{\alpha_3}$, and a $\mathbb{Z}_2\mathbb{Z}_4\mathbb{Z}_8$-linear Hadamard code is the Gray map image of such a code. A recursive construction of $\mathbb{Z}_2\mathbb{Z}_4\mathbb{Z}_8$-additive Hadamard codes $\mathcal H^{t_1,t_2,t_3}$, with all $\alpha_i\neq0$, $t_1\geq1$, $t_2\geq0$, and $t_3\geq1$, is known, as are the linearity, kernel dimension, and rank of the corresponding codes $H^{t_1,t_2,t_3}$ of length $2^t$, where $t+1=3t_1+2t_2+t_3$. Yet these invariants do not completely classify the family. Two infinite families of pairs of distinct types share the length, rank and kernel dimension, and for classified lengths $2^t$, $3\leq t\leq11$, such pairs were separated only by computer equivalence tests. In this paper, we introduce an equivalence invariant that resolves these cases. The kernel partitions the binary coordinates into blocks, two coordinates lying in the same block when every kernel word takes the same value in both; the kernel-block rank profile is the multiset of the dimensions of the linear span punctured on these blocks. Unlike rank and kernel dimension, which are global, this invariant records how much of the span survives on each block. We compute it for the whole family: there are $2^{t_1+t_2+t_3-1}$ blocks, all of size $2^{2t_1+t_2}$, and the profile takes at most two values $t_2+\binom{t_1+2}{2}$ and $t_2+2+\binom{t_1+1}{2}$, whose difference is $t_1-1$; it is constant precisely when $t_1=1$. Hence, the profile recovers $t_1$, and the length and kernel dimension recover $t_2$ and $t_3$. Two codes of the family with the same length are therefore equivalent if and only if their types coincide, and the number of pairwise nonequivalent such codes of length $2^t$ is $\lfloor(t^2+6)/12\rfloor$ for every $t\geq3$.
Read the full abstract

Information Theory

Quantum MDS codes from complements of unions of finite-field subsets

Let $q$ be an odd prime power. We use complements of unions of subsets of $\mathbb F_{q^2}$ as locator sets and establish a sufficient condition under which a generalized Reed–Solomon (GRS) code is Hermitian self-orthogonal. Using cosets of multiplicative subgroups and sets with prescribed trace or norm values, we construct five families of Hermitian self-orthogonal GRS codes over $\mathbb F_{q^2}$. The Hermitian construction then yields five corresponding families of $q$-ary quantum maximum-distance-separable (MDS) codes. Under suitable parameter conditions, these quantum codes have minimum distances greater than $q/2+1$. By comparing codes of the same length, we give conditions under which our codes have strictly larger minimum distances than those obtainable from several previously known constructions based on trace maps, linear transformations, and cosets of multiplicative subgroups, either directly or via the propagation rule. We further show that such improvements occur for infinitely many values of $q$.
Read the full abstract

Information Theory

Fast Collision-Free Acquisition in 1-Persistent Age-Threshold Slotted ALOHA via Role-Protected Counters

Goal-oriented sensing, estimation, and control benefit from prompt, regular access to task-relevant updates. Although 1-persistent age-threshold slotted ALOHA (1-pTSA) can self-organize into a periodic collision-free schedule, its acquisition transient can dominate finite-horizon performance. We propose role-protected counter-threshold slotted ALOHA (RP–CTSA), which separates reservation memory from the age of information (AoI). A scheduled singleton retains its phase after colliding with active contenders, whereas a collision involving multiple scheduled nodes releases them immediately; AoI resets only after a decoded update. The protocol requires individual acknowledgments and a binary RELEASE/HOLD indication, but no centralized phase assignment or identification of colliders. Let $n$ denote the number of nodes and $\Gamma_n$ the counter threshold. Under inverse-population access scaling, the acquisition dynamics admit an exact pure-death representation. When $\Gamma_n=n$, the acquisition time is $O(n^2)$; when $\Gamma_n\sim(1+\theta)n$, with $\theta>0$, it is $O(n\log n)$. Simulations confirm both regimes and show substantial finite-horizon AoI gains over 1-pTSA while preserving every collision-free schedule.
Read the full abstract

Information Theory · Cross-listed from quant-ph

Minimax games for quantum channel discrimination

Quantum channel discrimination is a primitive task for identifying, verifying, and benchmarking quantum dynamics. Previous studies have primarily considered either the best-case tester-input setting or the worst-case jammer-input setting. Here, we introduce a game-theoretic framework in which both the tester and jammer control separate inputs. Combining three input structures, characterized by whether the tester and jammer use entangled inputs or IID inputs across channel uses, with four information patterns, determined by the visibility of the jammer's strategy and its knowledge of the true hypothesis, yields twelve game models. We provide exact finite blocklength hypothesis testing characterizations of all twelve models in terms of nine minimax hypothesis testing divergences and derive their asymptotic Stein exponents. Notably, for entangled jammers, neither the visibility of the jammer's strategy nor its knowledge of the true hypothesis affects the asymptotic Stein exponent, whereas the information pattern remains consequential for IID jammers. As an example, we study the discrimination of a general channel from a replacer channel and show that all asymptotic Stein exponents coincide with the same additive, single letter quantity. We further develop a general argument that upgrades achievability results to strong converse results, thereby establishing strong converse properties for several game models, resolving an open problem in composite hypothesis testing posed by Berta et al. [Commun. Math. Phys. 385, 55 (2021)], and strengthening several recent results of Lami [arXiv:2510.06340]. The framework and techniques developed here may support future studies of quantum information tasks involving competing roles.
Read the full abstract

All authors Kun Fang, Michael X. Cao, Hao-Chung Cheng, Li Gao, Masahito Hayashi

Information Theory

Proximity Gaps for Gabidulin Codes and Applications

Proximity gaps are central to the soundness of interactive oracle proofs of proximity (IOPPs) and polynomial commitment schemes (PCSs). An $[n,k,d]$ linear code $C\subseteq\mathbb F^n$ has a $\delta$-proximity gap with error $\epsilon$ if, for every $u_0,u_1\in\mathbb F^n$, either all points on $\ell_{u_0,u_1}=\{u_0+\alpha u_1:\alpha\in\mathbb F\}$ are $\delta$-close to $C$, or at most an $\epsilon$ fraction are. Although proximity gaps for Hamming-metric codes are well understood, their rank-metric counterparts remain largely unexplored despite their applications in coding theory and cryptography. In this work, we study proximity gaps for linear rank-metric codes and their cryptographic applications. First, we show that every $[n,k,d]$ linear rank-metric code $C$ over $\mathbb F_{q^m}$ admits a proximity gap for every $\delta\le(d-1)/(3n)$, with error at most $q^{e+1}/q^m$, where $e=\lfloor\delta n\rfloor$. For Gabidulin codes, we improve the gap to $(d-1)/(2n)$ with error $10q^{n-1}/q^m$. These two proximity gaps match those for general linear Hamming-metric codes and Reed–Solomon (RS) codes, respectively. We prove the $(d-1)/(2n)$ bound is tight by constructing an infinite family of constant-rate Gabidulin codes and affine lines $\ell_{u_0,u_1}$ on which a $1-o(1)$ fraction of points are $d/(2n)$-close to the code, while $u_1$ is at least $3d/(4n)$-far from it. At the $d/(3n)$ gap, we also give a counterexample establishing a lower bound on $\epsilon$. As applications, we construct an IOPP for interleaved Gabidulin codes by adapting the Ligero IOPP for interleaved RS codes. We then adapt the Ligero-based PCS for ordinary polynomials to obtain a $q$-linearized polynomial commitment scheme. To our knowledge, this is the first PCS framework based on rank-metric error-correcting codes.
Read the full abstract

All authors Songsong Li, Chaoping Xing, Chen Yuan, Ruiqi Zhu

Information Theory

Learning-Aided Short Code Design for ISAC based on MIMO-OFDM

This paper proposes a deep learning (DL)-based coded waveform design for integrated sensing and communications (ISAC), enabling flexible trade-offs between communication reliability and ranging accuracy in short-block transmissions. The proposed scheme is built upon a practical multiple-input multiple-output orthogonal frequency-division multiplexing (MIMO-OFDM) architecture, where the communication channel state information and the angles of the static targets are assumed available at the transmitter. A transformer-based transmitter encodes input information bits directly into ISAC transmit waveforms to jointly optimize the bit error rate (BER) performance and the delay modified Cramer-Rao bound (MCRB). A corresponding transformer-based receiver is adopted at the communication side to recover the transmitted information bits. We further examine the learned codewords for communication-oriented and sensing-oriented designs, revealing that a balanced ISAC waveform naturally exhibits an intermediate structure between these two extremes. Numerical results illustrate these codeword structures and demonstrate that the proposed design provides substantial trade-off gains over conventional schemes based on standard channel coding and modulation.
Read the full abstract

All authors Mingcheng Nie, Shuangyang Li, Geng Wang, Peng Cheng, Shenghong Li, Chang Liu, Giuseppe Caire, Yonghui Li

Information Theory

Channel Estimation for OFDM via Delay-Doppler Refinement

In this paper, we propose a novel channel estimation (CE) algorithm for orthogonal frequency division multiplexing (OFDM) systems that exploits the unique characteristics of the delay-Doppler (DD) domain channel. Specifically, the time-frequency (TF) domain input-output relationship (IOR) is derived in a compact form by focusing solely on the non-zero elements of the TF domain channel matrix. Based on this compact IOR, a coarse TF domain CE is first performed using a linear minimum mean square error estimator. Then, the resultant TF domain estimates are transformed to the DD domain through a unitary transformation for further refinement. We reveal that the effective DD domain channel matrix can be viewed as an aggregation of multiple DD domain channel responses with different phase shifts. This allows us to devise a threshold-based estimation for DD domain channel parameters with high accuracy. The estimated DD domain channel parameters are then applied to form a refined estimate of TF domain channel. Our numerical results demonstrate that the proposed method can achieve substantial performance gains over conventional OFDM channel estimation techniques under the same pilot deployment.
Read the full abstract

All authors Mingcheng Nie, Hao Chang, Xiaoqi Zhang, Junkai Liu, Wibowo Hardjawana, Branka Vucetic, Yonghui Li

Information Theory

Conditions for Global Optimality in Quantum Arimoto-Blahut Algorithms

Generalized Arimoto–Blahut (AB) algorithms are widely used in information theory and quantum optimization, but monotonic objective decrease and numerical stabilization do not guarantee global optimality. We establish necessary and sufficient conditions for the global optimality of full-rank AB fixed points for convex differentiable objectives under linear constraints. An AB fixed point is globally optimal if and only if the AB update direction and the objective gradient differ by an element of the constraint normal space at that point. The same compatibility condition characterizes agreement between individual AB and mirror-descent (MD) updates, whereas pathwise equivalence requires it along the entire common trajectory. Thus, an AB algorithm may follow a trajectory different from MD and still reach the global optimum. We also develop a posteriori optimality certificates based on feasible directional derivatives, including finite-difference upper bounds on the objective gap that require only objective evaluations. For channel relative entropy between dephasing and depolarizing channels, we analytically identify the global minimizer as the unique full-rank AB fixed point, although pathwise equivalence fails. Numerical experiments illustrate convergence of AB and MD along different trajectories and validate the certificates. By contrast, an amplitude-damping example shows that a monotone AB iteration can stabilize at a suboptimal fixed point, whose nonoptimality is detected by the finite-difference certificate. These results provide structural and computable criteria for assessing global optimality in quantum AB algorithms.
Read the full abstract

Information Theory

Fundamental Limits of Joint Target Detection and Parameter Estimation - Characterizing Mixed-State Sensing Limits via Posterior Entropy Volume

The development of integrated sensing and communication calls for a unified theoretical foundation for sensing. This paper models target-presence patterns and continuous physical parameters as a mixed discrete-continuous state $\Xi$ on a branched reference measure, and treats posterior entropy volume and joint mutual information as two complementary representations of the same limit. Entropy volume carries physical units, can be compared with engineering scales such as resolution cells, and remains meaningful when the number of active targets varies; mutual information is dimensionless, invariant to coordinates and units, and additive through the chain rule. We define entropy number, entropy volume, and mixed entropy volume for discrete, continuous, and mixed states, respectively. The maximum-entropy principle for the uniform distribution on a support of fixed measure explains the measure-theoretic meaning of the exponential entropy scale, while the main limit follows from a mixed asymptotic equipartition property and a posterior probability-volume inequality through conditional typical sets. For asymptotically reliable high-probability sensing regions, the minimum achievable first-order posterior mixed entropy volume equals the prior mixed entropy volume multiplied by $2^{-I(\Xi;Y)}$, where $I(\Xi;Y)=I(V;Y)+I(X_V;Y\mid V)$. Thus, detection and estimation contributions multiply in the volume domain and add in the bit domain, and one sensing bit halves the posterior effective measure. We further prove that posterior-preserving cascades attain the direct-inference limit, while arbitrary intermediate compression incurs the exact information loss $I(\Xi;Y\mid Z)$. Numerical results for a single-target presence-range model illustrate the information composition, posterior entropy-volume contraction, and cascade-interface loss.
Read the full abstract

Information Theory · Cross-listed from quant-ph

A Sum-of-Squares Hierarchy with Quadratic Convergence for Quantum Channel Coding

Computing the optimal success probability for transmitting classical messages through a single use of a quantum channel is NP-hard, even for two messages. An existing semidefinite programming hierarchy based on symmetric extensions provides convergent upper bounds with an a priori error estimate that decays as the inverse square root of the extension level. In this work, we construct a Hermitian sum-of-squares hierarchy for an arbitrary number of messages and prove quadratic convergence in its level. The error bound is proportional to the advantage over random guessing. Our approach combines state-discrimination duality with positive polynomial kernels on products of spheres to construct feasible polynomial dual certificates. For binary messages, the resulting bounds give a multiplicative approximation from above of the trace-norm contraction coefficient.
Read the full abstract

Information Theory

Characterizing Multi-Cell Pinching-Antenna Transmission: Revealing the Other Side of the Coin

Using pinching antennas to enhance a user's connection to its own base station (BS) is intuitive and has been well investigated in the literature. This letter focuses on a less intuitive advantage of pinching antennas from the interference-suppression perspective. In particular, using pinching antennas ensures that all BSs serve their users with low transmit power, i.e., BSs can “whisper", rather than “shout", to their users. As a result, by experiencing less interference, a user's data rate can still be improved with pinching antennas, even if its link quality to its own BS remains unchanged. A stochastic geometric study is carried out in the letter, where BSs employ fractional power control. Analytical and numerical results are presented to reveal the significant impact of this interference-suppression capability offered by pinching antennas.
Read the full abstract

Tuesday 8 September

Information Theory · Cross-listed from stat.ML

Recovery Theory for Projected Power Iterations in Permutation Synchronization

We study the projected power method (PPM) for synchronizing \(n\) unknown permutations of \(m\) objects under a possibly sparse uniform corruption model. Each pair is observed with probability \(p\), and an observed measurement is uncorrupted with probability \(\pi_0\) and is otherwise an independent uniform permutation. Under \(\log m=o(np\pi_0^2)\), we prove exact one-step recovery (with high probability) of each prescribed block for an independent estimate with a fixed positive majority of correct blocks. When \(np\ge C_0\log n\) and \(m=o(np\pi_0^2)\), we prove that one high-probability event yields a block-error contraction simultaneously for every estimate whose optimally aligned error is at most \(0.5-\epsilon\). The contraction factor is \(O(m/(np\pi_0^2))\) and the error floor is \(O(e^{-cnp\pi_0}+e^{-cnp\pi_0^2}+{\log n}/{n})\). Consequently, one update maps every possibly data-dependent estimate in this basin to vanishing block error, and all subsequent iterates remain almost exact uniformly over the iteration index. The one-step and trajectory results extend to independent, non-identically distributed, permutation-valued corruptions with mean \(m^{-1} \mathbf{1}\mathbf{1}^{\top}\). Under the uniform model, a reference-block spectral initializer has aligned block error \(O_{\mathbb P}(m/(np\pi_0^2))\), yielding an end-to-end almost-exact recovery guarantee. Under a stronger all-block signal condition, PPM reaches exact recovery after finitely many iterations. The theory transfers exactly to partial permutations with common support; for varying supports, we establish deterministic and probabilistic co-visibility margins.
Read the full abstract

Information Theory · Cross-listed from eess.SP

Reliable Near-Field Multi-User Positioning Informed by Two-Stage MUSIC

Near-field localization is a promising technique for high-resolution multi-user positioning in future wireless systems, but its performance is often degraded by scattering-induced coherent propagation. Existing near-field localization methods, which require separate parameter estimation and path/source association, suffer from high computation overhead and accumulated errors, and usually do not provide any guarantee on reliability. In this paper, we propose MUSIC-Net, an end-to-end near-field positioning deep learning (DL) framework informed by two-stage MUltiple SIgnal Classification (MUSIC) in mixed line-of-sight (LoS) and non-LoS (NLoS) multi-path scenarios, which embeds the two-stage MUSIC objects into training to isolate the LoS-related signal subspace and to identify a surrogate distance. The proposed framework directly recovers multi-user positions without the need for involved NLoS parameter estimation or path/source association. Furthermore, we introduce split conformal prediction (SCP) to move beyond point-estimation-based positioning towards statistically guaranteed (confidence) set estimation for all users. Numerical results show that the proposed MUSIC-Net achieves lower mean positioning error (MPER) than existing benchmarks and yields tighter SCP-calibrated prediction regions, demonstrating both accurate LoS localization and efficient uncertainty quantification (UQ) in coherent multi-path environments.
Read the full abstract

All authors Jiaying Li, Haifeng Wen, Changsheng You, Yuanwei Liu, Hong Xing

Information Theory

Degree Sequence Reconstruction from Subgraph Traces

The goal of degree sequence reconstruction is to recover the ordered vector of degrees of an unknown graph from vertex deleted traces, where each vertex is deleted independently with probability $p$. We provide two algorithms for reconstruction; the first uses rejection sampling to reduce the problem to an estimation problem for a mixture distribution. Combined with prior trace reconstruction results, this gives a reconstruction algorithm using $\Exp{\tilde O (n^{1/3})}$ traces, although no sub-exponential time decoder is known. Our other approach involves recovering certain graph invariants, degree moments, that can identify a graphs degree sequence. Extremal polynomial bounds show that $\tilde \Theta(n^{1/2})$ degree moments are necessary and sufficient to reconstruct the degree sequence, which leads to an algorithm with $\Exp{\tilde O(n^{1/2})}$ trace complexity. The same polynomial machinery yields a sub-exponential time decoder for the degree sequence from the moments. Additionally, we give an $O(n^{3})$ upper bound and a $\Omega(n^2)$ lower bound for the trace complexity of recovering the number of edges.
Read the full abstract

Information Theory · Cross-listed from quant-ph

Non-Multiplicativity of the Holevo Barycenter of Quantum Channels

The Holevo barycenter of a quantum channel is the unique output state obtained as the average output of any ensemble achieving the Holevo capacity. Given two quantum channels, the multiplicativity problem asks whether this barycenter tensorizes under parallel composition, namely whether the barycenter of the product channel coincides with the tensor product of the individual barycenters. This question is closely related to the additivity problem for the Holevo capacity: additivity implies tensorization of the Holevo barycenter, while tensorization alone is not sufficient for additivity. Although a construction is known that demonstrates the existence of channels with non-additive Holevo capacity, their corresponding Holevo barycenters still tensorize, leaving open whether multiplicativity might ultimately hold universally. Here, we answer this question in the negative by exhibiting channels for which the Holevo barycenter is not multiplicative under the tensor product of the channel with itself. Moreover, we show that the entropy of the Holevo barycenter is neither universally subadditive nor universally superadditive under tensor product.
Read the full abstract

All authors Sayantan Chakraborty, Stefano Mancini, Leonardo Rossetti, Andreas Winter

Information Theory · Cross-listed from cs.LG

Explaining f-Divergence-Based Regularization via Local Curvature and Sharpness-Aware Minimization

Divergence-based regularization and Sharpness-Aware Minimization (SAM) are two prominent approaches for improving generalization in deep learning, both motivated by robustness to perturbations. However, their relationship has remained largely unexplored. Building on classical second-order expansions of $f$-divergences, we show that the two methods are locally consistent under parameter-space perturbations: both induce curvature-sensitive penalties, with divergence regularization yielding a Fisher-weighted quadratic form and SAM penalizing sharpness through the dominant Hessian eigenvalue. For negative log-likelihood objectives with exponential-family output distributions, this correspondence becomes especially transparent, since the Fisher and Gauss-Newton matrices coincide. We further show that the same local geometric perspective extends to input-space perturbations, where divergence-based regularization is defined through transformations of the input. In this setting, the regularizer induces a pullback quadratic form on the input space, providing a more general perturbation framework than standard SAM while preserving the same local sensitivity interpretation. To validate the analysis empirically, we use the asymmetric $\alpha$-skew Jensen-Shannon divergence (JSD) family as a controlled testbed. Its local curvature coefficient scales as $\alpha(1-\alpha)$ and is maximized at the symmetric point $\alpha=\tfrac12$, which recovers the standard JSD. Loss-landscape visualizations in the input-perturbation regime show that stronger induced curvature penalization is associated with flatter local minima. Experiments on four benchmark datasets further demonstrate that both accuracy and negative log-likelihood are consistently best near this regime of maximal curvature penalization.
Read the full abstract

Information Theory

On the Sequential Test and Distributed Detection

We present a simple definition of stopping time and its role in the formulation of sequential tests for both centralized and distributed detection, providing a straightforward procedure for obtaining optimal decision rules. Upper bounds for optimal stopping time are derived and numerically shown to possess certain qualitative features expected of the optimal stopping time. The results are extended to any distributed detection network in the form of an acyclic directed graph.
Read the full abstract

Information Theory · Cross-listed from stat.ML

Tensor Network Moral Graph Recovery of Discrete Probability Distributions

We present a method for recovering the moral graph of a causal DAG from a probability distribution over discrete variables, using fully connected tensor networks (FCTNs) with nuclear-norm-regularized bond corrections. Each bond matrix is parameterized as a baseline all-ones matrix plus a low-rank correction $C_{ij} = U_{ij}V_{ij}^\top$, and the nuclear norm of the correction implemented via the variational Frobenius norm penalty on the factors drives unnecessary bonds to zero. We prove that under faithfulness, positivity, and a no-implicit-rerouting assumption on the local tensor architecture, every optimal FCTN with zero reconstruction error $\varepsilon = 0$ has effective graph exactly equal to the moral graph. For the approximate regime ($\varepsilon > 0$), we provide explicit recovery bounds using the Fannes-Audenaert continuity of conditional mutual information, and derive a sufficient condition on the regularization parameter $\beta$. The effective graph is read directly from the optimized bond matrices.
Read the full abstract

All authors Á. Troyano Olivas, Chi-Hang Fred Fung, Hans H. Brunner, Momtchil Peev, Vicente Martin

Information Theory

Optimality of Kløve Arrays within the Symmetric Kløve-Mossige Class

Rajam$\unicode{228}$ki and Koivunen asked whether minimum-redundancy symmetric Kl$\unicode{248}$ve-Mossige arrays with contiguous sum co-arrays are always Kl$\unicode{248}$ve arrays. We give a computer-assisted proof that, at every fixed sensor count, every maximizing sensor set belongs to the Kl$\unicode{248}$ve class. The argument classifies the overlaps between a generator and its shifted reflection, then bounds the aperture of a hypothetical optimizer outside the Kl$\unicode{248}$ve class. Comparing these bounds with a classical Kl$\unicode{248}$ve construction settles all sensor counts at least 330. An exact integer certificate covers the remaining counts from 2 through 329 and matches every equality case to a Kl$\unicode{248}$ve array as a complete set. Consequently, optimization within the full symmetric Kl$\unicode{248}$ve-Mossige class reduces to the previously known search over Kl$\unicode{248}$ve parameters. The theorem concerns this specified class, rather than unrestricted sparse arrays or all restricted additive bases.
Read the full abstract

Information Theory

Stability of Fork-Join Systems with Redundancy and Heterogeneous Servers

We consider the stability problem of fork-join systems with redundancy (FJR) and heterogeneous servers under both static and dynamic capacity-allocation policies. In an $(n,k)$ FJR system, each arriving job is split into $n$ independent tasks, with one task assigned to each of $n$ parallel servers. Once $k \le n$ tasks have been processed, they are joined and the corresponding job departs the system; the remaining $n-k$ unprocessed tasks are then removed and are therefore termed redundant. We first identify the nominal traffic intensity and characterize the maximal stability region, defined as the set of traffic intensities for which there exists an admissible policy that stabilizes the system. We then establish conditions under which this maximal stability region is attained for two classes of policies: static and dynamic. Specifically, we show that for static allocation policies, in which service capacities remain fixed over time, maximality is achieved whenever the fastest server is allocated no more than $1/k$ of the total service capacity. For dynamic allocation policies, in which a fixed total service capacity may be repeatedly reallocated among the servers, we show that maximality is achieved whenever the cumulative capacity allocated to the $j$ shortest queues does not exceed $j/k$ of the total capacity for every $j=1,\ldots,k-1$. Our analysis is based on a projection of the $(n,k)$ FJR system onto a simpler $(k,k)$ system that has no redundancy, together with a novel sample-path comparison argument for multidimensional processes based on the generalized Schur-convex order.
Read the full abstract

Information Theory · Cross-listed from cs.AI

Answer-Distribution Trajectories: A Stochastic-Dynamics View of LLM Reasoning

Chain-of-thought reasoning provides a structured computation between a model's input and final answer. Yet it is often evaluated through endpoint accuracy, which ignores the path taken to reach that answer. An emerging line of work addresses this limitation using entropy profiles, which track how uncertainty evolves over the reasoning process but do not reveal which competing hypotheses account for that uncertainty. We introduce answer-distribution trajectories, a stochastic-dynamics-inspired representation that tracks the model's full predictive distribution over answers as reasoning unfolds. As a strictly finer representation than endpoint and entropy summaries, answer-distribution trajectories enable us to characterize a trace through a dynamical reasoning profile spanning exploration, revision, motion, and commitment, and to distinguish different dynamical mechanisms of reasoning success and failure. Across sixteen open-weight language models and four reasoning benchmarks, we show that traces with the same endpoint and similar entropy profiles can exhibit substantially different reasoning dynamics. We further find substantial variation in these dynamics both within and across models and tasks, with different objectives favoring different dynamical profiles. Additionally, we show that training and inference choices systematically reshape these profiles. Our results suggest that answer-distribution trajectories provide a rich framework for analysing and evaluating the dynamics of LLM reasoning.
Read the full abstract

All authors Mar Gonzàlez I Català, Haitz Sáez de Ocáriz Borde, Davide Murari, Carola-Bibiane Schönlieb, Pietro Liò, George Montañez

Information Theory · Cross-listed from quant-ph

No information transmission through quantum channels above capacity

We show that the capacity of a quantum channel demarcates a phase transition: while reliable transmission below capacity is always possible, any attempt to transmit information above it fails catastrophically. Specifically, we prove exponential strong converse theorems for unassisted quantum and classical communication over arbitrary finite-dimensional memoryless quantum channels. At rates beyond the respective capacity, the entanglement-generation fidelity and the success probability for classical communication decay exponentially with the number of channel uses. This rules out transmission above capacity even when one tolerates arbitrarily large errors. Our proof follows the classical Arimoto strategy, augmented by a crucial new ingredient: integral representations of Rényi information measures that lead to asymptotic continuity bounds for Rényi capacities.
Read the full abstract

Information Theory

On Weighted Mathai-Haubold Entropy Measures

In this paper, we propose weighted Mathai-Haubold entropy along with their residual and past versions and study their properties. We develop aging classes based on the weighted Mathai-Haubold residual and past entropy measures. Also, some inequalities related to the three proposed measures are discussed. Non-parametric estimators of the proposed measures are introduced and their properties are investigated. Performance of this estimator is evaluated by means of bias and mean squared error using Monte-Carlo simulations.
Read the full abstract

Information Theory

Hybrid Continuous DoA Estimation with Shared-Radius Co-Prime Circular Arrays

This paper proposes a shared-radius co-prime circular array for high-resolution, continuous 2D Direction-of-Arrival (DoA) estimation in 3D space, jointly estimating azimuth and elevation angles. The proposed architecture consists of two uniform circular sub-arrays with co-prime antenna counts sharing a common radius RR, a design that intrinsically suppresses mutual coupling leakage compared to dense uniform arrays. Unlike existing works that rely on complex phase-mode transformations to map circular structures to virtual linear arrays, we introduce a hybrid continuous-recovery framework operating directly in the physical spatial domain. By integrating a fast, discrete coarse-grid search with a swarm-intelligence continuous refinement stage, the proposed method completely bypasses discrete grid-mismatch limitations and computationally expensive eigenvalue decompositions. A rigorous theoretical analysis using Nivens Theorem establishes the spatial uniqueness of the true source direction, effectively resolving phase ambiguities. Simulation results demonstrate that this hybrid scheme achieves superior resolution and lower Root Mean Square Error (RMSE) at low Signal-to-Noise Ratios (SNR) compared to uniform configurations, while asymptotically converging to the theoretical Cramer-Rao Bound (CRB) at high SNRs.
Read the full abstract

Information Theory

The Weight Spectrum of the Affine Grassmann Code $C^{\mathbb A}(3,6)$

In this article, we consider the affine Grassmann code $C^{\mathbb A}(3,6)$, obtained from the affine open cell ${\mathbb A}^9$ of the Grassmannian $G_{3,6}$. We exploit the representation of codewords as linear combinations of minors of all sizes of a generic $3\times3$ matrix and classify them according to the largest size of a minor occurring with a nonzero coefficient. Using this classification, we determine all possible Hamming weights of codewords of $C^{\mathbb A}(3,6)$ and, for each weight, compute the number of codewords attaining that weight. Consequently, we obtain the complete weight spectrum of the affine Grassmann code $C^{\mathbb A}(3,6)$.
Read the full abstract

Information Theory

A Note on Scaling in Randomly Rotated Quantization and Its Connection to the CDEF +1 Pythagorean Relation

Quantization schemes based on randomized rotations have recently received renewed attention, including the roles of MMSE and unbiased reconstruction scalings. In this note, we point out the connection to classical results in statistical signal processing and communication theory. Specifically, the two reconstruction scales used in the EDEN line of work admit a natural interpretation as finite-dimensional, realization-dependent counterparts of the Wiener and unbiased coefficients in the classical CDEF formulation. At finite blocklength, the CDEF +1 relation holds pointwise for each rotation realization as an exact geometric (Pythagorean) identity, but does not hold after averaging the distortions over the rotation. The classical SNR relation $\sf{SNR}_{\rm MMSE}=\sf{SNR}_{\rm MMSE,U}+1$ is recovered as $d\to\infty$: once the overall scale is handled separately, the empirical coordinate statistics of a randomly rotated vector approach their i.i.d. Gaussian counterparts, and the rotation-dependent quantities concentrate. Importantly, EDEN goes beyond this classical correspondence: for every finite $d$, its Haar-rotation formulation guarantees exact conditional unbiasedness, a stronger property than the second-order notion of unbiasedness in CDEF. We further comment on two distinct roles random rotations play in quantization: one is approximate Gaussianization of the coordinates; the other is decorrelation of reconstruction errors across quantization branches.
Read the full abstract