Information Theory · Cross-listed from math.HO
Perfect Combinatorial Structures in Coding Theory and Cryptography
Vladimir N. Potapov
This book develops algebraic and combinatorial methods for studying discrete structures. It brings together graph theory, Boolean functions,
Fourier analysis on finite groups, coding theory, perfect colorings and perfect codes, association schemes, Latin squares, and related topics. A central theme is the interaction between different representations of the same object: combinatorial, algebraic, spectral, and coding-theoretic. The main mathematical object studied in this book is a perfect coloring of a graph, or, equivalently, an equitable partition of a graph. The book is intended for advanced undergraduate and graduate students in mathematics and computer science, as well as for researchers in discrete mathematics, combinatorics, coding theory, and related fields.
Read the full abstract ▾
Information Theory · Cross-listed from math.CO
Energy Estimation of the Hamming Slice and its Applications
Aniruddha Biswas, Jihun Hwang, Hemanta K. Maji et al. (+2 more)
Let $R=\mathbb{Z}/(2^n-1)\mathbb{Z}$, where $n\geq 3$, and let $S_w\subseteq R$ be the residues whose canonical $n$-digit binary expansion has Hamming weight $w$. We obtain, in particular, an asymptotic formula for the additive energy of $S_w$ \[ E(S_w)=\frac{\left|S_w\right|^4}{|R|}+ \mathcal{O}\left(|R|^3 n^{-3} \right), \] which holds uniformly in $w$. The error term is optimal in order, with a matching lower bound for $w=\lfloor n/2+\sqrt{n} \rfloor$. It follows that triple sums of arbitrary unit dilates have asymptotically uniform representation counts when $\prod_{j=1}^{3} \left|S_{w_j} \right| /\left(|R| n^{-3/5}\right)^3\to\infty$, and that double sums have asymptotically full support when $\left|S_{w_1}\right| \left|S_{w_2} \right|/\left(|R| n^{-3/4}\right)^2\to\infty$. In the proof, modular collisions are represented using a cyclic binary carry automaton; this appears to be a novel approach in this area of problems.
Read the full abstract ▾
All authors Aniruddha Biswas, Jihun Hwang, Hemanta K. Maji, Ilya D. Shkredov, Xiuyu Ye
Information Theory · Cross-listed from cond-mat.stat-mech
Leveraged Learning: entropy cleared per bit received
Daniel Chernowitz
An expository essay containing some new results. A learner holds a prior belief over Boolean maps that answer a finite set of $Q$ questions, and receives answers one by one. Each answer carries surprisal and can clear predictive uncertainty about both the question asked and questions still unasked. We quantify this effect by the leverage: table
entropy cleared per bit of surprisal received. Taking expectations over the truth prior and the question order, define the aggregate leverage as the ratio of expected uncertainty cleared to expected surprisal received. It equals one for independent answers and can exceed one for correlated answers. At finite size, this ratio is determined exactly by a single sequence: the mean
entropy $G_\ell$ of the answers to $\ell$ questions. As the number of input bits grows at fixed asked fraction $t=\ell/Q$, a limiting increment profile $\gamma(t)$ determines the macroscopic learning curve. With $\eta_0$ the limiting initial
entropy per question, the leverage becomes $L(t)= \frac{\eta_0-(1-t)\gamma(t)} {\int_0^t\gamma(x),dx}$. For exchangeable priors, de Finetti's representation gives a constant bulk profile $\gamma(t)$: deduction is confined to a boundary layer at $t=0$, and the leverage is forced to a
hyperbolic form, as surprisal grows linearly. By contrast, we construct a simplicity prior with nontrivial bulk learning by grading Boolean maps by their
polynomial degree over $\mathbb{F}_2$ and allocating weight across degree classes through a CDF $F$. Reed-Muller capacity then yields $\gamma(t)=1-F(t)$. This realizes any nonincreasing profile taking values in $[0,1]$, together with the corresponding macroscopic leverage curve.
Read the full abstract ▾
Information Theory
Algorithmic List Decoding of Reed-Solomon Codes up to Capacity
Joshua Brakensiek, Yeyuan Chen, Aaron Putterman et al. (+2 more)
We give a deterministic
polynomial-time list-decoding
algorithm for Reed-Solomon codes over
prime fields that approaches list-decoding capacity for every evaluation set and every constant rate.
Read the full abstract ▾
All authors Joshua Brakensiek, Yeyuan Chen, Aaron Putterman, Zihan Zhang, Kai Zhe Zheng
Information Theory
Exact Degrees of Freedom of Spatially Sparse MIMO Channels Without Prior CSI
Yifeng Xiong, Weijiang Zhao, Fan Liu et al. (+2 more)
We characterize the degree of freedom (DoF) of a point-to-point blockwise memoryless channel without prior channel state information (CSI), with a fixed number $K$ of propagation paths, where the transmitter (Tx) and the receiver (Rx) are equipped with nonuniform linear arrays (NULAs) of $N_t$ and $N_r$
antennas, respectively. The positions of array elements are fixed, known, pairwise distinct, and need not be equally spaced. The uniform linear array (ULA) is a special case. In each block of length $T$, the continuous angles of arrival (AoAs), angles of departure (AoDs), and independent complex Gaussian path gains are redrawn. Both Tx and Rx know the state distributions but are not given the current realizations before transmission. The receiver may estimate the channel from reference signals or decode without explicit channel estimation, with reference symbols counted in $T$ and their energy counted against the power constraint. Under the aforementioned model, we show that the DoF is $1-\frac{1}{T}$ for $K=1$, and $K(1-\frac{3}{2T})$ for $K \geq 2$, when $N_r\ge K+1$, $N_t\ge\max\{K,2\}$, and $T\ge K$. The analytical results are further demonstrated by their applications to the DoF tradeoff analysis in integrated sensing and communication (
ISAC). For more general array structures, an achievability result is established, while the converse remains open in general.
Read the full abstract ▾
All authors Yifeng Xiong, Weijiang Zhao, Fan Liu, Shi Jin, Jianhua Zhang
Information Theory · Cross-listed from quant-ph
A Novel Steganography Scheme Using Quantum Hilbert Transform
Nitin Jha and Abhishek Parakh
The main goal of steganography is to transmit hidden messages in legitimate-looking communication messages. Phase-domain information hiding, however, has not been fully explored for
quantum systems. This work introduces a finite-dimensional
Quantum Hilbert Transform (QHT) as a
unitary phase operator based on the
Quantum Fourier Transform. Using this construction, we develop a QHT-based
quantum steganography scheme that embeds classical bits as weak signed phase perturbations of
quantum cover states. Bob recovers the hidden message through binary state discrimination, block aggregation, and classical error-correcting decoding.
Read the full abstract ▾
Information Theory
A Note on Binary Quadratic Systems and their relation to complexity theory
Gabriele Radici and Massimiliano Sala
Deciding whether a system of multivariate quadratic equations over $\mathbb F_2$ has a solution is a classical NP-complete problem, and remains so for square systems, with as many equations as variables. The hardness of this problem is one of the cornerstones of nowadays post-
quantum cryptography. Let $\MQ_0(n)$ and $\MQ_1(n)$ denote the sets of square quadratic systems in $n$ variables having respectively no solutions and exactly one solution. $\cup_{n\geq 2} \MQ_0(n)$ is a coNP-complete
language, while $\cup_{n\geq 2} \MQ_1(n)$ lies in DP. It is known that $\lim_{n\to \infty} |\MQ_1(n)|/|\MQ_0(n)|=1$. Here we prove the explicit finite-$n$ bounds \[ |\MQ_0(n)|<|\MQ_1(n)| \le \left(1+\frac{1}{2^n-1}\right)|\MQ_0(n)|, \] More generally, let $Q_d$ be the space of
polynomial functions $(\FF_2)^n\to\mathbb F_2$ of degree at most $d$, and let $\alpha_k$ count square systems in $(Q_d)^n$ having exactly $k$ solutions. Then \[ \alpha_0<\alpha_1 \le \left(1+\frac{1}{2^n-1}\right)\alpha_0\,, \qquad 2\le d\le n \,. \] The proof combines matroid and coding-theoretic methods. We interpret $(\FF_2)^n$ as the ground set of the evaluation matroid of $Q_d$, express $\alpha_0$ and $\alpha_1$ through characteristic
polynomials, and use a Whitney-type sign-reversing involution to show that the only terms that can push $\alpha_1-\alpha_0$ below $\alpha_1/2^n$ come from the elements of a matroid port. These are identified with minimal-support words of the Reed–Muller code $\RM(n-d-1,n)=\RM(d,n)^\perp$; the required estimate then follows from the MacWilliams identity, the minimum-distance bound $2^{d+1}$, and the even-weight structure of the code.
Read the full abstract ▾
Information Theory · Cross-listed from math.CO
The Neighbor Graph of Linear Complementary Dual (LCD) Codes
Javier de la Cruz, Anna-Lena Horlemann, Marc Newman et al. (+2 more)
Linear complementary dual (LCD) codes form an important class of linear codes with applications in cryptography, classical error correction, and
quantum coding theory. In this paper, we study the neighbor relation on LCD codes over finite fields and the graph induced by this relation, where two codes are adjacent whenever they intersect in codimension one. We determine the number of neighbors of an LCD code that are also LCD, and we use this result to analyze the structure of the corresponding neighbor graph. In particular, we prove its regularity over arbitrary finite fields and establish further regularity properties for its main structural subgraphs in the binary and odd-characteristic cases. These results provide a graph-theoretic framework for the study of LCD codes and reveal a strong combinatorial regularity in their neighborhood structure.
Read the full abstract ▾
All authors Javier de la Cruz, Anna-Lena Horlemann, Marc Newman, Carlos Vela Cabello, Wolfgang Willems
Information Theory
Resource-Constrained Semantic-Aware Remote Estimation with Overlapping Sensor Coverage
Bowen Sun and Nikolaos Pappas
We study semantic-aware remote estimation of multiple finite-state Markov sources observed by K sensors with overlapping coverage. The sensors share a time-division multiple-access uplink and differ in transmission reliability, delivery delay, and transmission budget. In each slot, the scheduler jointly selects a source and one of its monitoring sensors, or remains idle, to minimize the long-run average cost of actuation error subject to global and per-sensor transmission-frequency constraints. We formulate this problem as a finite average-cost constrained Markov decision process. We show that the transmission resource functions have rank at most K, although the global constraint may still restrict the feasible region. Consequently, the Lagrangian depends only on K effective transmission costs, and an optimal constrained solution can be represented using at most K+1 deterministic policy-recurrent-class components. We further characterize the piecewise-affine concave Lagrangian value function and derive projected dual subgradient ascent over an explicitly bounded multiplier set. Numerical results illustrate the value-function structure, the need for policy randomization in a representative instance, and the interaction between global and per-sensor transmission budgets.
Read the full abstract ▾
Information Theory · Cross-listed from eess.SP
Resolving the Discontinuity of Continuous-Time AFDM Waveforms
Yewen Cao and Yulin Shao
Continuous-time affine frequency division multiplexing (AFDM) waveforms, constructed via frequency wrapping and phase correction, are known to be sample-wise equivalent to the widely adopted discrete AFDM framework. In this paper, we uncover a fundamental and previously overlooked flaw in this construction: its complex envelope is inherently discontinuous for generic chirp parameters. We show that these discontinuities are the direct cause of the high out-of-band emission (OOBE). To resolve this issue, we propose a fundamentally different continuous-time waveform, termed stepped frequency division multiplexing (SFDM). Unlike conventional approaches that allow continuous frequency variation, SFDM freezes the instantaneous frequency at the midpoint of the underlying chirp trajectory within each Nyquist sampling interval. This design yields a complex envelope that is strictly continuous over the entire symbol duration while preserving exact sample-wise equivalence with discrete AFDM. A unified spectral analysis reveals that the superior OOBE performance of SFDM stems from the absence of internal jump discontinuities, which otherwise dominate the far-out spectral roll-off. Numerical results confirm that SFDM consistently achieves significantly lower OOBE across a wide range of chirp rates.
Read the full abstract ▾
Information Theory
A Fundamental Limit in Decentralized Decision-Making
Marco Carpentiero, Felice Scala, Vincenzo Matta et al. (+1 more)
In decentralized decision-making, several
agents connected according to a network graph aim at solving a classification problem by collecting streaming observations. Due to decentralization, they run an iterative
algorithm where, at each iteration, they can only exchange information locally with their neighbors. While decentralized estimation solutions have been shown to match the performance of optimal centralized systems, we show here that surprisingly this conclusion does not hold for decentralized decision-making. Specifically, we prove that the error probability for the best decentralized decision strategy exhibits an irreducible loss with respect to the optimal centralized classifier. This result establishes a fundamental limit for the performance of any decentralized decision strategy. We obtain an analytical relation showing that this limit is related to the interplay between decentralization and classification. The first aspect appears through the distances between the nodes in the graph, while the second aspect plays through the moment generating functions of the likelihood ratios that describe the decision problem. By applying the derived closed-form relation to different network
topologies and inference problems, we observe some interesting and perhaps unexpected behavior emerging. In particular, we characterize the scaling law (with the network size) for the loss over popular network
topologies, showing that the error probabilities might differ by orders of magnitude; and we examine how performance is affected by the relative distance between informative and uninformative
agents over the graph.
Read the full abstract ▾
All authors Marco Carpentiero, Felice Scala, Vincenzo Matta, Ali H. Sayed
Information Theory
Cyclic Codes of Length 7_p^s over F_p^m + uF_p^m : Characterization, Duals, and Applications to Quantum and LCD Codes
Payel Chandra and Kalyan Hansda
Let $R_2 = \mathbb{F}_{p^m} + u\mathbb{F}_{p^m}$ ($u^2 = 0$), where $p$ is an odd
prime and $m, s \in \mathbb{N}$. For $p \equiv 3, 5 \pmod 7$ with $\gcd(m, 6) = 1$, the cyclotomic
polynomial $\Phi_7(x)$ is irreducible over $\mathbb{F}_{p^m}$. This yields a direct sum decomposition $C = C_1 \oplus C_2$ for any cyclic code $C$ of length $7p^s$ over $R_2$, where $C_1$ has length $p^s$ and $C_2$ is a $7$-cyclotomic code of length $6p^s$. We classify $7$-cyclotomic codes into four disjoint generator-based types and calculate exact cardinalities using residue and torsion subcodes. Furthermore, explicit generators for the Euclidean dual codes $C^\perp$ are determined. As operational applications of these classified codes, we construct new families of
quantum stabilizer codes via the CSS framework and establish parameter criteria for linear codes with complementary duals (LCD codes).
Read the full abstract ▾
Information Theory
Conditional Fisher-Information Central Limit Theorems under Log-Concavity with Information-Theoretic Consequences
Tong Ye and Liu-Quan Yao
We establish conditional central limit
theorems in Fisher information under log-concavity in every fixed dimension. For conditionally centered normalized sums, after whitening by the averaged conditional covariance, the averaged conditional Fisher information converges to the dimension if and only if it is finite at one convolution level. The scalar criterion follows as the one-dimensional case; we also provide an independent scalar proof based on a second-order continuity
theorem for Fisher production on Gaussian-smoothed, tail-controlled classes. For the original sums, the averaged Fisher information
matrix converges in operator norm to the inverse averaged conditional covariance. Consequently, the conditional relative Fisher information with respect to the limiting Gaussian law vanishes, and the Gaussian logarithmic Sobolev inequality yields convergence in conditional relative
entropy and conditional
entropy. We give two operational consequences. For any fixed finite-constellation low-power input, the first-order conditional mutual-information slope converges to the Gaussian-noise
benchmark. For Gaussian signaling at any fixed signal covariance, the mutual-information gap from that
benchmark is bounded by the conditional relative Fisher deficit and hence vanishes asymptotically.
Read the full abstract ▾
Information Theory
Spatial-Code-Domain Grouped Index Modulation: Fluid-Antenna-Assisted System Design and BER Performance Analysis
Peng Zhang, Jian Dang, Yao Ge et al. (+5 more)
Fluid
antenna systems (FASs) provide reconfigurable spatial resources within compact apertures. In this paper, we introduce code-domain grouped index modulation (CGIM) and its spatial-code-domain extension, termed SCGIM, for FA-assisted transceivers. CGIM partitions the available orthogonal spreading codes into multiple subsets and jointly maps information onto their in-phase and quadrature indices and constellation symbols. In an Rx-FAS-assisted single-input multiple-output (SIMO) link, group-wise despreading separates the orthogonal code groups for parallel detection, while receive-port selection provides spatial diversity. SCGIM further associates interleaved Tx-FA port subsets with the code subsets, with the Tx-FAS conveying spatial-index information and the Rx-FAS providing selection diversity in a multiple-input multiple-output (
MIMO) link. For SCGIM, we develop maximum-likelihood (ML), staged greedy (GD), and cross-domain index message-passing (CD-IMPD) detectors. CD-IMPD exchanges soft information over a cycle-free factor graph to account for the coupling between the spatial and code indices, requiring only one inward and one outward message pass. For CGIM, the BER is derived from the joint decision regions of the despread-domain observations and averaged over the Rx-FAS selected-gain distribution under Rayleigh, Nakagami-m, and additive white Gaussian noise channels. For SCGIM, an average-BER approximation is derived from a full-pair union bound using the selected-gain density ratio and exponentially tilted quadratic-form Laplace transforms. Simulation results validate the BER analysis and show that the proposed schemes achieve lower BER and higher throughput than the considered IM schemes, while CD-IMPD achieves near-ML BER performance with lower detection complexity.
Read the full abstract ▾
All authors Peng Zhang, Jian Dang, Yao Ge, Miaowen Wen, Ziyang Liu, Liang Wu, Zaichen Zhang, Yudong Yao
Information Theory
Equivalence of Fixed-Rank and Rank-One Even-Order Symmetric Tensor Factorization
Ruba Hussen Morsi and Anas A. Rahman
In the recent work of Barbier, Ko, and the second present author on sublinear-rank symmetric
matrix factorization [Math. Stat. Learn. 9 (2026), 1-68], a key result is that, in the Bayes-optimal setting, the large-size limit of the free
entropy of the finite-rank spiked Wigner model is the same as in the rank-one case when the signal has centered i.i.d. entries. In this paper, we show that this rank-one equivalence result extends to the case of finite-rank, even-order, symmetric tensor factorization. Moreover, we give a natural reformulation of a hypothesis that was stated in the aforementioned work to be necessary for this result. As in the
matrix case, we use information-theoretic identities and replica
symmetry to reduce a known multi-dimensional variational formula for the limiting free
entropy to its one-dimensional analog. The novelty stems from the fact that said formula involves a replica symmetric potential containing Hadamard (entrywise) powers, rather than squares, of the
matrix-valued variational parameter, so the
eigenvalue-based approach used in the
matrix case must be adjusted.
Read the full abstract ▾
Information Theory · Cross-listed from eess.SP
Networked Embodied Communication: From Collective Distinguishability to Communication Reliability
Yewen Cao and Yulin Shao
Embodied
agents need to convey information to surrounding infrastructure, but their active communication interfaces may be unavailable, constrained, or intentionally inactive. Their ability to manipulate physical states offers a complementary path: messages can be encoded in deliberately selected configurations and recovered through infrastructure sensing. This principle underlies embodied communication. Yet physical differences do not guarantee distinguishable messages: a single sensing viewpoint may leave ambiguities that repeated sensing cannot resolve. This paper develops networked embodied communication, where distributed access points (APs) jointly observe message-bearing scatterer positions under fixed illumination. Under a correlated Gaussian sensing model, we characterize the additional distinguishability supplied by receive APs, establish exact redundancy conditions, and reveal how distinctions absent from individual observations can emerge through cross-AP statistical relationships. We then establish the exact asymptotic optimal maximum-error behavior of a finite alphabet under repeated independent sensing. The largest group of indistinguishable messages determines the error floor; once all messages are distinguishable, the minimum pairwise Chernoff information determines the error exponent. For a given alphabet, receiver cooperation can therefore eliminate an error floor that repetition at any individual AP cannot overcome. Building on these results, we derive finite-budget reliability conditions and jointly design the receive AP set and message-bearing positions. Numerical results show that the proposed search closely approaches exact
benchmarks on reduced instances with substantially fewer candidate evaluations than exhaustive enumeration, while receiver cooperation reduces the sensing intervals needed to guarantee reliable decoding.
Read the full abstract ▾