Peer Revenue Publish or profit

Papers

Fresh from arXiv, typeset properly. Highlighted words trade on the market.

Computer Science Information Theory

cs.IT Watch Information Theory (sign in to use)

Tuesday 8 September

Information Theory

Linear programming bounds for binary and ternary LCD Codes

We derive linear programming (LP) bounds on the minimum distance of binary and ternary linear complementary dual (LCD) codes by imposing arithmetic constraints on their weight enumerators. Special values of the weight enumerator give finitely many Gauss phases, each of which yields linear equations in the ordinary weight-distribution variables. The resulting bounds strengthen the real-valued LCD counting LP without introducing additional variables; both the number of branches and the number of added equations per branch are bounded independently of the code length. Exact certificates establish strict improvements for 62 binary parameter pairs of length at most 20 and 39 ternary pairs of length at most 14. For four binary pairs, the bounds also improve the joint-weight-enumerator LP while using fewer variables per branch. These comparisons show that Gauss-phase information provides a compact strengthening of existing LP relaxations for LCD codes.
Read the full abstract

Information Theory

Sequential Lossy Compression With Causal Conditional Perception

In this paper, we study sequential lossy compression under a causal conditional perception criterion comparing source and reconstruction distributions given the same reconstruction history. For first-order Markov sources, we formulate the finite-horizon nonanticipative rate-distortion-perception function (NRDPF) with stagewise constraints and establish one-shot lower and upper bounds on the minimum variable-length sum rate using a strengthened strong functional-representation lemma (SFRL) and common randomness. For time-varying scalar Gauss–Markov sources under pointwise mean-squared error (MSE) and conditional squared Wasserstein-$2$ fidelity, we prove Gaussian optimality, derive a log-variance characterization, and obtain a closed-form solution that recovers the classical Gaussian nonanticipative rate-distortion function (NRDF) when perception is unconstrained and the classical Gaussian RDPF when the source is stationary and memoryless.
Read the full abstract

Information Theory · Cross-listed from stat.ML

Non-Adaptive 1-Bit Mean Estimation: Minimax Rates and the Sample-Interval Tradeoff

We study distributed one-dimensional mean estimation under a 1-bit communication constraint. Each agent observes one sample, drawn independently from an unknown distribution, and returns a single bit in response to a query $Q: \mathbb{R}\to\{0,1\}$ chosen by a central learner. The distribution has mean in $[-\lambda,\lambda]$ and $k$-th central moment at most $\sigma^k$, for a fixed $k>1$. The order-optimal two-stage protocol of Lau and Scarlett uses responses from the first batch to choose the second-batch queries, motivating the question of whether this single round of interaction is necessary. We answer this negatively: for every $k>1$, a non-adaptive protocol attains the adaptive 1-bit minimax rate (and concurrent works reached the same conclusion via different strategies). We further determine the minimax sample complexity among non-adaptive 1-bit estimators when every one-set $Q^{-1}(1)$ is restricted to a union of at most $s$ intervals. Relative to unrestricted non-adaptive 1-bit querying, this constraint adds a term of order $(\lambda\sigma/(s\varepsilon^2))\log(1/\delta)$, giving the full tradeoff between sample complexity and interval complexity to within $k$-dependent constant factors. As a corollary, we identify, order-wise, the minimum interval budget needed to retain the unrestricted 1-bit minimax sample rate.
Read the full abstract

Information Theory

The Fusion Frame Phase Retrieval

The phase retrieval problem involves reconstructing a function or signal solely from the magnitude of linear measurements. Most theoretical analyses of phase retrieval algorithms rely on i.i.d. Gaussian random measurements or sub-Gaussian random measurements. In this paper, our focus is on the fusion frame phase retrieval problem, where the sampling matrices are i.i.d. rank-$r$ orthogonal projections drawn from the Haar measure. We present concentration inequalities for functions on the set of rank-$r$ orthogonal projection matrices. These inequalities are crucial for the theoretical analysis of the fusion frame phase retrieval problem. Based on these inequalities, we demonstrate that gradient descent, combined with a two-stage initialization, achieves linear convergence to the target signal up to a global phase with a measurement complexity of $O(d\log^2 d)$ when the rank $r = O(1)$. We verify this convergence through numerical results.
Read the full abstract

Information Theory · Cross-listed from math.DS

Equation free data-driven modelling of chaotic processes

We introduce a method for constructing predictive models of non cyclic physical processes directly from time-series data, without assuming an underlying differential equation. The observations define a discrete evolution rule whose recurrent behaviour captures the essential dynamics of the process. Analysing this behaviour across multiple geometric scales leads to probabilistic models in the form of Markov chains. Hyperbolicity criteria identify when these models provide a consistent statistical description of the data. The method is inspired by, and illustrated through, the analysis of a biological imaging data set referred to as the Cell Process.
Read the full abstract

All authors Aurora Poggi, Marco Martens, Hjalmar Brismar, Ozan Oktem, Liviana Palmisano

Information Theory

Quantum Matrix-Product Codes: CSS-T Characterization and Maximality

CSS-T codes are quantum error-correcting codes that play an important role in fault-tolerant quantum computation, as they help mitigate the proliferation of errors. They admit a transversal T-gate and are defined from a pair of nested classical binary linear codes satisfying a specific algebraic condition expressed in terms of their Schur square. We extend this algebraic characterization to the propagation rule known as the $(u \mid u+v)$-construction, that is, the matrix-product code constructed from two constituent codes. Moreover, for cyclic constituent codes, we provide an explicit characterization in terms of the defining cyclotomic sets, which extends existing results for cyclic codes. This framework allows the construction of new and longer CSS-T codes.
Read the full abstract

All authors Delio Jaramillo-Velez, Alessandro Neri, Adway Patra, Diego Ruano, Flavio Salizzoni

Information Theory

Non-Coherent Over-the-Air Federated Learning: Protocol, Convergence, and Device Scheduling

To mitigate the scalability bottleneck in the radio access network (RAN) in federated edge learning (FEEL), over-the-air federated learning (AirFL) exploits waveform superposition over multiple-access channels (MACs) for analog model aggregation. However, coherent AirFL typically relies on stringent PHY-layer conditions such as accurate channel state information (CSI), tight time/frequency synchronization, and frequent transceiver calibration for signal alignment. However, these requirements, if not impossible to be met, incur substantial communication and computation overhead. In this paper, we propose a non-coherent AirFL (NCAirFL) protocol over a broadband single-antenna MAC, leveraging binary dithering, unbiased non-coherent detection, and long-term error feedback to waive the need for instantaneous CSI. For NCAirFL with general smooth non-convex objectives and a constant learning rate, we establish a convergence bound achieving the convergence rate in the same order of $\mathcal{O}(1/\sqrt{T})$ as communication-ideal FedAvg, where $T$ is the total number of communication rounds. To further improve communication efficiency under data and wireless resource heterogeneity, we also derive a lower bound on the expected single-round objective decrease in the global loss conditioned on device scheduling, building upon which a surrogate objective function is obtained for jointly optimal device selection and power control. Experimental results on MNIST and CIFAR-10 corroborate that NCAirFL achieves learning performance close to FedAvg in practical settings, with the proposed device scheduling policy substantially accelerating convergence.
Read the full abstract

All authors Haifeng Wen, Nicolò Michelusi, Osvaldo Simeone, Yang Yang, Hong Xing

Information Theory

Convolutional Codes from Cyclic Codes with Guaranteed Free and Local Minimum Distances

This paper presents an algebraic method to construct convolutional codes with guaranteed free and local minimum distances without limit based on cyclic codes of odd lengths. The constructions are simple but effective, and no computer search is needed. For any two positive integers $r$ and $t$ with $1 \leq r < t$, a rate-$r/t$ convolutional code $\mathcal{C}_{\text{convol}}$ can be constructed by using a chain of $r$ cyclic codes $\mathcal{C}_0, \mathcal{C}_1, \ldots, \mathcal{C}_{r-1}$ of the same length $n$ which satisfy the inclusion condition, $\mathcal{C}_0 \supset \mathcal{C}_1 \supset \ldots \supset \mathcal{C}_{r-1}$. Such a convolutional code $\mathcal{C}_{\text{convol}}$ is composed of a semi-infinite chain of identical local codes confined in a diagonal band of width $n$. Each local code $\mathcal{C}_{\text{local}}$ of $\mathcal{C}_{\text{convol}}$ is formed from the $r$ cyclic codes in the code chain and is a specially localized subcode of the mother code $\mathcal{C}_0$ in the code chain. The minimum distance $d_{\text{local}}$ of each local code of $\mathcal{C}_{\text{convol}}$ is lower bounded by the minimum distance $d_0$ of the mother code $\mathcal{C}_0$ in the code chain. The local structure of $\mathcal{C}_{\text{convol}}$ allows it to be decoded based on a designed parity-check matrix of the mother code $\mathcal{C}_0$ using a sliding window decoding scheme.
Read the full abstract

All authors Khaled Abdel-Ghaffar, Daniel J. Costello Jr., Juane Li, Shu Lin

Information Theory

Physics of Information Geometry - Part I: Principle of Least Action on the Probability Simplex

We develop a least-action framework for describing how a probability distribution can evolve from an equilibrium state to a prescribed nonequilibrium state under constrained incremental changes. Taking a Gibbs distribution as the equilibrium reference, the framework gives a direct physical meaning to the geometry of the probability simplex: distance from equilibrium corresponds to nonequilibrium free energy, while changes between successive distributions carry an informational kinetic cost. The Pythagorean structure of relative entropy then provides the central insight of the work. It shows that intermediate distributions chosen via sequential information projections can reduce the kinetic cost of large transitions and establishes an energy-conservation-like relation between the kinetic expenditure along a path and the free energy accumulated in reaching the target distribution. Motivated by this geometry, we construct a greedy least-action path through successive information projections, obtain a closed-form characterization of each projection through the Lambert W function, and establish a finite-step performance guarantee. We further show that state-dependent costs can be incorporated naturally by reshaping the underlying Gibbs reference, providing a thermodynamic interpretation of path penalties as modifications of the effective energy landscape. Together, these results provide a unified view of distributional evolution through least action, information geometry, and nonequilibrium thermodynamics.
Read the full abstract

Information Theory

Variational Bayesian Data Detection for Multiuser MIMO Systems Corrupted by Phase Noises

Phase noise (PN), arising from imperfect local oscillators, introduces multiplicative distortions that degrade the performance of communication systems. In uplink multiuser multiple-input multiple-output (MIMO) systems, this impairment is further compounded by the presence of independent oscillators at each transmit and receive antenna, each contributing an uncorrelated noise component. Existing PN compensation algorithms at the receiver either rely on linearization approximations that lose accuracy under severe PN conditions, or incur computational complexity that scales prohibitively with the number of antennas. To address these limitations, we propose a variational Bayes (VB) framework for joint PN estimation and data detection in uplink MIMO systems. We develop VB-based detectors that treat noise statistics as latent variables, and reformulate the inference problem by absorbing the transmitter PN into the transmitted signal, treating the resulting composite variable as the inference target. Under von Mises priors, this reformulation yields exact closed-form conjugate posterior updates, from which we derive an improved detector achieving superior performance at low complexity. Simulation results demonstrate that the proposed VB algorithm achieves lower symbol error rates than the Self-Interference Whitening (SIW) algorithm and conventional phase-noise-unaware detectors across a wide range of channel conditions, modulation orders, and PN severities, while remaining computationally scalable to large MIMO deployments.
Read the full abstract

Information Theory

Finite-Modal Realization and Operator-Norm Convergence of a Source-to-Observation Electromagnetic Scattering Green Operator

Source-to-observation operators provide reusable environment-level descriptions for multi-query electromagnetic (EM) prediction and communication-mode analysis. However, in practical multiple-scattering models, these operators are represented with finitely many angular modes, and agreement for selected excitations or between successive truncation orders does not establish uniform accuracy of the full map or reliability of its singular channels. To close this gap, we formulate the environment-induced response as a scattering Green operator on fixed continuous source and observation spaces and derive an exact trace-space factorization that reconstructs the Maxwell scattered field. For fixed, pairwise-disjoint enclosing trace spheres and a well-posed collective problem, nested vector spherical wave function (VSWF) realizations converge in operator norm. A structural bound separates external modal tails from collective-resolvent sensitivity, and operator-norm convergence guarantees uniform convergence of the singular values. We further construct a finite metric core that preserves the nonzero singular values of each finite-order operator and reconstructs matched orthonormal source–field channels without introducing external-support discretization degrees of freedom (DoF) into the spectral problem. Full-wave benchmarks verify the finite-order implementation. A controlled near-resonant two-sphere study shows that adjacent-order agreement can precede resolution of the dominant high-order collective direction. It further shows that only part of the internal amplification appears in externally accessible gains and that resonance promotes a distinct high-order channel pair above an otherwise preserved low-order family. The resulting framework provides a convergent, metric-consistent finite-modal representation of multiple-scattering source-to-observation operators and their accessible channels.
Read the full abstract

All authors Zhukang Wang, Da Li, Ruifeng Li, Jinyan Ma, Jiarun Hu, Jiahui Wang, Anqi Xia, Tengjiao Wang, Said Mikki, Er-Ping Li

Information Theory

Asymptotically good binary triorthogonal codes and higher-level transversal gates

For each level of the Clifford hierarchy from the third level onward, we construct explicit asymptotically good binary CSS codes for which a strongly transversal diagonal rotation, followed by a correction from the preceding level, implements the corresponding logical rotation. We achieve this using algebraic geometry codes over binary extension fields and performing an alphabet reduction that translates orthogonality conditions over the extension field to binary overlap conditions. In particular, we obtain the first asymptotically good family of binary triorthogonal codes. We also give a stronger construction with worse parameters for which the strongly transversal physical rotation implements the desired logical rotation, with no subsequent correction. Finally, adapting an error-correction-based distillation protocol, our binary $T$-gate families yield direct constant-overhead $T$-state block distillation from noisy $T$-state inputs under sufficiently weak input noise and ideal stabilizer operations.
Read the full abstract

Information Theory · Cross-listed from math.CO

A Note on Sphere Packing Bounds for Tuple Lattice Sieving

A finite set of unit vectors is $k$-irreducible if every signed sum of between two and $k$ distinct elements has norm greater than one. Let $\mathcal{R}_k$ be the maximal asymptotic rate of such sets, and let $\kappa(\alpha)$ be the maximal asymptotic rate of spherical codes with pairwise inner products at most $\alpha$. For $k \ge 2$ we show: \begin{align} \mathcal{R}_k \le \min_{1 \le r \le \lfloor k/2 \rfloor} \frac{1}{r} \, \kappa\!\left(1 - \frac{1}{2r}\right) \, . \end{align} Combining this with standard sphere packing bounds, for large $k$ we obtain an almost-tight asymptotic comparison with the known lower bounds: \begin{align} \left(\tfrac{1}{2}-o(1)\right) \, \frac{\log_2 k}{k} \le \mathcal{R}_k \le (1 + o(1)) \, \frac{\log_2 k}{k} \, . \end{align}
Read the full abstract

Information Theory

Function Tables for Secure Distributed Matrix Multiplication

We introduce function tables, an entrywise representation of the coefficient functions that appear in the worker responses of a secure distributed matrix multiplication (SDMM) scheme. We work under the outer-product partition, with $K$ row blocks, $L$ column blocks, and privacy against any $T$ colluding workers, in the general model of linear encoding and linear decoding. In this representation, privacy is a rank condition on the data and mask coefficients, and decodability is linear independence of the desired entries modulo the nuisance space. Degree tables, cyclic-addition tables, and algebraic-geometry constructions are the special cases obtained by restricting the coefficient functions to a structured family; we impose no such restriction, so our converses bind every linear scheme. For $T=1$, we determine the exact optimum over every finite field $\mathbb{F}_q$: it is $KL+K+L$ when $q\geq3$, and $KL+K+L+1$ over $\mathbb{F}_2$, where the identity $z^2=z$ forces one more worker. For arbitrary $T$, we prove $N\geq KL+K+L$ and $N\geq\max\{K,L\}+T$ with no MDS hypothesis on the masks; the first is stronger than the previously known bound $KL+\max\{K,L\}+2T-1$ whenever $\min\{K,L\}\geq2T$. We then reduce field feasibility exactly to MDS existence: a scheme exists over $\mathbb{F}_q$ if and only if an $[\max\{K,L\}+T,T]$ linear MDS code does, and whenever it does, a Cartesian construction attains $N=(K+T)(L+T)$ over that same field. For $T=2$ this makes $q\geq\max\{K,L\}+1$ necessary and sufficient, and we give a projective-line construction with $N=KL+K+L+2$ whenever $KL+K+L$ divides $q-1$; for $K,L\geq2$ it matches the best known worker count while requiring only an element of order $KL+K+L$.
Read the full abstract

All authors Rafael G. L. D'Oliveira, Giulia Gaggero, Arturo Jaramillo Gil, Hiram H. López, Cecilia Martínez-Reyes, Divyesh Vaghasiya

Monday 7 September

Information Theory · Cross-listed from math.HO

Perfect Combinatorial Structures in Coding Theory and Cryptography

This book develops algebraic and combinatorial methods for studying discrete structures. It brings together graph theory, Boolean functions, Fourier analysis on finite groups, coding theory, perfect colorings and perfect codes, association schemes, Latin squares, and related topics. A central theme is the interaction between different representations of the same object: combinatorial, algebraic, spectral, and coding-theoretic. The main mathematical object studied in this book is a perfect coloring of a graph, or, equivalently, an equitable partition of a graph. The book is intended for advanced undergraduate and graduate students in mathematics and computer science, as well as for researchers in discrete mathematics, combinatorics, coding theory, and related fields.
Read the full abstract

Information Theory · Cross-listed from math.CO

Energy Estimation of the Hamming Slice and its Applications

Let $R=\mathbb{Z}/(2^n-1)\mathbb{Z}$, where $n\geq 3$, and let $S_w\subseteq R$ be the residues whose canonical $n$-digit binary expansion has Hamming weight $w$. We obtain, in particular, an asymptotic formula for the additive energy of $S_w$ \[ E(S_w)=\frac{\left|S_w\right|^4}{|R|}+ \mathcal{O}\left(|R|^3 n^{-3} \right), \] which holds uniformly in $w$. The error term is optimal in order, with a matching lower bound for $w=\lfloor n/2+\sqrt{n} \rfloor$. It follows that triple sums of arbitrary unit dilates have asymptotically uniform representation counts when $\prod_{j=1}^{3} \left|S_{w_j} \right| /\left(|R| n^{-3/5}\right)^3\to\infty$, and that double sums have asymptotically full support when $\left|S_{w_1}\right| \left|S_{w_2} \right|/\left(|R| n^{-3/4}\right)^2\to\infty$. In the proof, modular collisions are represented using a cyclic binary carry automaton; this appears to be a novel approach in this area of problems.
Read the full abstract

All authors Aniruddha Biswas, Jihun Hwang, Hemanta K. Maji, Ilya D. Shkredov, Xiuyu Ye

Information Theory · Cross-listed from cond-mat.stat-mech

Leveraged Learning: entropy cleared per bit received

An expository essay containing some new results. A learner holds a prior belief over Boolean maps that answer a finite set of $Q$ questions, and receives answers one by one. Each answer carries surprisal and can clear predictive uncertainty about both the question asked and questions still unasked. We quantify this effect by the leverage: table entropy cleared per bit of surprisal received. Taking expectations over the truth prior and the question order, define the aggregate leverage as the ratio of expected uncertainty cleared to expected surprisal received. It equals one for independent answers and can exceed one for correlated answers. At finite size, this ratio is determined exactly by a single sequence: the mean entropy $G_\ell$ of the answers to $\ell$ questions. As the number of input bits grows at fixed asked fraction $t=\ell/Q$, a limiting increment profile $\gamma(t)$ determines the macroscopic learning curve. With $\eta_0$ the limiting initial entropy per question, the leverage becomes $L(t)= \frac{\eta_0-(1-t)\gamma(t)} {\int_0^t\gamma(x),dx}$. For exchangeable priors, de Finetti's representation gives a constant bulk profile $\gamma(t)$: deduction is confined to a boundary layer at $t=0$, and the leverage is forced to a hyperbolic form, as surprisal grows linearly. By contrast, we construct a simplicity prior with nontrivial bulk learning by grading Boolean maps by their polynomial degree over $\mathbb{F}_2$ and allocating weight across degree classes through a CDF $F$. Reed-Muller capacity then yields $\gamma(t)=1-F(t)$. This realizes any nonincreasing profile taking values in $[0,1]$, together with the corresponding macroscopic leverage curve.
Read the full abstract

Information Theory

Algorithmic List Decoding of Reed-Solomon Codes up to Capacity

We give a deterministic polynomial-time list-decoding algorithm for Reed-Solomon codes over prime fields that approaches list-decoding capacity for every evaluation set and every constant rate.
Read the full abstract

All authors Joshua Brakensiek, Yeyuan Chen, Aaron Putterman, Zihan Zhang, Kai Zhe Zheng

Information Theory

Exact Degrees of Freedom of Spatially Sparse MIMO Channels Without Prior CSI

We characterize the degree of freedom (DoF) of a point-to-point blockwise memoryless channel without prior channel state information (CSI), with a fixed number $K$ of propagation paths, where the transmitter (Tx) and the receiver (Rx) are equipped with nonuniform linear arrays (NULAs) of $N_t$ and $N_r$ antennas, respectively. The positions of array elements are fixed, known, pairwise distinct, and need not be equally spaced. The uniform linear array (ULA) is a special case. In each block of length $T$, the continuous angles of arrival (AoAs), angles of departure (AoDs), and independent complex Gaussian path gains are redrawn. Both Tx and Rx know the state distributions but are not given the current realizations before transmission. The receiver may estimate the channel from reference signals or decode without explicit channel estimation, with reference symbols counted in $T$ and their energy counted against the power constraint. Under the aforementioned model, we show that the DoF is $1-\frac{1}{T}$ for $K=1$, and $K(1-\frac{3}{2T})$ for $K \geq 2$, when $N_r\ge K+1$, $N_t\ge\max\{K,2\}$, and $T\ge K$. The analytical results are further demonstrated by their applications to the DoF tradeoff analysis in integrated sensing and communication (ISAC). For more general array structures, an achievability result is established, while the converse remains open in general.
Read the full abstract

All authors Yifeng Xiong, Weijiang Zhao, Fan Liu, Shi Jin, Jianhua Zhang

Information Theory · Cross-listed from quant-ph

A Novel Steganography Scheme Using Quantum Hilbert Transform

The main goal of steganography is to transmit hidden messages in legitimate-looking communication messages. Phase-domain information hiding, however, has not been fully explored for quantum systems. This work introduces a finite-dimensional Quantum Hilbert Transform (QHT) as a unitary phase operator based on the Quantum Fourier Transform. Using this construction, we develop a QHT-based quantum steganography scheme that embeds classical bits as weak signed phase perturbations of quantum cover states. Bob recovers the hidden message through binary state discrimination, block aggregation, and classical error-correcting decoding.
Read the full abstract

Information Theory

A Note on Binary Quadratic Systems and their relation to complexity theory

Deciding whether a system of multivariate quadratic equations over $\mathbb F_2$ has a solution is a classical NP-complete problem, and remains so for square systems, with as many equations as variables. The hardness of this problem is one of the cornerstones of nowadays post-quantum cryptography. Let $\MQ_0(n)$ and $\MQ_1(n)$ denote the sets of square quadratic systems in $n$ variables having respectively no solutions and exactly one solution. $\cup_{n\geq 2} \MQ_0(n)$ is a coNP-complete language, while $\cup_{n\geq 2} \MQ_1(n)$ lies in DP. It is known that $\lim_{n\to \infty} |\MQ_1(n)|/|\MQ_0(n)|=1$. Here we prove the explicit finite-$n$ bounds \[ |\MQ_0(n)|<|\MQ_1(n)| \le \left(1+\frac{1}{2^n-1}\right)|\MQ_0(n)|, \] More generally, let $Q_d$ be the space of polynomial functions $(\FF_2)^n\to\mathbb F_2$ of degree at most $d$, and let $\alpha_k$ count square systems in $(Q_d)^n$ having exactly $k$ solutions. Then \[ \alpha_0<\alpha_1 \le \left(1+\frac{1}{2^n-1}\right)\alpha_0\,, \qquad 2\le d\le n \,. \] The proof combines matroid and coding-theoretic methods. We interpret $(\FF_2)^n$ as the ground set of the evaluation matroid of $Q_d$, express $\alpha_0$ and $\alpha_1$ through characteristic polynomials, and use a Whitney-type sign-reversing involution to show that the only terms that can push $\alpha_1-\alpha_0$ below $\alpha_1/2^n$ come from the elements of a matroid port. These are identified with minimal-support words of the Reed–Muller code $\RM(n-d-1,n)=\RM(d,n)^\perp$; the required estimate then follows from the MacWilliams identity, the minimum-distance bound $2^{d+1}$, and the even-weight structure of the code.
Read the full abstract

Information Theory · Cross-listed from math.CO

The Neighbor Graph of Linear Complementary Dual (LCD) Codes

Linear complementary dual (LCD) codes form an important class of linear codes with applications in cryptography, classical error correction, and quantum coding theory. In this paper, we study the neighbor relation on LCD codes over finite fields and the graph induced by this relation, where two codes are adjacent whenever they intersect in codimension one. We determine the number of neighbors of an LCD code that are also LCD, and we use this result to analyze the structure of the corresponding neighbor graph. In particular, we prove its regularity over arbitrary finite fields and establish further regularity properties for its main structural subgraphs in the binary and odd-characteristic cases. These results provide a graph-theoretic framework for the study of LCD codes and reveal a strong combinatorial regularity in their neighborhood structure.
Read the full abstract

All authors Javier de la Cruz, Anna-Lena Horlemann, Marc Newman, Carlos Vela Cabello, Wolfgang Willems

Information Theory

Resource-Constrained Semantic-Aware Remote Estimation with Overlapping Sensor Coverage

We study semantic-aware remote estimation of multiple finite-state Markov sources observed by K sensors with overlapping coverage. The sensors share a time-division multiple-access uplink and differ in transmission reliability, delivery delay, and transmission budget. In each slot, the scheduler jointly selects a source and one of its monitoring sensors, or remains idle, to minimize the long-run average cost of actuation error subject to global and per-sensor transmission-frequency constraints. We formulate this problem as a finite average-cost constrained Markov decision process. We show that the transmission resource functions have rank at most K, although the global constraint may still restrict the feasible region. Consequently, the Lagrangian depends only on K effective transmission costs, and an optimal constrained solution can be represented using at most K+1 deterministic policy-recurrent-class components. We further characterize the piecewise-affine concave Lagrangian value function and derive projected dual subgradient ascent over an explicitly bounded multiplier set. Numerical results illustrate the value-function structure, the need for policy randomization in a representative instance, and the interaction between global and per-sensor transmission budgets.
Read the full abstract

Information Theory · Cross-listed from eess.SP

Resolving the Discontinuity of Continuous-Time AFDM Waveforms

Continuous-time affine frequency division multiplexing (AFDM) waveforms, constructed via frequency wrapping and phase correction, are known to be sample-wise equivalent to the widely adopted discrete AFDM framework. In this paper, we uncover a fundamental and previously overlooked flaw in this construction: its complex envelope is inherently discontinuous for generic chirp parameters. We show that these discontinuities are the direct cause of the high out-of-band emission (OOBE). To resolve this issue, we propose a fundamentally different continuous-time waveform, termed stepped frequency division multiplexing (SFDM). Unlike conventional approaches that allow continuous frequency variation, SFDM freezes the instantaneous frequency at the midpoint of the underlying chirp trajectory within each Nyquist sampling interval. This design yields a complex envelope that is strictly continuous over the entire symbol duration while preserving exact sample-wise equivalence with discrete AFDM. A unified spectral analysis reveals that the superior OOBE performance of SFDM stems from the absence of internal jump discontinuities, which otherwise dominate the far-out spectral roll-off. Numerical results confirm that SFDM consistently achieves significantly lower OOBE across a wide range of chirp rates.
Read the full abstract

Information Theory

A Fundamental Limit in Decentralized Decision-Making

In decentralized decision-making, several agents connected according to a network graph aim at solving a classification problem by collecting streaming observations. Due to decentralization, they run an iterative algorithm where, at each iteration, they can only exchange information locally with their neighbors. While decentralized estimation solutions have been shown to match the performance of optimal centralized systems, we show here that surprisingly this conclusion does not hold for decentralized decision-making. Specifically, we prove that the error probability for the best decentralized decision strategy exhibits an irreducible loss with respect to the optimal centralized classifier. This result establishes a fundamental limit for the performance of any decentralized decision strategy. We obtain an analytical relation showing that this limit is related to the interplay between decentralization and classification. The first aspect appears through the distances between the nodes in the graph, while the second aspect plays through the moment generating functions of the likelihood ratios that describe the decision problem. By applying the derived closed-form relation to different network topologies and inference problems, we observe some interesting and perhaps unexpected behavior emerging. In particular, we characterize the scaling law (with the network size) for the loss over popular network topologies, showing that the error probabilities might differ by orders of magnitude; and we examine how performance is affected by the relative distance between informative and uninformative agents over the graph.
Read the full abstract

All authors Marco Carpentiero, Felice Scala, Vincenzo Matta, Ali H. Sayed

Information Theory

Cyclic Codes of Length 7_p^s over F_p^m + uF_p^m : Characterization, Duals, and Applications to Quantum and LCD Codes

Let $R_2 = \mathbb{F}_{p^m} + u\mathbb{F}_{p^m}$ ($u^2 = 0$), where $p$ is an odd prime and $m, s \in \mathbb{N}$. For $p \equiv 3, 5 \pmod 7$ with $\gcd(m, 6) = 1$, the cyclotomic polynomial $\Phi_7(x)$ is irreducible over $\mathbb{F}_{p^m}$. This yields a direct sum decomposition $C = C_1 \oplus C_2$ for any cyclic code $C$ of length $7p^s$ over $R_2$, where $C_1$ has length $p^s$ and $C_2$ is a $7$-cyclotomic code of length $6p^s$. We classify $7$-cyclotomic codes into four disjoint generator-based types and calculate exact cardinalities using residue and torsion subcodes. Furthermore, explicit generators for the Euclidean dual codes $C^\perp$ are determined. As operational applications of these classified codes, we construct new families of quantum stabilizer codes via the CSS framework and establish parameter criteria for linear codes with complementary duals (LCD codes).
Read the full abstract

Information Theory

Conditional Fisher-Information Central Limit Theorems under Log-Concavity with Information-Theoretic Consequences

We establish conditional central limit theorems in Fisher information under log-concavity in every fixed dimension. For conditionally centered normalized sums, after whitening by the averaged conditional covariance, the averaged conditional Fisher information converges to the dimension if and only if it is finite at one convolution level. The scalar criterion follows as the one-dimensional case; we also provide an independent scalar proof based on a second-order continuity theorem for Fisher production on Gaussian-smoothed, tail-controlled classes. For the original sums, the averaged Fisher information matrix converges in operator norm to the inverse averaged conditional covariance. Consequently, the conditional relative Fisher information with respect to the limiting Gaussian law vanishes, and the Gaussian logarithmic Sobolev inequality yields convergence in conditional relative entropy and conditional entropy. We give two operational consequences. For any fixed finite-constellation low-power input, the first-order conditional mutual-information slope converges to the Gaussian-noise benchmark. For Gaussian signaling at any fixed signal covariance, the mutual-information gap from that benchmark is bounded by the conditional relative Fisher deficit and hence vanishes asymptotically.
Read the full abstract

Information Theory

Spatial-Code-Domain Grouped Index Modulation: Fluid-Antenna-Assisted System Design and BER Performance Analysis

Fluid antenna systems (FASs) provide reconfigurable spatial resources within compact apertures. In this paper, we introduce code-domain grouped index modulation (CGIM) and its spatial-code-domain extension, termed SCGIM, for FA-assisted transceivers. CGIM partitions the available orthogonal spreading codes into multiple subsets and jointly maps information onto their in-phase and quadrature indices and constellation symbols. In an Rx-FAS-assisted single-input multiple-output (SIMO) link, group-wise despreading separates the orthogonal code groups for parallel detection, while receive-port selection provides spatial diversity. SCGIM further associates interleaved Tx-FA port subsets with the code subsets, with the Tx-FAS conveying spatial-index information and the Rx-FAS providing selection diversity in a multiple-input multiple-output (MIMO) link. For SCGIM, we develop maximum-likelihood (ML), staged greedy (GD), and cross-domain index message-passing (CD-IMPD) detectors. CD-IMPD exchanges soft information over a cycle-free factor graph to account for the coupling between the spatial and code indices, requiring only one inward and one outward message pass. For CGIM, the BER is derived from the joint decision regions of the despread-domain observations and averaged over the Rx-FAS selected-gain distribution under Rayleigh, Nakagami-m, and additive white Gaussian noise channels. For SCGIM, an average-BER approximation is derived from a full-pair union bound using the selected-gain density ratio and exponentially tilted quadratic-form Laplace transforms. Simulation results validate the BER analysis and show that the proposed schemes achieve lower BER and higher throughput than the considered IM schemes, while CD-IMPD achieves near-ML BER performance with lower detection complexity.
Read the full abstract

All authors Peng Zhang, Jian Dang, Yao Ge, Miaowen Wen, Ziyang Liu, Liang Wu, Zaichen Zhang, Yudong Yao

Information Theory

Equivalence of Fixed-Rank and Rank-One Even-Order Symmetric Tensor Factorization

In the recent work of Barbier, Ko, and the second present author on sublinear-rank symmetric matrix factorization [Math. Stat. Learn. 9 (2026), 1-68], a key result is that, in the Bayes-optimal setting, the large-size limit of the free entropy of the finite-rank spiked Wigner model is the same as in the rank-one case when the signal has centered i.i.d. entries. In this paper, we show that this rank-one equivalence result extends to the case of finite-rank, even-order, symmetric tensor factorization. Moreover, we give a natural reformulation of a hypothesis that was stated in the aforementioned work to be necessary for this result. As in the matrix case, we use information-theoretic identities and replica symmetry to reduce a known multi-dimensional variational formula for the limiting free entropy to its one-dimensional analog. The novelty stems from the fact that said formula involves a replica symmetric potential containing Hadamard (entrywise) powers, rather than squares, of the matrix-valued variational parameter, so the eigenvalue-based approach used in the matrix case must be adjusted.
Read the full abstract

Information Theory · Cross-listed from eess.SP

Networked Embodied Communication: From Collective Distinguishability to Communication Reliability

Embodied agents need to convey information to surrounding infrastructure, but their active communication interfaces may be unavailable, constrained, or intentionally inactive. Their ability to manipulate physical states offers a complementary path: messages can be encoded in deliberately selected configurations and recovered through infrastructure sensing. This principle underlies embodied communication. Yet physical differences do not guarantee distinguishable messages: a single sensing viewpoint may leave ambiguities that repeated sensing cannot resolve. This paper develops networked embodied communication, where distributed access points (APs) jointly observe message-bearing scatterer positions under fixed illumination. Under a correlated Gaussian sensing model, we characterize the additional distinguishability supplied by receive APs, establish exact redundancy conditions, and reveal how distinctions absent from individual observations can emerge through cross-AP statistical relationships. We then establish the exact asymptotic optimal maximum-error behavior of a finite alphabet under repeated independent sensing. The largest group of indistinguishable messages determines the error floor; once all messages are distinguishable, the minimum pairwise Chernoff information determines the error exponent. For a given alphabet, receiver cooperation can therefore eliminate an error floor that repetition at any individual AP cannot overcome. Building on these results, we derive finite-budget reliability conditions and jointly design the receive AP set and message-bearing positions. Numerical results show that the proposed search closely approaches exact benchmarks on reduced instances with substantially fewer candidate evaluations than exhaustive enumeration, while receiver cooperation reduces the sensing intervals needed to guarantee reliable decoding.
Read the full abstract