Peer Revenue Publish or profit

Papers

Fresh from arXiv, typeset properly. Highlighted words trade on the market.

Computer Science Information Theory

cs.IT Watch Information Theory (sign in to use)

Tuesday 29 September

Information Theory · Cross-listed from eess.SP

End-to-End Optical Semantic Communication over a Nonlinear WDM Fiber Link

Emerging optical-network applications increasingly use received data for inference and control rather than exact source reproduction, creating an opportunity to trade bit-level fidelity for greater transmission reach and efficiency. We propose an end-to-end optical semantic communication system for joint image classification and reconstruction over a nonlinear wavelength-division multiplexed (WDM) fiber channel. The system maps each image directly into a fixed-length sequence of channel symbols that preserves task-relevant information, without explicit source compression or channel coding. Experiments on the MNIST dataset cover launch powers from -9 to +3 dBm, fiber lengths up to 800 km, and 16-, 64-, and 256-Quadrature Amplitude Modulation (QAM) formats. At 0 dBm, classification accuracy remains between 98.92% and 99.31% across all tested link lengths and modulation orders, while requiring fewer transmitted symbols than a Low-Density Parity-Check (LDPC)-coded JPEG baseline at every tested modulation order. These results show that semantic communication can simultaneously extend optical reach and reduce transmission resources by conveying only task-relevant information.
Read the full abstract

Information Theory · Cross-listed from quant-ph

A Memory-Magic Exchange Law in Streaming Clifford+T Compilation

A phase that reaches a fault-tolerant processor in additive pieces can be remembered until the last piece arrives, or executed on arrival: the first option costs classical memory carried across rounds, the second costs magic states committed before the phase is known. We determine the exchange rate $\alpha$, committed $T$ gates per bit of memory forgone, for ancilla-free coordinatewise Clifford+$T$ compilation. The Ramanujan bound gives $\alpha\ge2$ with explicit constants, the square-root barrier of the spectral method. An elementary determinant method, using that quaternion numerators lie on spheres in both real embeddings of $\mathbb{Q}(\sqrt2)$, counts words near any rotation coset below that barrier. With a height dichotomy for the sphere sections it produces and a fibration over rational projections, it gives every $\alpha<5/2$ unconditionally and uniformly over frames, by an exact SMT check of its continuum case analysis; $5/2$ is where this method stops. At Clifford-framed cosets the volume law holds up to subexponential factors: all but a vanishing fraction of $z$-rotations need $T$-count $(3-o(1))\log_2(1/\varepsilon)$, and processes whose committed pieces are near Clifford-framed $z$-rotations, including per-rotation pipelines, have $\alpha\ge3-o(1)$, which a fractional-passthrough family attains under the Ross-Selinger typical-cost hypothesis. Under an equidistribution conjecture supported by exhaustive enumeration to $T$-count 22, $\alpha=3$ in general and memory should be shed in whole rotations. The bounds hold even when the phases cancel to the identity; side information enters through a conditional entropy; probabilistic mixing halves the costs but not the rate. With clean ancillas and a phase-gradient catalyst, table lookups batched over coordinates drive the rate to $O(1/\log\log(1/\varepsilon))$, so the constant-rate law is specific to coordinatewise synthesis.
Read the full abstract

Information Theory

Rotatable Antenna-Enabled Space-Air-Ground Integrated Networks: Opportunities and Challenges

Space-air-ground integrated networks (SAGINs) are expected to support ubiquitous three-dimensional (3D) communication and sensing services in future sixth-generation (6G) wireless networks. However, heterogeneous mobility and service requirements across the space, air, and ground segments challenge fixed-boresight or fixed-sector antennas in supporting wide-area coverage, maintaining directional alignment over time-varying communication links, and flexibly adjusting observation directions for sensing tasks. To address these limitations, non-fixed flexible antenna architectures, such as fluid antenna system (FAS), movable antenna (MA), and pinching antenna, have garnered significant interest in recent years. Among them, rotatable antenna (RA) technology has emerged as a promising solution by enabling mechanical or electronic boresight adjustment while keeping the antenna positions fixed. This article investigates the roles of RA technology in enabling communication and sensing in SAGINs. Specifically, we first explain how RA boresight control complements platform mobility and supports wide-area coverage, dynamic directional transmission, cross-segment cooperative operation, and cooperative sensing. We then discuss the main design challenges, potential approaches, and future research directions, including channel acquisition and predictive tracking, joint orientation control and access/handover coordination, cross-segment coordination and resource management, as well as deployment tradeoffs and practical implementation. Finally, an RA array prototype and two representative simulation studies are presented to illustrate the feasibility and potential performance gains of RA-enabled SAGINs.
Read the full abstract

All authors Yanhua Tan, Beixiong Zheng, Tiantian Ma, Qingjie Wu, Lipeng Zhu, Wenyan Ma, Cheng-Xiang Wang, Robert Schober, Rui Zhang

Information Theory

Performance Guarantees of SIC-Based Decoding for VLSF Codes in Hardcore-Regulated MAC

Spatial regulation suffices to guarantee reliable, low-latency communication using variable-length stop-feedback (VLSF) codes over multiple access channels. The delay performance of VLSF codes under successive interference cancellation is characterized for transmitters within a coverage region. For deployments modeled by hardcore point processes, the signal-to-interference-plus-noise ratio (SINR) admits a positive lower bound for all transmitters within the coverage region. Under a predefined total error probability constraint, these transmitters are decodable within an upper-bounded delay. For each transmitter, the decoding delay is well approximated by an inverse Gaussian distribution parameterized by the codebook size, target error probability, and the SINR lower bound. Numerical results confirm that hardcore regulation provides uniform performance guarantees across links.
Read the full abstract

All authors Kevin Zagalo, Guodong Sun, Philippe Mary, Samir M. Perlaza, Jean-Marie Gorce

Information Theory

Six Families of Binary Codes Arising from Ding's Conjectures

Ding \cite{Ding2016} proposed ten conjectures on binary linear codes arising from Boolean functions. Four of them, namely Conjectures 38–41, were subsequently proved by Göloğlu and Krasnayová \cite{GologluKrasnayova2019}. In this paper, we investigate the remaining six conjectures, namely Conjectures 19, 27, 30, 33, 34, and 37. For Conjectures~19 and~27, we obtain common weight restrictions and several infinite five-weight families. For Conjecture~30, we prove that every admissible code has three, four, or five nonzero weights, and an explicit four-weight example disproves the original “three or five weights” assertion. For Conjecture~33, an infinite five-weight family is obtained. For Conjecture~34, we obtain a general $(2h+1)$-weight upper bound and give an explicit six-weight counterexample, showing that the original “three or five weights” assertion is false in general, where $h$ is a positive integer. The case $h=3$ with $3\nmid m$ is also completely determined. Finally, Conjecture~37 is completely resolved by combining the known results of Ahmadi and Shafaeiabr \cite{AhmadiShafaeiabr2023} with the treatment of the two remaining classes $(a)$ and $(b)$.
Read the full abstract

All authors Xiaoqiang Wang, Shiyan Xiong, Mu yuan, Jing Qiu, Dabin Zheng, Jiawei He

Information Theory · Cross-listed from cs.NI

Exponential Backoff: Meta-Stability and Implicit Admission Control

We analyze exponential backoff, an algorithm used to share a single communication channel in a distributed manner between several users, in a similar way as many networking standards such as 802.11. We demonstrate that this algorithm has a meta-stable behavior, in the sense that the system oscillates over long time-scales between meta-stable configurations where only a subset of the sources effectively access the channel. In other words, meta-stability creates a form of implicit admission control. We provide both theoretical tools and numerical experiments to understand this phenomenon further. Our experiments are fully reproducible and the code is publicly available as a Python package available at https://pypi.org/project/slotted-aloha-simulator/.
Read the full abstract

Information Theory

Evolving Towards Better Codes: LLM-Guided Search for High-Distance Binary Linear Codes

Evolutionary program search driven by large language models (LLMs) has produced record-breaking constructions for open problems in combinatorics and beyond. We apply this approach to the longstanding problem of improving the best-known bounds for binary linear codes. Building on the EvoTune evolutionary framework and the ShinkaEvolve codebase, we introduce LinCodeEvolve, which evolves code-construction programs against an exact minimum-distance evaluator. A strategy loop combines diversity-driven search and expert supervision: when progress plateaus, new strategies are used to redirect the search. LinCodeEvolve discovers seven record-breaking codes, $[172,21,66]$, $[173,20,68]$, $[176,21,68]$, $[181,21,70]$, $[184,21,72]$, $[189,22,72]$ and $[200,21,77]$, six of which have concise quasi-cyclic descriptions. With standard code modification techniques, they improve $22$ entries of the tables. Every code is verified by exhaustive enumeration. These results suggest that LLM-guided search can help find improved codes and complement existing methods in coding theory.
Read the full abstract

All authors Amal Seddas, Vladyslav Shashkov, Maryna Viazovska, Emmanuel Abbe

Information Theory · Cross-listed from eess.SP

Efficient Transmit Waveform Design for MIMO-OFDM DFRC Systems with 1-Bit DACS

This paper studies efficient waveform design for MIMO-OFDM dual-functional radar-communication (DFRC) systems with 1-bit digital-to-analog converters (DACs), which remains underexplored in the literature. We formulate the DFRC waveform design problem by maximizing the trace of the target angular Fisher information matrix (FIM), subject to symbol-error probability constraints realized via constructive interference (CI) and a time-domain 1-bit transmit alphabet constraint. The resulting problem is a large-scale nonlinear integer programming problem. We develop an inexact alternating direction method of multipliers (ADMM) algorithm with alternating time- and frequency-domain updates. The proposed scheme enables subcarrier-wise optimization in the frequency domain and closed-form primal and dual updates in the time domain. In particular, the CI constraints are deliberately retained in both the time- and frequency-domain subproblems to promote the feasibility of intermediate iterates and improve the convergence behavior of ADMM. Simulation results demonstrate promising DFRC performance.
Read the full abstract

Information Theory

HARS: LDPC Bit-Flipping Decoding With Initial-Syndrome-Conditioned Parameter Mapping and Local-Reliability Weighting

HARS (Hybrid Adaptive Reliability-Aware and Syndrome-Aware) is a bit-flipping decoder that combines local channel reliability with parameter selection from the initial syndrome. A bounded check reliability modifies the parity-check weight, while the initial syndrome weight selects the base weight, reliability coefficient, threshold decay factor, and perturbation amplitude for each frame. Computing these quantities at initialization supports synchronous multi-bit updates with a simple iterative datapath. For rate-one-half PEGReg and WiMAX codes over the binary-input additive white Gaussian noise channel, HARS reduces both bit-error rate (BER) and mean iteration count relative to a calibrated SM-NGDBF baseline. The PEGReg BER at 3.25 dB is approximately one-sixth of the comparison value; the WiMAX BER at 2.75 dB is reduced by 59%. A seven-fractional-bit FPGA implementation shares 132 variable-node lanes among four frame contexts. Precomputed check weights, encoded threshold states, and parallel perturbation generation support one group per clock during sustained decoding. On an XC7A200T at 60 MHz, for preloaded 128-frame batches with a ready receiver, measured coded throughputs are 49.7 Mb/s at 2.50 dB and 361.9 Mb/s at 4.00 dB, including initialization and output transfers.
Read the full abstract

Information Theory

On the Capacity of DNA Labeling in the Single-Label Setting

DNA labeling has attracted increasing attention in biomedical applications, including molecular imaging, diagnostics, and genomic analysis. In a DNA labeling process, a set of DNA sequence patterns, referred to as labels, is designed according to the requirements of a specific application. For each DNA sequence, the labeling process generates an output sequence that records the positions of the labels. DNA sequences with different labeling outputs can therefore be distinguished through the labeling process. To quantify this capability, the labeling capacity is defined as the exponential growth rate of the maximum number of DNA sequences that can be distinguished through the labeling process as the sequence length tends to infinity [2]. To date, the labeling capacities of several cases in the single-label setting have been determined. In this paper, we formulate the labeling process as a deterministic channel and show that its zero-error capacity is equal to the labeling capacity. For a single label, the corresponding channel can be represented by a star graph. Thus, characterizing the labeling capacity of a single label is equivalent to determining the zero-error capacity of the corresponding star graph. We derive the zero-error capacities of all star graphs, thereby providing a complete characterization of the labeling capacities for all single-label cases. Furthermore, we develop a general method for constructing capacity-achieving codes. These results apply to labeling problems over arbitrary finite alphabets and are not restricted to the DNA alphabet. Finally, for a fixed label length, we exactly characterize the range of achievable labeling capacities and identify all single-label structures that attain the minimum and maximum capacities.
Read the full abstract

All authors Zihan Wu, Qi Cao, Ling Liu, Baoming Bai

Information Theory

Surrogate-Enhanced Fractional Programming for MIMO Device-to-Device Interference Networks

Interference management in multi-stream multi-input multi-output (MIMO) device-to-device (D2D) networks often leads to weighted sum-rate maximization with sum-log-determinant involving matrix-valued signal-to-interference-plus-noise ratios (SINRs). The state-of-the-art paradigms, including weighted minimum mean-square error (WMMSE) and fractional programming (FP), have achieved tremendous success in link scheduling, power control, and beamforming problems. Recently, an upgraded FP approach, named surrogate-enhanced FP (SEFP) in a scalar form, has attained improved performance in joint uplink scheduling and power control in coordinated multicell SISO networks. The proposed SEFP improves the surrogate construction of the classical Lagrangian dual transform plus quadratic transform for logarithmic fractional objectives with a novel reciprocal-inverse transform (RIT), yet its extension to the matrix form for MIMO settings does not seem straightforward because the matrix ratio and the auxiliary matrix generally do not commute. In this paper, by leveraging mathematical tools from Hermitian functional calculus, we extend RIT to matrix ratios by lifting the scalar RIT along the eigendirections of an auxiliary matrix and recasting the resulting directional construction in an operator form. Following, we develop a matrix SEFP framework for weighted sum-log-determinant maximization. Further, we establish a unified view of SEFP and the recently proposed XMMSE method, specify when the two algorithms attribute to identical minorization-maximization (MM) surrogates and variable update trajectories, and prove XMMSE can be considered as a special case of SEFP under the algorithmic family perspective. Inspired by the unified view, we develop SEFPLinQ for the joint scheduling and beamforming optimization in flexible-association MIMO D2D networks. Numerical results demonstrate consistent performance gains.
Read the full abstract

All authors Zihan Jiao, Xinping Yi, Shi Jin, Giuseppe Caire

Information Theory

On the Lack of Periodicity of Walker Satellite Constellation Routing Tables

In a referential that rotates with Earth, the dynamics of the configurations of satellites in a Delta Walker constellation can be analyzed as a dynamical system as a function of a translation on the torus. This paper extends this type of analysis to routing over a Walker constellation, leveraging fixed ground relays. It considers any deterministic, time-invariant routing rule on such a collection of satellites and relays. The main object of interest is the routing table associated with this rule, which specifies, for all source-destination pairs, a route made of satellites and relays between them, for instance the shortest, together with angular information on next hop at each step of the route, which is essential for beamforming in this context. The main result is that, for each such routing rule, the routing table inherits the dichotomy of the torus flow: when the ratio of the Earth-spin and satellite angular speeds is rational, the routing table process is periodic with the same period as the constellation. When it is irrational, the table is non periodic but admits ergodic long-run averages which can be computed as ensemble averages w.r.t. an explicit invariant measure. Simulations with mixed satellite–gateway greedy routing illustrate these findings in terms of both temporal and spectral properties of the Walker routing table time series. The paper also discusses how to define metrics that cope with such non periodic fluctuations when present. This is illustrated by a comparison of the round-trip times between two far away cities as offered by a Walker constellation using greedy routing on one side, and by the currently available terrestrial fiber on the other side. It is shown how ergodicity can be used to make this comparison between the time varying instantaneous round trip times of the constellation and the constant round trip time of the fiber network meaningful.
Read the full abstract

Information Theory

Singleton-Optimal Rank-Metric CSS Codes : Equality Structure and Exact Projected-Recovery Radii

Correlated faults from shared control can have dense physical support yet low rank over a base field, motivating rank-metric quantum codes for stacked architectures. We prove an asymmetric rank-metric Singleton bound for Calderbank–Shor–Steane codes, including degenerate codes, and characterize equality through commuting maximum-rank-distance matrix codes. Optimal pairs exist for every admissible parameter triple and are necessarily pure. Comparison with erasure bounds establishes an exact advantage in stacked rank distance for general stabilizer codes at fixed physical resources on certain tall layouts. We determine whether relaxing the recovery target enlarges the worst-case correctable radius. For Singleton-optimal pairs with positive logical dimension, the measured syndrome determines the projected error modulo stabilizers exactly at radii strictly below half the sector rank distance, on every layout and for every nonzero projector. The projected syndrome is recoverable at arbitrary radii exactly when the complementary check space is invariant under the adjoint projector; otherwise, the same radius limit applies. For nontrivial idempotents, this invariance requires more rows than columns or sector distance one. For trace-self-adjoint projectors, linear ambient projected-syndrome interfaces in both sectors exist exactly when the code splits as a tensor product across the projector. Designs placing the two check spaces in complementary projector images are necessarily one-sided whenever they encode logical information. Two explicit families realize the extreme cases of the equality structure, including a two-sided family with an efficient certifying decoder attaining the optimal unique-decoding radius.
Read the full abstract

All authors Myeongjun Kim, Suseong Lee, Jaeho Jeon, Young-Sik Kim

Information Theory

Conditional-Coverage Contributor Selection for Regional Digital Twins Under Mobility

Regional digital twins (DTs) under mobility must coordinate contributor admission over congested broadcast networks without fixed infrastructure. Per-sender redundancy mitigation cannot make this set-level decision because only the host has a region-wide coverage map. Treating regional state as a public good, this letter develops a host-coordinated protocol admitting contributors whose timely, non-redundant coverage gain exceeds a congestion price within a cycle deadline. A 13-byte beacon digest enables pre-transmission scoring. Standards-based simulation shows the protocol reduces the timely actionable coverage deficit from 5.6% to 1.4% at load comparable to ETSI redundancy mitigation and by 26% versus random admission at matched tight-budget load.
Read the full abstract

Monday 28 September

Information Theory · Cross-listed from cs.LG

What Can Language Models Inherit from Solomonoff Induction? Limits, Attainable Properties, and What Served Conditionals Reveal

A familiar line of reasoning runs as follows: language models are flexible approximators trained under a strictly proper loss, so scale brings them closer to Solomonoff induction, and their predictive success is evidence of that approach. We apply known results from algorithmic information theory, universal prediction and Bayesian consistency. In its uniform form the conclusion holds for no computable model: each has cheap environments it never learns, and every uniformly computable family of total predictors shares one on which each member fails beyond a horizon growing with its index, so “closer” can hold only pointwise, one environment at a time. Nor could the offered routes certify even that: finite evaluation cannot certify agreement on rarely reached contexts, perfect corpus fit selects the corpus law as prior, and asymptotic criteria cannot see the constants that carry Solomonoff's guarantee. Our lens is the Kraft inequality read for predictors. Every model has at most the same budget of predictive success, so Solomonoff's predictor, which leaves part of it unspent, differs from a language model not in having more of it but in where it spends it; on mutually singular families this is exact, and only full-mass Bayes mixtures reach the frontier. We then discuss what is inheritable, including in-context learning as amortised Bayesian inference; what survives within a context window; which Solomonoff-like properties a deployed system should have or avoid; and what served conditionals determine. A closing table states what common practices certify and what to report. Tests are developed in a companion paper.
Read the full abstract

Information Theory · Cross-listed from stat.ML

Memory Prediction Excess: A Probabilistic Quantity for Predictive Gain and Memory Length in Stochastic Processes

A central question in the prediction of stochastic processes is the extent to which past information can improve the probability of correctly predicting the next state. We introduce the Memory Prediction Excess (MPE) to address this question quantitatively. The MPE measures the average improvement in prediction accuracy obtained by using the entire observed history relative to using only the static marginal distribution, in discrete-time finite-state processes. It is defined as the difference between the expected optimal conditional prediction accuracy and the optimal static prediction accuracy. Its basic properties are examined: the MPE is always non-negative; it admits an upper bound depending on the static accuracy, attained if and only if the future is almost surely a deterministic function of the past; and degenerate cases in which the MPE vanishes are characterized. A normalized version, taking values in the unit interval, is introduced as a dimensionless measure of predictive efficiency. A lower bound is derived by comparing predictions based on histories of different lengths, showing that the expected optimal prediction accuracy is monotone with respect to the history length. The framework is extended to finite-length histories, where the finite-history MPE (FH-MPE) measures the predictive gain attainable when only the most recent observations are retained. This leads to the notion of a minimal memory length required to achieve the same predictive performance as the full history. For finite-order Markov chains, this minimal memory length is shown to be bounded by the Markov order. The MPE and its variants are formulated in terms of conditional probabilities and prediction accuracies, offering a probabilistic perspective on the predictive utility of memory that is complementary to classical information-theoretic approaches.
Read the full abstract

Information Theory

LDPC Fractus Codes: Sparse Codes with Recursive Structure

We introduce a new family of recursively constructed sparse matrices, termed Fractus matrices, and investigate their use in constructing low-density parity-check (LDPC) codes. Generated through a self-similar recursive process, these matrices yield regular sparse parity-check matrices while preserving key structural properties across successive iterations. This recursive structure enables an efficient encoding algorithm with computational complexity that is nearly linear in the block length. Decoding is performed using standard iterative message-passing algorithms, thereby retaining the low-complexity decoding characteristic of LDPC codes. The proposed construction produces Tanner graphs with girth six and guarantees a minimum Hamming distance of at least $\ell+1$. We establish several algebraic properties of Fractus matrices, including sparsity, regularity, recursive decomposition, and symmetry under the flip-transpose operation. In addition, we show that the family of Fractus matrices admits a natural lattice structure and that the associated LDPC codes inherit corresponding lattice-theoretic properties. These results establish a connection between order theory and coding theory. Overall, the proposed framework integrates recursive matrix constructions, efficient encoding, graph-theoretic analysis, and lattice theory into a unified algebraic approach to the design and analysis of scalable LDPC codes.
Read the full abstract

Information Theory · Cross-listed from quant-ph

From Classical to Quantum Channels: Achieving Positive Covert Rates

In this paper, we study the conditions under which covert communication at positive rates is feasible over discrete memoryless classical, classical-quantum, and quantum channels. For classical point-to-point channels, we show that if the dimension of the channel input probability simplex exceeds that of the channel output probability simplex, equivalently, if the input alphabet has larger cardinality than the output alphabet, then positive covert rates are achievable for certain classes of Discrete Memoryless Channels (DMCs). We further show that allowing the innocent symbol (i.e., the symbol transmitted in the no-communication mode) to be chosen appropriately can enlarge the class of DMCs for which positive covert rates are achievable. We also study covert communication over classical Multiple-Access Channels (MACs), where the additional transmitter effectively enlarges the set of available channel input pairs, and we show that the conditions required to satisfy the covertness constraint are less restrictive for MACs than for point-to-point channels. We extend these results to classical-quantum DMCs by showing that if the dimension of the input probability simplex exceeds the affine dimension of the set of output states that can be induced at the channel output, then positive covert rates are achievable for certain classes of classical-quantum DMCs. Finally, for quantum channels, we show that if the innocent state (i.e., the state transmitted in the no-communication mode) is mixed, then the covertness constraint can always be satisfied by a non-trivial input ensemble. Consequently, positive covert rates are achievable whenever the legitimate receiver can distinguish at least two states in a suitable such ensemble.
Read the full abstract

Information Theory

Voronoi-Markov chain and spatial entropy for point pattern analysis

In this paper, we revisit the concept of entropy in the spatial context with the aim of deriving computable and interpretable metrics for point pattern analysis in domains such as histopathology. We discuss stochastic point process assumptions like Poisson homogeneity and Simple Sequential Inhibition (SSI) and review established results for Voronoi and Delaunay tilings of point sets for their potential to provide null distributions for rigorous empirical hypothesis testing. We present (1) a novel "dense basin entropy" defined in terms of the Ord distribution supported on Voronoi basins, which is shown to be sensitive to clustering, and (2) a related Markov chain designed as a simplification or approximation of Brownian motion in the underlying planar domain. We investigate bounds on the dense basin entropy in the SSI regime and in empirical data, and show that the entropy rate and spectral gap of the Markov chain lead to sharp discrimination metrics. Finally, we demonstrate a generalization to multiple-set analysis via aggregation of one set over the Markov invariant measure for another. Simulations and experiments in histopathology show that our proposed metrics offer insights complementary to other instantiations of entropy in spatial analysis. The code can be found on our SMProfiler GitHub: https://github.com/nadeemlab/SMProfiler.
Read the full abstract

All authors James C. Mathews Jr., Francisco Couzo, Aleksandr Petrov, Avijit Chatterjee, Saad Nadeem

Information Theory

Fundamental Limits of Dynamic Tracking and Communication: A Stationary Policy Formulation

We study a dynamic integrated sensing-and-communication problem in which a multi-antenna transmitter communicates with a receiver while simultaneously tracking a moving target governed by a stable Gauss–Markov model. We formulate the sensing–communication trade-off as a rate–distortion problem, where the communication rate is defined through the Verdú–Han information spectrum and the sensing distortion is measured by the long-run minimum mean square tracking error in angle and distance. We construct a tractable outer region by lower bounding this distortion through the posterior Cramér–Rao bound (PCRB). The control problem is partially observed because the target state is not directly available to the transmitter. We therefore introduce a belief-augmented information state and show, under the stated regularity assumptions, that stationary randomized Markov policies suffice for the covariance-based scalarized problem used in the outer bound. We then derive, under the stated large-block conditions, a Gaussian covariance-control outer bound by showing that, in the large-block regime, the sensing belief transition becomes asymptotically covariance sufficient; consequently, Gaussian signaling with the same stationary covariance policy preserves the stationary PCRB asymptotically while maximizing the communication reward for each transmit covariance. Numerical experiments compare an extended Kalman filter-based achievable frontier with a PCRB-based Gaussian covariance-control outer frontier.
Read the full abstract

All authors Mohammadreza Bakhshizadeh Mohajer, Luca Barletta, Alex Dytso, Giuseppe Caire

Information Theory

DNN-Assisted Near-Optimal Codebook Design for Uplink SCMA Schemes over Rician Fading Channels

Sparse Code Multiple Access (SCMA) is a promising non-orthogonal multiplexing technique for enhancing connectivity and spectral efficiency in next-generation communication networks. This paper proposes near-optimal uplink SCMA codebook designs based on a novel deep neural network (DNN)-assisted framework. The DNN is trained in an unsupervised manner, with a loss function derived from the structural characteristics of the generated codebooks, thereby eliminating the need for labeled training data. Based on error-probability analysis, Rician-factor-dependent design criteria are derived for uplink Rician fading and used to formulate the loss function. The resulting criteria naturally encompass AWGN and Rayleigh fading as limiting cases, providing a unified framework for codebook design. Moreover, upper and lower bounds on the average mutual information (AMI) are derived, providing an information-theoretic interpretation of the PEP-based criterion and establishing its asymptotic consistency with the AMI-lower-bound-based criterion in the high-SNR regime. The analysis further reveals how the dominant design factors evolve as the channel transitions from Rayleigh fading to AWGN. Numerical results show that the proposed near-optimal codebooks achieve significant performance gains over representative benchmark schemes across a wide range of Rician factors and exhibit excellent error-rate performance in the error-floor region, making them particularly attractive for ultra-reliable applications.
Read the full abstract

Information Theory

A Hyperbolic Bound for File Retrieval in DNA-Based Data Storage

In DNA-based storage systems, data are retrieved by sequencing molecules sampled from a DNA pool. We study how the way coding redundancy is shared between files affects their expected retrieval times. Our focus lies on the case of two files that are encoded by a systematic linear code over an arbitrary finite field. We consider the conjecture that the sum obtained by dividing each file dimension by its expected retrieval time is at most one whenever the dimension of at least one file is more than one. For this, we develop a geometric view of the retrieval process. As molecules are sampled, we follow the growing span of the corresponding columns of the generator matrix and track how much of this span comes from each file. Among the samples that enlarge the overall span, this lets us compare those that make progress toward recovering both files with those that make progress toward neither. We call a column mixed if the corresponding encoded symbol combines information from both files. In this work, we sharpen a projection bound and use it to control the effect of mixed columns. We prove the conjecture whenever the total information dimension is at least twice the number of mixed columns plus two. For equal-sized files, this allows up to one fewer mixed column than the dimension of either file and extends the previous result for codes with no mixed columns.
Read the full abstract

Information Theory · Cross-listed from cs.LG

TORQUE: Optimizing What (not) to Quantize Before and After Rotation

Uniform random rotations are an effective preprocessing step for quantization: they make normalized coordinate distributions approximately Gaussian, enabling the use of codebooks optimized offline. We introduce TORQUE, a framework that improves on previous quantization works that use random rotations by jointly optimizing how many and which coordinates to preserve at high precision both before and after rotation, under a fixed overall expected bit budget. Intuitively, before rotation, preserving large input coordinates at high precision can reduce overall error by preventing the rotation from spreading their values across many coordinates. Likewise, after rotation, preserving a small fraction of the largest-magnitude coordinates at high precision allows the remaining values to be quantized more accurately using codebooks optimized offline for the resulting truncated Gaussian distribution. We derive a quantization error upper bound and prove that top-$k$ pre-rotation retention minimizes it for each $k$. This reduces the search over coordinate subsets to an optimization over $k$, enabling a fast optimizer that uses offline codebooks and parallel parameter selection for practical implementation. We demonstrate an improved tradeoff between reconstruction accuracy and storage cost through numerical evaluation under the Gaussian model and experiments on nearest-neighbor retrieval, KV-cache compression, and activation compression.
Read the full abstract

Information Theory · Cross-listed from cs.MA

Bregman Consensus

Consider a community of agents who are seeking consensus on a set of parameters. The agents agree to use the same Bregman-type divergence to quantify disagreement between their individual estimates of the parameters but have varying confidence in each other's abilities. Each agent is happy to revise their estimate by moving to the weighted barycenter of all individual estimates with higher weights applied to more trusted agents. We show that such revisions naturally lead to an iterative algorithm which converges to a unique consensus estimate of the parameters. Furthermore, since the consensus estimate is itself a barycenter with computable weights, the group emerges as a collective super-agent with a well-formed opinion regarding the ability of each individual agent.
Read the full abstract

Information Theory

Dual-Branch Vector-Quantization-Aided Satellite Digital Semantic Communication with Index Compression for High-Resolution RSI Over AFDM

High-resolution remote sensing imagery (RSI) transmission is constrained by satellite-ground bandwidth and channel impairments, yet existing methods struggle to simultaneously achieve extreme compression and robust transmission. To address this, we propose a dual-branch vector-quantization aided satellite digital semantic communication (DVQ-SDSC) framework for RSI transmission over affine frequency division multiplexing (AFDM), whose bandwidth savings arise from two interrelated aspects. First, at the source-coding level, a dual-branch framework is developed to unify deep joint semantic coding, VQ-aided index transmission, channel estimation and adaption in an end-to-end architecture; departing from symmetric encoder designs, the codec is recast as an asymmetric dual-branch architecture that separately processes the high-frequency residuals and the low-frequency structural semantics, with gated fusion and channel-adaptive reconstruction jointly restoring the semantic content. Second, at the index-coding level, we develop a principal component analysis (PCA)-aided codebook reordering to align index topology with latent correlations, and devise group differential pulse-code modulation (G-DPCM) to encode prediction residuals rather than absolute indices, lowering the index bitrate while locally isolating clipping and channel errors. A two-stage training strategy further decouples channel impairments from the semantic codec. FAIR1M experiments over 3GPP NTN-TDL-D demonstrate that DVQ-SDSC with G-DPCM index coding outperforms the conventional JPEG-LDPC scheme at the base rate of 0.0625 bits per pixel (BPP), and that G-DPCM applies directly to the trained codec without retraining, yielding additional index compression at no extra cost.
Read the full abstract

All authors Jianqiao Chen, Nan Ma, Xiaodong Xu, Tingting Zhu, Huishi Song, Chen Dong, Rui Meng, Wenkai Liu, Ke Peng, Ping Zhang

Information Theory · Cross-listed from math.ST

Competitive optimality in testing by betting via Bell-Cover randomization

Bell and Cover showed that an investor who multiplies the initial unit of capital by an independent uniform random variable on $(0,2)$, and then uses the log-optimal portfolio, wins a head-to-head wealth comparison with probability at least one half against every independently randomized competitor. We explain very simply how this result transfers to testing by betting: for any composite null $\mathcal P$ and simple alternative $Q$, denoting $E^*$ as the corresponding numeraire e-variable, we show that $UE^*$ exceeds any other e-variable $E$ with probability at least half. Interestingly, we show that this competitive optimality result is actually equivalent to the numeraire inequality $\mathbb E_Q[E/E^*]\leq1$, and in general randomization only helps the numeraire and fails to improve the competitive advantage of an arbitrary e-variable. Under optional stopping with or without knowledge of $U$, we emphasize a key distinction between e-process validity and competitive optimality. We also show that competitive optimality comes at the price of expected log wealth and power: thresholding $UE^*$ at $1/\alpha$ has sharp size at most $\alpha/2$, but the factor of two actually disappears under optional stopping. Even after correcting for this factor of two, the test is dominated in conditional rejection probability by randomizing the testing threshold (randomized Markov's inequality). Thus, Bell-Cover randomization is optimal for a specific competitive objective, at the cost of others.
Read the full abstract

Information Theory

The Hidden Perception Constraint in Task-Aware Compression

With the recent advancements of neural compressors, explicitly incorporating perception constraints into the design of compression schemes has gained significant attention. Traditionally, these perception constraints ensure that the distribution of the reconstruction does not significantly deviate from the distribution of the source, thus attesting to the perceptual quality of the reconstruction. In this work, we uncover several perception constraints that are naturally present in task-aware compression. In particular, we consider a problem where the primary task is reconstruction and the secondary task is classification (i.e., a statistical test). We study this problem at varying levels of domain information available to us and discuss how to utilize the naturally emerging perception constraints to design rate-minimal compression schemes that also maximize the utility of our secondary task. We show that in this setting, if the decision boundaries of the classifier are ill-defined (mismatch) for our source distribution, then matching onto a target distribution enhances our classification accuracy.
Read the full abstract

All authors Sahan Liyanaarachchi, Semih Akkoc, Sennur Ulukus, Aylin Yener

Information Theory · Cross-listed from quant-ph

Learning sparse quantum states from single-qubit measurements

We study the problem of learning a sparse quantum state, an $n$-qubit quantum state whose density matrix has at most $s$ nonzero matrix entries in an unknown product basis. While such states admit compact classical descriptions, they can carry long-range entanglement that prevents reconstruction from local reduced density matrices alone. Therefore, previous learning approaches addressed such long-range-entangled states using many entangling gates to extract the necessary information. In this work, we show that sparse states can nevertheless be efficiently learned using only single-qubit measurements. Specifically, when the sparsity $s$ is constant, our algorithm can learn sparse states from single-qubit measurements with polynomial sample complexity and classical computational complexity. When $s$ grows polynomially with $n$, sparse states can still be learned from single-qubit measurements with polynomial sample complexity, although efficient classical computation is not guaranteed in general. In this regime, however, the classical computational complexity becomes quasipolynomial when the state is sparse in an unknown basis that is a product of a known fixed finite set of single-qubit bases (e.g., eigenbases of Pauli operators). These results establish efficient learning of sparse states with long-range entanglement without entangling gates, and the single-qubit measurement requirements make our algorithms compatible with current quantum devices.
Read the full abstract

Information Theory · Cross-listed from quant-ph

Low-Weight Canonical Logical Bases from Pair-Partition Codes

We construct complete canonical logical bases for qubit CSS codes by assigning quaternary coefficients to binary circulant permutation matrix pair-partition (CPM-PP) checks, constructing and normalizing logical representatives, and expanding the result into binary matrices. When the two check systems have invertible submatrices on disjoint column sets, cofactor representatives are canonically paired by the inverse of a single pairing polynomial. The resulting pairs span the entire logical space. When the pairing polynomial is a cyclic-shift monomial with coefficient one, normalization preserves the binary weights of the representatives. We state the construction for general block dimensions and CPM size, work through a corresponding example, and report the parameters, check ranks, and basis weights of seven binary codes. Representative examples have parameters $[[320,80,14]]$, $[[448,112,18]]$, and $[[2048,512,24]]$. All three have maximum check weight 10 on both the X and Z sides. Their canonical logical representatives have binary weights 25, 27, and 27, respectively, on both the X and Z sides.
Read the full abstract

Information Theory

A simple proof of the group-theoretic Zhang-Yeung inequality

Zhang and Yeung (IEEE Trans. Inf. Theory, 1998) established the first non-Shannon-type inequality that holds for all entropic vectors. Chan and Yeung (IEEE Trans. Inf. Theory, 2002) showed that there is a one-to-one relation between linear entropy inequalities and multiplicative inequalities involving cardinalities of subgroups of a finite group. The Shannon inequality admits a simple proof in the group theoretic setting, but a direct proof of the translation of Zhang–Yeung's inequality to the group-theoretic setting remained elusive. We resolve this open problem, giving a direct proof of the group-theoretic Zhang–Yeung inequality for cardinalities of subgroups of finite groups, using elementary group-theoretic and counting arguments.
Read the full abstract