Peer Revenue Publish or profit

Papers

Fresh from arXiv, typeset properly. Highlighted words trade on the market.

Computer Science Information Theory

cs.IT Watch Information Theory (sign in to use)

Wednesday 7 October

Information Theory

Sequential Random Sampling PIR with Multiple Colluding Servers in DNA-Based Data Storage

As DNA-based data storage evolves, protecting user privacy during data retrieval has become increasingly important. We study sequential random sampling DNA private information retrieval (SRS DNA PIR) with multiple colluding random sampling servers, where the database is partitioned into servers of equal size. We investigate the tradeoff between the download cost, defined as the expected number of queries, and the privacy leakage, measured by mutual information. We derive lower bounds on this tradeoff, including a bound given by an optimization problem. This bound is tight when each server stores two files, and we construct schemes that attain it. For servers of any size, we construct schemes that apply a single-server scheme to a randomly selected subset of servers.
Read the full abstract

Information Theory

The Multiple Unicast Conjecture is False

The undirected multiple-unicast conjecture [LL04] asserts that network coding offers no throughput advantage over multicommodity flow. We refute this conjecture by constructing a deterministic linear network code over $\mathbb{F}_9$ on a 182-vertex bipartite subgraph of the point-line incidence graph of $\mathrm{PG}(2,9)$. The construction supports $157$ independent unicast sessions at common coding rate at least $1$, while every fractional multicommodity flow has common rate at most $147/157$. By the amplification theorem of~[BGS17], this yields a family of undirected multiple-unicast instances with coding gap $\Omega((\log n)^\varepsilon)$ for some $\varepsilon>0$. We also introduce a nondeterministic model of network coding based on locally verifiable certificates, which guides our construction and may be of independent interest. Building on the high-girth graph and error-correcting code framework of [BH25], we use GPT-6 to find a nondeterministic counterexample based on a new choice of Reed–Solomon local codes, and then convert this example into a causal code using an edge orientation and local search.
Read the full abstract

Information Theory

Variational Bayesian Inference Based Progressive Multi-Target MIMO Sensing with Nuisance Parameters

This paper proposes a progressive Bayesian multiple-input multiple-output (MIMO) sensing framework for multiple targets over multiple stages. We consider a practical yet challenging scenario where the targets' angles are unknown and random parameters to be estimated, while the targets' reflection coefficients are unknown nuisance parameters. With an initial prior probability density function (PDF) for the targets' angles, we progressively update the prior PDF for each sensing stage as the posterior PDF obtained from the previous stage, based on which Bayesian transmit beamforming optimization is performed to minimize the sum posterior Cramér-Rao bound (PCRB) in estimating the targets' angles and Bayesian sensing is performed with the help of new observations in this stage. To analytically characterize the intractable and high-dimensional posterior PDF with low complexity, we propose a variational Bayesian inference based approach which derives a surrogate posterior PDF in closed form with only polynomial complexity over the number of targets, in sharp contrast to existing numerical calculation approaches with exponential complexity. Numerical results validate the efficacy of our proposed framework in progressively refining sensing performance.
Read the full abstract

Information Theory

Spectral Efficiency Analysis of Massive MIMO-OFDM Systems with Double Quantization

Massive multiple-input multiple-output (MIMO) achieves a high spectral efficiency (SE) by employing a large number of receive antennas in the uplink. Employing many receive antennas requires a large number of analog-to-digital converters (ADCs) and a high fronthaul data rate. Low-resolution ADCs can reduce power consumption and cost, while fronthaul quantization can reduce the required fronthaul data rate, at the expense of quantization distortion at both stages. In wideband orthogonal frequency-division multiplexing systems, ADC quantization is performed in the time domain, while fronthaul quantization may be applied after the discrete Fourier transform to transmit only active subcarriers. In this study, we investigate the achievable uplink SE over fronthaul links under double quantization and imperfect channel estimation. We derive a linear minimum mean-squared error channel estimator from the double-quantized pilot observations and obtain an achievable SE using the use-and-then-forget bound. Numerical results demonstrate that the ADC and fronthaul quantization resolutions have comparable impacts on the achievable SE. When the two resolutions differ, the lower resolution becomes the dominant factor limiting the SE. Furthermore, our numerical results show that six-bit ADC and fronthaul quantization achieve more than 90% of the SE attained in the ideal case.
Read the full abstract

All authors Bengu Bilgic Keskin, A. Oguz Kislal, Ali Gorcin, Özlem Tuğfe Demir

Information Theory

The Price of Privacy: Randomness Complexity of Graph-Based Multi-Secret Sharing

We study the randomness required to share possibly correlated secret bits among parties connected by a graph. A dealer places shares on the edges so that each party can recover its own secret from its incident shares and learn nothing about the others beyond what its own secret reveals. Anilkumar et al. completely determined the minimum randomness required for three binary secrets. We extend this study to four secrets and obtain results for arbitrary numbers of secrets on general graphs. For four parties on a complete graph, we determine the minimum number of random states for every set of permitted secret combinations: the possible values are one, two, three and four. We also characterize when one random bit suffices on an arbitrary graph.
Read the full abstract

Information Theory

Probabilistic GC-Constraints for Composite DNA

This paper addresses the challenge of encoding biochemical GC-content constraints in composite DNA-based data storage. Previous deterministic models impose high rate penalties by avoiding any possibility for a strand to fall outside the allowed range. To account for the stochastic nature of composite DNA, we introduce an $\epsilon$-probabilistic constraint framework, and derive capacity bounds for global constraints using composition types and for local sliding-window constraints via finite-state Markov chains. Furthermore, we propose a capacity-achieving multi-type enumerative encoder.
Read the full abstract

Information Theory

Model-Order-Adaptive Channel Estimation for AFDM Systems with Fractional Delay and Doppler

Affine frequency division multiplexing (AFDM) has emerged as a promising waveform for high-mobility communications owing to its ability to exploit multipath diversity. However, channel state information (CSI) acquisition remains challenging in channels with fractional delay and Doppler and an unknown number of propagation paths. In this paper, we investigate the channel estimation for AFDM systems. We first analyze the AFDM response in the presence of fractional-delay-induced frequency wrapping. The analysis reveals that fractional delay may displace the dominant extremum and generate informative secondary extrema. Then, we develop a model-order-adaptive channel estimator within an improved space-alternating generalized expectation-maximization (SAGE) framework. A dual-pilot reference symbol is employed for path and delay initialization, while pilot observations across multiple AFDM symbols provide temporal information for Doppler estimation. New paths are identified through statistically controlled residual tests, whereas unsupported or redundant paths are removed by conditional support pruning. The delay, Doppler frequency, and complex gain of each retained path are subsequently estimated through a coarse-to-fine procedure and refined using the exact AFDM likelihood. Simulation results demonstrate that the proposed method achieves lower normalized mean squared error (NMSE) and bit error rate (BER) than representative SAGE, sparse-recovery, and Bayesian benchmarks. It also provides reliable path detection and model-order estimation and maintains robust performance at terminal velocities of up to 600~km/h.
Read the full abstract

All authors Ruizhe Wang, Cunhua Pan, Hong Ren, Shaohua Li, Jiangzhou Wang

Information Theory · Cross-listed from math.ST

The Silhouette Operator: Identifiability of Low-Rank Measures from One-Dimensional Projections

Structured recovery phenomena, such as restricted isometry properties in compressed sensing, have shown that high-dimensional objects can often be reconstructed from remarkably low-dimensional linear measurements. This work develops an analogous recovery framework for low-rank signed measures on $\mathbb{R}^2$, defined here as measures that can be expressed as finite sums of product measures with one-dimensional factors. The framework is based on linear operators, termed "silhouette operators," that map a measure to a fixed finite collection of one-dimensional linear pushforwards. The main results show that a suitably chosen collection of $2k$ projected marginals suffices to identify every compactly supported rank-$\le k$ signed measure, that this number is optimal, and that the projection directions cannot be chosen arbitrarily. The framework is also extended to higher-dimensional sums of product measures by establishing sufficient conditions under which collections of pairwise marginals identify the full model. Building on this framework, a computationally efficient estimator, termed "silhouette mixture estimation" (SME), is introduced for constructing a low-rank empirical measure from data by matching its one-dimensional projected marginals to the corresponding empirical marginals in Wasserstein distance. When combined with one-dimensional density estimators, SME yields an efficient nonparametric density estimator that performs strongly relative to a range of parametric, nonparametric, and deep-learning baselines in settings of moderate dimension and sample size.
Read the full abstract

Information Theory

Function-Correcting Lee-distance Codes for Symbol-Pair Read Channels

Function-correcting codes (FCCs) protect specified function evaluations of messages against errors while reducing the redundancy required for reliable communication. We study FCCs for symbol-pair read channels, motivated by high-density storage systems that read overlapping symbol pairs. Phase-shift keying (PSK) modulation is well-suited to such systems due to its bandwidth efficiency and noise robustness. While FCCs for symbol-pair read channels have been studied under the Hamming metric, the Lee metric is a more appropriate error model for $q$-ary PSK and, hence for $q$-ary symbol-pair read channels. We generalize the symbol-pair Lee distance, previously defined only over $\mathbb{Z}_4$, to $\mathbb{Z}_q$, $q\ge2$, and introduce function-correcting symbol-pair Lee-distance codes (FCSPLCs) over $\mathbb{Z}_q$, specializing to $q=2^m$, $m\ge1$, for $2^m$-ary PSK constellations. We investigate their redundancy requirements by introducing irregular-pair Lee-distance codes and relating the optimal redundancy of FCSPLCs to the shortest length of such codes. We derive Plotkin-type and Gilbert–Varshamov-type bounds on the optimal redundancy through lower and upper bounds on the shortest length of irregular-pair Lee-distance codes. For bijective functions, we obtain corresponding Plotkin-type and Gilbert–Varshamov-type bounds for classical Lee metric codes for symbol-pair read channels over $\mathbb{Z}_q$, which, to the best of our knowledge, are the first such bounds for the Lee metric symbol-pair setting. We then specialize the FCSPLC framework to pair-locally bounded functions, the Pair-Lee weight function, and the Pair-Lee weight distribution function, giving explicit constructions and corresponding bounds on the optimal redundancy. Finally, for linear functions, we derive a Plotkin-type lower bound on the optimal redundancy.
Read the full abstract

Information Theory

Second-Order Image Characterization with Distortion and Secrecy

Image-size characterization connects coding constraints to the probability carried by source cells and their output images. At second order, this connection must retain the joint fluctuations of all active constraints and distinguish encoder-observable source variation from unobserved channel noise. We extend the single-output posterior characterization to simultaneous posterior and conditional-composition image bounds. The bounds preserve the actual coupling of multiple outputs, quantify conditional likelihood losses for irregular cells, and admit actual-distortion marks. Two further extensions replace disjoint counting by weighted reconstruction-policy images and replace output cardinality by posterior-mass constraints for secrecy. Direct applications yield matching second-order regions for compatible multi-source helper intersections, one lossy reconstruction with several informed lossless reconstructions, Gaussian common/private descriptions, and privacy amplification from a prescribed conditional type. The Gaussian description result also gives joint rate–distortion offsets. For general helper sections, genuinely lossy informed reconstruction, Gaussian Wyner–Ziv coding, and reconciliation followed by extraction, the same image methods give explicit rate bounds with their remaining losses identified. The resulting rate corrections reflect both the image constraints and the observations available to each terminal.
Read the full abstract

Information Theory

Physics-Aware Power Optimization for Rydberg Quantum Arrays via Barankin Bound Minimization

Rydberg-atom quantum uniform linear arrays (RAQ-ULAs) offer a promising sensing architecture for direction-of-arrival (DOA) estimation in terahertz (THz) beam alignment. Existing studies often model the quantum receiver as a macroscopic linear block and rely on the Cramer-Rao bound (CRB) for array evaluation or power allocation. However, as a local variance bound, the CRB cannot capture threshold breakdown caused by spatial ambiguities in low-signal-to-noise-ratio (SNR) regimes. This paper proposes a physics-aware power optimization framework for RAQ-ULAs based on stochastic Barankin bound minimization. We derive a closed-form stochastic multipoint Barankin bound (BRB) matrix under a low-SNR integrability condition and introduce an arcsine-prior calibration to characterize bounded-domain error saturation. By incorporating a Lindblad-guided electromagnetically induced transparency (EIT) readout model, we couple the ambiguity-sensitive BRB with photon shot noise, power broadening, and laser Rabi frequencies. A CRB-optimized analytical baseline is further derived to expose the limitation of local-SNR-based allocation. To solve the resulting nonconvex problem, we develop a backtracking majorization-minimization (MM) algorithm with a Lipschitz-based quadratic surrogate. The algorithm ensures monotonic decrease and converges to a feasible stationary point. Simulations show that the proposed framework predicts threshold breakdown more accurately than the CRB and enlarges the reliable operating region under severe THz attenuation.
Read the full abstract

All authors Yixiao Li, Jiayi Zhang, Bokai Xu, Yin Zhang

Information Theory

Network Coding Can Beat Routing in Undirected Multiple-Unicast Networks

Network coding lets the nodes of a network combine messages rather than merely forward them. In undirected networks, where the two directions of an edge share its capacity, Li and Li conjectured in 2004 that coding offers no advantage over fractional routing; the conjecture has been confirmed for many special classes but never settled in general. In this paper, we disprove it by constructing a finite connected simple undirected network with unit shared edge capacities, maximum degree three, and distinct leaf terminals, on which a binary linear block code achieves a common rate strictly above the maximum fractional routing rate. The construction turns a short completion-time code into a reversible circuit whose registers all carry independent messages, and a temporal metric on its wires yields the strict routing bound. The underlying integer-coefficient construction works over every finite field and every nontrivial finite abelian group; for deterministic fixed-schedule codes the common-rate supremum is one and the closure of the rate region is the unit cube. Amplifying the gap with a degree-preserving tensor construction and an even subdivision gives, for every $0<\beta<1$, an unbounded family of connected, simple, subcubic, bipartite networks with girth at least $n^\beta$ on which coding approaches rate one while routing is bounded by $K_\beta/(\log n)^c$, with one positive exponent $c$ independent of $\beta$. The finite counterexample and the family theorem are formalized in Lean.
Read the full abstract

Information Theory · Cross-listed from quant-ph

Building codes with transversal CCZ using projective geometry and SAT solvers

We construct CSS codes with three logical qubits whose logical CCZ gate is implemented by transversal physical $T/T^{\dagger}$ gates and whose distance is at least $3$. These codes start with $8$-divisible $X$-stabilizers defined by projective geometry, which guarantees $d_Z\geq 3$. A SAT solver then finds three $X$-logical operators compatible with the transversal CCZ. We build codes at thirteen block lengths from $n=48$ to $n=496$, with $d_Z=3$ or $4$, and illustrate the method with the $[[48,3,3]]$ code $Q_{48}$. Additionally, we prove that no CSS code with three logical qubits, $Z$-distance at least $3$, and a quasi-transversal CCZ gate (transversal $T$ with a diagonal Clifford correction) exists below $n=39$. The $[[47,3,3]]$ code of Jacinto et al. serves as an upper bound, leaving $39\leq n\leq46$ open.
Read the full abstract

Information Theory · Cross-listed from math.ST

Tightness and Error Exponents of SDP with Logarithmically Many Communities

We study a semidefinite programming (SDP) relaxation for community recovery when the number of communities grows logarithmically. In the balanced stochastic block model with $n=km$ vertices, we consider the regime $k/\log m\to\gamma>0$, with edge probabilities $\alpha\log m/m$ within communities and $\beta\log m/m$ across them, for fixed $\alpha>\beta>0$. We derive the sharp asymptotic tightness boundary away from critical cases. When rare vertices cause tightness to fail while the bulk remains spectrally stable, the normalized matrix error of every near-optimal solution still vanishes. We prove matching high-probability exponents for this error and the normalized optimal objective gain, governed by the same local correction that determines tightness. Throughout this spectrally stable region, a single SDP solve followed by explicit rounding and refinement achieves exact community recovery above the information-theoretic threshold. This guarantee holds even when the planted community matrix is not an optimal solution to the SDP.
Read the full abstract

Tuesday 6 October

Information Theory · Cross-listed from stat.ML

The optimal information complexity of VC learning

Steinke and Zakynthinou(2020) introduces the Conditional Mutual Information (CMI) framework of analyzing the information complexity of learning algorithms based on algorithm-dependent information-theoretic quantities. We study one of these quantities, the evaluated Conditional Mutual Information (eCMI). It has been an interesting question whether the optimal PAC guarantee for VC classes can be recovered from the algorithm-dependent analyses via CMI. And we show that it is possible to recover this guarantee by constructing a learning algorithm whose eCMI is of order O(d) in the realizable case, where d is the VC-dimension of the concept class. Specially, our algorithm is a randomized Majority-of-5 base learners with optimal in-expectation generalization guarantee.
Read the full abstract

Information Theory

Performance Analysis and Sensing-Aware Resource Allocation for Full-Duplex Massive MIMO ISCC Networks

Emerging edge applications must sense their environment and process data within tight latency budgets. Full-duplex (FD) integrated sensing, communication, and computing (ISCC) supports these functions concurrently, but radar probing interferes with uplink reception while user transmissions degrade target estimation. These coupled effects call for joint sensing and offloading decisions. We investigate a FD massive multiple-input multiple-output (mMIMO) ISCC network in which users partially offload tasks to an edge server while an access point probes a target. For zero-forcing uplink reception with imperfect channel estimates, we derive a tractable rate bound and target-angle Cramer-Rao lower bounds (CRLBs) under the stated interference and beam-alignment assumptions. We then jointly optimize offloading fractions, user and radar transmit powers, and edge computing resources to minimize average end-to-end task latency subject to sensing-accuracy, communication-rate, energy, deadline, and resource constraints. A successive convex approximation algorithm is developed to efficiently address the resulting nonconvex problem. The analysis shows that larger arrays improve sensing and uplink performance, but residual radar interference creates a finite rate ceiling when user powers scale down with array size. Simulation results show joint allocation reduces radar transmit power by approximately 86% relative to equal communication-user power at a -40 dB CRLB threshold and lowers latency compared with fixed-allocation and half-duplex schemes.
Read the full abstract

All authors Vo Phi Son, Van-Dinh Nguyen, Nhan Thanh Nguyen, Tuan-Vu Truong, Symeon Shatzinotas

Information Theory · Cross-listed from eess.SY

Mission-critical spectrum sharing with decentralized Multi-Agent Reinforcement Learning

Motivated by emerging mission-critical applications and an increasingly congested spectrum, we develop a decentralized multi-agent reinforcement learning (MARL) model for dynamic spectrum access. The model enables secondary users to learn effective transmission strategies across shared frequency bands while minimizing collisions with high-priority primary users and among themselves. We design the agent-level learners following a Markov potential game approach, connecting independent local updates to system-level improvement. We instantiate this design using lightweight linear actor-critic learners suitable for resource-constrained edge devices, rather than computationally intensive centralized or deep multi-agent architectures. Across spectrum environments with different incumbent activities, the learned policies adapt their transmission policy and waiting behavior to preserve throughput while greatly reducing transmission collisions relative to random and forecast-aware heuristic baselines. The results establish the value of decentralized MARL and shows up to 96.8% reduction in overall collisions.
Read the full abstract

All authors Dimitrios Pylorof, Imtiaz Nasim, Humberto E. Garcia, Vivek Agarwal, Jasni A. Mannil, Mingyue Ji

Information Theory · Cross-listed from cs.LG

An Accuracy-Information Tradeoff for Loss-Difference Conditional Mutual Information

Loss-difference conditional mutual information (ld-CMI) uses the smallest of the standard observations in the supersample hierarchy of generalization bounds: it measures what a learner's loss differences reveal about which candidate of each pair it was trained on. Accuracy is known to force information into the model; data processing does not carry such lower bounds to losses. We show, by bounding three moments of the loss differences, that accuracy also forces ld-CMI. For linear predictors with a smooth convex loss of nonzero slope at zero, such as the logistic loss, plus a regularizer whose curvature and growth are both of power $r\ge2$, on product distributions over a scaled sign cube in dimension at least linear in $n$, every proper learner with expected excess risk at most $\varepsilon$ on these distributions at the optimal sample size $n\asymp\varepsilon^{-2+2/r}$ has worst-case ld-CMI of order $n$ bits, and $\Theta(n/(1+(\tau/\varepsilon)^2))$ bits under Gaussian noise of standard deviation $\tau$ on the loss differences. The same holds without a regularizer, at $n\asymp\varepsilon^{-2}$. Consequently, range-scaled ld-CMI bounds cannot vanish on these distributions, although every proper learner's generalization gap is $O(n^{-1/2})$. We also show that model-level information does not determine noisy loss-difference information, and that the growth, slope and dimension conditions are needed, the last up to a logarithm.
Read the full abstract

Information Theory

On Optimal Encodings and Systematicity in Function-Correcting Codes

Function-correcting codes (FCCs) protect the value of a function $f$ of the message against $t$ errors. In the original formulation of Lenz et al. (2023), the encoding is systematic, and the lower bound of $2t$ on the redundancy relies on this form. Recently, D. Ho (arXiv, 2026) showed, for linear functions and linear encodings, that systematicity can cost redundancy. We begin with the OR function to show that the cost is not confined to the linear setting: a non-systematic encoding attains redundancy $1$ while every systematic encoding needs $2t$. For a linear function $f$ and a fixed linear code $C$, let $d_f$ denote the minimum distance between codewords of messages with different function values. Different generator matrices of $C$ assign different codewords to the messages and can give different values of $d_f$. We study which generator matrix of $C$ gives the largest $d_f$. We give an algorithm that constructs an optimal generator matrix and determines the optimal value as the weight of a codeword in a greedy basis of $C$. We then characterize, in terms of information sets, when a generator matrix in systematic form attains this optimum, and give a necessary condition that is checked on the low-weight codewords of $C$ alone. For two-valued functions, we drop both linearity and systematicity. Using the minimality of initial segments of the simplicial order with respect to Hamming neighbourhoods, we show that a non-systematic $(f,t)$-FCC of length $n$ exists if and only if a condition depending on $f$ only through the size of its smaller preimage holds. For $t=1$, redundancy $1$ is sufficient for every nonconstant two-valued function on $\mathbb{F}_2^k$ with $k\ge 10$. For general $t$, redundancy $1$ suffices for all two-valued functions once $k$ is large enough, and for each $s<2t$ we give an upper bound on the threshold in $k$ beyond which redundancy $s$ suffices.
Read the full abstract

Information Theory · Cross-listed from quant-ph

Efficiently computable bounds on the energy-constrained quantum reading capacity

In quantum reading, classical messages are encoded in sequences of quantum channels and recovered by probing the channels and processing their outputs. We study the reading capacity of a finite family of finite-dimensional channels under an average constraint on the probing energy, allowing arbitrary adaptive operations between channel uses. Using an input-dependent chain rule for the Belavkin-Staszewski relative entropy, we derive a converse bound expressed as an optimization involving channel Choi operators and the operator relative entropy. This formulation admits semidefinite approximations and reduces, without an energy constraint, to a channel information radius. To obtain achievable rates, we construct bilinear semidefinite lower approximations to a standard non-adaptive reading bound. Alternating optimization produces feasible probe states and encoding distributions, whose Holevo information gives a directly evaluable achievable rate. For jointly classical-quantum channels, we derive a separate converse based on the Umegaki relative entropy. Without an energy constraint, this converse matches a non-adaptive achievable rate, recovering a recent result of Pascual Abraldes and Winter: non-adaptive protocols suffice to achieve the unconstrained reading capacity of jointly classical-quantum channels.
Read the full abstract

Information Theory

A Unified Framework for Characterizing General MIMO Channels

Modern MIMO systems are evolving toward higher-dimensional and more flexible architectures, such as distributed and holographic MIMO, offering substantial benefits while giving rise to increasingly complex channel correlation structures. This growing architectural diversity makes it difficult to characterize the fundamental limits of different MIMO systems on a case-by-case basis, motivating a unified analytical framework applicable across a broad range of architectures. This paper addresses this research gap by investigating a generally correlated Rayleigh channel whose vectorized form follows a general Gaussian distribution with an arbitrary covariance matrix. For that purpose, we first prove that the spectral norm of the channel matrix is bounded in the asymptotic regime where the numbers of transmit and receive antennas grow proportionally. We then derive a deterministic approximation for the ergodic mutual information, with an explicit convergence rate governed by the structure of the channel correlation. The approximation is characterized by a pair of matrix-valued self-consistent equations, for which we establish the existence and uniqueness of the solution and propose an iterative numerical algorithm. Furthermore, we develop a framework based on positive linear maps to analyze the stability of these equations, which can facilitate the spectral analysis of broader classes of random matrices. The proposed characterization unifies many existing results for structured MIMO channels as special cases while remaining applicable to a broad class of general MIMO architectures that are difficult to evaluate using existing analytical frameworks. To demonstrate its utility, we apply the developed theory to two representative systems, namely downlink distributed MIMO and uplink heterogeneous MIMO. Numerical results confirm the accuracy of the derived deterministic approximations.
Read the full abstract

All authors Zeyan Zhuang, Anzheng Tang, Xin Zhang, Dongfang Xu, Shenghui Song

Information Theory

Task-Sufficient Contraction: Source Selection for Machine Information Interfaces

A declared task can sometimes certify a reduced source before a downstream encoder, codebook, rate, distortion target, or optimizer is chosen. This paper studies when one such reduction preserves the complete downstream problem family, a property termed Task-Sufficient Contraction. The reduced source is fixed by the task before the later operating point is selected. An exact contraction allows the later problem to be solved on that source with the same result as if the full source had been retained. For a machine with a fixed set of possible actions and a fixed loss, the paper identifies a consumer-specific source by merging states only when every available action has the same regret in both. For finite action sets, replacing the richer source by this reduced source preserves the complete one-step rate-regret curve, even though the reduction is fixed before the distortion target is chosen. A second result gives an exact characterization for quadratic loss on affine feasible-action sets: the canonical reduced source is the projection onto the directions in which feasible actions can differ. Under a fixed energy budget, this becomes centered load, while retaining only the optimal water-filled action is too coarse. Earlier Information Bottleneck, semantic rate-distortion, and goal-oriented quantization results are then used to distinguish exact, architecture-conditioned, approximate, failed, and corrected contractions. The framework suggests a way for heterogeneous machines to exchange what a receiving task needs without first aligning their full internal representations.
Read the full abstract

2610.08884 · 6 Oct · 19 pages, 1 figure, 1 table. An earlier version was first posted on Zenodo in September 2026 (v1: doi:10.5281/zenodo.22834532; all versions: doi:10.5281/zenodo.22834531). Companion paper on task-relative information contracts: doi:10.5281/zenodo.22819849

Information Theory

Slow Beats Fast at the Kesten-Stigum Threshold: Minimax, Fisher-Information and Belief-Propagation Characterizations of the Information-Computation Gap in Sparse Stochastic Block Models

We study community recovery in the sparse symmetric stochastic block model with $q$ communities, average degree $d$ and signal strength $\lambda$ through statistical decision theory and Fisher information, and obtain three characterizations of the Kesten-Stigum threshold $d\lambda^2=1$ and of the information-computation gap below it. First, on each community-size profile the minimax risk of any class of rules closed under averaging and vertex relabeling equals its Bayes risk under the uniform prior; the posterior mean is the unique Bayes rule and is admissible, and the Bayes risk of degree-$D$ polynomial rules is the trivial risk times $1-\mathrm{Corr}_D^2$. Combined with known low-degree and information-theoretic results, this gives the gap as a worst-case statement: for $q\ge 5$ there is a window below the threshold in which no low-degree rule beats the trivial risk asymptotically, while an exponential-time rule does on a set of labelings of probability $1-o(1)$. Second, the Fisher information about $\lambda$ carried by cycle counts is a series with terms of order $k(d\lambda^2)^k$, convergent exactly when $d\lambda^2<1$; below the threshold the relative error of every unbiased cycle-based estimator of $\lambda^k$ stays above an explicit constant, and every cycle-count test has success probability bounded below one. Third, the derivative of belief propagation at its uninformative fixed point multiplies a random perturbation by $|\lambda|\sqrt{d}$ per iteration, and one EM step taken there leaves $\lambda$ unchanged. A signal-to-noise computation recovers the condition $d\lambda^{1/\chi}>1$ of Chin et al. for $q=n^\chi$ communities and identifies personalized PageRank as a walk count with suboptimal weights. Experiments on networks with up to $3\times 10^5$ vertices confirm the threshold for $q=2$, the hard window for $q=5$, and the many-community scaling.
Read the full abstract

Information Theory

Algorithms for Sampling Self-Orthogonal and Totally Self-Orthogonal Codes in Odd Characteristic

We give an algorithm that samples uniformly random linear codes of any hull dimension and type over finite fields of odd characteristic, implying the first algorithm for sampling uniformly random self-orthogonal codes of any rate, including self-dual codes. Our algorithm is a re-visitation of the algorithm given by Albrecht, Benčina and Lai (EC'25), using the mass formulae proven by Li, Shi and Ling (IEEE Trans. Inf. Theory 71(1)). This allows us to instantiate code-based cryptographic schemes that rely on the hardness of Permutation Code Equivalence (PCE) on `random' self-dual codes for security and that were previously unable to sample them. Building on the observation by Bardet, Otmani and Saeed-Taha (ISIT'19) that Euclidean orthogonality is insufficient when considering PCE over finite extension fields due to non-trivial Galois automorphisms, we study the behaviour of what we call total orthogonality, that is orthogonality with respect to all induced Galois geometries simultaneously. We characterise total orthogonality of vectors and codes, and give an algorithm that samples linear codes with a total hull of a prescribed dimension; a subcode that acts as the hull in all Galois geometries of the ambient space. The algorithm incurs a rate decrease by a factor equal to the extension degree, however, we argue why this may be necessary in the context of PCE and explore how it limits the practicality of our algorithm. We consider the notion of Galois type of a linear code when Galois hulls are symmetric and show that all linear codes have constant Hermitian type.
Read the full abstract

Information Theory · Cross-listed from cs.CC

Reed-Solomon Codes at Capacity: Algorithmic List-Decoding and Proximity Gaps

Understanding the limits of list-decodability of Reed-Solomon codes has been one of the most important open problems in algebraic coding theory. Recently, Brakensiek, Chen, Putterman, Zhang, and Zheng, in a remarkable breakthrough, showed that Reed-Solomon (RS) codes over fields of large characteristic are algorithmically list-decodable all the way up to capacity. Building on this result, Jeronimo subsequently extended these techniques to solve the proximity-gaps question for RS codes. In this article, we give a unified and transparent exposition of these results.
Read the full abstract

Information Theory

Graph-Based Linear Codes Associated with the Finite Ring $\mathbb{F}_p[x]/\langle x^4 \rangle$

We investigate the linear codes derived from the zero-divisor graph $\Gamma(R)$ of the finite local ring $R = \mathbb{F}_p[x]/\langle x^4 \rangle$ for an odd prime $p$. Using an equitable partition of $Z^*(R)$, we determine the parameters of the binary incidence code of $\Gamma(R)$ and construct induced bipartite subgraph codes achieving dual minimum distance $4$. Over $\mathbb{F}_p$, we parameterize the adjacency and Laplacian codes, derive the closed-form weight distribution of the Laplacian code via the MacWilliams identity, and establish its LCD property. Additionally, we determine the automorphism groups of the graph and its matrix codes. Finally, from extremal subgraphs of $\Gamma(R)$, we construct two families of Griesmer-optimal linear codes over $\mathbb{F}_p$, comprising a constant-weight minimal code and an optimal two-weight code.
Read the full abstract

Information Theory

HintKD: Hint Knowledge Distillation for Bandwidth-Constrained Cloud-Edge Inference

Collaborative inference between the edge cloud and user equipment (UE) is a promising paradigm for deploying large deep neural networks (DNNs) in 6G networks. However, existing cloud-edge inference and distillation schemes often require the real-time transmission of high-dimensional intermediate features or soft probability vectors, which imposes a substantial communication burden on bandwidth-limited wireless links. To address this challenge, we propose HintKD, a bandwidth-constrained distillation framework for cloud-edge inference. The core idea is to compress the teacher's guidance into compact discrete hints rather than transmit raw features directly. Specifically, a cloud-side teacher is first trained with a maximum conditional mutual information (MCMI) objective to preserve informative intra-class variations. Its latent representation is then mapped to a compact codebook through differentiable vector quantization. During deployment, the cloud transmits only a hint index, and the UE uses a lightweight FiLM-based adapter to modulate student features according to the received codeword. Experiments on the DeepSense 6G beam prediction task show that HintKD preserves competitive accuracy while reducing the inference-side communication payload from O(D_t) for feature transmission or O(C) for logit transmission to O(1) for discrete hint transmission. In addition, experiments on the MNIST dataset further verify the generality of the proposed distillation method across different datasets and tasks. These results show that HintKD achieves a favorable accuracy-bandwidth trade-off by replacing high-dimensional feature or logit transmission with a compact discrete hint index.
Read the full abstract

All authors Wanling Luo, Jiayi Zhang, Bokai Xu, Ziheng Liu

Information Theory

Multi-Agent Reinforcement Learning for Movable Antenna-aided Cell-Free Massive MIMO Systems

The inherent non-convex minimum-separation constraints introduced by movable antennas present a formidable challenge to the joint optimization of antenna positions and transmission strategies, rendering conventional methods computationally infeasible, particularly in large-scale cell-free massive multiple-input multiple-output (MIMO). In this work, we propose the graph-based learning individual intrinsic reward heterogeneous-agent proximal policy optimization (GLIIR-HAPPO) algorithm, a novel heterogeneous multi-agent reinforcement learning (MARL) framework that fundamentally overcomes this impasse by systematically decomposing the original coupled optimization into coordinated subproblems. To ensure tractability, we embed the non-convex geometric constraints into a penalty-augmented reward structure and develop a specialized geometric solver that enables the positioning agents to efficiently navigate the high-dimensional action space. Specifically, we propose an architecture featuring a dynamic-interaction graph critic for adaptive cross-role coordination, together with role-conditioned federated distillation that synchronizes same-role policies through compact actor-output statistics. Beyond architectural design, we establish a rigorous theoretical analysis that derives monotonic performance improvement bounds and establishes convergence guarantees for the proposed bi-level optimization. Numerical simulations demonstrate that our framework yields significant sum-rate improvements over state-of-the-art MARL schemes. Moreover, the performance of our advanced architecture closely approaches its fully centralized counterpart, while drastically reducing communication overhead.
Read the full abstract

All authors Bokai Xu, Jiayi Zhang, Shuaifei Chen, Ziheng Liu, Huahua Xiao, Derrick Wing Kwan Ng, Bo Ai

Information Theory

Optimal Conversion Bandwidth for MDS Convertible Codes in the Split Regime with $r^F<k^F<r^I$

Erasure codes are widely used in distributed storage systems to provide fault tolerance. An $[n,k]$ erasure code encodes $k$ data symbols into $n$ coded symbols and distributes them across $n$ storage nodes. Once the code parameters are fixed, the achievable fault tolerance is also fixed. However, the failure rates of storage nodes may vary over time, and dynamically adapting the code parameters to these variations can substantially reduce storage overhead. Motivated by this observation, Maturana and Rashmi introduced convertible codes, which allow an $[n^I,k^I]$ initial code with redundancy $r^I=n^I-k^I$ to be transformed into an $[n^F,k^F]$ final code with redundancy $r^F=n^F-k^F$, while preserving the required code properties. Convertible codes whose initial and final codes are both MDS codes are called MDS convertible codes. They are of particular interest because MDS codes provide the maximum erasure tolerance for a given amount of storage overhead. Several works have established lower bounds and constructions for the bandwidth cost of MDS convertible codes in the split regime. However, the tight bound in the parameter range $r^F<k^F<r^I$ remains unknown. In this work, we establish a family of new rank inequalities for stable MDS convertible codes with linear conversion procedures and derive an improved lower bound on the bandwidth cost consisting of three cases for this remaining range. We prove that the bound is tight by presenting three explicit constructions, one for each case.
Read the full abstract

Information Theory

On the State Evolution of Approximate Message Passing with Discontinuous Denoisers

We consider approximate message passing (AMP) with discontinuous denoisers, such as hard slicers, quantizers and hard thresholding, for which the classical state evolution (SE) analysis does not apply. It is first shown that the standard Onsager coefficient; i.e., the average pointwise derivative of the denoiser, misses a boundary term, namely, the sum over the jumps of the jump size times the density of the denoiser input at the jump. Then, for real independent and identically distributed (i.i.d.) Gaussian matrices, a positive noise variance, a fixed number of iterations and a prior with finite second moment, we transfer the Lipschitz SE theorem directly to denoisers, fixed in advance, that are continuously differentiable with bounded derivative except at finitely many jumps, by bounding the distance between the iterates of AMP and of AMP on Lipschitz ramps of the denoisers through the fraction of inputs that cross a jump. It is thereby proven that AMP follows SE, also for test functions such as symbol errors, if its Onsager coefficient contains the boundary term, evaluated either along SE or, as we propose, at the noise level estimated from the residual, with the density computed from the known prior. Simulation results with 4- and 8-level pulse amplitude modulation (PAM) demonstrate that AMP with a hard slicer, whose standard coefficient is identically zero, fails with this coefficient, while with the proposed one, it follows SE and comes close to Bayes-optimal AMP.
Read the full abstract