Peer Revenue Publish or profit

Papers

Fresh from arXiv, typeset properly. Highlighted words trade on the market.

Computer Science Information Theory

cs.IT Watch Information Theory (sign in to use)

Tuesday 15 September

Information Theory · Cross-listed from cs.AI

AntennaFlow: A Generative Flow Model for Offset Correction in Phaseless Antenna Testing

Near-field to far-field transformation is central to large-aperture antenna testing, yet two coupled challenges remain: costly phase acquisition at millimeter-wave bands and violations of the centering assumption under offset mounting. Existing methods address these issues separately, requiring either dense full-field data or offset vectors. We tackle both jointly by exploiting a key observation: amplitude fields under different offsets are coordinate-transformed views of the same near field. The challenge is to recover the center-aligned field from offset amplitudes without a phase or offset vector. We propose AntennaFlow, a three-stage framework: a contrastively learned encoder that maps offset views to an offset-invariant embedding, a deterministic flow-matching transport that maps offset amplitudes to center-aligned ones, and the Simplified Extrapolation Technique, whose Green-function Taylor expansion is valid only for centered fields. Experiments show that AntennaFlow enables fast, phaseless, offset-vector-free NF–FF reconstruction from sparse amplitude-only measurements, consistently outperforming existing baselines while preserving physical consistency.
Read the full abstract

All authors Yongzhi Li, Chongting Shen, Menglin Chen, Xun Jiang, Zhengpeng Wang

Information Theory

Constructions of LCPs and LCD codes from twisted Reed-Solomon codes

Linear complementary pairs (LCPs) and linear complementary dual (LCD) codes have important applications in orthogonal direct-sum masking (ODSM), which provides effective countermeasures against side-channel attacks and fault-injection attacks. While LCD codes have been extensively investigated, comparatively fewer results are available for general LCPs. In this paper, we further investigate LCPs of twisted Reed–Solomon (TRS) codes. We derive necessary conditions for two TRS codes to form an LCP and establish several sufficient conditions and explicit constructions. We also study LCD codes constructed from TRS codes and investigate the security parameters of the resulting LCPs. Furthermore, under suitable conditions, we obtain MDS LCPs of TRS codes.
Read the full abstract

All authors Shuo Sun, Wenwen Chen, Chao Liu, Yaozong Zhang, Xiaoqiang Wang

Information Theory

On Sequence Reconstruction Problem for q-ary Deletion Channels

The sequence reconstruction problem for $q$-ary deletion channels, introduced by Levenshtein in 2001, concerns the minimum number of channels required to uniquely recover a transmitted sequence when each channel introduces exactly $t$ deletions. Combinatorially, it is equivalent to determining $N_q(n,d,t)$, the maximum intersection size of two $t$-deletion balls with centers at Levenshtein distance at least $d$, for $q$-ary sequences of length $n$ over the alphabet \(\Sigma_q=\{0,1,\dots,q-1\}\). Levenshtein solved the uncoded case $N_q(n,1,t)$ for all $n\ge t$; subsequently, Gabrys and Yaakobi determined $N_2(n,2,t)$, and Wang et al. extended the result to $N_3(n,2,t)$. In this paper, we study the problem for \(q\)-ary sequences under minimum Levenshtein distance \(d=2\) with channels that introduce exactly \(t\) deletions. We determine the exact value of \(N_q(n,2,t)\) for all \(t\ge 2, q\geq 4\), and for sufficiently large \(n\), and construct explicit pairs of sequences attaining the maximum intersection. Furthermore, for each $q\ge3$, we characterize all extremal sequence pairs. In particular, if the intersection size matches the first two terms of \(N_q(n,2,t)\), then the two center sequences must contain, at the same positions, length-5 blocks of the forms \((a,b,c,a,b)\) and \((b,a,c,b,a)\) for some distinct \(a,b,c\in\Sigma_q\); for \(t\ge q+2\), the exact maximum \(N_q(n,2,t)\) is attained precisely by \(2q!\) unordered pairs of sequences with a specific block structure. Asymptotically, we prove that for \(q\ge 4\) and \(t\ge 2\), \[ N_q(n,2,t)=\frac{6}{(t-2)!}n^{t-2}-\frac{3t+13}{(t-3)!}n^{t-3}+\frac{3t^2+25t+64}{4(t-4)!}n^{t-4}+O(n^{t-5}). \] Moreover, \(N_q(n,2,t)\) and \(N_{q-1}(n,2,t)\) share their first \(q-1\) terms, and for \(t\ge q\) the coefficient of \(n^{t-q}\) in their difference is \(\frac{6t-6q+5}{(t-q)!}\).
Read the full abstract

Information Theory

CPM-LDPC Codes Attaining the Minimum-Distance Bound

We study binary quasi-cyclic LDPC codes whose parity-check matrices are full arrays of single circulant permutation matrices (CPMs), referred to here as CPM-LDPC codes. Their minimum distance is at most $(J+1)!$, where $J$ is the column weight. For every fixed pair of column and row weights $2\le J<L$, we show that this bound is attained for all sufficiently large integer lift sizes. First, we give one integer exponent matrix independent of the lift size $P$. Second, we show that independent uniform exponent choices attain the bound with probability $1-O_{J,L}(P^{-1})$. Both proofs use cycle conditions required by low-weight codewords and a lower bound on the number of terms in vectors satisfying polynomial check equations. Neither construction requires $P$ to be prime. We also give small-lift arrays attaining the bound 24 for $J=3$, $L=4,\ldots,8$, and arrays with distance at least 28 for $J=4$, $L=5,\ldots,8$, together with computational distance verification.
Read the full abstract

Information Theory · Cross-listed from eess.SP

Pinching-Antenna System With Movable Waveguides: Modeling and Optimization

This paper proposes a movable waveguide (MW)-enabled pinching-antenna system (PASS), in which each waveguide is connected via a flexible cable and can be linearly moved by drivers. By simultaneously moving the MWs and the pinching antennas (PAs) on them, MW-enabled PASS can effectively track user locations and form flexible array geometries for efficient beamforming. We first examine the special case with a single user and derive the closed-form solutions for the optimal MW positions as well as an upper bound on the user rate. Furthermore, we develop a two-step optimization algorithm to maximize the achievable rate for the user, where the first step determines the optimal MW positions using the derived closed-form solutions, and the second step alternately optimizes the PA positions through a one-dimensional (1D) local search based on the user location. Then, for the general multi-user scenario, we derive the upper bounds on the minimum rate among all users. To maximize their minimum rate, we propose a low-complexity two-scale optimization algorithm, where the large-scale global search coarsely determines the MW and PA positions, followed by a small-scale local search to finely tune them. In addition, a two-timescale optimization scheme based on statistical channel information is investigated to reduce the mechanical movement overhead of the MWs. Simulation results demonstrate that the proposed scheme achieves performance close to the derived bounds. It also flexibly adapts to different user distributions compared with the conventional PASS employing dense or sparse fixed-position waveguides (FPWs), as well as fixed-position antenna (FPA) schemes.
Read the full abstract

All authors Jingze Ding, Zijian Zhou, Bingli Jiao, Rui Zhang

Information Theory · Cross-listed from quant-ph

Phase Transition in Binary Compressed Sensing via Annealing with Adaptive Regularization

Regularization choice changes the recovery phase diagrams of annealing-based binary compressed sensing. We develop a regularization-selection method that combines systematic parameter search with random forest regression. Under noiseless Gaussian measurements with known sparsity, reference parameters are selected from a candidate grid by minimizing mean squared reconstruction error over repeated simulated annealing (SA) trials. The fitted model predicts these reference values from signal dimension, sampling ratio, and sparsity. With predicted regularization, the SA recovery transition broadly follows the asymptotic reference boundary for box-constrained $\ell_1$ recovery at the larger signal dimensions examined. Without retraining, the same predictor supplies identical regularization values to SA and a quantum–classical hybrid solver. On matched problem instances, the hybrid solver yields smaller mean squared reconstruction errors than SA in parts of the evaluated parameter space. The resulting rule reuses the searched information for subsequent reconstruction without repeating candidate searches at each setting. The results quantify empirical performance under the stated finite candidate grid and solver settings; they do not constitute a solver-independent recovery guarantee or a time-to-solution comparison.
Read the full abstract

Information Theory · Cross-listed from quant-ph

Strong converse for the quantum capacity of the pure-loss bosonic channel

This paper reports the proof of a strong converse for the unconstrained quantum capacity of the pure-loss bosonic channel. At every fixed rate above capacity, the entanglement-generation fidelity of every code is bounded by a constant times the reciprocal of the number of channel uses. The bound holds without an energy constraint and for arbitrary encoded states, including states correlated across all input modes, and arbitrary joint decoders. The proof combines quantum Chebyshev and hockey-stick testing inequalities with a uniform relative-entropy-variance bound for the balanced pure-loss channel, corresponding to transmissivity $\eta=1/2$. The variance bound follows by expressing the balanced beam splitter in bright and dark modes: the dark modes are exactly in vacuum, and any state orthogonal to that vacuum contains at least one dark photon. For general transmissivity, dilating the degrading attenuator reduces the problem to this balanced-channel setting and bounds the decoder test by precisely the factor that produces the known quantum-capacity threshold. The resulting argument establishes the strong converse at the unconstrained quantum capacity for every pure-loss bosonic channel.
Read the full abstract

Information Theory · Cross-listed from stat.ME

Locally calibrated and mesh-free inference for spatial point distributions: closed-form null, contamination law, and detectability threshold

Local inference for spatial point distributions is dominated by Monte Carlo calibration. We develop an alternative based on the Tweedie–Miyasawa identities of empirical Bayes, which relate locally weighted moments of a point distribution under a Gaussian kernel to derivatives of its log-intensity in scale space. We first establish a rigidity theorem showing that the structure of these identities forces the Gaussian kernel. Under complete spatial randomness, we derive a closed-form null distribution for a bounded inter-scale contrast, yielding a calibrated simulation-free pointwise test. In experiments, the measured type I error is 0.070 at a nominal level of 0.05, with a calibration cost 199 times smaller than Monte Carlo for the same local statistic. We then derive a contamination law for structures of dimension m and width w embedded in a uniform background, together with an explicit detectability threshold. For a filament in three dimensions, the threshold is 16 pi. The resulting scale-resolved local dimension estimator has no free parameters. Applications to California seismicity, a trefoil knot, and 10,071 SDSS galaxies show that the method separates local structures across scales without a spatial mesh and reproduces published cosmic web fractions. All experiments are reproducible from a single public script.
Read the full abstract

Monday 14 September

Information Theory · Cross-listed from cs.NI

Toward Mission-Critical ISAC: Reliable Energy-Aware Coordination in UAV Swarms

Unmanned aerial vehicle (UAV) swarms deployed in mission-critical applications must simultaneously track a mobile aerial target and maintain reliable data links. However, active integrated sensing and communication (ISAC) operation imposes a dual energy burden on propulsion and transmission, threatening mission continuity through premature battery depletion. In this paper, we propose a two-tier UAV swarm architecture in which mission UAVs (MUAVs) execute cooperative ISAC for mobile aerial target tracking while dedicated charging UAVs (CUAVs), equipped with solar harvesting panels, replenish low-battery MUAVs via aerial UAV-to-UAV wireless power transfer (WPT). We formulate the joint minimization of the cooperative posterior Cramér-Rao bound (PCRB) over MUAV trajectories, per-slot sensing-communication time splits, WPT scheduling and admission, and CUAV rendezvous trajectories, subject to minimum uplink rate, dual-tier energy causality, WPT proximity, collision-avoidance, and speed constraints, yielding a non-convex mixed-integer program (MIP) that, to the best of our knowledge, is the first to jointly couple cooperative ISAC sensing quality with aerial WPT and dual-tier energy management. To solve it efficiently, we propose Receding-Horizon Alternating Optimization (RHAO), a four-block per-slot algorithm that decomposes the problem into: charging admission via the Hungarian algorithm, MUAV trajectory and time-split via successive convex approximation (SCA), CUAV rendezvous, and WPT power allocation, with monotone convergence guarantees. Simulation results demonstrate that RHAO reduces the mean PCRB by 16.8 times over a fixed-time-split baseline and 5.4 times over a static-trajectory scheme, while the aerial WPT subsystem sustains all MUAVs above the energy-critical threshold throughout the full mission horizon.
Read the full abstract

Information Theory · Cross-listed from q-fin.PM

Separated Signal Libraries: Packing, Saturation, and Joint Spectral Limits

We study libraries of cross-sectional signals: at each date, a forecast vector over $d$ assets intended to predict the next period's cross-sectional return. Demeaned and unit-normalized, a signal is a point on a sphere and its $T$-date history a point on a product of $T$ spheres. A pairwise correlation cap on histories is a minimum angular separation on that product, so growing a library under such a cap is a packing problem. If a large library is not too pairwise correlated and is equally weighted, does the equally weighted sum (EWS) tend to a known principal-component quantity as it grows? We answer this under explicit assumptions on how the library is filled. Separation alone guarantees nothing: it fixes no limiting distribution; a saturated library covers the sphere yet can carry a biased count; and near-maximum packing on a fixed domain forces uniform volume, which on the unrestricted sphere gives zero mean and no distinguished principal component (PC1). Alignment depends on the admission rule and candidate distribution. Under the uniform product-volume benchmark, screening on positive average information coefficient (IC) yields a nonzero, target-aligned mean but an isotropic second moment, whereas a positive IC margin $\beta$ makat every finite $T$, with athree-level spectrum whose leading eigenvalue tends to $\beta^2$ while residual levels decay as $1/T$; margins of order $T^{-1/2}$ keep a positive admission rate but a vanishing eigengA finite residual-spectrum criteS-PC1 alignment.Gilbert-Varshamov codes show separation permits both outcomes: exponentially large positive-IC libraries exist whose EWS is PC1, and others whose EWS is orthogonal to PC1. $\log J=o(T)$ suffices for uniform estimation among $J$ candidates from $T$ iid dates. Derived results are proved and checked numerically; no market data are used.
Read the full abstract

Information Theory

Amortized Relaxed Locally Decodable Codes

Locally decodable codes (LDCs) enable recovery of any message symbol by probing only a small number of positions in a possibly corrupted codeword. The central parameters of an LDC are its rate, locality, and error tolerance. Ideally, one would like all three parameters to be constant. However, classical lower bounds show that such codes cannot exist. A recent line of work introduced amortized locally decodable codes (aLDCs), in which the decoder is tasked with recovering an entire block of consecutive message symbols rather than a single symbol. While prior work obtained ideal aLDCs with constant rate, constant error tolerance, and constant amortized locality, those constructions relied on either shared randomness hidden from the channel or computational assumptions restricting the channel. Another well-studied relaxation is the notion of a relaxed locally decodable code (RLDC), in which the decoder may output a special failure symbol $\bot$ rather than risk decoding incorrectly. In this work, we introduce the notion of an amortized relaxed locally decodable code (aRLDC), combining amortized decoding with the relaxed decoding paradigm. Unlike prior ideal aLDC constructions, our model is fully information-theoretic and makes no assumptions about shared randomness or computational limitations of the adversarial channel. We construct the first aRLDC with constant rate, constant error tolerance, and constant amortized locality. Moreover, for any block of length $\Omega(\mathrm{polylog}(k))$, our decoder achieves amortized locality $1+\delta^{1 - o(1)}$, where $\delta$ is the error tolerance parameter. Thus, asymptotically, recovering a long block requires essentially less than two codeword probe per message symbol recovered. By contrast, without amortization no RLDC can simultaneously achieve constant rate, constant error tolerance, and constant locality.
Read the full abstract

Information Theory · Cross-listed from eess.IV

Semantic-Aware Neural Video Codec for Error-Resilient Low-Latency Transmission

Emerging physical AI systems require low-latency, task-oriented video communication over unreliable channels. We propose a semantic-aware multi-level neural video coding method for robust low-latency video transmission over unreliable channels that are abstracted as multi-level packet erasure channels. Built upon the real-time DCVC-RT neural video codec, the proposed framework introduces a semantic- and feature-aware coding strategy that partitions encoded representations into packets carrying different levels of semantic and latent-feature importance and assigns these packets to different streams, each associated with a priority level when transmitted over unreliable communication channels. We also developed an error-resilient entropy model that removes inter-packet dependencies, allowing each packet to be decoded independently under packet losses. The complete system is trained end-to-end over the abstracted multi-level packet erasure channels, enabling learning of channel-aware representations together with importance-aware packet assignment while facilitating the network for differentiated packet prioritization. Experiments show that the proposed framework significantly improves robustness over baseline DCVC-RT under packet erasures, achieving graceful degradation in less important regions while better preserving task-relevant visual content.
Read the full abstract

All authors Matin Mortaheb, Homa Esfahanizadeh, Jinfeng Du, Harish Viswanathan

Information Theory

Two variants of Twisted Reed-Solomon Codes

Generalized Reed-Solomon codes and twisted generalized Reed-Solomon codes provide important sources of maximum distance separable codes. In this paper, we study two variants obtained by introducing column twists and simultaneous row-column twists into Reed-Solomon-type evaluation codes. For the column-twisted family, we provide necessary and sufficient conditions for the code to be MDS in terms of explicit subset product conditions. Under the stated parameter assumptions, the Schur square has dimension 2k+1, which leads to MDS codes that are not equivalent to Reed-Solomon codes. For the row-column twisted family, we establish necessary and sufficient conditions for the MDS property in terms of elementary symmetric functions. The larger Schur-square dimension provides a further distinction from both Reed-Solomon codes and known twisted families, thereby yielding new non-RS MDS codes. Finally, explicit parity-check matrices and dual descriptions are obtained for both code families. These results provide a foundation for subsequent studies of self-orthogonality, hull dimensions, and applications to quantum-code constructions.
Read the full abstract

Information Theory · Cross-listed from quant-ph

Towards Block-Level Fault-Tolerant Quantum Simulation on Small High-Rate Non-CSS Codes

Small high-rate non-CSS stabilizer codes provide compact platforms for encoded quantum computation, but mixed-Pauli checks and limited native transversal logical gates complicate fault-tolerant dynamics. Block-level constructions offer an alternative by mapping an entire logical block to a physical circuit rather than compiling separately protected logical gates. We investigate this approach using the high-rate [[8,3,3]] non-CSS code and logical Trotter circuits as a testbed. We construct flagged syndrome-extraction circuits and establish a circuit-level memory pseudo-threshold near \(1.5\times10^{-3}\). We then apply our symplectic-transvection construction, which maps a logical Trotter circuit to a physical circuit with the same block pattern for any stabilizer code. Although this mapping preserves the intended unitary algebraically, encoded Trotter circuits exhibit asymmetry between logical-\(X\) and logical-\(Z\) failure channels. Single-fault analysis identifies the mechanism: a fault on the shared parity ancilla can propagate through the uncomputation network into an undetectable logical operator, reducing the effective circuit distance in the affected sector. We evaluate flag-conditioned recovery, biased-noise decoding, CliNR resource verification, flag postselection, and asymmetric gate-noise models. These methods suppress propagated faults but do not simultaneously suppress both logical sectors in the realistic configurations studied. A diagnostic protected limit removing the identified malignant first-order locations restores pseudo-threshold behavior in both sectors, approaching memory performance. These results demonstrate the potential of block-level logical constructions for non-CSS codes without rich native transversal gate sets and the joint protection of the parity network, analog rotation, and recovery required to preserve fault-tolerant distance.
Read the full abstract

Information Theory · Cross-listed from cs.AI

Optimal Pruning for Neural Architectures using Fisher Information Distances

A new scheme for parameter pruning is introduced, derived from the differential-geometric distance in model space. Pruning a parameter sets its value to zero, representing a displacement of the model to the hypersurface on which that parameter vanishes. The minimal distance from the unpruned model to this hypersurface is naturally computed via the geodesic distance in the model space as determined by the Fisher information metric. This distance determines the true change in the model, and its performance, under pruning. By analysing progressively more faithful approximations of this geodesic distance a natural hierarchy of optimality for pruning methods is determined. This starts with the traditional magnitude pruning, then develops into new more sophisticated and effective pruning schemes. The method is demonstrated for both fully-connected networks and vision transformers, on MNIST and CIFAR-10, over the complete $0$-$100\%$ pruning range and across five random seeds. It outperforms pruning by parameter magnitude and by the local Fisher information alone in every architecture and dataset combination considered, on both accuracy and the Matthews correlation coefficient. Additionally, analysis of different levels of geodesic approximation produces intermediate pruning schemes that are computationally efficient and maintain near-optimal performance. This geometric picture supplies not only a state-of-the-art pruning methodology for AI models, but also a verified and mathematically-motivated justification for pruning schemes.
Read the full abstract

All authors David S. Berman, Yen-Yu Fu, Edward Hirst, Thelma Chiwete Obirai

Information Theory

A Hardy-Space Proof of the Filter-Only Gaussian Feedback-Capacity Formula

The feedback capacity of power-constrained channels with additive stationary Gaussian noise was formulated by Kim in [Kim, 2010] as an infinite-dimensional optimization over the spectrum of an independent stationary Gaussian component and a strictly causal feedback filter. Kim further asserted that the independent stationary component can be omitted. However, Derpich and Østergaard [Derpich and Østergaard, 2022] identified a gap in the original proof, leaving the original derivation of the filter-only capacity formula incomplete. In this paper, we establish the filter-only formula at the level of capacity suprema for noise spectra satisfying the Paley-Wiener condition. In particular, we show that polynomial feedback filters suffice in the capacity supremum, without a positive lower bound on the noise spectrum or a rationality assumption. Under a positive essential lower bound, a complementary approximation preserves the output spectrum and rate exactly, while its input power converges to that of the original pair. An interleaved AR(1) example connects these results with the SK(2) coding scheme. The argument does not assert attainment by a single filter.
Read the full abstract

Information Theory

Private Information Retrieval With Arbitrary Privacy Requirements: Introduction and Capacity Results

In this paper, we introduce the problem of private information retrieval (PIR) under arbitrary privacy requirements, in a graph-based storage system. This formulation is motivated by the server storage limitations, abundance of data (messages) and heterogeneous data privacy requirements. Under the arbitrary privacy requirement, each message has to be retrieved privately from a pre-specified subset of servers, where the subset always includes the servers storing it. Thus, each server is associated with a privacy set, which pre-specifies the message indices that should be privately retrieved from it. This setting is a generalization of the classical PIR setting, where the required message index needs to be kept private from all servers, i.e., there, the privacy set of each server comprises all message indices. Our setting is also a bridge between the newly formulated local PIR (LPIR) setting and the classical PIR setting, where in the former, the privacy set is exactly the set of stored message indices. In this paper, we derive general lower and upper bounds on the PIR capacity for general graphs, under certain privacy requirements, that capture the essence of both LPIR and classical PIR. Then, we focus on path and cyclic storage graphs under these and more fine-grained settings, for which we derive capacity results for certain cases, and establish lower and upper bounds for others. Their low degree allows for a more in-depth understanding of the new privacy formulation and admits more privacy requirement settings compared to other simple graphs. Finally, we introduce a new graph structure, the pyramid storage graph, to model server storage. Although this graph has never been investigated in the literature in any PIR context, it enjoys a nice symmetric structure for message storage and replication patterns.
Read the full abstract

Information Theory · Cross-listed from cs.LG

Sharp Regret Bounds and a Task-Covariance Correction for Spectral Representation Learning

Spectral features can remain optimal under strongly uneven task preferences when they retain the directions most useful to the tasks. In a local-task model, expected probing gain depends on the task prior only through its covariance $\Lambda$: with $B$ recording dependence between views, $k$ spectral features span the leading eigenspace of $BB^\top$, while task-optimal features span that of $B\Lambda B^\top$. We derive alignment-dependent regret bounds, matching worst-case lower bounds for a flat leading spectrum, and bounds using the leading $2k$ directions with a spectral-tail term; a spectral gap makes the bound quadratic in small anisotropy. We also bound the imbalance from random preference patterns and from averaging independent tasks with an isotropic population covariance. With known $\Lambda$, changing one term of the spectral contrastive loss selects task-optimal features; with a labelled task bank, we propose a diagnostic and test correction without retraining. Correction reduces synthetic held-out regret from $0.858$ to $0.003$ with $2000$ tasks when less task-relevant directions dominate, and on CIFAR-100 lowers empirical regret by $0.031$–$0.053$ on held-out fine-label tasks using the same images. With a small task bank, however, correction can hurt.
Read the full abstract

Information Theory

The Capacity of the Relay Channel

The capacity of the relay channel is characterized by three schemes: decode-forward, coordinated compress-forward, and uncoordinated compress-forward. The proof relies entirely on properties of typical sequences.

Information Theory

An Overview of Rate-Distortion-Perception Theory

This paper provides a comprehensive overview of the rate-distortion-perception framework, tracing its evolution from mathematical theory to practical deployment. We review the mathematical definition of the the mathematical definition of the Blau–Michaeli function and the associated coding theorems, examine computational methods for its evaluation, and discuss alternative formulations of the framework. Operational principles and design guidelines for modern image and video coding are also presented, highlighting the rate-distortion-perception framework as a rigorous foundation for developing next-generation perceptual compression systems.
Read the full abstract

Information Theory

Spatially Coupled MacKay-Neal Codes Achieve Capacity on BMS Channels at Fixed Degrees

We establish two degree-dependent results for spatially coupled MacKay-Neal codes on binary-input memoryless symmetric channels. The ensembles use uniform random smoothing and shorten both variable types outside the active chain. For $r=g=3$, every integer $\ell\geq4$, and each channel of capacity greater than $R=r/\ell$, there is a sequence of code realizations whose actual transmitted rate tends to $R$ and whose average sum-product bit error tends to zero. For $r=g=2$ and each $\ell\in\{3,4,5\}$, an interval of binary symmetric channels has capacity greater than $R$ but retains positive transmitted-bit error under terminated density evolution as chain length grows relative to coupling width. Both results follow from the signs of the same density-valued potential at uncoupled fixed points. The degree-three proof combines analytic bounds for $\ell\geq33$ with exact interval certificates for $4\leq\ell\leq32$, followed by threshold saturation and a projection argument for the actual rate. The degree-two proof analytically constructs a fixed point with negative potential and controls both boundary contributions. We relate the potential and the degree-two bifurcation condition to earlier statistical-mechanical predictions. The finite certificates and verification software are available in a versioned supplement.
Read the full abstract

Information Theory

Infinite families of 3-designs from linear and nonlinear codes

The connection between coding theory and combinatorial $t$-designs is an important research topic at the intersection of coding theory and combinatorics. Let $q=p^m$, where $p$ is an odd prime and $m\geq 2$. In this paper, we investigate a class of linear codes $\mathcal{C}$ over $\mathbb{F}_{q^2}$ and their connection with combinatorial $3$-designs. By analyzing the relevant structural properties of $\mathcal{C}$ and $\mathcal{C}^{\perp}$, we show that the supports of the codewords of every nonzero weight in $\mathcal{C}$ and {the supports of the codewords of weight $4$ in $\mathcal{C}^{\perp}$} form $3$-designs. We further investigate a class of nonlinear codes $\mathcal{C}_2$ associated with $\mathcal{C}$, and prove that the supports of the codewords of every nonzero Hamming weight in $\mathcal{C}_2$ also form $3$-designs. These results identify further classes of linear and nonlinear codes whose codewords support combinatorial $3$-designs. In particular, the nonlinear case provides additional examples of codes supporting $3$-designs, a topic for which relatively few results are currently available. As applications, we construct from $\mathcal{C}^{\perp}$ an entanglement-assisted quantum error-correcting code with parameters $[[q+1,q-3,4;4]]_q$. We also prove that $\mathcal{C}$ is an all-symbol locally repairable code with locality $3$. Furthermore, we show that the code $\mathcal{C}$ {meets the Singleton-type bound for locally repairable codes} and hence is optimal in some cases.
Read the full abstract

All authors Shiyan Xiong, Xiaoqiang Wang, Dabin Zheng, Qinqin Ji

Information Theory

Differential-linear profiles over finite fields of arbitrary characteristic

The (binary) differential-linear connectivity table (DLCT) measures the dependence between an input difference and a linear mask applied to the corresponding output difference. For vectorial Boolean functions, each DLCT entry is one half of an additive autocorrelation value. We extend this relation to functions over finite fields of arbitrary prime characteristic by introducing a level-resolved p-ary differential-linear profile. Its entries are the centered numbers of inputs for which a derivative component has each prescribed trace value in $\mathbb{F}_p$. The discrete Fourier transform of this profile is the family of additive autocorrelations obtained by multiplying the output mask by the nonzero elements of $\mathbb{F}_p$; when p=2, the usual binary identity is recovered. For a fixed input difference, we show that the profiles over all nonzero output masks determine the corresponding DDT row exactly, and we give an explicit inversion formula. We establish a second-moment identity: the total profile energy in one derivative direction is a constant multiple of the squared Euclidean distance between that DDT row and the balanced row. Thus this energy is determined by the full row differential spectrum, not by differential uniformity alone. It follows that all profiles in a direction vanish exactly when the derivative is balanced; for square maps in odd characteristic, this gives a characterization of planarity. As concrete odd-characteristic examples, we determine the complete profile of the monomial $x^{p^k+1}$ and derive an exact Kloosterman-sum formula for the inverse monomial. Finally, we determine the behavior of the profiles under equivalence. EA-equivalence reindexes the input and output masks and translates the trace level, whereas a general CCZ equivalence may mix several derivative directions. Nevertheless, for square maps the global nontrivial profile energy is CCZ-invariant.
Read the full abstract

Information Theory

Free and projective LCD codes

LCD codes over finite commutative chain rings are known to be free. However, if the ring is not indecomposable, there always exists an LCD ideal that is projective but not free. We prove that all two-sided LCD codes are projective. We generalise the characterisation of finite commutative Frobenius rings by means of the size condition of a code and its dual to the noncommutative setting. This result is applied to prove that group codes are LCD if and only if they are generated by a central idempotent.
Read the full abstract

Information Theory · Cross-listed from eess.SP

Thinking in Tokens, Talking in Bits: A Practical Interface for Token Communication

Advanced artificial intelligence models think in tokens; contemporary communication systems carry bits. The direct way to bridge this gap is to transmit tokens, but that makes a model-specific representation part of the air interface, coupling the endpoints through a shared tokenizer, codebook, and often a neural transceiver. We take a different route: keep bits in the payload and let tokens control how those bits are generated and protected. The resulting token-bit interface transition aligns task-side tokens with source- and channel-coding units, translates token relevance into codec controls, and preserves the induced priority order across the coding chain. We instantiate it for image classification, where a vision transformer scores the task relevance of each image region from its attention maps: those scores steer block-wise JPEG rate allocation, then group the compressed bits for protection at different polar-code rates. The payload remains an explicit, reconstructable bitstream recovered by a correspondingly configured decoder. Over-the-air experiments on a software-defined radio testbed show improved accuracy–latency tradeoffs over separate source-channel coding, performance competitive with far more memory-intensive neural joint source-channel coding, and graceful degradation under channel mismatch. Token communication, then, need not transmit tokens explicitly; what it needs is an interface through which tokens determine how bits are communicated.
Read the full abstract

All authors Chanho Park, Bumsu Park, Soonhee Kwon, Sangrim Lee, Namyoon Lee

Information Theory · Cross-listed from stat.ML

Conformal Individual Treatment Effect Estimation under Networked Interference

Conformal counterfactual prediction constructs prediction sets with finite-sample coverage guarantees for counterfactual outcomes and individual treatment effects under the no-interference assumption. In this work, we relax this assumption by allowing each unit's potential outcomes to depend on other units' treatments and covariates. In this setting, propensity-score reweighting does not restore weighted exchangeability, and existing methods may fail to achieve valid coverage. To address this issue, we develop interference-adjusted weighted conformal prediction that accounts for interference by constructing an observable upper bound on the ideal and unobserved conformal $p$-value under the target intervention. The resulting prediction sets provide finite-sample marginal coverage guarantees for counterfactual outcomes and individual treatment effects in both transductive and inductive settings. We also derive a sharper construction when intervention-induced changes in nonconformity scores are bounded. Numerical experiments show that our methods preserve nominal coverage, whereas existing methods may not.
Read the full abstract

Information Theory

Zero-SNR Analyticity of the Scalar MMSE Is Equivalent to Gaussianity

Let $Y_s=\sqrt{s}X+Z$, where $Z$ is standard Gaussian and independent of the real random variable $X$. We prove that, under the square-exponential moment condition $\mathbb{E}e^{\beta X^2}<\infty$ for some $\beta>0$, the scalar minimum mean-square error $\operatorname{mmse}_X(s)$ is analytic at zero signal-to-noise ratio if and only if $X$ is Gaussian, with constant random variables included as degenerate Gaussians. The proof converts estimation in the Gaussian channel into a backward heat flow acting on the moment-generating function $M(z)=\mathbb{E}e^{zX}$. Under the stated tail condition, every non-Gaussian input forces $M$ to have a nonzero complex zero. We show that each zero cluster produces a finite singularity in its localized Borel transform at the action $\xi=z_0^2/2$. After removing the action scale, the Borel coefficients have a nonzero $n^{-1/2}$ prefactor for a simple zero. A zero of multiplicity $m\geq 2$ splits according to the roots of a Hermite polynomial and instead contributes a prefactor $n^{-m/2}e^{r_m\sqrt{2n}}$. A finite-disc localization and relative-cycle continuation argument then show that at least one such singularity survives in the full Borel transform. Thus, for every non-Gaussian input in the stated class, the formal zero-SNR expansion is Gevrey-1 but divergent. Rational-MMSE rigidity and the analogous analyticity criterion for mutual information follow as corollaries.
Read the full abstract

Sunday 13 September

Information Theory

Further results on binary linear covering codes and saturating sets in projective spaces

The binary length function $\ell_2(r,R)$ is the smallest length of a binary linear code with codimension (redundancy) $r$ and covering radius $R$. Let $s_2(N,\rho)$ be the smallest size of a $\rho$-saturating set in the binary projective space $\mathrm{PG}(N,2)$. It is known that the binary length function satisfies $\ell_2(r,R)=s_2(r-1,R-1)$. We obtain the following new upper bounds on $\ell_2(r,R)$, improving the previously known upper bounds by $\Delta(r,R)$: $R=2,r=2t\ge28$, and $r=10,18,20$, $\ell_2(r,2)=s_2(r-1,1)\le51\cdot2^{r/2-5}-1,\Delta(r,2)=2^{r/2-5}$; $R=3,r=3t-1\ge41$ and $r=26$, $\ell_2(r,3)=s_2(r-1,2)\le818\cdot2^{(r-26)/3}-1$, $\Delta(41,3)=63,\Delta(r,3)=2^{(r-26)/3}$ if $r\ge44$. To obtain these bounds, we construct new infinite code families, using distinct versions of the $q^m$-concatenating constructions of covering codes, including new versions proposed in this paper. We also obtain new useful partitions of column sets of parity check matrices of some codes. The new code families provide the asymptotic covering-density bounds $\overline{\mu}(2)\le2601/2048<1.27002$, $\overline{\mu}(3)\le1.35935$, improving the previously known bounds and giving rise to the new upper bounds $f(2)\le2601/2048<1.27002$, $f(3)\le1.35935$ on the constants $f(2),f(3)$ of the Green's Open Problem 40.
Read the full abstract

All authors Alexander A. Davydov, Stefano Marcugini, Fernanda Pambianco, Stephen Wu

Information Theory

Task-Aware Beamforming for Semantic Wireless Localization

Many semantic localization tasks require determining a contextually meaningful region or state rather than minimizing the error of a full Cartesian position estimate. In such settings, aggregate localization accuracy need not align with the accuracy of the semantic decision. This paper develops a Cramér–Rao bound (CRB)-based framework that uses the local geometry of a known semantic map to guide uplink receive beamforming. Using local boundary crossing as a surrogate for semantic misclassification, we derive normal information maximization (NIM), which minimizes the CRB of the position component along the local semantic boundary normal. Under the considered single-path line-of-sight model, an optimal receive codebook can be restricted to the subspace spanned by the matched steering vector and its angular derivative, reducing the design to an allocation of measurement resources between matched and derivative spatial modes. We derive the resulting allocation for a general smooth boundary, with geofencing and intrusion detection arising as radial and tangential limiting cases. The framework is further extended to multi-region semantic maps through a distance-normalized minimax criterion and to uncertain prior locations through worst-case and prior-weighted robust formulations. Numerical results with finite-slot implementations and observation-level Monte Carlo simulations using profile maximum-likelihood (ML) estimation show that NIM allocates measurements according to the task-relevant boundary geometry and can substantially reduce semantic error relative to the classic squared position error bound (SPEB) design in the considered scenarios. The empirical results also closely follow the local CRB-based boundary-crossing approximation in the studied operating regime.
Read the full abstract

All authors Mohammad Mahdi Mojahedian, Alireza Pourafzal, Musa Furkan Keskin, Henk Wymeersch

Information Theory

Fast-Slow Communication with Endogenous Transport

A communication system may convey urgent information through a fast physical stream and more specific information through a slower material stream. In several biological and engineered settings, however, the fast process also changes the transport law of the slow one. We study this architecture under a shared resource constraint, with a strictly increasing concave fast-channel capacity–cost function and a deadline-constrained slow molecular channel. We first characterize the capacity region under separated message routing and message-independent operating-point schedules, and identify the marginal criterion for complementarity rather than competition between the streams. For one-dimensional drift diffusion, we prove that arrival probability before a deadline is strictly log-concave in Péclet number. For a distinguishable-token deadline-erasure channel, any increasing concave transport-actuation law then yields an exact single-crossing theorem: complementarity exists if and only if an initial transport-assistance elasticity exceeds one, the transition is unique when it exists, and the decreasing allocation branch remains the Pareto boundary after convexification. For positive baseline drift and sufficiently strong coupling, a unique critical normalized deadline determines when complementarity disappears. Short- and long-deadline limits clarify the associated temporal regimes. Numerical examples for a finite-frame LTI-Poisson slow channel exhibit analogous allocation behavior with counting noise and intersymbol interference.
Read the full abstract