Peer Revenue Impact factor: volatile

Papers

Fresh from arXiv, typeset properly. Highlighted words trade on the market.

Computer Science Information Theory

cs.IT Watch Information Theory (sign in to use)

Wednesday 26 August

Information Theory · Cross-listed from cs.MS

The Pauli Lightcone: Information-Theoretic Error Mitigation Beyond the Autocorrelation

We introduce the wavemap: a spatial portrait of noise effects that assigns each site a per-noise-level arrival delay l_\gamma (v) and cross-entropy loss L_\gamma(v). These observables are exact at the lightcone frontier, where bond dimension \chi is small and the simulation is most faithful. Eigenvalue analysis of the composed gate-plus-noise Pauli transfer matrices confirms that the studied noise is pure amplitude damping: the spatial propagation pattern is entirely determined by the gate, making the wavemap a model-free noise diagnostic. We apply the multi-product formula (MPF) to recover the noiseless Pauli weight field from the noisy samples, subject to the Lieb-Robinson causal constraint nMPF <= nnl . Fitting time-adaptive coefficients \alpha(t) over the frontier recovers up to 55% of the information loss relative to the best noisy sample, exploiting the fact that the frontier is where truncation error is smallest. On an IBM heavy-hex lattice with heterogeneous hardware noise the method identifies an information-starved regime, pointing to calibrated synthetic noise as the next required experiment.
Read the full abstract

2608.25254 · 26 Aug · Results are independent and no raw data is disclosed. However, one simulation run incorporated noise data provided under a collaboration agreement for a joint publication in preparation. Withdrawing to resolve partners' concerns and delineate research scope. Revised version to follow, showing key findings are geometric properties reproducible with public synthetic noise models

Tuesday 25 August

Information Theory · Cross-listed from math.RA

A quaternionic construction behind $841$-point kissing arrangement in ${\mathbb R}^{12}$

Recently, a new record kissing arrangement of $841$ points in $\mathbb R^{12}$ was obtained numerically by optimization (Takhanov-Assylbekov-Yun, 2026). The configuration was released as a coordinate file, without a mathematical description of its structure. The purpose of this paper is to provide such a description. The key observation is that the geometry becomes transparent once we regard $\mathbb R^{12}\cong \mathbb H^3$ as the Cartesian product of three copies of the quaternion algebra. We first introduce a new $840$-point kissing arrangement with a certain quaternionic structure. It consists of three mutually orthogonal regular $24$-cells, supported on the three quaternionic coordinate factors $\mathbb H\times\{0\}\times\{0\}$, $\{0\}\times\mathbb H\times\{0\}$, $\{0\}\times\{0\}\times\mathbb H$, together with two $384$-point families obtained by lifting affine sets of the form $$\{(u,v,w)\in (\mathbb F_2^2)^3\mid u+v+w=\eta\},$$ to quaternionic triples (whose components belong to the binary octahedral group $2O$) and then applying suitable component-wise rotations and weightings. A characteristic feature of this construction is a pronounced asymmetry among the three quaternionic factors. For the $816$ vectors obtained after removing the third $24$-cell, most of the squared norm is concentrated in the first two quaternionic coordinates, while the third coordinate carries systematically less mass. Thus, the third four-dimensional factor contains more available space than the first two. We then show that this $840$-point configuration provides a natural structural model for the numerical $841$-point record. Finally, we introduce a notion of the general quaternionic construction in dimensions divisible by $4$, and check that record kissing arrangements in ${\mathbb R}^{4k}$, $k\leq 5$, admit a quaternionic construction.
Read the full abstract

Information Theory · Cross-listed from cs.GT

Truth Revelation, Information Hiding, or Misinformation: Characterization of Equilibrium Outcomes in Signaling Games

In signaling games where a sender and a receiver have misaligned criteria, equilibrium behavior may lead to fully revealing, quantized, or randomized policies. Notably, the first arises in statistical decision theory and classical communication theoretic problems involving a fully aligned sensor and receiver, the second arises in Nash theoretic simultaneous signaling games, and the last may appear in Stackelberg type (leader-follower) Bayesian signaling games. In this paper, we investigate the Bayesian persuasion problem involving a receiver that tries to estimate the source. We show that for certain payoff structures, the equilibrium solution is such that a source observation is mapped to distinct messages with nonzero probabilities. More specifically, we completely characterize conditions under which the sender requires randomization for the Bayesian persuasion problem involving general sources with finite cardinality. In particular, regardless of whether the equilibrium solution under a deterministic policy restriction is fully revealing, quantized or noninformative, there exists a randomized sender policy that improves the sender's payoff under certain conditions characterized in the paper. Moreover, we provide an algorithmic procedure to obtain the Bayesian persuasion solution, where the algorithm compares the payoffs with finitely many posterior probability combinations. We also consider fully aligned and completely misaligned payoff structures, where the solutions respectively involve a fully revealing sender and a noninformative sender. Then, we unify these results by proving that if the sender's expected payoff with respect to posterior distributions is continuous, then the equilibrium solution involves either a fully revealing sender or a noninformative sender.
Read the full abstract

Information Theory · Cross-listed from cs.LG

Transforms for LLM Quantization: The Great Inversion and Format Co-Design

Most competitive 4-bit LLM research pipelines now open the same way: apply a linear, function-preserving transform (rotation, scaling, permutation, non-orthogonal affine) so the outlier mass sits more favorably against the group scales, and only then round. Yet we are aware of no survey dedicated to this transform stage, and its literature is quietly re-deriving an older theory. We identify and formalize the principle that organizes it, the Great Inversion: allocation-flexible coding rewards energy concentration, whereas the grouped shared-scale quantization a deployed matrix instruction performs rewards within-group flattening. Classical transform coding (1963: decorrelate, allocate bits, quantize) spends different bits per coordinate at a fixed total rate; for a Gaussian source at high rate the Karhunen-Loeve transform's concentration minimizes distortion. A deployed operand tile instead carries one absolute-maximum scale per group and equal bits everywhere, with no allocation; on a uniform grid that objective rewards flattening, approached by Hadamard incoherence. We prove that opposition under within-group majorization: the prescriptions point in opposite directions, each backed by a proof against its own objective, and for a generic spectrum no optimality guarantee transfers. A second axis is the number format: the non-uniform FP4 grid makes flattening buy less, MXFP4's power-of-two block scale still rewards a rotation confined to that block, and NVFP4's mantissa-carrying scale largely removes that pull, so the target pole depends jointly on allocation regime and format. We survey 200 works to a June 2026 cutoff; classify 43 transform methods by structure, data-awareness, searched-versus-constructed, and runtime cost; record, where reported, how they compose with GPTQ rounding; distill a first-choice guide by deployment regime; and close with the open problems it exposes.
Read the full abstract

Information Theory

The Optimal Asymptotic Rate of Generalized Covering Codes

Let $G_q$ be an alphabet of size $q\geq2$. We determine the optimal asymptotic rate of generalized covering codes $C\subseteq G_q^n$, whose covering centers in $G_q^{t\times n}$ are constrained to the product form $C^t$. For every fixed integer $t\geq1$ and every $\rho\in[0,1]$, we prove that \[ \kappa_t(\rho,q)= \begin{cases} 1-H_{q^t}(\rho),&0\leq\rho<1-q^{-t},\\ 0,&1-q^{-t}\leq\rho\leq1, \end{cases} \] where $\kappa_t(\rho,q)$ denotes the minimum asymptotic rate $n^{-1}\log_q|C|$ among codes whose $t$-th covering radius is at most $\rho n$, and $H_{q^t}$ is the $q^t$-ary entropy function. When $q$ is a prime power, we prove that the same formula holds under the additional requirement that $C\leq\mathbb F_q^n$. Thus, both the product-form constraint and linearity are asymptotically cost-free: the resulting rate is the ordinary sphere-covering rate over an alphabet of size $q^t$. This extends the recent $t=2$ result of Elimelech and Schwartz for codes without a linearity constraint and the classical $t=1$ result of Cohen and Frankl for linear codes, thereby resolving both open problems posed by Elimelech and Schwartz. Our proofs are probabilistic and combine tools from information theory and probabilistic combinatorics, including the method of types, Janson's inequality, the second-moment method, and a structured alteration argument. Direct applications of Janson's inequality and the second-moment method are obstructed by highly dependent pairs of candidate error matrices. We overcome this obstruction by restricting the errors to a balanced exact-type class of optimal exponential size. Standard type-class estimates, together with Shearer's inequality, then give the required bounds on the number of error-matrix pairs whose selected rows have a prescribed difference.
Read the full abstract

Information Theory

Next-generation O-RAN Edge: Energy-aware Joint Placement and Migration of Cloud-Native Functions

The transition toward Open Radio Access Networks (O-RANs) is reshaping how cellular infrastructure is deployed, managed, and optimized. This paper investigates the energy-aware joint placement and migration of cloud-native functions (CNFs) in an O-RAN edge cloud. We consider both a Single-CU-UP association model and a slice-aware Multi-CU-UP relaxation, in which distinct slice-flow groups of the same distributed unit (DU) may be assigned to different Centralized Unit User Plane (CU-UP) processing targets under one Centralized Unit Control Plane (CU-CP). For brevity, these scenarios are referred to as Single-CU and Multi-CU, respectively; Multi-CU never denotes multiple CU-CP associations. We formulate the problem as a Mixed-Integer Linear Program (MILP) that minimizes server, transmission, wake-up, and migration energy while satisfying server-resource capacities and one-way delay requirements over the F1 user-plane interface (F1-U) between each DU and its selected CU-UP in a fat-tree edge data center. To improve computational scalability, we also develop a deterministic k-means-based heuristic that approximates the MILP decisions without requiring repeated exact optimization. Over the evaluated 24-hour workload, the theoretical Multi-CU relaxation reduces modeled energy consumption by 5.7% relative to the Single-CU baseline. For the Multi-CU case, the proposed heuristic remains within approximately 9.7% of the proposed MILP, demonstrating a favorable trade-off between energy efficiency and computational tractability.
Read the full abstract

Information Theory

Reliability Limits and Decoding for Partial Nanopore Protein Rereads With Persistent State

Repeated observations of one physical object need not constitute independent channel uses. We model partial nanopore protein rereads as a finite-alphabet channel with canonical content, persistent readout, and pass-local coverage and synchronization. For exact compound-pass data, matched inference approaches the equivalence-class canonical posterior, and sitewise excess Bayes risk admits an action-aware achievable exponent. In an aligned specialization, observation-local redraw can cause linear-in-$K$ growth in true-label negative log-likelihood (NLL). We derive order-$b$ projection-stability bounds and an exact passwise-fusion diagnostic. On a PASTOR-informed semi-synthetic hard-symbol channel, label-blind deterministic-mixture importance sampling (LB-IS) agrees with exact enumeration at $L=7$. At $L=24, K=10$, LB-IS meets every prespecified aggregate absolute marginal-posterior and score-agreement criterion against a fixed high-allocation reference in three selected conditions. Joint agreement holds for the representative and high-NLL conditions, while the near-zero condition remains inconclusive. Exact $L \leq 6$ benchmarks identify order 4 as the smallest tested common cap. At target scale, the reference supports selected unprojected functionals, while neither order 4 nor 5 attains joint agreement, defining a tested finite-memory boundary. Across 16 cells, the order-4 shared branch lowers NLL by 0.033-0.224 nats per residue relative to pass-local.
Read the full abstract

Information Theory

Code-Domain Grouped Index Modulation for Spectrally Efficient Spread-Spectrum Communications

Efficient exploitation of spreading resources is important for improving the transmission efficiency of spread-spectrum communications. Code index modulation (CIM) conveys additional information through spreading-code indices without requiring extra radio-frequency chains. The fixed number of code-index branches in existing CIM schemes limits information allocation between the code-index and modulation-symbol domains as the target rate increases. This paper proposes code-domain grouped index modulation (CGIM), which partitions an orthogonal spreading-code bank into multiple groups and maps the in-phase and quadrature components of one quadrature amplitude modulation (QAM) symbol in each group onto two independent code indices. Group-wise despreading enables parallel detection. Group-wise maximum-likelihood (ML) and low-complexity greedy detection (GD) are developed, with both achieving joint ML decisions under the stated conditions. A pairwise error probability (PEP)-based bit error rate (BER) analysis is derived for Rayleigh and Nakagami-$m$ fading, with additive white Gaussian noise (AWGN) as a benchmark. Numerical results show that CGIM achieves better BER performance than traditional CIM benchmark schemes at the same transmission rate, owing to a more balanced distribution of information bits between the code-index and modulation-symbol domains.
Read the full abstract

Information Theory · Cross-listed from cs.DC

Asynchronous Verifiable Information Dispersal with Low Space and Communication Complexity

The primary goal of a distributed storage system is to ensure that clients can both write and read data in a reliable and consistent manner, even in the presence of failures. While existing asynchronous verifiable information dispersal (AVID) protocols achieve optimal space complexity for storage and communication complexity for data retrieval in a Byzantine setting, the crucial operations of data dispersal and node recovery have received less attention. We propose an efficient AVID protocol that simultaneously guarantees low complexities for dispersal, storage, retrieval, and recovery. At the core of the proposed protocol lies a novel mechanism to encode data in a two-dimensional matrix and a bespoke dispersal algorithm. The protocol maintains an optimal communication complexity for retrieval while substantially improving upon the state of the art for recovery. Additionally, we describe how the protocol can be modified in order to reduce the space complexity and the communication complexity for dispersal, at the expense of a higher communication complexity for retrieval and recovery. As the proposed protocols strike a balance across all considered metrics, they are suitable for a broad range of real-world use cases.
Read the full abstract

Information Theory

HARQ-CC-Aided Slow Fluid Antenna Multiple Access with Highly Correlated Ports: An LST-Based Performance Analysis

Hybrid automatic repeat request with chase combining (HARQ-CC) improves the reliability of slow fluid antenna multiple access (sFAMA) through multi-round combining. However, existing analysis has not fully utilized the structure of densely spaced and highly correlated fluid antenna system (FAS) ports to derive tractable per-round characterizations, thereby maintaining a computationally intensive process. This paper re-investigates downlink HARQ-CC-aided sFAMA with densely-spaced and highly-correlated FAS configuration. Under a spatial block correlation model, we first formulate two validity-corrected high-correlation approximations for the per-round selected-port signal-to-interference ratio (SIR) distribution and its Laplace–Stieltjes transform (LST): a Marcum-Q-kernel route and a lower-complexity step-threshold route. Closed-form expressions are also obtained for block-representative antenna selection (BR-AS) and fixed-position antenna (FPA). Then, the per-round characteristics are used to evaluate the multi-round accumulated-SIR distribution through SIR-domain Stieltjes convolution and numerical LST inversion, yielding the outage probability, average number of transmissions, and payload throughput. Numerical results show close agreement between the two evaluation methods. The analytical FAS results are conservative relative to simulation but preserve the performance trends and receiver ordering. The FAS receiver consistently outperforms the benchmarks, while the payload-throughput gain from increasing the HARQ transmission limit becomes marginal under severe multiuser interference.
Read the full abstract

Information Theory · Cross-listed from cs.LG

Persistent Cross Entropy

Persistent entropy is the Shannon entropy of a persistence-based probability measure defined on a persistence diagram. However, its cross-entropy version is not naturally defined because two persistence diagrams generally have different event spaces. To bridge these event spaces, we combine a similarity function with persistence weighting to define an induced probability. The induced probability reflects information from one diagram on the event space of the other diagram and assigns unexplained probability mass to the unexplained event. Using the induced probability, we extend cross entropy to persistence diagrams, called persistent cross entropy (PCE). We establish the main properties of both the induced probability and PCE and prove stability theorems for both. Through three numerical studies, we show that PCE distinguishes diagrams with the same persistent entropy, separates causal directions in dynamical systems without constructing a joint persistent diagram, and can be used as a directional topology loss for knowledge distillation.
Read the full abstract

Information Theory

Achieving Torn-Paper Channel Capacity with Successive Revelation

The torn-paper channel independently cuts a binary codeword at its internal boundaries and outputs the resulting oriented fragments as an unordered multiset. We consider the critical regime pN log N to alpha, in which the channel capacity is e to alpha. Existing coding schemes use a fixed-density pilot to localize fragments, creating a tradeoff between positional information and payload rate. This paper introduces successive revelation, which partitions the codeword into interleaved tracks and decodes them sequentially. Each recovered payload track becomes an additional positional reference for subsequent stages, allowing progressively shorter fragments to be localized. We establish a finite-track achievable rate whose gap to capacity is O 1 or M for M tracks. Consequently, for every rate below the channel capacity, a finite number of tracks yields a sequence of deterministic codes with vanishing average decoding error probability.
Read the full abstract

Information Theory

Distributed Hypothesis Testing Against Dependence

We study distributed hypothesis testing and establish the exact error exponent in single-letter form for new testing problems. In distributed hypothesis testing, a receiver decides between $\mathcal{H}_0:P_{XY}$ and $\mathcal{H}_1:Q_{XY}$ based on $Y^n$ and a rate-limited description of $X^n$. So far, such single-letter forms are known only for testing against independence, studied by Ahlswede and Csiszár, and testing against conditional independence, studied by Rahman and Wagner. In this paper, we study testing against dependence, where $P_{XY}=P_XP_Y$, and show that its error exponent is given by Han's exponent, which is established by single-letterizing a multi-letter version of Han's exponent. We also disprove a previous conjecture of Han claiming that the error exponent is given by the lautum information, as we show that Han's exponent can strictly exceed the latter. We then consider the Cartesian product of testing against dependence and testing against independence, and derive a single-letter characterization of its error exponent. We next study testing against conditional dependence, which is the dependence-testing counterpart of the setting studied by Rahman and Wagner. We derive a single-letter converse bound for the error exponent by introducing and solving a related setting where the side information is also available to the transmitter. We show that our converse bound is tight in some cases by using a conditional-coding version of the quantization scheme. Finally, we extend our converse method for testing against dependence to the general setting, and recover a recently established single-letter converse bound.
Read the full abstract

Information Theory

Resource Allocation for Secure Dual-UAV-Assisted ISAC System

Integrated sensing and communication (ISAC) is a rising technology in the next wireless communication networks, enabling the simultaneous execution of communication and sensing tasks by fully utilizing limited spectrum resources. In this work, we investigate the secrecy performance of a dual-uncrewed aerial vehicle (UAV)-assisted secure ISAC system. Specifically, a base station UAV communicates with users and transmits radar signals to locate potential eavesdroppers, while simultaneously providing information to a jammer UAV to perform jamming tasks. Considering constraints such as maximum UAV velocity, transmit power, propulsion energy, and sensing thresholds, we maximize the average secrecy rate by optimizing user scheduling strategies, time allocation, transmit power, and UAV trajectories. The presence of a non-convex problem, originating from tightly coupled variables, is tackled by an efficient iterative algorithm. In particular, the original optimization problem is decomposed into six subproblems, and non-convex subproblems are transformed into approximately convex forms via successive convex approximation. Then, block coordinate descent techniques are employed to solve all subproblems sequentially. Numerical results demonstrate the convergence and effectiveness of the proposed algorithm.
Read the full abstract

All authors Hongjiang Lei, Jianshuo Geng, Ki-Hong Park, Jia Ye, Liang Yang, Xiaqing Miao, Gaofeng Pan

Information Theory

Universal Random Coding for Successive Refinement of Individual Sequences Based on Lempel-Ziv Complexity

This work extends an earlier proposed universal random-coding ensemble for sample-wise lossy compression of individual sequences to the two-stage (successive-refinement) setting — an extension that is not quite straightforward, as explained in the sequel. The construction has three layers. First, a complete, self-contained direct/converse match in the language of type classes and typical sequences, a two-stage analogue of Rimoldi's classical characterization (applied in the superalphabet of blocks). Second, a realization of the same rates via a random-coding scheme built from the Lempel–Ziv (LZ78) complexity rather than the type-class uniform measure the first layer relies on, since an LZ-based ensemble is universal across source statistics and distortion measures, carries no block-length parameter in the codebook itself, and is directly implementable. Third, we give a fully type-free achievability construction (no joint types of $\ell$-vectors appear anywhere in its search criterion) and show it matches the same converse exactly, reaching every point of the achievable region: the same converse from the first layer already binds any code, type-free schemes included, so no separate argument is needed to certify the match. We also describe (without proof) how to extend the type-free construction to any fixed number $r>2$ of stages. Finally, we show this paper's achievable region is a superset of the one obtained by a companion paper, which is based on a finite-state modeling approach to a similar two-stage problem, extending a known single-stage domination result to two stages.
Read the full abstract

Information Theory

One Burst of t-Deletion and One Burst of t-Substitution Error-Correcting Codes

Synchronization errors, including insertions, deletions, and substitutions, may occur in bursts in communication systems such as DNA data storage, file synchronization, and magnetic recording. In this paper, we study an error model con?sisting of one burst of t-deletions and one burst of t-substitutions. By reformulating the original sequence into a matrix form, we propose an explicit construction of error-correcting codes capable of correcting one burst of t-deletions and one burst of t-substitutions with O(log n) redundancy.
Read the full abstract

Information Theory

Compressive Sensing - Introduction and Relations to Deep Learning

Compressive sensing predicts that sparse vectors (signals) can be recovered from a small number of linear measurements via efficient algorithms. This finding, which dates back two decades, has triggered a paradigm shift in signal processing and initiated many developments both in practical signal-processing applications, such as medical imaging, radar, and astronomy, and on the theoretical side. More recently, seminal connections to the field of deep learning have led to further advances in the field, such as the use of unrolled neural networks for sparse recovery and the discovery that common training algorithms (variants of gradient descent) favor sparsity in overparameterized scenarios – the so-called implicit bias phenomenon. This article gives an introduction to compressive sensing and outlines connections to deep learning. In particular, we will discuss generalization for neural networks generated by unrolling sparse recovery algorithms and implicit regularization for gradient descent applied to learning simplified linear neural networks.
Read the full abstract

Information Theory

Convertible Polynomial Evaluation Codes in the Merge Regime: A Skew-Polynomial Framework

In this paper, we develop an algebraic framework for merge-regime convertible codes that works directly with the polynomial-evaluation structure of the underlying codes. We characterize the minimal skew polynomials associated with unions of conjugacy classes, establish an evaluation-compatible product rule, and derive a special Chinese Remainder Theorem (sCRT) tailored to these evaluation sets. Based on this machinery, we propose two conversion templates for skew polynomial evaluation codes (PECs). The first applies to distinct initial PECs, whose different evaluation sets naturally provide the moduli required by sCRT. The second treats identical initial PECs, for which distinct auxiliary evaluation sets and explicit algebraic compatibility conditions are introduced to preserve unchanged symbols and to generate written symbols from designated read symbols. When instantiated with the standard basis $1,x,\ldots,x^{k-1}$, both constructions yield merge conversions for linearized Reed–Solomon codes whose final codes are equivalent to linearized Reed–Solomon codes and achieve per-symbol access-optimal cost. The framework further specializes to the commutative ring $\mathbb{F}_q[x]$, yielding corresponding conversion constructions for ordinary PECs and recovering the known polynomial-form constructions for Reed–Solomon and Tamo–Barg codes as special cases. As a further application, to the best of our knowledge, this specialization gives the first merge-regime convertible construction with Gabidulin initial codes and a final code equivalent to a Gabidulin code, while attaining per-symbol optimal access under the symbol-access model considered in this paper.
Read the full abstract

Information Theory · Cross-listed from quant-ph

Improved Quantum Codes with Transversal T Gates

In this work, we study quantum CSS codes with transversal $T$ gates. Here, $T$ gate transversality is meant in the strongest sense; the application of physical $T$ to every physical qubit yields logical $T$ on every logical qubit, without Clifford corrections. Despite the importance of the $T$ gate in fault-tolerant quantum computation, the parameters of asymptotic families of such codes have not been improved since the work of Hastings and Haah in 2017, and Haah in 2018. In this work, we significantly broaden the achievable parameters of quantum code families with transversal $T$ gates, both expanding the regime of achievable polynomial rate and distance, and constructing such codes with constant rate and growing distance; this is the first time the latter has been achieved, even when allowing Clifford corrections after the transversal $T$ gate. These are also the first codes achieving $\gamma \to 0$ for a code with a transversal $T$ gate, where $\gamma$ is the overhead exponent of magic state distillation. To do this, we develop a framework of divisible decreasing monomial codes, punctured at a downward-closed set on the Boolean hypercube to create logical qubits. We prove a closed-form expression for the distance of such a code punctured at such a set, which may be of independent interest. We first instantiate this with an explicit construction based on weighted Reed-Muller codes, puncturing at low Hamming-weight points, and then with a randomised construction, where a small random set of points is protected from the puncturing to save quantum code distance, achieving improved parameters.
Read the full abstract

Monday 24 August

Information Theory · Cross-listed from eess.SP

Fluid Antenna Channel Reconstruction with Non-Negative Least Square Detector

Reconstructing the full-aperture channel of a fluid antenna system (FAS) from a few activated ports requires inferring unobserved responses from limited spatial samples. This paper proposes a covariance-domain FAS channel-reconstruction method based on nonnegative least squares (NNLS). A nonuniform port arrangement constructs a difference coarray with an enlarged aperture. Vectorizing the sample covariance maps the physical array to a virtual steering dictionary, and the resulting complex covariance-fitting model is recast as a strictly equivalent real-valued NNLS problem. A projected-gradient iteration initialized at zero estimates the nonnegative angular-occurrence coefficients, and the L_s strongest well-separated peaks yield the angles of arrival (AoAs). Simulations show that the proposed FAS-NNLS estimator exploits the enlarged virtual aperture and achieves lower AoA mean squared errors than uniform linear array (ULA) multiple signal classification (ULA-MUSIC) and ULA estimation of signal parameters via rotational invariance techniques (ULA-ESPRIT). Its non-line-of-sight (NLoS) path accuracy matches FAS covariance matching pursuit, while its line-of-sight (LoS) estimation is significantly improved.
Read the full abstract

Information Theory · Cross-listed from eess.SP

Experimental Evaluation of a Low-Power Ultra-Wideband Receiver for Spectrum Sensing

Walsh-sequence-based receiver architectures offer an alternative approach for the reception and reconstruction of multiple simultaneous RF signals over wide bandwidths. While previous works have focused on the architecture and theoretical operation of Walsh-domain processing, limited experimental results have been reported so far on hardware operation under realistic conditions. This paper presents the experimental evaluation of a Walsh-sequence-based receiver prototype. A measurement campaign was conducted under various signal placement, interference, and receiver configuration scenarios. Reconstructed spectra, Walsh-lane power spectral densities (PSDs), and Error Vector Magnitude (EVM) measurements were used to investigate Walsh-domain signal representation, interference effects, and receiver performance. Finally, dense- spectrum experiments involving up to ten simultaneously active signals demonstrate the potential of the architecture for low power wideband spectrum sensing applications.
Read the full abstract

All authors Panagiotis Vlachos, Ioannis A. Bartsiokas, Cedric Dehos, Francois Rivet, George Karachalios

Information Theory · Cross-listed from eess.SP

A Joint Information-Theoretic and Graph Learning Framework for Sensor Placement and Macroscopic Traffic State Reconstruction

Traffic sensor placement in large urban networks must balance traffic monitoring needs with limited installation, maintenance, and data-management budgets. This study develops a framework for preserving network-wide traffic information while reconstructing flow and density at unobserved links and the macroscopic fundamental diagram (MFD). The framework combines normalized mutual information (NMI) with Inductive Graph Neural Network Kriging (IGNNK). NMI quantifies lag-aware dependence between joint flow-density states, while a greedy algorithm selects sensors by balancing weighted information coverage against redundancy. An IGNNK-based bidirectional graph-diffusion model reconstructs unobserved link states and generates the MFD. The framework was evaluated against a principal component analysis (PCA) benchmark using seven hours of dynamic traffic assignment simulation data for the Chicago network, with 4,805 directed links and 420 one-minute intervals split into training, validation, and independent testing subsets. Reconstruction performance for both PCA and NMI-IGNNK varied substantially over the sensor ratios of 0.5% to 30%. PCA generally yielded lower root mean squared error (RMSE) over the 0.5%-3% range, but its errors were nonmonotonic and reached their minimum at 2%. At 3%, normalized joint RMSE was similar for PCA and NMI-IGNNK (0.100 and 0.105, respectively). NMI-IGNNK remained applicable up to 30% coverage and generally improved as coverage increased, reducing testing-subset normalized joint RMSE from 0.212 at 0.5% to 0.043 at 30%, with consistent trends over the complete analysis period. The framework integrates lag-aware, information-theoretic sensor placement based on joint flow-density states with directed graph-based reconstruction, enabling a broad range of sensor budgets in large-scale networks without strict limits on the number of sensors.
Read the full abstract

Information Theory

A Mathematical Theory of Interpretation: Rational Entropy, Spectral Readout, and Confusability as a Resource

This article presents the abridged core of A Mathematical Theory of Interpretation (MTI), which treats interpretation as observer-relative spectral measurement under an access structure. MTI makes interpretation a method-design problem: access, query, utility, and medium determine what an observer can select, identify, communicate, or refuse. On a learning-invariant Hilbert realization, Rational Entropy measures residual uncertainty across knowledge, utility, and medium. In the finite-effective regime, we classify its zero set. Pairwise confusability is equivalent to uniform atomic collapse, while a unique utility maximum can select one atom even when other zero-cost states remain non-atomic. This reverses the usual zero-error role of confusability: agreement in at least one observer direction excludes unresolved multi-atom readings, while the joint label preserves identification. The corresponding free-design capacity is the product of all but the smallest direction budget. A four-condition certificate characterizes sharp, decodable, medium-faithful, and order-independent readout on a finite commuting code sector and returns typed obstructions when those guarantees fail. Together, these results establish MTI as a theoretical basis for constructing interpretation methods with explicit access assumptions, guarantees, and failure modes.
Read the full abstract

Information Theory · Cross-listed from math.CO

Resolving a conjecture on quadratic APN functions and a new quadratic $(n,n)$-function associated to crooked functions

We say an $(n,n)$-function $F \colon \mathbb{F}_2^n \to \mathbb{F}_2^n$ is a crooked function if for any nonzero $a \in \mathbb{F}_2^n$, the image of $D_aF(x)=F(x)+F(x+a)$ is an affine hyperplane. The only known examples of crooked functions are all quadratic almost perfect nonlinear (APN), or equivalently, for every known crooked function, $D_aF$ is affine for all $a \in \mathbb{F}_2^n$. The ortho-derivative $\pi_F \colon\mathbb{F}_2^n \to \mathbb{F}_2^n$ of a crooked function $F$ is the function such that $\pi_F(0)=0$, and for any nonzero $a$, the set $\{0,\pi_F(a)\}^\perp$ is the underlying vector space of $\mathrm{Im}(D_aF)$. We prove that for $n \geq 4$ and a crooked function $F$, if $k$ is a non-negative integer such that $F$ has $2^k-1$ quadratic component functions, $\pi_F$ has at least $2^n-2^{n-k}$ component functions of algebraic degree $n-2$. In particular, we resolve Gorodilova's conjecture that every component function of $\pi_F$ has algebraic degree $n-2$ when $F$ is quadratic APN. As a second main result, for $n \geq 4$, we associate to a crooked function $F$ a quadratic function $\varepsilon_F \colon \mathbb{F}_2^n \to \mathbb{F}_2^n$ that satisfies a strong geometric-combinatorial condition regarding the sums of $F$ over $2$-dimensional linear subspaces. As a corollary to both of our main results, we prove that for any even $n \geq 4$, any quadratic APN $(n,n)$-function has at least $n$ semi-bent components. Furthermore, we obtain a congruence result on a problem on $m$-sequences introduced by Johansen, Helleseth, and Kholosha, and we determine the exact algebraic degrees of some Boolean functions associated to the bent and near-bent components of particular classes of plateaued vectorial functions.
Read the full abstract

Information Theory

Asymptotically Tight Bounds for Generalized Covering Radii of Binary Primitive BCH Codes at All Higher Orders

We study the generalized covering radii of binary primitive BCH codes, which measure how many parity-check columns suffice to span several prescribed syndromes. For the four-error-correcting family of length $2^m-1$, the second radius is exactly $11$ for $m\geq55$, and it is either $11$ or $12$ for $m\geq16$. For every fixed error parameter at least two, we give an explicit stable bound with two adjacent possible values for the second radius and an arithmetic criterion for exactness. At every higher order, we obtain explicit lower and upper bounds whose additive gap is bounded independently of the order for each fixed error parameter, once explicit field-size conditions hold. The bounds are therefore asymptotically tight as the order grows. The higher-order upper bound retains the common-core support count established by Xiong, Yip, and Zullo; our refinement reduces its sufficient field-size threshold at large order. The refinement combines componentwise mixed degrees with the ordinary degree of a multicone. The upper bounds come from constructing syndrome representations with a common set of parity-check columns.
Read the full abstract

Information Theory · Cross-listed from math-ph

A Comment on Local Hypercube Inequalities

This comment gives dimension-independent analytic proofs of the local inequalities arising in the odd- and even-dimensional constructions of higher-dimensional partition charge functions. The prior works established these inequalities by exhaustive computation in low dimensions and tested them numerically in selected higher dimensions.
Read the full abstract

Information Theory · Cross-listed from cs.LG

Provably adaptive sampling with uniform and remasking discrete diffusion models

Discrete diffusion models offer a promising alternative to autoregressive generation by enabling parallel updates, but their sampling efficiency can depend strongly on the choice of the forward process and the sampler. For the uniform forward process, existing lower bounds for the standard $\tau$-leaping sampler scale linearly with the ambient dimension $d$, raising the question of whether this dependence is intrinsic to the forward process. We answer this question in the negative. We consider a first-order sampler based on the leave-one-out denoiser for uniform and remasking processes whose coordinate updates can be performed in parallel. In both cases, the sampler can correct denoising mistakes during the sampling process, which becomes necessary when many coordinates are updated together. Our main result establishes an adaptive sampling guarantee: up to logarithmic factors, $N = O(\mathrm{DTC}(X_0) / \varepsilon)$ discretization steps suffice to achieve sampling error $O(\varepsilon_{\mathrm{score}}+\varepsilon)$, where $\varepsilon_{\mathrm{score}}$ is the error in score estimation. Thus, the sampling complexity is governed by the intrinsic dependence structure of the target distribution, as measured by its dual total correlation $\mathrm{DTC}(X_0)$, rather than directly by the ambient dimension $d$. Our analysis proceeds through a Bayes-optimal auxiliary sampler that separates discretization error from score-estimation error. We also derive an exact information-theoretic representation of the discretization error in terms of the mutual information between different coordinates of the forward process at different times. This representation applies to general forward processes and, in the uniform and remasking cases, can be controlled by $\mathrm{DTC}(X_0)$. Numerical experiments on structured synthetic distributions illustrate the predicted dimension-adaptive behavior.
Read the full abstract

Information Theory

Exact Rate Exponent Tradeoff for New Classes of Distributed Hypothesis Testing Problems

We characterize the exact rate–exponent tradeoff for new classes of one-way distributed hypothesis testing problems by demonstrating that a recent upper bound, derived via the auxiliary-receiver technique, coincides with known lower bounds. We achieve this by relaxing the upper bound on the type-II error exponent into a form that shares the same inner functional as Han's lower bound, differing only in the outer rate constraint. Furthermore, we prove that this upper bound is tight for testing against dependence and for the doubly symmetric binary source (DSBS) with crossover probabilities $\kappa_0$ under the null hypothesis and $\kappa_1$ under the alternative hypothesis, provided $0 < \kappa_1 < \kappa_0 < \frac12$. The characterization of the exact error exponent for the DSBS source holds for every communication rate $R \geq 0$.
Read the full abstract

Information Theory

Breakdown of Edgeworth Expansion in Finite-Blocklength Regime and Exact Absorption via $q$-Deformation

This paper addresses the structural breakdown of the Edgeworth expansion in the finite-blocklength (FBL) regime, where conventional asymptotic approximations yield unphysical negative probabilities in the deep-tail region. We propose a $q$-deformed framework that resolves this inconsistency by replacing additive polynomial perturbations with a geometric deformation of the information density space. Motivated by the linearization of nonlinear dynamics, we prove that dynamically scaling the $q$-logarithmic parameter exactly absorbs the third-order skewness while preserving global nonnegativity. We establish a universal asymptotic matching, demonstrating that the framework encapsulates higher-order asymptotic scales. Numerical results confirm that the proposed method matches the state-of-the-art precision of the Cornish-Fisher bound without the risk of negative probabilities. The framework offers a robust and computationally stable foundation for evaluating operational limits in ultra-reliable communications such as 6G and URLLC.
Read the full abstract

Information Theory

Compressed sensing matrices from orthogonal spaces over finite fields of odd characteristic

In this paper, we construct deterministic matrices from subspaces of orthogonal spaces over finite fields of odd characteristic and investigate their applicability to compressed sensing. The construction is based on incidence relations among three types of subspaces, yielding families of matrices with explicitly computable dimensions and coherence. Using coherence-based estimates, we establish sufficient conditions under which these matrices satisfy the Restricted Isometry Property for prescribed sparsity levels. We also provide numerical comparisons with DeVore's deterministic construction to illustrate the trade-off between the number of measurements, coherence, and sparse recovery guarantees.
Read the full abstract