Information Theory · Cross-listed from quant-ph
Kun Fang
Entanglement cost is the asymptotic rate of Bell pairs required to prepare a
quantum state. Its regularized definition has made exact evaluation difficult, even for isotropic states (i.e., depolarized maximally entangled states). In this work, we determine the
entanglement cost of every
qubit isotropic state and, more generally, every two-
qubit Bell-diagonal state. Our proof uses a family of suitably tuned
qubit semigroups to transform a general log-Sobolev
entropy bound into supporting lines of Wootters' function. A recent exact tensorization
theorem of Dong et al. [arXiv:2606.17729] extends these bounds to arbitrarily many copies, yielding a general lower bound on
entanglement cost. Matching this bound with the
entanglement of formation also determines the exact cost for a broader class of two-
qubit states. For qudit isotropic states, we derive another general lower bound from the full depolarizing $2\to 3$ norm. This bound substantially improves on the PPT-relative
entropy of
entanglement and nearly matches the
entanglement of formation, leaving a gap of at most $2\%$ of $\log d$ that vanishes as $d$ grows. Finally, the exact
qubit results and qudit bounds extend to the
entanglement cost of preparing
quantum depolarizing channels under both parallel and sequential strategies.
Read the full abstract ▾
Information Theory
An $m^{2.943}$ Bohnenblust–Hille Bound on the Boolean Cube
Joseph Slote, Chun-Kai Tseng and Alexander Volberg
Let $q_m=2m/(m+1)$ and put \[ \beta_0=\frac{3}{2}+\frac{1}{\log 2}=2.9426950408\ldots, \] where $\log$ is the natural logarithm. We give a proof scheme showing that, for every $\varepsilon>0$, there is $C_\varepsilon<\infty$ such that every complex-valued function $f:\{-1,1\}^n\to\C$ of
Fourier degree at most $m$ satisfies \[ \left(\sum_{A\subseteq[n]}\abs{\wh f(A)}^{q_m}\right)^{1/q_m} \le C_\varepsilon m^{\beta_0+\varepsilon}\norm{f}_\infty. \] The improvement over the $m^9$ estimate of the earlier draft has two ingredients. The first three
Fourier levels are estimated at the scales $m$, $m^{3/2}$, and $m^{5/3}$. These losses are encoded in the weight $M^{\mu_r/r}r^B\min\{r,L_M\}^8$, $L_M\asymp_B \log (M+1)$, with $\mu_r=\lceil3r/2\rceil$ for $r\ge2$. A parity-compatible central window handles $r<L_M$, while a shrinking balanced window handles $r\ge L_M\asymp_B\log(M+1)$, no parity is used in this regime. The leading high-degree loss–gain factor is $\ee\,2^{-B}$; careful uniform bounds close the bootstrap for every $B>1/\log2$. The formula for $\mu_r$ is explained below.
Read the full abstract ▾
Information Theory
Exploiting Mutual Coupling Structure for Channel Estimation of Active RIS-Assisted Links
Simon Tarboush, Pinjun Zheng, Hadi Sarieddeen et al. (+2 more)
Accurate channel modeling and estimation of active reconfigurable intelligent surface (RIS)-assisted links with densely integrated elements are essential to fully unleashing this technology's potential. This work adopts a physically consistent model incorporating mutual coupling (MC) effects, modeled via scattering parameters, in RIS-aided communication. We formulate the MC-aware channel estimation as a compressed sensing (CS) problem. The MC effect leads to an increase in the sensing
matrix dimensions. This increased dimensionality substantially elevates the complexity of the formulated CS problem. To overcome this, we propose a low-complexity
estimator that leverages the structure of the scattering
matrix and MC mechanisms to obtain a reduced-size design sensing
matrix. Numerical results demonstrate that our approach outperforms MC-unaware
estimators by several dBs, achieving accuracy comparable to fully MC-aware solutions but with significantly lower complexity.
Read the full abstract ▾
All authors Simon Tarboush, Pinjun Zheng, Hadi Sarieddeen, Tareq Y. Al-Naffouri, Giuseppe Caire
Information Theory
Learning-based near- versus far-field boundaries for ultra-massive MIMO communications
Simon Tarboush, Nour Kouzayha, Hadi Sarieddeen et al. (+2 more)
Signal processing techniques for wireless communications and sensing fundamentally differ between near-field and far-field propagation regimes. Accurately identifying the applicable propagation region is therefore essential for enabling efficient beamforming and channel estimation in ultra-massive
MIMO (UM-
MIMO) systems. This paper proposes a fully unsupervised learning framework to distinguish near-field from far-field propagation based solely on received signal measurements, before estimating the communication distance, and without relying on channel state information. The proposed approach exploits spatial signal power variations across subarrays of a UM array as a physics-inspired feature extraction stage, followed by the OPTICS clustering
algorithm to infer the communication region. Simulation results under various system configurations and signal-to-noise ratio (SNR) levels demonstrate that the proposed method accurately identifies the near-field and far-field regions, showing agreement with theoretical boundaries.
Read the full abstract ▾
All authors Simon Tarboush, Nour Kouzayha, Hadi Sarieddeen, Tareq Y. Al-Naffouri, Giuseppe Caire
Information Theory
SpaceDiffusion: Over-the-Orbit Diffusion for Space Generate-and-Forward Communications
Jianhao Huang, Zhanwei Wang, Khaled B. Letaief et al. (+1 more)
Satellite communications are an essential component of sixth-generation (6G) mobile networks, which provide ubiquitous connectivity for global services. However, the satellite uplink remains a critical bottleneck for ground devices: their limited transmit power and
antenna apertures result in low data rates and high packet errors. To overcome this bottleneck, this paper advocates a novel relaying paradigm termed generate-and-forward (GF) communications, where satellites exploit on-orbit generative artificial intelligence (AI) to robustly reconstruct corrupted data prior to forwarding. Specifically, we propose SpaceDiffusion, an over-the-orbit
diffusion framework for satellite-assisted image transmission. The core of this framework is a channel-distortion-aware
diffusion theory developed using the following approach. By formulating the recovery of compressed and lost image
tokens as an inverse problem, this theory incorporates a channel-distortion correction term directly into the conventional denoising
diffusion implicit model (DDIM) update. As a result, this design enables a single pretrained
diffusion model to adapt dynamically to varying packet-loss patterns and compression distortions without retraining. Furthermore, we analytically characterize the progressive
token-reconstruction error and derive a
diffusion-step activation threshold that predicts when SpaceDiffusion is expected to outperform conventional decode-and-forward (DF) relaying. Building on these theoretical insights, we further develop an energy-aware early-exit policy to efficiently deploy SpaceDiffusion in orbit. Experimental results demonstrate that SpaceDiffusion achieves lower end-to-end latency compared to DF scheme with retransmission protocol and saves approximately 15 dB of uplink transmit power at a target perceptual quality.
Read the full abstract ▾
All authors Jianhao Huang, Zhanwei Wang, Khaled B. Letaief, Kaibin Huang
Information Theory · Cross-listed from cs.GT
Mutual Evaluation and Supervision without Peers
Zachary Robertson
This article introduces mutual evaluation of a replicable task worker and a critic that incentivizes truthful reporting, both modeled as strategic
agents. The critic chooses a finite-valued rule that induces an evaluation score on joint report laws. Their common payoff is analyzed through regret relative to the unrestricted critic envelope. The critic rule is distinct from the evaluation score. This class enables a peer-free information elicitation mechanism using conditionally independent replications of a worker on the same task. This replication-loop mechanism implements a type-agreement payoff using same-task replications and new-task samples. In contrast to the peer-prediction and scoring-rule literature, implementations are shown that produce unbiased Pearson and Shannon information scores without requiring peers, a ground-truth reference, or likelihood-ratio estimation. A valid binary critic also can be represented by shared finite type annotations of worker returns. One runtime restriction is that the number of required replicas is random and can depend on the critic rule. Other timing effects, such as commitment and reoptimization, yield distinct incentives, connecting the framework to variational peer prediction. This mechanism class illustrates why strategic considerations matter for both critic and worker
agents.
Read the full abstract ▾
Information Theory · Cross-listed from math.PR
Copula Operad and Copula Entropy
Xuexing Lu
We construct a symmetric operad $\mathfrak{C}$ on the class of all multivariate copulas, where operadic composition is given by Sklar substitution. We prove that the absolutely continuous subclass $\mathfrak{C}^{ac}$—which coincides with the $L^1$ class of copula densities—forms a suboperad; under composition, the density of the composite copula is given by the explicit Sklar substitution density formula $g(v)=\phi\big(\Psi_1(v^{(1)}),\dots,\Psi_n(v^{(n)})\big)\prod_{k=1}^{n}\psi_{k}(v^{(k)})$. Furthermore, we show that copulas with finite copula
entropy—identified with the $L\log L$ class of copula densities—are closed under substitution and hence constitute a suboperad $\mathfrak{C}^{L\log L}$. On this suboperad, copula
entropy is strictly additive: $H(\gamma(\Phi;\Psi_{1},\ldots,\Psi_{n}))=H(\Phi)+\sum_{k=1}^{n}H(\Psi_{k})$.
Read the full abstract ▾
Information Theory
Galois Hulls of Generalized Roth-Lempel Codes and Their Applications to EAQECCs
Xuefei Wu, Qi Liu, Yingchun Chen et al. (+1 more)
The dimension of a Galois hull is an important parameter in the construction of
entanglement-assisted
quantum error-correcting codes. In this paper, we study generalized Roth-Lempel (GRL) codes with prescribed Galois hull dimensions over finite fields of arbitrary characteristic. We develop a common construction method based on normalized Lagrange coefficients and suitable choices of column multipliers, and obtain six explicit constructions from multiplicative cosets, trace fibers, additive-subspace cosets, and mixed additive–multiplicative fibers. For extension sizes $s=2$ and $s=3$, we construct MDS and AMDS GRL codes with Galois hulls of specific dimensions. The resulting codes provide EAQECCs with explicit dimension,
entanglement consumption, and relatively large minimum distance. Taking zero-dimensional hulls also gives Hermitian LCD GRL codes and the corresponding maximally entangled EAQECCs.
Read the full abstract ▾
All authors Xuefei Wu, Qi Liu, Yingchun Chen, Haiyan Zhou
Information Theory
Maximum Entropy Probability Distributions on Spheres with Fixed Mean Busemann Function and Holomorphic-Information-Geometric Model of Cognition
Vladimir Jacimovic
In the first half of the paper we revisit the question regarding MaxEnt probability distributions on spheres. We derive families of MaxEnt distributions on spheres in real and complex vector spaces with fixed expected Busemann function (energy). As a particular case, we deduce sub-families on canonical energy levels where inverse temperature equals the dimension of the sphere. In the second part we focus on the information
manifold of canonical MaxEnt distributions on the sphere in the complex vector space. This
manifold is isomorphic to the Bergman ball. We introduce the reproducing kernel on this
manifold and use the RKHS theory to elaborate the model of cognition. In particular, we state the principle of minimal cognitive effort in RKHS and demonstrate its dual relationship with the MaxEnt principle for probability distributions on the boundary sphere.
Read the full abstract ▾
Information Theory
Norm-One Torus Decompositions and Decoding of Gashkov-Sidel'nikov Codes
Minjia Shi, Shitao Li, Yuhong Xia et al. (+2 more)
Let $q=3^m$, let $K=\mathbb F_{q^2}$, and let \[\mathcal T=\{x\in K^*:\operatorname{N}_{K/\mathbb F_q}(x)=1\}.\] For both cyclic and constacyclic Gashkov-Sidel'nikov codes, we show that the set of signed parity-check column labels is precisely $\mathcal T$. Consequently, the decoding problem separates into two stages: determining the minimum error weight associated with a syndrome $S$ and constructing an error vector attaining this minimum. We identify the former quantity with the minimum additive length of $S$ with respect to $\mathcal T$ and determine it exactly by the norm and the quadratic character of $\mathbb F_q$. We also determine the complete coset-weight distribution and recover the known covering radius $3$. For the constructive part, we use quadratic-character sums and Weil bounds to construct a coset leader for every syndrome of coset weight three. The resulting procedures give complete maximum-likelihood decoders.
Read the full abstract ▾
All authors Minjia Shi, Shitao Li, Yuhong Xia, Tor Helleseth, Ferruh Ozbudak
Information Theory
A Mirror Vanishing Band for Weight Distributions of Binary Linear Codes
Xianmang He
Chen and Xie recently proved, using the Ashikhmin–Barg lemma on minimal vectors, that every binary linear $[n,k,d]$ code with $k=n-2d+2+v$ ($v\ge 0$) has no codewords of weight in the interval $[2d-v,\,2d-1]$. Their argument uses two of the five basic properties of minimal vectors established by Ashikhmin and Barg (1998). In this note we utilize the third property, the disjoint-support decomposition of non-minimal codewords in binary codes, to generate a mirror vanishing band on the other side of $2d$: if $A_{d+1}=\cdots=A_{d+t}=0$ for some $t\ge 1$ and $k\ge n-2d+1$, then $A_w=0$ for all $w\in[2d+1,\,2d+t]$. Combining the two bands, the number of nonzero weights of such a code is at most $n-d-v-2t+1$, improving the Chen–Xie bound $n-d+1-v$ by $2t$.
Read the full abstract ▾
Information Theory
Tri-Hybrid Beamforming Design for Large-Scale MIMO ISAC Systems
Tianyu Fang, Mengyuan Ma, Markku Juntti et al. (+3 more)
Tri-hybrid multiple-input multiple-output (
MIMO) architectures have been proposed as a promising solution for enabling energy-efficient communications systems in large-scale
antenna arrays by replacing conventional
antenna arrays in hybrid beamforming (HBF) systems with low-cost dynamic metasurface
antennas (DMAs). In this work, we investigate beamforming design for integrated sensing and communications (
ISAC) systems based on tri-HBF architectures, with the objective of jointly enhancing the communications sum rate and sensing sum mutual information. Specifically, we formulate a weighted multi-objective optimization problem that balances communications throughput and sensing mutual information, subject to a total transmit power consumption constraint and the physical limitations inherent to tri-HBF architectures. By exploiting the problem structure, we develop an efficient iterative
algorithm with closed-form updates to solve the non-convex optimization problem with low complexity. Numerical results are provided to evaluate the performance of the proposed tri-HBF architecture in various setups. The results demonstrate that the proposed tri-HBF architecture can achieve significant improvement in energy efficiency (EE) compared to the conventional hybrid
MIMO and DMA-only configurations, at the cost of minor degradations in sum rate and sensing mutual information.
Read the full abstract ▾
All authors Tianyu Fang, Mengyuan Ma, Markku Juntti, Inkyu Lee, Joonhyuk Kang, Nhan Thanh Nguyen
Information Theory
Equivalence Between Nested Gibbs Measures and Log-Linear Combinations of Gibbs Measures
Yaiza Bermudez, Samir M. Perlaza and Iñaki Esnaola
In this paper, three operations on Gibbs probability measures are studied. The first operation, often referred to as renormalization, takes one Gibbs probability measure and generates a new Gibbs measure by normalizing a power of its density. This normalization has a twofold effect: it changes the regularization factor and concentrates the support within a subset of the original support. Interestingly, these effects can be independently controlled by different parameters. The second operation consists of a normalized log-linear combination of the densities of Gibbs probability measures. The third operation takes two Gibbs probability measures and changes the reference measure of the latter with the former. Hence, the former is said to be "nested" within the latter, yielding a new Gibbs probability measure. The resulting measures from the second and third operations are also Gibbs probability measures and are shown, respectively, to solve optimization problems involving the expectations of linear combinations of the objective functions of the given measures, subject to a relative
entropy regularization. These optimization problems differ exclusively in the coefficients of the linear combinations. This leads to the conclusion that there exists a set of parameters for which nesting one Gibbs probability measure into another has the same effect as log-linearly combining them. These operations have relevant applications in statistical learning. As an example, a one-shot
federated learning system in which clients send their locally trained Gibbs
algorithms to the server for log-linear combination is shown to achieve the same performance as a Gibbs
algorithm trained upon the aggregation of all local training
datasets.
Read the full abstract ▾
Information Theory
Online Material-Labeled Environment Reconstruction via Bayesian Multipath Attribution for Low-Altitude ISAC
Meihui Liu, Shu Sun, Ruifeng Gao et al. (+1 more)
Environment reconstruction for low-altitude integrated sensing and communications (
ISAC) has largely focused on geometry-centric maps, overlooking material-dependent propagation effects. Material-labeled reconstruction is therefore a key step toward propagation-aware mapping, enabling more physically grounded channel prediction and uncrewed aerial vehicle (
UAV) networking. However, constructing such maps from wireless multipath observations is challenging in outdoor multi-building scenarios because multipath components (MPCs) from different facades are mixed, path-to-facade attribution is uncertain, and
UAV measurements arrive sequentially under time-varying observation geometries. To address these challenges, we propose a unified online probabilistic framework that represents each reflecting facade as a virtual anchor (VA) and couples
Bayesian VA localization, multipath attribution, and material inference. The
Bayesian front end estimates facade-level geometry and computes soft MPC-to-VA attribution probabilities using a speculardiffuse likelihood model, thereby accounting for both dominant specular paths and diffuse surface-interacted components. These attribution probabilities are used to construct attribution-aware MPC representations, which are aggregated in a VA-centric manner and mapped by a material inference network to facadelevel material evidence. The resulting evidence is recursively fused through an online
Bayesian update to produce stable material posteriors and material-labeled environment maps. Ray-tracing simulations in a representative urban street scenario show that the proposed method substantially outperforms a no-attribution baseline, achieves 93.75% final facade-level material accuracy on a held-out
UAV trajectory, and maintains accurate VA-based facade localization.
Read the full abstract ▾
All authors Meihui Liu, Shu Sun, Ruifeng Gao, Qiuming Zhu
Information Theory · Cross-listed from cs.GR
DELUGE: Decomposed Entropy-coded Live Unstructured Geometry Exchange for Real-time Particle Streaming
Hikari Yanagawa, Yuichi Hiroi and Takefumi Hiraki
Particle-based physics simulations, including fluids, smoke, and granular media, are fundamental to visual realism in immersive VR and AR. With the growing adoption of social VR and digital twins, demand is increasing for shared experiences in which multiple users interact with the same simulation in real time. Realizing such experiences requires low-latency streaming of large-scale particle data from a server to each client, yet existing point cloud compression methods such as G-PCC (TMC13) and Draco assume static
geometric structures; when applied to dynamic particle streaming, their encoding latency exceeds the frame period, failing to meet real-time delivery requirements. We propose DELUGE, a streaming compression architecture that exploits the temporal coherence and velocity predictability inherent in physics simulation particles, achieving sub-frame-latency encoding and decoding through three complementary techniques. Evaluation on dynamic point cloud
datasets demonstrates that DELUGE achieves approximately $20\times$ faster decoding than G-PCC (TMC13) and $6\times$ faster encoding than Draco. We further build end-to-end client implementations for both web browsers and Apple
Vision Pro, and confirm through a within-participants perceptual quality evaluation and a two-person collaborative task study on
Vision Pro that the proposed method supports real-time collaborative experiences with hand-tracked fluid interaction.
Read the full abstract ▾
Information Theory · Cross-listed from stat.ME
Federated multiple testing with quantized p-values under family-wise error control
Prasanjit Dubey and Xiaoming Huo
Several institutions test one family of hypotheses under family-wise error control but cannot pool their data, so each site releases only a quantized report of its p-value for each hypothesis, such as whether the p-value is significant. The report's resolution is the number of values it can take. We quantify the power lost to such reports relative to the most powerful centralized procedure given all p-values (the oracle), with reports and combining rule chosen optimally. A report from which the p-value can be recovered loses no power, so the loss is due to compression, not decentralization. Under the stated regularity and power-objective conditions, every finite resolution loses power, and the optimal loss decays as the inverse square of the resolution: equal-width intervals attain this order, and no partition into as many
cells improves it. In two-site Beta examples, optimized one-bit reports are nearly lossless for a single hypothesis but lose several times as much power for two. At level 0.05 with two Beta(1,2) hypotheses, optimally combined three-bit equal-width reports retain 99.2% of oracle power. We give the power-optimal combining rule for given reports, and a rule using only their exactly known null distribution, valid under arbitrary dependence across hypotheses.
Read the full abstract ▾
Information Theory
A generalization of the map $\chi$
Xiutao Feng, Qiang Wang, Jingyi Yu et al. (+1 more)
The mapping $ \chi_n:\mathbb{F}_2^n \to \mathbb{F}_2^n$ defined by $y=\chi_n(x)$ with $y_i = x_i + x_{i+1}x_{i+2} + x_{i+2}$, where the indices are computed modulo $n$, has been widely studied for its application in lightweight cryptography. In this paper, we generalize this mapping and completely characterize all these shift-invariant permutations of the form $y_i=x_{i+u}+x_{i+v}(x_{i+w}+a_i)$, where $0\le u, v, w<n$ and $a_i\in \mathbb{F}_2$, $1\le i\le n$.
Read the full abstract ▾
All authors Xiutao Feng, Qiang Wang, Jingyi Yu, Anpeng Zhang
Information Theory · Cross-listed from stat.ML
Next-token functional estimation
Milind Nakul, Vidya Muthukumar and Ashwin Pananjady
Suppose we observe the first $n$ points of a sequence of random variables having length $n+1$, and wish to estimate a functional of the unobserved final point and the empirical measure of the $n$ observed training points. Such next-
token functionals include the probability that the next
token is novel (also known as the surprise probability), the tail probability of the minimum distance between the next
token and training points, and the test error of a classifier trained on the observed points. All of these quantities are classically estimated by the leave-one-out method, which is inconsistent under temporal dependence. We propose a leave-a-window-out
estimator, which deletes a window of length $\tau$ after each index before forming the empirical measure and reduces to leave-one-out at $\tau = 1$. Under natural assumptions, we show that the error of our
estimator decays at a parametric rate for any stationary $\beta$-mixing process that also admits a Marton coupling. Our results thus cover several natural functionals on a large class of
stochastic processes. We complement these upper bounds with a sharp minimax lower bound for estimating the surprise probability on mixing Markov chains. Simulations on Markov chains, moving-average processes, and autoregressive processes show that our
estimator succeeds in many scenarios where leave-one-out and add-constant baselines fail.
Read the full abstract ▾