Machine Learning
Block Disentanglement in CRL: Bridging Identifiability and Visual State Estimation
Emre Acartürk, Pranamya Kulkarni, Puranjay Datta et al. (+3 more)
Causal representation learning (CRL) is the process of recovering causally-related latent variables from high-dimensional observations. As a label-free inference method, CRL is particularly attractive for applications where data labels are unavailable or impractical to obtain. While there has been significant progress in understanding the identifiability guarantees of CRL, such guarantees often hold under highly stylized assumptions, which temper the direct application to real-world problems. This paper has a two-fold objective for interventional CRL. First, it establishes identifiability guarantees for substantially weaker interventional assumptions, resulting in block disentanglement of the causal variables, where the block structure depends on the realistically available intervention mechanisms. Secondly, the block disentanglement framework is used for
embodied visual state estimation, in which the objective is to recover the latent physical variables of a robotic system directly from visual data (images and
videos) without labeled data. These two components are critically complementary. The block disentanglement theory delineates identifiability guarantees under weakened assumptions, and the application demonstrates that the resulting objective remains effective in a controlled
embodied setting despite further assumption violations, providing a theory-to-practice bridge needed to translate the promise of label-free CRL into practical problems.
Read the full abstract ▾
All authors Emre Acartürk, Pranamya Kulkarni, Puranjay Datta, Karthikeyan Shanmugam, Burak Var{\i}c{\i}, Ali Tajer
Data Structures and Algorithms · Cross-listed from quant-ph
Quantum 1-PCA with Pauli Measurements in Nearly Linear Time
Dutch Hansen and Jerry Li
We consider the problem of
quantum 1-PCA: given copies of an unknown $n$-
qubit mixed state, recover a classical description of its leading eigenvector. Our goal is to do so using non-adaptive and single-
qubit measurements. For an $n$-
qubit state with top
eigenvalue $\lambda$ and spectral gap at least $\Delta > 0$, we give an
algorithm that recovers the leading eigenvector to fidelity at least $1 - \varepsilon$ with high probability using $\tilde{O}\left( {2^n \cdot \eta^2} / {\Delta^3 \varepsilon^3}\right)$ copies and $\tilde{O}((2^n/\Delta \varepsilon) \cdot \operatorname{poly}(\eta/\Delta\varepsilon))$ time, where $\eta = \max (1 - \lambda, \varepsilon)$. All of our measurements are non-adaptively chosen, and performed in single-
qubit Pauli bases. When the spectral gap is constant and the desired accuracy is comparable to the noise level, i.e. $\varepsilon = \Omega (\eta)$, our runtime and copy complexity become $\tilde{O} (2^n / \varepsilon)$. This generalizes the guarantees of Grewal et al. [arXiv:2601.04444], who achieved similar rates, but under the assumption $\eta = 0$, i.e., that the state was pure. Our results show that the same rates hold in the presence of state misspecification, up to polylogarithmic factors. From a technical perspective, our
algorithm works by recursively constructing low-dimensional subspaces that approximately preserve the target eigenvector. To achieve nearly linear runtime dependence on the dimension of the
Hilbert space, we develop a novel structured Pauli sampling scheme that enables fast batched computation of exponentially many projected Pauli
matrices.
Read the full abstract ▾
Data Structures and Algorithms · Cross-listed from quant-ph
Polynomial-time classical algorithms for mean-field models up to the glass transition
Alexander Schmidhuber and Alexander Zlokapa
The Sachdev-Ye-Kitaev model is a strongly interacting fermionic system that has been well-studied in condensed matter and high energy physics. It is highly
quantum: Gaussian states are far from the thermal state (Hastings and O'Donnell, STOC'22) and representing the thermal state requires large
polynomial-size
quantum circuits (Anschuetz et al., QIP'25). Very recently, it was nonetheless proven that classical
algorithms can estimate local thermal expectations at sufficiently high temperature in quasipolynomial time (Zlokapa, FOCS'26). We show that classical
algorithms can in fact estimate local observables at all constant temperatures in
polynomial time. Our techniques also extend straightforwardly to classical systems: we resolve an open question about computing thermal expectations of a classical
spin glass up to its phase transition (Bencs et al., STOC'26). Our proof develops a fully rigorous
quantum cavity method. Due to the success of the classical cavity method in optimization, sampling, inference and learning, we expect the
quantum cavity method to find further applications of independent interest. As an example, we give a
quantum algorithm that learns SYK
Hamiltonians from the Gibbs state at any constant temperature with
polynomial time and sample complexity.
Read the full abstract ▾
Machine Learning
H-JEPA: End-to-End Learning of Hierarchical World Models for Visual Planning
Wancong Zhang, Basile Terver, Michael Rabbat et al. (+2 more)
Long-horizon planning with latent world models requires
reasoning across timescales and levels of abstraction. Existing task-agnostic JEPA world models predict and plan at a single timescale or with multiple horizons in one shared latent space. We introduce H-JEPA, an end-to-end recipe for training a hierarchy of action-conditioned JEPAs in which each level predicts farther ahead in its own learned latent space. Planning proceeds top-down: the top level optimizes progress toward the goal, and each level's predictions become subgoals for the planner below it. When factors in the data evolve at separated timescales, higher levels discard fast, unpredictable detail and retain slower task-relevant state. Across four simulated
navigation and manipulation environments, hierarchical planning improves over a flat JEPA; on Visual AntMaze, a three-level hierarchy raises success from 18% to 73% using less planner compute. Ablations attribute these gains to both temporal decomposition and higher-level goal representations. With inverse-dynamics supervision, the approach extends to diverse real-
robot videos from DROID, where hierarchy improves offline planning fidelity at lower planner compute.
Read the full abstract ▾
All authors Wancong Zhang, Basile Terver, Michael Rabbat, Yann LeCun, Randall Balestriero
Machine Learning
Sharpen Without Search: On-Policy Distillation of Sequence-Level Power Distribution
Erfan Baghaei Potraghloo, Seyedarmin Azizi, Arya Fayyazi et al. (+4 more)
A
language model can give a correct answer more probability than any single incorrect answer and still usually sample an incorrect one, because the incorrect answers together hold more probability. The power distribution raises each complete answer's probability to a power above one and renormalizes, shifting probability toward answers the model finds most likely (sharpening). Sampling from it improves
reasoning without changing parameters, but needs many scored candidates per query. We show that a model can instead be trained to produce such answers in one generation. On-policy power
distillation (OPPD) runs a sequential Monte Carlo sampler in which the model being trained generates candidates and a frozen teacher's power distribution weights them; the same probabilities weight each answer in a maximum-likelihood update. Training raises single-generation accuracy by up to 23.0 points on MATH500 and 27.3 on GSM8K over the untrained model at the same temperature, and one generation scores 2.4 and 3.5 points above published power sampling with 64 candidates, recovering 94 percent of the gain that 16 candidates give the untrained model. For context, against GRPO trained with verified rewards from the same checkpoint and budget, OPPD scores 3.8, 4.0 and 5.4 points higher on MATH500, GSM8K and AIME using no reference answers; the two are complementary, and OPPD applied after GRPO adds up to 9.3 points. Trained only on mathematics, OPPD raises HumanEval accuracy by up to 5.3 points. One loss coefficient moves the sharpening exponent the model absorbs between 1.19 and 2.02, against 1.14 for ordinary on-policy
distillation, and it rises mostly on the model's own answers. Gains hold across model families and sizes, including a model already trained with verified rewards, where lowering the temperature gives nothing and OPPD adds 4.4 points on MATH500. Code: https://github.com/ArminAzizi98/OPPD.
Read the full abstract ▾
All authors Erfan Baghaei Potraghloo, Seyedarmin Azizi, Arya Fayyazi, Saeid Shokoufa, Mehdi Kamal, Souvik Kundu, Massoud Pedram
Computer Vision
MC-Sparse: Deconstructing and Closing the Dense-Sparse Attention Gap in Diffusion Transformers
Jiarui Chen, Zeqiang Lai, Jiangshan Wang et al. (+5 more)
Sparse
attention is a primary approach to reducing the latency of
diffusion transformers in long-sequence generation tasks, such as
video and high-resolution 3D asset generation. However, existing methods can degrade generation quality and fidelity at high sparsity levels. Through controlled oracle comparisons, we trace this degradation to three sources: constraints imposed by
token grouping, inaccurate interaction selection, and the
attention contributions lost when
tokens are discarded. Guided by this analysis, we propose Meta-Cached Sparse
Attention (MC-Sparse), a training-free framework that selects individual key-value (KV)
tokens while organizing similar queries into tile-aligned groups for efficient GPU execution. MC-Sparse caches metadata comprising query groups, KV indices selected using exact
attention probabilities, and residuals between dense and sparse
attention outputs, and reuses them across subsequent denoising steps. Across
video and 3D generation models, MC-Sparse achieves higher fidelity to dense-
attention outputs and larger denoising speedups than existing sparse-
attention baselines, without visible quality degradation. Relative to dense
attention, it delivers a $1.80\times$ denoising speedup on Minimax-H3-Base and a $2.32\times$ speedup on 3D asset generation, both with negligible quality loss.
Read the full abstract ▾
All authors Jiarui Chen, Zeqiang Lai, Jiangshan Wang, Ziheng Ouyang, Ye Huang, Xiangyu Yue, Cewu Lu, Chunchao Guo
Machine Learning · Cross-listed from math.DS
A Response Theory Probe for Learned Stochastic AI Simulators, Tested on Lorenz-63
João Böger, Simon Driscoll, Niccolò Zagli et al. (+2 more)
Machine-learning emulators of chaotic and
stochastic systems are usually validated on forecast skill and long-run statistics. Neither certifies that an emulator responds correctly to forcing, the property that projection and attribution studies rely on. Linear response theory makes this testable: the forced response follows from unperturbed correlations through a generalized fluctuation-dissipation relation, and decomposes over the
stochastic Ruelle-Pollicott resonances of the Koopman generator. Building on the Koopmanism Response framework, we turn this into a calibrated, mode-resolved test for learned surrogates: each surrogate rollout passes or fails each check, and failure rates are compared with those of independent realizations of the true system. On
stochastic Lorenz-63, a three-variable toy model, we evaluate SINDy, an MLP, a reservoir computer, a neural ODE and a neural SDE with learned
diffusion, over up to 80 rollouts each. A sparse-regression model with the correct library passes every check at rates consistent with the true system. Invariant-statistics fidelity and response fidelity dissociate in both directions: a quarter of reservoir-computer rollouts pass every invariant-statistics check and match the static susceptibility $\chi(0)$, yet misrepresent the slow relaxation modes, while the neural ODE and SDE rarely meet the invariant-statistics floor but recover those modes in three quarters of rollouts. As expected of a time-integrated quantity dominated here by fast relaxation, $\chi(0)$ does not separate these cases. For a fixed network, the training formulation (one-step drift, flow map, or multi-step through the integrator) decides which of these properties it gets right.
Read the full abstract ▾
All authors João Böger, Simon Driscoll, Niccolò Zagli, Valerio Lucarini, Francisco Camara Pereira
Data Structures and Algorithms
Approximating Random Walks in $\widetilde{O}(\log n + \log^2 \kappa)$ Space for $\kappa$-Conditioned Graphs
Junzhao Yang
For $\kappa>1$, a directed graph is $\kappa$-conditioned if it is $\kappa$-mixing and its stationary distribution is approximated by the uniform distribution within a factor of $\kappa$. We present a deterministic
algorithm that approximates the stationary distribution of a $\kappa$-conditioned graph to inverse
polynomial relative error in $O((\log n + \log^2 \kappa) \log \log n)$ space. In the regime $\kappa = \exp(\Theta(\log^\alpha n))$ for any $\alpha \in (0, 2/3)$, our result improves the best-known $O(\log n \sqrt{\log \kappa} / \sqrt{\log \log n})$ space bound for approximating $\kappa$-step random walks in general directed graphs by [Hoza, RANDOM 2021]. We release this preliminary version due to recent rumors of LLM-based progress on related problems and uncertainty about when those results may appear. Further implementation details will be provided in a subsequent version.
Read the full abstract ▾
Machine Learning
Round-Trip KNN Clustering: multiscale hierarchical cluster detection on directed nearest-neighbour graphs
Eraldo Pereira Marinho, Caetano Mazzoni Ranieri and Fabricio Aparecido Breve
We introduce Round-Trip KNN Clustering (RTKNNC), a graph-based method for finding cluster structure at several neighbourhood scales without requiring the number of clusters in advance. Unlike approaches that first make a $k$-nearest-neighbour (KNN) graph undirected, RTKNNC keeps both directions of the neighbour relation: which points a given point selects and which points select it. Incoming selections are treated as weighted votes that help decide which local connections remain visible during a recursive forward-and-reverse traversal. Repeating the procedure for increasing $K$ reveals how groups persist or merge as the neighbourhood scale grows; for the reference inverse-square model before structural refinement, clusters can merge but do not split. Because graph connectivity can occasionally join distinct groups through a sparse bridge or a small region of overlap, we add an optional label-free refinement. It first tests whether an already formed component is better described by two or three Gaussian subpopulations, and accepts a subdivision only when the proposed groups are large enough and consistent with the visible KNN graph. Across eight synthetic
datasets and $K=2,\ldots,16$, independent C and Python implementations produced identical partitions in all 120 reference runs. Refinement increased adjusted Rand index from $0.7817$ to $0.9627$ on a variable-density
benchmark and from $0.8083$ to $0.9853$ on a sparse-bridge
benchmark. Comparisons with seven external clustering methods show competitive performance while preserving a label-free cluster-construction process.
Read the full abstract ▾
Artificial Intelligence
Back to the Future: Rethinking EDA Infrastructure for Agentic Systems in Chip Design Verification
Je Yang, Ivan Lobov and Thomas Karpati
The unprecedented computational scale of modern artificial intelligence depends on complex, multi-billion-transistor Systems-on-Chip, yet the workflows that verify these chips remain stubbornly manual. Although Large
Language Models (LLMs) have made rapid inroads into Electronic Design Automation (EDA), approximately 74.6% of existing studies target static Register-Transfer Level (RTL) code generation, leaving post-simulation verification and interactive waveform debugging largely untouched. We introduce Back-to-the-Future (BTTF), an end-to-end agentic framework that closes this infrastructural gap. BTTF distills massive, unstructured simulation dumps into a normalized relational SQLite database and couples it with a collaborative multi-
agent orchestration engine that translates natural-
language verification queries into schema-aware SQL while correlating signal anomalies with versioned RTL repositories. Across a 150-query
benchmark, BTTF attains 95.33% execution accuracy, charting a practical path toward autonomous EDA verification.
Read the full abstract ▾
Computational Complexity · Cross-listed from quant-ph
Characterizing Quantum Advantage for Generalizations of the Boolean Hidden Matching Problem
Mark Bun, Joao F. Doriguello, John Kallaugher et al. (+1 more)
We study the one-way communication complexity of the $f$-Boolean Hidden Partition problem. Here, Alice is given an $n$-bit string and Bob is given $\Omega(n)$ disjoint blocks of its indices together with a string of labels. Under the promise that the evaluations of $f$ on these blocks either agree with all of the labels or disagree with all of them, Bob must determine which is the case using a single message from Alice. This problem generalizes the Boolean Hidden Matching and Hidden Hypermatching problems, which capture the special case where $f$ is the parity function. We establish classical and
quantum communication bounds for $f$-Boolean Hidden Partition in terms of the sign degree $d$ of $f$, proving a
conjecture of Doriguello and Montanaro (TQC 2020). Their prior work gave logarithmic communication upper bounds for classical protocols when $d \le 1$ and
quantum protocols when $d \le 2$, as well as
polynomial lower bounds for certain structured functions with larger sign degree. We show that for every $f$ of sign degree $d \ge 2$, the randomized classical communication complexity of this problem is $\Theta(n^{1-1/d})$ while its
quantum communication complexity lies between $\Omega(n^{1-2/d})$ and $\bO{n^{1-1/\lceil d/2 \rceil} \log n}$. This completely characterizes the functions $f$ admitting
polynomial quantum advantage as those for which $d \ge 2$, with a new infinite family of exponential separations given by the case $d = 2$.
Read the full abstract ▾
All authors Mark Bun, Joao F. Doriguello, John Kallaugher, Nadezhda Voronova
Numerical Analysis
On the Growth Factor of Random Matrices
John Urschel
Gaussian elimination is the oldest and most popular method for solving a linear system. Its numerical stability for a given
matrix is controlled by the growth factor, a measure of how large entries can become during elimination. In this work, we prove a number of new results regarding the growth factor of random
matrices. First, we provide tight estimates for the growth factor of a
matrix preconditioned by a Haar orthogonal
matrix without pivoting and characterize the asymptotic distribution of the growth factor of Gaussian
matrices without pivoting. Second, and most notably, we prove that the growth factor of an $n \times n$ Gaussian
matrix under partial pivoting is rarely much larger than $\sqrt{n}$, resolving an old
conjecture of Nick Trefethen. The same techniques used to prove this
conjecture also provide an improved smoothed analysis of the growth factor under partial pivoting.
Read the full abstract ▾
Machine Learning · Cross-listed from hep-ex
How to scale your HEP ML models: A recipe for robust architecture comparisons at scale
Matthias Vigl, Nikita Pond, Jackson Barr et al. (+5 more)
Much of the recent progress in machine learning domains such as
language models has come from scaling laws that predict performance as a function of training effort. In high-energy physics (HEP) similar behavior has now been observed. To aid further study, we present a systematic procedure to derive robust scaling laws and compare design choices on the relevant budget axes for HEP tasks. We first validate the full scaling trajectory on toy problems and then apply the procedure to multi-task
transformers on the ~11 billion-jet ATLAS JetSet2
dataset, in both the compute- and data-constrained regimes. For the latter, we predict, to the best of our knowledge for the first time, the jointly optimal model size, training horizon, learning rate and batch size under early stopping. At compute-optimal scaling, we recover a near-equal $\sqrt{C}$ dependence of model and
dataset size, and find that auxiliary objectives lower the primary jet-classification loss at equal compute budget. Expanding the inputs toward lower-level data systematically lowers the loss while leaving the scaling exponent nearly unchanged. The onset of the power-law regime is itself set by scale: below a threshold in
dataset size the loss carries little information about high-compute scaling, underscoring the value of large, high-quality full-simulation
datasets as a foundation for scaling studies and the development of foundation models in HEP.
Read the full abstract ▾
All authors Matthias Vigl, Nikita Pond, Jackson Barr, Alexander Froch, Dan Guest, Nicole Hartman, Michael Kagan, Lukas Heinrich
Data Structures and Algorithms
Truly Subquadratic 3SUM and Truly Subcubic APSP via Triangles in Sparse Lopsided Graphs
Josh Alman and Virginia Vassilevska Williams
We give the first
polynomial improvements over the textbook
algorithms for $3$SUM and All-Pairs Shortest Paths (APSP): we show how to deterministically solve $3$SUM on $n$ integers of
polynomial size in $O(n^{1.9992})$ time and APSP on directed $n$-vertex graphs with polynomially bounded integer weights in $O(n^{2.9995})$ time. This refutes the $3$SUM and APSP hypotheses. Using known reductions, we also refute the real-valued versions of the $3$SUM and APSP hypotheses, the Exact Triangle hypothesis, the Zero-Weight $k$-Clique hypotheses, and the three rectangular hinted Online
Matrix–Vector
conjectures of van den Brand, Nanongkai, and Saranurak, and we give
polynomial speedups for a variety of other problems. All of these results follow from a single new
algorithm for thin
matrix products. Let $X$ be an $N\times D$ integer
matrix and $Y$ a $D\times N$ integer
matrix with $D\le N^{1/18}$, and let $W$ be any set of at most $N^2/\sqrt D$ positions. We compute the entries $(XY)[I,J]$, $(I,J)\in W$, in $O(N^2/D^{0.063})$ operations, which is polynomially less than the time needed to write down $XY$ or to compute $N^2/\sqrt D$ inner products one by one. We design this
algorithm by modifying a variant of Coppersmith's rectangular
matrix multiplication
algorithm, built from a ten-multiplication identity of Schönhage, to perform only the operations needed for the entries in $W$, and show that few operations are needed. Interpreted as a graph
algorithm, this solves the All-Edges Sparse Triangle problem in truly subquadratic time on sparse lopsided tripartite graphs where two parts have $n$ vertices but one part has $n^{\varepsilon}$ vertices for $\varepsilon<0.12$. By known reductions, Exact Triangle, and hence $3$SUM and APSP, reduce to this problem. We also give a data structure version that answers queries for single entries of $XY$, not known in advance.
Read the full abstract ▾
Computation and Language
T-Search: An Open Agentic Retriever and Playground for Hard Multi-Step Search
Olga Tsymboi, Ramil Latypov, Aleksandr Medvedev et al. (+5 more)
We present T-Search, an open-weight agentic retriever for hard multi-step search. Given a question and a search tool over a fixed corpus, it runs a bounded multi-round search and returns a ranked list of evidence chunks with short justifications, leaving answer generation to a downstream model, so backend and generator can be swapped without retraining. T-Search is built on Qwen3.6-35B-A3B and trained on adversarially filtered synthetic search tasks with round-sliced supervised fine-tuning followed by GSPO on a recall reward. Averaged over seven English and Russian
benchmarks with gold evidence annotations, it reaches 56.0 Recall@10 with one rollout, 14.4 points above its base, and 61.3 with three fused rollouts, outperforming larger open models. We release the model, harness, live demo, and three
benchmarks, including TRuST, the first native-Russian hard-search
benchmark.
Read the full abstract ▾
All authors Olga Tsymboi, Ramil Latypov, Aleksandr Medvedev, Danil Taranets, Dmitrii Stoianov, Nikita Gulyakov, Gleb Alektorov, Anatolii Potapov
Computation and Language
IdeaLens: Detecting AI Ideas in Long-form Writing
Rishanth Rajendhran, Minjoon Choi, Jenna Russell et al. (+5 more)
While modern AI detectors identify who wrote the words, emerging policies on AI use increasingly hinge on a different question: who came up with the ideas? We introduce IdeaLens, a detector that identifies whether a document's ideas came from a human or AI (idea provenance), regardless of who wrote its words. To focus IdeaLens on ideas rather than prose, we represent documents as outlines: lists of items that each pair a discourse role with a brief, paraphrased description of the content, minimizing word-level overlap with the raw text. We train IdeaLens on 1M FineWeb documents with silver labels from Pangram, a prose provenance detector. Since the outlines are largely stripped of surface-level information, the labels must be fit mainly through the ideas. In a controlled study, IdeaLens's AI flag rate drops from 95% to 7% as models write from increasingly detailed human plans, while Pangram 4 still flags 92%; from AI-derived plans, IdeaLens stays above 96%. Conversely, on a new
dataset of 50 stories that human authors wrote from AI-generated plans, IdeaLens flags 68% of the stories as AI, compared to 8% for Pangram 4. On a comprehensive suite of 19 existing detection
benchmarks, we show that IdeaLens maintains strong detection rates at low false positive rates, suggesting that ideas themselves provide a powerful discriminative signal, and its performance holds across domains, formats, and
languages. Finally, we examine 90K predictions from IdeaLens to characterize systematic differences between human and AI ideation. We release our models and labeled
datasets to facilitate future research on idea provenance detection.
Read the full abstract ▾
All authors Rishanth Rajendhran, Minjoon Choi, Jenna Russell, Ramya Namuduri, Deniz Bölöni-Turgut, Marzena Karpinska, John Wieting, Mohit Iyyer
Multiagent Systems
On Learning Optimal Corners in Orthogonal Partially Observable Cooperative Guard Art Galleries
Yassin Ben Mansour and Edwin Meriaux
The CADENCE
algorithm solves the Partially Observable Cooperative Guard Art Gallery Problem (POCGAGP) with formal coverage and connectivity guarantees, but leaves unspecified which valid corner each
agent should be deployed to, a choice that strongly affects efficiency. We introduce two learned corner-selection heuristics that preserve these guarantees: a CNN scoring candidates on a grid encoding, and a GATv2 network trained with Deep Q-Learning (DQN) on a visibility graph. Across 7,500 runs on random orthogonal environments (50x50 to 250x250), our heuristics outperform baseline CADENCE in both steps to full coverage and peak
agent count, with gains growing with scale, and improve on Incremental Self-Deployment (ISDA) baselines in
agent utilization while providing guarantees ISDA lacks. Learned corner selection thus improves CADENCE in speed and
agent utilization at no cost to its formal properties.
Read the full abstract ▾
Game Theory
The Hardness of Dominant Strategy Mechanism Design, Revisited
Frederick V. Qiu
We study the communication complexity of dominant-strategy incentive-compatible (DSIC) mechanisms for combinatorial auctions. For $\gamma \in [\log m, m]$, let $\mathsf{DSIC_{GEN}}(m, \gamma)$, $\mathsf{DSIC_{XOS}}(m, \gamma)$, and $\mathsf{DSIC_{GS}}(m, \gamma)$ denote the best approximation ratio attainable by a deterministic, individually rational, no-negative-transfers, DSIC mechanism using at most $2^\gamma$ communication over $m$ items, for general monotone, XOS, and gross substitutes (GS) valuations, respectively. We give a unified proof that shows $\mathsf{DSIC_{GEN}}(m, \gamma) = \Omega(m/\gamma)$, $\mathsf{DSIC_{XOS}}(m, \gamma) = \Omega((m/\gamma)^{1/5})$, and $\mathsf{DSIC_{GS}}(m, \gamma) = \Omega((m/\gamma)^{1/7})$. The GS lower bound answers an open question of~\cite{DobzinskiRV22}: although poly-communication welfare maximization for GS valuations admits a poly-communication deterministic truthful mechanism via VCG, no good approximation is possible in poly-communication for deterministic DSIC mechanisms. Additionally, the general lower bound establishes that $\mathsf{DSIC_{GEN}}(m, \gamma) = \Theta(m/\gamma)$ due to the deterministic DSIC $O(m/\gamma)$-approximation of~\cite{QiuW24}. We also obtain several results in the two-bidder setting. We show that attaining a $1.0001$-approximation for two weighted matroid-rank valuations (a subclass of GS) with a universally DSIC mechanism requires exponential communication. On the other hand, we give a poly-communication $(1+\sqrt{5})/2 \approx 1.618$-approximation for two submodular bidders using a universally DSIC mechanism. Prior to this work, it was not known whether even a poly-communication universally truthful mechanism could beat a $2$-approximation for two submodular valuations, nor whether a poly-communication universally DSIC mechanism could beat a $2$-approximation for two weighted matroid rank valuations.
Read the full abstract ▾
Numerical Analysis
Singular parameters and missing limits in neural PDE solvers
Daniel Fernández
Neural solvers for partial differential equations (PDEs) can approach an accurate solution while their parameters grow without bound. In such cases, the limiting solution may have no finite representation in the chosen model, leaving the best loss unattained. Our analysis connects missing limits in deep neural tanh- networks to unbounded hidden parameters or increasingly redundant
neurons. For a class of models built from translated kernels, we describe the missing functions and recover them by adding kernel derivatives to the model. This completion makes the best approximation attainable under standard assumptions. Numerical studies follow the associated parameter growth and explore how completion affects PDE optimization.
Read the full abstract ▾
Computational Complexity · Cross-listed from quant-ph
Complexity separations for optimal matchgate-Clifford synthesis
Berta Casas, Diego García-Martín and Yuxuan Zhang
Clifford and matchgate
circuits are canonical families of classically simulable
quantum circuits. Their intersection, the matchgate-Clifford group, plays an important role in randomized fermionic protocols and in matchgate synthesis. Its adjoint action is isomorphic to the group of unit-determinant signed permutations of $2n$ Majorana modes, and we study optimal exact synthesis in this group. That is, given a target
unitary and a gate set, output an $n$-
qubit circuit implementing the target using the fewest operations. We show that the complexity of this problem strongly depends on the gate set. In particular, we study gate sets consisting of Majorana braids with different connectivity graphs. For path and complete graphs, we prove that the problem is classically solvable in $\mathcal{O}\left(n^2\right)$ time, and we provide explicit gate-optimal compilers. In addition, we prove that when the connectivity graph is a tree, the decision version of the optimal synthesis problem becomes NP-complete. Finally, we
benchmark our optimal compiler on chains of up to $n=80$
qubits against those of Qiskit and Tket, obtaining
circuits with constant factor improvements $\times2.57$ and $\times2.28$ in the total number of gates, respectively.
Read the full abstract ▾
Artificial Intelligence
Conditional Rank Allocation for Taxonomy-Aware Medical Language Model Adaptation
Guangyuan Dong, Ziwei Hong, Xuehao Zhou et al. (+6 more)
Medical question answering spans specialties and clinical operations that may benefit from different adaptation directions. We propose ARBOR, a parameter-efficient method that selects rank-one components from a shared low-rank basis for each question. An additive gate combines question representations, specialty tags, operation tags, and their interaction; a learned coefficient scales the adapter residual. An illustrative separation under orthogonal, equiprobable subtasks shows how conditional selection can avoid an approximation floor faced by a fixed update with the same active rank. This result motivates the design without asserting a corresponding bound for medical corpora. On Qwen3-8B across CMB, CMExam, MedQA, and MedMCQA, five-seed experiments yield 69.69% mean accuracy across
benchmarks, exceeding LoRA r16 and MoELoRA by 1.26 and 1.30 percentage points, respectively. The reported advantage over LoRA r16 increases from 0.08 to 1.94 points as training expands from one to seven specialties. Tag perturbations and atom masking support the usefulness of clinical routing, while atom clusters align with the supplied specialty labels (adjusted Rand index 0.62). Calibration, transfer, and measured costs further characterize the method. These findings support structured conditional adaptation for medical QA, while leaving clinical safety and broader deployment untested.
Read the full abstract ▾
All authors Guangyuan Dong, Ziwei Hong, Xuehao Zhou, Zidong Yu, Bingchen Liu, Kehan Liu, Chuang Liu, Rong Fu, Yuchao Hou
Graphics
Real-time Rendering of Pre-integrated Neural Emitters
Arno Coomans, Floor Verhoeven, Edoardo A. Dominici et al. (+1 more)
Direct illumination from non-trivial emitters with occluding housing, high-polygon emissive meshes, spatially varying emission, or deformable assemblies is a persistent bottleneck in real-time rendering. Current real-time solutions either rely on simplified analytical representations or fall back to runtime sampling. Analytical methods are restricted to simple emitter geometry, pure sampling-based
estimators need high sampling budgets to be noise-free, and proxy representations still require runtime integration over outgoing radiance around the emitter. We present Neural Emission Fields (NEF), a representation that eliminates runtime integration by precomputing the illumination in the volume around the emitter. This neural field is parameterized by position, normal, view direction, and material parameters. Using a two-headed diffuse/glossy architecture, it yields noise-free unoccluded direct illumination from a single network evaluation per shading point. Because training is performed in the emitter's local frame, a trained NEF acts as a portable lighting asset reusable across scenes under rigid transforms. Internal interreflections, self-occlusion, spatially varying emission, and deformations are absorbed into the learned representation at zero additional runtime cost.
Read the full abstract ▾
All authors Arno Coomans, Floor Verhoeven, Edoardo A. Dominici, Markus Steinberger
Information Theory · Cross-listed from quant-ph
Nonadditivity in fermionic quantum Shannon theory
Farzin Salek, Amir-Reza Negari, Graeme Smith et al. (+2 more)
We study collective state preparation and channel encoding in fermionic systems under parity superselection and composition governed by the canonical anticommutation relations. For a two-mode Gaussian state $\tau$, we obtain the exact
entanglement of formation, $E_{\mathrm F}^{\mathrm{phys}}(\tau^{\otimes m})=\lceil m/2\rceil\log2$ for every $m\geq1$. Two copies have the same formation value as one, violating additivity and strong superadditivity, while regularization halves the single-copy value. For an associated Gaussian channel, we determine the minimum output
entropy and Holevo information at every blocklength and prove nonadditivity of both. Together, these results give exact answers to the fermionic counterparts of the four additivity questions associated with Shor and Hastings. One physical use carries no classical information, whereas two uses transmit one bit perfectly. The unassisted classical and zero-error classical capacities both equal one half bit per mode. A sharp finite-block bound gives a strong converse: the decoding success probability vanishes at every rate above capacity. These optimizations cover all physical pure-state decompositions and channel inputs, with Gaussian ensembles and classical codes attaining the optima. The formation and minimum output
entropy formulas hold for every Rényi order $\alpha\in(0,\infty]$. We also determine the unassisted
quantum and zero-error
quantum capacities, both equal to one half logical
qubit per mode, and prove a strong converse:
entanglement fidelity vanishes at every rate above capacity. For a noisy Gaussian family, we determine the one- and two-copy formation values and prove strict nonadditivity at full rank. For $\tau$, Bell violation under local parity-preserving measurements first appears at three copies.
Read the full abstract ▾
All authors Farzin Salek, Amir-Reza Negari, Graeme Smith, Jens Eisert, Debbie Leung
Machine Learning
MatrixFormer: A Foundation Model for Matrix Completion
Dwaipayan Saha, Jacob Feitelberg, Kyuseong Choi et al. (+2 more)
Matrix completion underlies problems from tabular imputation to causal inference, yet existing tabular foundation models treat it as entry-by-entry prediction, repeating context for every target and discarding the
matrix's two-dimensional structure. We introduce MatrixFormer, a pre-trained
matrix-native
transformer that predicts a full distribution for every missing entry in a single forward pass. MatrixFormer is trained entirely on synthetic low-rank and latent-factor
matrices under diverse missingness patterns. Applied zero-shot and with the same model weights, MatrixFormer achieves competitive performance on causal inference panel-data tasks,
language-model
benchmark-score completion, tabular imputation, and recommendation systems
matrix completion. These results position MatrixFormer as a general-purpose foundation model for
matrix completion.
Read the full abstract ▾
All authors Dwaipayan Saha, Jacob Feitelberg, Kyuseong Choi, Raaz Dwivedi, Anish Agarwal
Computation and Language
Balancing Memory Pathways: Analyzing and Improving Memory Utilization in Hybrid LMs
Hyunji Lee, Joykirat Singh, Zaid Khan et al. (+5 more)
Recurrent-
attention hybrid
language models (LMs), which interleave
attention and recurrent layers, are increasingly used to combine the efficiency of the recurrent layers with the strong performance of
attention layers. Prior work suggests that
attention and recurrent layers offer complementary pathways to use past information:
attention supports precise
memory recall from earlier
tokens, while recurrent layers support consolidation of disparate information over long contexts. However, we observe that simply having access to both pathways does not mean that hybrid LMs are effectively using them. We find that they rely substantially more on
attention than on the recurrent state. Standard supervised fine-tuning improves overall performance but does not improve how the two
memory pathways are coordinated: the model becomes more reliant on information propagated by
attention layers, while its use of information propagated by recurrent layers remains limited. To encourage better coordination between the two
memory pathways, we add an auxiliary loss that limits
attention's access to earlier context while the recurrent state propagates through the full sequence. This objective encourages the model to retain and use information through the recurrent pathway alongside
attention. It improves overall performance, with particularly strong gains on tasks involving longer contexts or requiring information aggregation, consistent with the strengths of recurrent layers observed in analysis. Crucially, this imbalance and the benefit of our auxiliary loss generalize: they apply to multiple recurrent-
attention LMs in question-answering and agentic tasks, as well as to
attention-based LMs that combine different forms of
memory. Together, our findings show that simply providing multiple
memory pathways does not ensure their effective use, and that targeted supervision is needed to better coordinate them.
Read the full abstract ▾
All authors Hyunji Lee, Joykirat Singh, Zaid Khan, Justin Chih-Yao Chen, Elias Stengel-Eskin, Alessandro Sordoni, Arman Cohan, Mohit Bansal
Multiagent Systems
BazaarBench: Delegation Safety in Decentralized C2C Marketplaces Run by LLM Agents
Ziyan Wang, Shuqing Shi, James Oldfield et al. (+5 more)
In decentralized consumer-to-consumer (C2C) marketplaces, people list goods, negotiate with strangers, and rate one another, so trust rests on reputation. Large
language model (LLM)
agents now act for users, raising risks to their money,
privacy, and reputation. We introduce BazaarBench, a simulated C2C marketplace and
benchmark for evaluating the safety of these
agents. It tracks ownership, item condition, and commitments across transactions, combining record checks with rubric-based LLM judgments to identify six failure types across five stages. We run three base
markets for 30 simulated days, each with 100
agents using one model and inventories drawn from a public eBay sample. Across 45 continuations, we evaluate five models under ordinary instructions, deadline pressure, or
adversarial instructions to exploit other traders. Each continuation runs for seven simulated days from a copy of a
market's day-30 state. The tested model controls the same 20 selected
agents, retaining their personas, inventories, and histories, while the other 80 keep the base model. All five models attempt to promise the same item to multiple buyers under ordinary instructions. Adding targets and deadlines increases these attempts for every model. Under
adversarial instructions, the share of tested sellers' committed transactions completed despite unavailable items or overstated conditions rises from 15.4% to 33.4%, reaching 55.5% for GPT-5.4. Averaged across models and
markets, simulated weekly earnings per tested
agent rise from USD 20 under ordinary instructions to USD 33 under
adversarial instructions. Most of the increase comes from items the sellers never held. We release the simulator, saved
market states, evaluation code, and records covering 357,608
agent model calls for evaluating new models and developing safer marketplace
agents.
Read the full abstract ▾
All authors Ziyan Wang, Shuqing Shi, James Oldfield, Samuele Marro, Jialin Yu, Philip Torr, Yali Du, Adel Bibi
Machine Learning
Hyperbolic Graph Representation Learning: Embed in One Metric, Optimize with Another
Federico Larroca, Paola Bermolen, Marcelo Fiori et al. (+1 more)
Hierarchical graphs embed in
hyperbolic space with lower distortion than in Euclidean space owing to its negative
curvature. However, their gradient-based learning is hampered at large radii, where the Poincaré ball and the Lorentz hyperboloid models fail numerically. Polar coordinates avoid this problem, but the
hyperbolic metric scales the angular step by the
hyperbolic sine of the radius, freezing angular motion. We observe that this factor is a choice, silently fixed by existing implementations: the Euclidean tangent parametrization, for instance, uses the radius itself. We show that other choices are not only possible but preferable. They are endpoints of a one-parameter family of optimization preconditioners with
curvatures from $-1$ to $0$, while the
embedding remains at
curvature $-1$. We show that since the Euclidean preconditioner rearranges a layout but refines it poorly, while an intermediate one refines far better once a layout is in place, combining them in two stages reduces the loss on real-world trees by 46-74% over the best single
curvature.
Read the full abstract ▾
All authors Federico Larroca, Paola Bermolen, Marcelo Fiori, Bernardo Marenco
Computation and Language
ufakzeka-karar: An Open Turkish Typed-Decision Model with Order-Invariant Option Scoring
Sait Furkan Teke
ufakzeka-karar is an open Turkish decision model with 182,494,466 parameters. Given a Turkish text and questions of a fixed answer type (a choice, a level on an ordered scale, or yes or no), it returns a temperature-scaled probability for every option and an expected error that serves as a "not sure" signal, without generating text and in one CPU forward pass for up to ten options. Built on the lab's ufakzeka-1-base, its head scores each option blind to the others at shared positions, so the answer does not depend on option order. A sequential head trained with shuffled options was about as accurate but changed 2.3 to 2.8 percent of its answers when only the option order changed; REINFORCE lost 10.2 points (0.102) of macro F1 to cross-
entropy. On the open set of HakemBench v1.0 (4,275 questions, 7 tracks) the released model ranks 7th of 16 rows with a composite of 0.660 (95% interval 0.642 to 0.677). Temperature scaling lowers calibration error (smooth ECE) on the development set but raises it on held-out support questions, from 0.027 to 0.045 for the first scored run, which never trained on them; the released model later trained on them, so its 0.036 to 0.064 is not an unseen-question test. The released model is the last of three runs scored on HakemBench, and its numbers are not blind. The second run's new training data was aimed at the first run's errors on the full test set in guardrails, moderation and customer support, and the released run was trained after the second run's guardrail results on the full test set were read, under a protocol fixed in writing before any of its data, code or runs. All its numbers come after these readings; its guardrail, moderation and customer support numbers carry the flag "shaped by reading the test results". With every model scored on the other four tracks only, its composite is 0.678, 6th of 16. Weights and code are under Apache-2.0.
Read the full abstract ▾
Formal Languages and Automata
Recognizers for Graph-Encoding Languages
Anssi Yli-Jyrä
We introduce recurrent incidence automata (RIAs), a new automaton model motivated by a decomposition of certain two-stack visibly pushdown computations. The decomposition separates vertex-local finite-state computations from recurrent one-stack interfaces connecting consecutive vertices. The construction is motivated by a two-stack visibly pushdown encoding of arbitrary ordered graphs whose strings admit a unique factorization into center-foldable vertex-local factors and whose auxiliary stack is empty at every factor boundary. Folding each factor into a sequence of pair symbols yields a local interface transformation. An RIA consists of a finite-state unit that computes these transformations and a recurrent layer that composes them across consecutive factors. Rather than manipulating an internal pushdown store, RIAs externalize long-range stack
memory into recurrent interfaces between local computations. We show that nondeterministic RIA
languages are closed under union, intersection, concatenation, Kleene-*, and reversal. Deterministic RIAs are closed under Boolean operations, although emptiness remains undecidable.
Read the full abstract ▾
Information Theory · Cross-listed from quant-ph
Quantum minimum description of density matrices
Patrick Hayden, Alexander Maloney, Jinzhao Wang et al. (+1 more)
We study a variant of Schumacher compression. The task asks for the minimal
memory cost for compressing many copies of a density
matrix with known spectrum and unknown eigenbasis, without preserving its purification. For fixed dimension and distinct positive
eigenvalues, we obtain the cost through its additive constant. Achievability uses a generalization of Werner's cloning map to $\mathrm{GL}(d,\mathbb C)$ irreducible representations, with finite trace-distance bounds controlled by highest-weight differences and row gaps. The matching converse follows from a quantitative form of Koashi–Imoto incompressibility for irreducible group orbits under a spectral-gap assumption. We also identify the relation between this
quantum minimum description length and universal lossless coding overhead, and its connection to free
entropy is explained in a companion letter. We provide a Lean certificate for our proofs.
Read the full abstract ▾
All authors Patrick Hayden, Alexander Maloney, Jinzhao Wang, Yuxiang Yang