Machine Learning
S$^{2}$-PINN: Stochastic Separable Physics-Informed Neural Networks
Zhendong Li and Akwum Onwunta
Uncertainty quantification (UQ) for random partial differential equations (PDEs) is ubiquitous in computational science and engineering. However, classical spectral solvers for this class of problems face the curse of dimensionality, and existing neural solvers often ignore the
stochastic structure that makes moments and calibration tractable. We introduce a
stochastic separable physics-informed neural network, dubbed S$^{2}$-PINN, that represents the solution $u(t,\mathbf{x},\mathbf{Z})$ of a random PDE with a learnable Gaussian spatial dictionary,
Fourier temporal features, and a generalized
polynomial chaos (gPC)
stochastic basis, coupled by a low-rank Canonical Polyadic (CP) tensor decomposition core. The method is trained with a hybrid strong-form and gPC-projected residual loss. Our theoretical analysis establishes that the separable class is dense in $L^2$ under mild conditions, and the projected residual corresponds exactly to a
stochastic Galerkin constraint. Furthermore, we show that mini-batch projection coefficients are logarithmically dependent on the number of gPC modes, and that the orthogonality penalty controls the conditioning of the learned spatial dictionary. Using four manufactured random PDE
benchmarks, we show that S$^{2}$-PINN outperforms nine baselines in terms of mean and variance accuracy, as well as calibration, while using significantly fewer parameters. Further evaluations on non-manufactured Poisson and Darcy problems, a
stochastic Navier–Stokes problem, a
diffusion scaling study of higher random dimensions, and two
stochastic inverse problems reveal the generalization capabilities of the proposed structure. Together, these results support
stochastic separability as an effective design principle for physics-informed neural UQ. The code for the experiments can be found in https://github.com/DMax1314/s2pinn
Read the full abstract ▾
Artificial Intelligence
JOVE: Joint Execution and Verification for Resource-Aware LLM Task Graphs
Haoran Zhang, Dongjun Kim, Seohyeon Cha et al. (+4 more)
Complex
reasoning queries can be decomposed into directed acyclic task graphs and distributed across heterogeneous LLMs, reducing latency through parallelism and enabling smaller models to solve complex tasks. In practice, however, the suitability of an LLM for a given subtask may be a priori unknown, and execution alone does not reveal output correctness. We propose JOVE, an online framework that jointly assigns executor LLMs and selects intermediate outputs for paid verification. Verification runs asynchronously and is used to improve future allocations, so the system must balance spending on execution now against learning for later. We study how to optimize this trade-off under a long-term budget and a per-query latency constraint, with
stochastic, initially unknown LLM service quality, invocation costs, and execution times. JOVE makes execution and verification decisions by solving a sequence of per-query mixed-integer linear programs. Online learning updates task-dependent estimates of LLM quality based on verification feedback, while an information-gain bonus incorporates the value of learning into allocation decisions. Under a natural set of assumptions, we establish sublinear quality-learning regret for JOVE. Across four
reasoning benchmarks, JOVE achieves competitive accuracy against standard inference baselines while reducing average cost and latency by at least 3.17 times.
Read the full abstract ▾
All authors Haoran Zhang, Dongjun Kim, Seohyeon Cha, Kevin S Chan, Ananthram Swami, Gustavo De Veciana, Haris Vikalo
Data Structures and Algorithms · Cross-listed from quant-ph
Arthur Braida, Joseph Cunningham and Jérémie Roland
An analog device implements a local
Hamiltonian H, but a
polynomial P (H) is in general not local, so the device cannot implement it. We carry P (H), to any prescribed accuracy, as the action of a single time-independent local
Hamiltonian on an explicitly described invariant subspace. Short chains of ancilla
qubits are attached to H. A chain of 2m sites has a unique isolated
eigenvalue that is an analytic function of the input vanishing to order exactly 2m, because the input must cross the chain and come back before it can shift the energy at the far end. Chains of different lengths therefore form a triangular family, and a weighted sum of them reproduces a prescribed
polynomial term by term. Even chains give the even part and odd chains the odd part, so any
polynomial is reached. We prove uniqueness, analyticity and coefficient bounds uniform in the chain length for inputs H of norm below any r < 1. Where the
circuit model pays degree 2l in 2l sequential oracle calls, the result here is one
Hamiltonian of locality two more than that of H, which pays the degree in O(l^2 + log2^(1/eps)) ancillas and in energy scale. As an application we filter a marked eigenstate of a local
Hamiltonian. Composing a synthesised square along the Chebyshev doubling identity works, but its energy scale grows quasi-polynomially with the degree. Iterating instead the exact
eigenvalue branch of the two-site chain k times gives a filter on k + 1 ancilla
qubits whose error decays geometrically in k, at an energy scale
polynomial in the inverse passband width and independent of k, the locality growing by one per stage. In adiabatic optimisation with a rank-one driver, the construction replaces that non-local driver, by a
Hamiltonian with O(log n) ancillas and O(log n)- body terms, at an energy scale
polynomial in n. Simulations including every ancilla reproduce the spectrum of the ideal
algorithm.
Read the full abstract ▾
Neural and Evolutionary Computing
Parallel Time-Aligned Spiking Self-Attention for Consistent Integer-Valued Training and Spike-Driven Inference
Peng Xue, Wei Fang, Kaiwei Che et al. (+4 more)
Integer-valued leaky integrate-and-fire (I-LIF)
neurons and spike firing approximation (SFA) reduce temporal training cost by representing spike trains as firing counts and normalized firing rates, respectively. However, applying spiking self-
attention (SSA) directly to these compressed query, key, and value representations introduces cross-time interactions that are absent during spike-driven inference. We term this operator-level discrepancy Temporal Interaction Mismatch (TIM). We propose Parallel Time-Aligned Spiking Self-
Attention (PT-SSA), which reconstructs consecutive virtual spike slices from either I-LIF counts or SFA firing rates, computes
attention only between time-aligned slices in parallel, and sums the per-step outputs. To accommodate the reduced
attention output scale under SFA, we further introduce Adaptive PT-SSA, which learns a positive per-block rescaling before the output SFA
neuron to improve firing-level utilization. Experiments on CIFAR-10, CIFAR-100, and ImageNet-1K show that the proposed methods substantially reduce train–inference mismatch. On CIFAR-100 with I-LIF, PT-SSA reduces the mean Top-1 gap from 1.85 to 0.29 percentage points. On ImageNet-1K, Adaptive PT-SSA reduces the Top-1 gap from 27.78 to 0.06 percentage points and achieves 74.53% spike-driven Top-1 accuracy. A Triton-fused PT-SSA training kernel retains a $2.91\times$ throughput advantage over recurrent LIF SSA.
Read the full abstract ▾
All authors Peng Xue, Wei Fang, Kaiwei Che, Qingyan Meng, Zhengyu Ma, Yonghong Tian, Huihui Zhou
Computer Vision · Cross-listed from eess.IV
Wrong Organ, Right Physics: Transferring Echocardiography Pretraining to Lung Ultrasound for Tuberculosis Screening
Christiaan M. Geldenhuys, Joshua M. Jansen van Vüren, Véronique Suttels et al. (+6 more)
Lung ultrasound (LUS) is attractive for tuberculosis (TB) screening at primary-care level, but labelled cohorts are small. Echocardiography carries no such constraint, while sharing the same underlying ultrasound imaging physics, signal processing and B-mode appearance as LUS. We ask whether an encoder pretrained on that high-resource ultrasound domain carries representations that remain usable in the low-resource one. Only the encoder varies, across seventeen encoders spanning three architecture families. Among them, a latent-predictive
video encoder pretrained on generic
video (V-JEPA2-L) and its echocardiography counterpart (EchoJEPA-L) differ in pretraining corpus alone. The choice among these encoders does not resolve the classification, the whole family spanning 2.50 percentage points against a measurement resolution of 2.71. What moves the task instead is feature conditioning. Standardising the features between the encoder and the classifier improves all seventeen encoders by a mean of +1.23 percentage points at $p=1.5\times10^{-5}$. On the held-out test set every encoder selected on the development folds stands above the baseline system by up to +2.57 percentage points of area under the receiver operating characteristic curve (AUROC), and specificity at 90% sensitivity reaches 79.3% against 60.3%. The contrast specified in advance, EchoJEPA-L against V-JEPA2-L, measures -0.16 percentage points at $p=0.926$. We therefore find no evidence that shared ultrasonic physics alone makes echocardiography a more productive pretraining corpus than generic
video, and any advantage, if present, is smaller than this cohort can resolve. The
video encoders receive replicated still images, however, so whether this absence of an effect reflects the pretraining domain or a
video encoder applied to static frames cannot be separated. The limiting factor is the labelled cohort rather than the encoder.
Read the full abstract ▾
All authors Christiaan M. Geldenhuys, Joshua M. Jansen van Vüren, Véronique Suttels, Trevor Brokowski, Ablo P. Wachinou, Mary-Anne Hartley, Rensu P. Theart, Grant Theron, Thomas R. Niesler
Machine Learning
Architecture-Dependent Fusion Pathways in MLLMs
Hebao Zhu and Dongxia Wu
Multimodal Large
Language Models (MLLMs) achieve strong performance across
vision-
language tasks, yet the internal mechanisms by which visual and textual information are fused across layers remain insufficiently understood. We investigate representative MLLMs from two architectural paradigms: concatenation architectures and native
multimodal architectures. We conduct three progressively connected analyses:
alignment decoupling identifies which modality changes,
attention routing and
entropy characterize how cross-modal information is distributed, and intrinsic dimensionality examines how fusion reshapes feature spaces. Separately, we perform causal intervention experiments as a validation of the resulting interpretation. As a supplementary analysis, we use visual CKA to examine the Platonic Representation Hypothesis. Together, these analyses reveal two distinct fusion pathways: concatenation models follow a text-first,
vision-later pathway, whereas native models exhibit earlier visual-textual co-adaptation and feature-space reorganization. This work provides a mechanistic perspective for understanding
multimodal fusion and supports architecture-aware diagnostics of
multimodal representations.
Read the full abstract ▾
Distributed Computing
VenusRL: A Fully Disaggregated Agentic RL System with Priority Scheduling and Scalable Interaction
Mingjun Zhang, Yucheng Li, Menghao Zhang et al. (+15 more)
Agentic Reinforcement Learning (RL) trains LLM
agents through multi-turn interactions with external tool environments. Its multi-turn nature exposes two system-level bottlenecks unaddressed by existing agentic RL frameworks. First, end-to-end training throughput is constrained by the slowest trajectories to complete, yet optimizing per-GPU utilization alone scatters rollout progress across many groups, delaying the completion of enough groups to unblock the next training step. Second, tool sandboxes are statically over-provisioned by their declared
memory ceilings, leaving most physical
memory stranded while replicating near-identical state across sandboxes launched from the same
prompt. We present VenusRL, a fully disaggregated agentic RL system that addresses both bottlenecks. VenusRL's priority-aware action scheduler uses length-prediction heuristics to identify sample groups whose completion is most likely to unblock the next training step, and pushes them ahead of others across batch admission, KV Cache residency, and cross-worker request orchestration. VenusRL's environment resource manager combines a
memory-aware admission threshold with a template-keyed page-sharing pool, packing more sandboxes per node while preserving strict
memory isolation via write-protected page table entry aliasing and copy-on-write. Across representative agentic RL workloads, VenusRL achieves up to 4.24x end-to-end training speedup over state-of-the-art baselines and reduces environment cost by up to 89%.
Read the full abstract ▾
All authors Mingjun Zhang, Yucheng Li, Menghao Zhang, Shuyong Zhu, Ping Zhang, Xiaohe Hu, Jun Chen, Zhixin Wang, Xutong Wang, He Liu, Yanmin Jia, Shengrong Zhu, Peng Sun, Mingjie Zhang, Liming Liu, Jinlong Hou, Yuan Cheng, Yujun Zhang
Computational Engineering
A space-time finite element formulation for geometrically exact shear-deformable beams
Ivo Steinbrecher and Alexander Humer
We present a space-time finite element formulation for the transient analysis of geometrically exact shear-deformable beams. The formulation treats space and time within a unified finite element framework and employs a mixed approach in which translational and angular velocities are introduced as independent fields. The rotation field is parametrized using nodal rotation (pseudo-)vectors and a suitable objective interpolation of the triad field is employed. The resulting formulation supports generally curved beam structures, including
geometric kinks and rigid joints. Furthermore, time-dependent material domains can be represented directly through the geometry of the space-time surface, enabling the treatment of non-material boundaries without modifying the underlying beam formulation. Numerical examples demonstrate convergence to solutions obtained with classical time-stepping schemes, objectivity of the formulation, and the influence of the space-time stabilization. Finally, the sliding spaghetti problem illustrates the applicability of the proposed approach to axially moving continua.
Read the full abstract ▾
Robotics
HexVIO: Towards All-Day Stereo-Inertial Tracking Through Commodity DSPs
Patrick Wolf, Mateo de Mayo and Daniel Cremers
The ability of a device to localize itself within its surroundings is a fundamental prerequisite for spatial computing. Visual-inertial odometry (VIO) has proven to be a cost-effective and accurate solution for this task.
Robots, wearables, XR devices, and drones can benefit significantly from efficient implementations of VIO since they allow for cooler, lighter, and cheaper devices with longer battery life and a better user experience. In this work, we propose to enhance the efficiency of a VIO system by leveraging the Hexagon DSP, a commodity co-processor present in many modern smartphones and XR devices. Our approach offloads the visual frontend of a stereo-inertial odometry system to the DSP while keeping the backend on the main CPU. By optimizing the implementation for the DSP architecture, we achieve significant reductions in power consumption and latency compared to CPU-only execution. Our system, HexVIO, demonstrates a 67% reduction in power consumption or an 86% increase in throughput on a commodity smartphone, with the ability to sustain long-term real-time 30 fps tracking for 0.83 W, corresponding to ~18 hours of tracking on the testing device. These results highlight the potential of commodity DSPs for enabling all-day visual-inertial tracking in robotics and mobile devices.
Read the full abstract ▾
Neural and Evolutionary Computing
The Investment Acceleration Principle Revisited by means of a Neural Network
Guido Fioretti
The investment acceleration principle is a heuristic for modelling investment time series out of consumption time series. The model presented herein develops a disaggregated accelerator equation whose coefficients are the weights of a Kohonen neural net that represents firms' decision-making. According to this model, investments take place when managers recognise emerging technological patterns. Furthermore, a technique borrowed from the theory of self-organising systems is used in order to disentangle innovation-driven investments from plant-replication investments.
Read the full abstract ▾
Information Theory · Cross-listed from quant-ph
Efficiently and Reliably Measuring Information Processing Capacity in Dynamical Systems via Kernels
Alessio Benavoli, Felix Binder and Cangxiong Chen
Information Processing Capacity (IPC) is a powerful system-agnostic metric for quantifying a dynamical system's computational capability and is widely used in
quantum reservoir computing. However, standard IPC suffers from severe computational limitations. Computing IPC involves estimating how well the system can reconstruct, via linear regression, an (in principle) infinite family of orthogonal
polynomial functions of delayed inputs. In practice, this evaluation must be made finite, so we need only to consider
polynomials up to a chosen maximum degree. Moreover, the computational complexity for computing IPC grows combinatorially with the considered maximum degree and delay. Here, we introduce Kernel-IPC (KIPC), a scalable framework that uses kernel methods to compute the total IPC without explicitly enumerating basis functions. This allows us to account for the full (infinite) basis (without degree truncation). We also provide a null-hypothesis test for statistically comparing the KIPC of two dynamical systems. We validate KIPC on an echo state network and demonstrate its utility for
quantum reservoir computing on a disordered
spin chain.
Read the full abstract ▾
Robotics
DexJoCo-X: Benchmarking Action Representations for Multi-Hand Dexterous Manipulation
Xiangwei Jiang, Yao Mu, Lixin Duan et al. (+1 more)
As dexterous hands proliferate, collecting data and training policies separately for every morphology becomes increasingly impractical. Scalable cross-embodiment learning therefore requires a unified representation that captures shared manipulation structure while preserving morphology-specific control. Differences in hands, tasks,
datasets, and control interfaces prevent existing studies from isolating the effects of representation, pretraining, and architecture. We introduce DexJoCo-X, a
benchmark and toolkit for controlled comparison across seven representative dexterous hands, six single-arm and bimanual tasks, and 2,100 balanced demonstrations. DexJoCo-X provides a matched multi-hand, multi-task protocol with common scenes, success criteria, and execution interfaces, redesigned glove-to-hand mappings, and an automated pipeline that expands reviewed demonstrations across randomized scenes. Using $\pi_{0.5}$, Ego-Pi, and Being-H0.5, we examine whether a shared action interface is sufficient for multi-hand learning. Expanding $\pi_{0.5}$ to an 80-dimensional bimanual output yields near-zero success. Ego-Pi preserves the pretrained action head through interleaved prediction and supports per-hand multi-task learning, but remains ineffective for seven-hand joint training. By contrast, Being-H0.5 combines cross-embodiment pretraining, a unified action space, and embodiment-aware experts, enabling one policy to control all seven hands. Within this architecture, function-aligned action slots achieve 47.7% mean success, compared with 47.0% for native coordinates and 33.1% for DexLatent. These results show that cross-embodiment representation depends on the entire learning system: action coordinates, pretraining, and architecture must jointly separate shared manipulation structure from embodiment-specific control.
Read the full abstract ▾
All authors Xiangwei Jiang, Yao Mu, Lixin Duan, Wen Li
Data Structures and Algorithms
Monge matrix searching for lot sizing with piecewise-concave production costs
Kleitos Papadopoulos
We study single-item lot sizing with piecewise-concave production and holding–backlog costs over $T$ periods. Production has $m$ common positive finite breakpoints, and stock costs and domains have $K$ common finite boundary levels. For fixed $m,K$, we give an exact deterministic
algorithm using $\OmK(T^{m+2}\alpha(T+2))$ arithmetic operations and a Las Vegas
algorithm using $\OmK(T^{m+2})$ expected operations, where $\alpha$ is the inverse Ackermann function. The
algorithms retain nonlinear concave cost pieces and cover backlogging, common-grid stock limits, and explicit terminal-stock policies. A structural decomposition at stock boundary levels yields breakpoint-only prefix and suffix tables. Batching transitions by a designated production period produces implicit
matrices that are Monge double staircases on each production piece. Established
matrix searches, merged state orders, and backward evaluation provide the bounds. A simpler rectangle/SMAWK variant requires $\OmK(T^{m+2}\log(T+2))$ operations. On 300 no-backlogging
benchmark cases, its objectives agree exactly with the predecessor dynamic program and an inventory-state oracle.
Geometric-mean paired time ratios are \GeoUncap\ for uncapacitated cases and \GeoCap\ for capacitated cases, with ratios above one favoring
matrix searching. A 640-case base-model validation suite and a separate 624-case generalized-model suite pass. The timing study does not
benchmark the generalized models or the stronger staircase routines. All bounds assume exact arithmetic, constant-time cost queries, and explicit closed-domain concavity conditions.
Read the full abstract ▾
Computer Vision
Moving Forward with Video Saliency: A New Dataset and Benchmark where Motion Matters
Susmit Agrawal, Rebecca Wanner, Juliane Verwiebe et al. (+3 more)
Video saliency prediction is inherently harder to model than static image saliency due to the additional temporal dimension.
Video saliency
benchmarks rest on the premise that predicting gaze on
video requires utilizing temporal activity distributed across frames. Prior work has challenged this, showing that static baselines recover a significant fraction of the explainable gaze information on LEDOV, a popular
video saliency
dataset, and that
video saliency models fail in the same places as this static baseline. We verify that this diagnosis still stands: under a more capable gold standard than the original analysis, and an updated panel of recent architectures, the strongest temporal architecture in the panel still does not substantially improve over a fine-tuned static baseline. However, it remains unclear whether the marginal gain reflects limitations of current temporal architectures or a lack of temporal patterns in the
benchmark itself. We introduce SalTempto, a
video saliency
benchmark with greater dynamism: 224 clips of highly dynamic content, sourced from the HACS-Segments
dataset so that each clip contains an event together with its lead-up and aftermath, with gaze recordings from up to 16 subjects and a training split for adapting pretrained models. On SalTempto, the static baseline recovers only about 13% of the headroom above the centerbias, against more than half on LEDOV. A fine-tuned temporal architecture shows a substantial gain in performance over the static baseline, indicating that it does capture meaningfully more temporal information, which LEDOV fails to measure. Yet, even this SoTA model still leaves nearly half of SalTempto's headroom unexplained, indicating room for improvement in
video saliency modelling. Examination of SalTempto also lets us describe human tendencies that models miss. SalTempto link: https://huggingface.co/
datasets/bethgelab/
video_saliency.
Read the full abstract ▾
All authors Susmit Agrawal, Rebecca Wanner, Juliane Verwiebe, Matthias Tangemann, Matthias Bethge, Matthias Kümmerer
Systems and Control
How suboptimal is my stochastic network controller allowed to be? Completion certificates with application to power grids hosting AI data centers
Michael Chertkov
Power grids are beginning to host AI data centers whose demand can change abruptly and in a correlated way, and operators and planners must decide whether existing controllers can absorb the resulting transients and where new flexibility is worth installing. We cast this as a question in
stochastic control: how far from optimal is an implementable controller? For controlled
diffusions with affine, state-independent actuation, additive and possibly degenerate noise and quadratic control cost, any Hamilton-Jacobi-Bellman (HJB) subsolution bounds the optimal cost from below and simulation bounds the deployed cost from above, so their gap certifies the permissible suboptimality. We construct subsolutions from path-integral control by completing the control geometry: enlarging the control Gramian until it matches the physical noise makes the problem linearly solvable, and its Feynman-Kac value is an automatic lower bound whose HJB residual is exactly the energy of the fictitious control. A dual noise-deflation construction can be tighter but requires a
curvature condition. The geometry yields planning rules: price control authority in proportion to local noise variance, and use shadow values to guide sparse reinforcement. For nonlinear
stochastic swing dynamics of the IEEE 118-bus system after a severe load loss, a simple generator controller is certified within 2.8% of optimal under homogeneous forcing; under heterogeneous forcing the gap is 39% with uniform prices and 1.2% once the same total authority is repriced, before any hardware is added.
Read the full abstract ▾
Artificial Intelligence
EVOL: Simulator-Guided Evolutionary Expert Synthesis for Deployment-Free Learning Path Recommendation
Geonwoo Bang, Dongho Kim and Moohong Min
Reinforcement learning (RL) for learning path recommendation (LPR) faces two coupled obstacles. First, the policy must commit to a sequence of L concepts without intermediate feedback, producing a combinatorial search space that grows super-exponentially with L and provides reward only at the final step. Second, expert learning paths would be the natural cure for sparse-reward RL, but they do not exist in educational data, because student logs record what learners did, not what they should have done. We address both obstacles by importing a recipe from simulator-based demonstration learning in robotics: the knowledge tracing simulator is used both to synthesize per-learner expert demonstrations through evolutionary search and to train a deployment-free policy that distills these demonstrations into a feed-forward learner. Our framework, EVOL, instantiates this pipeline with an asymmetric actor-critic where the actor commits to deployment-realistic blind planning while the critic exploits the privileged simulator state during training. Across three
datasets (ASSIST15, Junyi, and EdNet; 39-189 concepts) and path lengths L = 5, 10, and 20, EVOL surpasses 8 baselines spanning heuristic, sequential, RL, graph-enhanced RL, and LLM-enhanced methods. We further compare three imitation strategies (BC, AWR, and DAPG) and show that final performance is governed by the quality of evolutionary experts rather than by the particular imitation objective.
Read the full abstract ▾
Computation and Language
Shrome at Touché: Soft-Vote Ensembling and Counter-Causal Augmentation for Causality Extraction
Roham Zendehdel Nobari and Shayan Sooratgar
Touché 2026 extends causality extraction to counter-causal claims: news sentences whose surface form appears causal but whose meaning denies the causation, as in "It is falsely believed that X caused Y." A system that relies on surface cues such as "caused" or "led to" will accept such a sentence as causal and give it the wrong polarity. On the Countercausal News Corpus (CCNC), the task has three subtasks: deciding whether a sentence is causal (detection), locating its cause and effect spans (extraction), and labeling its polarity as procausal, counter-causal, or uncausal. We build one model per subtask. Detection is a fine-tuned classifier with a single cross-task rule that uses the extracted spans to remove false positives. For extraction, we ensemble three RoBERTa-large BILOU+CRF taggers by averaging their
token-level scores before decoding, rather than voting on the spans each tagger produces. For polarity, where labeled counter-causal examples are scarcest, we add training sentences generated by a large
language model prompted with nine patterns of counter-causal expression adapted from Hagen et al., keeping only those that pass automatic structural checks. On the held-out CCNC test set, the system reaches F1 0.869 on detection and macro-F1 0.817 on polarity, and in the organizers' final causal-only evaluation of extraction it scores granularity-adjusted F1 0.728, the highest extraction score among all submissions including the organizers' baseline. The development split is used only for component selection and the ablations reported in the paper.
Read the full abstract ▾
Numerical Analysis
On the Choice of Continuous and Discontinuous Lagrange Multipliers in Fictitious-Domain Methods
Najwa Alshehri and Shumoua F. Alrzqi
This article examines the Fictitious-Domain approach using Distributed Lagrange Multipliers (FD-DLM), a method that handles
elliptic interface problems with separate meshes without requiring the interface to match the background mesh. It compares two stable, low-order FD-DLM discretizations when using both continuous and discontinuous multiplier spaces. The study distinguishes between satisfying the weak coupling constraint per element and the size of the discrepancy between the two discrete primal fields. Numerical experiments indicate that the continuous formulation usually yields smaller local errors and maximum mismatch values, while the discontinuous formulation shows a more regular decrease in mismatch as the mesh is refined and has smaller primal errors.
Read the full abstract ▾
Information Theory
Performance Analysis of MR-NOMA with Arbitrary Number of Users and Symbol Rates
Zainab Khader, Arafat Al-Dweik and Emad Alsusa
This paper analytically investigates the bit error rate (BER) performance of downlink multi-rate (MR)-non-orthogonal multiple access (NOMA) over Nakagami-m fading channels for an arbitrary number of users and symbol rates. The analysis is first developed for a three-user case, then generalized to systems with more than three users, yielding an exact BER expression for the first detected user and an accurate closed-form approximations for the remaining users under the perfect-successive interference cancellation (SIC) assumption. These results are further unified into a general average-BER expression over Nakagami-m fading for arbitrary user numbers and symbol-rate configurations. A symbol-pattern-dependent signal-to-interference plus noise ratio (SINR) analysis further shows how the symbol-duration diversity enables inherent interference cancellation, explaining the BER advantage of MR-NOMA over conventional single-symbol rate (SR)-NOMA. An average BER minimization problem is also formulated and numerically solved to optimize the users' power allocation, with simulation results corroborating the analytical findings. Overall, MR-NOMA is shown to offer greater flexibility in user pairing while maintaining reliable BER performance and accommodating diverse quality-of-service (QoS) requirements.
Read the full abstract ▾
Machine Learning
SPEAR: A Spectral-Disentangled MoE Neural Operator with Knowledge-Guided Expert Aggregation for Large-Scale PDE Pretraining
Dengdi Sun, Xiaoya Zhou, Xiao Wang et al. (+3 more)
Large-scale pre-training has improved the generalization of neural operators across diverse PDEs. However, existing PDE foundation models still struggle with heterogeneous dynamics, where shared representations may cause knowledge interference, while mixture-of-experts (MoE) architectures suffer from increasing expert redundancy. We propose SPEAR, a spectral-disentangled MoE neural operator with knowledge-guided expert aggregation for large-scale PDE pre-training. SPEAR decouples latent features into low- and high-frequency components, enabling shared modeling of transferable dynamics and specialized learning of PDE-specific patterns. To address expert redundancy, we design a knowledge-guided expert aggregation strategy that measures expert similarity from
dataset-specific learned knowledge and routing preferences, enabling the identification and consolidation of similar experts. Experiments on twelve PDE
datasets and multiple downstream
benchmarks demonstrate superior performance in pre-training, fine-tuning, and transfer learning. Furthermore, our aggregation strategy reduces the number of experts by 50% while maintaining or improving prediction accuracy, achieving a balance between model efficiency and generalization for PDE foundation models.
Read the full abstract ▾
All authors Dengdi Sun, Xiaoya Zhou, Xiao Wang, Wanli Lyu, Jin Tang, Bin Luo
Systems and Control · Cross-listed from math.OC
Wasserstein Contraction of Stochastic Systems on Manifolds: A Differential Approach
Dongjun Wu
Contraction analysis of dynamical systems turns a global convergence problem into a local one. If the variational system is stable in a uniform sense, then all trajectories of the original system converge toward each other. This paper develops a
stochastic analogue for continuous-time
stochastic systems, where convergence is measured by Wasserstein distance between probability laws. The key step is to employ mean-square differentiation to construct
stochastic variational dynamics. Its uniform $L_2$ stability can then be integrated along curves of initial conditions, yielding Wasserstein contraction of the associated probability laws. This yields criteria formulated in terms of differential Lyapunov functions, and on
manifolds, it leads to intrinsic Riemannian formulations. A distinctive feature of the
stochastic setting is that the coupling of the noises becomes a design freedom. To exploit this freedom, we introduce an orthogonal differential coupling that extends the framework beyond synchronous coupling. The resulting criterion explicitly exposes how the
curvature of the state space enters the contraction mechanism and, in the orthonormal-frame case, recovers the classical
Ricci-
curvature structure. Finally, we apply the framework to
stochastic control on a compact
manifold. By introducing
stochastic control input, we overcome a deterministic obstruction to global stabilization. That is, a system that cannot be globally stabilized through smooth time-invariant deterministic feedback is rendered globally contracting in $W_2$, and its steady state distribution can be made arbitrarily concentrated around a prescribed target
equilibrium.
Read the full abstract ▾
Cryptography and Security
Asymptotic Analysis of Trading Fees in CFMM
Peiyang Jin, Clouds and Jing Qian
As the dominant trading mechanism in decentralized finance, Automated
Market Maker has been widely studied in research. However, limited research has been done with the trading fees taken into consideration. In this work, we study how much trading fee Liquidity Providers(LPs) can receive from arbitrage trading when the fee rate approaches zero. We give a closed-form formula for it and our result shows that the trading fees generated by arbitrage trading can fully offset the LVR loss when the price process is continuous. We further extend our conclusions to price processes with jumps and the theoretical analysis shows that jumps are the only cause of LP loss apart from
market risks. Our results provide practical guidance for AMM designers as well as LPs.
Read the full abstract ▾
Computer Vision
Consecutive Posterior Fusion for Diffusive Recovery of Unobservable Image Structures
Elena Morotti, Davide Evangelista and Elena Loli Piccolomini
Solving severely ill-posed imaging inverse problems requires recovering image structures that are unobservable or weakly constrained by the measurements.
Diffusion models provide expressive learned priors for inferring such missing information, while posterior sampling incorporates measurement consistency along the reverse process. Standard
diffusion posterior samplers, however, rely on instantaneous measurement-aware estimates, without explicitly exploiting information carried by previous posterior corrections. We introduce Consecutive Posterior Fusion Denoising
Diffusion Null-Space Models (CPF-DDNM), an inference-time strategy that fuses consecutive measurement-aware estimates to improve the diffusive recovery of unobservable image structures, without requiring retraining or additional denoiser evaluations. We instantiate this principle within DDNM, whose range/null-space decomposition reveals that consecutive fusion preserves the measurement-determined component while acting exclusively on the prior-driven null-space estimate. We thus provide a
geometric interpretation of CPF-DDNM and a local error analysis that characterizes the optimal time-dependent fusion coefficient, including the extrapolative regime. Experiments on sparse-view and simulated low-dose computed
tomography, as well as medical image super-resolution, show consistent improvements over DDNM and competitive performance against
diffusion-based inverse solvers.
Read the full abstract ▾
Hardware Architecture · Cross-listed from quant-ph
Compiling Together: High-Throughput Distributed Quantum Computing via Multi-Compilation
Yipei Liu, Sen Zhang, Zebo Yang et al. (+1 more)
Quantum computing is a promising paradigm for problems that are challenging for classical machines, but realizing that promise requires far more
qubits than a single processor can offer. Distributed
quantum computing (DQC) scales out by connecting multiple
quantum processing units (QPUs), at the cost of making
entanglement the scarce resource: every remote gate consumes a Bell pair, and inter-QPU links generate Bell pairs at finite rates orders of magnitude slower than local gates. Since
quantum programs are executed repeatedly, this rate bounds how fast shots complete and thus how fast results are obtained. Existing DQC compilers emit a single implementation per
circuit, so throughput is capped by its busiest link while other links stay idle. We observe that alternative compilations of the same
circuit are logically equivalent yet stress different links; executing them concurrently and pooling their samples converts idle Bell pairs into additional shots. We formulate the joint selection of compilations and allocation of shots under per-link Bell-pair capacities as Candidate-Constrained Max-Shot Allocation (CMA), prove it NP-hard, and solve it with a dynamic program and its approximate variant AppDP, a compact MILP, and a greedy heuristic Effi. In simulation on six-QPU networks, multi-compilation raises throughput by 2-4.5* over the single compilation and correspondingly improves output fidelity under equal Bell-pair budgets. On hardware, it increases measured fidelity by up to 93% and reaches the single-compilation fidelity in up to 10* less time. Scaling to 36 QPUs and 144-
qubit circuits, MILP improves throughput over the single compilation by 76.8% on average across 48 configurations while Effi allocates in milliseconds.
Read the full abstract ▾
All authors Yipei Liu, Sen Zhang, Zebo Yang, Lei Yang
Machine Learning
PaMIR: Open Benchmark of Public Credit-Default Datasets
Mikhail Liashkov, Ilyas Varshavskiy, Shuhratjon Khalilbekov et al. (+2 more)
We release PaMIR (Public Arrival-ordered Measurement for Inference in Risk), an open
benchmark for credit-default prediction when labels are scarce and arrive late. The field's reference
benchmark studies use eight
datasets each, only two or four of them public. PaMIR brings together 19 public
datasets with binary default labels – 1.24M loans, firms and card accounts from nine countries – rebuilt from pinned source snapshots by one leakage-audited recipe and never redistributed; to our knowledge it is the one of its kind as of today. Every model is a single function, scored under a repeated i.i.d. split and a label-delayed stream in which each application is scored on arrival, with AUC reported by label budget; fleet means are withheld unless every
dataset is scored. A synthetic-data harness tests generated training rows without letting a generator see held-out rows. This report describes release 0.4.0 of this living
benchmark.
Read the full abstract ▾
All authors Mikhail Liashkov, Ilyas Varshavskiy, Shuhratjon Khalilbekov, Azizjon Azimi, Bonu Boboeva
Machine Learning
Mapping and Advancing the Scalability-Accuracy Frontier of Nonlinear Causal Discovery
Hendrik Suhr, Sascha Xu and Jilles Vreeken
Scalable nonlinear causal discovery requires methods that combine flexible mechanism
estimators with efficient search over large graph spaces. Several algorithmic families have been proposed to address this challenge, yet their accuracy-runtime trade-offs remain poorly understood. We empirically compare the four major approaches: differentiable structure learning, amortized structure learning, score-matching, and combinatorial search. Our results reveal complementary bottlenecks: differentiable and amortized methods scale well but exhibit an accuracy gap, score-matching methods can be accurate in low dimensions but degrade quickly for increasing feature sizes, and combinatorial methods remain accurate but are slowed by repeated and redundant local scoring. Motivated by this bottleneck, we develop SPADE, a spline-based score-evaluation scheme that compiles sufficient statistics once and reuses them throughout combinatorial search. Under bounded indegree, its Gaussian variant reduces algorithmic complexity from O(nd^3) to O(nd^2+d^3). Empirically, SPADE shifts the observed scalability-accuracy frontier by orders of magnitude: it solves 100-variable problems with 160K samples in seconds and 1600-variable problems with 2.5K samples in minutes, while retaining high structural accuracy across synthetic and real-world
benchmarks. These results reveal a substantial shift in the practical scale of combinatorial search and highlight the importance of evaluating scalable causal-discovery methods along the full accuracy-runtime frontier.
Read the full abstract ▾
Machine Learning
Cross-cohort TB classification using clinical data gathered in Uganda and South Africa
Joshua M. Jansen van Vüren, Devendra S. Parihar, Daphne Naidoo et al. (+8 more)
We present a first evaluation of machine learning applied to patient clinical and demographic data gathered in two different countries for the purpose of tuberculosis (TB) screening to identify people who would benefit from expensive molecular testing. Experiments are based on the recently-compiled CAGE-TB
dataset, which includes sub-cohorts of people with presumptive TB presenting at community health care centres in South Africa and Uganda. Three neural network architectures (logistic regression (LR), multilayer perceptrons (MLP) and convolutional neural networks (CNN)) are considered in conjunction with greedy feature selection. For the convolutional neural network, a strategy that jointly optimises feature selection and feature ordering is proposed and shown to lead to consistent development and test set improvements. For all three models, development set area under the receiver operating characteristic (AUROC) curve is improved by 2-7% using feature selection. LR after feature selection achieves an AUROC of 0.8 [0.75,0.86] (95% CI) and 0.84 [0.78,0.9] when testing on the held-out Ugandan and South African data respectively. Although outperforming LR on the development cohort, the deeper networks (MLP, CNN) show inconsistent trends on the held-out cohorts, while LR achieves performance within 1-2% of the best achieved in terms of AUROC. LR narrowly misses the WHO minimum requirements by 4-9% in sensitivity even though the network is being evaluated on a completely held-out cohort. The development of neural-network based classifiers for TB screening therefore appears viable.
Read the full abstract ▾
All authors Joshua M. Jansen van Vüren, Devendra S. Parihar, Daphne Naidoo, Marisa Klopper, Frank Cobelens, Lutz Kolbe, Kimsey Zajac, Willy Ssengooba, Moses Joloba, Grant Theron, Thomas R. Niesler
Game Theory
Prompt framing governs LLM default following in collective-action
Eladio Montero-Porras, Axel Abels and Tom Lenaerts
Large
language models are increasingly deployed as
agents that make or recommend decisions on behalf of users, often operating through interfaces that pre-fill suggested values or default options. Whether models treat such defaults as merely informational or as suggestions that systematically alter their choices remains unclear. We study default deference in two one-shot social dilemmas: a common-pool resource (CPR) extraction game and a threshold public-good (TPG) contribution game. We measure how defaults shift each model's choice distribution relative to its no-default baseline, across default values, wordings, and action-space granularities. We find that pre-filled defaults pull probability mass on the default value in both games, but the magnitude depends strongly on wording: the same model can show high pull under one formulation and near-zero pull under another. Permission-style wording reduces default pull in both games, more strongly in CPR than in TPG. Default pull is weaker in coarse action spaces, and conflict defaults attract more mass than agreement ones. These results indicate that default deference depends on the model, the wording of the interface, and the structure of available choices. For agentic systems, evaluating model behaviour without controlling the surrounding choice architecture can miss an important source of behavioural variation.
Read the full abstract ▾
Computer Vision
COSMI: COmpositional Synthesis of Multi-object Interactions
Daniel Eskandar, Ilya A. Petrov and Gerard Pons-Moll
Generative models of human-object interaction are bounded by the data that exists: everyday activities involve several objects, but most captured
datasets record one at a time, as multi-object capture is combinatorially expensive. Our observation is that interactions are local, so single-object captures already contain the parts of multi-object activities. We compose them: contact-consistent clips of single interactions, mirrored to balance the hands, transfer between bodies, and a
language model and
geometric checks admit only the pairings that are plausible, semantically and physically. Therefore, the
dataset grows combinatorially with the clips rather than recording time. The COSMI
dataset holds 222k sequences and 275 hours with up to five objects, nearly thirty times the largest multi-object capture, and can be extended by adding
datasets or even hand-object recordings. On this data we train the COSMI method, a text-to-interaction
diffusion transformer that follows how the data is built: weight-shared object slots generate a variable number of objects, predicted relative to the body parts that move them. On a
benchmark with an unseen object and unseen interaction combinations, models trained on the
dataset generalize to the unseen combinations. COSMI outperforms baselines in text
alignment and contact accuracy, where its margin is largest on the unseen object. Code, models, and the
dataset pipeline will be released on the project page: https://ptrvilya.github.io/cosmi.
Read the full abstract ▾
Artificial Intelligence
Learning a Fact Is Not Learning How to Retrieve It
Chaemin Jang, Jihee Kim and Dongman Lee
A model trained on "The capital of X is Y" may produce "Y" after "The capital of X is" but fail after "The capital of X:." We call these different ways of eliciting the same fact request forms. To separate learning a fact from retrieving it, we train two models in two stages. In the first stage (request-form training), one model sees each fact in five forms and the other sees the same facts only as statements. In the second stage (target-fact training), both receive identical training on new facts, all as statements. Both then retrieve the new facts almost equally well from statements, but differ sharply on other request forms. Thus, a model can learn how to retrieve through a request form before it learns the facts. To understand this difference, we examine the hidden state immediately before the answer, which we call the context state. When given two different request forms for the same fact, the model trained on five forms in stage one produces more similar context states than the model trained on statements alone in that stage. Changing this state at
retrieval time can enable or prevent
retrieval of an already learned fact, and the same effect transfers across facts and factual relations, such as capitals and currencies. To test its role during learning, we change the context state only during target-fact training. This intervention changes later
retrieval without intervention at test time. Together, these results show that later
retrieval depends on earlier request-form experience and the context state during fact learning.
Read the full abstract ▾