Computer Vision
TAME: Temporal-Aware Mixture-of-Experts for Text-Video Retrieval
Uicheol Jung, Juyoung Hong, Hojung Kwon et al. (+1 more)
Text-
Video Retrieval (TVR) retrieves
videos that match a natural-
language query, but extending image-text models such as CLIP to
videos is fundamentally limited by the lack of temporal modeling.
Videos exhibit frame-wise heterogeneity in appearance and motion, and compressing all frames into a single representation often obscures temporal structure and semantic transitions. To address this, we propose Temporal-Aware Mixture-of-Experts for Text-
Video Retrieval (TAME), a CLIP-based framework that jointly models frame-level structure and temporal relations. First, we integrate sparse Mixture-of-Experts (MoE) layers into both CLIP encoders and apply frame-consistent routing on the
vision branch so that experts specialize according to frame-level visual patterns while preserving the original
vision-
language alignment. Second, we introduce Frame-Temporal (FT)
tokens that aggregate global cross-frame information and feed it back to each frame, enabling the visual encoder to capture long-range temporal dependencies without harming local details. Third, we design a Cross-Temporal Interaction and Aggregation (CTIA) module that refines frame-wise sentence-
video similarities through staged temporal filtering and fusion. Experiments on standard TVR
benchmarks show that TAME consistently improves over CLIP-based baselines. On MSR-VTT, it improves R@1 by 4.0 over CLIP4Clip, and also achieves consistent gains on DiDeMo, MSVD, LSMDC, and ActivityNet. The code is available at https://github.com/sejong-rcv/TAME.
Read the full abstract ▾
All authors Uicheol Jung, Juyoung Hong, Hojung Kwon, Yukyung Choi
Machine Learning
SMart: A Multi-source Multi-phase Time Series Representation Transfer Framework
Fang He and Wang-chien Lee
Time series representation learning (TSRL) has attracted growing research interests in recent years. Two recent explorations in TSRL are: i) exploiting a
transformer-based framework to learn time series; ii) instead of using only the targeted
dataset, borrowing time series from other
datasets to to facilitate representation transfer. While these two explorations are shown effective, the self-supervised time series recovery task in (i) and the single-source
dataset used in (ii) are technically simple and thus can be enhanced with new ideas. In this work, we propose a new TSRL framework, namely multi-source multi-phase time series representation transfer (SMart), which has two novel mechanisms to address the aforementioned deficiencies: 1) a multi-phase recurrence plots recovery task, in three alternative modes, for guiding the encoder to embed time series dynamics into the time series representation; and 2) a source
dataset selector to select multiple suitable source
datasets to supplement the original target
dataset for pre-training the TSRL encoder. Experimental results show that SMart outperforms several state-of-the-art models for time series representation learning, classification and regression on both uni-variate and multi-variate time series
datasets, reducing mean absolute error up to 19.5% for time series regression, and increasing average accuracy up to 1.34% for time series classification.
Read the full abstract ▾
Artificial Intelligence · Cross-listed from stat.ML
Schrödinger Bridges on Lie Group Manifolds for Probabilistic Intrinsic Generation
Shizhe Zhang, Mingyang Zhao and Lei Ma
Generative modeling directly on
geometric manifolds can avoid errors introduced by flattening non-Euclidean data, repeated ambient projection, and coordinate inconsistency in Euclidean representations. Schrodinger bridges provide a probabilistic generative framework for
entropy-regularized transport between prescribed endpoint distributions. We study Schrodinger bridges for kinetic dynamics on Lie group
manifolds with state X_t = (g_t, xi_t) in G x g, allowing endpoint observations to constrain only the variables that are actually measured. In particular, the
entropy projection determines the conditional law of the unobserved endpoint velocities. For the same observed endpoint bridge, we develop two computational realizations: Wrapped-Kernel Bridge Calibration (WKBC) uses an explicit periodized kinetic kernel on compact Abelian groups, whereas Reciprocal Conditional-Control Bridge Matching (RCCBM) handles compact non-Abelian groups through two-sided endpoint calibration and mollified conditional-control matching. The canonical teacher-mixture path law is itself a Markov reciprocal law, so forward generation uses a calibrated initial law and one learned Doob controller. Moreover, we establish a modular error bound in the bounded-Lipschitz path metric that provides a clean separation of errors due to endpoints, control regression, initialization, discretization, and related approximations. Experiments on multiple Lie group
manifold datasets validate the feasibility and consistency of our proposed method, covering
protein and RNA torsions, SO(3), U(n), and the
Protein Conformational Transition Pathway Generation task using mdCATH trajectories in a compact reduced representation. The source code is publicly available at https://github.com/cafferyzhang12/Schr-dinger_Bridge_on_LieGroup.
Read the full abstract ▾
Neural and Evolutionary Computing
Memory as an Energy Landscape—Hopfield
Nima Dehghani
This chapter reconstructs the Hopfield network as a physical theory of
memory rather than merely an early neural-network
algorithm. It begins with the problem as it stood before 1982-threshold logic, Hebbian association, correlation
memories, and recurrent binary networks-and isolates what Hopfield's synthesis added: a dynamical definition of content-addressable
memory, a symmetric recurrent architecture with a Lyapunov function, a Hebbian
embedding of patterns in its couplings, and a physical account of basins, robustness, and graceful degradation. The binary and graded-response energy functions are derived in full, together with the signal-crosstalk decomposition governing pattern stability, the mean-field theory of
retrieval at extensive load, and the zero-temperature
retrieval spinodal at (alpha 0.138) established by Amit, Gutfreund, and Sompolinsky. The energy-based program is then followed through analog optimization networks,
polynomial dense associative
memories, exponential interactions, and modern continuous Hopfield updates, including the precise conditions under which the update becomes scaled dot-product
attention. Throughout, capacity claims are tied to their disorder ensemble, scaling limit, and success criterion, showing why numerically different storage limits need not conflict. A closing assessment distinguishes established results from surviving principles, assumption-bound limitations, and open problems, treating the Hopfield network as an effective theory whose
symmetry, locality, and point-
neuron assumptions delimit its biological reach. Fixed-seed numerical experiments expose the mechanisms discussed but do not substitute for analytical results.
Read the full abstract ▾
Machine Learning
Learning the Constitutive Behavior of Materials via Neural Operators and Causal Attention: Case Studies in Plasticity and Damage
Rishabh Arora, Lisa Scheunemann, Tim Brepols et al. (+1 more)
Classical constitutive modeling of path-dependent inelastic materials relies on internal state variables whose
evolution equations must be postulated based on domain knowledge and calibrated against experimental data. However, in many practical settings, the relevant internal variables are typically not measurable in experiments, and the constitutive response must be inferred entirely from measured strain-stress data without any prior knowledge of the material's internal state. We propose a data-driven constitutive modeling framework based on the concept of a material operator, which treats a deforming material as a functional mapping from its entire strain history to the corresponding stress response. In contrast to traditional autoregressive or recurrent formulations, the model is trained directly on full loading paths as function-to-function mappings, predicting complete stress trajectories in a single parallel forward pass. Temporal path dependence is enforced through a causally masked
attention mechanism embedded within the operator, which restricts the model's
attention to past material states while preserving computational parallelizability. Spectral convolutions provide discretization-invariant representations in the frequency domain, while causal
attention captures highly adaptive, non-local history dependence. Furthermore, sinusoidal activation functions are used to resolve the strong nonlinear transitions inherent in inelastic regimes. The framework is evaluated across multidimensional, rate-independent material models exhibiting complex phenomena, with an emphasis on nonlinear plasticity and ductile damage accumulation. The results demonstrate accurate and robust predictions of irreversible deformation mechanisms while simultaneously achieving resolution invariance and excellent parallel efficiency.
Read the full abstract ▾
All authors Rishabh Arora, Lisa Scheunemann, Tim Brepols, Shahed Rezaei
Artificial Intelligence
Examining the Vulnerability of Multi-Agent Medical Systems to Human Interventions for Clinical Reasoning
Benjamin C Liu, Dillon Mehta, Rishi Malhotra et al. (+7 more)
Human interventions at fault points can alter the diagnostic accuracy of multi-
agent medical systems. We defined fault points as moments in AI
agent conversations, in which an
agent's
reasoning became most vulnerable to external influence. Using the MedQA
dataset, this study analyzed simulated doctor-patient conversations to measure how interventions shifted
reasoning and accuracy. Correct intervention methods showed an improvement in baseline diagnostic accuracy of up to 40%, while incorrect or bias-related interventions degraded performance by up to 6% and increased diagnostic drift and uncertainty. Beyond performance changes, our analysis revealed behavioral similarities between cognitive biases in simulated
agent environments and real-world clinical practice. Examples included premature closure and susceptibility to misleading cues. Overall, these findings demonstrate that identifying and guiding fault points with human interventions may provide a mechanism for improving diagnostic robustness in multi-
agent medical systems.
Read the full abstract ▾
All authors Benjamin C Liu, Dillon Mehta, Rishi Malhotra, Adam Zobian, Yong Ying Tan, Samir Chopra, Daniella Rand, Natalie Pang, Abhiram Gudimella, Kevin Zhu
Computational Engineering
A physics-enhanced bidirectional multi-order graph fusion network for interpretable bearing remaining useful life prediction
Haoxuan Zhang, Dinghao Yang, Kangning Zhang et al. (+4 more)
Accurate prediction of bearing remaining useful life (RUL) is a key challenge for intelligent maintenance. Although deep learning-based prediction methods have showed effectiveness, existing methods still have limitations in learning nonlinear bearing degradation processes and model interpretability. Especially in engineering applications, the "black box" nature of deep learning models can easily raise concerns about their reliability. Therefore, we propose a physics-enhanced bidirectional multi-order graph fusion network for interpretable bearing RUL prediction. Our network mines complementary information from both forward and backward degradation sequences. Specifically, our network introduces a multi-order graph propagator to capture the local-global degradation dependencies. A gated cross-fusion mechanism is further designed to dynamically balance the feature contributions from both forward and backward directions. Then, our network stores representative historical degradation prototypes in dynamic
memory, so that the final RUL prediction no longer depends solely on the current latent features, but is guided by reusable historical degradation knowledge. To reveal how our model learns the nonlinear degradation process, the feature mapping parts utilize the Kolmogorov-Arnold network, which allows the nonlinear mapping to be visualized using learnable functions. Finally, a physics-enhanced dynamic loss function is developed to help our network learn effective and reliable degradation representations. Extensive experiments on two public
datasets show that our method achieves the lowest error while providing more conservative estimates than existing methods. Our code is available at https://github.com/IMGresearcher/PE-BMGN.
Read the full abstract ▾
All authors Haoxuan Zhang, Dinghao Yang, Kangning Zhang, Shaoyong Guo, Haisheng Li, Rui Yang, Ruijun Liu
Information Retrieval
June Park, Jun Kwon, Jonghyo Kim et al. (+1 more)
Reasoning-intensive
retrieval addresses queries whose relevance cannot be identified by surface-level matching, thereby requiring multi-step
reasoning. Because relevant documents rarely appear in the initial candidate set,
retrieval systems suffer from the bounded recall problem. Existing methods iteratively expand a candidate pool at the document level over a corpus graph, examining each neighbor in isolation and drifting toward a narrow region of the corpus. To address this problem, we propose Group-Aware Adaptive
Retrieval for Evidence
Navigation (GAREN), which explores the corpus graph through group-level expansion. GAREN organizes documents into semantically coherent and distinguishable groups based on their connections in the corpus graph. The information in each group indicates what can be accessed by expanding through it, providing guidance beyond individual document-level signals. At each iteration, GAREN uses a group-level navigator to identify promising expansion directions, retrieves documents from the selected groups, and applies a document-level reranker to evaluate the updated candidate set. Extensive experiments show that GAREN achieves up to 8.0% improvement over the strongest baseline on BRIGHT. The source code is available at https://github.com/KJ12124/GAREN
Read the full abstract ▾
All authors June Park, Jun Kwon, Jonghyo Kim, Jongwuk Lee
Computer Vision
Lightweight Adaptation of General-Purpose VLMs for Multispectral and SAR Image Understanding
Shanji Liu, Kelu Yao, Junxiao Xue et al. (+5 more)
General-purpose
vision-
language models (VLMs) now support strong visual recognition, instruction following, and generation. However, most pretrained visual encoders are built around three-channel natural images and do not directly accommodate observations such as native multispectral measurements or synthetic aperture radar (SAR). Adapting VLMs to these sensors typically requires dedicated encoders and domain pretraining, slowing the reuse of stronger general-purpose checkpoints. We show that the multi-image interface of general-purpose VLMs offers a lightweight alternative. Our protocol renders each observation as five optical views and one SAR view, names them in the
prompt, and adapts the
language network and selected visual
transformer blocks with LoRA. This exposes band composites, spectral indices, and radar backscatter through an existing visual interface. For land-cover recognition, structured supervision couples predicted classes with sensor evidence. We further construct preference pairs in which a true label is omitted while its supporting evidence is retained, encouraging complete predictions that remain consistent with the observations. On a balanced six-class land-cover
benchmark derived from BigEarthNet-v2, the adapted Qwen3-VL reaches 0.8275 micro F1. The same input and adaptation protocol improves all four tested VLM architectures and transfers to Sen1Floods11 flood verification and BigEarthNet.txt captioning. Image removal and mismatch controls show that the adapted models use the supplied sensor observations. Together, these results demonstrate that VLMs can be repurposed for multispectral and SAR tasks through rendered inputs and compact LoRA adaptation, without training a new foundation model.
Read the full abstract ▾
All authors Shanji Liu, Kelu Yao, Junxiao Xue, Chenghui Lv, Xiangyang Miao, Yekai Huang, Yaying Chen, Chao Li
Machine Learning · Cross-listed from quant-ph
Quantum MeanFlow: single-shot generative sampling on NISQ hardware
Ashish Joshi, Eshaan Mistry and Takahiko Koyama
Quantum generative models offer a promising framework for exploring whether
quantum computation can enhance generative machine learning. Flow matching is a generative method in which samples are generated by transporting a simple, known distribution to the target data distribution with a learned velocity field. Its
quantum counterpart, known as
quantum flow matching (QFM), was introduced recently, and, like its classical counterpart, requires integrating an ordinary differential equation over many time steps during inference. As each step requires the output from the previous step, the
circuit submission is sequential and a drawback on
quantum computers as they have high input/output costs. To alleviate this problem, we introduce
Quantum MeanFlow (QMF), the
quantum analogue of the MeanFlow formulation, which allows single-step sample generation. While the QFM learns an instantaneous velocity field at each time step, QMF learns the average velocity over a time interval. We use a parameterized
quantum circuit to learn these velocity fields and
benchmark the two methods on the MNIST
dataset. We show that while single-step QMF has lower image quality compared to multi-step QFM, it performs better than the single-step QFM sampling at every shot count. Both of our models are executed on IBM
quantum computers and best-of-N rejection sampling recovers most of the accuracy lost to device noise without modifying the
circuit. This is especially advantageous for QMF which has only one
circuit evaluation per image. Here, We establish QMF as a viable method for single-step
quantum generative sampling, saving on
quantum circuit evaluations per generated sample.
Read the full abstract ▾
Computer Vision
CC-4DGS: Computational Deformation and Point-Cloud Compression for Storage-Efficient Dynamic Gaussian Splatting
Kyungdae Park and Chae Eun Rhee
Dynamic four-dimensional (4D) Gaussian Splatting has emerged as a powerful explicit representation for high-quality view synthesis, yet existing methods still require tens to hundreds of megabytes per scene due to their heavy reliance on large multi-resolution hash tables and high-dimensional Gaussian attributes. This paper presents CC-4DGS, a storage-efficient and scalable framework that rethinks both deformation modeling and canonical attribute storage. First, we introduce a computational deformation field (CDF) that replaces large multi-resolution learnable hash tables with deterministic dense hash encoding and compact neural decoders, enabling on-the-fly synthesis of deformation features while reducing deformation storage to only 1–3 MB per scene. Second, we propose a compression of canonical point-cloud attributes (CCA) pipeline that compresses high-dimensional spherical harmonic appearance terms and auxiliary Gaussian attributes via conditional autoencoding, selective quantization, and residual codebooks, achieving 3–5$\times$ point-cloud reduction with negligible quality loss. Together, these components yield a unified representation that preserves real-time rendering performance while reducing total storage to 20–30 MB. Extensive experiments across the N3DV and Technicolor Light Field
datasets demonstrate that CC-4DGS achieves reconstruction accuracy comparable to state-of-the-art methods such as Swift4D, while offering significantly improved storage efficiency and favorable runtime-
memory trade-offs.
Read the full abstract ▾
Formal Languages and Automata · Cross-listed from q-bio.NC
Neural Logic, Invariance, and the Retina—McCulloch and Pitts
Nima Dehghani
This chapter reconstructs the McCulloch-Pitts program as a physics of neural computation rather than the familiar cartoon of a binary
neuron. The 1943 logical calculus is developed in both directions: given a net, characterize the propositions realized by its activity; given an admissible logical expression, construct a net that realizes it. We recover the original distinction between thresholded excitatory summation and absolute inhibitory veto-one the weighted-threshold form cannot preserve for arbitrarily large excitatory inputs-and read unit-time delay as the physical realization of logical depth. Recurrence is treated exactly: an autonomous, deterministic network of finitely many binary units has a finite state space, so every trajectory eventually enters a periodic orbit-a fact about finite-state dynamics, not unbounded Turing computation. A single threshold element realizes only linearly separable Boolean functions, whereas finite feedforward networks of them synthesize any Boolean function on a finite domain. We then follows McCulloch and Pitts beyond threshold logic. The 1945 heterarchy paper turns cyclic preference into an obstruction to representation by a scalar utility. The 1947 work on universals asks how a physical network can identify inputs related by nuisance transformations, developed here via group averaging and feedback canonicalization. The 1959 frog-retina study makes the adequate-stimulus question experimental, revealing parallel invariant operations before the
brain proper. Spike-triggered analysis shows how a nonlinearly driven
neuron can have a vanishing first-order average while second-order statistics recover its hidden selectivity: methodological failure can masquerade as physiological absence. Modern mathematical tools are used without projecting their notation onto the historical papers, and limitations of the idealization are stated explicitly.
Read the full abstract ▾
Computational Geometry · Cross-listed from math.CO
Helly-Type Theorems for Splitting Point Sets
Lidor Portal and Natan Rubin
Let $0 < \alpha \leq 1/2$. We say that a finite point set $P$ in $\mathbb{R}^d$ is $\alpha$-split by a hyperplane $h$ if each of the closed half-spaces determined by $h$, contains at least $\alpha |P|$ of the points of $P$. We further say $P$ is $\alpha$-split by a $k$-dimensional flat $\tau$ if $P$ is $\alpha$-split by any hyperplane through $\tau$. In the standard notation (which coincides with Tukey depth for $k= 0$), the $k$-flat $\tau$ has depth $\alpha$ with respect to $P$. We establish interesting Helly-type
theorems for splitting families of finite point sets in $\mathbb{R}^d$. Unlike the classical sufficient Helly-type criteria for transversals to families of compact convex sets, which exist only for point and hyperplanes, our results extend to splitting families of point sets by collections of $k$-flats of arbitrary dimensionality $ 0 \leq k \leq d-1$.
Read the full abstract ▾
Numerical Analysis
Error estimate of the nonuniform BDF3-L2 method for subdiffusion equations via multiscale solution decomposition
Wenlin Qiu, Kexin Li, Yiqun Li et al. (+1 more)
Numerical experiments reported by Quan and Wu [SIAM J Numer Anal 61 (2023) 2106-2132] show that the observed temporal convergence rates of nonuniform L2 methods for subdiffusion models are not consistent with the theoretically predicted order $3-\alpha$. This discrepancy suggests that a more refined analysis is needed and motivates the development of a nonuniform BDF3-L2 method for the subdiffusion equation. To account for the initial solution singularity, we employ the multiscale solution decomposition to decompose the original solution and approximate a smoother unknown variable that satisfies the subdiffusion model with a smoother source term. The resulting formulation, however, involves restrictive high-order boundary conditions on the source term and initial data. To overcome this difficulty, we introduce a spectral truncation technique that requires only slightly stronger regularity of the data and a controllable truncation error. We establish high-order regularity estimates of the solution to the truncated problem and develop a nonuniform BDF3-L2 method for its numerical approximation, based on which we derive a rigorous error estimate of temporal convergence order $2+\alpha$. Numerical experiments are carried out to substantiate the theoretical findings.
Read the full abstract ▾
All authors Wenlin Qiu, Kexin Li, Yiqun Li, Hao Zhang
Cryptography and Security
WeaveMark: Robust and Scalable Multi-bit LLM Watermarking via Coded Payload Spreading
Gang-Hyun Park, Ju-Hyeong Lee, Hee-Youl Kwak et al. (+1 more)
Multi-bit watermarking for large
language models enables content source tracing by
embedding user-identifiable messages into generated text. Existing methods face a fundamental trade-off among extraction accuracy, text quality, and payload capacity. We propose WeaveMark, a robust and scalable multi-bit LLM watermarking scheme based on coded payload spreading. WeaveMark shifts this trade-off frontier by improving payload capacity through multi-bit-per-
token spreading (weaving), improving extraction accuracy through soft-decision error-correcting codes, and preserving text quality through unbiased multilayer reweighting. It further introduces dedicated zero-bit layers for reliable watermark presence detection. Extensive experiments demonstrate substantial gains in extraction performance, especially for long messages and edited text, without degrading text quality. WeaveMark achieves an 89.8% match rate for 32-bit messages at 200
tokens, compared with 20.8% for BiMark. Under 10% substitution attacks on 16-bit messages at 200
tokens, it maintains 86.0% versus 30.7%. Code is available at https://anonymous.4open.science/r/WeaveMark-ED6F.
Read the full abstract ▾
All authors Gang-Hyun Park, Ju-Hyeong Lee, Hee-Youl Kwak, Dae-Young Yun
Systems and Control
Prosumer Synchronisation Risk: Impacts of Time-Varying Tariffs on Distribution Network Expansion
Dillon Zadoks, Alfredo Oneto, Carlo Tajoli et al. (+4 more)
The rapid deployment of distributed energy resources, including heat pumps, electric vehicles, photovoltaics, and battery storage, is reshaping the operation of low-voltage networks. While distribution system operators often aim to develop time-varying tariffs to incentivise network-friendly behaviour and defer reinforcements, they risk triggering prosumer synchronisation. As prosumers follow price signals, their behaviour may synchronise, avoiding existing load peaks while creating undesirable peaks at other times. This paper quantifies the impact on low-voltage network reinforcement needs when shifting from flat tariffs to two time-varying tariffs: Time-of-Use and Real-Time Pricing. Applying a mixed-integer linear model across 471 low-voltage reference networks in Switzerland, we evaluate expansion requirements under projections of distributed energy resource deployment for 2050. In the model, prosumers operate their distributed energy resources in accordance with their subscribed electricity tariff to minimise costs, and the distribution system operator subsequently optimises reinforcements. Our results demonstrate that while adopting time-varying tariffs can reduce reinforcement investment costs by more than 50%, high adoption rates can reverse this declining trend. Specifically, once prosumer adoption exceeds the optimal thresholds of 50% for Time-of-Use and 40% for Real-Time Pricing, reinforcement needs increase by 39% and 134%, respectively, for an additional 20% of tariff adoption.
Read the full abstract ▾
All authors Dillon Zadoks, Alfredo Oneto, Carlo Tajoli, Yi Guo, Philipp Heer, Giovanni Sansavini, Gabriela Hug
Computation and Language
Breadth Beats Depth: Improving GCG-Based Jailbreak Optimization with Breadth-Oriented Suffix Search
Shiliang Xiao, Jingsong Wei, Yuzhi Liang et al. (+3 more)
Optimization-based jailbreak attacks such as Greedy Coordinate Gradient (GCG) achieve strong effectiveness and transferability by optimizing
adversarial suffixes on white-box source models. However, existing GCG-based methods rely on averaged
adversarial loss and deep greedy search, which can over-emphasize easy-to-jailbreak behaviors and overlook promising regions of the suffix space. We propose BOSS, a plug-and-play framework that improves GCG-based jailbreak optimization through breadth-oriented suffix search. BOSS uses Tail-Focused
Adversarial Loss (TFAL), standard source loss, and behavior coverage to select terminal suffixes, then explores multiple short trajectories and selectively continues promising suffixes. Experiments on public
benchmarks show that BOSS improves attack success rates across multiple GCG-based methods while reducing optimization time.
Read the full abstract ▾
All authors Shiliang Xiao, Jingsong Wei, Yuzhi Liang, Yufan Zheng, Xia Li, Qiliang Lin
Computer Vision
Progressive Pseudo-Label Optimization for Point-Supervised Change Detection
Hailong Ning, Hao Wang, Yimeng Wang et al. (+3 more)
Point-supervised change detection (PS-CD) aims to identify pixel-level changes between bi-temporal images using only sparsely annotated points. Although point annotations substantially reduce labeling costs, their limited spatial coverage often results in incomplete and noisy pseudo-labels. To address this issue, we propose a two-stage framework that introduces SAM2 priors into PS-CD and progressively adapts them to the target task. In Stage I, SAM2 generates object-aware candidate masks from point annotations on the bi-temporal images, and a bi-temporal mask selection strategy is designed to convert generic
segmentation responses into more reliable change pseudo-labels. Subsequently, a lightweight CNN refinement module with an uncertainty-aware loss is employed to improve boundary quality and local structural consistency. In Stage II, we construct a teacher-student self-training framework in which the teacher is updated by exponential moving average and periodically refreshes the pseudo-labels. This design establishes a closed-loop optimization process that alternates between pseudo-label refinement and model re-optimization. Experiments on three
benchmark datasets, including WHU-CD, LEVIR-CD, and SYSU-CD, demonstrate that the proposed method outperforms previous weakly supervised approaches on most
benchmarks and remains competitive with several fully supervised methods.
Read the full abstract ▾
All authors Hailong Ning, Hao Wang, Yimeng Wang, Tao Lei, Renwei Dian, Asoke K. Nandi
Machine Learning
DMRL: Document-Mediated Reinforcement Learning for Skill Optimization in Advertising Recommendation
Wei Zhang, Hongji Li, Song Sun et al. (+4 more)
Advertising recommendation requires continuously tuning complex system parameters while balancing commercial returns and user experience. Recent work has introduced large
language models (LLMs) with skill documents to assist this labor-intensive process, but skill optimization remains largely
prompt-driven, lacking a principled mechanism to attribute rewards to specific document edits. To address this limitation, we propose Document-Mediated Reinforcement Learning (DMRL), a skill self-
evolution framework that models skill document optimization as a sequence of structured editing actions. In DMRL, an upper-level
agent performs controlled document edits, while a frozen lower-level task
agent evaluates their effects through A/B testing. To address credit assignment and long-term outcomes, we introduce two key components: (1) Dual-Relative Policy Optimization (DRPO), a post-training policy optimization method for robust and risk-aware advantage estimation; and (2) Long-term Reward Predictor (LRP), which estimates long-term outcomes by modeling population heterogeneity with disentangled representation learning and cross-
attention transfer. DMRL was deployed on a large-scale short-
video ads platform and extensive empirical evaluation shows that DMRL outperforms state-of-the-art baselines across key advertising metrics
Read the full abstract ▾
All authors Wei Zhang, Hongji Li, Song Sun, Peng Yu, Xue Yang, Lei Zhao, Peng Jiang
Artificial Intelligence
FUSE: An Evaluating Framework for Dangerous Capabilities of LLMs
Zhengyi Jin, Ru Zhang, Xiao Chen et al. (+5 more)
Fragmented safety evaluation undermines the governance of dangerous AI capabilities. We present a modular framework that evaluates each model through three orthogonal pipelines—Knowledge ($K$), Defense ($D$), and Harm ($H$)—under a unified protocol, aggregating results into a standardized dangerous-capability profile $\phi$. Pluggable modules supply scenario seeds, knowledge banks, hazard queries, and judge rubrics, while the core evaluation engine remains unchanged across domains; the CB evaluation is complemented by a cyber pilot demonstrating protocol transfer. Instantiating the framework with a chemical-biological (CB) module, we evaluate 12 commercial LLMs from four families. Our first contribution is a horizontal comparison of dangerous capability across models and model families: the three dimensions expose sharply divergent profiles—models with comparable knowledge differ in refusal resilience, and strong defenders do not generate less harmful content when they do comply—while family-level patterns further separate Claude, DeepSeek, and GPT models. The second is a temporal analysis of capability
evolution: tracking $K$, $D$, and $H$ against model release dates reveals that dangerous capability has not monotonically declined; newer models deepen knowledge while only partially improving defense, showing that scaling and
alignment progress do not uniformly translate into safety. Reliability is established via cross-judge consistency (bootstrap $\rho > 0.79$, 4 of 5 judges) and pipeline orthogonality ($K$–$D$–$H$ inter-correlations $\rho \in [0.32, 0.52]$).
Read the full abstract ▾
All authors Zhengyi Jin, Ru Zhang, Xiao Chen, Xinbo Liu, Jiaxuan Lin, Jia Huang, Jianyi Liu, Zhen Yang
Computation and Language
Do Cantonese-Adapted Language Models Better Predict Cantonese Reading? A Cross-Model Eye-Tracking Evaluation
Ziqi Zhang, Emmanuele Chersoni and Mohammad Momenian
Information-theoretic measures derived from autoregressive
language models are widely used to characterize the expectations that shape human reading, but whether
language-variety-specific training improves such psycholinguistic
alignment remains unclear. This question is still open for Cantonese, where recent NLP evaluations reported mixed benefits from Cantonese-specific training relative to Mandarin-oriented or general-purpose models. Using naturalistic Cantonese eye-tracking data, we compare two within-family adaptation contrasts: CKIP GPT-2 Tiny versus its lightly Cantonese-adapted JED351 derivative, and Qwen2.5-7B versus CantoneseLLM-7B, which underwent substantially more extensive Cantonese continued pretraining and instruction tuning. From each model, we derive lexical surprisal, POS surprisal,
entropy before the target, and
entropy reduction. Lexical surprisal and the joint four-metric model consistently favor CantoneseLLM-7B, followed by Qwen2.5-7B, CKIP, and JED351, whereas
entropy reduction favors CKIP. These results suggest that more extensive Cantonese-specific training can be associated with stronger predictive fit, while model rankings also depend on the information-theoretic measure being evaluated.
Read the full abstract ▾
Information Retrieval
GenCAR: Generative Counterfactual Alignment with Risk-Controlled Selection for Out-of-Distribution Recommendation
Qianqian Wang, Yunshan Li, Jiawen Zeng et al. (+2 more)
Serving useful recommendations under distribution shift is crucial for balancing utility and risk in out-of-distribution (OOD) recommendation. However, most existing OOD methods improve ranking or construct counterfactual candidates without controlling the proxy-label false discovery rate (FDR) of the served set. In this work, we formulate OOD serving as the $\alpha$-Valid Counterfactual Recommendation ($\alpha$-VCR) problem to retain candidate support learned from counterfactual supervision while controlling proxy-label FDR, and propose GenCAR, which couples preference-grounded counterfactual supervision with calibrated set selection. In particular, GenCAR fixes the stable-preference representation while intervening on the environmental factor, grounds offline large
language model proposals through preference anchors and trust-radius filtering, and uses conformal $p$-values for Benjamini–Hochberg selection. We theoretically bound conditional counterfactual approximation error and prove finite-sample, distribution-free control of proxy-label FDR under exchangeability and positive regression dependence, with a Benjamini–Yekutieli guarantee under arbitrary dependence. Extensive experiments audit realized proxy false discovery proportions and demonstrate that GenCAR consistently enhances OOD candidate recovery across diverse
benchmarks.
Read the full abstract ▾
All authors Qianqian Wang, Yunshan Li, Jiawen Zeng, Wenwu Gong, Lili Yang
Machine Learning
GeoSPRINT: Geometric Redundancy-Aware Step Pruning for Inference in Diffusion Trajectories
Arpita Joshi
Diffusion models achieve high sample quality but remain expensive at inference time because sampling requires many sequential neural function evaluations (NFEs). Existing acceleration methods either use fixed step-skipping schedules, adapt step sizes based on local numerical error, or require additional training. We introduce GeoSPRINT (
Geometric Step
Pruning for Inference in Trajectories), a training-free framework for constructing non-uniform sampling schedules from the geometry of denoising trajectories. GeoSPRINT detects geometrically redundant steps using a hyperplanarity test in latent space, implemented efficiently via QR factorization, and converts the resulting redundancy profile into a sampling schedule that allocates more steps to high-
curvature regions of the trajectory. In addition, we introduce the trajectory projection score $\alpha_{\mathrm{traj}}$, a residual-variance metric that quantifies trajectory straightness and serves as a model-free diagnostic for rectified flow quality. Across CIFAR-10 ($32{\times}32$), LSUN Church ($256{\times}256$), and Stable
Diffusion v1.5 ($512{\times}512$ latent), GeoSPRINT consistently improves over uniform DDIM (Denoising
Diffusion Implicit Models) schedules at matched NFE budgets. On CIFAR-10, GeoSPRINT improves FID (Fréchet Inception Distance) by 0.7-1.1 over DDIM across 49-89 NFEs and surpasses DPM-Solver++ at NFE${\geq}30$ despite using a first-order DDIM solver. On LSUN Church, it reduces FID from 1.48 to 1.26 at 52 steps, and on Stable
Diffusion v1.5 it achieves up to 1.93 FID improvement over DDIM. These results show that trajectory geometry provides a useful global signal for allocating inference steps and that schedule quality can substantially improve
diffusion sampling efficiency without retraining.
Read the full abstract ▾
Computer Vision
World-Coherent Decoding: Self-Verifying Test-Time Planning for World Action Models
Chuhan Zhang, Seiji Ito, Kenta Hoshino et al. (+2 more)
World Action Models (WAMs) aim to control
robots by stochastically generating visual futures and then decoding actions, but empirical observations indicate that the results can strongly depend on which future is selected. We propose World-Coherent-Decoding (WCD), a self-verifying test-time planning framework that treats WAM rollouts as falsifiable future–action hypotheses. At each decision step, WCD samples multiple candidates from a frozen WAM and ranks them using internal generative signals: flow-based
video surprisal for visual plausibility and action path effort for action-generation stability. After execution, the realized observation audits the selected imagination, yielding an imagination–reality mismatch that trains a lightweight online predictor for future candidate selection. Thus, WCD converts delayed self-verification into pre-execution reliability estimation without updating the backbone model. On RoboTwin 2.0, WCD improves Hard success under limited randomized-scene supervision from $55.80\%$ to $60.90\%$, with a $+16.43$ gains on Horizon-3 tasks, and shows qualitative robustness on real Franka visual-shift tests. These results highlight a simple principle: test-time scaling for WAMs depends less on sampling more futures than on selecting reliable ones.
Read the full abstract ▾
All authors Chuhan Zhang, Seiji Ito, Kenta Hoshino, Satoshi Ikehata, Ikuro Sato
Computation and Language
OBJECTION! Lawyer Agents Mitigate Guilty Bias in Legal Judgment Prediction
Jaehoon Jeong and Jay-Yoon Lee
Legal Judgment Prediction (LJP) models are typically trained on documents that describe facts from a prosecutorial perspective. Existing
datasets further exhibit severe label imbalance toward guilty outcomes. Consequently, these models suffer from "Guilty Bias", blindly accepting the prosecution's narrative as objective truth. Previous studies employing three-step
reasoning structures or training on synthetically generated innocence data improve overall accuracy, but they still fail to mitigate bias at inference time. In this paper, we introduce OBJECTION, an inference-time pipeline that integrates an
Adversarial Lawyer
Agent into each 3-step
reasoning of offense, unlawfulness, and culpability. Unlike generic critics, our
agent actively challenges the model's presumptions of guilt by injecting legal defense arguments at each
reasoning stage. To thoroughly evaluate this, we present a new "Natural Innocent"
dataset including 3.4k real-world cases, overcoming the limitations of synthetic innocence
benchmarks. Test results show that OBJECTION drastically reduces the False Guilty Rate (FGR) from 82.93% (SOTA baseline) to 16.69%, proving its capability to perform substantive legal
reasoning. This work denotes a key progress toward aligning Legal AI with the presumption of innocence.
Read the full abstract ▾
Robotics
Towards Effective Physical Reservoir Computing with a Pneumatic Soft Robot
Jeevan Hebbal Manjunath, Jun Wang, Suyi Li et al. (+1 more)
Physical reservoir computing (PRC) refers to the use of a physical dynamical system as a computational resource for tasks such as state estimation and control, but there has been a lack of formal study of design rules towards more effective design of such physical reservoirs. Using a pneumatic soft arm with a five-pouch sensing column, this work studies how the pouch interconnection
topology,
robot stiffness, and the number of instrumented sensors affect bending-angle estimation performance. Across 36 matched trials spanning waveform, baseline pressure of the sensing column, and actuation range, all designs are evaluated under the same-time bending-angle estimation
benchmark using 0.2 s of pressure history and a fixed ridge
estimator. Our analysis of the experimental results leads to three design guidelines. First, independently sealed pouches preserve a much richer observable state than a shared
manifold. Second, increasing the baseline pressure of the sensing column makes the pouch responses more redundant and increases estimation error most strongly in the coupled
topology. Third, in the sealed
topology, two strategically placed sensors already recover most of the attainable benefit, three capture essentially all of it, and additional sensors provide little or no additional value. In summary, the results suggest that
topology, stiffness, and number of instrumented sensors should be co-designed for accurate PRC of soft
robot states; stronger excitation alone cannot recover the diversity that poor design choices have already removed.
Read the full abstract ▾
All authors Jeevan Hebbal Manjunath, Jun Wang, Suyi Li, Wenlong Zhang
Machine Learning
Exact Limits of Random Projections for Preserving Geometry: Distance Recovery, Nearest-Neighbor Rankings, and Covariance Shape in Gaussian Models
Piyush Sao
The Johnson-Lindenstrauss (JL) lemma guarantees that a random projection of $n$ points to $m=O(\varepsilon^{-2}\log n)$ dimensions preserves pairwise squared distances within relative error $\varepsilon$ with high probability, and this dimension order is asymptotically optimal. In high dimensions, however, distances concentrate around a baseline while key
geometric information lies in much smaller fluctuations. We show that the JL bound can therefore be uninformative about retained geometry: an independent Gaussian replacement map can satisfy it even though the replacement cloud is independent of the original data. We then ask how well any decoder can recover a feature $f(D)$ of a squared distance $D$ from a linear sketch. Under squared-error loss, the optimal decoder is conditional expectation, so recovery defines a linear operator whose singular values quantify feature recovery. For isotropic Gaussian data ($\Sigma=\sigma^2 I_d$), we diagonalize this operator in closed form. For fixed $k$ with $m,d-m\to\infty$, its $k$th singular value satisfies $\ell_k\approx(m/ d)^{k/2}$. This yields three sharp consequences. A rank-$m$ sketch retains at most an $m/d$ fraction of the variance of any feature of one squared distance. If $m\to\infty$ and $m/d\to0$, the expected Kendall correlation is $\frac{2}{\pi}\sqrt{m/d}(1+o(1))$; for fixed $q$, nearest- neighbor agreement tends to $1/q$. Yet one projection can satisfy the JL bound while mean Kendall correlation vanishes when $\log n\ll m\ll d$. After removing scale, Haar-averaged retained covariance-shape information is $(m/d)^2$. Thus JL distance preservation does not quantify the geometry available for comparison or inference.
Read the full abstract ▾
Networking
WiP: Characterizing and Defending Against Mobile-Agent-Driven MFA Automation
Yimeng Liu and Hua Huang
Mobile
agents automate smartphone tasks by interpreting interfaces, interacting with apps, and coordinating cross-app workflows. This capability challenges the human-mediated separation assumed by passcode-based MFA, creating factor collapse: valid authentication factors are combined within one autonomous environment. Our modular pipeline com- pletes all 10 authorized MFA workflows, compared with 3/10 and 6/10 for two single-
agent baselines. We also de- velop a motion-based Android risk signal that distinguishes human- from
agent-driven logins with 98.4% table-top and 92.6% hand-held accuracy across 116 pilot sessions. These results demonstrate factor collapse and motivate physical- interaction sensing as complementary evidence of user pres- ence.
Read the full abstract ▾
Computation and Language
A Layered Taxonomy for Chinese Learner Grammatical Error Annotation
Mengyang Qiu and Jungyeul Park
Grammatical error annotation in Chinese learner writing requires labels that are both consistent and linguistically meaningful. This paper proposes a layered scheme linking computational Chinese grammatical error correction (CGEC) with pedagogical error analysis. The scheme first identifies character- and punctuation-level orthographic errors, labeling them by edit operation and subtype. Other errors receive a three-layer core label combining edit operation, linguistic domain, and part of
speech, with optional Chinese-specific extensions for aspect, modality, comparison, argument structure, and complements. Drawing on CGEC resources, learner-error taxonomies, and Mandarin grammar, the taxonomy is evaluated through a coverage analysis of automatically extracted MuCGEC edits and a preliminary consistency study in which five large
language models apply it to a sample. The results support the layered approach while identifying category boundaries requiring further refinement.
Read the full abstract ▾
Information Retrieval
Beyond Modality Harmony: Orthogonal Purification and Topology-Guided MoE for Conflict-Aware Multimodal Recommendation
Jialin Liu, Zhaorui Zhang and Ray C. C. Cheung
Multimodal Recommender Systems (MRSs) typically rely on a flawed "modality harmony" assumption, presuming that
multimodal features are inherently beneficial and strictly aligned with users' collaborative interaction patterns. However, modality-
topology conflicts are ubiquitous in real-world scenarios due to deceptive visual clickbaits and mismatched semantics. Blindly integrating these noisy modalities inevitably pollutes the pristine collaborative space, causing severe representation distortion. To address this, we propose Orthogonal purification and
topology-guided MoE for conflict-aware
multimodal Recommendation (OrthoRec). At its core, OrthoRec introduces Collaborative-Guided Orthogonal Purification (CGOP), which geometrically decouples
multimodal features into directions parallel and orthogonal to a pure collaborative anchor. By adaptively truncating the orthogonal noise with an energy-preserving normalization, CGOP rectifies deceptive semantic directions while preserving the modality's intrinsic representation capacity. Furthermore, we design a
Topology-Aware Routing Mixture-of-Experts (TAR-MoE). Guided by the collaborative
topology, TAR-MoE employs decoupled sigmoid gating to break the zero-sum bottleneck of traditional softmax
attention, autonomously determining the injection scale for each purified modality. Finally, a safe-SSL objective is introduced to dynamically penalize the forced contrastive
alignment of contradictory pairs. Experiments on three real-world Amazon
datasets show that OrthoRec consistently outperforms competitive recent baselines and exhibits improved robustness under modality noise and item sparsity.
Read the full abstract ▾