Computer Vision
Papers
Fresh from arXiv, typeset properly. Highlighted words trade on the market.
All of arXiv
Monday 28 September
Latent world models offer a promising way to improve Vision-Language-Action policies by capturing the consequences of actions. However, models trained primarily on expert demonstrations have limited exposure to failure outcomes and may struggle to distinguish visually similar successful and failed interactions. We propose WorldGuide, a framework that learns these distinctions in latent space and uses them to guide policy training. WorldGuide combines predictive pretraining on successful and failed trajectories with contrastive learning on matched success–failure pairs. The learned predictor then provides a differentiable reward to guide joint optimization of the policy and visual encoder. The predictor is discarded after training, so deployment requires no additional world-model inference. Extensive experiments show that WorldGuide substantially improves VLA reliability and achieves state of the art performance on LIBERO 100 and SimplerEnv, reaching 96.8% and 72.0%, respectively. Code will be publicly available.
Machine Learning
Learning to Optimize through Solver-Grounded Self-Play
Optimization modeling is central to many decision-making scenarios, but traditionally requires extensive domain expertise. While Large Language Models (LLMs) have shown promise in automating this process, current training paradigms mainly rely on human-annotated or teacher-generated datasets. This dependence introduces a Generalization Ceiling, where models overfit to narrow data distributions, and Capability Anchoring, where models' reasoning is bounded by annotator proficiency and teacher model capability. In response, we propose OPT-Zero, the first fully self-play training framework for optimization modeling that requires zero external training data. OPT-Zero employs a single LLM in a dual-role closed loop: a Proposer that synthesizes increasingly challenging optimization problems alongside their mathematical formulations and solving code, and a Solver that attempts to resolve the problems given only natural-language problem descriptions. Grounded in execution feedback from external optimization solvers, we alternately train both roles using reinforcement learning. This process fosters an auto-curriculum in which the Proposer and Solver co-evolve: generating harder valid problems by the Proposer seamlessly enhances the structural reasoning ability of the Solver. Extensive results indicate that with zero curated data, OPT-Zero matches state-of-the-art data-dependent methods while exhibiting substantially stronger generalizability, establishing self-play training as a highly scalable paradigm for advancing LLM reasoning in modeling and solving optimization problems.
Read the full abstract
Analysis of PDEs
Unique continuation, nonexistence and bubbling for the critical $p$-Laplace equation in the plane
For $1<p<2$ we prove weak and strong unique continuation properties for the solutions to $\Delta_pu+f(u)=0$ in a planar domain, with $f$ continuous and such that $|f(s)|\leq C|s|^{p-1}$: a solution vanishing on an open set vanishes identically, and so does a solution vanishing to infinite order at a single point. We can therefore make progress towards a proof of some long-standing nonexistence results available only for $p=2$, such as a celebrated one of Esteban and Lions, establishing here that for the critical $p$-Laplace equation with zero Dirichlet boundary condition on a half-plane, there are no nontrivial finite energy solutions. In the plane, unique continuation thus provides the missing ingredient for a generalisation to the $p$-Laplacian operator of a classical result of Struwe on the bubble-profile decomposition of possibly sign-changing Palais-Smale sequences associated to the Brezis-Nirenberg problem, which remains open in dimension $N\geq3$ for $p\neq2$. We obtain a characterisation of their loss of compactness in terms of the finite energy solutions of $\Delta_pu+|u|^{p^*-2}u=0$ in $\mathbb R^2$.
Read the full abstract
Representation Theory
Quasi-cellular categories and the structure of the Brauer category
We introduce the notion of a quasi-cellular category, which is a variant of cellular algebras and cellular categories. Many diagram categories, such as the Brauer category and the partition category, are quasi-cellular. We study the Brauer category $B$ over a commutative ring $\mathbb k$ with parameter $\delta$ through its quasi-cellular structure. We construct a linear functor $L:B\to mB$ to the matrix Brauer category $mB$, which has the same objects and hom-spaces as $B$ but a matrix-like composition. For a non-singular parameter $\delta$, we show that $L$ is an isomorphism of linear categories, and that $B$ is Morita equivalent to its subcategory $\mathbb S$ spanned by permutations, whose endomorphism algebras are the group algebras of symmetric groups. These results generalize those of Brown and König and Xi for the Brauer algebras.
Read the full abstract
Analysis of PDEs
Nonlinear Stability of Nonconstant Steady States in Chemotaxis–Consumption Systems with General Motility
We prove nonlinear stability of positive nonconstant steady states for a chemotaxis–consumption system with nutrient-dependent motility and a fixed boundary nutrient concentration $b$. The motility satisfies two monotonicity conditions met by power laws and saturating functions. For each prescribed population mass, sufficiently large nutrient diffusivity $D$ yields a unique positive steady state. Small compatible perturbations generate unique global solutions converging exponentially to the steady state with their conserved mass. The result holds on general bounded domains in two and three dimensions, with a lower-regularity version on an interval. At order $D^{-1}$, the nutrient deficit is the torsion function multiplied by the mean population density and boundary nutrient value; the population contrast also depends on $\kappa_b=b\phi'(b)/\phi(b)$. Computations illustrate relaxation from compatible data and convergence to different steady states when the initial mass changes.
Read the full abstract
Quantum Physics
Quantum memory in an effective $\Lambda$-type system using dynamic detuning control of a superconducting qubit pair
We theoretically investigate quantum-light storage in an effective $\Lambda$-type system formed by a pair of tunable superconducting qubits coupled to a semi-infinite transmission line and separated by half a wavelength. The frequency detuning between the qubits directly couples the superradiant excited state and the subradiant metastable state. By adjusting the qubit detuning, the system exhibits a controllable spectral response accompanied by slow-light behavior. Dynamically controlling the detuning enables an incident quantum field to be mapped onto the subradiant collective state, stored as a long-lived excitation, and subsequently retrieved on demand. Our results establish the proposed system as a minimal and tunable quantum-memory architecture for scalable superconducting quantum networks.
Read the full abstract
Quantum Physics
Nakayama's reduction of quantum topos and Bayesian quantum computing
Nakayama found the way to limit the contexts in the Döring-Isham topos quantum theory and unified such limitation and the definition of probability as a single choice of topology. We explain how this unification supports the Bayesian perspective where the probability changes as data is obtained. We describe this change as a local shift of the applicability of a predictive theory and apply it to quantum computing.
Read the full abstract
Robotics
WB-WAM: Heterogeneous Body-Hand Pre-training for Humanoid Loco-Manipulation
Humanoid loco-manipulation demands coordinated body and hand behavior, while conventional robot pre-training data provide limited coverage of such whole-body motion. We present WB-WAM, a World Action Model that incorporates explicit whole-body action supervision into generative video pre-training. A shared physical action space integrates body, root, and dexterous hand annotations from heterogeneous sources, enabling joint video and action learning from 1880.2 hours of partially annotated video and motion data. The resulting priors are refined through PICO mid-training and adapted to robot tasks with auxiliary forward kinematics supervision. We construct WB-Datasets to support these stages with retargeted egocentric human demonstrations and robot trajectories, allowing task-aligned human motion to supplement limited robot data. Evaluations in simulation demonstrate strong whole-body task performance with 81.9% in HumanoidArena, while real-world experiments further validate WB-WAM with 84.0% mean success across five tasks. Moreover, task-aligned PICO mid-training improves downstream task performance while reducing the need for real-robot demonstrations. These results support heterogeneous whole-body pre-training and human motion transfer as a practical route to data-efficient humanoid loco-manipulation.
Read the full abstract
Machine Learning
Frozen Judges, Moving Agents: Version-Dependent LLM-Judge Error and the Limits of Judge-Assisted Agent Evaluation
Language-model judges compare agent upgrades with their predecessors, but a fixed judge can make version-dependent mistakes. We analyze 35 public coding-agent submissions (20 prespecified version pairs on 250 SWE-bench Verified issues), two customer-service agents (155 tau-bench tasks), and 1,106 expert-labeled AgentRewardBench trajectories. An upstream outage left three judges for the primary SWE-bench analysis (8,743 aligned cells); the fourth is descriptive. All three coding-agent judges and all four tau-bench judges reject task-conditioned error invariance after multiplicity adjustment. On SWE-bench, 32 of 60 judge-by-pair units have a detectable differential comparison component; eight judge-only intervals declare upgrades that execution-based intervals cannot establish, despite rank correlations of 0.71-0.79. In tau-bench, one judge reverses a nine-point reference-reward gap by penalizing a procedural habit the reward ignores. False acceptance of failed coding patches rises with agent capability conditional on task and execution outcome, while a task-solvability prediction reverses sign across domains. A separately fixed post-submission OpenHands follow-up on the same 250 issues (eight configurations, 1,981 three-judge cells) reproduces the capability/false-acceptance association (mean Spearman +0.944, exact p=0.000099) and decreasing Youden contrast (mean -0.937, p=0.000397); this is observational, not a new-task replication. Transporting old-version calibration raises SWE-bench comparison error from 3.8 to 19.5 points, with 24.6% undefined bootstrap ratios. A paired audit saves only 5% in interval width at 80 labeled tasks. A randomized self-report test is negative (three adjusted p-values=1.0). These results favor paired audits of current outputs over judge-only release decisions or transported calibration; independent human patch review remains pending.
Read the full abstract
Optimization and Control
Regular simplex tensors: optimization landscape, conjecture proof, and beyond
The concept of tensor eigenpairs has attracted increasing research attention in the past decades. Recent works have focused on a special class termed regular simplex tensors, which are constructed from an equiangular tight frame of n vectors in (n-1) dimensional space for n >= 3 and order m >= 3. Existing works focus on analyzing the robustness of eigenpairs obtained by the tensor power method. At the end of that work, a conjecture was made that if they exist, the only robust eigenvectors of a regular simplex tensor, up to sign equivalence, are the vectors in the regular simplex frame. A subsequent study theoretically proved that this holds for the simplest triangle case where n = 3. However, for cases with higher n, the process becomes complicated in both checking all eigenpairs and determining the explicit formula for the robustness criterion. In this paper, to deal with this issue, a connection between robust and locally optimal eigenpairs is built, recognizing the latter as another pivotal concept in the field of optimization. Then, we turn to checking the local optimality of all eigenpairs, for which we have developed an efficient model with a favorable structure that facilitates the enumeration of all eigenpairs and delineates the optimization landscape for the model. Then, integrating the two advances enables us to narrow the scope of the robust eigenpairs to those locally maximized ones, which are exactly the vectors in the regular simplex frame. Finally, the proof of the conjecture reduces to only examining the vectors in the frame, whose robustness can be easily checked for any higher n and m. This work shows that, up to sign equivalence, excluding the exceptional cases (m, n) = (3, 3)/(3, 4)/(4, 3) where no robust eigenpairs exist, the only robust eigenvectors of a regular simplex tensor are the vectors in the regular simplex frame.
Read the full abstract
Computer Vision
ConvCue: Complementary Visual Inductive Biases for Vision-Language Models
Modern vision-language models (VLMs) achieve strong performance across a broad range of multimodal tasks, yet still struggle with visual questions that require fine-grained discrimination and spatial understanding. These limitations motivate investigating whether supplementary visual representations can improve existing VLMs without replacing their native visual encoders. Pretrained convolutional networks offer a candidate feature source, motivated by their local connectivity and spatial weight sharing. We introduce CONVCUE, which augments the native visual representations of a pretrained VLM with final-stage features from a parallel, frozen pretrained CNN. A learnable adapter maps convolutional features to the native visual feature dimension, while gated cross-attention allows the original visual tokens to retrieve information from the CNN features. The enhanced tokens are passed through the original visual-to-language projector, and the model is adapted through a two-stage training procedure. We evaluate CONVCUE on Qwen3-VL-2B, Qwen3-VL-4B, and LLaVA-OneVision-7B across 13 multimodal benchmarks covering visual question answering, document and chart understanding, and multimodal reasoning. CONVCUE improves average benchmark performance over both the original models and matched two-stage fine-tuning controls on all three backbones. On Qwen3-VL-4B, it improves over the original model on all 13 benchmarks and raises the average score from 75.00 to 78.82 relative to the matched fine-tuning control. These results show that pretrained convolutional representations, when integrated through learned adaptation and fusion, can improve the visual understanding of existing VLMs without replacing their original visual encoders.
Read the full abstract
Artificial Intelligence
PainterBench: A Figural Divergent-Thinking Benchmark for Tool-Using Language Models
Figural divergent thinking is the ability to develop a given shape fragment into an original drawing. In humans, this ability is assessed with incomplete-drawing tasks. We introduce PainterBench, a benchmark that ports the incomplete-drawing task to the agentic setting. The agent draws on a canvas through tool calls and observes the result after every turn. The canvas includes a starting shape which cannot be erased, and the agent's goal is to incorporate this shape into the most original drawing it can produce. The task is open-ended, and the agent itself decides when the drawing is finished. The benchmark tests incremental visual planning over a short horizon and the transfer of creative ability from pretraining to multi-turn tool use. We evaluate 14 multimodal language models from small to frontier scale. Across the primary study and six sensitivity analyses, we collect 2,700 drawings and crowdsource creativity and recognizability ratings for every drawing and for 300 human reference drawings. We also present ViDrA-adapted, an automated scorer that predicts human creativity ratings of agent drawings (r = 0.85 on random held-out test split). Figural divergent thinking varies widely across the 14 models, and GPT-6 Astra produces the most creative drawings. Relative to the human drawings, the agent drawings score higher in creativity but lower in recognizability. We release the final drawings, per-round canvas snapshots, tool call traces, stimulus bank, benchmark harness, crowdsourced ratings (N = 72,000), and ViDrA checkpoint.
Read the full abstract
Chemical Physics
Machine-learned Laplacian-level density functional from exact exchange-correlation potentials and energies
We present NNLap, a machine-learned Laplacian-level exchange-correlation (XC) functional that augments PBE with a neural-network correction depending on the electron density, its gradient, and its Laplacian. The model is trained on exact XC potentials and energies, obtained through inverse density-functional theory (DFT) calculations on configuration-interaction densities. Despite training on only a few systems – five atoms and three molecules – the model achieves remarkable accuracy on thermochemistry benchmarks, competing with the meta-GGA functionals SCAN and r2SCAN. It also attains accurate total energies, comparable to SCAN and better than r2SCAN and B3LYP. This shows that a Laplacian-level model, trained on exact XC potentials and energies, can reach the accuracy of meta-GGAs without their orbital dependence.
Read the full abstract
Rings and Algebras
A proper dg algebra which does not cogenerate
Keller's strong form of the homological conjectures asserts: any finite dimensional algebra cogenerates its unbounded derived category of modules. Here we record an example of a (coconnective) dg algebra with finite dimensional cohomology, which does not cogenerate its module category, along with some related phenomena: a smooth dg category whose dualizing bimodule fails to be nondegenerate, and a nontrivial fully faithful left Calabi-Yau morphism. All examples and most proofs were produced by ChatGPT. In an appendix we explain the reason we were looking for such examples: their existence would follow from the existence of Weinstein symplectic manifolds which failed to satisfy Arnol'd's chord conjecture.
Read the full abstract
Information Retrieval
RidgeRank: Efficient Visual Document Reranking via Score Fusion and a Shallow Linear Readout
Multimodal language models rerank visual document retrieval results accurately, but scoring every candidate page at full cost makes them slow. Some methods that compress these rerankers need relevance labels to regain accuracy, and they rank by the reranker score alone. RidgeRank measures how much relevance signal the reranker score lacks and recovers it from the retriever score through a closed-form fusion rule. Maximizing a correlation objective gives the optimal fusion weight, along with the exact condition under which the reranker score by itself cannot reach that optimum. The reranker is further corrected by a single vector applied to an intermediate hidden state, obtained through one centered ridge regression onto the same model's full-depth scores on uncompressed pages. On 12 datasets drawn from ViDoRe 2 and ViDoRe 3, evaluated with two retrievers and two language model backbones, RidgeRank brings NDCG@5 to within 1.2 pp of a full cross encoder with speedups of up to 48 times, advancing the accuracy and latency Pareto frontier for visual document reranking.
Read the full abstract
Machine Learning
Cardinality-Stratified Interaction Decomposition for Interpretable Pairwise and Higher-Order Structure in Transactional Basket Data
Transactional basket data can reveal associations among items, but observed co-occurrence conflates item-specific relations with basket-size structure and unmodeled higher-order dependence. We introduce Cardinality-Stratified Interaction Decomposition (CSID), an interpretable framework that decomposes log-odds contrasts stratified by the number of remaining items into item-set-specific and cardinality-common components, without fitting a global joint distribution. CSID uses an information-weighted, gauge-constrained ridge projection to estimate pair and triple components and to diagnose higher-order contributions to pairwise structure. CSID is designed primarily for interpretable decomposition of association structure rather than for full-distribution prediction. In a simulation with zero pair effects, increasingly strong small-basket cardinality potentials drive ordinary Ising couplings spuriously negative, whereas CSID pair estimates remain centered near zero. Detection power rises with the magnitude of planted triple effects, and local deprojection reduces pair-coefficient RMSE from 0.244 to 0.073. Across three grocery datasets, high-information triple components are reproducible over time. In the matched cross-period partial-transfer evaluation, transferred CSID triple components show closer agreement with later-period stratified contrasts than the nodewise-symmetrized cardinality-aware higher-order pseudolikelihood comparator, with gains in weighted Lin's concordance correlation of 0.038–0.122. These results support CSID as an exploratory and interpretable decomposition framework for pairwise and higher-order association structure in transactional data.
Read the full abstract
Computer Vision
MotionSpaceFlow: Representation-Aware Flow Matching in Direct Motion Space
Recent advances in diffusion and flow models have substantially improved text-driven human motion generation. Yet most methods generate in low-dimensional, temporally downsampled latent spaces learned primarily for reconstruction, a bottleneck that can limit generation quality and preclude direct manipulation of individual frames and joints. We introduce MotionSpaceFlow (MSFlow), a representation-aware flow-matching framework that predicts clean motion directly in continuous motion space without a learned encoder or decoder. To account for the anisotropic structure of direct motion representations, we propose representation-aware noise scaling and show how the initial Gaussian source scale governs the covariance of intermediate probability-path marginals. We further introduce a Representation-Aware Multimodal Diffusion Transformer (RA-MMDiT), which jointly updates token-level language and full-resolution motion features through joint attention while adapting temporal information flow to the motion representation: causal attention for incremental features defined by frame-to-frame changes, and bidirectional attention for global features such as absolute joint coordinates. Across different datasets and motion representations, MSFlow achieves state-of-the-art text-to-motion performance. Its global representation variant additionally enables zero-shot, inference-time control over any joint or frame through projection sampling without control-conditioned training, delivering leading motion quality with exact constraint satisfaction.
Read the full abstract
Astrophysics of Galaxies
Morphological Statistic of Milky Way-like Galaxies
We analyze the spiral morphology of 1,738 nearby galaxies with similar Hubble type of the Milky Way ($i<60^\circ$, $z<0.048$) using multi-band optical images from the Sloan Digital Sky Survey and Digitized Sky Survey. Multiple-arm systems dominate, comprising $\sim$50-60% of the sample and $\sim$75% of large galaxies ($d_{\rm max} \geqslant 18~\mathrm{kpc}$). In $90\pm3$% of multiple-arm galaxies, two inner arms extend into multiple outer arms; three-arm inner structures occur in $9\pm2$%, and four or more are rare ($<1$%). Morphology and inner-arm counts are consistent across bands at $\sim$80%. Bifurcation points, marking the transition from two inner arms to multiple outer arms, occur in up to $\sim$40% of galaxies, are more prominent in bluer bands tracing younger stellar populations, and cluster within 4-7~kpc of galaxy centers. These statistics suggest that the Milky Way's inner two-arm and outer multiple-arm morphology, including bifurcations at similar radii, is broadly consistent with that of a typical multiple-arm spiral galaxy.
Read the full abstract
Machine Learning (Statistics)
AlphaPareto: Formulaic Alpha Discovery with LLM-Guided Multi-Objective Reinforcement Learning
Formulaic alpha discovery is a core challenge in quantitative trading, as identifying alphas that work well together remains difficult. Recent reinforcement learning (RL) methods formulate this task as a Markov decision process (MDP), but two important issues remain unresolved. First, as the alpha pool evolves, the reward function changes accordingly, making the MDP inherently non-stationary. Second, most existing methods optimize a single objective, typically predictive power, while ignoring other important properties of a high-quality alpha pool. Motivated by these challenges, we propose AlphaPareto, an RL method for formulaic alpha discovery. To address non-stationarity, AlphaPareto augments the state to include both the alpha under construction and the current alpha pool, and applies a large language model (LLM) to encode the pool. This design allows the agent to adapt to the evolving search environment. To overcome the limitation of single-objective reward design, AlphaPareto replaces the scalar reward with a multi-objective vector-valued reward that simultaneously captures predictive power, temporal stability, perturbation robustness, and diversity, and optimizes these objectives through a Pareto-regularized learning procedure. Empirical applications to real-world datasets show that our AlphaPareto method outperforms its competitors.
Read the full abstract
Computation and Language
LLMs are not stochastic parrots: Evidence for meaning-mediated abstraction from conlang-like tasks
The strong version of the stochastic parrot argument claims that, although large language models (LLMs) may exceed rote regurgitation, they cannot move beyond statistical pattern matching into abstraction or reasoning, remaining ontologically near the lower bound of pattern reuse despite producing alluringly fluent text. We test this hypothesis using conlang-like tasks. Several LLMs are given only natural-language descriptions of fictional languages that subvert prominent superficial patterns in training data by combining statistically uncommon and unattested features. Crucially, no example outputs are given. We argue that if the models exhibit rule-following behaviour, they cannot be relying solely on superficial statistical patterns; such patterns often work against the correct output. Instead, successful performance requires representations of the constraints specified in the prompt. Across three complementary task families, models systematically move in the meaning-predicted direction: they distinguish prompt exposure from instructed use, alter semantic relationships in response to novel constraints, and sometimes produce exact matches to complex translation answer keys. Although performance varies across the spectrum of models used, these results provide evidence for meaning-mediated abstraction in LLMs and refute the strong stochastic parrot hypothesis. Our work shows that, under appropriate architectural and contextual constraints, statistical learning can produce meaning-mediated abstractions, although generation remains strongly constrained by superficial plausibility. We discuss implications for model development and for understanding how increasingly abstract representations may emerge from plausible-text-generation objectives.
Read the full abstract
Molecular Networks
An interactive simulator for integrating biochemical models with experimental data
Biological models based on mathematical simulations (e.g., ordinary differential equations) are hugely beneficial for understanding biological processes and predicting the outcomes of experiments. Such models are built using a variety of sophisticated modeling tools. Unfortunately, the complexity of these tools is often a barrier to use by experimental biologists. To improve the usability and impact of biological models, we have created a desktop platform (DeskIridium) and a web-based simulator (WebIridium, hosted as a GitHub page) that, in combination, provide features that promote ease of use by experimental biologists, including: human-readable editing of models via the Antimony syntax; sliders for adjusting parameter values while simultaneously displaying simulation results in real time; zero-install distribution; AI chat integration; and generation of standalone Python implementations of SBML models to support reproducibility. The desktop version uses the well-established libroadrunner simulation package; the web-based application uses an Emscripten translated version of COPASI. Both simulators are SBML-compatible, allowing users to easily import previously built models or edit existing models using the easy-to-use antimony language. We used modern AI methods for software development and share the lessons we learned. Binaries, source code, and the web interface are available at: https://github.com/sys-bio/IridiumSimulator and https://github.com/sys-bio/WebIridium.
Read the full abstract
Machine Learning
EntroPack: Fast and Accurate Entropy-Coded Weight Compression at Arbitrary Bitrates
Weight compression helps large neural networks fit deployment memory budgets, but common fixed-width formats offer only coarse storage choices. Entropy coding supports finer rates, yet the achieved size depends on the quantized weight distribution and coding overhead. Exploiting this flexibility requires accurate rate selection and efficient weight reconstruction for inference. We present EntroPack, an entropy-coded weight compressor that supports arbitrary target bitrates without activation calibration or fine-tuning. It combines row-normalized $E_8$ lattice quantization with a conditional probability model of lattice coordinates. Sampled storage estimates select the quantization resolution without repeated full-stream encoding. The final coordinates are entropy-coded in independently decodable tiles, enabling fast, fused symbol decoding and numerical weight reconstruction on the GPU. EntroPack supports floating-point and integer weight containers, such as BF16, FP16, FP8, and INT8, with storage bitrate controlled independently of numerical precision. Online decoding adds latency that grows with weight count, making the method well suited to compute-intensive workloads such as diffusion denoising and Transformer prefill. Experiments demonstrate fast encoding and modest inference overhead in these settings. When compressing the linear-layer weights of the image generator Z-Image-Turbo, EntroPack achieves substantially lower weight and denoiser output errors than fixed-width formats at comparable storage rates, with modest denoising-step overhead. Targeting 4 bits per parameter, it achieves lower weight and denoiser output errors than NF4, including about 24% lower relative $L_2$ weight error, with less storage. Source code is available at https://github.com/modelscope/entropack.
Read the full abstract
Artificial Intelligence
CASS: Contribution-Aware Structured Sparsity for Model Merging
Model merging integrates task-specific fine-tuned models into a single multi-task model, but often suffers from parameter interference caused by conflicting task-vector updates. Existing methods typically mitigate conflicts by pruning task vectors based on weight magnitude or random heuristics, treating Transformers as unstructured “bags of parameters” and overlooking their inherent modularity. In this paper, we propose Contribution-Aware Structured Sparsity (CASS), a unified framework that reduces parameter interference by identifying and preserving task-specific components. At the core of CASS is a contribution-aware structured mask that identifies task-relevant attention heads and FFN neurons. We instantiate this mask in two settings: CASS-Merging, the primary post-hoc setting where masks serve as a plug-and-play denoising filter for existing merging operators, and CASS-Tuning, an extension for scenarios with fine-tuning access where masks constrain gradients to reduce structural overlap between task vectors. Our analysis shows that task-relevant components are sparse and partially disjoint, supporting structured component-level filtering as an effective way to reduce merging interference. Extensive experiments across vision (ViT, 20 tasks) and language (RoBERTa, 8 tasks; Qwen2.5, 4 tasks) benchmarks demonstrate that CASS improves a range of representative merging baselines.
Read the full abstract
Computer Vision
CRF Loss is How Networks Should Learn Boundaries in Weakly Supervised Segmentation
Weakly Supervised Semantic Segmentation (WSSS) learns pixel-level predictions from image-level tags. Recent work focuses on improving coarse CAMs extracted from large vision-language models (commonly CLIP), but does little to improve their accuracy along segment boundaries. That job is instead delegated to a post-processing method like DenseCRF. However, because DenseCRF relies on low-level colour cues, it can flip correct labels to incorrect ones when neighbouring pixels share similar colours. SAM has recently been adopted as a natural alternative, yet it simply takes on DenseCRF's role as an intermediate "refinement" step that outputs one-hot pseudo-labels in prior work. By discarding the valuable uncertainty in CAMs, these one-hot pseudo-labels turn borderline errors into confidently wrong targets. Our key insight is that CAMs should supervise training alongside SAM boundaries, each through its own loss, rather than being fused together into a single hard target. Inspired by CRF potentials, we propose a framework that disentangles soft pseudo-labels as unary supervision and binary edge maps as pairwise supervision. We realize our framework in a single-stage model, DS-CRF, using CAMs from dino.txt and boundaries from SAM. DS-CRF sets a new state-of-the-art of 56.5% mIoU on MS COCO among training-based methods.
Read the full abstract
Robotics
Unified Visual-Tactile-Action Modeling from Human Demonstrations for Dexterous Manipulation
Dexterous manipulation requires tactile feedback. However, robot tactile demonstrations are difficult to scale,because dexterous-hand teleoperation provides limited tactile feedback to the operator. In contrast, human demonstrations offer a substantially more scalable source of diverse tactile interactions. Motivated by a simple premise: hands can change, but the underlying physics of interaction does not. We leverage human tactile data to improve dexterous manipulation policies. Specifically, we first build a tactile motion-capture system that synchronously records images, tactile signals, and hand motions. Using this system, we construct the UVTA dataset spanning five contact-rich tasks, with 1,000 human demonstrations covering diverse interaction patterns and 150 robot demonstrations per task. To transfer the underlying physics of human interaction to robot control, we propose a Unified Visual-Tactile-Action Model that maps both embodiments into aligned tactile and action representations and jointly predicts future action and tactile trajectories. The joint objective enables human demonstrations to supervise contact-aware representation learning, while only robot actions are executed during deployment. In real-robot evaluations across five tasks, our method achieves an average success rate of 70%, outperforming the strongest visual-tactile baseline, which achieves 29%, and an architecture ablation, which achieves 42%. Performance improves consistently with additional human demonstrations and exhibits no saturation at 1,000 demonstrations per task, validating the effectiveness of scalable human tactile data for dexterous manipulation. Project page is available at https://uni-vta.github.io/.
Read the full abstract
Artificial Intelligence
Efficient Reasoning via Constrained Optimization in Latent Space
Large Reasoning Models (LRMs) have shown remarkable reasoning capabilities, yet they still suffer from overthinking, generating redundant reasoning steps which incur substantial token consumption. Existing methods, such as suppressing reflective keywords or forcing shorter reasoning lengths, attempt to mitigate this issue but inevitably truncate necessary steps and induce underthinking, thereby compromising performance. To address this dilemma, we investigate the latent representations and observe that efficient reasoning steps naturally cluster into a concentrated region in latent space, while those deviating from this region tend to produce verbose sequences. To leverage this, we keep reasoning focused within this region via a quadratic program which projects deviating hidden states back into the region. Then we propose a novel training-free framework to achieve efficient reasoning that reduces token generation costs without sacrificing performance. Extensive experiments conducted on four models ranging from 1.5B to 14B, and across six benchmarks in math reasoning, coding, and scientific QA, validate the effectiveness of our method, up to a 12.1% improvement in accuracy while reducing generated tokens by 11.8% to 52.8%. Codes are available at \href{https://github.com/hzn18/Opt4Reasoning}{https://github.com/hzn18/Opt4Reasoning}.
Read the full abstract
Artificial Intelligence
Decision Readouts for Text-Mediated Video Anomaly Detection: An Exploratory Evaluation of Jev and Qwen
How much does the decision readout matter when video-derived textual evidence is held fixed? We evaluate Jev typed decisions and three Qwen readouts on a sparse development sample of 40 videos and 400 target anchors from UCF-Crime and XD-Violence, each presented as a summary and ordered captions. Each dataset contributes 20 source groups and 200 anchors, including only 10 and 37 positives, respectively. The original five-backend pilot requested 4,000 predictions; Jev Choice returned 776 valid responses out of 800 under the study's strict numerical policy, blocking its full-coverage quality comparison. On XD captions, Jev Noul achieved 75.99% average precision versus 48.47% for Qwen generated probability and 57.81% for the stronger local ordinal-likelihood expectation. The latter paired difference was 18.18 percentage points (95% source-group bootstrap interval 5.53-31.50). UCF did not show a corresponding advantage: caption ROC-AUC was 52.26% for Noul and 65.95% for ordinal likelihood. Both probability readouts had higher, hence worse, UCF Brier scores than the evaluation-prevalence reference of 0.0475. We additionally audit historical LAVAD scores at exactly matched anchors and distinguish response structure from numerical consistency. A binary-likelihood control is missing. These exploratory offline results characterize ranking, probability quality and interface failures; they establish neither a causal typed-interface benefit nor general superiority, calibration or end-to-end acceleration.
Read the full abstract
Artificial Intelligence
RAGWarrant: Evidence-Preserving Governance for RAG Policy Promotion Under Quality, Cost, Latency, and Risk Constraints
Retrieval-augmented generation systems are extensively instrumented with metrics, benchmarks, traces, and automated judges, but these tools do not decide whether a proposed policy change is safe to release. We present RAGWarrant, an open-source promotion-control framework that treats deployment as a constrained evidence decision rather than a leaderboard choice. RAGWarrant normalizes evaluator outputs and operational telemetry, applies predeclared quality and hard-risk gates, assigns evidence-class claim ceilings, preserves negative outcomes, and emits auditable PROMOTE, BLOCK, REJECT, or INCONCLUSIVE decisions. We evaluate the framework across T2-RAGBench, MultiHop-RAG, CRAG, HotpotQA, synthetic reproduction, and bounded local generative experiments. On HotpotQA, operational savings were blocked because answer quality fell beyond the declared margin. A bounded CRAG study selected a lower-cost quality-tied policy, but related generative gains were unstable and a held-out guardrail failed closed. We claim an auditable promotion-control abstraction, not optimizer superiority, human validation, or production readiness. The tagged artifact reproduces from a fresh clone, runs as a hardened Docker job, accepts external evaluator exports, and verifies artifact integrity.
Read the full abstract
Computer Vision
Enhanced Video Text Editing with Trajectory-Aligned Glyph Rendering
Video text editing aims to replace or add text in a video while keeping the rest of the video unchanged, which requires the edited text to be correct in every frame and to move coherently with the scene. Despite the remarkable progress of video diffusion models, they struggle to reproduce exact stroke structures and often produce garbled or wrong characters, especially for characters with complex strokes. To address this, we propose a trajectory-aligned glyph rendering reference that provides explicit per-frame glyph guidance following the position and perspective of the text, and a depth-normalized recognizer feature supervision that supervises the generated text on multi-depth features of a frozen text recognizer with per-depth normalized errors, targeting stroke errors overlooked by the diffusion loss. We further build VTEdit, a benchmark of 288 real-scene clips with 440 annotated text trajectories covering text replacement and text addition, which will be publicly released to facilitate future research. Experiments on VTEdit show that our method outperforms image text editing methods, video editing methods, and commercial models in text accuracy and background preservation, achieving a sentence accuracy of 0.9408, and receives the highest preference in a user study.
Read the full abstract
Artificial Intelligence
ReplayLens: Auditing Agents' Use of Outcomes
When an agent reuses logged experience, a changed decision may reflect the recorded score, the action's name, or the record's position in storage. Standard memory evaluations do not reveal which relationship drives that change. We introduce ReplayLens, a black-box audit that changes one relationship in the stored history at a time, holds the remaining interface fixed, and measures the resulting decision. Four interventions target four relationships. Outcome reassignment swaps which scores belong to which actions. Pair transport moves intact action-score pairs to new record slots. Consistent renaming relabels actions in both history and menu. Key-slot reassignment changes both score attachment and position. A constructive separation shows why the audit is needed: two memory writers with identical endpoint accuracy respond differently to the same replay, so conventional evaluation cannot resolve the underlying dependence. On black-box LLM interfaces, swapping scores changes decisions while moving intact pairs does not, separating score attachment from record order. A bounded-memory study exposes ingestion-order sensitivity that endpoint comparison misses. In sequential experiment planning, altered historical scores redirect exploration and reduce final utility despite fresh measurements. A code-debugging agent with sealed hidden tests shows the same pattern outside model selection. ReplayLens provides a relationship-level audit for deciding whether logged experience can be merged, reordered, or reindexed safely.