$ATTN attention

Latest papers

1. Can Learning to Answer Spatial Questions Improve Novel-View Generation? cs.CV · 14 Oct · 2 hits

   …both VAE and ViT representations and leverages understanding features during generation through joint self-attention with a modality-aware attention masking strategy. Experiments demonstrate strong image quality and…

2. SafeDriveVLA: Navigation-Conditioned World Model Dreaming for Conflict-Aware End-to-End Autonomous Driving cs.RO · 14 Oct · 1 hit

   Vision-Language-Action (VLA) models are gaining attention in autonomous driving, inheriting commonsense priors from large language models (LLMs) and widening…

3. Modeling and Understanding Neural Weights of Humanoid Policies with Diffusion cs.RO · 14 Oct · 1 hit

   …control networks are typically obtained through conventional training procedures, while comparatively little attention has been given to directly modeling the distribution of their learned weights and generating…

4. Your Transformer Is Secretly Elastic cs.LG · 14 Oct · 2 hits

   …unit-ranking problem: unlike prior work, which optimizes a single importance weight per MLP block or attention head, we rank every individual MLP neuron and attention head jointly, on a common scale, by…

5. Continuum Attention cs.LG · 14 Oct · 6 hits

   We introduce Continuum Attention (CA), a causal Transformer attention operator that replaces discrete key and value lookup with…

6. Latent Compaction with Test-Time Training cs.CL · 14 Oct · 3 hits

   Long contexts enlarge key--value (KV) caches, increasing memory use and attention costs during generation. Compressing these caches must preserve information for unseen questions.…

7. Refurbishment and Cryocooler Upgrade of the CPAPIR Wide-Field Near-Infrared Camera: Design, Integration, and Lessons Learned astro-ph.IM · 14 Oct · 1 hit

   …analysis (FEA), three-dimensional CAD modeling, hardware selection, and laboratory validation. Particular attention is given to the challenges encountered during integration and testing, notably vibration mitigation…

8. ReaDy: Recurrent States as Dynamic Context for Speculative Drafting in Hybrid Linear Attention Large Language Models cs.CL · 14 Oct · 2 hits

   …features whose contextual emphasis may not align with the needs of subsequent draft positions. Hybrid linear attention (HLA) models maintain compact recurrent states that accumulate historical associations, offering an…