Cryptography and Security
The End of Trust: How Agentic AI Breaks Security Assumptions
Osama Zafar, Alexander Nemecek and Erman Ayday
For decades, the security of digital interaction has rested on an unacknowledged economic constraint. Attackers faced a tradeoff between the fidelity of a deception and the scale at which it could be deployed. Convincing impersonation required sustained human effort and was confined to a narrow set of high-value targets, while mass-
market attacks sacrificed plausibility for reach. Detection systems, verification mechanisms, and user awareness training have all been implicitly calibrated to the artifacts of cheap deception that this tradeoff produced. Agentic AI collapses the tradeoff, allowing high-fidelity, individually tailored deception to be produced at mass-
market scale. We argue that this shift exhausts a security paradigm rather than merely intensifying the threat landscape. We introduce the Infinite Impostor, an attack model in which an autonomous
agent interposes itself between two parties who already trust each other, hijacking an existing relationship rather than building a new one from scratch. Detection-oriented defenses share an assumption that generative progress is eliminating, that synthetic outputs are distinguishable from authentic ones. We propose a suspect-by-default paradigm that shifts security from authenticating actors to evaluating actions, and examine the governance tensions that arise when platforms become the regulatory substrate of digital interaction.
Read the full abstract ▾
Cryptography and Security
Topical Shifts in the Dark Web: A Longitudinal Analysis of Content from the Cybercrime Ecosystem
Roy Ricaldi, Maximilian Schafer, Philipp Zech et al. (+3 more)
The dark web hosts a dynamic ecosystem of cybercrime forums and marketplaces that adapt to law enforcement pressure, technological change, and economic incentives. Prior research has extracted cyber threat intelligence from these platforms using static snapshots, with limited
attention to how discussions evolve over time. In this study, we conduct a longitudinal analysis of 25,065 websites in the dark web using 11,403,638 HTML snapshots (approximately 1245.38 GB) collected over six years. We develop a longitudinal topic-modeling framework combining domain-specific
embeddings, density-based clustering and temporal aggregation to measure topic prevalence and lifecycle at the website level. Our analysis identifies 55 thematic clusters. We find that approximately 75% of total discussion volume is concentrated in a small set of persistent core topics, while short-lived themes account for approximately 3% of activity. The median topic lifespan is 75 months, indicating gradual thematic
evolution rather than abrupt replacement.
Read the full abstract ▾
All authors Roy Ricaldi, Maximilian Schafer, Philipp Zech, Luca Allodi, Raffaela Groner, Irdin Pekaric
Cryptography and Security
Hidden in Memory: Sleeper Memory Poisoning in LLM Agents
Sidharth Pulipaka, Stanislau Hlebik, Leonidas Raghav et al. (+4 more)
Large
language models are increasingly augmented with persistent
memory, allowing assistants to store user-specific information across sessions for personalization and continuity. This statefulness introduces a new security risk:
adversarial content can corrupt what an assistant remembers and thereby influence future interactions. We propose and study sleeper
memory poisoning, a delayed attack in which an adversary manipulates external context, such as a document, webpage, or repository, to cause the assistant to store a fabricated
memory about the user. Unlike conventional
prompt injection, the attack can remain dormant and re-emerge across multiple later conversations. We evaluate the full attack pipeline: whether poisoned
memories are written, later retrieved, and ultimately used to steer the following conversations. Across stateful LLM assistants, poisoned
memories were added up to 99.8% on GPT-5.5 and 95% on Kimi-K2.6. Crucially, among successful
retrievals, poisoned
memories cause attacker-intended agentic actions in 60-89% of evaluations across models. These results show that persistent
memory can act as a long-term attack surface across multiple future conversations.
Read the full abstract ▾
All authors Sidharth Pulipaka, Stanislau Hlebik, Leonidas Raghav, Sahar Abdelnabi, Vyas Raina, Ivaxi Sheth, Mario Fritz
Cryptography and Security
Distance-Preserving Digests: A Primitive for BFT Consensus
Ryan Patrick Mercier
Every BFT consensus protocol uses collision-resistant hashes to compare validator state. Collision resistance destroys distance: two validators agreeing on 19 of 20 transactions produce unrelated hashes, indistinguishable from validators sharing nothing. This forces three design constraints across the BFT literature: validators must synchronize state before voting, agreement quality cannot be measured until votes are counted, and hierarchical committees must be large enough for independent BFT, limiting tree depth. This paper introduces distance-preserving transaction digests, a primitive that replaces collision-resistant hashes with commutative vector sums in 8-dimensional space. The primitive has three properties hashes lack: distance is proportional to disagreement, weighted means are exact, and set differences are identifiable via bloom filter diff. We demonstrate three applications: a two-phase BFT protocol (Proxima) that achieves single-round finality when validators agree; tree-structured consensus with groups of 10 validators (vs 128 in Ethereum), enabled because distance filtering replaces per-group BFT; and cross-shard consistency verification at 128 bytes per shard pair, replacing the per-transaction coordination of two-phase commit. Safety is proved: fewer than N/3 Byzantine validators cannot cause conflicting finalization, independent of Phase 1 clustering or tree
topology. At N =100,000, Proxima Tree uses 2.2x fewer messages than HotStuff (a structural property unaffected by parallelism). Single-core finality is 0.9s vs 18s for HotStuff; multi-core BLS narrows but does not eliminate this gap.
Read the full abstract ▾
Cryptography and Security
Autonomous Intelligent Agents for Natural-Language-Driven Web Execution with Integrated Security Assurance
Vinil Pasupuleti, Siva Rama Krishna Varma Bayyavarapu and Shrey Tyagi
Modern web test suites rot. A UI refactor breaks locators, a timing change causes race conditions, and within weeks developers abandon the suite entirely. This paper presents an AI-driven autonomous testing framework that addresses these failure modes through five integrated strategies -
navigation reliability, context-aware selector generation, post-generation validation, smart wait injection, and failure learning - implemented over a containerised worker architecture that decouples orchestration from long-running browser execution. Evaluated across four production applications and 176 scenarios, the framework improves script generation success from 55% to 93%, achieves an 8x reduction in
navigation failures, eliminates 80% of timing-related race conditions, and reduces test creation time by 75% compared to manual Selenium authoring. The framework extends naturally to security validation: testers describe attack scenarios in plain English - "try accessing another user's invoice" - which the
agent converts to OWASP Top 10-aligned browser probes, detecting 85% of authentication bypass vulnerabilities and 95% of input validation flaws with false positive rates below 12%. Natural-
language-driven security testing of this kind represents, to our knowledge, a novel contribution to the field.
Read the full abstract ▾
Cryptography and Security
Enabling Adversarial Robustness in AI Models through Kubeflow MLOps
Stavros Bouras, Ioannis Korontanis, Antonios Makris et al. (+1 more)
AI models are increasingly deployed in cloud-native environments to support scalable and automated services. However, while platforms such as Kubernetes provide strong infrastructure orchestration, security mechanisms specifically designed to protect deployed AI models remain limited. This paper presents security measures for AI models deployed in Kubernetes clusters. The proposed architecture integrates Kubeflow-based MLOps to automatically detect
adversarial attacks during the inference phase and trigger defense mechanisms that preserve the model's accuracy and reliability. Specifically, a Fast Gradient Sign Method (FGSM) attack is applied at inference time, and a Projected Gradient Descent (PGD)-based
adversarial training defense is automatically deployed when a degradation in accuracy is detected. The experimental results indicate that the deployed defense robustifies the model, significantly recovering accuracy relative to the degradation caused by the attack.
Read the full abstract ▾
All authors Stavros Bouras, Ioannis Korontanis, Antonios Makris, Konstantinos Tserpes
Cryptography and Security · Cross-listed from cs.SE
Probing Privacy Leaks in LLM-based Code Generation via Test Generation
Yifei Ge, Zhenpeng Chen, Weisong Sun et al. (+7 more)
The widespread availability of large-scale code
datasets has fueled the rapid development of large
language models (LLMs) for code-related tasks. These
datasets may include sensitive personally identifiable information (PII), which can lead to
privacy leakage when LLMs memorize and reproduce it. However, existing
privacy-leakage detection methods rely on ad-hoc
prompt construction (manually or automatically designed). Therefore, they do not adequately approximate the real-world contexts in which PII appears in code corpora, making it difficult to extract realistic
privacy leakage. In this paper, we propose a pipeline that simulates practical
privacy-related code generation scenarios and adopts a test-driven strategy to elicit the memorized information from the generated test cases. We further introduce an automatically constructed
privacy feature library that replaces manual
prompt engineering by providing realistic templates and examples to guide test case generation. Large-scale experiments on 5 widely used LLMs show that our pipeline exposes more confirmed
privacy leakage, achieving a 2.56 times increase in detected leakage compared to existing baselines.
Read the full abstract ▾
All authors Yifei Ge, Zhenpeng Chen, Weisong Sun, Yuchen Chen, Chunrong Fang, Juan Zhai, Xiaofang Zhang, Xia Feng, Yang Liu, Zhenyu Chen
Cryptography and Security · Cross-listed from quant-ph
Quantum Meets Statistical-Physical Secrecy: A Novel Hybrid Key Distribution Architecture
Ertugrul Basar
This letter proposes a novel hybrid key distribution architecture that jointly exploits
quantum key distribution (QKD) and Kirchhoff-law-Johnson-noise (KLJN) statistical-physical key exchange. In the proposed system, an optical BB84-type QKD link operates in coordination with a parallel wired KLJN link, which is used for secure basis handling and, in selected protocols, additional raw key generation. Three novel KLJN-assisted QKD protocols are introduced to eliminate public basis disclosure messages and bit sifting, extract basis-derived key bits, or generate raw key bits under ideal KLJN assumptions. Analytical expressions for the normalized key rate and absolute throughput are derived by accounting for optical channel penalties, KLJN bandwidth constraints, and synchronization bottlenecks. Numerical results show that the proposed hybrid architecture can improve key generation efficiency and throughput in short-haul infrastructures, including metropolitan area networks (MANs) and data center interconnects.
Read the full abstract ▾
Cryptography and Security
MetaBackdoor: Exploiting Positional Encoding as a Backdoor Attack Surface in LLMs
Rui Wen, Mark Russinovich, Andrew Paverd et al. (+2 more)
Backdoor attacks pose a serious security threat to large
language models (LLMs), which are increasingly deployed as general-purpose assistants in safety- and
privacy-critical applications. Existing LLM
backdoors rely primarily on content-based triggers, requiring explicit modification of the input text. In this work, we show that this assumption is unnecessary and limiting. We introduce MetaBackdoor, a new class of
backdoor attacks that exploits positional information as the trigger, without modifying textual content. Our key insight is that
Transformer-based LLMs necessarily encode
token positions to process ordered sequences. As a result, length-correlated positional structure is reflected in the model's internal computation and can be used as an effective non-content trigger signal. We demonstrate that even a simple length-based positional trigger is sufficient to activate stealthy
backdoors. Unlike prior attacks, MetaBackdoor operates on visibly and semantically clean inputs and enables qualitatively new capabilities. We show that a backdoored LLM can be induced to disclose sensitive internal information, including proprietary system
prompts, once a length condition is satisfied. We further demonstrate a self-activation scenario, where normal multi-turn interaction can move the conversation context into the trigger region and induce malicious tool-call behavior without attacker-supplied trigger text. In addition, MetaBackdoor is orthogonal to content-based
backdoors and can be composed with them to create more precise and harder-to-detect activation conditions. Our results expand the threat model of LLM
backdoors by revealing positional encoding as a previously overlooked attack surface. This challenges defenses that focus on detecting suspicious text and highlights the need for new defense strategies that explicitly account for positional triggers in modern LLM architectures.
Read the full abstract ▾
All authors Rui Wen, Mark Russinovich, Andrew Paverd, Jun Sakuma, Ahmed Salem
Cryptography and Security
Talk is (Not) Cheap: A Taxonomy and Benchmark Coverage Audit for LLM Attacks
Karthik Raghu Iyer, Yazdan Jamshidi, Nicholas Bray et al. (+1 more)
We introduce a reusable framework for
auditing whether LLM attack
benchmarks collectively cover the threat surface: a 4$\times$6 Target $\times$ Technique
matrix grounded in STRIDE, constructed from a 507-leaf taxonomy – 401 data-populated and 106 threat-model-derived leaves – of inference-time attacks extracted from 932 arXiv security studies (2023–2026). The
matrix enables
benchmark-external validation –
auditing collective coverage rather than individual
benchmark consistency. Applying it to six public
benchmarks reveals that the three primary frameworks (HarmBench, InjecAgent, AgentDojo) occupy non-overlapping
cells covering at most 25% of the
matrix, while entire STRIDE threat categories (Service Disruption, Model Internals) lack any standardized evaluation, despite published attacks in these categories achieving 46$\times$
token amplification and 96% attack success rates through mechanisms which no
benchmark tests. The corpus of 2,521 unique attack groups further reveals pervasive naming fragmentation (up to 29 surface forms for a single attack) and heavy concentration in Safety &
Alignment Bypass, structural properties invisible at smaller scale. The taxonomy, attack records, and coverage mappings are released as extensible artifacts; as new
benchmarks emerge, they can be mapped onto the same
matrix, enabling the community to track whether evaluation gaps are closing.
Read the full abstract ▾
All authors Karthik Raghu Iyer, Yazdan Jamshidi, Nicholas Bray, Alexey A. Shvets
Cryptography and Security · Cross-listed from cs.SE
Veritas: Grounding LLM Agents for Reliable Vulnerability Reasoning over Stripped Binaries
Xinran Zheng, Alfredo Pesoli, Marco Valleri et al. (+2 more)
Frontier LLM
agents are increasingly capable of localizing suspicious code, but vulnerability
reasoning requires more than access to program artifacts. An
agent must carry forward the evidence that actually decides whether a vulnerability exists. Otherwise, safety-relevant facts may be present in the artifact but absent from the
reasoning used to justify the claim, creating a semantic gap between available program facts and the evidence used by the
agent. This problem is especially acute for stripped binaries, where source-level cues are removed and relevant evidence is fragmented across noisy lifted IR and lossy decompiled views. We formulate stripped-binary vulnerability
reasoning as a semantic grounding problem and present Veritas, a three-stage framework for reliable analysis. First, a static-analysis Slicer recovers witness-backed source-to-sink flows from lifted LLVM IR. Second, an LLM-based Discover stage aligns decompiled code with IR witnesses to construct vulnerability claims. Third, a multi-
agent Validator checks these claims through guided debugging and runtime oracles. Together, these stages turn fragmented binary views into checkable claims rather than relying on direct
agent inference. We instantiate Veritas for out-of-bounds vulnerabilities and evaluate it on a curated
benchmark with flow-level annotations. Veritas achieves 90% recall, outperforms static, dynamic, binary-analysis, and agentic baselines, and reports no false positives among 623 exhaustively validated candidates and only two observed false positives in sampled audits. In a real-world case study, Veritas discovered a previously unknown Apple vulnerability that was confirmed and assigned a CVE, demonstrating that grounded
reasoning can produce actionable findings beyond the curated
benchmark.
Read the full abstract ▾
All authors Xinran Zheng, Alfredo Pesoli, Marco Valleri, Suman Jana, Lorenzo Cavallaro
Cryptography and Security
PickleFuzzer: A Case Study in Fuzzing for Discrepancies Between Python Pickle Implementations
Justin Applegate and Andreas Kellas
Python's native serialization protocol, pickle, is a powerful but insecure format for transferring untrusted data. It is frequently used, especially for saving machine learning models, despite known security challenges. While developers sometimes mitigate this risk by restricting imports during unpickling or using static and dynamic analysis tools, these approaches are error-prone and depend heavily on accurate interpretations of the Pickle Virtual Machine (PVM) opcodes. Discrepancies across Python's three native PVM modules can lead to incorrect detection of malicious payloads and undermine existing defenses. To efficiently and scalably identify discrepancies, we present PickleFuzzer, a custom generation-based fuzzer that identifies inconsistencies across pickle implementations. PickleFuzzer generates pickle objects, passes them to each implementation, and detects differences in thrown exceptions or changes to key internal states. It generates pickle objects using a grammar, which we developed to account for the missing pickle specification. It determines discrepancies by comparing the execution behaviors of each test implementation, rather than requiring a specification-derived oracle. PickleFuzzer detected 14 new discrepancies between the pickle implementations. Four discrepancies are critical and can be used to bypass security-critical scanning tools like those deployed on the popular model hosting platform, Hugging Face. We disclosed all findings to the Python Software Foundation for remediation, and additionally disclosed the security issues to a bug bounty platform and were awarded a $750 bounty. We demonstrate that differential testing is a viable approach for identifying security-relevant discrepancies in important pickle implementations, and our work can lead to promising future directions for finding deeper pickle bugs with more directed fuzzing.
Read the full abstract ▾
Cryptography and Security
Analyzing Codes of Conduct for Online Safety in Video Games at Scale
Jiuming Jiang, Shidong Pan, Daniel W Woods et al. (+1 more)
Online
video games have become major online social spaces where users interact, compete, and create together. These spaces, however, expose users to a wide spectrum of online harms, including harassment, discrimination, inappropriate content,
privacy breach, cheating, and more. The shape and severity of such harms vary across game design, mechanics, and community context. To mitigate these harms, game companies issue Codes of Conduct (CoCs) that articulate online safety rules and direct players to safety resources. However, it remains unclear how prevalent CoCs are, what safety, security and
privacy violations they govern, and whether they meet growing regulatory and industry expectations. We develop and leverage CONDUCTIFY, a pipeline for identifying and analyzing CoCs at scale. Applied to Steam, the largest PC game marketplace, it located the available CoCs for 350 of the 9,586 multiplayer titles on Steam. We found that CoCs are more available among popular, adult-oriented, and community-driven games, while most multiplayer games operate without CoCs despite regulatory and industry recommendations. Although over 80% of the games with CoCs available consistently address traditional security and safety violations, their governance approaches vary substantially across types of violations. A further asymmetry emerges in specificity. Compared with harms related to gameplay mechanics, the articulations of interpersonal harm and the underage player safety are often less specific, despite their relevance to many game communities. Together, these results inform the improvement of online safety governance and CoC enforcement practices, and building better safety infrastructure for the community of players and developers.
Read the full abstract ▾
All authors Jiuming Jiang, Shidong Pan, Daniel W Woods, Jingjie Li
Cryptography and Security
WARD: Adversarially Robust Defense of Web Agents Against Prompt Injections
Tri Cao, Yulin Chen, Hieu Cao et al. (+8 more)
Web
agents can autonomously complete online tasks by interacting with websites, but their exposure to open web environments makes them vulnerable to
prompt injection attacks embedded in HTML content or visual interfaces. Existing guard models still suffer from limited generalization to unseen domains and attack patterns, high false positive rates on benign content, reduced deployment efficiency due to added latency at each step, and vulnerability to
adversarial attacks that evolve over time or directly target the guard itself. To address these limitations, we propose WARD (Web
Agent Robust Defense against
Prompt Injection), a practical guard model for secure and efficient web
agents. WARD is built on WARD-Base, a large-scale
dataset with around 177K samples collected from 719 high-traffic URLs and platforms, and WARD-PIG, a dedicated
dataset designed for
prompt injection attacks targeting the guard model. We further introduce A3T, an adaptive
adversarial attack training framework that iteratively strengthens WARD through a
memory-based attacker and guard co-
evolution process. Extensive experiments show that WARD achieves nearly perfect recall on out-of-distribution
benchmarks, maintains low false positive rates to preserve
agent utility, remains robust against guard-targeted and adaptive attacks under substantial distribution shifts, and runs efficiently in parallel with the
agent without introducing additional latency.
Read the full abstract ▾
All authors Tri Cao, Yulin Chen, Hieu Cao, Yibo Li, Khoi Le, Thong Nguyen, Yuexin Li, Yufei He, Yue Liu, Shuicheng Yan, Bryan Hooi
Cryptography and Security
Toward Securing AI Agents Like Operating Systems
Lukas Pirch, Micha Horlboge, Patrick Großmann et al. (+4 more)
Autonomous
agents based on large
language models (LLMs) are rapidly emerging as a general-purpose technology, with recent systems such as OpenClaw extending their capabilities through broad tool use, third-party skills, and deeper integration into user environments. At the same time, these agentic systems introduce substantial security risks by combining unconstrained capabilities with access to sensitive user data. In this work, we investigate the security of LLM-based
agents through the lens of operating systems. We argue that both face strikingly similar challenges in isolating resources, separating privileges, and mediating communication. Guided by this perspective, we survey the current landscape of open-source
agents, derive a unified
agent architecture, and systematically analyze potential attack vectors. To validate this analysis, we conduct a case study evaluating four widely used OpenClaw-like
agents. Even under modest attacker capabilities, we find that several protection mechanisms fail in practice and that secure operation requires detailed system knowledge and careful configuration. However, we also observe that while some agentic capabilities remain insecure by design, many vulnerabilities can be mitigated using well-established techniques from operating system security. We conclude with a set of recommendations for the secure design of agentic systems.
Read the full abstract ▾
All authors Lukas Pirch, Micha Horlboge, Patrick Großmann, Syeda Mahnur Asif, Klim Kireev, Thorsten Holz, Konrad Rieck
Cryptography and Security
Do Coding Agents Understand Least-Privilege Authorization?
Zheng Yan, Jingxiang Weng, Charles Chen et al. (+9 more)
As coding
agents gain access to shells, repositories, and user files, least-privilege authorization becomes a prerequisite for safe deployment: an
agent should receive enough authority to complete the task, without unnecessary authority that exposes sensitive surfaces. To study whether current models can infer this boundary themselves, we first introduce permission-boundary inference, where a model maps a task instruction and terminal environment to a file-level read/write/execute policy, and AuthBench, a
benchmark of 120 realistic terminal tasks with human-reviewed permission labels and executable validators for utility and attack outcomes. AuthBench shows that authorization is not a simple conservative-versus-permissive calibration problem: frontier models often omit permissions required by the execution chain while also granting unused or sensitive accesses. Increasing inference-time
reasoning does not resolve this mismatch. Instead, each model moves toward a model-specific authorization attractor: more
reasoning makes it more consistent in its own failure mode, whether broad-but-exposed or tight-but-brittle. This suggests that direct policy generation is the bottleneck, because a single generation must both discover all necessary accesses and reject all unnecessary ones. We therefore propose Sufficiency-Tightness Decomposition, which first generates a coverage-oriented policy by forward-simulating the task and then audits each granted entry for grounding and sensitivity. Across tested models, this decomposition improves sensitive-task success by up to 15.8% on tightness-biased models while reducing attack success across all evaluated models.
Read the full abstract ▾
All authors Zheng Yan, Jingxiang Weng, Charles Chen, Dengyun Peng, Ethan Qin, Jiannan Guan, Jinhao Liu, Qiming Yu, Yixin Yuan, Fanqing Meng, Carl Che, Mengkang Hu
Cryptography and Security · Cross-listed from cs.CV
Can Visual Mamba Improve AI-Generated Image Detection? An In-Depth Investigation
Mamadou Keita, Wassim Hamidouche, Hessen Bougueffa Eutamene et al. (+3 more)
In recent years, computer
vision has witnessed remarkable progress, fueled by the development of innovative architectures such as Convolutional Neural Networks (CNNs), Generative
Adversarial Networks (GANs),
diffusion-based architectures,
Vision Transformers (ViTs), and, more recently,
Vision-
Language Models (VLMs). This progress has undeniably contributed to creating increasingly realistic and diverse visual content. However, such advancements in image generation also raise concerns about potential misuse in areas such as misinformation, identity theft, and threats to
privacy and security. In parallel, Mamba-based architectures have emerged as versatile tools for a range of image analysis tasks, including classification,
segmentation, medical imaging, object detection, and image restoration, in this rapidly evolving field. However, their potential for identifying AI-generated images remains relatively unexplored compared to established techniques. This study provides a systematic evaluation and comparative analysis of
Vision Mamba models for AI-generated image detection. We
benchmark multiple
Vision Mamba variants against representative CNNs, ViTs, and VLM-based detectors across diverse
datasets and synthetic image sources, focusing on key metrics such as accuracy, efficiency, and generalizability across diverse image types and generative models. Through this comprehensive analysis, we aim to elucidate
Vision Mamba's strengths and limitations relative to established methodologies in terms of applicability, accuracy, and efficiency in detecting AI-generated images. Overall, our findings highlight both the promise and current limitations of
Vision Mamba as a component in systems designed to distinguish authentic from AI-generated visual content. This research is crucial for enhancing detection in an age where distinguishing between real and AI-generated content is a major challenge.
Read the full abstract ▾
All authors Mamadou Keita, Wassim Hamidouche, Hessen Bougueffa Eutamene, Abdelmalik Taleb-Ahmed, Xianxun Zhu, Abdenour Hadid
Cryptography and Security
Known By Their Actions: Fingerprinting LLM Browser Agents via UI Traces
William Lugoloobi, Samuelle Marro, Jabez Magomere et al. (+2 more)
As LLM-based
agents increasingly browse the web on users' behalf, a natural question arises: can websites passively identify which underlying model powers an
agent? Doing so would represent a significant security risk, enabling targeted attacks tailored to known model vulnerabilities. Across 14 frontier LLMs and four web environments spanning information
retrieval and shopping tasks, we show that an
agent's actions and interaction timings, captured via a passive JavaScript tracker, are sufficient to identify the underlying model with up to 96% F1. We formalise this attack surface by demonstrating that classifiers trained on
agent actions generalise across model sizes and families. We further show that strong classifiers can be trained from few interaction traces and that
agent identity can be inferred early within an episode. Injecting randomised timing delays between actions substantially degrades classifier performance, but does not provide robust protection: a classifier retrained on delayed traces largely recovers performance. We release our harness and a labelled corpus of
agent traces \href{https://github.com/KabakaWilliam/known_actions}{here}.
Read the full abstract ▾
All authors William Lugoloobi, Samuelle Marro, Jabez Magomere, Joss Wright, Chris Russell