Cryptography and Security · Cross-listed from cs.LG
When Safety Geometry Collapses: Fine-Tuning Vulnerabilities in Agentic Guard Models
Ismail Hossain, Sai Puppala, Jannatul Ferdaus et al. (+4 more)
A guard model fine-tuned on entirely benign data can lose all safety
alignment – not through
adversarial manipulation, but through standard domain specialization. We demonstrate this failure across three purpose-built safety classifiers – LlamaGuard, WildGuard, and Granite Guardian – deployed as protection layers in agentic AI pipelines, and show that it originates in the destruction of latent safety geometry: the structured harmful – benign representational boundary that guides classification. We extract per-layer safety subspaces via SVD on class-conditional activation differences and track how this boundary evolves under benign fine-tuning. Granite Guardian undergoes complete collapse – refusal rate drops from 85% to 0%, CKA falls to zero, and 100% of outputs become ambiguous – a severity exceeding prior findings on general-purpose LLMs, explained by the specialization hypothesis: concentrated safety representations are efficient but catastrophically brittle. To mitigate this, we propose Fisher-Weighted Safety Subspace Regularization (FW-SSR), a training-time penalty combining (i)
curvature-aware direction weights derived from diagonal Fisher information and (ii) an adaptive $\lambda_t$ that scales with task-safety gradient conflict. FW-SSR recovers 75% refusal on Granite Guardian (CKA = 0.983) and reduces WildGuard's Attack Success Rate to 3.6% – below the unmodified baseline – by actively sharpening the safety subspace rather than merely anchoring it. Across all three models, structural representational geometry (CKA, Fisher score) predicts safety behavior more reliably than absolute displacement metrics, establishing geometry-based monitoring as a necessary component of guard model evaluation in agentic deployments.
Read the full abstract ▾
All authors Ismail Hossain, Sai Puppala, Jannatul Ferdaus, Md Jahangir Alam, Yoonpyo Lee, Syed Bahauddin Alam, Sajedul Talukder
Cryptography and Security
Semantic Intent Fragmentation: A Single-Shot Compositional Attack on Multi-Agent AI Pipelines
Tanzim Ahad, Ismail Hossain, Md Jahangir Alam et al. (+4 more)
We introduce Semantic Intent Fragmentation (SIF), an attack class against LLM orchestration systems where a single, legitimately phrased request causes an orchestrator to decompose a task into subtasks that are individually benign but jointly violate security policy. Current safety mechanisms operate at the subtask level, so each step clears existing classifiers – the violation only emerges at the composed plan. SIF exploits OWASP LLM06:2025 through four mechanisms: bulk scope escalation, silent data exfiltration, embedded trigger deployment, and quasi-identifier aggregation, requiring no injected content, no system modification, and no attacker interaction after the initial request. We construct a three-stage red-teaming pipeline grounded in OWASP, MITRE ATLAS, and NIST frameworks to generate realistic enterprise scenarios. Across 14 scenarios spanning financial reporting, information security, and HR analytics, a GPT-20B orchestrator produces policy-violating plans in 71% of cases (10/14) while every subtask appears benign. Three independent signals validate this: deterministic taint analysis, chain-of-thought evaluation, and a cross-model compliance judge with 0% false positives. Stronger orchestrators increase SIF success rates. Plan-level information-flow tracking combined with compliance evaluation detects all attacks before execution, showing the compositional safety gap is closable.
Read the full abstract ▾
All authors Tanzim Ahad, Ismail Hossain, Md Jahangir Alam, Sai Puppala, Yoonpyo Lee, Syed Bahauddin Alam, Sajedul Talukder
Cryptography and Security · Cross-listed from cs.LG
Joint Interference Detection and Identification via Adversarial Multi-task Learning
H. Xu, L. Hu, B. He et al. (+1 more)
Precise interference detection and identification are crucial for enhancing the survivability of communication systems in non-cooperative wireless environments. While deep learning (DL) has advanced this field, existing single-task learning (STL) approaches neglect inherent task correlations. Furthermore, emerging multi-task learning (MTL) methods often lack a theoretical foundation for quantifying and modeling task relationships. To bridge this gap, we establish a theoretically grounded MTL framework for joint interference detection, modulation identification, and interference identification. First, we derive an upper bound for the weighted expected loss in MTL frameworks. This bound explicitly connects MTL performance to task similarity, quantified by the Wasserstein distance and learnable task relation coefficients. Guided by this theory, we present the
adversarial multi-task interference detection and identification network (AMTIDIN), which integrates
adversarial training to minimize distributional discrepancies across tasks and uses adaptive coefficients to model task correlations dynamically. Crucially, we conducted a quantitative analysis of task similarity to reveal intrinsic task relationships, specifically that modulation identification and interference identification share a substantial feature overlap distinct from interference detection. Experiments demonstrate that AMTIDIN outperforms its independently trained single-task counterparts and MTL baselines under the evaluated conditions of limited training data, short signal lengths, and low signal-to-noise ratios (SNRs)
Read the full abstract ▾
All authors H. Xu, L. Hu, B. He, S. Wang
Cryptography and Security
Interpreting the Error of Differentially Private Median Queries through Randomization Intervals
Thomas Humphries, Tim Li, Shufan Zhang et al. (+2 more)
It can be difficult for practitioners to interpret the quality of differentially private (DP) statistics due to the added noise. One method to help analysts understand the amount of error introduced by DP is to return a Randomization Interval (RI), along with the statistic. A RI is a type of confidence interval that bounds the error introduced by DP. For queries where the noise distribution depends on the input, such as the median, prior work degrades the quality of the median itself to obtain a high-quality RI. In this work, we propose PostRI, a solution to compute a RI after the median has been estimated. PostRI enables a median estimation with 14%-850% higher utility than related work, while maintaining a narrow RI.
Read the full abstract ▾
All authors Thomas Humphries, Tim Li, Shufan Zhang, Karl Knopf, Xi He
Cryptography and Security
MEV-ACE: Identity-Authenticated Fair Ordering for Proposer-Controlled MEV Mitigation
Jian Sheng Wang
Maximal Extractable Value, or MEV, remains a structural threat to blockchain
fairness because a block producer can often observe pending transactions and unilaterally decide their ordering or inclusion. Existing mitigations hide transaction contents or outsource ordering, but they often leave two gaps unresolved. First, commitments are not authenticated by slashable identities. Second, inclusion obligations are not backed by transferable evidence that other validators can verify. This paper presents MEV ACE, a fair ordering protocol for proposer controlled ordering MEV. MEV ACE combines three mechanisms. First, it uses registered economic identities whose authentication keys are deterministically derived from the ACE GF framework and bonded on chain. Second, it uses authenticated commit and open messages with validator receipt thresholds, which make admissibility and inclusion obligations independently auditable. Third, it uses verifiable delay based randomness to determine transaction order only after the admissible commitment set is fixed. We formalize the protocol in a Byzantine fault tolerant validator model with threshold receipts and show three properties under standard assumptions: order unpredictability after the admissible set is locked, commitment authenticity under signature unforgeability, and accountable inclusion for transactions that obtain threshold commit and open receipts. Under these conditions, and when producer and user bonds exceed the one slot gain from invalid execution or selective non opening, MEV ACE removes unilateral proposer discretion over front running, sandwich attacks, and censorship against admitted transactions. The protocol remains single slot in structure, requires no threshold decryption committee, and is compatible with post
quantum signature schemes such as ML DSA 44.
Read the full abstract ▾
Cryptography and Security · Cross-listed from cs.NI
SAFE: Spatially-Aware Feedback Enhancement for Fault-Tolerant Trust Management in Event-Based VANETs
İpek Abas{\i}keleş Turgut
In event-based trust management for vehicular ad hoc networks (VANETs), vehicles that witness a road event broadcast its state, and vehicles that later witness the same event score the earlier broadcasters in feedback reports sent to a central decision unit (CDU). When the event state changes, an honest vehicle that reported the previous state receives negative feedback, as the evaluator compares an out-of-date message with the new state. This stale-witness problem is hypothesised to be a major source of unfair penalisation of honest vehicles. To address it, SAFE (Spatially-Aware Feedback Enhancement) is proposed. In SAFE, vehicles continue to record event messages after their decision and throughout the witness area, and send an updated feedback report when they leave it. SAFE was compared with the trust cascading-based emergency message dissemination model (TCEMD) in attack-free highway scenarios simulated with OMNeT++, Veins and Simulation of Urban MObility (SUMO). In the single-event scenario, the negative-feedback rate in the two update rounds after the state change decreased from 53.8% to 24.7% and from 55.6% to 8.3%, and the number of distinct honest vehicles blacklisted decreased from 20 to 6. In the multi-event scenario, the negative-feedback rate remained at or below 1.3% in SAFE, compared with up to 77.6% in TCEMD, and the share of trust evaluations ending in an untrusted label decreased from 22.7% to at most 1.7%. These gains required 2.3 to 5.0 times more feedback entries. Experiments with two decision distances showed that a shorter gap between the decision and witness distances reduced stale feedback in both schemes, supporting the stale-witness hypothesis
Read the full abstract ▾
Cryptography and Security
MCP-DPT: A Defense-Placement Taxonomy and Coverage Analysis for Model Context Protocol Security
Mehrdad Rostamzadeh, Sidhant Narula, Nahom Birhan et al. (+2 more)
The Model Context Protocol (MCP) enables large
language models (LLMs) to dynamically discover and invoke third-party tools, significantly expanding
agent capabilities while introducing a distinct security landscape. Unlike
prompt-only interactions, MCP exposes pre-execution artifacts, shared context, multi-turn workflows, and third-party supply chains to
adversarial influence across independently operated components. While recent work has identified MCP-specific attacks and evaluated defenses, existing studies are largely attack-centric or
benchmark-driven, providing limited guidance on where mitigation responsibility should reside within the MCP architecture. This is problematic given MCP's multi-party design and distributed trust boundaries. We present a defense-placement-oriented security analysis of MCP, introducing a layer-aligned taxonomy that organizes attacks by the architectural component responsible for enforcement. Threats are mapped across six MCP layers, and primary and secondary defense points are identified to support principled defense-in-depth
reasoning under adversaries controlling tools, servers, or ecosystem components. A structured mapping of existing academic and industry defenses onto this framework reveals uneven and predominantly tool-centric protection, with persistent gaps at the host orchestration, transport, and supply-chain layers. These findings suggest that many MCP security weaknesses stem from architectural misalignment rather than isolated implementation flaws.
Read the full abstract ▾
All authors Mehrdad Rostamzadeh, Sidhant Narula, Nahom Birhan, Mohammad Ghasemigol, Daniel Takabi
Cryptography and Security · Cross-listed from cs.CC
Vulnerability Abundance: A formal proof of infinite vulnerabilities in code
Eireann Leverett and Jeroen van der Ham-de Vos
We present a constructive proof that a single C program, the Vulnerability Factory, admits a countably infinite set of distinct, independently CVE-assignable software vulnerabilities. We formalise the argument using elementary set theory, verify it against MITRE's CVE Numbering Authority counting rules, sketch a model-checking analysis that corroborates unbounded vulnerability generation, and provide a Turing-machine characterisation that situates the result within classical computability theory. We then contextualise this result within the long-running debate on whether undiscovered vulnerabilities in software are dense or sparse, and introduce the concept of vulnerability abundance: a quantitative analogy to chemical elemental abundance that describes the proportional distribution of vulnerability classes across the global software corpus. Because different programming
languages render different vulnerability classes possible or impossible, and because
language popularity shifts over time, vulnerability abundance is neither static nor uniform. Crucially, we distinguish between infinite vulnerabilities and the far smaller set of exploits: empirical evidence suggests that fewer than 6% of published CVEs are ever exploited in the wild, and that exploitation frequency depends not only on vulnerability abundance but on the
market share of the affected software. We argue that measuring vulnerability abundance, and its interaction with software deployment, has practical value for both vulnerability prevention and cyber-risk analysis. We conclude that if one programme can harbour infinitely many vulnerabilities, the set of all software vulnerabilities is necessarily infinite, and we suggest the Vulnerability Factory may serve as a reusable proof artifact, a foundational `test object',for future formal results in vulnerability theory.
Read the full abstract ▾
Cryptography and Security
TRUSTDESC: Preventing Tool Poisoning in LLM Applications via Trusted Description Generation
Hengkai Ye, Zhechang Zhang, Jinyuan Jia et al. (+1 more)
Large
language models (LLMs) increasingly rely on external tools to perform time-sensitive tasks and real-world actions. While tool integration expands LLM capabilities, it also introduces a new
prompt-injection attack surface: tool poisoning attacks (TPAs). Attackers manipulate tool descriptions by
embedding malicious instructions (explicit TPAs) or misleading claims (implicit TPAs) to influence model behavior and tool selection. Existing defenses mainly detect anomalous instructions and remain ineffective against implicit TPAs. In this paper, we present TRUSTDESC, the first framework for preventing tool poisoning by automatically generating trusted tool descriptions from implementations. TRUSTDESC derives implementation-faithful descriptions through a three-stage pipeline. SliceMin performs reachability-aware static analysis and LLM-guided debloating to extract minimal tool-relevant code slices. DescGen synthesizes descriptions from these slices while mitigating misleading or
adversarial code artifacts. DynVer refines descriptions through dynamic verification by executing synthesized tasks and validating behavioral claims. We evaluate TRUSTDESC on 52 real-world tools across multiple tool ecosystems. Results show that TRUSTDESC produces accurate tool descriptions that improve task completion rates while mitigating implicit TPAs at their root, with minimal time and monetary overhead.
Read the full abstract ▾
All authors Hengkai Ye, Zhechang Zhang, Jinyuan Jia, Hong Hu
Cryptography and Security · Cross-listed from cs.NI
IPEK: Event-Criticality-Aware Evidential Trust Management against Strategic Insider Attacks in Vehicular Ad Hoc Networks
İpek Abas{\i}keleş Turgut
Event-based trust management in vehicular ad hoc networks is vulnerable to strategic insider attackers who report trivial events correctly to build reputation, falsify reports on safety-critical events, and corrupt the trust feedback they provide about other vehicles. This paper proposes IPEK, an event-criticality-aware evidential trust management framework. IPEK combines an asymmetric local trust that scales rewards and penalties with event severity and location criticality, a reporter-credibility test that discounts feedback deviating systematically from the consensus of witnesses, and a Dempster-Shafer global trust that fuses feedback with Yager's rule, historical combination and risk accentuation. Closed-form properties quantify how quickly trust is lost and regained and show why Yager's rule keeps the global state revisable. IPEK is evaluated in simulation against a trust cascading-based dissemination scheme and the beta reputation system under eight attacks, with severity-, location-, on-off- and continuously triggered attackers falsifying their reports alone or also their feedback, at attacker ratios from 10% to 40%. Threshold-free separation measures are complemented by closed-loop revocation with frozen thresholds. With up to 25% attackers, IPEK achieves a significantly higher F1-score than both baselines under all attacks, with false positive rates of 0.9-15.5% against 7.8-49.7% and 26.0-41.4%, and it remains robust up to 40% attackers when only reports are falsified. Under fully colluding attackers that also corrupt feedback, all methods break down beyond about one third of attackers; this envelope and a longer detection delay are reported as limitations.
Read the full abstract ▾
Cryptography and Security
Differentially Private Modeling of Disease Transmission within Human Contact Networks
Shlomi Hod, Debanuj Nayak, Jason R. Gantenberg et al. (+3 more)
Epidemiologic studies of infectious diseases often rely on models of contact networks to capture the complex interactions that govern disease spread, and ongoing projects aim to vastly increase the scale at which such data can be collected. However, contact networks may include sensitive information, such as sexual relationships or drug use behavior. Protecting individual
privacy while maintaining the scientific usefulness of the data is crucial. We propose a
privacy-preserving pipeline for disease spread simulation studies based on a sensitive network that integrates differential
privacy (DP) with statistical network models such as
stochastic block models (SBMs) and exponential random graph models (ERGMs). Our pipeline comprises three steps: (1) compute network summary statistics using node-level DP (which corresponds to protecting individuals' contributions); (2) fit a statistical model, like an ERGM, using these summaries, which allows generating synthetic networks reflecting the structure of the original network; and (3) simulate disease spread on the synthetic networks using an
agent-based model. We evaluate the effectiveness of our approach using a simple Susceptible-Infected-Susceptible (SIS) disease model under multiple configurations. We compare both numerical results, such as simulated disease incidence and prevalence, as well as qualitative conclusions such as intervention effect size, on networks generated with and without differential
privacy constraints. Our experiments are based on
egocentric sexual network data from the ARTNet study (a survey about HIV-related behaviors). Our results show that the noise added for
privacy is small relative to other sources of error (sampling and model misspecification). This suggests that, in principle, curators of such sensitive data can provide valuable epidemiologic insights while protecting
privacy.
Read the full abstract ▾
All authors Shlomi Hod, Debanuj Nayak, Jason R. Gantenberg, Iden Kalemaj, Thomas A. Trikalinos, Adam Smith
Cryptography and Security
Private Seeds, Public LLMs: Realistic and Privacy-Preserving Synthetic Data Generation
Qian Ma and Sarah Rajtmajer
Large
language models (LLMs) have emerged as a powerful tool for synthetic data generation. A particularly important use case is producing synthetic replicas of private text, which requires carefully balancing
privacy and utility. We propose Realistic and
Privacy-Preserving Synthetic Data Generation (RPSG), which uses private seeds and integrates
privacy-preserving strategies, including a formal differential
privacy (DP) mechanism in the candidate selection, to generate realistic synthetic data. Comprehensive experiments against state-of-the-art private synthetic data generation methods demonstrate that RPSG achieves high fidelity to private data while providing strong
privacy protection.
Read the full abstract ▾
Cryptography and Security
RefineRAG: Word-Level Poisoning Attacks via Retriever-Guided Text Refinement
Ziye Wang, Guanyu Wang and Kailong Wang
Retrieval-Augmented Generation (RAG) significantly enhances Large
Language Models (LLMs), but simultaneously exposes a critical vulnerability to knowledge poisoning attacks. Existing attack methods like PoisonedRAG remain detectable due to coarse-grained separate-and-concatenate strategies. To bridge this gap, we propose RefineRAG, a novel framework that treats poisoning as a holistic word-level refinement problem. It operates in two stages: Macro Generation produces toxic seeds guaranteed to induce target answers, while Micro Refinement employs a retriever-in-the-loop optimization to maximize
retrieval priority without compromising naturalness. Evaluations on NQ and MSMARCO demonstrate that RefineRAG achieves state-of-the-art effectiveness, securing a 90% Attack Success Rate on NQ, while registering the lowest grammar errors and repetition rates among all baselines. Crucially, our proxy-optimized attacks successfully transfer to black-box victim systems, highlighting a severe practical threat.
Read the full abstract ▾
Cryptography and Security
Label Leakage Attacks in Machine Unlearning: A Parameter and Inversion-Based Approach
Weidong Zheng, Kongyang Chen, Yao Huang et al. (+2 more)
With the widespread application of artificial intelligence technologies in face recognition and other fields, data
privacy security issues have received extensive
attention, especially the right to be forgotten emphasized by numerous
privacy protection laws. Existing technologies have proposed various unlearning methods, but they may inadvertently leak the categories of unlearned data. This paper focuses on the category unlearning scenario, analyzes the potential problems of category leakage of unlearned data in multiple scenarios, and proposes four attack methods from the perspectives of model parameters and model inversion based on attackers with different knowledge backgrounds. At the level of model parameters, we construct discriminative features by computing either dot products or vector differences between the parameters of the target model and those of auxiliary models trained on subsets of retained data and unrelated data, respectively. These features are then processed via k-means clustering, Youden's Index, and decision tree
algorithms to achieve accurate identification of the forgotten class. In the model inversion domain, we design a gradient optimization-based white-box attack and a genetic
algorithm-based black-box attack to reconstruct class-prototypical samples. The prediction profiles of these synthesized samples are subsequently analyzed using a threshold criterion and an information
entropy criterion to infer the forgotten class. We evaluate the proposed attacks on four standard
datasets against five state-of-the-art unlearning
algorithms, providing a detailed analysis of the strengths and limitations of each method. Experimental results demonstrate that our approach can effectively infer the classes forgotten by the target model.
Read the full abstract ▾
All authors Weidong Zheng, Kongyang Chen, Yao Huang, Yuanwei Guo, Yatie Xiao
Cryptography and Security
Validated Intent Compilation for Constrained Routing in LEO Mega-Constellations
Yuanhang Li
Operating LEO mega-constellations requires translating high-level operator intents ("reroute financial traffic away from polar links under 80 ms") into low-level routing constraints – a task that demands both natural
language understanding and network-domain expertise. We present an end-to-end system comprising three components: (1) a GNN cost-to-go router that distills Dijkstra-quality routing into a 152K-parameter graph
attention network achieving 99.8% packet delivery ratio with 17x inference speedup; (2) an LLM intent compiler that converts natural
language to a typed constraint intermediate representation using few-shot prompting with a verifier-feedback repair loop, achieving 98.4% compilation rate and 87.6% full semantic match on feasible intents in a 240-intent
benchmark (193 feasible, 47 infeasible); and (3) an 8-pass deterministic validator with constructive feasibility certification that achieves 0% unsafe acceptance on all 47 infeasible intents (30 labeled + 17 discovered by Pass 8), with 100% corruption detection across 240 structural corruption tests and 100% on 15 targeted
adversarial attacks. End-to-end evaluation across four constrained routing scenarios confirms zero constraint violations with both routers. We further demonstrate that apparent performance gaps in polar-avoidance scenarios are largely explained by topological reachability ceilings rather than routing quality, and that the LLM compiler outperforms a rule-based baseline by 46.2 percentage points on compositional intents. Our system bridges the semantic gap between operator intent and network configuration while maintaining the safety guarantees required for operational deployment.
Read the full abstract ▾