Cryptography and Security · Cross-listed from cs.MA
Information-Theoretic Privacy Control for Sequential Multi-Agent LLM Systems
Sadia Asif and Mohammad Mohammadi Amiri
Sequential multi-
agent large
language model (LLM) systems are increasingly deployed in sensitive domains such as healthcare, finance, and enterprise decision-making, where multiple specialized
agents collaboratively process a single user request. Although individual
agents may satisfy local
privacy constraints, sensitive information can still be inferred through sequential composition and intermediate representations. In this work, we study compositional
privacy leakage in sequential LLM
agent pipelines. We formalize leakage using mutual information and derive a theoretical bound that characterizes how locally introduced leakage can amplify across
agents under sequential execution. Motivated by this analysis, we propose a
privacy-regularized training framework that directly constrains information flow between
agent outputs and
agent-local sensitive variables. We evaluate our approach across sequential
agent pipelines of varying depth on three
benchmark datasets, demonstrating stable optimization dynamics and consistent, interpretable
privacy-utility trade-offs. Our results show that
privacy in agentic LLM systems cannot be guaranteed by local constraints alone and must instead be treated as a system-level property during both training and deployment.
Read the full abstract ▾
Cryptography and Security
SecureGate: Learning When to Reveal PII Safely via Token-Gated Dual-Adapters for Federated LLMs
Mohamed Shaaban and Mohamed Elmahallawy
Federated learning (FL) enables collaborative training across organizational silos without sharing raw data, making it attractive for
privacy-sensitive applications. With the rapid adoption of large
language models (LLMs),
federated fine-tuning of generative LLMs has gained
attention as a way to leverage distributed data while preserving confidentiality. However, this setting introduces fundamental challenges: (i)
privacy leakage of personally identifiable information (PII) due to LLM memorization, and (ii) a persistent tension between global generalization and local utility under heterogeneous data. Existing defenses, such as data sanitization and differential
privacy, reduce leakage but often degrade downstream performance. We propose SecureGate, a
privacy-aware
federated fine-tuning framework for LLMs that provides fine-grained
privacy control without sacrificing utility. SecureGate employs a dual-adapter LoRA architecture: a secure adapter that learns sanitized, globally shareable representations, and a revealing adapter that captures sensitive, organization-specific knowledge. A
token-controlled gating module selectively activates these adapters at inference time, enabling controlled information disclosure without retraining. Extensive experiments across multiple LLMs and real-world
datasets show that SecureGate improves task utility while substantially reducing PII leakage, achieving up to a 31.66X reduction in inference attack accuracy and a 17.07X reduction in extraction recall for unauthorized requests. Additionally, it maintains 100% routing reliability to the correct adapter and incurs only minimal computational and communication overhead.
Read the full abstract ▾
Cryptography and Security
MELT: A Behavioral Trace Dataset for High-Risk Memecoin Launch Detection
Sihao Hu, Selim Furkan Tekin, Yichang Xu et al. (+1 more)
Launchpads have become the dominant mechanism for issuing memecoins, exposing investors to a new class of high-risk launches that existing rug-pull detection methods cannot capture. We argue that detecting these threats requires structured behavioral traces that underlie raw heterogeneous blockchain data, i.e., how insiders accumulate, coordinate, and unwind positions. To enable such analysis, we introduce MELT (MEmecoin Launch Trace, the first behavioral trace
dataset for analyzing and detecting high-risk memecoin launches on Solana. MELT covers 41k+ memecoin launches with 200M+ transactions parsed into typed behavioral records that distinguish swaps, wash trades, transfers, and mints. Beyond per-account behaviors, MELT contributes bundle-trace data that links accounts controlled by the same entity, revealing that, on average, 36.5% of
token supply is held by coordinated accounts, a concealment strategy that disguises the true ownership concentration from unsuspecting buyers. On top of these traces, MELT provides 122 behavioral features and risk-level annotations, enabling supervised learning at a population scale. We
benchmark representative ML models on the high-risk launch detection task. Integrating their predictions into a simple memecoin selection strategy reduces investment loss significantly, demonstrating that behavioral traces can be translated into risk mitigation. Our
dataset and code is available at https://github.com/git-disl/MELT.
Read the full abstract ▾
All authors Sihao Hu, Selim Furkan Tekin, Yichang Xu, Ling Liu
Cryptography and Security
Backdooring Bias in Large Language Models
Anudeep Das, Prach Chantasantitam, Gurjot Singh et al. (+3 more)
Large
language models (LLMs) are increasingly deployed in settings where inducing a bias toward a certain topic can have significant consequences, and
backdoor attacks can be used to produce such models. Prior work on
backdoor attacks has largely focused on a black-box threat model, with an adversary targeting the model builder's LLM. However, in the bias manipulation setting, the model builder themselves could be the adversary, warranting a white-box threat model where the attacker's ability to poison, and manipulate the poisoned data is substantially increased. Furthermore, despite growing research in semantically-triggered
backdoors, most studies have limited themselves to syntactically-triggered attacks. Motivated by these limitations, we conduct an analysis consisting of over 1000 evaluations using higher poisoning ratios and greater data augmentation to gain a better understanding of the potential of syntactically- and semantically-triggered
backdoor attacks in a white-box setting. In addition, we study whether two representative defense paradigms, model-intrinsic and model-extrinsic
backdoor removal, are able to mitigate these attacks. Our analysis reveals numerous new findings. We discover that while both syntactically- and semantically-triggered attacks can effectively induce the target behaviour, and largely preserve utility, semantically-triggered attacks are generally more effective in inducing negative biases, while both
backdoor types struggle with causing positive biases. Furthermore, while both defense types are able to mitigate these
backdoors, they either result in a substantial drop in utility, or require high computational overhead.
Read the full abstract ▾
All authors Anudeep Das, Prach Chantasantitam, Gurjot Singh, Lipeng He, Mariia Ponomarenko, Florian Kerschbaum
Cryptography and Security
Unsafer in Many Turns: Benchmarking and Defending Multi-Turn Safety Risks in Tool-Using Agents
Xu Li, Simon Yu, Minzhou Pan et al. (+5 more)
LLM-based
agents are becoming increasingly capable, yet their safety lags behind. This creates a gap between what
agents can do and should do. This gap widens as
agents engage in multi-turn interactions and employ diverse tools, introducing new risks overlooked by existing
benchmarks. To systematically scale safety testing into multi-turn, tool-realistic settings, we propose a principled taxonomy that transforms single-turn harmful tasks into multi-turn attack sequences. Using this taxonomy, we construct MT-AgentRisk (Multi-Turn
Agent Risk
Benchmark), the first
benchmark to evaluate multi-turn tool-using
agent safety. Our experiments reveal substantial safety degradation: the Attack Success Rate (ASR) increases by 16% on average across open and closed models in multi-turn settings. To close this gap, we propose ToolShield, a training-free, tool-agnostic, self-exploration defense: when encountering a new tool, the
agent autonomously generates test cases, executes them to observe downstream effects, and distills safety experiences for deployment. Experiments show that ToolShield effectively reduces ASR by 30% on average in multi-turn interactions. Our code is available at https://github.com/CHATS-lab/ToolShield.
Read the full abstract ▾
All authors Xu Li, Simon Yu, Minzhou Pan, Yiyou Sun, Bo Li, Dawn Song, Xue Lin, Weiyan Shi
Cryptography and Security
Assessing Spear-Phishing Website Generation in Large Language Model Coding Agents
Tailia Malloy and Tegawende F. Bissyande
Large
Language Models are expanding beyond being a tool humans use and into independent
agents that can observe an environment, reason about solutions to problems, make changes that impact those environments, and understand how their actions impacted their environment. One of the most common applications of these LLM
Agents is in computer programming, where
agents can successfully work alongside humans to generate code while controlling programming environments or networking systems. However, with the increasing ability and complexity of these
agents comes dangers about the potential for their misuse. A concerning application of LLM
agents is in the domain cybersecurity, where they have the potential to greatly expand the threat imposed by attacks such as social engineering. This is due to the fact that LLM
Agents can work autonomously and perform many tasks that would normally require time and effort from skilled human programmers. While this threat is concerning, little
attention has been given to assessments of the capabilities of LLM coding
agents in generating code for social engineering attacks. In this work we compare different LLMs in their ability and willingness to produce potentially dangerous code bases that could be misused by cyberattackers. The result is a
dataset of 200 website code bases and logs from 40 different LLM coding
agents. Analysis of models shows which metrics of LLMs are more and less correlated with performance in generating spear-phishing sites. Our analysis and the
dataset we present will be of interest to researchers and practitioners concerned in defending against the potential misuse of LLMs in spear-phishing.
Read the full abstract ▾
Cryptography and Security · Cross-listed from cs.DC
Bloom Filter Look-Up Tables for Private and Secure Distributed Databases in Web3 (Revised Version)
Shlomi Dolev, Ehud Gudes and Daniel Shlomo
The rapid growth of decentralized systems in theWeb3 ecosystem has introduced numerous challenges, particularly in ensuring data security,
privacy, and scalability [3, 8]. These systems rely heavily on distributed architectures, requiring robust mechanisms to manage data and interactions among participants securely. One critical aspect of decentralized systems is key management, which is essential for encrypting files, securing database segments, and enabling private transactions. However, securely managing cryptographic keys in a distributed environment poses significant risks, especially when nodes in the network can be compromised [9]. This research proposes a decentralized database scheme specifically designed for secure and private key management. Our approach ensures that cryptographic keys are not stored explicitly at any location, preventing their discovery even if an attacker gains control of multiple nodes. Instead of traditional storage, keys are encoded and distributed using the BFLUT (Bloom Filter for Private Look-Up Tables)
algorithm [7], which enables secure
retrieval without direct exposure. The system leverages OrbitDB [4], IPFS [1], and IPNS [10] for decentralized data management, providing robust support for consistency, scalability, and simultaneous updates. By combining these technologies, our scheme enhances both security and
privacy while maintaining high performance and reliability. Our findings demonstrate the system's capability to securely manage keys, prevent unauthorized access, and ensure
privacy, making it a foundational solution for Web3 applications requiring decentralized security.
Read the full abstract ▾
Cryptography and Security
In-Context Autonomous Network Incident Response: An End-to-End Large Language Model Agent Approach
Yiran Gao, Kim Hammar and Tao Li
Rapidly evolving cyberattacks demand incident response systems that can autonomously learn and adapt to changing threats. Prior work has extensively explored the reinforcement learning approach, which involves learning response strategies through extensive simulation of the incident. While this approach can be effective, it requires handcrafted modeling of the simulator and suppresses useful semantics from raw system logs and alerts. To address these limitations, we propose to leverage large
language models' (LLM) pre-trained security knowledge and in-context learning to create an end-to-end agentic solution for incident response planning. Specifically, our
agent integrates four functionalities, perception,
reasoning, planning, and action, into one lightweight LLM (14b model). Through fine-tuning and chain-of-thought
reasoning, our LLM
agent is capable of processing system logs and inferring the underlying network state (perception), updating its
conjecture of attack models (
reasoning), simulating consequences under different response strategies (planning), and generating an effective response (action). By comparing LLM-simulated outcomes with actual observations, the LLM
agent repeatedly refines its attack
conjecture and corresponding response, thereby demonstrating in-context adaptation. Our agentic approach is free of modeling and can run on commodity hardware. When evaluated on incident logs reported in the literature, our
agent achieves recovery up to 23% faster than those of frontier LLMs.
Read the full abstract ▾
Cryptography and Security
TrustMee: Self-Verifying Remote Attestation Evidence
Parsa Sadri Sinaki, Zainab Ahmad, Wentao Xie et al. (+3 more)
Remote attestation allows a TEE to attest its own state to a remote party, and is used in the Confidential Computing ecosystem to provide assurance that data and code are available only to authorized hardware and software. This functionality can then be incorporated into higher-level platforms, allowing workloads to attest themselves to a remote party. However, supporting each new platform enlarges a Verifier's trusted computing base, since it must include code to verify the attestation evidence from each platform, often performing risky operations e.g., binary parsing. This means that emerging or niche Attester platforms cannot be supported by standard Verifier software, preventing them from interacting with the broader confidential computing ecosystem. We introduce self-verifying remote attestation evidence. Each attestation bundle identifies its verification logic in the form of a WebAssembly component that is downloaded by the Verifier and executed. This approach transforms evidence verification into a platform-agnostic functionality that is implemented once for all platforms: the Verifier executes the supplied verification logic to validate the evidence and incorporates its hash and, when available, the signer's public key as identity claims into the attestation result. As a result, Verifiers can validate attestation evidence without any platform-specific code; the verification logic is just another measurement whose reference value can be checked with existing mechanisms. We implement this concept as TrustMee, a platform-agnostic verification driver for the Trustee framework. We demonstrate self-verifying evidence for AMD SNP, Intel TDX, Intel SGX, Kata
agent-policy appraisal, and ReCFA control-flow attestations, producing attestation claims in the standard EAT format. The last two are part of the software stack, and not supported by existing Verifiers such as Trustee.
Read the full abstract ▾
All authors Parsa Sadri Sinaki, Zainab Ahmad, Wentao Xie, Merlijn Sebrechts, Jimmy Kjällman, Lachlan J. Gunn
Cryptography and Security · Cross-listed from cs.LG
Backdoor Attacks on Contrastive Continual Learning for IoT Systems
Alfous Tim and Kuniyilh Simi D
The Internet of Things (IoT) systems increasingly depend on continual learning to adapt to non-stationary environments. These environments can include factors such as sensor drift, changing user behavior, device aging, and
adversarial dynamics. Contrastive continual learning (CCL) combines contrastive representation learning with incremental adaptation, enabling robust feature reuse across tasks and domains. However, the
geometric nature of contrastive objectives, when paired with replay-based rehearsal and stability-preserving regularization, introduces new security vulnerabilities. Notably,
backdoor attacks can exploit
embedding alignment and replay reinforcement, enabling the implantation of persistent malicious behaviors that endure through updates and deployment cycles. This paper provides a comprehensive analysis of
backdoor attacks on CCL within IoT systems. We formalize the objectives of
embedding-level attacks, examine persistence mechanisms unique to IoT deployments, and develop a layered taxonomy tailored to IoT. Additionally, we compare vulnerabilities across various learning paradigms and evaluate defense strategies under IoT constraints, including limited
memory, edge computing, and
federated aggregation. Our findings indicate that while CCL is effective for enhancing adaptive IoT intelligence, it may also elevate long-lived representation-level threats if not adequately secured.
Read the full abstract ▾
Cryptography and Security
Cryptographic Choreographies
Sebastian Mödersheim, Simon Lund, Alessandro Bruni et al. (+2 more)
We present CryptoChoreo, a choreography
language for the specification of cryptographic protocols. Choreographies can be regarded as an extension of Alice-and-Bob notation, providing an intuitive high-level view of the protocol as a whole (rather than specifying each protocol role in isolation). The extensions over standard Alice-and-Bob notation that we consider are non-deterministic choice, conditional branching, and mutable long-term
memory. We define the semantics of CryptoChoreo by translation to a process calculus. This semantics entails an understanding of the protocol: it determines how
agents parse and check incoming messages and how they construct outgoing messages, in the presence of an arbitrary algebraic theory and non-deterministic choices made by other
agents. While this semantics entails algebraic problems that are in general undecidable, we give an implementation for a representative theory. We connect this translation to ProVerif and show on a number of case studies that the approach is practically feasible.
Read the full abstract ▾
All authors Sebastian Mödersheim, Simon Lund, Alessandro Bruni, Marco Carbone, Rosario Giustolisi
Cryptography and Security
Neighborhood Blending: A Lightweight Inference-Time Defense Against Membership Inference Attacks
Osama Zafar, Shaojie Zhan, Tianxi Ji et al. (+1 more)
In recent years, the widespread adoption of Machine Learning as a Service (MLaaS), particularly in sensitive environments, has raised considerable
privacy concerns. Of particular importance are membership inference attacks (MIAs), which exploit behavioral discrepancies between training and non-training data to determine whether a specific record was included in the model's training set, thereby presenting significant
privacy risks. Although existing defenses, such as
adversarial regularization, DP-SGD, and MemGuard, assist in mitigating these threats, they often entail trade-offs such as compromising utility, increased computational requirements, or inconsistent protection against diverse attack vectors. In this paper, we introduce a novel inference-time defense mechanism called Neighborhood Blending, which mitigates MIAs without retraining the model or incurring significant computational overhead. Our approach operates post-training by smoothing the model's confidence outputs based on the neighborhood of a queried sample. By averaging predictions from similar training samples selected using differentially private sampling, our method establishes a consistent confidence pattern, rendering members and non-members indistinguishable to an adversary while maintaining high utility. Significantly, Neighborhood Blending maintains label integrity (zero label loss) and ensures high utility through an adaptive, "pay-as-you-go" distortion strategy. It is a model-agnostic approach that offers a practical, lightweight solution that enhances
privacy without sacrificing model utility. Through extensive experiments across diverse
datasets and models, we demonstrate that our defense significantly reduces MIA success rates while preserving model performance, outperforming existing post-hoc defenses like MemGuard and training-time techniques like DP-SGD in terms of utility retention.
Read the full abstract ▾
All authors Osama Zafar, Shaojie Zhan, Tianxi Ji, Erman Ayday
Cryptography and Security · Cross-listed from cs.NI
Chimera: Neuro-Symbolic Attention Primitives for Trustworthy Dataplane Intelligence
Rong Fu, Xiaowen Ma, Kun Liu et al. (+8 more)
Deploying expressive learning models directly on programmable dataplanes promises line-rate, low-latency traffic analysis but remains hindered by strict hardware constraints and the need for predictable, auditable behavior. Chimera introduces a principled framework that maps
attention-oriented neural computations and symbolic constraints onto dataplane primitives, enabling trustworthy inference within the match-action pipeline. Chimera combines a kernelized, linearized
attention approximation with a two-layer key-selection hierarchy and a cascade fusion mechanism that enforces hard symbolic guarantees while preserving neural expressivity. The design includes a hardware-aware mapping protocol and a two-timescale update scheme that together permit stable, line-rate operation under realistic dataplane budgets. The paper presents the Chimera architecture, a hardware mapping strategy, and empirical evidence showing that neuro-symbolic
attention primitives can achieve high-fidelity inference within the resource envelope of commodity programmable switches.
Read the full abstract ▾
All authors Rong Fu, Xiaowen Ma, Kun Liu, Wangyu Wu, Ziyu Kong, Jia Yee Tan, Tailong Luo, Xianda Li, Yongtai Liu, Youjin Wang, Simon Fong
Cryptography and Security
Reliable Hierarchical Operating System Fingerprinting via Conformal Prediction
Rubén Pérez-Jove, Osvaldo Simeone, Alejandro Pazos et al. (+1 more)
Operating System (OS) fingerprinting is critical for network security, but conventional methods do not provide formal uncertainty quantification mechanisms. Conformal Prediction (CP) could be directly wrapped around existing methods to obtain prediction sets with guaranteed coverage. However, a direct application of CP would treat OS identification as a flat classification problem, ignoring the natural taxonomic structure of OSs and providing brittle point predictions. This work addresses these limitations by introducing and evaluating two distinct structured CP strategies: level-wise CP (L-CP), which calibrates each hierarchy level independently, and projection-based CP (P-CP), which ensures structural consistency by projecting leaf-level sets upwards. Our results demonstrate that, while both methods satisfy validity guarantees, they expose a fundamental trade-off between level-wise efficiency and structural consistency. L-CP yields tighter prediction sets suitable for human forensic analysis but suffers from taxonomic inconsistencies. Conversely, P-CP guarantees hierarchically consistent, nested sets ideal for automated policy enforcement, albeit at the cost of reduced efficiency at coarser levels.
Read the full abstract ▾
All authors Rubén Pérez-Jove, Osvaldo Simeone, Alejandro Pazos, Jose Vázquez-Naya
Cryptography and Security · Cross-listed from cs.CL
RAT-Bench: A Comprehensive Benchmark for Text Anonymization
Nataša Krčo, Zexi Yao, Matthieu Meeus et al. (+1 more)
Data containing personal information is increasingly used to train, fine-tune, or query Large
Language Models (LLMs). Text is typically scrubbed of identifying information prior to use, often with tools such as Microsoft's Presidio or Anthropic's PII purifier. These tools have traditionally been evaluated on their ability to remove specific identifiers (e.g., names), yet their effectiveness at preventing re-identification remains unclear. We introduce RAT-Bench, a comprehensive
benchmark for text anonymization tools based on re-identification risk. Using U.S. demographic statistics, we generate synthetic text containing various direct and indirect identifiers across domains,
languages, and difficulty levels. We evaluate a range of NER- and LLM-based text anonymization tools and, based on the attributes an LLM-based attacker is able to correctly infer from the anonymized text, we report the risk of re-identification in the U.S. population, while properly accounting for the disparate impact of identifiers. We find that, while capabilities vary widely, even the best tools are far from perfect in particular when direct identifiers are not written in standard ways and when indirect identifiers enable re-identification. Overall we find LLM-based anonymizers, including new iterative anonymizers, to provide a better
privacy-utility trade-off albeit at a higher computational cost. Importantly, we also find them to work well across
languages. We conclude with recommendations for future anonymization tools and will release the
benchmark and encourage community efforts to expand it, in particular to other geographies.
Read the full abstract ▾
All authors Nataša Krčo, Zexi Yao, Matthieu Meeus, Yves-Alexandre de Montjoye
Cryptography and Security
Fool Me If You Can: On the Robustness of Binary Code Similarity Detection Models against Semantics-preserving Transformations
Jiyong Uhm, Minseok Kim, Michalis Polychronakis et al. (+1 more)
Binary code analysis plays an essential role in cybersecurity, facilitating reverse engineering to reveal the inner workings of programs in the absence of source code. Traditional approaches, such as static and dynamic analysis, extract valuable insights from stripped binaries, but often demand substantial expertise and manual effort. Recent advances in deep learning have opened promising opportunities to enhance binary analysis by capturing latent features and disclosing underlying code semantics. Despite the growing number of binary analysis models based on machine learning, their robustness to
adversarial code transformations at the binary level remains underexplored. We evaluate the robustness of deep learning models for the task of binary code similarity detection (BCSD) under semantics-preserving transformations. The unique nature of machine instructions presents distinct challenges compared to the typical input perturbations found in other domains. We introduce asmFooler, a system that evaluates the resilience of BCSD models using a diverse set of
adversarial code transformations that preserve functional semantics. We construct a
dataset of 9,565 binary variants from 620 baseline samples by applying eight semantics-preserving transformations across six representative BCSD models. Our major findings highlight several key insights: i) model robustness relies on the processing pipeline, including code pre-processing, architecture, and feature selection; ii)
adversarial transformation effectiveness is bounded by a budget shaped by model-specific constraints like input size and instruction expressive capacity; iii) well-crafted transformations can be highly effective with minimal perturbations; and iv) such transformations efficiently disrupt model decisions (e.g., misleading to false positives or false negatives) by focusing on semantically significant instructions.
Read the full abstract ▾
All authors Jiyong Uhm, Minseok Kim, Michalis Polychronakis, Hyungjoon Koo
Cryptography and Security
TensorCommitments: A Lightweight Verifiable Inference for Large Language Models
Oguzhan Baser, Elahe Sadeghi, Eric Wang et al. (+5 more)
Most large
language models (LLMs) run on external clouds: users send a
prompt, pay for inference, and must trust that the remote GPU executes the LLM without any
adversarial tampering. We critically ask how to achieve verifiable LLM inference, where a prover (the service) must convince a verifier (the client) that an inference was run correctly without rerunning the LLM. Existing cryptographic works are too slow at the LLM scale, while non-cryptographic ones require a strong verifier GPU. We propose TensorCommitments (TCs), a tensor-native proof-of-inference scheme. TC binds the LLM inference to a commitment, an irreversible tag that breaks under tampering, organized in our multivariate Terkle Trees. For LLaMA2, TC adds only 0.97% prover and 0.12% verifier time over inference while improving robustness to tailored attacks by up to 48% over the best prior work requiring a verifier GPU.
Read the full abstract ▾
All authors Oguzhan Baser, Elahe Sadeghi, Eric Wang, Nico Vergauwen, Sam Kazemian, Hong Kang, Sandeep P. Chinchali, Sriram Vishwanath
Cryptography and Security
RADAR: Exposing Unlogged NoSQL Operations
Mahfuzul I. Nissan and James Wagner
The widespread adoption of NoSQL databases has made digital forensics increasingly difficult as storage formats are diverse and often opaque, and audit logs cannot be assumed trustworthy when privileged insiders, such as DevOps or administrators, can disable, suppress, or manipulate logging to conceal activity. We present RADAR (Record & Artifact Detection,
Alignment & Reporting), a log-adversary-aware framework that derives forensic ground truth by cross-referencing low-level storage artifacts against high-level application logs. RADAR analyzes artifacts reconstructed by the Automated NoSQL Carver (ANOC), which infers layouts and carves records directly from raw disk bytes, bypassing database APIs and the management system entirely, thereby treating physical storage as the independent evidence source. RADAR then reconciles carved artifacts with the audit log to identify delta artifacts such as unlogged insertions, silent deletions, and field-level updates that exist on disk but are absent from the logical history. We evaluate RADAR across ten NoSQL engines, including BerkeleyDB, LMDB, MDBX, etcd, ZODB, Durus, LiteDB, Realm, RavenDB, and NitriteDB, spanning key-value and document stores and multiple storage designs, e.g., copy-on-write/MVCC, B/B+ tree, and append-only. Under log-evasion scenarios, such as log suppression and post-maintenance attacks, including cases where historical bytes are pruned, RADAR consistently exposes unattributed operations while sustaining 31.7-397 MB/min processing throughput, demonstrating the feasibility of log-independent, trustworthy NoSQL forensics.
Read the full abstract ▾
Cryptography and Security · Cross-listed from cs.SE
Favia: Forensic Agent for Vulnerability-fix Identification and Analysis
André Storhaug, Jiamou Sun and Jingyue Li
Identifying vulnerability-fixing commits corresponding to disclosed CVEs is essential for secure software maintenance but remains challenging at scale, as large repositories contain millions of commits of which only a small fraction address security issues. Existing automated approaches, including traditional machine learning techniques and recent large
language model (LLM)-based methods, often suffer from poor precision-recall trade-offs. Frequently evaluated on randomly sampled commits, we uncover that they are substantially underestimating real-world difficulty, where candidate commits are already security-relevant and highly similar. We propose Favia, a forensic,
agent-based framework for vulnerability-fix identification that combines scalable candidate ranking with deep and iterative semantic
reasoning. Favia first employs an efficient ranking stage to narrow the search space of commits. Each commit is then rigorously evaluated using a ReAct-based LLM
agent. By providing the
agent with a pre-commit repository as environment, along with specialized tools, the
agent tries to localize vulnerable components, navigates the codebase, and establishes causal
alignment between code changes and vulnerability root causes. This evidence-driven process enables robust identification of indirect, multi-file, and non-trivial fixes that elude single-pass or similarity-based methods. We evaluate Favia on CVEVC, a large-scale
dataset we made that comprises over 8 million commits from 3,708 real-world repositories, and show that it consistently outperforms state-of-the-art traditional and LLM-based baselines under realistic candidate selection, achieving the strongest precision-recall trade-offs and highest F1-scores.
Read the full abstract ▾