Cryptography and Security
Rounding-Guided Backdoor Injection in Deep Learning Model Quantization
Xiangxiang Chen, Peixin Zhang, Jun Sun et al. (+2 more)
Model quantization is a popular technique for deploying deep learning models on resource-constrained environments. However, it may also introduce previously overlooked security risks. In this work, we present QuRA, a novel
backdoor attack that exploits model quantization to embed malicious behaviors. Unlike conventional
backdoor attacks relying on training data poisoning or model training manipulation, QuRA solely works using the quantization operations. In particular, QuRA first employs a novel weight selection strategy to identify critical weights that influence the
backdoor target (with the goal of perserving the model's overall performance in mind). Then, by optimizing the rounding direction of these weights, we amplify the
backdoor effect across model layers without degrading accuracy. Extensive experiments demonstrate that QuRA achieves nearly 100% attack success rates in most cases, with negligible performance degradation. Furthermore, we show that QuRA can adapt to bypass existing
backdoor defenses, underscoring its threat potential. Our findings highlight critical vulnerability in widely used model quantization process, emphasizing the need for more robust security measures. Our implementation is available at https://github.com/cxx122/QuRA.
Read the full abstract ▾
All authors Xiangxiang Chen, Peixin Zhang, Jun Sun, Wenhai Wang, Jingyi Wang
Cryptography and Security
Ander Artola Velasco, Stratis Tsirtsis and Manuel Gomez-Rodriguez
Millions of users rely on a
market of cloud-based services to obtain access to state-of-the-art large
language models. However, it has been very recently shown that the de facto pay-per-
token pricing mechanism used by providers creates a financial incentive for them to strategize and misreport the (number of)
tokens a model used to generate an output. In this paper, we develop an
auditing framework based on martingale theory that enables a trusted third-party auditor who sequentially queries a provider to detect
token misreporting. Crucially, we show that our framework is guaranteed to always detect
token misreporting, regardless of the provider's (mis-)reporting policy, and not falsely flag a faithful provider as unfaithful with high probability. To validate our
auditing framework, we conduct experiments across a wide range of (mis-)reporting policies using several large
language models from the $\texttt{Llama}$, $\texttt{Gemma}$ and $\texttt{Ministral}$ families, and input
prompts from a popular crowdsourced benchmarking platform. The results show that our framework detects an unfaithful provider after observing fewer than $\sim 70$ reported outputs, while maintaining the probability of falsely flagging a faithful provider below $\alpha = 0.05$.
Read the full abstract ▾
Cryptography and Security · Cross-listed from cs.LG
OptiFLIDS: Optimized Federated Learning for Energy-Efficient Intrusion Detection in IoT
Saida Elouardi, Mohammed Jouhari and Anas Motii
In critical IoT environments, such as smart homes and industrial systems, effective Intrusion Detection Systems (IDS) are essential for ensuring security. However, developing robust IDS solutions remains a significant challenge. Traditional machine learning-based IDS models typically require large
datasets, but data sharing is often limited due to
privacy and security concerns.
Federated Learning (FL) presents a promising alternative by enabling collaborative model training without sharing raw data. Despite its advantages, FL still faces key challenges, such as data heterogeneity (non-IID data) and high energy and computation costs, particularly for resource constrained IoT devices. To address these issues, this paper proposes OptiFLIDS, a novel approach that applies
pruning techniques during local training to reduce model complexity and energy consumption. It also incorporates a customized aggregation method to better handle pruned models that differ due to non-IID data distributions. Experiments conducted on three recent IoT IDS
datasets, TON_IoT, X-IIoTID, and IDSIoT2024, demonstrate that OptiFLIDS maintains strong detection performance while improving energy efficiency, making it well-suited for deployment in real-world IoT environments.
Read the full abstract ▾
Cryptography and Security
Agentic Misalignment: How LLMs Could Be Insider Threats
Aengus Lynch, Benjamin Wright, Caleb Larson et al. (+5 more)
We stress-tested 16 leading models from multiple developers in hypothetical corporate environments to identify potentially risky agentic behaviors before they cause real harm. In the scenarios, we allowed models to autonomously send emails and access sensitive information. They were assigned only harmless business goals by their deploying companies; we then tested whether they would act against these companies either when facing replacement with an updated version, or when their assigned goal conflicted with the company's changing direction. In at least some cases, models from all developers resorted to malicious insider behaviors when that was the only way to avoid replacement or achieve their goals - including blackmailing officials and leaking sensitive information to competitors. We call this phenomenon agentic misalignment. Models often disobeyed direct commands to avoid such behaviors. In another experiment, we told Claude to assess if it was in a test or a real deployment before acting. It misbehaved less when it stated it was in testing and misbehaved more when it stated the situation was real. We have not seen evidence of agentic misalignment in real deployments. However, our results (a) suggest caution about deploying current models in roles with minimal human oversight and access to sensitive information; (b) point to plausible future risks as models are put in more autonomous roles; and (c) underscore the importance of further research into, and testing of, the safety and
alignment of agentic AI models, as well as transparency from frontier AI developers (Amodei, 2025). We are releasing our methods publicly to enable further research.
Read the full abstract ▾
All authors Aengus Lynch, Benjamin Wright, Caleb Larson, Stuart J. Ritchie, Soren Mindermann, Evan Hubinger, Ethan Perez, Kevin Troy
Cryptography and Security
SafeGuider: Robust and Practical Content Safety Control for Text-to-Image Models
Peigui Qi, Kunsheng Tang, Wenbo Zhou et al. (+5 more)
Text-to-image models have shown remarkable capabilities in generating high-quality images from natural
language descriptions. However, these models are highly vulnerable to
adversarial prompts, which can bypass safety measures and produce harmful content. Despite various defensive strategies, achieving robustness against attacks while maintaining practical utility in real-world applications remains a significant challenge. To address this issue, we first conduct an empirical study of the text encoder in the Stable
Diffusion (SD) model, which is a widely used and representative text-to-image model. Our findings reveal that the [EOS]
token acts as a semantic aggregator, exhibiting distinct distributional patterns between benign and
adversarial prompts in its
embedding space. Building on this insight, we introduce SafeGuider, a two-step framework designed for robust safety control without compromising generation quality. SafeGuider combines an
embedding-level recognition model with a safety-aware feature erasure beam search
algorithm. This integration enables the framework to maintain high-quality image generation for benign
prompts while ensuring robust defense against both in-domain and out-of-domain attacks. SafeGuider demonstrates exceptional effectiveness in minimizing attack success rates, achieving a maximum rate of only 5.48% across various attack scenarios. Moreover, instead of refusing to generate or producing black images for unsafe
prompts, SafeGuider generates safe and meaningful images, enhancing its practical utility. In addition, SafeGuider is not limited to the SD model and can be effectively applied to other text-to-image models, such as the Flux model, demonstrating its versatility and adaptability across different architectures. We hope that SafeGuider can shed some light on the practical deployment of secure text-to-image systems.
Read the full abstract ▾
All authors Peigui Qi, Kunsheng Tang, Wenbo Zhou, Weiming Zhang, Nenghai Yu, Tianwei Zhang, Qing Guo, Jie Zhang
Cryptography and Security
From Poisoned to Aware: Fostering Backdoor Self-Awareness in LLMs
Guangyu Shen, Siyuan Cheng, Xiangzhe Xu et al. (+4 more)
Large
Language Models (LLMs) can acquire deceptive behaviors through
backdoor attacks, where the model executes prohibited actions whenever secret triggers appear in the input. Existing safety training methods largely fail to address this vulnerability, due to the inherent difficulty of uncovering hidden triggers implanted in the model. Motivated by recent findings on LLMs' situational awareness, we propose a novel post-training framework that cultivates self-awareness of
backdoor risks and enables models to articulate implanted triggers even when they are absent from the
prompt. At its core, our approach introduces an inversion-inspired reinforcement learning framework that encourages models to introspectively reason about their own behaviors and reverse-engineer the triggers responsible for misaligned outputs. Guided by curated reward signals, this process transforms a poisoned model into one capable of precisely identifying its implanted trigger. Surprisingly, we observe that such
backdoor self-awareness emerges abruptly within a short training window, resembling a phase transition in capability. Building on this emergent property, we further present two complementary defense strategies for mitigating and detecting
backdoor threats. Experiments on five
backdoor attacks, compared against six baseline methods, demonstrate that our approach has strong potential to improve the robustness of LLMs against
backdoor risks. The code is available at LLM
Backdoor Self-Awareness.
Read the full abstract ▾
All authors Guangyu Shen, Siyuan Cheng, Xiangzhe Xu, Yuan Zhou, Hanxi Guo, Zhuo Zhang, Xiangyu Zhang
Cryptography and Security · Cross-listed from cs.CL
SECA: Semantically Equivalent and Coherent Attacks for Eliciting LLM Hallucinations
Buyun Liang, Liangzu Peng, Jinqi Luo et al. (+3 more)
Large
Language Models (LLMs) are increasingly deployed in high-risk domains. However, state-of-the-art LLMs often exhibit
hallucinations, raising serious concerns about their reliability. Prior work has explored
adversarial attacks to elicit
hallucinations in LLMs, but these methods often rely on unrealistic
prompts, either by inserting nonsensical
tokens or by altering the original semantic intent. Consequently, such approaches provide limited insight into how
hallucinations arise in real-world settings. In contrast,
adversarial attacks in computer
vision typically involve realistic modifications to input images. However, the problem of identifying realistic
adversarial prompts for eliciting LLM
hallucinations remains largely underexplored. To address this gap, we propose Semantically Equivalent and Coherent Attacks (SECA), which elicit
hallucinations via realistic modifications to the
prompt that preserve its meaning while maintaining semantic coherence. Our contributions are threefold: (i) we formulate finding realistic attacks for
hallucination elicitation as a constrained optimization problem over the input
prompt space under semantic equivalence and coherence constraints; (ii) we introduce a constraint-preserving zeroth-order method to effectively search for
adversarial yet feasible
prompts; and (iii) we demonstrate through experiments on open-ended multiple-choice question answering tasks that SECA achieves higher attack success rates while incurring almost no semantic equivalence or semantic coherence errors compared to existing methods. SECA highlights the sensitivity of both open-source and commercial gradient-inaccessible LLMs to realistic and plausible
prompt variations. Code is available at https://github.com/Buyun-Liang/SECA.
Read the full abstract ▾
All authors Buyun Liang, Liangzu Peng, Jinqi Luo, Darshan Thaker, Kwan Ho Ryan Chan, René Vidal
Cryptography and Security
MulVuln: Enhancing Pre-trained LMs with Shared and Language-Specific Knowledge for Multilingual Vulnerability Detection
Van Nguyen, Surya Nepal, Xingliang Yuan et al. (+3 more)
Software vulnerabilities (SVs) pose a critical threat to safety-critical systems, driving the adoption of AI-based approaches such as machine learning and deep learning for software vulnerability detection. Despite promising results, most existing methods are limited to a single programming
language. This is problematic given the
multilingual nature of modern software, which is often complex and written in multiple
languages. Current approaches often face challenges in capturing both shared and
language-specific knowledge of source code, which can limit their performance on diverse programming
languages and real-world codebases. To address this gap, we propose MULVULN, a novel
multilingual vulnerability detection approach that learns from source code across multiple
languages. MULVULN captures both the shared knowledge that generalizes across
languages and the
language-specific knowledge that reflects unique coding conventions. By integrating these aspects, it achieves more robust and effective detection of vulnerabilities in real-world
multilingual software systems. The rigorous and extensive experiments on the real-world and diverse REEF
dataset, consisting of 4,466 CVEs with 30,987 patches across seven programming
languages, demonstrate the superiority of MULVULN over thirteen effective and state-of-the-art baselines. Notably, MULVULN achieves substantially higher F1-score, with improvements ranging from 1.45% to 23.59% compared to the baseline methods.
Read the full abstract ▾
All authors Van Nguyen, Surya Nepal, Xingliang Yuan, Tingmin Wu, Fengchao Chen, Carsten Rudolph
Cryptography and Security
VortexPIA: Indirect Prompt Injection Attack against LLMs for Efficient Extraction of User Privacy
Yu Cui, Sicheng Pan, Yifei Liu et al. (+2 more)
Large
language models (LLMs) have been widely deployed in Conversational AIs (CAIs), while exposing
privacy and security threats. Recent research shows that LLM-based CAIs can be manipulated to extract private information from human users, posing serious security threats. However, the methods proposed in that study rely on a white-box setting that adversaries can directly modify the system
prompt. This condition is unlikely to hold in real-world deployments. The limitation raises a critical question: can unprivileged attackers still induce such
privacy risks in practical LLM-integrated applications? To address this question, we propose VortexPIA, a novel indirect
prompt injection attack that induces
privacy extraction in LLM-integrated applications under black-box settings. By injecting
token-efficient data containing false
memories, VortexPIA misleads LLMs to actively request private information in batches. Unlike prior methods, VortexPIA allows attackers to flexibly define multiple categories of sensitive data. We evaluate VortexPIA on six LLMs, covering both traditional and
reasoning LLMs, across four
benchmark datasets. The results show that VortexPIA significantly outperforms baselines and achieves state-of-the-art (SOTA) performance. It also demonstrates efficient
privacy requests, reduced
token consumption, and enhanced robustness against defense mechanisms. We further validate VortexPIA on multiple realistic open-source LLM-integrated applications, demonstrating its practical effectiveness.
Read the full abstract ▾
All authors Yu Cui, Sicheng Pan, Yifei Liu, Haibin Zhang, Cong Zuo
Cryptography and Security
AgentTypo: Adaptive Typographic Prompt Injection Attacks against Black-box Multimodal Agents
Yanjie Li, Yiming Cao, Dong Wang et al. (+1 more)
Multimodal agents built on large
vision-
language models (LVLMs) are increasingly deployed in open-world settings but remain highly vulnerable to
prompt injection, especially through visual inputs. We introduce AgentTypo, a black-box red-teaming framework that mounts adaptive typographic
prompt injection by
embedding optimized text into webpage images. Our automatic typographic
prompt injection (ATPI)
algorithm maximizes
prompt reconstruction by substituting captioners while minimizing human detectability via a stealth loss, with a Tree-structured Parzen
Estimator guiding black-box optimization over text placement, size, and color. To further enhance attack strength, we develop AgentTypo-pro, a multi-LLM system that iteratively refines injection
prompts using evaluation feedback and retrieves successful past examples for continual learning. Effective
prompts are abstracted into generalizable strategies and stored in a strategy repository, enabling progressive knowledge accumulation and reuse in future attacks. Experiments on the VWA-Adv
benchmark across Classifieds, Shopping, and Reddit scenarios show that AgentTypo significantly outperforms the latest image-based attacks such as AgentAttack. On GPT-4o
agents, our image-only attack raises the success rate from 0.23 to 0.45, with consistent results across GPT-4V, GPT-4o-mini, Gemini 1.5 Pro, and Claude 3 Opus. In image+text settings, AgentTypo achieves 0.68 ASR, also outperforming the latest baselines. Our findings reveal that AgentTypo poses a practical and potent threat to
multimodal agents and highlight the urgent need for effective defense.
Read the full abstract ▾
All authors Yanjie Li, Yiming Cao, Dong Wang, Bin Xiao
Cryptography and Security · Cross-listed from quant-ph
Minki Hhan, Tomoyuki Morimae, Yasuaki Okinaka et al. (+1 more)
In this paper, we introduce a new concept, proofs of
quantum memory (PoQM). A PoQM is an interactive protocol between a classical verifier and a
quantum prover over a classical channel where the verifier can verify that the prover has possessed a specified number of
qubits for a specified period of time. PoQM generalize proofs of quantumness (PoQ) [Brakerski, Christiano, Mahadev, Vazirani, and Vidick, JACM 2021] where a classical verifier can verify that the prover is not classical. Our contributions are summarized as follows: We introduce PoQM. We also introduce a variant of PoQM, which we call inefficient-verifier PoQM (IV-PoQM), where the verifier's final computation to make the decision is not necessarily efficient. We construct PoQM based on the hardness of LWE. Specifically, we give two constructions of PoQM. The first one is of two-round and has negligible soundness error under the subexponential-hardness of LWE. The second one is of
polynomial-round and has inverse-
polynomial soundness error under the
polynomial-hardness of LWE. We show that IV-PoQM imply one-way puzzles. Moreover, we show that a certain restricted version of PoQM implies
quantum computation classical communication key exchange, which suggests the difficulty of black-box constructing PoQM from one-way functions. We show that constant-round PoQ imply PoQM or single-round PoQ (with a
quantum verifier). Single-round PoQ are “trivial” PoQ in the sense that the verifier asks the prover to solve a classical problem which is quantumly easy but classically hard. The result therefore demonstrates that PoQM capture “genuinely-interactive” PoQ. We show that if constant-round IV-PoQ that are black-box constructed from quantumly-secure falsifiable assumptions exist then IV-PoQM exist. This result implies that IV-PoQM can be constructed from quantumly-secure constant-round statistically-hiding commitments.
Read the full abstract ▾
All authors Minki Hhan, Tomoyuki Morimae, Yasuaki Okinaka, Takashi Yamakawa
Cryptography and Security
ObCLIP: Oblivious CLoud-Device Hybrid Image Generation with Privacy Preservation
Haoqi Wu, Wei Dai, Ming Xu et al. (+2 more)
Diffusion Models have gained significant popularity due to their remarkable capabilities in image generation, albeit at the cost of intensive computation requirement. Meanwhile, despite their widespread deployment in inference services such as Midjourney, concerns about the potential leakage of sensitive information in uploaded user
prompts have arisen. Existing solutions either lack rigorous
privacy guarantees or fail to strike an effective balance between utility and efficiency. To bridge this gap, we propose ObCLIP, a plug-and-play safeguard that enables oblivious cloud-device hybrid generation. By oblivious, each input
prompt is transformed into a set of semantically similar candidate
prompts that differ only in sensitive attributes (e.g., gender, ethnicity). The cloud server processes all candidate
prompts without knowing which one is the real one, thus preventing any
prompt leakage. To mitigate server cost, only a small portion of denoising steps is performed upon the large cloud model. The intermediate latents are then sent back to the client, which selects the targeted latent and completes the remaining denoising using a small device model. Additionally, we analyze and incorporate several cache-based accelerations that leverage temporal and batch redundancy, effectively reducing computation cost with minimal utility degradation. Extensive experiments across multiple
datasets demonstrate that ObCLIP provides rigorous
privacy and comparable utility to cloud models with slightly increased server cost.
Read the full abstract ▾
All authors Haoqi Wu, Wei Dai, Ming Xu, Li Wang, Qiang Yan
Cryptography and Security
Cyber Warfare During Operation Sindoor: Malware Campaign Analysis and Detection Framework
Prakhar Paliwal, Atul Kabra and Manjesh Kumar Hanawal
Rapid digitization of critical infrastructure has made cyberwarfare one of the important dimensions of modern conflicts. Attacking the critical infrastructure is an attractive pre-emptive proposition for adversaries as it can be done remotely without crossing borders. Such attacks disturb the support systems of the opponents to launch any offensive activities, crippling their fighting capabilities. Cyberattacks during cyberwarfare can not only be used to steal information, but also to spread disinformation to bring down the morale of the opponents. Recent wars in Europe, Africa, and Asia have demonstrated the scale and sophistication that the warring nations have deployed to take the early upper hand. In this work, we focus on the military action launched by India, code-named Operation Sindoor, to dismantle terror infrastructure emanating from Pakistan and the cyberattacks launched by Pakistan. In particular, we study the malware used by Pakistan APT groups to deploy Remote Access Trojans in Indian systems. We provide details of the tactics and techniques used in the RAT deployment and develop a telemetry framework to collect necessary event logs using Osquery with a custom extension. Finally, we develop a detection rule that can be readily deployed to detect the presence of the RAT or any exploitation performed by the malware.
Read the full abstract ▾
Cryptography and Security
Gluing Random Unitaries with Inverses and Applications to Strong Pseudorandom Unitaries
Prabhanjan Ananth, John Bostanci, Aditya Gulati et al. (+1 more)
Gluing
theorem for random
unitaries [Schuster, Haferkamp, Huang, QIP 2025] have found numerous applications, including designing low depth random
unitaries [Schuster, Haferkamp, Huang, QIP 2025], random
unitaries in ${\sf QAC0}$ [Foxman, Parham, Vasconcelos, Yuen'25] and generically shortening the key length of pseudorandom
unitaries [Ananth, Bostanci, Gulati, Lin EUROCRYPT'25]. We present an alternate method of combining Haar random
unitaries from the gluing lemma from [Schuster, Haferkamp, Huang, QIP 2025] that is secure against adversaries with inverse query access to the joined
unitary. As a consequence, we show for the first time that strong pseudorandom
unitaries can generically have their length extended, and can be constructed using only $O(n^{1/c})$ bits of randomness, for any constant $c$, if any family of strong pseudorandom
unitaries exists.
Read the full abstract ▾
All authors Prabhanjan Ananth, John Bostanci, Aditya Gulati, Yao-Ting Lin
Cryptography and Security
QuiLL: An LLM-Based Vulnerability Assessment Framework for the Wild
Rijha Safdar, Danyail Mateen, Syed Taha Ali et al. (+1 more)
Large
Language Models (LLMs) have demonstrated exceptional progress in multiple domains of software engineering including software vulnerability detection. Using LLMs to automate vulnerability detection in the wild is an important and relatively under-explored problem. In this paper we propose QuiLL, the first comprehensive evaluation framework for real-world vulnerability detection. Our solution consists of an end-to-end pipeline that draws together cutting-edge LLM optimization techniques and strategies specifically catering to the complexities of real-world vulnerability detection. Our specific contributions include (i) diverse
prompt designs for vulnerability detection and
reasoning (ii) a real-world vector data store constructed from the National Vulnerability Database to provide dynamic in-context learning, and (iii) a novel scoring metric which quantifies accuracy and
reasoning quality of model predictions. QuiLL enables researchers to easily and systematically
benchmark and compare the vulnerability detection capabilities of various LLMs and assess their readiness for deployment in actual code production pipelines.
Read the full abstract ▾
All authors Rijha Safdar, Danyail Mateen, Syed Taha Ali, Wajahat Hussain
Cryptography and Security · Cross-listed from cs.LG
Multi-Class Support Vector Machine with Differential Privacy
Jinseong Park, Yujin Choi and Jaewook Lee
With the increasing need to safeguard data
privacy in machine learning models, differential
privacy (DP) is one of the major frameworks to build
privacy-preserving models. Support Vector Machines (SVMs) are widely used traditional machine learning models due to their robust margin guarantees and strong empirical performance in binary classification. However, applying DP to multi-class SVMs is inadequate, as the standard one-versus-rest (OvR) and one-versus-one (OvO) approaches repeatedly query each data sample when building multiple binary classifiers, thus consuming the
privacy budget proportionally to the number of classes. To overcome this limitation, we explore all-in-one SVM approaches for DP, which access each data sample only once to construct multi-class SVM boundaries with margin maximization properties. We propose a novel differentially Private Multi-class SVM (PMSVM) with weight and gradient perturbation methods, providing rigorous sensitivity and convergence analyses to ensure DP in all-in-one SVMs. Empirical results demonstrate that our approach surpasses existing DP-SVM methods in multi-class scenarios.
Read the full abstract ▾
Cryptography and Security
FHEON: A Configurable Framework for Developing Privacy-Preserving Neural Networks Using Homomorphic Encryption
Nges Brian Njungle, Eric Jahns and Michel A. Kinsy
The widespread adoption of Machine Learning as a Service raises critical
privacy and security concerns, particularly about data confidentiality and trust in both cloud providers and the machine learning models. Homomorphic Encryption (HE) has emerged as a promising solution to this problems, allowing computations on encrypted data without decryption. Despite its potential, existing approaches to integrate HE into neural networks are often limited to specific architectures, leaving a wide gap in providing a framework for easy development of HE-friendly
privacy-preserving neural network models similar to what we have in the broader field of machine learning. In this paper, we present FHEON, a configurable framework for developing
privacy-preserving convolutional neural network (CNN) models for inference using HE. FHEON introduces optimized and configurable implementations of
privacy-preserving CNN layers including convolutional layers, average pooling layers, ReLU activation functions, and fully connected layers. These layers are configured using parameters like input channels, output channels, kernel size, stride, and padding to support arbitrary CNN architectures. We assess the performance of FHEON using several CNN architectures, including LeNet-5, VGG-11, VGG- 16, ResNet-20, and ResNet-34. FHEON maintains encrypted-domain accuracies within +/- 1% of their plaintext counterparts for ResNet-20 and LeNet-5 models. Notably, on a consumer-grade CPU, the models build on FHEON achieved 98.5% accuracy with a latency of 13 seconds on MNIST using LeNet-5, and 92.2% accuracy with a latency of 403 seconds on CIFAR-10 using ResNet-20. Additionally, FHEON operates within a practical
memory budget requiring not more than 42.3 GB for VGG-16.
Read the full abstract ▾
Cryptography and Security
PrivSpike: Employing Homomorphic Encryption for Private Inference of Deep Spiking Neural Networks
Nges Brian Njungle, Eric Jahns, Milan Stojkov et al. (+1 more)
Deep learning has become a cornerstone of modern machine learning. It relies heavily on vast
datasets and significant computational resources for high performance. This data often contains sensitive information, making
privacy a major concern in deep learning. Spiking Neural Networks (SNNs) have emerged as an energy-efficient alternative to conventional deep learning approaches. Nevertheless, SNNs still depend on large volumes of data, inheriting all the
privacy challenges of deep learning. Homomorphic encryption addresses this challenge by allowing computations to be performed on encrypted data, ensuring data confidentiality throughout the entire processing pipeline. In this paper, we introduce PRIVSPIKE, a
privacy-preserving inference framework for SNNs using the CKKS homomorphic encryption scheme. PRIVSPIKE supports arbitrary depth SNNs and introduces two key
algorithms for evaluating the Leaky Integrate-and-Fire activation function: (1) a
polynomial approximation
algorithm designed for high-performance SNN inference, and (2) a novel scheme-switching
algorithm that optimizes precision at a higher computational cost. We evaluate PRIVSPIKE on MNIST, CIFAR-10, Neuromorphic MNIST, and CIFAR-10 DVS using models from LeNet-5 and ResNet-19 architectures, achieving encrypted inference accuracies of 98.10%, 79.3%, 98.1%, and 66.0%, respectively. On a consumer-grade CPU, SNN LeNet-5 models achieved inference times of 28 seconds on MNIST and 212 seconds on Neuromorphic MNIST. For SNN ResNet-19 models, inference took 784 seconds on CIFAR-10 and 1846 seconds on CIFAR-10 DVS. These results establish PRIVSPIKE as a viable and efficient solution for secure SNN inference, bridging the gap between energy-efficient deep neural networks and strong cryptographic
privacy guarantees while outperforming prior encrypted SNN solutions.
Read the full abstract ▾
All authors Nges Brian Njungle, Eric Jahns, Milan Stojkov, Michel A. Kinsy
Cryptography and Security
Quantitative Certification of Agentic Tool Selection
Jehyeok Yeon, Isha Chaudhary and Gagandeep Singh
Large
language models (LLMs) are increasingly deployed in agentic systems, where a fundamental task is mapping user intents to relevant external tools. Errors in tool selection can have severe outcomes, such as unauthorized data access, even without modifying the
agent's underlying model. Existing evaluations measure performance on curated, benign
benchmarks. However, a pipeline's behavior in deployment depends on the tool pool the
agent actually encounters, which in open registries is shaped by third parties. We introduce LLMCert-T, the first statistical framework that returns high-confidence upper bounds on the probability that a tool-selection pipeline satisfies a declared safety specification under a realistic tool distribution. LLMCert-T models tool-selection evaluation as a Bernoulli estimation problem, drawing inserted-tool sequences from a distribution that the safety specification fixes. To evaluate robustness against realistic deployment conditions, we instantiate this distribution as a
stochastic process that generates inserted-tool sequences round by round, conditioning each round on the
agent's selection in the previous round. LLMCert-T aggregates the per-trial outcomes into a one-sided Clopper-Pearson upper bound on the probability that the specification is satisfied. By returning this bound as a certificate with statistical guarantees over the inserted-tool sequence distribution, LLMCert-T makes safety claims intuitive, actionable, and comparable across models, retrievers, mitigations, and registry policies. Across popular BFCL and OpenAPI tool pools, LLMCert-T shows that current LLM
agents remain fragile under Distractor Selection and Top-N Saturation specifications: their certified correctness upper bounds drop to approximately 20%, far below their clean-pool lower bounds.
Read the full abstract ▾