惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

A
About on SuperTechFans
WordPress大学
WordPress大学
雷峰网
雷峰网
Threat Intelligence Blog | Flashpoint
Threat Intelligence Blog | Flashpoint
Latest news
Latest news
Spread Privacy
Spread Privacy
T
Threat Research - Cisco Blogs
T
Tor Project blog
博客园 - Franky
U
Unit 42
K
Kaspersky official blog
博客园_首页
G
GRAHAM CLULEY
美团技术团队
I
Intezer
T
The Exploit Database - CXSecurity.com
P
Proofpoint News Feed
Engineering at Meta
Engineering at Meta
The Hacker News
The Hacker News
B
Blog
云风的 BLOG
云风的 BLOG
cs.CL updates on arXiv.org
cs.CL updates on arXiv.org
S
Securelist
Last Week in AI
Last Week in AI
F
Fortinet All Blogs
N
Netflix TechBlog - Medium
M
MIT News - Artificial intelligence
Martin Fowler
Martin Fowler
Schneier on Security
Schneier on Security
cs.AI updates on arXiv.org
cs.AI updates on arXiv.org
S
SegmentFault 最新的问题
W
WeLiveSecurity
Cyber Security Advisories - MS-ISAC
Cyber Security Advisories - MS-ISAC
J
Java Code Geeks
Cyberwarzone
Cyberwarzone
爱范儿
爱范儿
K
KPMG report finds enterprise disconnect between AI and its ROI | CIO
The GitHub Blog
The GitHub Blog
S
Security @ Cisco Blogs
GbyAI
GbyAI
P
Proofpoint News Feed
D
Docker
D
DataBreaches.Net
aimingoo的专栏
aimingoo的专栏
博客园 - 司徒正美
T
Tenable Blog
V2EX - 技术
V2EX - 技术
The Register - Security
The Register - Security
V
Vulnerabilities – Threatpost
B
Blog RSS Feed

cs.CR updates on arXiv.org

CTFusion: A CTF-based Benchmark for LLM Agent Evaluation Large Language Models for Agentic NetOps and AIOps: Architectures, Evaluation, and Safety From Controlled to the Wild: Evaluation of Pentesting Agents for the Real-World Red-Teaming Agent Execution Contexts: Open-World Security Evaluation on OpenClaw Graph Representation Learning Augmented Model Manipulation on Federated Fine-Tuning of LLMs Containment Verification: AI Safety Guarantees Independent of Alignment Defense effectiveness across architectural layers: a mechanistic evaluation of persistent memory attacks on stateful LLM agents From Specification to Deployment: Empirical Evidence from a W3C VC + DID Trust Infrastructure for Autonomous Agents SafeHarbor: Hierarchical Memory-Augmented Guardrail for LLM Agent Safety Agentic Vulnerability Reasoning on Windows COM Binaries From Beats to Breaches:How Offensive AI Infers Sensitive User Information from Playlists Undetectable Backdoors in Model Parameters: Hiding Sparse Secrets in High Dimensions When Embedding-Based Defenses Fail: Rethinking Safety in LLM-Based Multi-Agent Systems When Alignment Isn't Enough: Response-Path Attacks on LLM Agents Block-wise Codeword Embedding for Reliable Multi-bit Text Watermarking FlexServe: A Fast and Secure LLM Serving System for Mobile Devices with Flexible Resource Isolation TwoHamsters: Benchmarking Multi-Concept Compositional Unsafety in Text-to-Image Models Symbolic Guardrails for Domain-Specific Agents: Stronger Safety and Security Guarantees Without Sacrificing Utility Hardening x402: PII-Safe Agentic Payments via Pre-Execution Metadata Filtering Hijacking Text Heritage: Hiding the Human Signature through Homoglyphic Substitution Like a Hammer, It Can Build, It Can Break: Large Language Model Uses, Perceptions, and Adoption in Cybersecurity Operations on Reddit Private Seeds, Public LLMs: Realistic and Privacy-Preserving Synthetic Data Generation Chimera: Neuro-Symbolic Attention Primitives for Trustworthy Dataplane Intelligence Sockpuppetting: Jailbreaking LLMs by Combining Prefilling with Optimization StegoStylo: Squelching Stylometric Scrutiny through Steganographic Stitching Learning-Based Automated Adversarial Red-Teaming for Robustness Evaluation of Large Language Models AutoGraphAD: Unsupervised network anomaly detection using Variational Graph Autoencoders CrossGuard: Safeguarding MLLMs against Joint-Modal Implicit Malicious Attacks Feedback Lunch: Learned Feedback Codes for Secure Communications Noise Aggregation Analysis Driven by Small-Noise Injection: Efficient Membership Inference for Diffusion Models A First Look at the Security Issues in the Model Context Protocol Ecosystem Formalizing the Safety, Security, and Functional Properties of Agentic AI Systems MEASER: Malware embedding attacks on open-source LLMs Fall into a Pit, Gain in a Wit: Cognitive-Guided Harmful Meme Detection via Misjudgment Risk Pattern Retrieval When Search Goes Wrong: Red-Teaming Web-Augmented Large Language Models Differentially Private Synthetic Text Generation for Retrieval-Augmented Generation (RAG) From surveillance to signalling: escalation channels as environmental controls for agentic AI STAC: When Innocent Tools Form Dangerous Chains to Jailbreak LLM Agents Federated Spatiotemporal Graph Learning for Passive Attack Detection in Smart Grids Guidance Watermarking for Diffusion Models SecureVibeBench: Benchmarking Secure Vibe Coding of AI Agents via Reconstructing Vulnerability-Introducing Scenarios xOffense: An Autonomous Multi-Agent Framework for Penetration Testing with Domain-Adapted Large Language Models Hammer and Anvil: Toward a Theory of Backdoors in Federated Learning Neuro-Symbolic AI for Cybersecurity: State of the Art, Challenges, and Opportunities Tell-Tale Watermarks for Explanatory Reasoning in Synthetic Media Forensics Between a Rock and a Hard Place: The Tension Between Ethical Reasoning and Safety Alignment in LLMs A Comprehensive Guide to Differential Privacy: From Theory to User Expectations Enabling Transparent Cyber Threat Intelligence Combining Large Language Models and Domain Ontologies Unveiling Unicode's Unseen Underpinnings in Undermining Authorship Attribution Searching for Privacy Risks in LLM Agents via Simulation SPRINT: Robust Model Attribution of Generated Images via Secret Pixel Reconstruction Majority Bit-Aware Watermarking For Large Language Models Coward: Collision-based OOD Watermarking for Practical Proactive Federated Backdoor Detection Prompt to Pwn: Automated Exploit Generation for Smart Contracts Activation-Guided Local Editing for Jailbreaking Attacks Random Walk Learning and the Pac-Man Attack ExCyTIn-Bench: Evaluating LLM agents on Cyber Threat Investigation White-Basilisk: A Hybrid Model for Code Vulnerability Detection Intrinsic Fingerprint of LLMs: Continue Training is NOT All You Need to Steal A Model! InvisibleInk: High-Utility and Low-Cost Text Generation with Differential Privacy Logit-Gap Steering: A Forward-Pass Diagnostic for Alignment Robustness Toward Principled LLM Safety Testing: Solving the Jailbreak Oracle Problem Exploring the Secondary Risks of Large Language Models Benchmarking Misuse Mitigation Against Covert Adversaries Efficient Preimage Approximation for Neural Network Certification Practical Adversarial Attacks on Stochastic Bandits via Fake Data Injection PARASITE: Conditional System Prompt Poisoning to Hijack LLMs Secure LLM Fine-Tuning via Safety-Aware Probing Can Large Language Models Really Recognize Your Name? PoLO: Proof-of-Learning and Proof-of-Ownership at Once with Chained Watermarking A Survey on the Safety and Security Threats of Computer-Using Agents: JARVIS or Ultron? AutoRAN: Automated Hijacking of Safety Reasoning in Large Reasoning Models Remote Rowhammer Attack using Adversarial Observations on Federated Learning Clients Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agents DiffMI: Breaking Face Recognition Privacy via Diffusion-Driven Training-Free Model Inversion Chronology of Multi-Agent Interactions for Provenance of Evolving Information Gungnir: Exploiting Stylistic Features in Images for Backdoor Attacks on Diffusion Models Detecting Malicious Concepts without Image Generation in AI-Generated Content (AIGC) How Vulnerable Is My Learned Policy? Universal Adversarial Perturbation Attacks On Modern Behavior Cloning Policies Imitation Game for Adversarial Disillusion with Chain-of-Thought Reasoning in Generative AI PromptGuard: Soft Prompt-Guided Unsafe Content Moderation for Text-to-Image Models A Multiparty Homomorphic Encryption Approach to Confidential Federated Kaplan Meier Survival Analysis Red-Teaming Text-to-Image Models via In-Context Experience Replay and Semantic-Preserving Prompt Rewriting DeTrigger: A Gradient-Centric Approach to Backdoor Attack Mitigation in Federated Learning Privacy Leakage via Output Label Space and Differentially Private Continual Learning ARQ: A Mixed-Precision Quantization Framework for Accurate and Certifiably Robust DNNs CoreGuard: Safeguarding Foundational Capabilities of LLMs Against Model Stealing in Edge Deployment Power-Softmax: Towards Secure LLM Inference over Encrypted Data Hypnopaedia-Aware Machine Unlearning via Psychometrics of Artificial Mental Imagery Anomaly Detection from a Tensor Train Perspective Survival of the Cheapest: Cost-Aware Hardware Adaptation for Adversarial Robustness Improving Clean Accuracy via a Tangent-Space Perspective on Adversarial Training The AI risk repository: A meta-review, database, and taxonomy of risks from artificial intelligence Towards Agentic Runtime Healing Verification of Machine Unlearning is Fragile Aggressive or Imperceptible, or Both: Network Pruning Assisted Hybrid Byzantines in Federated Learning Whispers in the Machine: Confidentiality in Agentic Systems MalPurifier: Enhancing Android Malware Detection with Adversarial Purification against Evasion Attacks Towards Adaptive, Learning-Based Security in Decentralized Applications Can Blockchains Reliably Train Machine Learning Models?
Distillation as a Defense to Adversarial Perturbations against Deep Neural Networks
Nicolas Papernot, Patrick McDaniel, Xi Wu, Somesh Jha, Ananthram · 2015-11-14 · via cs.CR updates on arXiv.org

Deep learning algorithms have been shown to perform extremely well on many classical machine learning problems. However, recent studies have shown that deep learning, like other machine learning techniques, is vulnerable to adversarial samples: inputs crafted to force a deep neural network (DNN) to provide adversary-selected outputs. Such attacks can seriously undermine the security of the system supported by the DNN, sometimes with devastating consequences. For example, autonomous vehicles can be crashed, illicit or illegal content can bypass content filters, or biometric authentication systems can be manipulated to allow improper access. In this work, we introduce a defensive mechanism called defensive distillation to reduce the effectiveness of adversarial samples on DNNs. We analytically investigate the generalizability and robustness properties granted by the use of defensive distillation when training DNNs. We also empirically study the effectiveness of our defense mechanisms on two DNNs placed in adversarial settings. The study shows that defensive distillation can reduce effectiveness of sample creation from 95% to less than 0.5% on a studied DNN. Such dramatic gains can be explained by the fact that distillation leads gradients used in adversarial sample creation to be reduced by a factor of 10^30. We also find that distillation increases the average minimum number of features that need to be modified to create adversarial samples by about 800% on one of the DNNs we tested.