惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

MongoDB | Blog
MongoDB | Blog
B
Blog
Y
Y Combinator Blog
大猫的无限游戏
大猫的无限游戏
aimingoo的专栏
aimingoo的专栏
B
Blog RSS Feed
博客园 - Franky
V
V2EX
IT之家
IT之家
WordPress大学
WordPress大学
博客园 - 三生石上(FineUI控件)
J
Java Code Geeks
F
Fortinet All Blogs
I
InfoQ
云风的 BLOG
云风的 BLOG
腾讯CDC
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
月光博客
月光博客
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
N
Netflix TechBlog - Medium
宝玉的分享
宝玉的分享
钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
P
Proofpoint News Feed
Microsoft Security Blog
Microsoft Security Blog

Proceedings of the AAAI Conference on Artificial Intelligence

Resource Efficient Sleep Staging via Multi-Level Masking and Prompt Learning AutoMalDesc: Large-Scale Script Analysis for Cyber Threat Research Modulation-Based Backdoors: Leveraging Amplitude and Frequency Patterns to Attack Speaker Recognition Learning Structurally Stabilized Representations for Lossless DNA Storage ViG-RAG: Video-aware Graph Retrieval-Augmented Generation via Temporal and Semantic Hybrid Reasoning Transferable Backdoor Attacks for Code Models via Sharpness-Aware Adversarial Perturbation Toward Multimodal Fake News Detection by Multi-perspective Rationale Generation and Verification RTMol: Rethinking Molecule-text Alignment in a Round-trip View Physical-regularized Hierarchical Generative Model for Metallic Glass Structural Generation and Energy Prediction Regressor-guided Diffusion Model for De Novo Peptide Sequencing with Explicit Mass Control RareAgents: Autonomous Multi-disciplinary Team for Rare Disease Diagnosis and Treatment Transferring Causal Driving Patterns for Generalizable Traffic Simulation with Diffusion-Based Distillation TRACE: Transformation-Aware Graph Refinement for Reaction Condition Prediction SIDE: Surrogate Conditional Data Extraction from Diffusion Models DyC-STG: Dynamic Causal Spatio-Temporal Graph Network for Real-time Data Credibility Analysis in IoT ProAR: Probabilistic Autoregressive Modeling for Molecular Dynamics Light but Sharp: SlimSTAD for Real-Time Action Detection from Sensor Data VFCionX: Bridging Large and Small Models for Robust Vulnerability-Fixing Commit Identification T2Agent: A Tool-augmented Multimodal Misinformation Detection Agent with Monte Carlo Tree Search Measuring What Matters: Scenario-Driven Evaluation for Trajectory Predictors in Autonomous Driving DensiCrafter: Physically-Constrained Generation and Fabrication of Self-Supporting Hollow Structures Topology-Enhanced and Label Correlation-Aware Model for Protein-Protein Interaction Prediction InteChar: A Unified Oracle Bone Character List for Ancient Chinese Language Modeling NucEL: Single-Nucleotide ELECTRA-Style Genomic Pre-training for Efficient and Interpretable Representations OR-R1: Automating Modeling and Solving of Operations Research Optimization Problem via Test-Time Reinforcement Learning Learning from Long-Term Engagement: Adaptive Tutoring Dialogue Planning for Personalized Education Toward Time-Continuous Data Inference in Sparse Urban CrowdSensing Multi-Horizon Time Series Forecasting of Non-Parametric CDFs with Deep Lattice Networks From Stimuli to Minds: Enhancing Psychological Reasoning in LLMs via Bilateral Reinforcement Learning Unveiling the Attribute Misbinding Threat in Identity-Preserving Models
VoiceCloak: A Multi-Dimensional Defense Framework Against...
Qianyue Hu, · 2026-03-14 · via Proceedings of the AAAI Conference on Artificial Intelligence

Authors

  • Qianyue Hu SUN YAT-SEN UNIVERSITY
  • Junyan Wu SUN YAT-SEN UNIVERSITY
  • Wei Lu SUN YAT-SEN UNIVERSITY
  • Xiangyang Luo Information Engineering University

DOI:

https://doi.org/10.1609/aaai.v40i1.37002

Abstract

Diffusion Models (DMs) have achieved remarkable success in realistic voice cloning (VC), while they also increase the risk of malicious misuse. Existing proactive defenses designed for traditional VC models aim to disrupt the forgery process, but they have been proven incompatible with DMs due to the intricate generative mechanisms of diffusion. To bridge this gap, we introduce VoiceCloak, a multi-dimensional proactive defense framework with the goal of obfuscating speaker identity and degrading perceptual quality in potential unauthorized VC. To achieve these goals, we conduct a focused analysis to identify specific vulnerabilities within DMs, allowing VoiceCloak to disrupt the cloning process by introducing adversarial perturbations into the reference audio. Specifically, to obfuscate speaker identity, VoiceCloak first targets speaker identity by distorting representation learning embeddings to maximize identity variation, which is guided by auditory perception principles. Additionally, VoiceCloak disrupts crucial conditional guidance processes, particularly attention context, thereby preventing the alignment of vocal characteristics that are essential for achieving convincing cloning. Then, to address the second objective, VoiceCloak introduces score magnitude amplification to actively steer the reverse trajectory away from the generation of high-quality speech. Noise-guided semantic corruption is further employed to disrupt structural speech semantics captured by DMs, degrading output quality. Extensive experiments highlight VoiceCloak's outstanding defense success rate against unauthorized diffusion-based voice cloning. Additional audio samples of VoiceCloak are available in demo pages.

How to Cite

Hu, Q., Wu, J., Lu, W., & Luo, X. (2026). VoiceCloak: A Multi-Dimensional Defense Framework Against Unauthorized Diffusion-Based Voice Cloning. Proceedings of the AAAI Conference on Artificial Intelligence, 40(1), 399–407. https://doi.org/10.1609/aaai.v40i1.37002

Issue

Section

AAAI Technical Track on Application Domains I