惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

D
DataBreaches.Net
月光博客
月光博客
雷峰网
雷峰网
K
Kaspersky official blog
D
Docker
CTFtime.org: upcoming CTF events
CTFtime.org: upcoming CTF events
Recent Announcements
Recent Announcements
IT之家
IT之家
Know Your Adversary
Know Your Adversary
www.infosecurity-magazine.com
www.infosecurity-magazine.com
美团技术团队
H
Hackread – Cybersecurity News, Data Breaches, AI and More
The GitHub Blog
The GitHub Blog
V
Vulnerabilities – Threatpost
I
InfoQ
U
Unit 42
AWS News Blog
AWS News Blog
C
Cyber Attacks, Cyber Crime and Cyber Security
T
Threatpost
V
V2EX
云风的 BLOG
云风的 BLOG
T
The Exploit Database - CXSecurity.com
aimingoo的专栏
aimingoo的专栏
C
CERT Recently Published Vulnerability Notes
Engineering at Meta
Engineering at Meta
P
Proofpoint News Feed
Cyberwarzone
Cyberwarzone
The Hacker News
The Hacker News
T
Threat Research - Cisco Blogs
Stack Overflow Blog
Stack Overflow Blog
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
C
Cybersecurity and Infrastructure Security Agency CISA
Vercel News
Vercel News
L
LINUX DO - 热门话题
P
Privacy & Cybersecurity Law Blog
Y
Y Combinator Blog
Security Latest
Security Latest
T
Tor Project blog
T
Troy Hunt's Blog
C
CXSECURITY Database RSS Feed - CXSecurity.com
SecWiki News
SecWiki News
Simon Willison's Weblog
Simon Willison's Weblog
Project Zero
Project Zero
博客园_首页
Cisco Talos Blog
Cisco Talos Blog
S
SegmentFault 最新的问题
Cyber Security Advisories - MS-ISAC
Cyber Security Advisories - MS-ISAC
V2EX - 技术
V2EX - 技术
TaoSecurity Blog
TaoSecurity Blog
S
Security @ Cisco Blogs

Benson's blog

Enjoy life Internship AI on academic research How AI Will Change the Mobile Ecosystem Look ahead Goodbye 2025 Hacker News to Kindle Another project How to imporve english Introduction of Fraud detection PopTranslate Last day in netease Better idea between Copilot-typed and CLI-typed assistant Gemini-cli LLM Post-Training experience Papers I readed recently about LLM application Difference between LLMs and traditional computer technology GRPO Weekly-#26 AI Application Weekly-#25 AI infra and application Weekly-#24 First week as LLM inference engineer Weekly-#23 seeking job Weekly-#22 2025 New Year AutoSwitch Translate Goodbye 2024 Weekly-#20 Breaking of glass Cross Entropy Loss of Triton Weekly-#18 Cross Entropy Loss of Triton Weekly-#17 Triton Puzzles Weekly-#16 AutoBuilder Weekly-#15 Starting of tanble tennis Weekly-#14 Accident in life Weekly-#13 Trying of xiaohongshu Weekly-#12 summary of LLM acceleration Outline of LLM acceleration Weekly-#11 Copilot-type products Weekly-#10 Preparation for next journey Weekly-#9 Startup of YouTube Notes of flash-attention How to learn knowledge in new fields? Weekly-#8 Start Reading Notes of LoRA Acceleration of LLM - Matrix Multiplication Weekly-#8 Summary for two month Weekly-#7 Staying home Weekly-#6 Cost of PopTranslate Weekly-#5 Updating of PopTranslate Validated example of LLM acceleration Weekly-#4 First insight of LLM accelerate Weekly-#3 PopTranslate Weekly-#2 The fail of first product Weekly-#1 First week of indie develop slack迁移discord 雅思备考 2024Q3 中文博客合集 English Diary in May 五一游记 开始休假 离职前的状态 2024-01-01 duckdb 看懂的第一个PR learning english in October learning english in September learning english in August top hack news 收集 大模型调研 自动驾驶的小玩具 旅游 扬州+苏州 small talk of learning english 新年新气象-碎碎念 刷剧 感染新冠 强化学习简介 神经网络解释性 全局的模型无关解释方法合集 社区发现算法概览 图神经网络入门(GNN) 我的第一款 iOS APP AtCoder Beginner Contest 268 人的信息输入方式对比 重叠社区检测 人穷极一生到底在追求什么 重拾生活规划 社区发现算法 - Louvain 《幸福的方法》 读《人类简史》有感 妙峰山骑行 黑客帝国 特征工程 累计局部效应图 模型解释性-PDP 模型解释性 Web3 入门科普 总结 2022.4 孪生网络做 query 相似度任务 学习 2022.4 Imagen DeBERTa 读论文 用CNN做query相似度任务
特征交互
Benson · 2022-07-10 · via Benson's blog

介绍

特征交互是要衡量两组特征之间的相关性,即在特征1 和特征2 分别取某个值时,对模型结果是否有特殊的影响。

基本假设:当两个特征完全独立,即没有任何相关性时,我们认为$PD_{jk}(j,k)=PD_j(j) + PD_k(k)$,特征有一定相关性时,等号不成立。那么就可以用等号前后的两个函数的差异,衡量特征之间的相关性。

那么就可以用一下公式来衡量两个特征的相关性: \(H_{j,k}^2=\frac{\sum_{i=1}^n[PD_{j,k}(x_{j}^{(i)},x_{k}^{(i)})-PD_j(x_{j}^{(i)})-PD_k(x_{k}^{(i)})]^2}{\sum_{i=1}^nf(x)^2}\) 使特征 k = all - j,就可衡量特征 j 与其他所有特征的相关性。

案例

1)计算每个特征与其他所有特征的相关性,挑出相关性最强的特征。

2) 从第一步挑出的特征中,两两计算相关性,挑出相关性最强的组合。

优缺点

优点

  1. 可以统计任何形式的特征关系
  2. 可以统计 >= 3 维的特征关系

缺点

https://christophm.github.io/interpretable-ml-book/interaction.html

Trending Tags