惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

H
Help Net Security
T
ThreatConnect
SecWiki News
SecWiki News
F
Future of Privacy Forum
AWS News Blog
AWS News Blog
C
Cisco Blogs
A
Arctic Wolf
Vercel News
Vercel News
The GitHub Blog
The GitHub Blog
Scott Helme
Scott Helme
V
V2EX
博客园 - 叶小钗
阮一峰的网络日志
阮一峰的网络日志
K
Kaspersky official blog
G
Google Developers Blog
freeCodeCamp Programming Tutorials: Python, JavaScript, Git & More
P
Privacy International News Feed
C
Cyber Attacks, Cyber Crime and Cyber Security
N
News | PayPal Newsroom
Schneier on Security
Schneier on Security
NISL@THU
NISL@THU
Microsoft Azure Blog
Microsoft Azure Blog
量子位
The Hacker News
The Hacker News
Stack Overflow Blog
Stack Overflow Blog
Security Latest
Security Latest
M
Microsoft Research Blog - Microsoft Research
Google Online Security Blog
Google Online Security Blog
博客园_首页
C
CXSECURITY Database RSS Feed - CXSecurity.com
I
InfoQ
Google DeepMind News
Google DeepMind News
Y
Y Combinator Blog
The Cloudflare Blog
Microsoft Security Blog
Microsoft Security Blog
Martin Fowler
Martin Fowler
Cisco Talos Blog
Cisco Talos Blog
钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
T
Troy Hunt's Blog
F
Fox-IT International blog
S
Security @ Cisco Blogs
博客园 - 司徒正美
cs.CV updates on arXiv.org
cs.CV updates on arXiv.org
C
Comments on: Blog
Threat Intelligence Blog | Flashpoint
Threat Intelligence Blog | Flashpoint
L
LINUX DO - 最新话题
GbyAI
GbyAI
Project Zero
Project Zero
腾讯CDC
T
Tailwind CSS Blog

cs updates on arXiv.org

End-to-End Intracortical Speech Decoding from Neural Activity Zeroth-Order Nonconvex Nonsmooth Optimization with Heavy-Tailed Noise Rethinking Continual Anomaly Detection on the Edge: Benchmarking Under Realistic Industrial Conditions Word Class Representations Spontaneously Emerge from Successor Representations Trained on Natural Language Beyond the Aggregation Dilemma: Prior-Retaining Decoupled Learning for Multimodal Graphs An Effective-Rank Audit of Alignment-Induced Activation Shifts: Confound Control, Constructive Calibration, and Limits Phonetic Modeling of Dialectal Variation in Vietnamese Speech Refined Analysis of Entropy-Regularized Actor-Critic LLMs Show No Signs Of Individuated Metacognition Structure-Aware RAG: Structured Retrieval Augmented Generation from Noisy Data for Conversational Agents RL with Learnable Textual Feedback: A Bilevel Approach A computational phase transition for learning-to-sample from Ising models Hardware-Aware Federated Learning for Speech Emotion Recognition MindAlign: Bridging EEG, Vision, and Language for Zero-Shot Visual Decoding CP-Agent: A Calibrated Risk-Controlled Agent for Feedback-Driven Competitive Programming Measuring the Depth of LLM Unlearning via Activation Patching Distinguishing Right from Wrong in Debates: Attribution Analysis of Chinese Harmful Memes Fourier Feature Pyramids for Physics-Informed Neural Networks A Unified Python Framework for Direct PPO-based Control of AHUs with Economizer Logic and CO2-Constrained Ventilation Assessing the Operational Viability of Foundation Models for Time Series Forecasting Optimizing Digital Therapeutic Interventions: Online Learning under Endogenous Adherence Grammatically-Guided Sparse Attention for Efficient and Interpretable Transformers Beyond Generative Priors: Minority Sampling with JEPA-Guided Diffusion LAPLEX: The FFT of Learnable Laplace Kernels Lake Detection and Water Quality Estimation in Sentinel-2 Data Streaming Reinforcement Learning under Partial Observability with Real-Time Recurrent Learning SliceWorld: A Predictive and Controllable World-State Model for CT Report Generation A Contractive Feedback Semantics for Reinforcement Learning Trajectory-Based Difficulty Scoring for Reliable Learning on Tabular Data Position: AI for Science Should Treat Measurement-to-Dataset Pipelines as Inference Components Temporal Concept Drift in Legal Judgment Prediction: Neural Baselines Across Three Epochs of Ukrainian Court Decisions Discovering Lexical Gaps Using Embeddings from Multilingual LLMs CSP-Atlas: Concept-Specific Neural Circuits in a Sparse Python Transformer The Tokenizer Tax Across 25 European Languages: Domain Invariance, Cross-Lingual Few-Shot Effects, and the Ukrainian Penalty The Path Matters: Learning a Token-Commitment Policy for Diffusion Language Models WhenLoss: Diagnosing Write and Retrieval Bottlenecks in Long-Context Memory Systems Side-by-side Comparison Amplifies Dialect Bias in Language Models Omissive Bias in Religious Representation: Benchmarking LLM Answers to Everyday Ethical Decision-making ChaosBench-Logic v2: Evaluating LLM Logical Reasoning over Dynamical Systems at Scale PrivFusion: A Privacy-preserving Multi-Agent Framework for Harmonizing Distributed Datasets Treatment Effect Estimation with Differentiated Networked Effect on Graph Data ChainLearn: A Blockchain-Based Capacity-Aware Framework for Federated Ensemble Learning Synheart Capacity: A Theory-Driven Physiological Representation of Cognitive Capacity Dynamics from Wearable Signals Evolving Robustness--Exploration Trade-off in Online Reinforcement Learning via Quantile Bayesian Risk MDPs Faithfulness as Information Flow: Evaluating and Training Faithful Chain-of-Thought Reasoning How Much Structure Do LLMs Need? Evaluating LLMs for Bibliometric Cluster Description Deep ZakaiJ: Structured Filtering for Jump-Diffusion Time Series Forecasting The Normalized Maximum Likelihood for Regular Non-Smooth Models: Measure-Theoretic Foundations and Geometric Sampling Polymorphism Is Rotation: Operational Mechanistic Interpretability from a Two-Layer Transformer to Pythia-70m On the Stability and Realizability of Recurrent Polynomial Surrogate Ternary Logic Gate Networks Beyond Fixed Points: Superpolynomial Capacity of Asymmetric Hopfield Networks PILOT: Policy-Informed Learned Optimization for Adaptive Deep Network Training What Are We Actually Decoding? Source Attribution for Non-Invasive Brain-to-Language Retrieval Reinforcement Learning for Reachability: Guaranteeing Asymptotic Optimality Feature Learning in Wide Neural Networks under $μ$P: Identifiability and Sparse-Dictionary Decomposition of the Mean-Field Limit IterInject: Indirect Prompt Injection Against LLM Agents via Feedback-Guided Iterative Optimization Bilevel Optimization of Synthetic Trajectories for Multi-Turn LLM Fine-Tuning Geometric Workspace Analysis and Transmission-Aware Dynamics of a Serial Spherical Tool for Microsurgery Rubato: Transcribing Piano Music with Timestamps Aligning Molecular Graph Explanations with Chemical Identity via InChIfied Invariants WLNO: Wavelet-Laplace Neural Operator for Solving Partial Differential Equations ECHO: Terminal Agents Learn World Models for Free ContextEcho: A Benchmark for Persona Drift in Long Agentic-Coding Sessions Found in Conversation: LLMs Teach Themselves to Close the Multi-Turn Gap Unveil: Unified Visual-Textual Integration and Distillation for Multi-modal Document Retrieval Decompose-and-Refine: Structured Legal Question Answering with Parametric Retrieval SEAL: Synergistic Co-Evolution of Agents and Learning Environments DRInQ: Evaluating Conversational Implicature with Controlled Context Variation HiMed: Incentivizing Hindi Reasoning in Medical LLMs Guarded Repair for Harm-Aware Post-hoc Replacement of LLM Mathematical Reasoning AstroMind: A High-Fidelity Benchmark for Spacecraft Behavior Reasoning Based on Large Language Models Mix-MoE: Improving Multilingual Machine Translation of Large Language Models through Mixed MoEs World-State Transformations for Neuro-symbolic Interactive Storytelling TS-Skill: A Benchmark for Evaluating Analytical Skills in Time-Series Question Answering Know You Before You Speak: User-State Modeling for LLM Personalization in Multi-Turn Conversation Generating Legal Commentaries from Case Databases via Retrieval, Clustering, and Generation An Interactive Paradigm for Deep Research A lift for input-convex neural network training Who judges the judges? Governance from metrics: a runtime framework for continuous LLM compliance monitoring Private Adaptive Covariance Estimation via Gaussian Graphical Models Interdomain Attention: Beyond Token-Level Key-Value Memory From One-Pass SGD to Data Reuse: Mini-Batch Scaling Laws in Sketched Linear Regression TUBE: Tangent Upper Bound on Evidence for Discrete Diffusion Language Models StepGap: A Hybrid NLI-LLM Checker for Step-Level Evidence-Gap Detectionin Multi-Hop Question Answering Learning Laplacian Eigenspace with Mass-Aware Neural Operators on Point Clouds GEESE: Genotype-aware End-to-End Spatio-temporal Embedding for Behavioral Phenotyping ChainzRule: Sample-Efficient, Robust Deep Learning Across Tabular, NLP, and Vision Tasks Generative OOD-regularized Model-based Policy Optimization Batch Normalization Amplifies Memorization and Privacy Risks LLMTabBench: Evaluating LLMs on Binary Tabular Classification From Zero to Few Shots AvAtar: Learning to Align via Active Optimal Transport CurveRL: Principled Distribution-Aware Context Reweighting for LLM Reasoning ROC Analysis for Evaluating Translation Quality Estimation Systems Improving Labeling Consistency with Detailed Constitutional Definitions and AI-Driven Evaluation Balancing Fairness, Privacy, and Accuracy: A Multitask Adversarial Framework for Centralized Data-Driven Systems Rethinking Federated Unlearning via the Lens of Memorization SemanticZip: A Pilot Framework for Lossy Text Compression with LLMs as Semantic Decompressors CAffNet: Hard Constraint-Affine Neural Networks Representation-Guided Discrete Molecular Graph Retrosynthesis Momentum Streams for Optimizer-Inspired Transformers
Do Image-Text Metrics Respect Semantic Invariances?
Amit Agarwal · 2026-05-26 · via cs updates on arXiv.org

View PDF HTML (experimental)

Abstract:Reference-free image-to-text evaluators are now standard for scoring image-caption alignment, yet it is unclear whether they respect semantic invariances. We present an invariance probe on five popular evaluators (CLIPScore, PAC-S, UMIC, FLEUR, and a deterministic LLM judge) under semantics-preserving perturbations along three axes -- spatial (flips, context-preserving repositioning, light rotations), object (scale, category), and socio-linguistic framing (cultural/economic adjectives with neutral and length-matched controls). Across curated slices of three detection datasets and three caption evaluation suites, we find consistent non-semantic sensitivities, where benign spatial edits and simple phrasing changes shift scores by $\approx$6--9\% on average, and for systems separated by just 0.7\%, these shifts can cause ranking flips in up to $\sim$37\% of cases, particularly under spatial changes. A small human study also supports this finding and confirms that annotators generally judge perturbed pairs as equally correct, so these shifts reflect metric behavior rather than semantic change. We further propose invariance-calibrated scoring, a post-hoc adjustment that roughly halves median absolute sensitivity while retaining correlation with learned caption evaluators.
Subjects: Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2605.24702 [cs.CV]
  (or arXiv:2605.24702v1 [cs.CV] for this version)
  https://doi.org/10.48550/arXiv.2605.24702

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Hansa Meghwani Ms [view email]
[v1] Sat, 23 May 2026 18:53:51 UTC (3,012 KB)