On the Limits of LLM-as-Judge for Scientific Novelty Assessment - 惯性聚合

推荐订阅源

The Blog of Author Tim Ferriss

人人都是产品经理

博客园 - 叶小钗

博客园_首页

Help Net Security

aimingoo的专栏

Fortinet All Blogs

DataBreaches.Net

罗磊的独立博客

Kaspersky official blog

Cyber Attacks, Cyber Crime and Cyber Security

Palo Alto Networks Blog

Know Your Adversary

Security Affairs

Engineering at Meta

Recent Commits to openclaw:main

The Exploit Database - CXSecurity.com

LINUX DO - 热门话题

Threat Research - Cisco Blogs

Threat Intelligence Blog | Flashpoint

Privacy International News Feed

Cisco Talos Blog

Tor Project blog

Simon Willison's Weblog

Help Net Security

OSCHINA 社区最新新闻

有赞技术团队

cs.AI updates on arXiv.org

Vulnerabilities – Threatpost

The Hacker News

博客园 - 聂微东

Schneier on Security

Recent Announcements

Darknet – Hacking Tools, Hacker News & Cyber Security

cs.AI updates on arXiv.org

Generating High Quality Synthetic Data for Dutch Medical Conversations GIANTS: Generative Insight Anticipation from Scientific Literature Should We be Pedantic About Reasoning Errors in Machine Translation? Computational Implementation of a Model of Category-Theoretic Metaphor Comprehension CoSToM:Causal-oriented Steering for Intrinsic Theory-of-Mind Alignment in Large Language Models ASPIRin: Action Space Projection for Interactivity-Optimized Reinforcement Learning in Full-Duplex Speech Language Models CircuitSynth: Reliable Synthetic Data Generation Think in Sentences: Explicit Sentence Boundaries Enhance Language Model's Capabilities CodaRAG: Connecting the Dots with Associativity Inspired by Complementary Learning From Query to Counsel: Structured Reasoning with a Multi-Agent Framework and Dataset for Legal Consultation ReFEree: Reference-Free and Fine-Grained Method for Evaluating Factual Consistency in Real-World Code Summarization LLMs Should Incorporate Explicit Mechanisms for Human Empathy Early Decisions Matter: Proximity Bias and Initial Trajectory Shaping in Non-Autoregressive Diffusion Language Models Bridging Linguistic Gaps: Cross-Lingual Mapping in Pre-Training and Dataset for Enhanced Multilingual LLM Performance Computational Lesions in Multilingual Language Models Separate Shared and Language-specific Brain Alignment Efficient Process Reward Modeling via Contrastive Mutual Information Learning and Enforcing Context-Sensitive Control for LLMs Too Nice to Tell the Truth: Quantifying Agreeableness-Driven Sycophancy in Role-Playing Language Models Deep-Reporter: Deep Research for Grounded Multimodal Long-Form Generation Generating Multiple-Choice Knowledge Questions with Interpretable Difficulty Estimation using Knowledge Graphs and Large Language Models Do BERT Embeddings Encode Narrative Dimensions? A Token-Level Probing Analysis of Time, Space, Causality, and Character in Fiction TInR: Exploring Tool-Internalized Reasoning in Large Language Models Advancing Polish Language Modeling through Tokenizer Optimization in the Bielik v3 7B and 11B Series AOP-Smart: A RAG-Enhanced Large Language Model Framework for Adverse Outcome Pathway Analysis Mem$^2$Evolve: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillation Uncertainty-Aware Web-Conditioned Scientific Fact-Checking A Systematic Analysis of the Impact of Persona Steering on LLM Capabilities When Verification Fails: How Compositionally Infeasible Claims Escape Rejection When Valid Signals Fail: Regime Boundaries Between LLM Features and RL Trading Policies Shared Emotion Geometry Across Small Language Models: A Cross-Architecture Study of Representation, Behavior, and Methodological Confounds Efficient Training for Cross-lingual Speech Language Models CocoaBench: Evaluating Unified Digital Agents in the Wild MathAgent: Adversarial Evolution of Constraint Graphs for Mathematical Reasoning Data Synthesis Exploring Knowledge Conflicts for Faithful LLM Reasoning: Benchmark and Method Do LLMs Know Tool Irrelevance? Demystifying Structural Alignment Bias in Tool Invocations Enhancing Multimodal Large Language Models for Ancient Chinese Character Evolution Analysis via Glyph-Driven Fine-Tuning Retrieval as Generation: A Unified Framework with Self-Triggered Information Planning METRO: Towards Strategy Induction from Expert Dialogue Transcripts for Non-collaborative Dialogues Think Before you Write: QA-Guided Reasoning for Character Descriptions in Books METER: Evaluating Multi-Level Contextual Causal Reasoning in Large Language Models Policy Split: Incentivizing Dual-Mode Exploration in LLM Reinforcement with Dual-Mode Entropy Regularization NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessment Time is Not a Label: Continuous Phase Rotation for Temporal Knowledge Graphs and Agentic Memory Synthius-Mem: Brain-Inspired Hallucination-Resistant Persona Memory Achieving 94.4% Memory Accuracy and 99.6% Adversarial Robustness on LoCoMo A Triadic Suffix Tokenization Scheme for Numerical Reasoning RPA-Check: A Multi-Stage Automated Framework for Evaluating Dynamic LLM-based Role-Playing Agents Playing Along: Learning a Double-Agent Defender for Belief Steering via Theory of Mind Legal2LogicICL: Improving Generalization in Transforming Legal Cases to Logical Formulas via Diverse Few-Shot Learning Evaluating Cooperation in LLM Social Groups through Elected Leadership Discourse Diversity in Multi-Turn Empathic Dialogue C-ReD: A Comprehensive Chinese Benchmark for AI-Generated Text Detection Derived from Real-World Prompts General365: Benchmarking General Reasoning in Large Language Models Across Diverse and Challenging Tasks MCERF: Advancing Multimodal LLM Evaluation of Engineering Documentation with Enhanced Retrieval Seven simple steps for log analysis in AI systems LETGAMES: An LLM-Powered Gamified Approach to Cognitive Training for Patients with Cognitive Impairment Generative UI: LLMs are Effective UI Generators ACE-TA: An Agentic Teaching Assistant for Grounded Q&A, Quiz Generation, and Code Tutoring LABBench2: An Improved Benchmark for AI Systems Performing Biology Research DeepReviewer 2.0: A Traceable Agentic System for Auditable Scientific Peer Review CID-TKG: Collaborative Historical Invariance and Evolutionary Dynamics Learning for Temporal Knowledge Graph Reasoning Unifying Ontology Construction and Semantic Alignment for Deterministic Enterprise Reasoning at Scale Digital hybridity and relics in cultural heritage: using corpus linguistics to inform design in emerging technologies from AI to VR LLM Nepotism in Organizational Governance Explainability and Certification of AI-Generated Educational Assessments How LLMs Might Think Assessing the Pedagogical Readiness of Large Language Models as AI Tutors in Low-Resource Contexts: A Case Study of Nepal's K-10 Curriculum CONSCIENTIA: Can LLM Agents Learn to Strategize? Emergent Deception and Trust in a Multi-Agent NYC Simulation Pioneer Agent: Continual Improvement of Small Language Models in Production COMPOSITE-Stem Instructing LLMs to Negotiate using Reinforcement Learning with Verifiable Rewards Cross-Cultural Value Awareness in Large Vision-Language Models Demographic and Linguistic Bias Evaluation in Omnimodal Language Models From UAV Imagery to Agronomic Reasoning: A Multimodal LLM Benchmark for Plant Phenotyping Exploring Structural Complexity in Normative RAG with Graph-based approaches: A case study on the ETSI Standards FinTrace: Holistic Trajectory-Level Evaluation of LLM Tool Calling for Long-Horizon Financial Tasks Learning from Emptiness: De-biasing Listwise Rerankers with Content-Agnostic Probability Calibration The Amazing Agent Race: Strong Tool Users, Weak Navigators Thinking Fast, Thinking Wrong: Intuitiveness Modulates LLM Counterfactual Reasoning in Policy Evaluation AI Patents in the United States and China: Measurement, Organization, and Knowledge Flows Calibration Collapse Under Sycophancy Fine-Tuning: How Reward Hacking Breaks Uncertainty Quantification in LLMs NSFL: A Post-Training Neuro-Symbolic Fuzzy Logic Framework for Boolean Operators in Neural Embeddings Skill-SD: Skill-Conditioned Self-Distillation for Multi-turn LLM Agents SCOPE: Signal-Calibrated On-Policy Distillation Enhancement with Dual-Path Adaptive Weighting Bringing Value Models Back: Generative Critics for Value Modeling in LLM Reinforcement Learning Detecting RAG Extraction Attack via Dual-Path Runtime Integrity Game Speaking to No One: Ontological Dissonance and the Double Bind of Conversational AI Audio Flamingo Next: Next-Generation Open Audio-Language Models for Speech, Sound, and Music ZoomR: Memory Efficient Reasoning through Multi-Granularity Key Value Retrieval A molecular clock for writing systems reveals the quantitative impact of imperial power on cultural evolution CFMS: A Coarse-to-Fine Multimodal Synthesis Framework for Enhanced Tabular Reasoning Back to the Barn with LLAMAs: Evolving Pretrained LLM Backbones in Finetuning Vision Language Models Min-$k$ Sampling: Decoupling Truncation from Temperature Scaling via Relative Logit Dynamics Towards Proactive Information Probing: Customer Service Chatbots Harvesting Value from Conversation Use of AI Tools: Guidelines to Maintain Academic Integrity in Computing Colleges Guardrails Beat Guidance: A Large-Scale Study of Rules, Skills, and Persistent Configuration for Coding Agents RECIPER: A Dual-View Retrieval Pipeline for Procedure-Oriented Materials Question Answering Teaching Language Models How to Code Like Learners: Conversational Serialization for Student Simulation The Past Is Not Past: Memory-Enhanced Dynamic Reward Shaping The Salami Slicing Threat: Exploiting Cumulative Risks in LLM Systems Learning from Contrasts: Synthesizing Reasoning Paths from Diverse Search Trajectories

On the Limits of LLM-as-Judge for Scientific Novelty Assessment

[Submitted on 10 Jun 2026] · 2026-06-11 · via cs.AI updates on arXiv.org

此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。原文来自 — 版权归原作者所有。