






















Authors:Kirill Dubovikov (1), Omar El Mansouri (1), Hachem Madmoun (1), Yanda Li (1), Sandeep Kumar (1), Aya El Mir (1), Supriyo Ghosh (2), Writabrata Bhattacharya (2), Adrian Garcia-Garcia (2), Onkar Pandit (2), Sunil Kumar Sahu (2), Federico Castanedo (2), Larry Murray (2), Martin Takac (1), Salem Lahlou (1) ((1) Mohamed bin Zayed University of Artificial Intelligence, (2) Inception AI)
Abstract:Petroleum-engineering search exposes a supervision gap for strong general retrievers: relevant evidence exists in public web text, but domain relevance labels are scarce. To address this gap, we propose PETRA, a large-scale Petroleum Engineering Text for Retrieval Adaptation dataset and pipeline that converts noisy public web data into a curated domain corpus and synthetic supervision for dense retrieval and reranking. PETRA contains 1.36M curated chunks, approximately 2B token equivalents, $\approx$859k, embedding training rows from $\approx$224k anchors, and roughly 400k teacher-scored reranker candidate rows. Its construction combines high-recall energy-domain curation, an energy-domain classifier with 98.4% test accuracy, chunk-grounded query generation, LLM-written hard negatives, and retrieval-mined candidate lists. PETRA improves first-stage in-domain Normalized Discounted Cumulative Gain (nDCG) from 0.703 to 0.763 through score fusion. Reranker adaptation improves the public Earth Science benchmark by 44% relative and a six-task reasoning-intensive panel by 23%. Failed training recipes show that high train-holdout accuracy on synthetic labels does not predict retrieval gains; retrieval-mined data helps only after being repackaged as teacher-scored candidate lists sampled from the inference-time candidate distribution.
From: Kirill Dubovikov [view email]
[v1]
Tue, 23 Jun 2026 09:37:44 UTC (1,208 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理,仅供阅读参考。 原文来自 — 版权归原作者所有。