













Here at Common Crawl we have been busy in the first quarter of 2026 improving our tools, building new resources, publishing studies, and, of course, releasing our monthly crawl archives and our host and domain level Web Graphs.
Our Web Graph Statistics site has been updated with interactive charts, a domain lookup tool for tracking harmonic centrality and PageRank over time, mobile improvements, unified rank tables with OR filtering, and merged degree plots. More details in our blog post.
We've replaced our old Examples and Use Cases pages with a single searchable, filterable browser. 119 resources from 115 contributors, all in one place. Search, filter by type or language, sort, and share links. We welcome community submissions.
Here it is in action:
In February, we announced the release of CommonLID, a language identification benchmark for the web, covering 109 languages. CommonLID was developed in collaboration with multiple open-source organizations and language community groups. See our announcement for more.
We released an interactive visualization of thousands of research papers using or citing Common Crawl data. Learn more in our blog post, and browse the visualization on our Hugging Face space.

A WCAG colour contrast audit of 240 top domains using Common Crawl's February 2026 archive found that four in ten colour pairings fall short of accessibility thresholds. Only one in five sites are fully compliant. Read the paper on arXiv, and find more details and links on our blog post.
We probed the 100,000 most-linked web hosts for IPv6 support using the Common Crawl Web Graph. Only 36.9% are fully reachable over IPv6, with adoption ranging from 71% among the top 100 to 32% in the long tail. Read more on our blog post.
We introduced whirlwind-java, the second installment in our Whirlwind Tour series, covering crawl structure, index access, and content extraction, giving developers a practical foundation for building Java-based data workflows. This follows our Whirlwind Tour in Python. Keep an eye out for our Rust version, coming in the future.
此内容由惯性聚合(RSS阅读器)自动聚合整理,仅供阅读参考。 原文来自 — 版权归原作者所有。