惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

Stack Overflow Blog
Stack Overflow Blog
S
SegmentFault 最新的问题
大猫的无限游戏
大猫的无限游戏
The GitHub Blog
The GitHub Blog
M
MIT News - Artificial intelligence
T
Tailwind CSS Blog
aimingoo的专栏
aimingoo的专栏
Last Week in AI
Last Week in AI
freeCodeCamp Programming Tutorials: Python, JavaScript, Git & More
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
罗磊的独立博客
H
Help Net Security
Engineering at Meta
Engineering at Meta
Microsoft Security Blog
Microsoft Security Blog
阮一峰的网络日志
阮一峰的网络日志
J
Java Code Geeks
T
The Blog of Author Tim Ferriss
Hugging Face - Blog
Hugging Face - Blog
C
Check Point Blog
F
Fortinet All Blogs
腾讯CDC
博客园 - Franky
WordPress大学
WordPress大学
U
Unit 42

Snorkel AI

Building AI-Native Systems for Federal Infrastructure: A Conversation with Rezaur Rahman Code World Models and AutoHarness for LLM Agents Benchtalks #1: Alex Shaw (Terminal-Bench, Harbor) – Building the Benchmark Factory Building FinQA: An Open RL Environment for Financial Reasoning Agents How Tool Discipline Let a 4B Model Outsmart a 235B Giant on Financial Tasks Coding agents don’t need to be perfect, they need to recover Closing the Evaluation Gap in Agentic AI SlopCodeBench: Measuring Code Erosion as Agents Iterate Introducing the Snorkel Agentic Coding Benchmark 2026: The year of environments Part V: Future Direction and Emerging Trends in Rubric-Based AI Evaluation The self-critique paradox: Why AI verification fails where it’s needed most Chat With the Terminal-Bench Team | Snorkel AI Intelligence per watt: A new metric for AI’s future Terminal-Bench 2.0: Raising the bar for AI agent evaluation Snorkeling in RL environments Introducing SnorkelSpatial: A Benchmark for LLM Spatial Reasoning Scaling Trust: Rubrics in Snorkel's Quality Process Evaluating Multi-Agent Systems in Enterprise Tool Use Evaluating Coding Agents with Terminal-Bench 2.0 Parsing isn’t neutral: why evaluation choices matter The science of rubric design The right tool for the job: An A-Z of rubrics Data quality and rubrics: how to build trust in your models Building the benchmark: inside our agentic insurance underwriting dataset Evaluating AI agents for insurance underwriting LLM observability: key practices, tools, and challenges Anthropic Claude + AWS: revolutionizing pharma data analytics with Snorkel AI Data-centric development of an enterprise AI agent with Snorkel Building the data development platform for specialized AI
Why QBE Ventures invested in Snorkel AI
Alex Taylor, Lynn Thompson and Daniel Wypler – QBE Ventures · 2024-01-25 · via Snorkel AI
  • QBE Ventures has made a strategic investment in Snorkel AI, a company providing a leading platform for data-centric AI model development.
  • Insurers need simple, scalable, and affordable ways to customise Machine Learning models and fine-tune foundation models.
  • We’re excited to advance our existing QBE-Snorkel relationship by working alongside each other to develop Generative AI operating models, accelerators and patterns to support the delivery of QBE’s strategic priorities.

This article was originally published by QBE Ventures. We have reposted it here with their permission.

The vision

AI is a key focus for QBE as we continue our ambition to be the most consistent and innovative risk partner. There are many applications for AI across the entire insurance value chain, with insurance itself being a highly specialised industry with unique datasets and use cases.

As such, there are several key industry challenges that create opportunities for start-ups, technology companies and incumbents to collaborate.

Training data quality is the single biggest determinant of model performance. Insurance data is typically highly inaccessible: reports suggest that 80% of insurance data is unstructured, unlabelled, and not ready for AI model training. Finding ways to utilise unstructured data for AI/Machine Learning (ML) use cases requires platforms that not only make the data accessible, but do so in a way that can be built on by non-technical stakeholders.

Image1

In addition, ‘off the shelf’ Generative AI models are constrained in their ability to meet niche industry use cases. Models such as GPTx, Bard, Gemini and Claude will often require a high degree of prompt customisation to perform with the level of consistency, accuracy and reliability deemed sufficient for a regulated market. The limits of Retrieval Augmented Generation techniques (‘RAG’), which retrieves relevant supporting information, but does not necessarily improve model understanding of the task at hand, will mean that as we enter 2024, we expect more large enterprises will start to explore fine-tuning foundational models. This will push insurance companies to open-source base models, which allow an organisation to bring them in-house and fine-tune at an accessible price point (with the important advantage of retaining full control of their data, intellectual property, and newly created proprietary tokens).

The opportunity

As key challenges are solved, our view is that the most successful insurance market participants will succeed, not with one AI model leveraging proprietary data, but with hundreds (if not thousands) of models. This means that an insurer’s ability to select, adopt and customise ML and Generative AI at scale will be a key competitive battleground.

Enterprises are already starting to maintain these libraries of models, striking a specific balance between accuracy, cost, performance, and stability per use case. At the project level, there is significant opportunity to make it easier when having to decide which model, and how to inject business context into the data sources in a transparent, efficient way.

The QBE Ventures team has been scouting for best-in-class founders leading the world in providing the rails for simple, scalable, and affordable ways to customise ML models and fine tune foundational Generative AI models.

Introducing Snorkel AI

Snorkel AI started as a research project in the Stanford AI Lab in 2015, where Alex Ratner, Chris Re, Paroma Varma, Braden Hancock, and Henry Ehrenberg worked together to help use AI to tackle human trafficking. They found that the lack of labelled training data was a crucial bottleneck.

After five years of developing the product and deploying it within organisations including Google, Apple, Intel and the US Department of Defence, the open-source collaboration evolved into a platform for data-centric AI called ‘Snorkel Flow’, which enables programmatic model iteration, collaboration and labelling at scale.

Snorkel Flow makes the classifying and managing of unstructured data easier and faster which reduces the challenging and expensive need for collaboration between business experts (who have the business context) and data scientists (who have the base models and ability to work with them), as well as the technical requirements for data-centric AIOps (Artificial Intelligence for IT Operations).

QBE Ventures’ introduction to Snorkel AI came from our QBE data science and claims analytics peers. QBE’s North American teams use Snorkel Flow across a variety of predictive analytics use cases. The immediate value has come from reducing the friction involved in converting vast amounts of previously locked-up corporate data to improve the outcomes of ML solutions being applied to claims and underwriting business processes. We invested to help accelerate the evolution of Snorkel AI as it pushes further into Generative AI.

Why we invested

The investment in Snorkel AI marks a significant step in QBE Ventures’ commitment to embracing and advancing cutting-edge technology for the insurance industry. It’s a long-term strategic partnership anchored in establishing industry specific patterns for the responsible and explainable use of data-centric models.  

The most impactful innovation often happens when cutting edge academic concepts are applied in practice, at scale, for real-world problems. Achieving this requires strategic and significant collaboration between early-stage companies and industry incumbents.

“Ensuring carriers have the capability for customising models in safe and scalable ways is of paramount importance,” said James Orchard, QBE Ventures CEO.

“We’re excited to be working with Alex and the founding team to help pioneer the capabilities needed to enable the insurance sector to adopt ML and Generative AI in ethical, fair and data-informed ways”.

Alex Ratner, co-founder and CEO at Snorkel AI believes we are at the early stages of understanding the potential of Generative AI: “Our partnership with QBE brings valuable industry experience that will help us productize insurance specific use cases in Snorkel Flow, making it easier for carriers to get faster and better value from their AI projects”.

Looking ahead

Over 2024, we’ll bring together founders, QBE executives, leading applied researchers and industry experts to experiment and learn together. We’re excited to advance the existing QBE-Snorkel relationship to develop Generative AI operating models, accelerators and patterns for the insurance sector.