惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

Scott Helme
Scott Helme
有赞技术团队
有赞技术团队
阮一峰的网络日志
阮一峰的网络日志
雷峰网
雷峰网
D
Docker
Stack Overflow Blog
Stack Overflow Blog
Hugging Face - Blog
Hugging Face - Blog
爱范儿
爱范儿
奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
MyScale Blog
MyScale Blog
A
About on SuperTechFans
博客园 - 【当耐特】
U
Unit 42
H
Help Net Security
博客园 - 三生石上(FineUI控件)
V2EX - 技术
V2EX - 技术
T
Tor Project blog
博客园 - 叶小钗
G
Google Developers Blog
S
Securelist
Security Latest
Security Latest
Threat Intelligence Blog | Flashpoint
Threat Intelligence Blog | Flashpoint
cs.CL updates on arXiv.org
cs.CL updates on arXiv.org
T
Threat Research - Cisco Blogs
aimingoo的专栏
aimingoo的专栏
C
Cybersecurity and Infrastructure Security Agency CISA
博客园_首页
V
Vulnerabilities – Threatpost
P
Palo Alto Networks Blog
T
The Exploit Database - CXSecurity.com
The Register - Security
The Register - Security
Recorded Future
Recorded Future
NISL@THU
NISL@THU
量子位
L
LangChain Blog
C
CXSECURITY Database RSS Feed - CXSecurity.com
C
Cyber Attacks, Cyber Crime and Cyber Security
C
CERT Recently Published Vulnerability Notes
The Hacker News
The Hacker News
D
DataBreaches.Net
小众软件
小众软件
罗磊的独立博客
Forbes - Security
Forbes - Security
The Last Watchdog
The Last Watchdog
Jina AI
Jina AI
I
InfoQ
S
Schneier on Security
Recent Announcements
Recent Announcements
CTFtime.org: upcoming CTF events
CTFtime.org: upcoming CTF events
S
Secure Thoughts

Snorkel AI

Building AI-Native Systems for Federal Infrastructure: A Conversation with Rezaur Rahman Code World Models and AutoHarness for LLM Agents Benchtalks #1: Alex Shaw (Terminal-Bench, Harbor) – Building the Benchmark Factory Building FinQA: An Open RL Environment for Financial Reasoning Agents How Tool Discipline Let a 4B Model Outsmart a 235B Giant on Financial Tasks Coding agents don’t need to be perfect, they need to recover Closing the Evaluation Gap in Agentic AI SlopCodeBench: Measuring Code Erosion as Agents Iterate Introducing the Snorkel Agentic Coding Benchmark 2026: The year of environments Part V: Future Direction and Emerging Trends in Rubric-Based AI Evaluation The self-critique paradox: Why AI verification fails where it’s needed most Chat With the Terminal-Bench Team | Snorkel AI Intelligence per watt: A new metric for AI’s future Terminal-Bench 2.0: Raising the bar for AI agent evaluation Snorkeling in RL environments Introducing SnorkelSpatial: A Benchmark for LLM Spatial Reasoning Scaling Trust: Rubrics in Snorkel's Quality Process Evaluating Multi-Agent Systems in Enterprise Tool Use Evaluating Coding Agents with Terminal-Bench 2.0 Parsing isn’t neutral: why evaluation choices matter The science of rubric design The right tool for the job: An A-Z of rubrics Data quality and rubrics: how to build trust in your models Building the benchmark: inside our agentic insurance underwriting dataset Evaluating AI agents for insurance underwriting LLM observability: key practices, tools, and challenges Anthropic Claude + AWS: revolutionizing pharma data analytics with Snorkel AI Data-centric development of an enterprise AI agent with Snorkel Building the data development platform for specialized AI LLM-as-a-judge for enterprises: evaluate model alignment at scale Why GenAI evaluation requires SME-in-the-loop for validation and trust Research spotlight: is long chain-of-thought structure all that matters when it comes to LLM reasoning distillation? Why enterprise GenAI evaluation requires fine-grained metrics to be insightful What is specialized GenAI evaluation, and why is it so critical to enterprise AI? LLM alignment techniques: 4 post-training approaches Research spotlight: Is intent analysis the key to unlocking more accurate LLM question answering? Why enterprises should embrace LLM distillation Retrieval-augmented generation (RAG) failure modes and how to fix them What is large language model (LLM) alignment? Databricks + Snorkel Flow: integrated, streamlined AI development How LLM evaluation drives better models in Snorkel Flow Unlock proprietary data with Snorkel Flow and Amazon SageMaker LLM evaluation in enterprise applications: a new era in ML Snorkel AI joins the AWS ISV Accelerate Program and launches Snorkel Flow Availability in AWS Marketplace AI data development: a guide for data science projects SnorkelCon 2024: Inaugural Snorkel AI user conference gathers leaders from 30+ Fortune 500 companies Snorkel Flow 2024.R3: Supercharge your AI development with enhanced data-centric workflows Explore the new GenAI Evaluation Suite: Snorkel 2024.R3 New NLP features in Snorkel Flow 2024.R3 Enterprise data compliance and security review: Snorkel Flow 2024.R3 How a global financial services company built a specialized AI copilot accurate enough for production Task Me Anything: innovating multimodal model benchmarks Alfred: Data labeling with foundation models and weak supervision RAG: LLM performance boost with retrieval-augmented generation Call center AI for customer experience management: a case study New GenAI features, data annotation: Snorkel Flow 2024.R2 How data slices transform enterprise LLM evaluation Meta’s Llama 3.1 405B is the new Mr. Miyagi, now what? Meta’s new Llama 3.1 models are here! Are you ready for it? Data-centric AI with Snorkel and MinIO Weak supervision for non-categorical applications + superalignment Snorkel AI signs strategic collaboration agreement with AWS to help enterprises cross the demo-to-production chasm AI alignment made simple: innovative solutions for businesses How does the Snorkel Flow label model work? Vision language models: how LLMs boost image classification Long context models in the enterprise: benchmarks and beyond How to build production-grade RAG retrieval with Snorkel Flow How Bonito helps fine-tune specialized LLMs faster than ever Walking safely before building flying saucer seatbelts: introducing Enterprise Alignment Role-based access controls in Snorkel Flow secure enterprise data Accelerating AI development in manufacturing with Snorkel Flow and AWS SageMaker How ROBOSHOT boosts zero-shot foundation model performance Discover what’s new in Snorkel Flow: Flexible data and LLM connectivity, secure data controls, and more! Faster than ever document intelligence with new Snorkel Flow FM-first workflow The art of data development for Enterprise LLMs Crossing the demo-to-production chasm with Snorkel Custom How Snorkel topped the AlpacaEval leaderboard (and why we're not there anymore) CRFM's HELM and enterprise LLM evaluation beyond accuracy How we achieved 89% accuracy on contract question answering Five sessions not to miss at Google Cloud Next 24 Content filtering breakthrough: Snorkel client reaches 96% recall in 3 days Here's how Snorkel Flow + Google AI built an enterprise-ready model in a day Snorkel teams with Microsoft to showcase new AI research at NVIDIA GTC How Skill-it! enables faster, better LLM training Fine-tuned representation models boost LLM systems. Here's how Enterprise GenAI to surge in 2024: survey results Large language model training: how three training phases shape LLMs LoRA: Low-Rank Adaptation for LLMs LLM distillation demystified: a complete guide Enterprises must shift their focus from models to data in AI development Insurance’s GenAI revolution: a business perspective Scaling human preferences in AI: Snorkel's programmatic approach Building better enterprise AI: incorporating expert feedback in system development “Fall in love with your data”—Snorkel AI’s Enterprise LLM Summit New benchmark results demonstrate value of Snorkel AI approach to LLM alignment Retrieval augmented generation (RAG): a conversation with its creator Snorkel Flow 2023.R4: enhanced UI + PDF and Databricks tools How Snorkel Flow users can register custom models to Databricks Stanford professor discusses exciting advances in foundation model evaluation
Why QBE Ventures invested in Snorkel AI
Alex Taylor, Lynn Thompson and Daniel Wypler – QBE Ventures · 2024-01-25 · via Snorkel AI
  • QBE Ventures has made a strategic investment in Snorkel AI, a company providing a leading platform for data-centric AI model development.
  • Insurers need simple, scalable, and affordable ways to customise Machine Learning models and fine-tune foundation models.
  • We’re excited to advance our existing QBE-Snorkel relationship by working alongside each other to develop Generative AI operating models, accelerators and patterns to support the delivery of QBE’s strategic priorities.

This article was originally published by QBE Ventures. We have reposted it here with their permission.

The vision

AI is a key focus for QBE as we continue our ambition to be the most consistent and innovative risk partner. There are many applications for AI across the entire insurance value chain, with insurance itself being a highly specialised industry with unique datasets and use cases.

As such, there are several key industry challenges that create opportunities for start-ups, technology companies and incumbents to collaborate.

Training data quality is the single biggest determinant of model performance. Insurance data is typically highly inaccessible: reports suggest that 80% of insurance data is unstructured, unlabelled, and not ready for AI model training. Finding ways to utilise unstructured data for AI/Machine Learning (ML) use cases requires platforms that not only make the data accessible, but do so in a way that can be built on by non-technical stakeholders.

Image1

In addition, ‘off the shelf’ Generative AI models are constrained in their ability to meet niche industry use cases. Models such as GPTx, Bard, Gemini and Claude will often require a high degree of prompt customisation to perform with the level of consistency, accuracy and reliability deemed sufficient for a regulated market. The limits of Retrieval Augmented Generation techniques (‘RAG’), which retrieves relevant supporting information, but does not necessarily improve model understanding of the task at hand, will mean that as we enter 2024, we expect more large enterprises will start to explore fine-tuning foundational models. This will push insurance companies to open-source base models, which allow an organisation to bring them in-house and fine-tune at an accessible price point (with the important advantage of retaining full control of their data, intellectual property, and newly created proprietary tokens).

The opportunity

As key challenges are solved, our view is that the most successful insurance market participants will succeed, not with one AI model leveraging proprietary data, but with hundreds (if not thousands) of models. This means that an insurer’s ability to select, adopt and customise ML and Generative AI at scale will be a key competitive battleground.

Enterprises are already starting to maintain these libraries of models, striking a specific balance between accuracy, cost, performance, and stability per use case. At the project level, there is significant opportunity to make it easier when having to decide which model, and how to inject business context into the data sources in a transparent, efficient way.

The QBE Ventures team has been scouting for best-in-class founders leading the world in providing the rails for simple, scalable, and affordable ways to customise ML models and fine tune foundational Generative AI models.

Introducing Snorkel AI

Snorkel AI started as a research project in the Stanford AI Lab in 2015, where Alex Ratner, Chris Re, Paroma Varma, Braden Hancock, and Henry Ehrenberg worked together to help use AI to tackle human trafficking. They found that the lack of labelled training data was a crucial bottleneck.

After five years of developing the product and deploying it within organisations including Google, Apple, Intel and the US Department of Defence, the open-source collaboration evolved into a platform for data-centric AI called ‘Snorkel Flow’, which enables programmatic model iteration, collaboration and labelling at scale.

Snorkel Flow makes the classifying and managing of unstructured data easier and faster which reduces the challenging and expensive need for collaboration between business experts (who have the business context) and data scientists (who have the base models and ability to work with them), as well as the technical requirements for data-centric AIOps (Artificial Intelligence for IT Operations).

QBE Ventures’ introduction to Snorkel AI came from our QBE data science and claims analytics peers. QBE’s North American teams use Snorkel Flow across a variety of predictive analytics use cases. The immediate value has come from reducing the friction involved in converting vast amounts of previously locked-up corporate data to improve the outcomes of ML solutions being applied to claims and underwriting business processes. We invested to help accelerate the evolution of Snorkel AI as it pushes further into Generative AI.

Why we invested

The investment in Snorkel AI marks a significant step in QBE Ventures’ commitment to embracing and advancing cutting-edge technology for the insurance industry. It’s a long-term strategic partnership anchored in establishing industry specific patterns for the responsible and explainable use of data-centric models.  

The most impactful innovation often happens when cutting edge academic concepts are applied in practice, at scale, for real-world problems. Achieving this requires strategic and significant collaboration between early-stage companies and industry incumbents.

“Ensuring carriers have the capability for customising models in safe and scalable ways is of paramount importance,” said James Orchard, QBE Ventures CEO.

“We’re excited to be working with Alex and the founding team to help pioneer the capabilities needed to enable the insurance sector to adopt ML and Generative AI in ethical, fair and data-informed ways”.

Alex Ratner, co-founder and CEO at Snorkel AI believes we are at the early stages of understanding the potential of Generative AI: “Our partnership with QBE brings valuable industry experience that will help us productize insurance specific use cases in Snorkel Flow, making it easier for carriers to get faster and better value from their AI projects”.

Looking ahead

Over 2024, we’ll bring together founders, QBE executives, leading applied researchers and industry experts to experiment and learn together. We’re excited to advance the existing QBE-Snorkel relationship to develop Generative AI operating models, accelerators and patterns for the insurance sector.