惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

K
Kaspersky official blog
T
Threat Research - Cisco Blogs
N
News and Events Feed by Topic
Hacker News: Ask HN
Hacker News: Ask HN
Project Zero
Project Zero
Application and Cybersecurity Blog
Application and Cybersecurity Blog
博客园 - 叶小钗
Security Latest
Security Latest
Spread Privacy
Spread Privacy
aimingoo的专栏
aimingoo的专栏
N
News and Events Feed by Topic
Webroot Blog
Webroot Blog
U
Unit 42
Cyberwarzone
Cyberwarzone
小众软件
小众软件
Scott Helme
Scott Helme
Engineering at Meta
Engineering at Meta
Microsoft Security Blog
Microsoft Security Blog
T
The Blog of Author Tim Ferriss
A
About on SuperTechFans
爱范儿
爱范儿
S
Schneier on Security
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
Schneier on Security
Schneier on Security
Latest news
Latest news
GbyAI
GbyAI
cs.CV updates on arXiv.org
cs.CV updates on arXiv.org
Simon Willison's Weblog
Simon Willison's Weblog
The Register - Security
The Register - Security
WordPress大学
WordPress大学
博客园_首页
Blog — PlanetScale
Blog — PlanetScale
PCI Perspectives
PCI Perspectives
Jina AI
Jina AI
AI
AI
NISL@THU
NISL@THU
I
Intezer
G
GRAHAM CLULEY
B
Blog
S
Secure Thoughts
IT之家
IT之家
宝玉的分享
宝玉的分享
Recent Announcements
Recent Announcements
Y
Y Combinator Blog
奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
酷 壳 – CoolShell
酷 壳 – CoolShell
有赞技术团队
有赞技术团队
V2EX - 技术
V2EX - 技术
Recorded Future
Recorded Future
Hacker News - Newest:
Hacker News - Newest: "LLM"

DEV Community

Authentication Security Deep Dive: From Brute Force to Salted Hashing (With Java Examples) Why AI Systems Don’t Fail — They Drift Spilling beans for how i learn for exam😁"Reinforcement Learning Cheat Sheet" I Replaced Chrome with Safari for AI Browser Automation. Here's What Broke (and What Finally Worked) How Python Borrows Other People's Work The $40 Architecture: Processing 1 Billion API Requests with 99.99% Uptime Vibe Coding: A Workflow Guide (From Zero to SaaS) Most webhook security guides protect the wrong side. The scary part is delivery. Headless CMS for TanStack Start: Build a Blog with Cosmic EU Age Verification App "Hacked in 2 Minutes" — What Actually Happened Comfy Cloud’s delete function does not actually remove files Running AI Models on GPU Cloud Servers: A Beginner Guide Event-driven media intelligence with AWS Step Functions and Bedrock I scored 500 AI prompts across 8 quality dimensions — here's what broke How to Call Google Gemini API from Next.js (Free Tier, No Backend Needed) The Portal Protocol: Reclaiming Human Connection in the Age of AI How to Fix Your Team's Scattered Knowledge Problem With a Self-Hosted Forum Intro to tc Cloud Functors: A Graph-First Mental Model for the Modern Cloud Designing Multi-Tenant Backends With Both Ownership and Team Access I Built a Neumorphic CSS Library with 77+ Components — Here's What I Learned PostgreSQL Performance Optimization: Why Connection Pooling Is Critical at Scale Cómo construí un SaaS multi-rubro para gestionar expensas en Argentina con FastAPI + Vue 3 🚀 I Built an Ethical Hacking Scanner Tool – Open Source Project I Replaced /usage and /context in Claude Code With a Single Statusline A Pythonic Way to Handle Emails (IMAP/SMTP) with Auto-Discovery and AI-Ready Design I Collected 8.9 Million Polymarket Price Points — Here's What I Found About How Markets Really Move EcoTrack AI — Carbon Footprint Tracker & Dashboard Everyone's Using AI. No One Agrees How. 5 self-hosted ebook managers worth trying in 2026 Building Your First AI Agent with LangChain: From Chatbot to Autonomous Assistant Common SOC 2 Failures (Real World) Stop Vibe-Checking Your AI App: A Practical Guide to Evals How to Use SonarQube and SonarScanner Locally to Level Up Your Code Quality Your Next To-Do App Is Dead — I Replaced Mine with an OpenClaw AI Sign a Nostr event in 60 lines of Python using coincurve — no nostr-sdk, no nbxplorer, no rust toolchain ITGC Audit Explained Like You’re in Big 4 Patch Tuesday abril 2026: Microsoft parcha 163 vulnerabilidades y un zero-day en SharePoint Stop scraping everything: a better way to track competitor price changes Listing on MCPize + the Official MCP Registry while routing payments OUTSIDE the marketplace — how I kept 100% of my x402 revenue Building an AI-Powered Risk Intelligence System Using Serverless Architecture Why We Ripped Function Overloading Out of Our AI Toolchain Testing AI-Generated Code: How to Actually Know If It Works SaaS Churn Is Killing Your Business. Here Is What to Do About It (Without a Support Team) The Speed of AI Is No Longer Linear - And Self-Improving Models Are Why How to Implement RBAC for MCP Tools: A Practical Guide for Engineering Teams From Standard Quote to Persuasive Proposal: AI Automation for Arborists I built a CLI that scaffolds complete multi-tenant SaaS apps Axios CVE-2025–62718: The Silent SSRF Bug That Could Be Hiding in Your Node.js App Right Now The dashboard that ended our friendship Data Pipelines Explained Simply (and How to Build Them with Python) The Hidden Cost of AI Systems Nobody Talks About. undefined vs undeclared, and how typeof behaves Switching from file-based jobs to NATS/Kafka in Rust without changing code io_uring Adventures: Rust Servers That Love Syscalls Why Agentic AI is Killing the Traditional Database The POUR principles of web accessibility for developers and designers Quantum Neural Network 3D — A Deep Dive into Interactive WebGL Visualization How To Install Caveman In Codex On macOS And Windows Automation Pipeline Reliability: Why Your Workflow Breaks When Nobody Is Watching I Built an 'Open World' AI Coding Agent — It Works From ANY Folder From Freelancing to Product: A Tech Service Company's SaaS Transformation China's AI Giants: Adding Tencent Hunyuan & ByteDance Doubao to AI University (74 Providers) On the Vibe Coders and Their Lies clerk: Auto-Summarize Your Claude Code Sessions AI Weekly — 2026/04/10–04/17 | The Model Lockdown Is Here, but the Toolchain Is the Real Battleground AI 週報 — 2026/04/10–2026/04/17 模型封鎖潮來了,但工具鏈才是真戰場 Maybe this is how Open-Source apps are born... 🚀 Fine-Tune LLMs with LoRA and QLoRA: 2026 Guide tRPC v11 + Next.js App Router: End-to-End Type Safety Without the Boilerplate ShadCN UI in 2026: Why I Stopped Installing Component Libraries and Started Owning My Components SaaS Billing in React Server Components: Stripe + Supabase Without a Single `useEffect` Join our DEV Weekend Challenge — $1,000 in Prizes Across TEN winners! Submissions Due April 20 at 6:59 AM UTC. Implementing FSRS Spaced Repetition in Flutter + Supabase — Adding Memory Science to an AI Learning App "I Texted My Localhost From the Train — Claude Code Fixed the Bug Before I Got Home" I Built a Sales Prep AI and It Went Deeper Than Expected Design to Code #2: One JSON, Eleven Outputs Solving the 100M-Row Problem: A Summary Table Pattern for High-Volume Push Notification Logs Flutter Web With Wasm: What Actually Changes For Developers I Built 50 Royalty-Free Soundtracks for My Side Project in a Weekend Using AI Music Generation The Vibe Coding Security Checklist: 7 Things to Check Before You Ship Stop Letting Googlebot Guess Fix Your React App's SEO Right Desconstruindo o Streaming do LinkedIn: Como Criar um Engine de Extração de Vídeo de Alta Performance com HLS e FFmpeg (EDA Part-1) EDA (Exploratory Data Analysis) Explained With Real Life — Why Looking at Your Data Is the Most Important Step in Machine Learning Brand Relationship Management at Scale: Our 4-Touch Outreach System for 200+ Brands Why String.fromEnvironment() Might Return an Empty String in Dart JGuardrails 1.0.0 — Hardening Java LLM Apps Against Jailbreaks, Toxicity, and Prompt Injection Plan and Schedule a Full Week of Threads Content From One Claude Conversation Coding Cat Oran Ep3, Five Tables Changed Everything Updated: BFF Pattern I'm done watching freelancers get buried by 200 proposals. So I'm building the alternative. This is my first post BFS Algorithm in Java Step by Step Tutorial with Examples Tracking LLM Pricing Monthly: An Open Dataset for 22 AI Models How We Measure Content ROI on a Comparison Site: Revenue Attribution Without Perfect Data Introducing Nova AI Ops: The AI-Native Operating System for SRE Teams I built a free desktop video downloader for Windows — Grabbit How Talkie OCR Helps Vision-Impaired & Dyslexic Users Read the World Around Them VRCFaceTracking安装和iPhone面捕配置教程,有bug Even CrowdStrike Can't See Your Agents The Automation Gold Rush: What n8n Workflows and Claude Are Opening Up for Developers Right Now
Mistral Large 3: The 675B Open-Weight MoE Model Developer Guide
Jangwook Kim · 2026-05-05 · via DEV Community

Jangwook Kim

Mistral Large 3 launched in December 2025 as Mistral's flagship open-weight model. Six months later it remains the largest model Mistral has publicly released under a permissive license. This guide covers the architecture, benchmarks, pricing, and practical considerations for developers deciding whether to use it in 2026.

What Mistral Large 3 Is

Mistral Large 3 (model ID mistral-large-2512, the 2512 indicating December 2025) is a sparse Mixture-of-Experts (MoE) model with 675 billion total parameters and 41 billion active parameters per forward pass. Mistral trained it from scratch on 3,000 NVIDIA H200 GPUs.

The MoE architecture is the key efficiency decision. Instead of activating all 675B parameters for every token, the model routes each token through a subset of "expert" subnetworks. With 41B active parameters, Mistral Large 3 runs at roughly the same computational cost as a 41B dense model while accessing the capacity of a 675B one.

For self-hosting, that matters significantly: memory footprint and inference compute are determined by the active parameter count, not the total.

License: Apache 2.0

Mistral Large 3 is released under Apache 2.0. This means:

  • Free commercial use
  • Can be fine-tuned and redistributed
  • No usage restrictions beyond standard Apache terms
  • Model weights downloadable from HuggingFace: mistralai/Mistral-Large-3-675B-Instruct-2512

The license is what distinguishes Mistral Large 3 from comparable models. GPT-4o and Claude Opus 4 are API-only. Llama 4 405B carries a Meta community license with usage restrictions above 700M monthly users. Mistral Large 3 has no such conditions.

For enterprise deployment teams that need to run models on-premises, in air-gapped environments, or with full weight access for fine-tuning, this is the practical differentiator.

Specifications at a Glance

Verified from official Mistral documentation and HuggingFace model card.

Specification Value
Total parameters 675B
Active parameters 41B
Architecture Sparse MoE
Context window 256,000 tokens
License Apache 2.0
Model ID (Mistral API) mistral-large-latest or mistral-large-2512
HuggingFace ID mistralai/Mistral-Large-3-675B-Instruct-2512
Release date December 2025
Training hardware 3,000 NVIDIA H200 GPUs

Benchmarks

Scores from ArtificialAnalysis.ai and IntuitionLabs (independent evaluators).

Benchmark Score
MMLU ~85.5%
MMLU-Pro 73.11%
MATH-500 93.60%
HumanEval Top tier (varies by test configuration)

The MATH-500 score of 93.60% is high relative to most non-reasoning-specialized models. This reflects Mistral's investment in mathematical reasoning capability during training.

Important caveat: Benchmark scores are useful for directional comparison, not absolute guarantees. Model performance on your specific task will differ based on instruction format, system prompt, temperature, and the nature of your domain. Always run your own evaluation on a representative sample before making infrastructure decisions.

API Pricing

Verified from Mistral API documentation and pricepertoken.com (May 2026).

Token type Price
Input $0.50 per 1M tokens
Output $1.50 per 1M tokens

At $0.50/$1.50 per million tokens, Mistral Large 3 is positioned as a high-quality model at roughly half the cost of closed-source frontier options. For comparison, the pricing tier aligns with mid-tier API models from OpenAI and Anthropic while offering open weights.

Where to Access It

Via Mistral API:

curl https://api.mistral.ai/v1/chat/completions \
  -H "Authorization: Bearer $MISTRAL_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "mistral-large-latest",
    "messages": [{"role": "user", "content": "Explain MoE architecture in one paragraph."}]
  }'

Enter fullscreen mode Exit fullscreen mode

Via Python SDK:

from mistralai import Mistral

client = Mistral(api_key="YOUR_MISTRAL_API_KEY")

response = client.chat.complete(
    model="mistral-large-latest",
    messages=[
        {"role": "user", "content": "Write a Python function to parse JSONL files."}
    ]
)

print(response.choices[0].message.content)

Enter fullscreen mode Exit fullscreen mode

Via Azure AI Foundry:

Mistral Large 3 is available on Azure AI Foundry through Mistral's partnership with NVIDIA and Microsoft. This allows Azure customers to access it with Azure-native billing and compliance controls.

Self-hosted:

Download weights from HuggingFace and serve with vLLM, llama.cpp (for quantized versions), or Mistral's own inference tools. The 41B active parameter count makes it feasible to run on multi-GPU setups that cannot fit a 70B dense model at full precision.

Using the 256K Context Window

256,000 tokens is enough for approximately 200,000 words — a long novel, several codebases, or months of conversation history in a single context. In practice, there are two considerations:

Cost: Input tokens are billed at $0.50/1M, so a 200K-token context costs $0.10 per call. For use cases that genuinely need long context, that is reasonable. For tasks that do not, context management (summarization, retrieval) remains more economical.

Quality at context extremes: Models trained with long context windows often exhibit "lost in the middle" degradation — important information buried in the middle of a very long context is weighted less than information at the beginning or end. This is a general LLM limitation, not specific to Mistral. If your use case places critical information in the middle of large documents, test explicitly at that position.

Function Calling and Tool Use

Mistral Large 3 supports native function calling in the same JSON schema format as OpenAI:

tools = [
    {
        "type": "function",
        "function": {
            "name": "get_weather",
            "description": "Get current weather for a location",
            "parameters": {
                "type": "object",
                "properties": {
                    "location": {"type": "string"},
                    "unit": {"type": "string", "enum": ["celsius", "fahrenheit"]}
                },
                "required": ["location"]
            }
        }
    }
]

response = client.chat.complete(
    model="mistral-large-latest",
    messages=[{"role": "user", "content": "What's the weather in Tokyo?"}],
    tools=tools,
    tool_choice="auto"
)

Enter fullscreen mode Exit fullscreen mode

Tool use quality is one of the model's strong points, consistent with the MMLU-Pro scores.

Mistral Large 3 vs the Broader Mistral 2026 Lineup

As of May 2026, Mistral has several models in production. Understanding the lineup helps pick the right one:

Model Best for Notes
Mistral Large 3 Highest-quality tasks, self-hosting, fine-tuning 675B MoE, Apache 2.0, $0.50/$1.50/1M
Mistral Small 4 General use, lower cost Dense model, merges reasoning + vision + coding
Mistral Medium 3.5 Long-running agentic tasks Powers Le Chat Work Mode and Mistral Vibe
Codestral Code-specialized tasks Dedicated coding model
Ministral Edge / low-latency Small models for on-device use

A note on Le Chat Work Mode: Le Chat's "Work Mode" feature — which runs multi-step agentic tasks like email research, calendar management, and document production — is powered by Mistral Medium 3.5, not Mistral Large 3. The two are separate products at different capability levels. Large 3 is the open flagship; Work Mode is a product feature built on Medium 3.5's instruction-following and long-context strengths.

When to Choose Mistral Large 3

It makes sense when:

  • You need open weights (Apache 2.0) for self-hosting, air-gap deployment, or fine-tuning
  • You want a strong general model at a moderate API price point
  • Your use case involves long documents and needs genuine 256K context support
  • You are building on Azure and want Mistral native on Azure AI Foundry

Consider alternatives when:

  • You need the latest reasoning capabilities (dedicated reasoning models like o3 or Gemini 2.5 Pro outperform Large 3 on multi-step reasoning tasks)
  • You need multimodal (image/audio) input — Large 3 is text-only; Mistral Small 4 includes vision
  • Cost is the primary constraint — Mistral Small 4 at a lower price tier handles most general tasks

Fine-Tuning

Apache 2.0 means you can fine-tune and redistribute Mistral Large 3 without restrictions. For fine-tuning at this model size, common approaches:

  • QLoRA (quantized low-rank adaptation): Reduces memory requirement significantly; feasible on consumer multi-GPU hardware with quantization
  • LoRA at fp16/bf16: Requires approximately 80–100 GB VRAM in practice for the 41B active weight subset
  • Full fine-tuning: Requires a multi-node setup; practical only with datacenter hardware

Mistral's own fine-tuning API (fine_tuning.jobs.create) is available through the Mistral API for managed fine-tuning without local GPU infrastructure.


Model specifications verified from Mistral official announcement (mistral.ai/news/mistral-3), HuggingFace model card (mistralai/Mistral-Large-3-675B-Instruct-2512), and Mistral API documentation. Benchmarks from ArtificialAnalysis.ai and IntuitionLabs. Pricing from Mistral API documentation and pricepertoken.com (verified May 2026). Le Chat Work Mode attribution confirmed via testingcatalog.com and mistral.ai/news/vibe-remote-agents-mistral-medium-3-5.