惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

月光博客
月光博客
WordPress大学
WordPress大学
博客园 - 三生石上(FineUI控件)
H
Help Net Security
小众软件
小众软件
The Cloudflare Blog
人人都是产品经理
人人都是产品经理
Apple Machine Learning Research
Apple Machine Learning Research
S
SegmentFault 最新的问题
Last Week in AI
Last Week in AI
爱范儿
爱范儿
量子位
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
IT之家
IT之家
博客园 - 【当耐特】
V
Visual Studio Blog
大猫的无限游戏
大猫的无限游戏
博客园_首页
Jina AI
Jina AI
D
Docker
博客园 - 司徒正美
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
Microsoft Security Blog
Microsoft Security Blog
阮一峰的网络日志
阮一峰的网络日志

DEV Community

Authentication Security Deep Dive: From Brute Force to Salted Hashing (With Java Examples) Why AI Systems Don’t Fail — They Drift Spilling beans for how i learn for exam😁"Reinforcement Learning Cheat Sheet" I Replaced Chrome with Safari for AI Browser Automation. Here's What Broke (and What Finally Worked) How Python Borrows Other People's Work The $40 Architecture: Processing 1 Billion API Requests with 99.99% Uptime Vibe Coding: A Workflow Guide (From Zero to SaaS) Most webhook security guides protect the wrong side. The scary part is delivery. Headless CMS for TanStack Start: Build a Blog with Cosmic EU Age Verification App "Hacked in 2 Minutes" — What Actually Happened Comfy Cloud’s delete function does not actually remove files Running AI Models on GPU Cloud Servers: A Beginner Guide Event-driven media intelligence with AWS Step Functions and Bedrock I scored 500 AI prompts across 8 quality dimensions — here's what broke How to Call Google Gemini API from Next.js (Free Tier, No Backend Needed) The Portal Protocol: Reclaiming Human Connection in the Age of AI How to Fix Your Team's Scattered Knowledge Problem With a Self-Hosted Forum Intro to tc Cloud Functors: A Graph-First Mental Model for the Modern Cloud Designing Multi-Tenant Backends With Both Ownership and Team Access I Built a Neumorphic CSS Library with 77+ Components — Here's What I Learned PostgreSQL Performance Optimization: Why Connection Pooling Is Critical at Scale Cómo construí un SaaS multi-rubro para gestionar expensas en Argentina con FastAPI + Vue 3 🚀 I Built an Ethical Hacking Scanner Tool – Open Source Project I Replaced /usage and /context in Claude Code With a Single Statusline A Pythonic Way to Handle Emails (IMAP/SMTP) with Auto-Discovery and AI-Ready Design I Collected 8.9 Million Polymarket Price Points — Here's What I Found About How Markets Really Move EcoTrack AI — Carbon Footprint Tracker & Dashboard Everyone's Using AI. No One Agrees How. 5 self-hosted ebook managers worth trying in 2026 Building Your First AI Agent with LangChain: From Chatbot to Autonomous Assistant
Mastering Ollama AI endpoints: How to use each one correctly
Nube Colectiva · 2026-06-22 · via DEV Community

Learn how to use all 14 Ollama API endpoints with real-world examples, best practices, and production-ready insights.

Artificial Intelligence is rapidly moving from cloud-only environments to local deployments. Developers increasingly want privacy, lower latency, reduced costs, and complete control over their AI infrastructure.

This is where Ollama shines.

Ollama allows you to run powerful Large Language Models (LLMs) such as Llama, Gemma, Mistral, Qwen, DeepSeek, and many others directly on your local machine or server. Beyond running models, Ollama provides a robust REST API that enables developers to integrate AI capabilities into applications, automation workflows, chatbots, coding assistants, search engines, and enterprise systems.

In this guide, you'll learn all 14 Ollama API endpoints, understand when to use each one, and see practical examples that go beyond the official documentation.


What Is Ollama?

Ollama is a platform designed to simplify the deployment and execution of large language models locally.

Some advantages include:

  • Privacy-focused AI processing
  • No dependency on external AI providers
  • Reduced API costs
  • Fast local inference
  • OpenAI-compatible API support
  • Easy model management

By default, Ollama runs on:

http://localhost:11434


1. Generate Text

Endpoint

POST /api/generate

Purpose

Generates text from a single prompt.

Example

curl http://localhost:11434/api/generate \
-d '{
  "model":"llama3",
  "prompt":"Explain quantum computing in simple terms."
}'

Real Use Cases

  • Content generation
  • Code generation
  • Documentation writing
  • SEO article creation
  • Email drafting

Expert Tip

Use /api/generate for one-shot tasks where conversation history is unnecessary. It consumes fewer resources than chat endpoints.


2. Chat Conversations

Endpoint

POST /api/chat

Purpose

Maintains conversational context.

Example

curl http://localhost:11434/api/chat \
-d '{
  "model":"llama3",
  "messages":[
    {
      "role":"user",
      "content":"Create a Node.js REST API."
    }
  ]
}'

Real Use Cases

  • AI assistants
  • Customer support bots
  • Programming copilots
  • Internal company chatbots

Expert Tip

For production chat applications, always store conversation history externally rather than relying solely on the model context window.


3. Generate Embeddings

Endpoint

POST /api/embeddings

Purpose

Converts text into numerical vectors.

Example

curl http://localhost:11434/api/embeddings \
-d '{
  "model":"nomic-embed-text",
  "prompt":"How does machine learning work?"
}'

Real Use Cases

  • Semantic search
  • RAG systems
  • Recommendation engines
  • Knowledge bases

Expert Tip

Embeddings are the foundation of modern Retrieval-Augmented Generation (RAG) systems.


4. List Installed Models

Endpoint

GET /api/tags

Purpose

Displays all downloaded models.

Example

curl http://localhost:11434/api/tags

Why It Matters

Useful for:

  • Admin dashboards
  • Deployment scripts
  • Health checks
  • Monitoring systems

5. Display Model Details

Endpoint

POST /api/show

Purpose

Returns detailed model information.

Example

curl http://localhost:11434/api/show \
-d '{
  "name":"llama3"
}'

Useful Information Returned

  • Parameters
  • Quantization level
  • Model size
  • Context length
  • Architecture details

Expert Tip

Use this endpoint to automatically validate model compatibility before deployment.


6. Download a Model

Endpoint

POST /api/pull

Purpose

Downloads a model from the Ollama registry.

Example

curl http://localhost:11434/api/pull \
-d '{
  "name":"deepseek-r1"
}'

Automation Scenario

When deploying a new server:

startup.sh

can automatically pull required models before application startup.


7. Upload a Model

Endpoint

POST /api/push

Purpose

Publishes a model to a registry.

Example

curl http://localhost:11434/api/push \
-d '{
  "name":"mycompany-assistant"
}'

Real Use Cases

  • Internal AI distribution
  • Team collaboration
  • Enterprise model sharing

8. Create a Custom Model

Endpoint

POST /api/create

Purpose

Creates custom models from a Modelfile.

Example

curl http://localhost:11434/api/create \
-d '{
  "name":"seo-expert",
  "modelfile":"FROM llama3"
}'

Why This Is Powerful

You can:

  • Add custom system prompts
  • Create branded assistants
  • Standardize AI behavior
  • Build department-specific AI agents

9. Copy a Model

Endpoint

POST /api/copy

Purpose

Duplicates an existing model.

Example

curl http://localhost:11434/api/copy \
-d '{
  "source":"llama3",
  "destination":"llama3-backup"
}'

Common Use Cases

  • Versioning
  • Testing
  • Experimentation
  • Safe upgrades

10. Delete a Model

Endpoint

DELETE /api/delete

Purpose

Removes a model from local storage.

Example

curl -X DELETE http://localhost:11434/api/delete \
-d '{
  "name":"old-model"
}'

Best Practice

Always verify model usage before deleting in shared environments.


11. View Running Models

Endpoint

GET /api/ps

Purpose

Shows models currently loaded in memory.

Example

curl http://localhost:11434/api/ps

Why It Matters

Helpful for:

  • Memory monitoring
  • Resource optimization
  • Capacity planning
  • Troubleshooting

Expert Tip

Large models may occupy several gigabytes of RAM even when idle.


12. Check Ollama Version

Endpoint

GET /api/version

Purpose

Returns the installed Ollama version.

Example

curl http://localhost:11434/api/version

Production Use

Useful for:

  • CI/CD validation
  • Compatibility checks
  • Deployment audits

13. OpenAI-Compatible Chat Completions

Endpoint

POST /v1/chat/completions

Purpose

Provides OpenAI API compatibility.

Example

curl http://localhost:11434/v1/chat/completions \
-d '{
  "model":"llama3",
  "messages":[
    {
      "role":"user",
      "content":"Write a Python function for sorting."
    }
  ]
}'

Why Developers Love This

Applications built for OpenAI can often switch to Ollama with minimal code changes.

Real Benefits

  • Lower costs
  • Local execution
  • Better privacy
  • Vendor independence

14. OpenAI-Compatible Model Listing

Endpoint

GET /v1/models

Purpose

Lists available models using the OpenAI format.

Example

curl http://localhost:11434/v1/models

Best Use Cases

  • AI gateways
  • SDK integrations
  • Multi-provider platforms
  • Existing OpenAI-based projects

Building Production Systems with Ollama

Many developers stop at generating text, but modern AI applications usually combine several endpoints:

AI Chatbot

/api/chat
/api/show
/api/ps

RAG Search Engine

/api/embeddings
/api/chat

Internal AI Platform

/api/pull
/api/show
/api/chat
/api/delete

OpenAI Replacement

/v1/chat/completions
/v1/models

Combining endpoints intelligently is what separates a proof of concept from a production-ready AI solution.


Security Best Practices

Before exposing Ollama publicly:

  • Place it behind a reverse proxy
  • Enable authentication
  • Limit access with firewalls
  • Monitor resource consumption
  • Restrict model management endpoints
  • Use HTTPS in production

Never expose an unrestricted Ollama instance directly to the internet.


Performance Optimization Tips

To achieve better performance:

  1. Use quantized models when possible.
  2. Keep frequently used models loaded.
  3. Monitor RAM utilization.
  4. Cache embeddings.
  5. Use SSD storage.
  6. Separate inference and application servers for high traffic.

These practices can significantly reduce latency and improve throughput.


Conclusion

Ollama is much more than a tool for running local language models—it is a complete AI platform with endpoints covering text generation, conversational AI, embeddings, model lifecycle management, monitoring, and OpenAI compatibility.

Understanding all 14 endpoints allows developers to build sophisticated AI solutions without relying entirely on external providers. Whether you're creating a chatbot, a RAG-powered knowledge base, a coding assistant, or an enterprise AI platform, Ollama provides the building blocks needed to deploy AI locally, securely, and efficiently.

As organizations increasingly prioritize privacy, cost control, and infrastructure ownership, mastering the Ollama API is becoming a valuable skill for modern software engineers, DevOps professionals, and AI developers.