telnyx-code-examples/build-rag-with-telnyx-inference-python at main · team-telnyx/telnyx-code-examples

name	build-rag-with-telnyx-inference
title	Build RAG with Telnyx Inference
description	Build a retrieval-augmented generation API with Telnyx embeddings and chat completions.
language	python
framework	flask
telnyx_products	AI Inference

Build a retrieval-augmented generation API with Telnyx embeddings and chat completions.

Telnyx API Endpoints Used

Embeddings: POST /v2/ai/embeddings - create vectors for documents and questions
AI Inference: POST /v2/ai/chat/completions - API reference

Architecture

  User question
        |
        v
  Embed question with Telnyx
        |
        v
  Compare against document embeddings
        |
        v
  Send retrieved context to Telnyx AI
        |
        v
  Grounded answer + source titles

Environment Variables

Copy .env.example to .env and fill in:

Variable	Type	Example	Required	Description	Where to get it
`TELNYX_API_KEY`	`string`	`KEY0123456789ABCDEF`	yes	Telnyx API v2 key	Portal
`AI_MODEL`	`string`	`moonshotai/Kimi-K2.6`	no	Telnyx chat model	Models
`EMBEDDING_MODEL`	`string`	`thenlper/gte-large`	no	Telnyx embedding model	Models
`HOST`	`string`	`127.0.0.1`	no	Local server host	-
`PORT`	`integer`	`5000`	no	Local server port	-

Setup

git clone https://github.com/team-telnyx/telnyx-code-examples.git
cd telnyx-code-examples/build-rag-with-telnyx-inference-python
cp .env.example .env
pip install -r requirements.txt
python app.py

API Reference

`POST /rag/ask`

Ask a question. The app retrieves relevant in-memory support docs and answers using only that context.

curl -X POST http://localhost:5000/rag/ask \
  -H "Content-Type: application/json" \
  -d '{
    "question": "Production signup broke after rotating an API key. Logs show 401 errors. What should we check first?"
  }'

Response:

{
  "answer": "Check that production services are using the new active API key and that the key has the required permissions. Also verify no old key is cached in deployment secrets.",
  "model": "moonshotai/Kimi-K2.6",
  "embedding_model": "thenlper/gte-large",
  "sources": [
    {"title": "API Key Authentication", "score": 0.9123},
    {"title": "Verification Message Delivery", "score": 0.7811}
  ]
}

`GET /documents`

Returns the sample knowledge base.

`GET /health`

Returns service status, configured models, and document count.

Troubleshooting

Issue	Cause	Fix
`401 Unauthorized`	Invalid or missing Telnyx API key	Verify `TELNYX_API_KEY` in `.env`
Slow first request	The app creates document embeddings lazily	First request may take longer; later requests reuse embeddings in memory
Weak answers	Sample knowledge base is too small	Add more documents or replace `DOCUMENTS` with your own content

Related Examples

Resources

Why Telnyx

Telnyx is an AI Communications Infrastructure platform - voice, messaging, SIP, AI, and IoT on one private, global network.

推荐订阅源

Hacker News - Newest: "AI"