ZSE v2.0.0 — The "Own Everything" Release

A complete rewrite. Zero third-party dependencies. No PyTorch, no Triton, no transformers, no bitsandbytes. Pure-Python kernel compiler emits CUDA C, HIP C, and Metal Shading Language directly.

Install size: ~3 GB → ~5 MB.

Headline numbers (Qwen2.5-14B INT4 vs vLLM AWQ INT4 on A100-80GB)

Validated on 6 platforms

Install

pip install zse-engine
zse serve model.zse --port 8000

Or run the kernel compiler standalone:

What's in this release

• ZSE Kernel Compiler — @zse.kernel Python DSL → CUDA / HIP / Metal. Warp primitives, vectorized memory, block reductions, tiling, fusion, WMMA, CDNA3 MFMA matrix cores, auto-tuning.
• .zse model format v2 — pre-quantized INT4/INT8/FP16, mmap-friendly, C-accelerated quantization (~600× faster). Adapters for Llama / Mistral / Qwen2 / Gemma2 / Phi3.
• Own PagedAttention — adaptive block sizing, token-level eviction, FNV-1a dedup, COW forking.
• ZStreamer — continuous batching, disaggregated prefill/decode, chunked prefill, speculative decoding (n-gram + self-draft).
• Orchestrator — unified VRAM allocator, 29 GPU kernels on MI300X, CUDA Graphs + HIP Graphs, LoRA hot-swap.
• Server — OpenAI-compatible API, API key auth, rate limiting, SQLite store, built-in RAG (/v1/rag/*), web dashboard.
• RAG — BM25 + TF-IDF + dense embeddings (via the loaded LLM, zero extra deps) + Reciprocal Rank Fusion + LLM cross-encoder rerank.
• Tensor Parallelism — pure-ctypes NCCL/RCCL wrapper, multi-process workers.

Breaking changes

• Package rename: zllm-zse → zse-engine on PyPI
• Module rename: zse → zse_engine
• .zse format v2 is incompatible with 1.x — re-convert with zse convert
• bnb / bitsandbytes backend removed
• PyTorch / Triton / transformers dependencies removed

Full migration guide and detailed change log: CHANGELOG.md

Acknowledgments

AMD MI300X validation, 32B-parameter benchmarks, and our ROCm wave-64 kernel development were made possible by DigitalOcean's Open Source Sponsorship Program.

447 tests passing. Zero dependencies. Three GPU backends. One package.