惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

L
LangChain Blog
B
Blog RSS Feed
阮一峰的网络日志
阮一峰的网络日志
Cyber Security Advisories - MS-ISAC
Cyber Security Advisories - MS-ISAC
H
Help Net Security
MyScale Blog
MyScale Blog
WordPress大学
WordPress大学
Microsoft Azure Blog
Microsoft Azure Blog
GbyAI
GbyAI
小众软件
小众软件
大猫的无限游戏
大猫的无限游戏
Martin Fowler
Martin Fowler
Vercel News
Vercel News
S
SegmentFault 最新的问题
M
MIT News - Artificial intelligence
Microsoft Security Blog
Microsoft Security Blog
G
Google Developers Blog
Last Week in AI
Last Week in AI
Hugging Face - Blog
Hugging Face - Blog
酷 壳 – CoolShell
酷 壳 – CoolShell
博客园 - 【当耐特】
Google DeepMind News
Google DeepMind News
Engineering at Meta
Engineering at Meta
云风的 BLOG
云风的 BLOG

DEV Community

Authentication Security Deep Dive: From Brute Force to Salted Hashing (With Java Examples) Why AI Systems Don’t Fail — They Drift Spilling beans for how i learn for exam😁"Reinforcement Learning Cheat Sheet" I Replaced Chrome with Safari for AI Browser Automation. Here's What Broke (and What Finally Worked) How Python Borrows Other People's Work The $40 Architecture: Processing 1 Billion API Requests with 99.99% Uptime Vibe Coding: A Workflow Guide (From Zero to SaaS) Most webhook security guides protect the wrong side. The scary part is delivery. Headless CMS for TanStack Start: Build a Blog with Cosmic EU Age Verification App "Hacked in 2 Minutes" — What Actually Happened Comfy Cloud’s delete function does not actually remove files Running AI Models on GPU Cloud Servers: A Beginner Guide Event-driven media intelligence with AWS Step Functions and Bedrock I scored 500 AI prompts across 8 quality dimensions — here's what broke How to Call Google Gemini API from Next.js (Free Tier, No Backend Needed) The Portal Protocol: Reclaiming Human Connection in the Age of AI How to Fix Your Team's Scattered Knowledge Problem With a Self-Hosted Forum Intro to tc Cloud Functors: A Graph-First Mental Model for the Modern Cloud Designing Multi-Tenant Backends With Both Ownership and Team Access I Built a Neumorphic CSS Library with 77+ Components — Here's What I Learned PostgreSQL Performance Optimization: Why Connection Pooling Is Critical at Scale Cómo construí un SaaS multi-rubro para gestionar expensas en Argentina con FastAPI + Vue 3 🚀 I Built an Ethical Hacking Scanner Tool – Open Source Project I Replaced /usage and /context in Claude Code With a Single Statusline A Pythonic Way to Handle Emails (IMAP/SMTP) with Auto-Discovery and AI-Ready Design I Collected 8.9 Million Polymarket Price Points — Here's What I Found About How Markets Really Move EcoTrack AI — Carbon Footprint Tracker & Dashboard Everyone's Using AI. No One Agrees How. 5 self-hosted ebook managers worth trying in 2026 Building Your First AI Agent with LangChain: From Chatbot to Autonomous Assistant
Building an efficient logger in Go for hosts with restric...
Tudor Hulban · 2026-05-20 · via DEV Community

Tudor Hulban

Arenalog: Async Go logging optimized for 1–2 vCPU containers and serverless runtimes.


The Problem: Current loggers are not efficient in hosts with up to two cores

Traditional Go loggers are engineered for macro-scale vertical
concurrency. But what if your service runs in a 1–2 vCPU container? Then aggregate throughput becomes irrelevant. What matters is: how many cycles does one log call take from your business logic?

Design Philosophy

Arenalog completely flips this paradigm. It is purposely designed from the ground up
to be transparent in high-density, low-core cloud architectures: Kubernetes Sidecars,
Microservices, Serverless environments like AWS Lambda or Cloud Run.

By hyper-optimizing for a single core, Arenalog achieves a paradigm shift:
Delivering 3-core generic logger throughput on a 1-core cloud budget. On single core, the runtime completely avoids cross-core cache-line bouncing and atomic synchronization thrashing, helping the bytearena ingestor achieve its most efficient ingest conditions.

Arenalog operates asynchronously as long as the underlying writer writes.

Building blocks

The formatter part strives to keep heap allocations at a minimum.

How to use

First step is to initialize the ingestor.

By default the ingestor is optimized for one core hosts (ex. docker run --rm --memory="128m" --cpuset-cpus="0" -p 8080:8080 cname). To use with multicore hosts the bytearena.WithCounterCoreCPU() option should be used as in below:

ingestor, errCrIngestor := bytearena.NewIngestor(
            bytearena.Size100K(),// ingestor uses two arenas of size
            &writer,

            helpers.TernaryWithValueIn(
                []int{1},        // if NumCPU() == 1
                runtime.NumCPU(),// condition
                nil,             // use default
                bytearena.WithCounterCoreCPU(),
            ),
        )

Enter fullscreen mode Exit fullscreen mode

where the helper is:

func TernaryWithValueIn[V comparable, T any](haystack []V, needle V, value1, value2 T) T {
    if slices.Contains(haystack, needle) {
        return value1
    }

    return value2
}

Enter fullscreen mode Exit fullscreen mode

Ingestion should be started:

ctx, cancel := context.WithCancel(context.Background())
chIngestionEnd := ingestor.StartIngestion(ctx)

Enter fullscreen mode Exit fullscreen mode

We can use the ingestor in the logger creation:

logger, errCrLogger := arenalog.NewLogger(
        &arenalog.ParamsNewLogger{
            Ingestor:    ingestor,
            LoggerLevel: arenalog.LevelInfo,

            WithFatalWriter: os.Stdout,
            WithJSON:        true,
        },

        arenalog.WithTimestampRFC3339UTC(t.Context()),
    )

Enter fullscreen mode Exit fullscreen mode

Once we have a logger we can start using it directly:

logger.Info("logger ready")

Enter fullscreen mode Exit fullscreen mode

Or create a context root that would be shared among entries:

    logContext := arenalog.NewLogContext(logger).
        WithRoot("service", "auth")

    entry := logContext.WithString("area", "some area")
    entry.Info().Msg("benchmark test")

Enter fullscreen mode Exit fullscreen mode

And that should produce:

{"ts":"2026-05-19T13:56:10.288Z","level":"INFO","msg":"created logger, level INFO"}
{"ts":"2026-05-19T13:56:10.288Z","level":"INFO","msg":"logger ready"}
{"ts":"2026-05-19T13:56:10.288Z","level":"INFO","service":"auth","area":"some area","msg":"benchmark test"}

Enter fullscreen mode Exit fullscreen mode

The first line is emitted automatically by NewLogger() as an initialization confirmation. Subsequent lines come from explicit logger.Info() calls.

Measured Performance

A log context with multiple fields as

logContext := NewLogContext(logger).
            WithRoot("service", "auth").
            SetInt("req_id", 12345).
            SetBool("cache_hit", true)

    entry := logContext.
                                WithString("area", "some area").
                                Info().
                                WithString("user", "tudor").
                                WithInt("attempt", i).
                                WithFloat("some float", 1.1137).
                                WithBool("success", true)

                            entry.Msg("benchmark test")

Enter fullscreen mode Exit fullscreen mode

Is scoring as below:

// cpu: AMD Ryzen 7 5800H with Radeon Graphics
// BenchmarkArenalog_MultipleFields_Parallel/gomaxprocs=1-16            15310951            76.55 ns/op        0 B/op          0 allocs/op
// BenchmarkArenalog_MultipleFields_Parallel/gomaxprocs=2-16            17851222            66.67 ns/op        0 B/op          0 allocs/op
// BenchmarkArenalog_MultipleFields_Parallel/gomaxprocs=3-16            16263550            74.16 ns/op        0 B/op          0 allocs/op
// BenchmarkArenalog_MultipleFields_Parallel/gomaxprocs=4-16            15345500            76.67 ns/op        0 B/op          0 allocs/op
// BenchmarkArenalog_MultipleFields_Parallel/gomaxprocs=8-16            16770168            73.00 ns/op        0 B/op          0 allocs/op

Enter fullscreen mode Exit fullscreen mode

When NOT to Use Arenalog

Arenalog prioritizes per-call latency on 1–2 core hosts. If you are running on 8+ core machines and need maximum aggregate throughput, a batched, multi-worker logger may still be more efficient.

Note that logs may be dropped under backpressure. Backpressure could be measured for specific cases, but on modern CPUs, a safe harbour value should be above one million logs per second per core if the arena size corresponds to the payloads velocity.

Source

The source is available on GitHub at github.com/TudorHulban/arenalog. Benchmarks, tests and helpers are all included.