惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

W
WeLiveSecurity
博客园 - 【当耐特】
Microsoft Azure Blog
Microsoft Azure Blog
WordPress大学
WordPress大学
Stack Overflow Blog
Stack Overflow Blog
cs.AI updates on arXiv.org
cs.AI updates on arXiv.org
IT之家
IT之家
Cloudbric
Cloudbric
The Register - Security
The Register - Security
小众软件
小众软件
PCI Perspectives
PCI Perspectives
G
Google Developers Blog
AI
AI
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
Google DeepMind News
Google DeepMind News
Google DeepMind News
Google DeepMind News
宝玉的分享
宝玉的分享
Recent Commits to openclaw:main
Recent Commits to openclaw:main
量子位
TaoSecurity Blog
TaoSecurity Blog
cs.CV updates on arXiv.org
cs.CV updates on arXiv.org
F
Full Disclosure
N
Netflix TechBlog - Medium
博客园_首页
Last Week in AI
Last Week in AI
A
Arctic Wolf
B
Blog RSS Feed
J
Java Code Geeks
C
Cybersecurity and Infrastructure Security Agency CISA
I
InfoQ
aimingoo的专栏
aimingoo的专栏
云风的 BLOG
云风的 BLOG
NISL@THU
NISL@THU
MyScale Blog
MyScale Blog
H
Hackread – Cybersecurity News, Data Breaches, AI and More
Jina AI
Jina AI
有赞技术团队
有赞技术团队
S
Schneier on Security
L
Lohrmann on Cybersecurity
P
Privacy & Cybersecurity Law Blog
T
Threat Research - Cisco Blogs
P
Palo Alto Networks Blog
S
Security @ Cisco Blogs
Security Archives - TechRepublic
Security Archives - TechRepublic
Security Latest
Security Latest
Vercel News
Vercel News
博客园 - 司徒正美
Webroot Blog
Webroot Blog
Hacker News: Ask HN
Hacker News: Ask HN
A
About on SuperTechFans

DEV Community

Authentication Security Deep Dive: From Brute Force to Salted Hashing (With Java Examples) Why AI Systems Don’t Fail — They Drift Spilling beans for how i learn for exam😁"Reinforcement Learning Cheat Sheet" I Replaced Chrome with Safari for AI Browser Automation. Here's What Broke (and What Finally Worked) How Python Borrows Other People's Work The $40 Architecture: Processing 1 Billion API Requests with 99.99% Uptime Vibe Coding: A Workflow Guide (From Zero to SaaS) Most webhook security guides protect the wrong side. The scary part is delivery. Headless CMS for TanStack Start: Build a Blog with Cosmic EU Age Verification App "Hacked in 2 Minutes" — What Actually Happened Comfy Cloud’s delete function does not actually remove files Running AI Models on GPU Cloud Servers: A Beginner Guide Event-driven media intelligence with AWS Step Functions and Bedrock I scored 500 AI prompts across 8 quality dimensions — here's what broke How to Call Google Gemini API from Next.js (Free Tier, No Backend Needed) The Portal Protocol: Reclaiming Human Connection in the Age of AI How to Fix Your Team's Scattered Knowledge Problem With a Self-Hosted Forum Intro to tc Cloud Functors: A Graph-First Mental Model for the Modern Cloud Designing Multi-Tenant Backends With Both Ownership and Team Access I Built a Neumorphic CSS Library with 77+ Components — Here's What I Learned PostgreSQL Performance Optimization: Why Connection Pooling Is Critical at Scale Cómo construí un SaaS multi-rubro para gestionar expensas en Argentina con FastAPI + Vue 3 🚀 I Built an Ethical Hacking Scanner Tool – Open Source Project I Replaced /usage and /context in Claude Code With a Single Statusline A Pythonic Way to Handle Emails (IMAP/SMTP) with Auto-Discovery and AI-Ready Design I Collected 8.9 Million Polymarket Price Points — Here's What I Found About How Markets Really Move EcoTrack AI — Carbon Footprint Tracker & Dashboard Everyone's Using AI. No One Agrees How. 5 self-hosted ebook managers worth trying in 2026 Building Your First AI Agent with LangChain: From Chatbot to Autonomous Assistant Common SOC 2 Failures (Real World) Stop Vibe-Checking Your AI App: A Practical Guide to Evals How to Use SonarQube and SonarScanner Locally to Level Up Your Code Quality Your Next To-Do App Is Dead — I Replaced Mine with an OpenClaw AI Sign a Nostr event in 60 lines of Python using coincurve — no nostr-sdk, no nbxplorer, no rust toolchain ITGC Audit Explained Like You’re in Big 4 Patch Tuesday abril 2026: Microsoft parcha 163 vulnerabilidades y un zero-day en SharePoint Stop scraping everything: a better way to track competitor price changes Listing on MCPize + the Official MCP Registry while routing payments OUTSIDE the marketplace — how I kept 100% of my x402 revenue Building an AI-Powered Risk Intelligence System Using Serverless Architecture Why We Ripped Function Overloading Out of Our AI Toolchain Testing AI-Generated Code: How to Actually Know If It Works SaaS Churn Is Killing Your Business. Here Is What to Do About It (Without a Support Team) The Speed of AI Is No Longer Linear - And Self-Improving Models Are Why How to Implement RBAC for MCP Tools: A Practical Guide for Engineering Teams From Standard Quote to Persuasive Proposal: AI Automation for Arborists I built a CLI that scaffolds complete multi-tenant SaaS apps Axios CVE-2025–62718: The Silent SSRF Bug That Could Be Hiding in Your Node.js App Right Now The dashboard that ended our friendship Data Pipelines Explained Simply (and How to Build Them with Python) The Hidden Cost of AI Systems Nobody Talks About. undefined vs undeclared, and how typeof behaves Switching from file-based jobs to NATS/Kafka in Rust without changing code io_uring Adventures: Rust Servers That Love Syscalls Why Agentic AI is Killing the Traditional Database The POUR principles of web accessibility for developers and designers Quantum Neural Network 3D — A Deep Dive into Interactive WebGL Visualization How To Install Caveman In Codex On macOS And Windows Automation Pipeline Reliability: Why Your Workflow Breaks When Nobody Is Watching I Built an 'Open World' AI Coding Agent — It Works From ANY Folder From Freelancing to Product: A Tech Service Company's SaaS Transformation China's AI Giants: Adding Tencent Hunyuan & ByteDance Doubao to AI University (74 Providers) On the Vibe Coders and Their Lies clerk: Auto-Summarize Your Claude Code Sessions AI Weekly — 2026/04/10–04/17 | The Model Lockdown Is Here, but the Toolchain Is the Real Battleground AI 週報 — 2026/04/10–2026/04/17 模型封鎖潮來了,但工具鏈才是真戰場 Maybe this is how Open-Source apps are born... 🚀 Fine-Tune LLMs with LoRA and QLoRA: 2026 Guide tRPC v11 + Next.js App Router: End-to-End Type Safety Without the Boilerplate ShadCN UI in 2026: Why I Stopped Installing Component Libraries and Started Owning My Components SaaS Billing in React Server Components: Stripe + Supabase Without a Single `useEffect` Join our DEV Weekend Challenge — $1,000 in Prizes Across TEN winners! Submissions Due April 20 at 6:59 AM UTC. Implementing FSRS Spaced Repetition in Flutter + Supabase — Adding Memory Science to an AI Learning App "I Texted My Localhost From the Train — Claude Code Fixed the Bug Before I Got Home" I Built a Sales Prep AI and It Went Deeper Than Expected Design to Code #2: One JSON, Eleven Outputs Solving the 100M-Row Problem: A Summary Table Pattern for High-Volume Push Notification Logs Flutter Web With Wasm: What Actually Changes For Developers I Built 50 Royalty-Free Soundtracks for My Side Project in a Weekend Using AI Music Generation The Vibe Coding Security Checklist: 7 Things to Check Before You Ship Stop Letting Googlebot Guess Fix Your React App's SEO Right Desconstruindo o Streaming do LinkedIn: Como Criar um Engine de Extração de Vídeo de Alta Performance com HLS e FFmpeg (EDA Part-1) EDA (Exploratory Data Analysis) Explained With Real Life — Why Looking at Your Data Is the Most Important Step in Machine Learning Brand Relationship Management at Scale: Our 4-Touch Outreach System for 200+ Brands Why String.fromEnvironment() Might Return an Empty String in Dart JGuardrails 1.0.0 — Hardening Java LLM Apps Against Jailbreaks, Toxicity, and Prompt Injection Plan and Schedule a Full Week of Threads Content From One Claude Conversation Coding Cat Oran Ep3, Five Tables Changed Everything Updated: BFF Pattern I'm done watching freelancers get buried by 200 proposals. So I'm building the alternative. This is my first post BFS Algorithm in Java Step by Step Tutorial with Examples Tracking LLM Pricing Monthly: An Open Dataset for 22 AI Models How We Measure Content ROI on a Comparison Site: Revenue Attribution Without Perfect Data Introducing Nova AI Ops: The AI-Native Operating System for SRE Teams I built a free desktop video downloader for Windows — Grabbit How Talkie OCR Helps Vision-Impaired & Dyslexic Users Read the World Around Them VRCFaceTracking安装和iPhone面捕配置教程,有bug Even CrowdStrike Can't See Your Agents The Automation Gold Rush: What n8n Workflows and Claude Are Opening Up for Developers Right Now
Where Does the Data Go? A Comprehensive Guide to Databases
Lawrence Mur · 2026-05-26 · via DEV Community

Introduction

Whether you are building a website, a mobile app, or a complex business system, you will inevitably need a secure and efficient place to house your data. This data serves as the digital backbone of your application, and how you manage it directly impacts your system's reliability and performance. To handle this responsibility, developers rely on a database. A database is a specialized, organized system designed to store, manage, and retrieve information with precision and speed.
However, in today’s digital landscape, not all data is created equal. Storing a highly sensitive list of user passwords requires a fundamentally different architectural approach than processing thousands of temperature readings collected per second from a weather sensor. Because modern data comes in various shapes, sizes, and velocities, software engineers have developed different types of databases specifically tailored to handle these diverse requirements.
This article explores the primary types of databases, how they work, when to best utilize them, foundational database concepts, and the pros and cons of each.

1. Relational Databases (SQL)

Relational databases are the traditional filing cabinets of the software world. They have been around since the 1970s and store data in strict, organized tables containing rows and columns—very much like an Excel spreadsheet. The relational part means you can link these tables together. For example, a Customers table can be easily linked to an Orders table using a customer ID number. To talk to these databases, developers use a standard language called SQL (Structured Query Language).
Examples: MySQL, PostgreSQL, Oracle, Microsoft SQL Server.
Uses: Banking systems, inventory management, e-commerce stores, and anywhere you need absolute accuracy.

Pros

Reliability - They use a strict rule system (ACID), guaranteeing that data transactions are processed reliably. If you transfer $10 to a friend, the database ensures your account loses $10 and their account gains $10. If the system crashes halfway through, it safely cancels the whole transaction rather than losing the money.
Standardization - SQL is widely known, highly documented, and supported by almost all data tools.
Complex Querying - You can easily ask complicated questions that pull connected data from dozens of different tables at once.
Data Integrity - Built-in rules prevent orphaned data (like having an order in the system for a customer that has been deleted).

Cons

Rigid Structure - You must define exactly what your tables look like ahead of time. Adding a new column later can be a slow, system-locking process.
Hard to Scale Out - To handle more traffic, you usually have to buy a bigger, more expensive server (scaling up). It is very difficult to spread a relational database across dozens of cheap servers (scaling out).
Performance Bottlenecks - They can become slow when searching through massive, row datasets if not perfectly optimized.

2. NoSQL Databases

NoSQL stands for Not Only SQL. These databases were created in the 2000s when companies realized traditional relational databases could not handle the massive amounts of fast, messy, unstructured data they were collecting. Instead of strict tables and rows, NoSQL databases come in a few different types.

A. Document Databases
These store data as documents (usually JSON format), which look like nested lists. Instead of splitting a user's details across five different tables, you store all their information together in one single document.
Examples: MongoDB, CouchDB.
Uses: User profiles, content management systems (like blogs), and product catalogs.

Pros

Highly flexible - You can add new, unique pieces of information to one document without affecting the others.
Developer-friendly - the documents look exactly like the code objects developers write.

Cons

Not great for complex queries - Cross-referencing data across hundreds of documents is slow.
Data duplication - stores the same piece of info in multiple documents to keep reading fast.

B. Key-Value Stores
This is the simplest type of database. It works just like a dictionary. You have a Key (a unique word or ID) and a Value (the data attached to it). To retrieve the data, you must know the exact key.
Examples: Amazon DynamoDB, Redis.
Uses: Shopping carts, user session data (keeping you logged in), and user preferences.

Pros

  • Fast and simple to implement
  • Easy to scale across hundreds of servers.

Cons

  • You can only search by the exact key. You cannot easily ask the database complex questions like, Show me all users who live in New York.
  • They also offer no built-in way to link data together.

C. Wide-Column Stores
These look a bit like relational tables, but the names and formats of the columns can change from row to row. They are designed to hold massive amounts of data spread out over many servers.
Examples: Apache Cassandra, HBase.
Uses: Logging user activity, smart home (IoT) device data, massive music or video streaming platforms.

Pros

  • Can handle millions of data writes per second.
  • They are highly fault-tolerant and almost never go down, even if several servers in the cluster break. They also compress data very efficiently.

Cons

  • Complex to set up and manage.
  • They offer very limited querying options and are slower for reading individual, specific records compared to a Key-Value store.

D. Graph Databases
These databases care more about the relationships between data than the data itself. They store data in nodes (entities/people) and edges (the connections between them).
Examples: Neo4j, Amazon Neptune.
Uses: Social networks (finding friends of friends), fraud detection rings, and recommendation engines (users who bought X also bought Y).

Pros

  • Makes querying deeply connected, complex relationships incredibly fast.
  • They also provide highly intuitive, visual ways to look at your data.

Cons

  • Highly specialized. Its built to do one specific job and cant be used as a normal database.
  • They are terrible for keeping standard business records, doing simple counting tasks,
  • Require learning steep, specialized query languages.

3. NewSQL Databases

NewSQL combines the strict, reliable rules of a Relational (SQL) database, but scales and grows across hundreds of servers as effortlessly as a NoSQL database.
Examples: CockroachDB, Google Cloud Spanner.
Uses: Global financial platforms, multi-region software apps, and high-availability gaming backends.

Pros

  • You get the absolute safety of SQL, but the database automatically balances itself across many servers without manual work.
  • It survives data center crashes easily and prevents downtime.

Cons

  • They are highly complex to operate compared to standard SQL databases
  • Require more expensive hardware or cloud setups to run smoothly
  • Smaller community of developers if you need troubleshooting help.

4. Vector Databases

Vector databases are the storage brains behind modern Artificial Intelligence. Instead of searching for exact word matches, they turn data (like text, images, or audio) into complex arrays of numbers called embeddings. They find things based on underlying meaning and similarity.
Examples: Pinecone, Milvus, Weaviate.
Uses: AI chatbots (feeding relevant info to models like ChatGPT), facial recognition, and semantic search (searching by context, not just keywords).

Pros

  • Extremely fast at similarity searches, even when sifting through billions of complex records.
  • Effortlessly handle unstructured data like audio and video files.

Cons

  • Very specialized hence cannot be used to store user passwords, process credit card payments, or keep track of inventory.
  • Yield approximate results (trading 100% accuracy for speed)
  • Useless for standard business bookkeeping.
  • Generating the embeddings to put into the database can be computationally expensive.

5. Time-Series Databases

Sometimes, time is the most important piece of data you have. A time-series database is built specifically to handle data that is recorded over time, usually arriving in a constant, heavy stream.
Examples: InfluxDB, Prometheus, TimescaleDB.
Uses: Stock market tracking, server performance monitoring, weather station data.

Pros

  • Heavily optimized to write data quickly and compress it so it takes up minimal space.
  • They feature built-in functions to easily answer questions like, What was the average temperature between 2:00 PM and 4:00 PM?
  • Can automatically delete old data after a set period.

Cons

  • They are notoriously bad at handling random data updates or deleting specific old records.
  • Once a timestamped event happens, it is generally treated as permanent history.

6. Search Databases

If you search for red running shoes on a website, a standard database might struggle to quickly find all variations, misspellings, and relevant items. Search databases (search engines) are built specifically to read through massive blocks of text and return highly relevant results in milliseconds.
Examples: Elasticsearch, Meilisearch, Apache Solr.
Uses: E-commerce search bars, scanning millions of computer logs for errors, document/wiki search.

Pros

  • Lightning-fast full-text search.
  • They handle typos gracefully (fuzzy matching)
  • Feature built-in ranking systems so the most relevant results show up at the top.

Cons

  • They consume a massive amount of memory (RAM) and storage space because they index every single word.
  • They lack the strict safety rules of a relational database.

7. In-Memory Databases

Standard databases permanently save data onto a server's hard drive. In-memory databases save data directly into the computer's RAM (Main Memory).
Examples: Redis, Memcached.
Uses: Caching (saving a temporary copy of frequently requested data so the main database doesn't have to work as hard), real-time gaming leaderboards, instant messaging.

Pros

  • Very fast. They retrieve data in fractions of a millisecond, drastically reducing the load on your primary databases.

Cons

  • RAM is very expensive, meaning storage capacity is limited.
  • Because data is stored in memory, a sudden power loss or server crash will cause the data to disappear instantly (though modern versions offer background backup tricks to mitigate this).

8. Object-Oriented Databases

These store data exactly how software developers write it in modern programming languages (as objects). Instead of breaking a complex digital item apart to fit into rows and columns, it saves the whole object exactly as it is.
Examples: db4o, ObjectDB.
Uses: Complex engineering systems (CAD designs), 3D modeling, scientific simulations.

Pros

  • Excellent for highly complex, nested data.
  • Removes the tedious extra work developers usually have to do to translate their application code into database tables.

Cons

  • They have a very small developer community
  • No universally standard query language
  • Poor interoperability with other data tools
  • Have mostly been replaced by Document NoSQL databases.

9. Cloud-Native and Serverless Databases

These databases do not run on a physical server that you own. They live entirely in the cloud. The cloud provider handles all the heavy lifting—such as backups, security patching, and adding more compute power when traffic spikes.
Examples: Amazon Aurora, Firebase, Supabase, DynamoDB.
Uses: Fast-moving startups, mobile apps, and systems where user traffic spikes unpredictably.

Pros

  • Zero operational headaches.
  • Built-in disaster recovery.
  • If the database is truly serverless, it scales down to zero when not in use, meaning you only pay for exactly what you consume.

Cons

  • Vendor lock-in; once you build your app heavily around a specific cloud database, it is difficult to move to a competitor.
  • Troubleshooting is harder because you do not control the underlying server
  • Costs can skyrocket unexpectedly if your app suddenly goes viral.

10. Multi-Model Databases

Instead of setting up a document database for user profiles, a graph database for friend connections, and a key-value store for session data, a multi-model database allows you to do all of it in a single system.
Examples: ArangoDB, PostgreSQL (when utilizing extra add-ons).
Uses: Applications with diverse data needs, or small teams that want to keep their software architecture simple.

Pros

  • You only have one database to learn, monitor, secure, and back up.
  • All your data stays unified in one place, making agile development easier.

Cons

  • The jack of all trades, master of none dilemma. They might not be as incredibly fast or efficient at one specific task as a dedicated, single-purpose database would be.
  • They can also be complex to tune for performance.

A Few Important Database Rules to Know

When comparing these options, developers often use specific acronyms to describe how the database handles data.

ACID vs. BASE
ACID guarantees your data is always 100% correct, verified, and safely recorded before moving on (used by Relational databases).
BASE prioritizes keeping the database online and running fast, even if it means some users briefly see slightly outdated data for a few milliseconds (used by NoSQL databases).

The CAP Theorem
In a system spread across many servers, you can only guarantee two out of these three things;
Consistency - everyone sees the exact same data at the exact same time.
Availability - the system always responds and never goes down .
Partition Tolerance -the system survives even if the servers lose connection to each other.
NB: You must pick a database that makes the right trade-off for your specific business needs.

Sharding vs. Replication
Sharding means chopping your data into pieces and putting different pieces on different servers to make the database hold more total data.
Replication means making exact duplicate copies of your data and putting them on different servers so the data remains safe and readable if one server dies.

Tools Often Mistaken for Databases

Because modern software architecture is complicated, you will often hear names of technologies thrown around that sound like databases, but aren't. They work alongside databases, but serve totally different purposes. Let's clarify a few common ones.

1. Debezium
People often confuse Debezium for a database because it deals heavily with data. In reality, Debezium is a messenger.
It is a Change Data Capture (CDC) tool. Imagine you have a main database running your store, a separate search engine, and a data warehouse for accounting. When a user updates their address in your main database, how do the other systems know? Debezium sits next to your database and constantly reads its internal diary (transaction log). When a change happens, Debezium grabs it and broadcasts a message saying, Hey everyone, User 123 changed their address!
Debezium doesn't store your data permanently. It simply watches for changes and passes the news along.

2. Apache Kafka
Kafka is often mentioned alongside Debezium and is frequently mistaken for a database because it can hold data. However, Kafka is actually an Event Streaming Platform, or a Message Broker.
Think of Kafka as a giant, high-speed conveyor belt. Different parts of your software drop messages onto the conveyor belt, and other parts of your software pick them up.
While Kafka temporarily holds onto messages so they don't get lost, it is not designed for you to look up specific information. You cannot easily query Kafka. Its job is to move data reliably from Point A to Point B, not to act as a filing cabinet.

3. Elasticsearch
While we listed Elasticsearch as a Search Database in the categories above, developers often dump all their primary data into it and treat it like a traditional Relational database.
Elasticsearch is brilliant at reading blocks of text and returning search results in milliseconds. However, it lacks strict ACID compliance. If you use it to permanently store critical things, a server crash could cause you to lose data or get out of sync. It should always be used as a secondary copy of your data strictly for search purposes, functioning alongside a more reliable primary database.

Conclusion

Choosing the right database ultimately comes down to understanding the shape of your data and what you want to achieve with it.
No single database is perfect for everything. The best, most scalable software systems in the world use multiple databases together; a relational database for financial transactions, a search engine for product discovery, an in-memory cache for speed, and a wide-column data warehouse for analytics. This approach is known as polyglot persistence.