惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

Security Archives - TechRepublic
Security Archives - TechRepublic
T
The Exploit Database - CXSecurity.com
P
Proofpoint News Feed
Scott Helme
Scott Helme
NISL@THU
NISL@THU
Cisco Talos Blog
Cisco Talos Blog
C
Cybersecurity and Infrastructure Security Agency CISA
AWS News Blog
AWS News Blog
V
Vulnerabilities – Threatpost
J
Java Code Geeks
U
Unit 42
The GitHub Blog
The GitHub Blog
H
Help Net Security
T
Tenable Blog
aimingoo的专栏
aimingoo的专栏
Jina AI
Jina AI
Spread Privacy
Spread Privacy
Apple Machine Learning Research
Apple Machine Learning Research
人人都是产品经理
人人都是产品经理
L
Lohrmann on Cybersecurity
T
Threatpost
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
Engineering at Meta
Engineering at Meta
A
About on SuperTechFans
I
InfoQ
Microsoft Azure Blog
Microsoft Azure Blog
B
Blog
L
LINUX DO - 最新话题
K
Kaspersky official blog
cs.CV updates on arXiv.org
cs.CV updates on arXiv.org
T
Threat Research - Cisco Blogs
C
Check Point Blog
T
The Blog of Author Tim Ferriss
有赞技术团队
有赞技术团队
宝玉的分享
宝玉的分享
Help Net Security
Help Net Security
Google DeepMind News
Google DeepMind News
A
Arctic Wolf
Y
Y Combinator Blog
N
News | PayPal Newsroom
M
MIT News - Artificial intelligence
Latest news
Latest news
H
Hacker News: Front Page
Blog — PlanetScale
Blog — PlanetScale
腾讯CDC
I
Intezer
爱范儿
爱范儿
F
Fortinet All Blogs
P
Palo Alto Networks Blog
C
CERT Recently Published Vulnerability Notes

DEV Community

Authentication Security Deep Dive: From Brute Force to Salted Hashing (With Java Examples) Why AI Systems Don’t Fail — They Drift Spilling beans for how i learn for exam😁"Reinforcement Learning Cheat Sheet" I Replaced Chrome with Safari for AI Browser Automation. Here's What Broke (and What Finally Worked) How Python Borrows Other People's Work The $40 Architecture: Processing 1 Billion API Requests with 99.99% Uptime Vibe Coding: A Workflow Guide (From Zero to SaaS) Most webhook security guides protect the wrong side. The scary part is delivery. Headless CMS for TanStack Start: Build a Blog with Cosmic EU Age Verification App "Hacked in 2 Minutes" — What Actually Happened Comfy Cloud’s delete function does not actually remove files Running AI Models on GPU Cloud Servers: A Beginner Guide Event-driven media intelligence with AWS Step Functions and Bedrock I scored 500 AI prompts across 8 quality dimensions — here's what broke How to Call Google Gemini API from Next.js (Free Tier, No Backend Needed) The Portal Protocol: Reclaiming Human Connection in the Age of AI How to Fix Your Team's Scattered Knowledge Problem With a Self-Hosted Forum Intro to tc Cloud Functors: A Graph-First Mental Model for the Modern Cloud Designing Multi-Tenant Backends With Both Ownership and Team Access I Built a Neumorphic CSS Library with 77+ Components — Here's What I Learned PostgreSQL Performance Optimization: Why Connection Pooling Is Critical at Scale Cómo construí un SaaS multi-rubro para gestionar expensas en Argentina con FastAPI + Vue 3 🚀 I Built an Ethical Hacking Scanner Tool – Open Source Project I Replaced /usage and /context in Claude Code With a Single Statusline A Pythonic Way to Handle Emails (IMAP/SMTP) with Auto-Discovery and AI-Ready Design I Collected 8.9 Million Polymarket Price Points — Here's What I Found About How Markets Really Move EcoTrack AI — Carbon Footprint Tracker & Dashboard Everyone's Using AI. No One Agrees How. 5 self-hosted ebook managers worth trying in 2026 Building Your First AI Agent with LangChain: From Chatbot to Autonomous Assistant Common SOC 2 Failures (Real World) Stop Vibe-Checking Your AI App: A Practical Guide to Evals How to Use SonarQube and SonarScanner Locally to Level Up Your Code Quality Your Next To-Do App Is Dead — I Replaced Mine with an OpenClaw AI Sign a Nostr event in 60 lines of Python using coincurve — no nostr-sdk, no nbxplorer, no rust toolchain ITGC Audit Explained Like You’re in Big 4 Patch Tuesday abril 2026: Microsoft parcha 163 vulnerabilidades y un zero-day en SharePoint Stop scraping everything: a better way to track competitor price changes Listing on MCPize + the Official MCP Registry while routing payments OUTSIDE the marketplace — how I kept 100% of my x402 revenue Building an AI-Powered Risk Intelligence System Using Serverless Architecture Why We Ripped Function Overloading Out of Our AI Toolchain Testing AI-Generated Code: How to Actually Know If It Works SaaS Churn Is Killing Your Business. Here Is What to Do About It (Without a Support Team) The Speed of AI Is No Longer Linear - And Self-Improving Models Are Why How to Implement RBAC for MCP Tools: A Practical Guide for Engineering Teams From Standard Quote to Persuasive Proposal: AI Automation for Arborists I built a CLI that scaffolds complete multi-tenant SaaS apps Axios CVE-2025–62718: The Silent SSRF Bug That Could Be Hiding in Your Node.js App Right Now The dashboard that ended our friendship Data Pipelines Explained Simply (and How to Build Them with Python) The Hidden Cost of AI Systems Nobody Talks About. undefined vs undeclared, and how typeof behaves Switching from file-based jobs to NATS/Kafka in Rust without changing code io_uring Adventures: Rust Servers That Love Syscalls Why Agentic AI is Killing the Traditional Database The POUR principles of web accessibility for developers and designers Quantum Neural Network 3D — A Deep Dive into Interactive WebGL Visualization How To Install Caveman In Codex On macOS And Windows Automation Pipeline Reliability: Why Your Workflow Breaks When Nobody Is Watching I Built an 'Open World' AI Coding Agent — It Works From ANY Folder From Freelancing to Product: A Tech Service Company's SaaS Transformation China's AI Giants: Adding Tencent Hunyuan & ByteDance Doubao to AI University (74 Providers) On the Vibe Coders and Their Lies clerk: Auto-Summarize Your Claude Code Sessions AI Weekly — 2026/04/10–04/17 | The Model Lockdown Is Here, but the Toolchain Is the Real Battleground AI 週報 — 2026/04/10–2026/04/17 模型封鎖潮來了,但工具鏈才是真戰場 Maybe this is how Open-Source apps are born... 🚀 Fine-Tune LLMs with LoRA and QLoRA: 2026 Guide tRPC v11 + Next.js App Router: End-to-End Type Safety Without the Boilerplate ShadCN UI in 2026: Why I Stopped Installing Component Libraries and Started Owning My Components SaaS Billing in React Server Components: Stripe + Supabase Without a Single `useEffect` Join our DEV Weekend Challenge — $1,000 in Prizes Across TEN winners! Submissions Due April 20 at 6:59 AM UTC. Implementing FSRS Spaced Repetition in Flutter + Supabase — Adding Memory Science to an AI Learning App "I Texted My Localhost From the Train — Claude Code Fixed the Bug Before I Got Home" I Built a Sales Prep AI and It Went Deeper Than Expected Design to Code #2: One JSON, Eleven Outputs Solving the 100M-Row Problem: A Summary Table Pattern for High-Volume Push Notification Logs Flutter Web With Wasm: What Actually Changes For Developers I Built 50 Royalty-Free Soundtracks for My Side Project in a Weekend Using AI Music Generation The Vibe Coding Security Checklist: 7 Things to Check Before You Ship Stop Letting Googlebot Guess Fix Your React App's SEO Right Desconstruindo o Streaming do LinkedIn: Como Criar um Engine de Extração de Vídeo de Alta Performance com HLS e FFmpeg (EDA Part-1) EDA (Exploratory Data Analysis) Explained With Real Life — Why Looking at Your Data Is the Most Important Step in Machine Learning Brand Relationship Management at Scale: Our 4-Touch Outreach System for 200+ Brands Why String.fromEnvironment() Might Return an Empty String in Dart JGuardrails 1.0.0 — Hardening Java LLM Apps Against Jailbreaks, Toxicity, and Prompt Injection Plan and Schedule a Full Week of Threads Content From One Claude Conversation Coding Cat Oran Ep3, Five Tables Changed Everything Updated: BFF Pattern I'm done watching freelancers get buried by 200 proposals. So I'm building the alternative. This is my first post BFS Algorithm in Java Step by Step Tutorial with Examples Tracking LLM Pricing Monthly: An Open Dataset for 22 AI Models How We Measure Content ROI on a Comparison Site: Revenue Attribution Without Perfect Data Introducing Nova AI Ops: The AI-Native Operating System for SRE Teams I built a free desktop video downloader for Windows — Grabbit How Talkie OCR Helps Vision-Impaired & Dyslexic Users Read the World Around Them VRCFaceTracking安装和iPhone面捕配置教程,有bug Even CrowdStrike Can't See Your Agents The Automation Gold Rush: What n8n Workflows and Claude Are Opening Up for Developers Right Now
The Python Data Analytics Handbook: A Guide for Beginners
grace wambua · 2026-05-18 · via DEV Community

Introduction

Python is a computer programming language often used to build websites and software, automate tasks, and conduct data analysis.

Python allows analysts to handle the entire data lifecycle, from collecting and cleaning raw data to performing complex statistical modeling and creating interactive visualizations.

Why Python is popular in data analytics

Python was designed to be human-friendly; easy to read and write.
It has become the most popular tool in data analytics because it’s approachable but powerful. It does the heavy lifting for you, allowing you to focus on the story your data is telling rather than struggling with the tools themselves.
For a beginner, Python isn't just another skill, it’s the bridge that takes you from being overwhelmed by numbers to actually making sense of them.

Essential Python Libraries for Data Analysis

In Python, a library is a collection of pre-written code that you can use to perform specific tasks without writing everything from scratch.
These libraries act like ready-made toolkits, each designed for a specific part of the workflow, from data manipulation to visualization. Let's look at the most essential ones every analyst should know:

1. Pandas (Python Data Analysis)
Pandas is an open-source tool for data manipulation.
It is the most popular Python library for working with tabular data. It is similar to Excel sheets, but with far more power and flexibility. You can use it for:

  • Easy data loading from CSV, Excel, SQL, and JSON.
  • Filtering, grouping, and merging datasets.
  • Handling missing data and time-series analysis.

Example:

import pandas as pd

df = pd.read_csv('student.csv')  # load the file
print(df['Math'])  # print just the math column

Enter fullscreen mode Exit fullscreen mode

2. NumPy (Numerical Python)
NumPy is the foundational library for scientific computing in Python.
The NumPy library contains multidimensional array data structures, such as the homogeneous, N-dimensional ndarray, and a large library of functions that operate efficiently on these data structures.

Example:

import numpy as np

prices = np.array([5, 10, 15]) # list of numbers
new_prices = prices + 2   # add 2 to every number
print(new_prices)  # print new list

Enter fullscreen mode Exit fullscreen mode

  • SciPy (Scientific Python): Extends NumPy for advanced scientific and engineering computations.

3. Matplotlib
Matplotlib is the most widely used Python library for creating static, animated, and interactive data visualizations. It has become a fundamental tool in data science and machine learning for exploring patterns and trends.

Example:

import matplotlib.pyplot as plt

students = ["Alex", "Mary", "John", "Anna"]
grades = [85, 92, 58, 95]

plt.bar(students, grades, color="skyblue") # create a bar chart

plt.title("Student Math Grades")  # add labels to chart
plt.xlabel("Student Name")
plt.ylabel("Math Score")

plt.show()  # display chart

Enter fullscreen mode Exit fullscreen mode

4. Seaborn
While Matplotlib handles the basics, Seaborn builds on it with elegant styles and simpler syntax for statistical visualizations. It is perfect for visualizing relationships and distributions in your data. Seaborn automatically handles color palettes, aesthetics, and complex charts.

Example:

import matplotlib.pyplot as plt  # handles the graph layout and displays it on your screen
import pandas as pd  # opens and structures your student.csv file
import seaborn as sns  # colors and styles the bars automatically based on your columns

df = pd.read_csv("student.csv")  # load student file

sns.barplot(data=df, x="Name", y="Score", hue="Subject", palette="deep") # draw the chart (Seaborn automatically reads the columns from df)

plt.title("Student Performance Comparison")  # add titles 
plt.show()  # show the window

Enter fullscreen mode Exit fullscreen mode

5. Scikit-learn (often imported as sklearn)
This is a Python open-source machine learning library. Built on top of core scientific libraries like NumPy, SciPy, and Matplotlib, it provides simple and efficient tools for predictive data analysis.
Note: Scikit-learn requires data to be formatted as numerical arrays to perform its calculations.

Example:

import numpy as np  # it formats data into a 2D column grid so the machine learning model can read it
from sklearn.linear_model import LinearRegression

# classes attended vs. final Score
classes = np.array([[10], [20], [30]])
scores = np.array([40, 60, 80])  # the computer sees that more classes = higher score

model = LinearRegression() # create and train the model
model.fit(classes, scores)

#  predict the score for a student who attended 25 classes
predicted_score = model.predict([[25]]) 
print(predicted_score)

Enter fullscreen mode Exit fullscreen mode

6. Requests
Requests library is a simple and powerful tool to send HTTP requests and interact with web resources. It allows you to easily send get, post, put, delete, patch, head requests to web servers, handle responses, and work with REST APIs and web scraping tasks.

Example:

import requests

url = "githubusercontent.com"  # connect to the raw student data file link on GitHub
response = requests.get(url)

print(response.text)  # print the raw data content from the internet

Enter fullscreen mode Exit fullscreen mode

  • Beautiful Soup: For parsing HTML and XML data.
  • Django & Flask: Frameworks used to build powerful web applications.
  • TensorFlow & PyTorch: Leading frameworks for deep learning and neural networks.

How Python is used to clean, analyze, and visualize data

Data cleaning is a critical step in any data analysis or machine learning project.
Essential Python-specific steps include: handling missing values, standardizing data types, removing duplicates, and identifying outliers to ensure analysis accuracy.
Here are some best practices to keep in mind as you streamline your data cleaning process:

  • Store raw data separately
    Always keep the original!
    This is the number one most important tip when cleaning data. Keep a copy of the raw data files separate from the cleaned and processed versions. This ensures that you always have a reference point and can easily revert to the original data if needed.

  • Document your data-cleaning code
    Add comments to your code to explain the purpose of each cleaning step and any assumptions made.

  • Look out for unintended consequences
    Make sure your data cleaning efforts aren’t significantly changing the distribution or introducing any unintended biases. Repeated data exploration after your cleaning efforts can help ensure you are on the right track.

  • Keep a data cleaning log
    If you have a long cleaning process or one that is automated, you may want to maintain a separate document where you record the details of each cleaning step.
    Details such as the date, the specific action taken, and any issues encountered may be helpful down the road.

  • Write reusable functions
    Identify common data cleaning tasks and encapsulate them into reusable functions. This allows you to apply the same cleaning steps to multiple datasets. This is especially helpful if you have company-specific abbreviations you want to map.

Moving to the Analysis stage, this is the bridge where you extract meaning from your cleaned rows.
Using tools like Pandas, you calculate averages, find the highest and lowest values, and group items into categories to see how they compare.
This process takes a giant pile of cleaned data and summarizes it to a few important facts, so you know exactly what to show in your final charts.

The final phase Visualization, is where you turn those rows of numbers into insights that can easily be understood.
This is achieved by using Matplotlib for foundational control, Seaborn for polished statistical graphics, and Plotly for interactivity.
The process involves aggregating your data into summaries, selecting a chart type that fits the relationship and refining the output with clear labels and titles to ensure the data is immediately understood by the viewer.

An example use case for the process:
Python sorts through a Kenyan bank's records and organizes it automatically:

  • Cleaning: fixing messy M-Pesa transaction texts and converting USD deposits into Kenya Shillings automatically.
  • Analyzing: calculating which customers qualify for loans based on how regularly a customer’s balance in M-Shwari or KCB M-Pesa is growing or shrinking over time.
  • Visualizing: uses maps to show where to open new shops and gauges that warn managers the moment an ATM runs out of cash.

Real-world examples of Python in data analytics

1. Data Science and Data Analysis

Python is the leading language in data science. It offers powerful tools for data manipulation, visualization, and machine learning.

Use Case Example: A data analyst uses Pandas to clean large CSV files and visualize sales trends with Matplotlib.

Libraries:

  • Pandas: Data cleaning and manipulation
  • NumPy: Numerical computation
  • Matplotlib / Seaborn: Data visualization

2. Education & Research

Python is the preferred language in academia and research due to its simplicity and vast scientific libraries.

Use Case Example: Researchers use Python for data modeling in climate studies or biological simulations.

Libraries:

  • Jupyter Notebooks for documentation and experiments
  • SymPy for symbolic math
  • SciPy for computations

3. Healthcare

Python is used in healthcare for image-based diagnostics and predictive analysis, to enable health care professionals determine the information they need to make the best decision possible regarding treatment plans.

Use Case Example: Algorithms help detect bone fractures, tumors, and early-stage breast cancer from mammograms.

Libraries:

  • NumPy & Pandas to clean, filter, and structure tabular patient metrics, lab stats, and vitals.
  • Scikit-learn to train standard medical risk-assessment machine learning algorithms.
  • TensorFlow & PyTorch to power deep learning applications that automatically spot tumors in diagnostic imagery.

4. Machine Learning & Artificial Intelligence

Python dominates ML and AI development. Its ecosystem allows you to train, test, and deploy intelligent models with ease.

Use Case Example: Netflix uses Python-based recommendation algorithms to personalize movie suggestions.

Libraries:

  • Scikit-learn for traditional ML models
  • TensorFlow and PyTorch for deep learning
  • spaCy for NLP tasks

5. Web Development

Python simplifies web development with frameworks like Django, Flask, and FastAPI. These tools help build scalable and secure web applications quickly.

Use Case Example:

  • Instagram: Uses Django for scalability.
  • Pinterest: Built with Flask for flexibility.

Libraries:

  • Django for rapid web app development
  • Flask for lightweight APIs
  • FastAPI for high-performance web services.

6. Web Scraping and Data Extraction

Python helps gather and analyze online information at scale. Businesses use it for price tracking, content aggregation, and market research.

Use Case Example: E-commerce teams use Python scripts to monitor competitor pricing in real time.

Libraries:

  • Requests
  • BeautifulSoup
  • Scrapy

7. Software Development and Testing

Python is used for backend software development and test automation.

Use Case Example: Developers use Python to test APIs automatically after every code change.

Frameworks:

  • PyTest and Unittest for testing
  • Sphinx for documentation
  • Buildbot for CI/CD pipelines

8. Desktop GUI Applications

Python supports GUI-based applications that run across platforms.

Use Case Example: Simple apps like file explorers or calculators are often built using Tkinter.

Libraries:

  • Tkinter for basic GUIs
  • PyQt and Kivy for advanced interfaces

9. Internet of Things (IoT)

Python connects hardware and sensors in IoT systems. It’s used for collecting and processing real-time data.

Use Case Example: Home automation systems that monitor temperature and lighting using Raspberry Pi.

Tools and Platforms:

  • Raspberry Pi
  • MicroPython
  • Adafruit Python SDKs

10. Game Development

Python supports simple and mid-level game creation. It’s ideal for building prototypes, 2D games, and educational projects.

Use Case Example: Several well-known titles have used Python for their core logic or extensive modding capabilities like: The Sims 4, Battlefield 2, Pacman, Sudoku.

Tools and Frameworks:

  • Pygame for 2D games
  • Panda3D for 3D graphics
  • Arcade for modern designs

Why beginners should learn Python

Python is the perfect starting point because its syntax is as clear as plain English, allowing you to focus on logic rather than fighting complex code. Its massive global community means you’ll never get stuck, and its incredible versatility allows you to transition easily into high-paying fields like data science, AI, or web development.
By using powerful libraries that handle the heavy lifting for you, Python lets you build professional-grade projects like automating your bank statements or analyzing electricity bills, faster than almost any other language.