惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
Jina AI
Jina AI
博客园 - Franky
Apple Machine Learning Research
Apple Machine Learning Research
酷 壳 – CoolShell
酷 壳 – CoolShell
阮一峰的网络日志
阮一峰的网络日志
量子位
雷峰网
雷峰网
宝玉的分享
宝玉的分享
V
Visual Studio Blog
博客园_首页
小众软件
小众软件
The Cloudflare Blog
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
大猫的无限游戏
大猫的无限游戏
博客园 - 聂微东
S
SegmentFault 最新的问题
博客园 - 【当耐特】
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
博客园 - 叶小钗
月光博客
月光博客
博客园 - 三生石上(FineUI控件)
人人都是产品经理
人人都是产品经理
WordPress大学
WordPress大学

Pierce Freeman

A browser for agents | Pierce Freeman The grey market of podcast appearances The way I travel | Pierce Freeman Fixing slow AWS uploads | Pierce Freeman Local tools should still use vaults We solved scratch content first Starting a podcast in 2025 Being late but still being early Automating our home video imports Adding my parents to tailscale A deep dive on agent sandboxes Language servers for AI | Pierce Freeman My simple home podcast studio We need centralized infrastructure | Pierce Freeman Coercing agents to follow conventions using AST validation My unified theory of social selling My personal backup strategy | Pierce Freeman July updates to the homelab How the KV Cache works httpx is the right way to do web requests in Python Reputation is becoming everything | Pierce Freeman Building a (kind of) invisible mac app Updated knowledge in language models Making an ascii animation | Pierce Freeman How speculative decoding works | Pierce Freeman Under the hood of Claude Code Doing things because they're easy, not hard Speeding up sideeffects with JIT in mountaineer Firehot for hot reloading in Python Misadventures in Python hot reloading
Buzzword peaks and valleys | Pierce Freeman
2023-02-14 · via Pierce Freeman

At the turn of 2017, everyone was talking about AI. The rise of deep learning and new transformer architectures seemed ready to thrust us into an age of innovation. Every company wanted to be an AI-first company: rebranding, adding copy to their promotional pages, etc. Most didn't change their underlying tech. They had a Logistic Regression model for a particular feature and suddenly they were AI Everywhere All At Once. Many companies I researched during this time didn't have a single ML engineer or data scientist.

At the turn of 2020, everyone wanted to go into Web3. A proliferation of startups looked to reinvent the core stack of financial ecosystem (instant clearance, payment, trading platforms) alongside the backbone of the Internet (peer detection, file sharing, identification). Every company newly wanted to become a Blockchain company. R&D Groups were spun up to investigate how blockchains could be slotted into existing business practices and leverage. AI took a temporary backseat.

Now it's 2023 and once again, we are all in on AI. This is thanks in part to the cultural phenomena that is ChatGPT - based largely on the same foundational model introduced nearly two years ago1. Many companies are racing to deploy AI models (generative where possible) just to put it on their slide deck. Like clockwork, three years later, we've reverted back to AI.

It's not necessarily bad to capitalize on trends. If a company with a few SVMs wants to label themselves as an AI company, they're not technically lying. And in some ways SVMs can be better than even the most modern deep learning methods. They're more interpretable, require more intentional thought to input features, and have clearer bounds on behavior. I'm still bullish on SVMs.

But expectations are important. And I do fear that once again pseudo-AI is going to drown out real-AI companies. When a buzzword is everywhere it just leads to confusion. Does AI become another checkbox on the RFP?

The pitch of AI can be particularly pernicious in this way. The pitch of "give us your data, the system will get better" only works for a limited time. Eventually users will expect to see more, perhaps way more, personalization and delightful predictive experiences. Without a step change in data or model architectures, which typically is out of the organizational wheelhouse, that's not going to happen.

Eventually people get immune to the pitch - to the flashy buzzwords, to the unrealized expectations. At the end of the day it comes down to what the product does versus how it does it. Does this actually help people get their job done or help them better enjoy life? My barometer remains to buy a product for what it can do today, not what it can do tomorrow.

Speaking of tomorrow, I'm convinced Blockchain is going to be a comeback story in 2026. I'll grab my popcorn.

  1. Technically speaking, GPT3.5 was released last November and included RL finetuning to better mirror human text. But the model architecture is almost identical to GPT3. Companies building on the GPT3 API have also been around for some time, which makes me think this recent hype cycle has more to do with ChatGPT and sociology than the tech itself. ↩