惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

Forbes - Security
Forbes - Security
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
P
Palo Alto Networks Blog
Martin Fowler
Martin Fowler
T
Threatpost
D
Docker
S
Schneier on Security
M
MIT News - Artificial intelligence
G
Google Developers Blog
L
LINUX DO - 热门话题
J
Java Code Geeks
月光博客
月光博客
博客园 - 三生石上(FineUI控件)
IT之家
IT之家
博客园 - Franky
C
Cyber Attacks, Cyber Crime and Cyber Security
K
Kaspersky official blog
Google DeepMind News
Google DeepMind News
N
News and Events Feed by Topic
V
Vulnerabilities – Threatpost
CTFtime.org: upcoming CTF events
CTFtime.org: upcoming CTF events
人人都是产品经理
人人都是产品经理
Spread Privacy
Spread Privacy
T
Tailwind CSS Blog
爱范儿
爱范儿
阮一峰的网络日志
阮一峰的网络日志
U
Unit 42
C
CERT Recently Published Vulnerability Notes
The GitHub Blog
The GitHub Blog
Simon Willison's Weblog
Simon Willison's Weblog
NISL@THU
NISL@THU
MongoDB | Blog
MongoDB | Blog
Application and Cybersecurity Blog
Application and Cybersecurity Blog
H
Heimdal Security Blog
Recorded Future
Recorded Future
云风的 BLOG
云风的 BLOG
SecWiki News
SecWiki News
P
Privacy International News Feed
P
Proofpoint News Feed
O
OpenAI News
B
Blog
腾讯CDC
F
Full Disclosure
Apple Machine Learning Research
Apple Machine Learning Research
T
Tor Project blog
H
Hacker News: Front Page
Project Zero
Project Zero
Hugging Face - Blog
Hugging Face - Blog
C
Cisco Blogs
S
Security Affairs

Forbes - Innovation

Why Do Humans Have Fingerprints? Hint: It’s Not What You Think Booking.com Confirms Data Breach, Reservation PIN Codes Changed Why Major News Sites Are Blocking The Internet Archive’s Wayback Machine iPhone Fold Release Date: New Report Details Frustrating Apple News Comet Tracker: How To See Pan-STARRS And Three Planets On Wednesday NYT Mini Crossword Today: Tuesday, April 14 Hints And Answers Today’s NYT Strands Hints, Spangram, Answers: Tuesday, April 14 (It’s A Little Unclear) Today’s Wordle #1760 Hints And Answer For Tuesday, April 14 Most Of The Microplastics In Urban Air Come From Tires Today’s Wordle #1759 Hints And Answer For Monday, April 13 NYT Mini Crossword Today: Monday, April 13 Hints And Answers NYT Pips Today: Hints, Answers And Walkthrough For Monday, April 13 The YC Chief Who Codes 10,000 Lines A Day Has A Simple Secret Samsung Expands One UI 8.5 Beta To More Galaxy Owners Why You Should Stop Using Your iPhone If It’s On This List Chamath Says Firms That Treat AI As A Strategy Hand Rivals Their Edge 3 Unexpected Habits Of Secure Couples, By A Psychologist The First Lamp That Folds Your Clothes Samsung’s Disappointing Price Update For Galaxy Phone Buyers 3 Subtle Signs Someone Is Falling In Love With You, By A Psychologist Do Mantis Shrimp See More Colors Than Humans? A Biologist Explains NYT Connections Answers Explained For Monday, April 13 (#1,037) NYT Connections Hints Today: Monday, April 13 Clues And Answers (#1,037) LEGO Luigi & Mach 8 (72050) Review: 2026’s Best Set Yet? Marc Andreessen Says AI Productivity Will Trigger A Hiring Boom 3D Printing Is The Ultimate Hack To Reduce Household Spending Apple iPhone Fold: Striking Design Revealed In Leaked Photos Apple Smart Glasses: New Leak Reveals A Major Design Twist To Beat Meta Tested: The AI Coming To The Rivian R2 Quordle Hints Today: Monday, April 13 Clues And Answers Companies And H-1B Employees Endure Immigration Waits At Consulates 3 Easy Ways To Turn Anxiety Into Sustained Focus, By A Psychologist Here’s The Most Affordable Humanoid Robot You Can Buy Now UFC 327 Results: 5 Biggest Takeaways From A Wild Night In Miami UFC 327 Results, Bonus Winners, Highlights And Reactions Dana White Announces Huge New Fight For UFC White House Today’s NYT Strands Hints, Spangram, Answers: Sunday, April 12 (Get Ready) Tesla ‘Model 2’ Rises From The Ashes Today’s Wordle #1758 Hints And Answer For Sunday, April 12 NYT Pips Today: Hints, Answers And Walkthrough For Sunday, April 12 Tyson Fury Vs. Arslanbek Mahkmudov Results: Highlights and Reaction NYT Mini Crossword Today: Sunday, April 12 Hints And Answers How Shadow AI Culture Is Destroying Your Business Venture Capital Funds That Market Like Startups Win More Deals Conor Benn Vs. Regis Prograis Results: Highlights and Reaction Samsung’s Disappointing Price Update For Galaxy Phone Buyers Artemis Reached The Moon. The Grid Can Reach The 21st Century A Biologist Explains How Archerfish Shoot Down Prey. Hint: Their Aim Rivals Human Throwing Is It Time For Apple To Forget About The MacBook Air NYT Connections Hints Today: Sunday, April 12 Clues And Answers (#1036) Trump’s 2027 Budget To Reshape U.S. Environmental And Energy Policy CDC Delays Reporting Of COVID-19 Vaccine Benefits—Here’s What To Know Oura Has Designed A Solution To A Big Smart Ring Problem Netflix’s Best New Show Has A Near-Perfect 95% Rotten Tomatoes Score Coachella 2026 Is Being Taken Over By Creator Streams Quordle Hints Today: Sunday, April 12 Clues And Answers This Startup Wants To Use AI To Help Digitize History How To Get The Best Shield In ‘Crimson Desert’ Microsoft Venom Attack Targets C-Suite Executives ‘Maul: Shadow Lord’ Sets Even More Star Wars Rotten Tomatoes Records 3 Ways Happy Couples Argue Differently, By A Psychologist Success For Leapmotor Might Have Negatives For Stellantis New Names Surface As Potential Rogue And Wonder Woman In The MCU And DCU 4 Reasons Artemis Mission Matters Even If You Think It Is Wasteful Fast ‘Crimson Desert’ Patch Adds New Moves, Shield Hiding And One Great Feature Why Do Humans Blush? An Evolutionary Biologist Explains The Signal We Can’t Control Apple iPhone Fold: Striking Design Revealed In Leaked Photos Adobe Attacks Underway—Windows And Mac Users Given 72 Hours To Update iOS 26.4.1 Release: Crucial iPhone Feature Update Arrives, But No Security Fix Fury vs. Makhmudov Full Card, Ring Walk Times and How to Watch Can’t Stand Liquid Glass? This New Hidden iPhone Setting Is A Game-Changer Test-Driving The 2026 Changan Deepal S05: Italian Style Made In China NSA Warning—Reboot Your Internet Router Now Ways That Human-AI Collaboration Slides People Into ‘AI Brain Fry’ And Cognitive Downturns Stop Using These Networks—Google, NSA And TSA Warn NASA Changes Moon Plan: Landing Now Depends On SpaceX Or Blue Origin Samsung Expands One UI 8.5 Beta To More Galaxy Owners The Evolution Of Programmable Hardware At Xilinx NYT Mini Today: Saturday, April 11 Hints And Answers Today’s NYT Strands Hints, Spangram, Answers: Saturday, April 11 (You’re Putting Me On) Splashdown! NASA’s Artemis II Returns To Earth After Moon Mission Attention Is All You Need. The Human Kind Is Still The One That Counts Today’s Wordle #1757 Hints And Answer For Saturday, April 11 NYT Pips Today: Hints, Answers And Walkthrough For Saturday, April 11 Android Circuit: Galaxy S27 Pro Emerges, Honor 600 Pre-Order Offers, Pixel 11 Display Leaks Apple Loop: iPhone 18 Pro Leak, Urgent iOS Update, MacBook Neo Issues Morgan Stanley Has Mostly Positive Outlook On Tesla Robotaxi, FSD V15 Running Out Of AI Tokens Faster Than Ever? Here’s Why CoreWeave Shares Pop 13% After Anthropic Deal ‘Euphoria’ Season 3’s Rotten Tomatoes Score Crashes, Has Lost Key Player People Don’t Agree On What AI Can Do, But They Don’t Even Use The Same Product ‘Overwhelming’—Google Issues Gemini Update For Gmail Users NYT Connections Hints Today: Saturday, April 11 Clues And Answers (#1035) Quordle Hints Today: Saturday, April 11 Clues And Answers The Costly Dream Of Space-Based AI Infrastructure Can You See The Watcher In This ‘Daredevil: Born Again’ Shot? Adobe Attacks Underway—Windows And Mac Users Given 72 Hours To Update You Just Watched The Backdoor Pilot For ‘The Pitt: Night Shift’ Are Nicotine Pouches Like Zyn And VELO Safe To Use? A Doctor Answers Human Resources (HR) Is The Key To AI Success Per WalkMe ( SAP)
Human-In-The-Loop AI: What It Takes To Find The Right Balance
Ryan Johnson · 2026-05-13 · via Forbes - Innovation

Ryan Johnson is the chief product officer at CallRail, an AI-powered lead engagement platform that serves over 225,000 businesses worldwide.

getty

​Every new wave of technology promises speed, efficiency and cost savings. AI does, too. As an example, for many overloaded companies, it can help triage incoming requests, separating what’s urgent from what can wait.

​Still, history has shown that adopting new technology does not guarantee immediate returns. Those lessons are not lost with AI. Despite 88% of organizations citing regular use of AI in McKinsey’s research, less than 20% have seen AI make a tangible impact on enterprise-level EBIT.

This dichotomy isn’t new. Prior tech implementations, such as ERPs and CRMs, also had high failure rates. Just like with those implementations, the disconnect with AI often stems from a misunderstanding of how it changes the way a business runs.

In the case of AI, one of the most important concepts to understand is how to architect a system that augments rather than replaces human judgment.

Human-In-The-Loop AI: The Missing Piece

AI typically performs best when tasks are structured, clearly defined and predictable. Its strength lies in analyzing vast datasets within a confined set of rules and providing recommendations based on observed patterns. That’s why it’s effective in generating reports, routing calls or identifying duplicates in a spreadsheet.

However, AI falls short when it lacks the context and specificity to be truly intelligent and effective. Without domain or market knowledge that usually resides in a person's mind, the output becomes unreliable.

In a business setting, this lack of accuracy can cause negative downstream effects, such as when Deloitte had to refund much of its fee for producing a report that contained AI-generated errors or when lawyers for MyPillow CEO Mike Lindell were fined for filing briefs with errors generated by AI. ​​

The implication for businesses is the need to layer human oversight into AI workflows. While AI is getting better at handling more complex tasks, human intervention is still needed in the process to ensure the right outcomes.

Why Workflow Orchestration Sits At The Center Of AI Success

To successfully integrate humans in the loop, answer this question: Where in the process should you trigger the AI-to-human handoff? ​The answer becomes even more pressing as the deployment of AI agents ramps up, since they act autonomously, often without natural points for human intervention. ​

The goal is to blend the speed and efficiency of AI with the accuracy and quality of human input to improve outputs. A study by Stanford and Carnegie Mellon, for example, found that AI-human teams are 68.7% more effective and accurate than AI or humans alone. ​

A way to think about it is to view tasks on a spectrum, with AI and humans at opposite ends. The AI handles ​repeatable and operational tasks, such as answering inbound calls or routing messages, while the human focuses on edge cases that require judgment before execution. ​

Take, for example, a pool company using an AI voice agent to manage inbound call leads. The AI voice agent can be used in the first half of the workflow to triage and qualify calls based on the lead-scoring rules the pool company has established.

Depending on the complexity, the AI voice agent can prompt the caller to book an appointment or a quick service request, at which point, the workflow is complete.

But if the caller requests a more complex service, like new pool construction, the AI voice agent will need to be orchestrated to route the call to the best-fit sales agent based on the conversation. ​

The net positive for the pool company is that it can deliver better customer experiences by ensuring timely and consistent support. Likewise, the company benefits from ensuring that no inbound leads slip through the cracks, thereby supporting bottom-line results. ​

Architecting The AI-To-Human Handoff

As a chief product officer, I view the orchestration of AI-driven workflows with human-in-the-loop the same way I approach solving product challenges. It starts with understanding the problem, outlining next steps, finding where technology can help and then engineering the system based on these outputs.

The same logic applies to designing the AI-to-human handoff. Specific business tasks need to be broken down into steps. Using the spectrum example above, the tasks need to be organized into those better suited to AI and those that require human approval or feedback.

As the system takes shape, the next step is to map the required data streams to facilitate the workflow. Not all businesses have the context for AI to reference, and that’s okay. This insight can guide how to optimize the perfect handoff as more data becomes available with use.

While automating end-to-end tasks can be difficult, the best approach is to start simple. See what AI can automate as much as possible without compromising accuracy for efficiency. Once the workflow design is completed, deciding which AI solution to implement, if one has not been selected, becomes easier.

Achieving AI-Human Harmony

AI might be one of the most powerful tools we’ll see in our lifetimes. But the promise of immediate productivity benefits exists only when we carefully balance how AI and humans work together as a complete system.

At face value, this might seem like a slower approach. Yet AI can also be used to expedite discovery and workflow design by running interactive tests that enable you to make iterative changes in real time.

Ultimately, it’s the integration of AI and humans working together as one system, not the AI solution alone, that will deliver the best results for businesses and their customers. ​


Forbes Technology Council is an invitation-only community for world-class CIOs, CTOs and technology executives. Do I qualify?