惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

G
GRAHAM CLULEY
T
Tenable Blog
Know Your Adversary
Know Your Adversary
C
CXSECURITY Database RSS Feed - CXSecurity.com
P
Privacy International News Feed
S
Security Affairs
NISL@THU
NISL@THU
O
OpenAI News
Attack and Defense Labs
Attack and Defense Labs
Application and Cybersecurity Blog
Application and Cybersecurity Blog
Hacker News: Ask HN
Hacker News: Ask HN
Webroot Blog
Webroot Blog
Schneier on Security
Schneier on Security
S
SegmentFault 最新的问题
S
Schneier on Security
G
Google Developers Blog
V
V2EX
C
Check Point Blog
U
Unit 42
Google DeepMind News
Google DeepMind News
T
Threatpost
阮一峰的网络日志
阮一峰的网络日志
T
The Exploit Database - CXSecurity.com
Recent Announcements
Recent Announcements
M
MIT News - Artificial intelligence
S
Secure Thoughts
博客园 - 司徒正美
Recorded Future
Recorded Future
P
Proofpoint News Feed
Spread Privacy
Spread Privacy
K
Kaspersky official blog
Cyber Security Advisories - MS-ISAC
Cyber Security Advisories - MS-ISAC
AI
AI
博客园 - 聂微东
N
News and Events Feed by Topic
SecWiki News
SecWiki News
钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
V
Vulnerabilities – Threatpost
P
Palo Alto Networks Blog
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
Engineering at Meta
Engineering at Meta
Recent Commits to openclaw:main
Recent Commits to openclaw:main
奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
酷 壳 – CoolShell
酷 壳 – CoolShell
WordPress大学
WordPress大学
The Hacker News
The Hacker News
The Last Watchdog
The Last Watchdog
Project Zero
Project Zero
W
WeLiveSecurity
博客园 - Franky

IEEE Spectrum

How a Spinning Drone Exploits Your Eyes to Become Nearly Invisible Why Indonesia’s Fisheries Future Hinges On Data Integrity and Trust Inside the Race to Tame AI’s Wild Power Swings Stable Jobs Can Hide the Riskiest Move In Your Tech Career Inside ELIZA’s Source Code and Its Multiple Personalities Tiny Puerto Rican Island Tests Hydrogen to Slash Sky High Power Bills AI Turns DNA Into Tiny Dogs and Mona Lisa Nanostructures How Darth Vader Taught Me Card Counting and AI Security Got Weird The Memory in Your Thumb Drive Could Fix AI's Big Problem The AI Arms Race in Technical Interviews Is Escalating Inside Nokia’s Race to Catch the iPhone and Android Wave Quantum Sensor Sniffs Out Radio Signals in 3D Two New Wheelchairs Reveal What “Smart” Really Means Today Video Friday: A World Cup for Robots Japan Pulls Off One of the Closest Asteroid Flybys Ever How Cheap Ground Robots Are Rewriting Frontline Warfare in Ukraine Nvidia’s NVLink Fusion Quietly Pushes Optics Inside the Rack Are Battery PoweredTrailers the Shortcut to Cleaner Long Haul Freight? The Hidden Overthinking Flaw That Could Drag AI Services Down Stacking Chips Sideways Gives AI More Memory There Independent Labs Crack Google Brain Inspired Camera Sensor Learns to See and Gently Forget Why Small AI Models Could Power Health Care Where Big Tech Cannot China’s Humanoid Army Pushes Japan to Rethink Its Robot Future NASA AI’s Wild Power Demands Are Quietly Rewriting Grid Rules Old EV Batteries Find a Second Life Backing Up the Grid UCLA’s Semiconductor Hub Is Rewiring Industry and Academia for AI Why Engineers Who Speak Up Build Stronger and Safer Careers The Orbital Data Center Hype Machine Is Already in Orbit What Emily Bender Really Meant by "Stochastic Parrots" The History and Mystery of Fireworks Poetry for Engineers: Nine Lives of Nikola Tesla Trump’s Quantum Orders Push Fault Tolerant Qubits Toward 2028 Underwater Tidal Kites Promise Steady Power for Remote Coasts How a Forgotten Wire Turned a Cheap Chip Into a Brainlike Neuron How the U.S. Engineered Its Sovereignty AI Model ConlangCrafter Dreams up Entire New Languages Weirdly Fascinating: Robotic Arm Crawls Using Its Three Fingers. Shadow-Free Augmented Reality Makes Illusions More Realistic How a Power Bank Can Turn Your AC Into a Grid Superhero Records Fall for 3D Chip Tech What it Means to Be a Mathematician When AI Does the Math Is This Stacked CFET Architecture The Ultimate CMOS Platform? Why 6 GHz Spectrum Could Make or Break Future Wi-Fi and 6G Plans Make an Origami Circuit Board AI Learns the "Dark Art" of RF Chip Design U.S. Regulator Aims to Cut Data Center Queues and Electricity Bills Home Broadband Is the Killer App 5G Was Never Designed For How Smarter Grids Could Save Americans $100 Billion On Power Can AI Learn to Read the Room? How Did Two Prompts Turn Into Potent Vibe Hacking Malware Is Europe Finally Ready to Take Back Control Of Its Tech Stack? New Device Can Take Photographs with a Single Atom War Taught this Ukrainian Entrepreneur the Value of Resilience Do Robots Need Legs? What If You Gave ChatGPT a Body? What Amazon’s Astro Taught Me About Giving Robots a Soul Optical Metasurface Sees a Sunny Future Can Sound-Driven Synapses Make AI Both Faster and Greener? Modos Color E‑Paper Monitor Pushes Open‑Source Displays Further Beat Biased Hiring By Owning Your Story In Every Interview Room How AI Attribution Could Finally Pay Musicians for Training Data How Liquid Cooling Let a Humanoid Robot Shatter Half Marathon Records Inside GM’s AI Push to Speed Up the Design of Cars and Moon Rovers Smart EV Charger Learns Your Battery’s Age to Let It Live Longer Phoenix Links IoT Chips to Save High‑Value Legacy Systems Phoenix Links IoT Chips to Save High‑Value Legacy Systems Tensordyne's Wild Log Math Aims to Leave Nvidia’s AI Chips In the Dust The Tiny Turbine That Kick-Started the U.S. Wind Industry Satellites Are Tracing Railroad Tracks Across SPHEREx’s Cosmic Map Are Emotion Reading Robots Still Missing What Matters Most? Watch This Humanoid Robot Move in Ways Your Hips Wouldn't Like The Real Cost Of Cooling GPUs In Space Might Shock You The Google DeepMind Spinoff Chasing Hidden Drug Targets We Are Crowd-Sourcing the Panopticon Gene Therapy and Sound Waves Team up to Steady Failing Hearts Save 14 Percent of Energy Used in LLM Training With This Trick The Real Tradeoffs Between Startups, Mid-Size Firms, and Giants When Does Job Hopping Stop Helping Your Engineering Future Why a Computer Science Degree Still Opens Hidden Doors AI Can Help Track the World’s Shrinking Glaciers Curiosity’s 13 Years of Software Hacks Keeps It Alive on Mars Fractal OS Lets Security Researchers See What Their CPUs Really Do Formula E DNA Helps the Cayenne Electric Bend Physics to Beat the Heat Moon’s Dark Craters Could Become the Most Precise Clocks in Space New Radio Giant in New Mexico Takes Its First Glimpse of the Cosmos Nvidia’s AI Hardware Comes to Windows in RTX Spark PCs Can Humanoid Robots Run Stairs Without Tripping? Do They Need Shoes? Inside the Compact Fusion Reactor Aiming to Power 280,000 Homes NSF X Labs Power Agile, High-Stakes Experiments "Hemopurifier" Could Help Fight Bundibugyo Ebola Strain Why Quantum Computers Need a ‘Healthy Chunk’ Of Classical Power
Large Tabular Models Excel Where LLMs Fail
https://www.facebook.com/48576411181 · 2026-07-09 · via IEEE Spectrum

The large language models (LLMs) that form the basis of generative AI chatbots such as ChatGPT, Claude, and Gemini can generate uncannily human-like text and images. But these models still struggle with a skill that, ironically, looks at face value to be right in their wheelhouse: analyzing structured data. A new type of generative AI is set to change this situation.

Although you can get your favorite chatbot to solve intractable math problems, review dense legal documents, compose a catchy pop song, or put together some slick PowerPoint slides, give it anything more than a small table and it doesn’t have a clue what to do.

For most companies and organizations, the most important data sits in spreadsheets. Whether it’s a bank’s transaction logs, a marketing agency’s website metrics, clinical trial participants’ vital signs, or the vast amount of proton collision information produced at atom smashers like the Large Hadron Collider, structured, row-and-column data runs the world, and LLMs can’t deal with it.

AI startup Fundamental is pioneering a new type of AI foundation model, known as a large tabular model (LTM), to fill the gap. Fundamental came out of stealth mode on 5 February 2026 with US $275 million in funding and a model called NEXUS, purpose-built for tabular data. Now, the model is being adopted by companies such as Amazon Web Services, while others race to build their own LTMs.

Why LLMs struggle with spreadsheets

Part of why structured data has garnered less attention is a very human bias, argues Boris van Breugel, a senior AI researcher based in Amsterdam. “People like to see images, videos, and ChatGPT responses,” he says. “But tabular data really lags behind because it’s not fun to look at numbers.”

Different tabular datasets are also difficult to compare, explains van Breugel, who co-wrote a prescient position paper on this topic in 2024. Whereas most language has similar semantics, making LLMs well-suited to being trained on vast amounts of text data, van Breugel argues that it is much harder to train a single tabular model on tables with very different variables.

Additionally, language is sequential by nature (as are music, images, and video). Changing the order of words in a sentence may change or completely destroy its meaning. But the structured data you find in spreadsheets isn’t sequential. You can swap the order of columns or play around with rows, but the underlying factual meaning of the data remains the same.

This independence from linear order is incompatible with an LLM’s fundamental purpose of predicting the next value in a linear sequence. “With LLMs, even slightly changing the input, you get a different output,” says Jeremy Fraenkel, CEO of Fundamental. “That’s fine, and actually often desirable for LLMs, but when you’re making a prediction of whether a transaction is fraudulent or not, you want to make sure that the prediction is the same, or deterministic, no matter what.”

Developing Fundamental’s LTM

Current tabular data solutions are limited to machine learning algorithms, such as XGBoost, that have been around for more than 15 years and are used by organizations globally. These algorithms—called gradient-boosted decision trees—have to be trained and optimized by data scientists over the course of months for each and every use case. In contrast, NEXUS and other emerging LTMs are foundational, leveraging learning amassed from pre-training on diverse databases so that they can be applied across a range of different predictive tasks with minimal bespoke feature engineering or task-specific model building.

And unlike LLMs, which primarily model sequences of tokens, LTMs model the structure of tabular data directly. They jointly learn from each entry’s numerical value, what it represents, and how it relates to other entries. For example, imagine an entry in a grocery stock inventory table for bananas: The LTM can take in not just the magnitude—say, 500—but the fact that the entry represents the current banana stock quantity, its category (produce), and the statistical properties that link the entry with the rest of the column. This contextual understanding enables more accurate reasoning and prediction over structured data.

According to Fraenkel, one of Fundamental’s biggest challenges in developing NEXUS was obtaining the right training data. Unlike natural language, which is abundant and broadly uniform in structure, tabular data is relatively hard to find—much of the data is sensitive or proprietary—and diverse. There are very few similarities between, for instance, a biology dataset and a financial one. That combination of factors meant Fundamental needed to invest in building a huge training set.

“We pre-trained NEXUS on billions of tables using a combination of proprietary datasets acquired through partnerships and licensing, high-quality public and open-source datasets, and data augmentation techniques that expanded the diversity and coverage of our training corpus,” Fraenkel says, though he is keen to point out that NEXUS is not trained on customer data. In fact, it is a confidential computing platform, which means that Fundamental physically cannot access customer data, let alone train on it.

This feature was most likely a key consideration when in June, Amazon Web Services (AWS) embedded NEXUS in Amazon SageMaker, widely considered the default operating system for secure machine learning. This brings NEXUS to many customer’s often sensitive data—a contrasting approach to LLMs, where the data has to be imported to the model.

“With Amazon, we have a first-party partnership, which means that our model exists as if it’s a native AWS solution,” says Fraenkel. “And over time, the goal is to expand these types of relationships to allow [ens-users] to really access their data wherever they do their predictions.”

The future of data analysis

Though Fundamental has taken the lead, at least in enterprise applications, the company is not alone in pursuing foundational LTMs. In March, Feedzai, which provides fraud and financial crime prevention services, and credit card company Mastercard separately launched similar proprietary technologies focused on finance. Then, in late June, Google launched its own foundational competitor TabFM, trained entirely on hundreds of millions of synthetic datasets.

And machine learning researchers are not far behind either. FlexTab, TabICL, and iLTM are just three of a raft of LTMs developed by the research community in the past year, all in the pursuit of bringing the success of LLMs to the tabular domain.

For all involved, the direction of travel is clear. “I would be very surprised if most data processing and analysis is not done through an automated system in the future, whether that’s an LLM, an LTM, or some combination,” says van Breugel. “Most people don’t necessarily like to do data analysis, and these systems will be able to do it a lot better.”

Fraenkel agrees. “I see the relationship between LLMs and LTMs as being a bit like the human brain: The left side is good at reasoning and understanding and summarizing text, and the right side is really good at understanding numbers and statistics and patterns,” he says. “But it’s when you combine both of those that you really get something much more powerful.”