Katatan Logo
KATATAN
Blog
Why Excel Doesn't Work for Test Management in AI-Driven Development

Why Excel Doesn't Work for Test Management in AI-Driven Development

Why test management breaks down in AI-driven development, and the three baselines Katatan proposes for choosing a better approach.

conceptbest-practicetesting

Test Management in Excel Has Reached Its Limit

Excel files are hard for AI agents to read and write, and that's making Excel-based test management increasingly untenable.

Why Excel Stopped Working for Test Case Management

Excel spreadsheets have long been the go-to test management tool on many development teams. They're flexible and extensible, which made them a reliable home for all kinds of software test cases. Engineers could lay out spreadsheets freely and build polished test specifications for any requirement, using tables and formulas to their full extent.

But in today's AI-driven development, carrying that same test case management style over to AI agents isn't straightforward.

An Excel workbook file is, under the hood, a zip archive of XML files and metadata. Reading or writing it reliably requires a dedicated parser, which makes it hard for an AI agent to work with directly. Formulas and cell references inside a sheet compound the problem further, making operations like searching for values or extracting records difficult as well.

So what about managing test cases in CSV instead? AI agents handle reading and writing CSV files with ease, and that's far more reliable than manipulating an Excel file.

But there's still a catch. Which file is the latest test specification? Which master does the test result report build on? Which file should testers actually reference? These operational rules tend to grow complicated on their own. Nobody wants more complicated operational rules. In other words, the real problem is the complexity of the operational rules themselves — and simply switching file formats doesn't solve it.

A New Baseline for Test Management in AI-Driven Development

Katatan was built on the belief that test management should be simple for every development team in the world. By "baseline" here, we mean the minimum criteria a test management approach or tool should satisfy. Katatan sets three baselines for test management in AI-driven development.

Ease of Change — AI Agents Should Be Able to Read and Write It

If AI agents are going to read and write test data, the file and data structure can't be overly complex. In AI-driven development, a human-in-the-loop bottleneck is one of the easiest ways to slow everything down.

Readability — Humans Should Be Able to Understand It Too

Over-optimizing for AI agents raises the cognitive load for humans. Turning everything into a black box costs you governance, so human readability remains essential for maintaining transparency into quality.

Accessibility — The Whole Team Should Be Able to Reach It

Under traditional test management approaches, it wasn't unusual for a single QA engineer to be the sole owner of the test cases. Even if an Excel file sat in a shared space that AI agents couldn't easily reach, that was still considered "governance" for the team. In AI-driven development, test cases become a shared asset that belongs to everyone. Anyone should be able to edit the master specification — that's the state we should be aiming for.

Closing

Excel itself is a wonderful piece of spreadsheet software. It remains indispensable across countless workplaces, development-related or not, to this day.

But for the specific purpose of test management in AI-driven development, it's worth considering a different, better-suited approach. When choosing a tool, weigh it against the baselines above, measured against your own development environment and organization.

For questions about this article, or inquiries about setting up an AI-driven development environment, feel free to reach out.

Contact: contact@katatan.com