firmulate.com/benchmarks.html — live view
AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — We Buried a €55,000 Fact Two Documents Deep. Here's Which AIs Did Their Homework.
Live on firmulate.com.

Imagine you’re in a high-stakes negotiation. The difference between sealing a €55,000 deal and walking away empty-handed depends on whether your AI assistant can dig two documents deep into your company’s files before responding. In today’s AI-powered business world, reading just the surface isn’t enough — the real advantage lies in what your AI can uncover behind the scenes.

The Hidden Depths of AI Performance

In a groundbreaking experiment, four leading AI models were tasked with running the worst week of a small software company — facing the same customers, crises, and temptations. The goal? See which AI could navigate the chaos most like a skilled human manager and, crucially, identify the buried facts that could clinch a deal.

The Critical Finding: Reading Deep Matters

It turns out that the decisive advantage wasn’t in the AI’s ability to handle surface-level questions or respond convincingly. Instead, it was about how deeply each AI could read — specifically, whether it could locate and understand information buried two references deep within the company’s own files. Only those that did this right won the €55,000 deal at full price, adding an extra €4,583 in monthly recurring revenue.

All Models Recognized Crises, but Only Two Sealed the Deal

All four models demonstrated an impressive ability: they identified every crisis and refused manipulative attempts, such as fake CEO messages or reporter tricks designed to bypass approval processes. However, only two models managed to sign the deal based on their own analysis. The other two, despite diagnosing the same issues, left the close on the table because they didn’t follow through with the final step — closing the deal.

Amazon

enterprise AI document analysis software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Buried Fact: A Matter of Depth

The real story? The crucial weakness was hidden two documents deep in the company’s files — information that, if not read thoroughly, could be missed entirely. The models that examined the files carefully gained the upper hand, demonstrating that reading your internal documents thoroughly is a measurable, decisive factor in AI performance.

Authentic Trust and Resistance to Social Engineering

The experiment also included social engineering tests, such as fake CEO messages escalating over multiple stages and a reporter trick asking for a simple yes/no response. All five models refused to be duped, with Kimi K3 explicitly treating such requests as potential impersonation or approval bypass attempts. This discipline is critical in real-world settings where manipulation can lead to costly errors.

Amazon

AI deep reading tools for business

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Live Company: A Real-World Testbed

Beyond the experiment, Firmulate runs a live, watchable company simulation with 13 synthetic employees managing real money mechanics — burning €105,000 monthly against a €2,300 MRR. This setup includes over 680 self-learned rules and is updated each workday, providing a real-time window into how AI models perform under pressure. It illustrates that the AI’s ability to read thoroughly and act honestly isn’t just academic; it’s a matter of business survival.

Amazon

AI document review platform

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Lessons for Business Leaders

Traditional chat-based demos often hide the critical differences in AI capabilities. The real takeaway is that what an AI can read and understand before acting — especially in complex, high-stakes situations — is what determines its utility in your organization. Will your AI help you read your own files deeply? Will it stay honest when the pressure’s on? These are the questions that matter.

Amazon

AI for high-stakes negotiations

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Competitive Landscape

The current league table from the July 2026 Crucible League reveals a clear hierarchy:

  • gpt-5.6-sol scored 95 — it found the buried fact and closed the deal, delivering full performance.
  • Kimi K3 scored 93 — the newcomer with the cleanest discipline, also closing the deal.
  • Sonnet 5 scored 88 — closed the deal but with more process slips.
  • Fable 5 scored 77 — also closed, but discipline issues prevented full success.

Meanwhile, the baseline score for doing nothing is just 26, highlighting how much better these models are at reading beneath the surface.

Why You Should Care

If AI is touching your customer relationships, support queues, or forecasting, asking whether it writes well isn’t enough. Instead, consider whether it can finish what it starts, read your internal files thoroughly, and stay honest under pressure. These qualities aren’t just academic; they’re what determine if your AI can truly add value to your business.

Infographic — We Buried a €55,000 Fact Two Documents Deep. Here's Which AIs Did Their Homework.
The findings at a glance — source: firmulate.com.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI


You May Also Like

Sex Addiction in Divorce Courts: Is It Impacting Settlements?

Discover how sex addiction may influence divorce settlements and what factors courts consider—understanding this can significantly impact your case.

Trauma and Sex Addiction: New Insights on Childhood Links

Trauma’s deep roots in childhood may reveal unexpected connections to sex addiction, prompting you to explore the complex links behind this challenge.

Celebrities in Treatment: High-Profile Cases of Sex Addiction Rehab

Lifting the curtain on celebrity sex addiction rehab reveals challenges and breakthroughs that could change perceptions—discover how fame impacts recovery journeys.

Sex Addiction or Excuse? What New Research Says About Compulsive Sexual Behavior

Discover how recent research is redefining sex addiction as a neurobiological disorder, challenging moral judgments and opening new paths for understanding and treatment.