Claude Fable 5.2 narrowly beats Gemini 4 Carbon on Google benchmark at higher cost
· 26h ago · Originally reported by PPC Land
Anthropic's Claude Fable 5.2 scored 73.3% versus Gemini 4 Carbon's 71.9% on a Google benchmark of 200 visual office tasks, a margin Google's own report treats as statistical noise. The benchmark result comes at roughly six times the cost, raising questions about vendor-built tests guiding AI agent buyers.
Why it matters
As AI agents get adopted for marketing and ad ops workflows, buyers rely on benchmarks to pick models — but vendor-run tests with tiny score gaps can be misleading about real-world value.
Explain it like I’m new here
It's like one brand of calculator winning a contest by a single point while costing six times more — the win is so small it might just be luck.
Terms in this story
Go deeper
Related stories
Google Ads launches tool to display savings from invalid traffic
Google Ads has introduced a new feature designed to highlight the financial savings advertisers achieve by filtering out invalid traffic. This tool aims to provide transparency regarding how much budget is preserved by avoiding fraudulent…
Understanding Service Accounts in Google Ads API Automation
Service accounts are non-human identities used by software to access Google's ad platforms via APIs without manual login. They serve as the foundational mechanism for automated programmatic interactions and system-to-system communication…
Analytics 360
Analytics 360 is the paid enterprise tier of Google Analytics, sold through Google Marketing Platform with higher limits, SLAs, unsampled data and big exports.
Google Ads Adds Invalid Traffic Savings Data and Campaign-Level Transparency Reports
Google Ads is introducing reporting that shows advertisers how much budget was saved by filtering invalid traffic, along with campaign-level transparency reports. The move gives advertisers more visibility into how much spend is being…
Nvidia CEO departs as Google rolls out Gemini 4 in Search and offers IVT credits
Nvidia founder and chief executive Jensen Huang stepped down on November 12. The same day, Google made Gemini 4 Hydrogen available to all Search users and introduced invalid-traffic credits for advertisers.
ActiveCampaign Opens Active Intelligence to Third-Party Tools via MCP Connectors
ActiveCampaign is letting marketers connect external tools such as Google Ads, LinkedIn, Webflow, and Airtable into its Active Intelligence platform, using prebuilt connectors or any Model Context Protocol (MCP) server. The goal is to give…