KYBench: Adverse Media Search

The adverse media step of a know-your-business review: given a business’s name, and an address for some, an agent searches the web for news that ties the business to financial crime and names the categories that apply. Forty-six real businesses, 19 of them with adverse media, are labelled by compliance analysts from nine categories. The score is total economic cost per business screened, lowest first: analyst time spent on the agent’s errors plus its token cost.

Last updated

Main Insights

Results

KYBench: Adverse Media Search results, ranked by categories found, highest first. Last updated .
RankModelProviderCategories foundCost (USD / task)Duration (seconds / task)
1DeepSeek V4.1 Flash (1017)DeepSeek98.3%$0.02666
2GPT-6.1 SolOpenAI97.4%$0.28230
3GPT-6 AstraOpenAI97.0%$1.8476
4Claude Opus 5Anthropic94.7%$0.6688
5Gemini 4 ArgonGoogle94.1%$0.14183
6Claude Opus 5.5Anthropic91.7%$0.3980
7GPT-5.6 SolOpenAI90.9%$0.79146
8GPT-5.6 TerraOpenAI89.2%$0.4182
9Claude Opus 4.7Anthropic89.2%$0.8564
10Claude Sonnet 5Anthropic88.2%$0.08126
11GPT-5.6 LunaOpenAI88.2%$0.04351
12Claude Opus 4.6Anthropic86.1%$0.61112
13Claude Sonnet 4.5Anthropic85.7%$0.4687
14GPT-5.4OpenAI84.8%$0.3355
15Gemini 3.1 ProGoogle81.3%$0.12345