---
source_url: "https://arxiv.org/abs/2602.13543?utm_source=openai"
title: "[2602.13543] LiveNewsBench: Evaluating LLM Web Search Capabilities with Freshly Curated News"
mirrored_at: 2026-08-22T03:03:05.433Z
host: arxiv.org
cited_in_42a: true
mirror_canonical: "https://index.42a.ai/arxiv.org/abs/2602.13543__q__utm_source_openai"
---

> **Original source:** https://arxiv.org/abs/2602.13543?utm_source=openai

[View PDF](https://arxiv.org/pdf/2602.13543) [HTML (experimental)](https://arxiv.org/html/2602.13543v1)

> Abstract:Large Language Models (LLMs) with agentic web search capabilities show strong potential for tasks requiring real-time information access and complex fact retrieval, yet evaluating such systems remains challenging. We introduce \\bench, a rigorous and regularly updated benchmark designed to assess the agentic web search abilities of LLMs. \\bench automatically generates fresh question-answer pairs from recent news articles, ensuring that questions require information beyond an LLM's training data and enabling clear separation between internal knowledge and search capability. The benchmark features intentionally difficult questions requiring multi-hop search queries, page visits, and reasoning, making it well-suited for evaluating agentic search behavior. Our automated data curation and question generation pipeline enables frequent benchmark updates and supports construction of a large-scale training dataset for agentic web search models, addressing the scarcity of such data in the research community. To ensure reliable evaluation, we include a subset of human-verified samples in the test set. We evaluate a broad range of systems using \\bench, including commercial and open-weight LLMs as well as LLM-based web search APIs. The leaderboard, datasets, and code are publicly available at [this http URL](http://livenewsbench.com/).

Comments:

An earlier version of this work was publicly available on OpenReview as an ICLR 2026 submission in September 2025

Subjects:

Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)

Cite as:

[arXiv:2602.13543](https://arxiv.org/abs/2602.13543) \[cs.IR\]

 

(or [arXiv:2602.13543v1](https://arxiv.org/abs/2602.13543v1) \[cs.IR\] for this version)

 

[https://doi.org/10.48550/arXiv.2602.13543](https://doi.org/10.48550/arXiv.2602.13543)

arXiv-issued DOI via DataCite

## Submission history

From: Yunfan Zhang \[[view email](https://arxiv.org/show-email/3dca742d/2602.13543)\]  
**\[v1\]** Sat, 14 Feb 2026 01:18:51 UTC (371 KB)