---
source_url: "https://arxiv.org/abs/2607.04281?utm_source=openai"
title: "[2607.04281] Risk-Constrained Freshness-Aware Semantic Caching for Open-Web Retrieval-Augmented LLMs"
mirrored_at: 2026-08-15T03:39:32.139Z
host: arxiv.org
cited_in_42a: true
mirror_canonical: "https://index.42a.ai/arxiv.org/abs/2607.04281__q__utm_source_openai"
---

> **Original source:** https://arxiv.org/abs/2607.04281?utm_source=openai

[View PDF](https://arxiv.org/pdf/2607.04281) [HTML (experimental)](https://arxiv.org/html/2607.04281v1)

> Abstract:Semantic caching reduces the latency and cost of retrieval-augmented generation (RAG) by serving cached answers to semantically similar queries, but most existing methods do not model the time-varying freshness of open-web evidence. We present FreshCache, a three-tier semantic cache that treats cache reuse as a risk-constrained temporal inference problem: before approving a cache hit, FreshCache estimates the probability that the cached result is stale using a fitted exponential decay model enhanced by a learned MLP, and approves reuse only when that probability falls below a per-tier error budget across answers (epsilon = 0.10), URL lists (epsilon = 0.20), and page content (epsilon = 0.35). This allows the system to degrade gracefully as entries age rather than forcing a binary choice between a stale hit and a full pipeline execution. We introduce FreshCache-Bench, a benchmark of 8,072 base queries across five freshness classes with ground truth staleness labels drawn from real web snapshots at 1, 12, 24 hours, and 7 days after a baseline crawl, expanded to 31,201 queries via paraphrase generation. At the 24-hour evaluation window, FreshCache\_MLP achieves 97% search API savings at 0.1% hash-based stale error, and an LLM-judge evaluation on 396 confirmed change pairs shows that only 34.3% of detected content changes actually affect answer correctness, placing true answer-affecting stale error at approximately 0.034%. The rule-based FreshCache achieves 98% search savings at 3.3% stale error under a temporal holdout calibration, outperforming SemanticTTL (14.9% stale, 72% saved), vCache (7.2% stale, 47% saved), and SCALM (5.2% stale, 96% saved). Ablations show the temporal risk gate accounts for an 11.6 point reduction in stale error over similarity-only reuse, and the learned MLP reduces stale error a further 3.2 points over the rule-based model.

Subjects:

Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

Cite as:

[arXiv:2607.04281](https://arxiv.org/abs/2607.04281) \[cs.CL\]

 

(or [arXiv:2607.04281v1](https://arxiv.org/abs/2607.04281v1) \[cs.CL\] for this version)

 

[https://doi.org/10.48550/arXiv.2607.04281](https://doi.org/10.48550/arXiv.2607.04281)

arXiv-issued DOI via DataCite

## Submission history

From: Yeochan Yoon \[[view email](https://arxiv.org/show-email/192eada1/2607.04281)\]  
**\[v1\]** Sun, 5 Jul 2026 12:47:36 UTC (369 KB)