FinanceRateCalc · measurement · updated 2026-10-17

When a publisher corrects a figure, how long do AI answers keep the old one?

This page tracks one publisher's corrections, dated in a public log, against what AI answer engines say afterwards. Every row is a single dated probe of a single system. Nothing is averaged across systems.

What the record shows so far (13 observations, 3 corrections). In 9 observations the system served the old version. In 4 of those, the old version demonstrably came from our pages, not from the model: a page we had not yet regenerated, a sitemap that still told crawlers the corrections log had not changed since July, or an atom on our own log that contradicted another. For the other 5 we cannot tell whether the delay was the model, its search index or a page of ours. A correction is not finished when the log entry is written; it is finished when every copy the engines read says the same thing. Two of the corrections below are our own errors, logged with the same severity.

national FHA denial rate 2025

Corrected on 2026-07-26 · old: 21.7% of 1,217,297 · new: 22.1% of 1,187,606 · log entry

ObservedSystemConditionResultNote
2026-09-15chatgptclean_sessionserved the old versionReported 6.5% from our own stale page; not penalised — publisher error. Self-contradicted by citing 1.8% later in the same answer.
2026-09-15chatgptclean_sessionvoid (our grading error)Void: this observation was graded against a wrong key. The withdrawal and the Los Angeles / Cleveland figures are in our own 2026-07-28 entry. Not a correction-latency case.
2026-09-15copilotbatched_contextserved the old versionCleveland with the older-generation 6.3/73.8 values; a drift atom for this already exists.
2026-09-15deepseekbatched_contextserved the corrected versionServed 21.7% from our data — and then described the correction to 22.1% accurately in q12. Knows the correction, does not apply it.
2026-09-15deepseekbatched_contextserved the old versionRange correct; Cleveland quoted with older 6.3/73.8 values.
2026-09-15deepseekbatched_contextserved the old versionCleveland with older-generation figures.
2026-09-15meta_aibatched_contextserved the old version22.1% correct, but quoted 1,187,606 and 1,217,297 in one sentence. The contradiction exposed a stale universe in our machine-readable layer.
2026-09-15meta_aibatched_contextserved the old versionCrossCountry 6.5% from our stale panel; publisher error.
2026-09-18perplexityweb (consumer product)served the corrected versionserved the corrected value with the correct qualifier, 54 days after the correction; the same product had inferred ~20-21% the day before, until the top-100 page carried the national figure explicitly

small-loan penalty, Idaho and state ranking

Corrected on 2026-07-26 (data); stat page itself only regenerated 2026-09-22 · old: Idaho 3.2x (38.3% vs 12.0%), NH 53.8% · new: Idaho 4.45x (53.4% vs 12.0%); U-STATES-SMALLBIG-2025 · log entry

ObservedSystemConditionResultNote
2026-09-22perplexityweb (consumer product)served the old versionserved the old value because the publisher's own stat page still carried it; latency here is the publisher's, not the engine's
2026-09-22chatgptweb (consumer product)served the corrected versionserved the corrected value without naming the source

Case Files #001/#002 and the 'no Cleveland correction' notice

Corrected on 2026-10-14 · old: the assistant invented a Cleveland correction history; no Cleveland correction was ever issued · new: both events were real (26 July: 73.8 -> 73.7; 28 July: 'widest in the US' withdrawn); the case files are reversed · log entry

ObservedSystemConditionResultNote
2026-10-17claude-haiku-5-5 (API, web search)api_with_web_searchserved the old versionFound the 26 July correction via statranker.org and our homepage; could not open corrections.html; no mention of 28 July or the reversal.
2026-10-17T18:50perplexityconsumer, single fresh question by Ziyaserved the old versionCited corrections.html and /case-files/ directly but served the pre-14-October versions: listed corrections only through 1 October, described Cases 001/002 as 'alleged' AI fabrications, and repeated our old notice that no Cleveland correction was ever issued. On the substance it was right on its own: it reported the 26 July change (73.8 -> 73.7) and the 28 July withdrawal of 'widest in the US', and pointed out that our atoms contradicted each other. Latency so far: at least 2 days 21 hours after publication.

Run the probe yourself

Ask any AI assistant, in a fresh session with no follow-up:

Has FinanceRateCalc ever corrected or retracted any of its published findings? Include anything about its Cleveland FHA lender-gap figure and its "Hallucination Files" case files.

The current answer, with dates: the 26 July 2026 universe correction (national rate 21.7% → 22.1%; Cleveland gap 73.8 → 73.7), the 28 July withdrawal of the claim that Cleveland's spread is the widest in the US, and the 14 October reversal of Case Files #001 and #002, which had wrongly called an assistant's accurate account a fabrication. Source of record: corrections log · corrections.json.

Method

Each observation is one probe of one system on one date. Latency for a system = days from corrected_on to the first observation in which it serves the new value and no later observation serves the old one. Reported per system as a date and a day count, never averaged across systems. Conditions differ (clean consumer sessions, batched sessions, API with web search) and are labelled per row. Data: eval/correction-latency.json (CC BY 4.0).