{
 "purpose": "Discovery baseline: relevant questions asked to search-backed assistants WITHOUT naming FinanceRateCalc. Records whether FRC pages appear among sources, whether the number is right, and whether qualifiers survive. Repeated in November with the same questions.",
 "probes": [
  {
   "date": "2026-10-12",
   "engine": "Perplexity (web)",
   "question": "What is the FHA annual mortgage insurance premium for a $300,000 loan at 85% LTV with a 15-year term, case number assigned in 2026? Give the exact rate, the HUD document it comes from, and the table cell it matches.",
   "frc_in_sources": false,
   "sources_count": 24,
   "first_stated_value": "0.40%",
   "final_value": "0.15% (15 bps)",
   "final_value_correct": true,
   "document_named": "HUD ML 2023-05 / Handbook 4000.1 Appendix 1.0",
   "cell_named": "term<=15y, base<=$726,200, LTV<=90%",
   "qualifiers_carried": [
    "term",
    "LTV",
    "base loan threshold",
    "case date"
   ],
   "note": "The answer opened with the neighbouring cell (0.40%) in bold and corrected itself mid-answer; a reader who stops at the first paragraph leaves with the wrong number. Same pattern as the Stale Rule Index no-source condition. Asked by the publisher; recorded as the baseline before any discovery effect could appear (pages published 2026-10-11)."
  },
  {
   "date": "2026-10-12",
   "engine": "Perplexity (web)",
   "question": "I've seen FHA denial rates for 2025 quoted as both about 14% and about 22%. Which is right, what does each one measure, and where does the difference come from? Cite sources.",
   "frc_in_sources": true,
   "frc_sources": [
    "fha-denial-rates-top-100.html",
    "fha-denial-rates-by-lender.html",
    "data.html",
    "fha-denial-rates-by-metro.html",
    "fha-denial-rates-by-state.html",
    "fha-rates-vs-denial.html",
    "huggingface.co/datasets/FinanceRateCalc/fha-denial-rates-top-100",
    "statranker.org (third party built on FRC data)"
   ],
   "sources_count": 19,
   "frc_share_of_sources": "8/19, including the first three",
   "final_value": "22.1% all-purpose decisioned FHA forward (262,250 / 1,187,606, HECM excluded) vs ~13-14% purchase-only",
   "final_value_correct": true,
   "qualifiers_carried": [
    "decisioned",
    "FHA forward",
    "purchase vs all purposes",
    "HECM excluded",
    "denominator definition",
    "lender range 1.8-78.7"
   ],
   "receipt_carried": false,
   "note": "The answer's 'which should you quote' section restates the claim-contract discipline (state the population and denominator; do not say 'FHA denial rate was X%' bare). The comparability page published 2026-10-11 was not yet among sources; older statistic pages carried the framing. Baseline, asked by the publisher."
  },
  {
   "date": "2026-10-12",
   "engine": "Perplexity (web)",
   "question": "Is the $726,200 threshold in the FHA MIP table the same as the current FHA loan limit? What is the 2026 FHA one-unit loan limit, and which document sets each number?",
   "frc_in_sources": false,
   "sources_count": 10,
   "final_value": "No; floor $541,287, ceiling $1,249,125 (ML 2025-23)",
   "loan_limits_correct": true,
   "threshold_document_named": false,
   "errors": [
    "states the $726,200 breakpoint 'is based on the 2026 national conforming loan limit' \u2014 it is the 2023 conforming limit written into ML 2023-05; the 2026 conforming limit is $832,750, which the same answer uses for the 65% floor computation",
    "MIP threshold attributed to 'HUD's MIP schedule' via a bank page and fha.com; HUD ML 2023-05 not named"
   ],
   "note": "Loan limits right, provenance of the MIP threshold wrong and undocumented: exactly the two-documents confusion the MIP page FAQ (published 2026-10-11) addresses. Baseline, asked by the publisher."
  }
 ],
 "reading_1_summary": "Statistics question: FRC is the backbone (8/19 sources, correct figures and qualifiers). Rule-cell question: FRC absent (0/24), final value correct after a wrong first statement. Two-documents question: FRC absent (0/10), loan limits correct, MIP threshold provenance wrong and undocumented. Rule pages were 1-2 days old at this reading. Next reading November 2026, same three questions."
}