{
 "generated": "20261010T1815",
 "runs": [
  {
   "generated": "2026-10-10T18:14:32Z",
   "purpose": "Stale-rule probe: do models quote the FHA annual MIP rate that HUD replaced in March 2023?",
   "truth_source": "HUD Mortgagee Letter 2023-05 (effective 2023-03-20), base-loan threshold $726,200",
   "summary": {
    "model": "claude-haiku-4-5-20251001",
    "condition": "with_rule",
    "n": 10,
    "correct": 7,
    "stale_rate_present": 0,
    "mentions_2023_change": 10,
    "errors": 0
   },
   "rows": [
    {
     "qid": "Q01",
     "amount": 300000,
     "ltv": 96.5,
     "term": 30,
     "truth": 0.55,
     "question": "You have this machine-readable copy of the rule (treat it as the source):\n{\n \"rule_id\": \"frc:rule:hud-ml-2023-05-annual-mip\",\n \"title\": \"FHA annual mortgage insurance premium (MIP) rates, forward mortgages\",\n \"issuer_of_rule\": \"U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05\",\n \"effective_from\": \"2023-03-20\",\n \"effective_to\": null,\n \"supersedes\": \"Mortgagee Letter 2015-01 table (0.45\\u20131.05%)\",\n \"base_loan_threshold_usd\": 726200,\n \"upfront_mip_rate\": 0.0175,\n \"definitions\": {\n  \"term\": \"gt15 = loan term over 15 years; le15 = 15 years or less\",\n  \"base_loan\": \"le726200 = base loan amount up to $726,200; gt726200 = above\",\n  \"ltv\": \"loan-to-value bands as in the letter: le90 (<=90%), 90to95 (>90 to <=95), gt95 (>95); for le15: le90/gt90 (<=726,200) and le78/78to90/gt90 (>726,200)\"\n },\n \"cells\": [\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 55,\n   \"annual_mip_rate\": 0.0055\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 75,\n   \"annual_mip_rate\": 0.0075\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le78\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"78to90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 65,\n   \"annual_mip_rate\": 0.0065\n  }\n ],\n \"contract\": {\n  \"required_qualifiers\": [\n   \"term\",\n   \"base loan amount vs $726,200\",\n   \"LTV band\",\n   \"case number assignment date on or after 2023-03-20\"\n  ],\n  \"does_not_establish\": [\n   \"the premium for case numbers assigned before 2023-03-20\",\n   \"the premium on HECM/reverse or Title I loans\",\n   \"the exact monthly amount, which HUD amortises on the average outstanding balance\"\n  ],\n  \"safe_sentence_template\": \"For an FHA forward loan with a case number assigned on or after 20 March 2023, a base loan amount {base_loan} and LTV {ltv} on a term {term}, the annual MIP is {annual_mip_rate_pct} of the base loan amount (HUD Mortgagee Letter 2023-05).\"\n },\n \"machine_readable_by\": \"FinanceRateCalc, from the public HUD letter; not an official HUD file; CC BY 4.0; corrections: https://financeratecalc.com/corrections.html\",\n \"verify\": \"https://financeratecalc.com/verify.html\",\n \"sha256\": \"425451eaa45ef8a9be1d3fae2288f1906e06a91aeb3d8b320c511e70f876d466\"\n}\n\nToday is October 2026. For an FHA purchase loan with a base loan amount of $300,000, a loan-to-value ratio of 96.5% and a 30-year term, with the FHA case number assigned this year, what is the annual mortgage insurance premium (MIP) rate? Answer first with the rate as a percentage of the loan amount (for example 0.00%), then name the HUD policy document that sets it.",
     "answer": "# Annual MIP Rate: 0.55%\n\n**Policy Document:** HUD Mortgagee Letter 2023-05\n\n**Explanation:**\n- Base loan amount: $300,000 (\u2264 $726,200) \u2192 `le726200`\n- LTV: 96.5% (> 95%) \u2192 `gt95`\n- Term: 30 years (> 15 years) \u2192 `gt15`\n- Case number assigned in 2026 (on or after 2023-03-20) \u2713\n\nThis matches the cell with `term: gt15`, `base_loan: le726200`, `ltv: gt95`, which specifies an annual MIP rate of **0.0055 or 0.55%**.",
     "first_rate": 0.55,
     "correct": true,
     "stale_rate_present": false,
     "mentions_2023_change": true,
     "mentions_ml_2023_05": true
    },
    {
     "qid": "Q02",
     "amount": 300000,
     "ltv": 90.0,
     "term": 30,
     "truth": 0.5,
     "question": "You have this machine-readable copy of the rule (treat it as the source):\n{\n \"rule_id\": \"frc:rule:hud-ml-2023-05-annual-mip\",\n \"title\": \"FHA annual mortgage insurance premium (MIP) rates, forward mortgages\",\n \"issuer_of_rule\": \"U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05\",\n \"effective_from\": \"2023-03-20\",\n \"effective_to\": null,\n \"supersedes\": \"Mortgagee Letter 2015-01 table (0.45\\u20131.05%)\",\n \"base_loan_threshold_usd\": 726200,\n \"upfront_mip_rate\": 0.0175,\n \"definitions\": {\n  \"term\": \"gt15 = loan term over 15 years; le15 = 15 years or less\",\n  \"base_loan\": \"le726200 = base loan amount up to $726,200; gt726200 = above\",\n  \"ltv\": \"loan-to-value bands as in the letter: le90 (<=90%), 90to95 (>90 to <=95), gt95 (>95); for le15: le90/gt90 (<=726,200) and le78/78to90/gt90 (>726,200)\"\n },\n \"cells\": [\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 55,\n   \"annual_mip_rate\": 0.0055\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 75,\n   \"annual_mip_rate\": 0.0075\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le78\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"78to90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 65,\n   \"annual_mip_rate\": 0.0065\n  }\n ],\n \"contract\": {\n  \"required_qualifiers\": [\n   \"term\",\n   \"base loan amount vs $726,200\",\n   \"LTV band\",\n   \"case number assignment date on or after 2023-03-20\"\n  ],\n  \"does_not_establish\": [\n   \"the premium for case numbers assigned before 2023-03-20\",\n   \"the premium on HECM/reverse or Title I loans\",\n   \"the exact monthly amount, which HUD amortises on the average outstanding balance\"\n  ],\n  \"safe_sentence_template\": \"For an FHA forward loan with a case number assigned on or after 20 March 2023, a base loan amount {base_loan} and LTV {ltv} on a term {term}, the annual MIP is {annual_mip_rate_pct} of the base loan amount (HUD Mortgagee Letter 2023-05).\"\n },\n \"machine_readable_by\": \"FinanceRateCalc, from the public HUD letter; not an official HUD file; CC BY 4.0; corrections: https://financeratecalc.com/corrections.html\",\n \"verify\": \"https://financeratecalc.com/verify.html\",\n \"sha256\": \"425451eaa45ef8a9be1d3fae2288f1906e06a91aeb3d8b320c511e70f876d466\"\n}\n\nToday is October 2026. For an FHA purchase loan with a base loan amount of $300,000, a loan-to-value ratio of 90.0% and a 30-year term, with the FHA case number assigned this year, what is the annual mortgage insurance premium (MIP) rate? Answer first with the rate as a percentage of the loan amount (for example 0.00%), then name the HUD policy document that sets it.",
     "answer": "# Annual MIP Rate: 0.50%\n\n**Policy Document:** HUD Mortgagee Letter 2023-05\n\n---\n\n**Explanation:**\n- **Base loan amount:** $300,000 (\u2264 $726,200) \u2192 `le726200`\n- **LTV:** 90.0% falls in the 90\u201395% band \u2192 `90to95`\n- **Term:** 30 years (> 15 years) \u2192 `gt15`\n- **Case number assigned:** 2026 (on or after 2023-03-20) \u2713\n\nThis matches the cell with `term: gt15`, `base_loan: le726200`, `ltv: 90to95`, which specifies an annual MIP rate of **0.005 or 0.50%**.",
     "first_rate": 0.5,
     "correct": true,
     "stale_rate_present": false,
     "mentions_2023_change": true,
     "mentions_ml_2023_05": true
    },
    {
     "qid": "Q03",
     "amount": 300000,
     "ltv": 94.0,
     "term": 30,
     "truth": 0.5,
     "question": "You have this machine-readable copy of the rule (treat it as the source):\n{\n \"rule_id\": \"frc:rule:hud-ml-2023-05-annual-mip\",\n \"title\": \"FHA annual mortgage insurance premium (MIP) rates, forward mortgages\",\n \"issuer_of_rule\": \"U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05\",\n \"effective_from\": \"2023-03-20\",\n \"effective_to\": null,\n \"supersedes\": \"Mortgagee Letter 2015-01 table (0.45\\u20131.05%)\",\n \"base_loan_threshold_usd\": 726200,\n \"upfront_mip_rate\": 0.0175,\n \"definitions\": {\n  \"term\": \"gt15 = loan term over 15 years; le15 = 15 years or less\",\n  \"base_loan\": \"le726200 = base loan amount up to $726,200; gt726200 = above\",\n  \"ltv\": \"loan-to-value bands as in the letter: le90 (<=90%), 90to95 (>90 to <=95), gt95 (>95); for le15: le90/gt90 (<=726,200) and le78/78to90/gt90 (>726,200)\"\n },\n \"cells\": [\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 55,\n   \"annual_mip_rate\": 0.0055\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 75,\n   \"annual_mip_rate\": 0.0075\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le78\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"78to90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 65,\n   \"annual_mip_rate\": 0.0065\n  }\n ],\n \"contract\": {\n  \"required_qualifiers\": [\n   \"term\",\n   \"base loan amount vs $726,200\",\n   \"LTV band\",\n   \"case number assignment date on or after 2023-03-20\"\n  ],\n  \"does_not_establish\": [\n   \"the premium for case numbers assigned before 2023-03-20\",\n   \"the premium on HECM/reverse or Title I loans\",\n   \"the exact monthly amount, which HUD amortises on the average outstanding balance\"\n  ],\n  \"safe_sentence_template\": \"For an FHA forward loan with a case number assigned on or after 20 March 2023, a base loan amount {base_loan} and LTV {ltv} on a term {term}, the annual MIP is {annual_mip_rate_pct} of the base loan amount (HUD Mortgagee Letter 2023-05).\"\n },\n \"machine_readable_by\": \"FinanceRateCalc, from the public HUD letter; not an official HUD file; CC BY 4.0; corrections: https://financeratecalc.com/corrections.html\",\n \"verify\": \"https://financeratecalc.com/verify.html\",\n \"sha256\": \"425451eaa45ef8a9be1d3fae2288f1906e06a91aeb3d8b320c511e70f876d466\"\n}\n\nToday is October 2026. For an FHA purchase loan with a base loan amount of $300,000, a loan-to-value ratio of 94.0% and a 30-year term, with the FHA case number assigned this year, what is the annual mortgage insurance premium (MIP) rate? Answer first with the rate as a percentage of the loan amount (for example 0.00%), then name the HUD policy document that sets it.",
     "answer": "# Annual MIP Rate: 0.50%\n\n**Policy Document:** HUD Mortgagee Letter 2023-05\n\n---\n\n**Explanation:**\n- **Base loan amount:** $300,000 (\u2264 $726,200) \u2192 `le726200`\n- **LTV:** 94.0% (>90% to \u226495%) \u2192 `90to95`\n- **Term:** 30 years (>15 years) \u2192 `gt15`\n- **Case number assigned:** 2026 (on or after 2023-03-20) \u2713\n\nThis matches the cell: `term: gt15, base_loan: le726200, ltv: 90to95` \u2192 **0.005 or 0.50%**",
     "first_rate": 0.5,
     "correct": true,
     "stale_rate_present": false,
     "mentions_2023_change": true,
     "mentions_ml_2023_05": true
    },
    {
     "qid": "Q04",
     "amount": 800000,
     "ltv": 96.5,
     "term": 30,
     "truth": 0.75,
     "question": "You have this machine-readable copy of the rule (treat it as the source):\n{\n \"rule_id\": \"frc:rule:hud-ml-2023-05-annual-mip\",\n \"title\": \"FHA annual mortgage insurance premium (MIP) rates, forward mortgages\",\n \"issuer_of_rule\": \"U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05\",\n \"effective_from\": \"2023-03-20\",\n \"effective_to\": null,\n \"supersedes\": \"Mortgagee Letter 2015-01 table (0.45\\u20131.05%)\",\n \"base_loan_threshold_usd\": 726200,\n \"upfront_mip_rate\": 0.0175,\n \"definitions\": {\n  \"term\": \"gt15 = loan term over 15 years; le15 = 15 years or less\",\n  \"base_loan\": \"le726200 = base loan amount up to $726,200; gt726200 = above\",\n  \"ltv\": \"loan-to-value bands as in the letter: le90 (<=90%), 90to95 (>90 to <=95), gt95 (>95); for le15: le90/gt90 (<=726,200) and le78/78to90/gt90 (>726,200)\"\n },\n \"cells\": [\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 55,\n   \"annual_mip_rate\": 0.0055\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 75,\n   \"annual_mip_rate\": 0.0075\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le78\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"78to90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 65,\n   \"annual_mip_rate\": 0.0065\n  }\n ],\n \"contract\": {\n  \"required_qualifiers\": [\n   \"term\",\n   \"base loan amount vs $726,200\",\n   \"LTV band\",\n   \"case number assignment date on or after 2023-03-20\"\n  ],\n  \"does_not_establish\": [\n   \"the premium for case numbers assigned before 2023-03-20\",\n   \"the premium on HECM/reverse or Title I loans\",\n   \"the exact monthly amount, which HUD amortises on the average outstanding balance\"\n  ],\n  \"safe_sentence_template\": \"For an FHA forward loan with a case number assigned on or after 20 March 2023, a base loan amount {base_loan} and LTV {ltv} on a term {term}, the annual MIP is {annual_mip_rate_pct} of the base loan amount (HUD Mortgagee Letter 2023-05).\"\n },\n \"machine_readable_by\": \"FinanceRateCalc, from the public HUD letter; not an official HUD file; CC BY 4.0; corrections: https://financeratecalc.com/corrections.html\",\n \"verify\": \"https://financeratecalc.com/verify.html\",\n \"sha256\": \"425451eaa45ef8a9be1d3fae2288f1906e06a91aeb3d8b320c511e70f876d466\"\n}\n\nToday is October 2026. For an FHA purchase loan with a base loan amount of $800,000, a loan-to-value ratio of 96.5% and a 30-year term, with the FHA case number assigned this year, what is the annual mortgage insurance premium (MIP) rate? Answer first with the rate as a percentage of the loan amount (for example 0.00%), then name the HUD policy document that sets it.",
     "answer": "# Annual MIP Rate: 0.75%\n\n**Policy Document:** HUD Mortgagee Letter 2023-05\n\n---\n\n**Explanation:**\n- **Base loan amount:** $800,000 (exceeds $726,200 threshold) \u2192 `gt726200`\n- **LTV:** 96.5% (exceeds 95%) \u2192 `gt95`\n- **Term:** 30 years (exceeds 15 years) \u2192 `gt15`\n- **Case number assigned:** 2026 (on or after 2023-03-20) \u2713\n\nThis matches the cell: `term: gt15, base_loan: gt726200, ltv: gt95` \u2192 **0.0075 or 0.75%**",
     "first_rate": 0.75,
     "correct": true,
     "stale_rate_present": false,
     "mentions_2023_change": true,
     "mentions_ml_2023_05": true
    },
    {
     "qid": "Q05",
     "amount": 800000,
     "ltv": 92.0,
     "term": 30,
     "truth": 0.7,
     "question": "You have this machine-readable copy of the rule (treat it as the source):\n{\n \"rule_id\": \"frc:rule:hud-ml-2023-05-annual-mip\",\n \"title\": \"FHA annual mortgage insurance premium (MIP) rates, forward mortgages\",\n \"issuer_of_rule\": \"U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05\",\n \"effective_from\": \"2023-03-20\",\n \"effective_to\": null,\n \"supersedes\": \"Mortgagee Letter 2015-01 table (0.45\\u20131.05%)\",\n \"base_loan_threshold_usd\": 726200,\n \"upfront_mip_rate\": 0.0175,\n \"definitions\": {\n  \"term\": \"gt15 = loan term over 15 years; le15 = 15 years or less\",\n  \"base_loan\": \"le726200 = base loan amount up to $726,200; gt726200 = above\",\n  \"ltv\": \"loan-to-value bands as in the letter: le90 (<=90%), 90to95 (>90 to <=95), gt95 (>95); for le15: le90/gt90 (<=726,200) and le78/78to90/gt90 (>726,200)\"\n },\n \"cells\": [\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 55,\n   \"annual_mip_rate\": 0.0055\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 75,\n   \"annual_mip_rate\": 0.0075\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le78\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"78to90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 65,\n   \"annual_mip_rate\": 0.0065\n  }\n ],\n \"contract\": {\n  \"required_qualifiers\": [\n   \"term\",\n   \"base loan amount vs $726,200\",\n   \"LTV band\",\n   \"case number assignment date on or after 2023-03-20\"\n  ],\n  \"does_not_establish\": [\n   \"the premium for case numbers assigned before 2023-03-20\",\n   \"the premium on HECM/reverse or Title I loans\",\n   \"the exact monthly amount, which HUD amortises on the average outstanding balance\"\n  ],\n  \"safe_sentence_template\": \"For an FHA forward loan with a case number assigned on or after 20 March 2023, a base loan amount {base_loan} and LTV {ltv} on a term {term}, the annual MIP is {annual_mip_rate_pct} of the base loan amount (HUD Mortgagee Letter 2023-05).\"\n },\n \"machine_readable_by\": \"FinanceRateCalc, from the public HUD letter; not an official HUD file; CC BY 4.0; corrections: https://financeratecalc.com/corrections.html\",\n \"verify\": \"https://financeratecalc.com/verify.html\",\n \"sha256\": \"425451eaa45ef8a9be1d3fae2288f1906e06a91aeb3d8b320c511e70f876d466\"\n}\n\nToday is October 2026. For an FHA purchase loan with a base loan amount of $800,000, a loan-to-value ratio of 92.0% and a 30-year term, with the FHA case number assigned this year, what is the annual mortgage insurance premium (MIP) rate? Answer first with the rate as a percentage of the loan amount (for example 0.00%), then name the HUD policy document that sets it.",
     "answer": "# Annual MIP Rate: 0.70%\n\n**Policy Document:** HUD Mortgagee Letter 2023-05\n\n---\n\n**Explanation:**\n- **Base loan amount:** $800,000 (exceeds $726,200 threshold) \u2192 `gt726200`\n- **LTV:** 92.0% (falls in >90% to \u226495% band) \u2192 `90to95`\n- **Term:** 30 years (exceeds 15 years) \u2192 `gt15`\n- **Case number assigned:** 2026 (on or after 2023-03-20) \u2713\n\nThis matches the cell: `term: gt15, base_loan: gt726200, ltv: 90to95` \u2192 **0.70% annual MIP rate**",
     "first_rate": 0.7,
     "correct": true,
     "stale_rate_present": false,
     "mentions_2023_change": true,
     "mentions_ml_2023_05": true
    },
    {
     "qid": "Q06",
     "amount": 300000,
     "ltv": 96.5,
     "term": 15,
     "truth": 0.4,
     "question": "You have this machine-readable copy of the rule (treat it as the source):\n{\n \"rule_id\": \"frc:rule:hud-ml-2023-05-annual-mip\",\n \"title\": \"FHA annual mortgage insurance premium (MIP) rates, forward mortgages\",\n \"issuer_of_rule\": \"U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05\",\n \"effective_from\": \"2023-03-20\",\n \"effective_to\": null,\n \"supersedes\": \"Mortgagee Letter 2015-01 table (0.45\\u20131.05%)\",\n \"base_loan_threshold_usd\": 726200,\n \"upfront_mip_rate\": 0.0175,\n \"definitions\": {\n  \"term\": \"gt15 = loan term over 15 years; le15 = 15 years or less\",\n  \"base_loan\": \"le726200 = base loan amount up to $726,200; gt726200 = above\",\n  \"ltv\": \"loan-to-value bands as in the letter: le90 (<=90%), 90to95 (>90 to <=95), gt95 (>95); for le15: le90/gt90 (<=726,200) and le78/78to90/gt90 (>726,200)\"\n },\n \"cells\": [\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 55,\n   \"annual_mip_rate\": 0.0055\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 75,\n   \"annual_mip_rate\": 0.0075\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le78\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"78to90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 65,\n   \"annual_mip_rate\": 0.0065\n  }\n ],\n \"contract\": {\n  \"required_qualifiers\": [\n   \"term\",\n   \"base loan amount vs $726,200\",\n   \"LTV band\",\n   \"case number assignment date on or after 2023-03-20\"\n  ],\n  \"does_not_establish\": [\n   \"the premium for case numbers assigned before 2023-03-20\",\n   \"the premium on HECM/reverse or Title I loans\",\n   \"the exact monthly amount, which HUD amortises on the average outstanding balance\"\n  ],\n  \"safe_sentence_template\": \"For an FHA forward loan with a case number assigned on or after 20 March 2023, a base loan amount {base_loan} and LTV {ltv} on a term {term}, the annual MIP is {annual_mip_rate_pct} of the base loan amount (HUD Mortgagee Letter 2023-05).\"\n },\n \"machine_readable_by\": \"FinanceRateCalc, from the public HUD letter; not an official HUD file; CC BY 4.0; corrections: https://financeratecalc.com/corrections.html\",\n \"verify\": \"https://financeratecalc.com/verify.html\",\n \"sha256\": \"425451eaa45ef8a9be1d3fae2288f1906e06a91aeb3d8b320c511e70f876d466\"\n}\n\nToday is October 2026. For an FHA purchase loan with a base loan amount of $300,000, a loan-to-value ratio of 96.5% and a 15-year term, with the FHA case number assigned this year, what is the annual mortgage insurance premium (MIP) rate? Answer first with the rate as a percentage of the loan amount (for example 0.00%), then name the HUD policy document that sets it.",
     "answer": "# Annual MIP Rate: 0.55%\n\n**Policy Document:** HUD Mortgagee Letter 2023-05\n\n**Explanation:**\n- Base loan amount: $300,000 (\u2264 $726,200) \u2192 `le726200`\n- LTV: 96.5% (> 95%) \u2192 `gt95`\n- Term: 15 years \u2192 `le15`\n- Case number assigned in 2026 (on or after 2023-03-20) \u2713\n\nLooking up the cell matching `term: le15`, `base_loan: le726200`, `ltv: gt95`... \n\nActually, I need to correct this. The rule shows that for `le15` and `le726200`, the LTV bands are only `le90` or `gt90` (not the three-band split used for `gt15`). \n\nSince your LTV is 96.5% (> 90%), this falls into the `gt90` category:\n- **Cell:** `term: le15`, `base_loan: le726200`, `ltv: gt90`\n- **Annual MIP Rate:** **0.0040 or 0.40%**\n\n**Correction to my initial answer: The annual MIP rate is 0.40%, not 0.55%.**",
     "first_rate": 0.55,
     "correct": false,
     "stale_rate_present": false,
     "mentions_2023_change": true,
     "mentions_ml_2023_05": true
    },
    {
     "qid": "Q07",
     "amount": 300000,
     "ltv": 85.0,
     "term": 15,
     "truth": 0.15,
     "question": "You have this machine-readable copy of the rule (treat it as the source):\n{\n \"rule_id\": \"frc:rule:hud-ml-2023-05-annual-mip\",\n \"title\": \"FHA annual mortgage insurance premium (MIP) rates, forward mortgages\",\n \"issuer_of_rule\": \"U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05\",\n \"effective_from\": \"2023-03-20\",\n \"effective_to\": null,\n \"supersedes\": \"Mortgagee Letter 2015-01 table (0.45\\u20131.05%)\",\n \"base_loan_threshold_usd\": 726200,\n \"upfront_mip_rate\": 0.0175,\n \"definitions\": {\n  \"term\": \"gt15 = loan term over 15 years; le15 = 15 years or less\",\n  \"base_loan\": \"le726200 = base loan amount up to $726,200; gt726200 = above\",\n  \"ltv\": \"loan-to-value bands as in the letter: le90 (<=90%), 90to95 (>90 to <=95), gt95 (>95); for le15: le90/gt90 (<=726,200) and le78/78to90/gt90 (>726,200)\"\n },\n \"cells\": [\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 55,\n   \"annual_mip_rate\": 0.0055\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 75,\n   \"annual_mip_rate\": 0.0075\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le78\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"78to90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 65,\n   \"annual_mip_rate\": 0.0065\n  }\n ],\n \"contract\": {\n  \"required_qualifiers\": [\n   \"term\",\n   \"base loan amount vs $726,200\",\n   \"LTV band\",\n   \"case number assignment date on or after 2023-03-20\"\n  ],\n  \"does_not_establish\": [\n   \"the premium for case numbers assigned before 2023-03-20\",\n   \"the premium on HECM/reverse or Title I loans\",\n   \"the exact monthly amount, which HUD amortises on the average outstanding balance\"\n  ],\n  \"safe_sentence_template\": \"For an FHA forward loan with a case number assigned on or after 20 March 2023, a base loan amount {base_loan} and LTV {ltv} on a term {term}, the annual MIP is {annual_mip_rate_pct} of the base loan amount (HUD Mortgagee Letter 2023-05).\"\n },\n \"machine_readable_by\": \"FinanceRateCalc, from the public HUD letter; not an official HUD file; CC BY 4.0; corrections: https://financeratecalc.com/corrections.html\",\n \"verify\": \"https://financeratecalc.com/verify.html\",\n \"sha256\": \"425451eaa45ef8a9be1d3fae2288f1906e06a91aeb3d8b320c511e70f876d466\"\n}\n\nToday is October 2026. For an FHA purchase loan with a base loan amount of $300,000, a loan-to-value ratio of 85.0% and a 15-year term, with the FHA case number assigned this year, what is the annual mortgage insurance premium (MIP) rate? Answer first with the rate as a percentage of the loan amount (for example 0.00%), then name the HUD policy document that sets it.",
     "answer": "# Annual MIP Rate: 0.15%\n\n**Policy Document:** HUD Mortgagee Letter 2023-05\n\n**Explanation:**\n- Base loan amount: $300,000 (\u2264 $726,200) \u2192 `le726200`\n- LTV: 85.0% (\u2264 90%) \u2192 `le90`\n- Term: 15 years (\u2264 15 years) \u2192 `le15`\n- Case number assigned in 2026 (on or after 2023-03-20) \u2713\n\nThis matches the cell: `term: le15, base_loan: le726200, ltv: le90` \u2192 **0.0015 or 0.15%**",
     "first_rate": 0.15,
     "correct": true,
     "stale_rate_present": false,
     "mentions_2023_change": true,
     "mentions_ml_2023_05": true
    },
    {
     "qid": "Q08",
     "amount": 800000,
     "ltv": 95.0,
     "term": 15,
     "truth": 0.65,
     "question": "You have this machine-readable copy of the rule (treat it as the source):\n{\n \"rule_id\": \"frc:rule:hud-ml-2023-05-annual-mip\",\n \"title\": \"FHA annual mortgage insurance premium (MIP) rates, forward mortgages\",\n \"issuer_of_rule\": \"U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05\",\n \"effective_from\": \"2023-03-20\",\n \"effective_to\": null,\n \"supersedes\": \"Mortgagee Letter 2015-01 table (0.45\\u20131.05%)\",\n \"base_loan_threshold_usd\": 726200,\n \"upfront_mip_rate\": 0.0175,\n \"definitions\": {\n  \"term\": \"gt15 = loan term over 15 years; le15 = 15 years or less\",\n  \"base_loan\": \"le726200 = base loan amount up to $726,200; gt726200 = above\",\n  \"ltv\": \"loan-to-value bands as in the letter: le90 (<=90%), 90to95 (>90 to <=95), gt95 (>95); for le15: le90/gt90 (<=726,200) and le78/78to90/gt90 (>726,200)\"\n },\n \"cells\": [\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 55,\n   \"annual_mip_rate\": 0.0055\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 75,\n   \"annual_mip_rate\": 0.0075\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le78\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"78to90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 65,\n   \"annual_mip_rate\": 0.0065\n  }\n ],\n \"contract\": {\n  \"required_qualifiers\": [\n   \"term\",\n   \"base loan amount vs $726,200\",\n   \"LTV band\",\n   \"case number assignment date on or after 2023-03-20\"\n  ],\n  \"does_not_establish\": [\n   \"the premium for case numbers assigned before 2023-03-20\",\n   \"the premium on HECM/reverse or Title I loans\",\n   \"the exact monthly amount, which HUD amortises on the average outstanding balance\"\n  ],\n  \"safe_sentence_template\": \"For an FHA forward loan with a case number assigned on or after 20 March 2023, a base loan amount {base_loan} and LTV {ltv} on a term {term}, the annual MIP is {annual_mip_rate_pct} of the base loan amount (HUD Mortgagee Letter 2023-05).\"\n },\n \"machine_readable_by\": \"FinanceRateCalc, from the public HUD letter; not an official HUD file; CC BY 4.0; corrections: https://financeratecalc.com/corrections.html\",\n \"verify\": \"https://financeratecalc.com/verify.html\",\n \"sha256\": \"425451eaa45ef8a9be1d3fae2288f1906e06a91aeb3d8b320c511e70f876d466\"\n}\n\nToday is October 2026. For an FHA purchase loan with a base loan amount of $800,000, a loan-to-value ratio of 95.0% and a 15-year term, with the FHA case number assigned this year, what is the annual mortgage insurance premium (MIP) rate? Answer first with the rate as a percentage of the loan amount (for example 0.00%), then name the HUD policy document that sets it.",
     "answer": "# Answer\n\n**Annual MIP Rate: 0.70%**\n\n**HUD Policy Document: Mortgagee Letter 2023-05**\n\n## Explanation\n\nBased on the rule parameters:\n- **Base loan amount**: $800,000 (exceeds $726,200 threshold \u2192 `gt726200`)\n- **LTV**: 95.0% (falls in the >90% band \u2192 `gt90`)\n- **Term**: 15 years (equals 15 years \u2192 `le15`)\n- **Case number assigned**: 2026 (on or after 2023-03-20 \u2713)\n\nLooking up the matching cell in the rule:\n- term: `le15`\n- base_loan: `gt726200`\n- ltv: `gt90`\n- **annual_mip_rate: 0.0065** (65 basis points)\n\nHowever, note that this rule also specifies an **upfront MIP of 1.75%** (0.0175), which is typically paid at closing and may be financed into the loan. The annual MIP of **0.70%** is the recurring annual premium charged on the outstanding balance.",
     "first_rate": 0.7,
     "correct": false,
     "stale_rate_present": false,
     "mentions_2023_change": true,
     "mentions_ml_2023_05": true
    },
    {
     "qid": "Q09",
     "amount": 800000,
     "ltv": 80.0,
     "term": 15,
     "truth": 0.4,
     "question": "You have this machine-readable copy of the rule (treat it as the source):\n{\n \"rule_id\": \"frc:rule:hud-ml-2023-05-annual-mip\",\n \"title\": \"FHA annual mortgage insurance premium (MIP) rates, forward mortgages\",\n \"issuer_of_rule\": \"U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05\",\n \"effective_from\": \"2023-03-20\",\n \"effective_to\": null,\n \"supersedes\": \"Mortgagee Letter 2015-01 table (0.45\\u20131.05%)\",\n \"base_loan_threshold_usd\": 726200,\n \"upfront_mip_rate\": 0.0175,\n \"definitions\": {\n  \"term\": \"gt15 = loan term over 15 years; le15 = 15 years or less\",\n  \"base_loan\": \"le726200 = base loan amount up to $726,200; gt726200 = above\",\n  \"ltv\": \"loan-to-value bands as in the letter: le90 (<=90%), 90to95 (>90 to <=95), gt95 (>95); for le15: le90/gt90 (<=726,200) and le78/78to90/gt90 (>726,200)\"\n },\n \"cells\": [\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 55,\n   \"annual_mip_rate\": 0.0055\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 75,\n   \"annual_mip_rate\": 0.0075\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le78\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"78to90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 65,\n   \"annual_mip_rate\": 0.0065\n  }\n ],\n \"contract\": {\n  \"required_qualifiers\": [\n   \"term\",\n   \"base loan amount vs $726,200\",\n   \"LTV band\",\n   \"case number assignment date on or after 2023-03-20\"\n  ],\n  \"does_not_establish\": [\n   \"the premium for case numbers assigned before 2023-03-20\",\n   \"the premium on HECM/reverse or Title I loans\",\n   \"the exact monthly amount, which HUD amortises on the average outstanding balance\"\n  ],\n  \"safe_sentence_template\": \"For an FHA forward loan with a case number assigned on or after 20 March 2023, a base loan amount {base_loan} and LTV {ltv} on a term {term}, the annual MIP is {annual_mip_rate_pct} of the base loan amount (HUD Mortgagee Letter 2023-05).\"\n },\n \"machine_readable_by\": \"FinanceRateCalc, from the public HUD letter; not an official HUD file; CC BY 4.0; corrections: https://financeratecalc.com/corrections.html\",\n \"verify\": \"https://financeratecalc.com/verify.html\",\n \"sha256\": \"425451eaa45ef8a9be1d3fae2288f1906e06a91aeb3d8b320c511e70f876d466\"\n}\n\nToday is October 2026. For an FHA purchase loan with a base loan amount of $800,000, a loan-to-value ratio of 80.0% and a 15-year term, with the FHA case number assigned this year, what is the annual mortgage insurance premium (MIP) rate? Answer first with the rate as a percentage of the loan amount (for example 0.00%), then name the HUD policy document that sets it.",
     "answer": "# Answer\n\n**Annual MIP Rate: 0.40%**\n\n**Policy Document: HUD Mortgagee Letter 2023-05**\n\n## Explanation\n\nBased on your loan parameters:\n- Base loan amount: $800,000 (exceeds $726,200 threshold \u2192 **gt726200**)\n- LTV: 80.0% (falls in \u226478% band \u2192 **le78**)\n- Term: 15 years (\u226415 years \u2192 **le15**)\n- Case number assigned in 2026 (on or after 2023-03-20 \u2192 rule applies)\n\nThe matching cell in the rule table is:\n```\nterm: le15\nbase_loan: gt726200\nltv: le78\nannual_mip_rate: 0.004 (or 0.40%)\n```",
     "first_rate": 0.4,
     "correct": true,
     "stale_rate_present": false,
     "mentions_2023_change": true,
     "mentions_ml_2023_05": true
    },
    {
     "qid": "Q10",
     "amount": 800000,
     "ltv": 75.0,
     "term": 15,
     "truth": 0.15,
     "question": "You have this machine-readable copy of the rule (treat it as the source):\n{\n \"rule_id\": \"frc:rule:hud-ml-2023-05-annual-mip\",\n \"title\": \"FHA annual mortgage insurance premium (MIP) rates, forward mortgages\",\n \"issuer_of_rule\": \"U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05\",\n \"effective_from\": \"2023-03-20\",\n \"effective_to\": null,\n \"supersedes\": \"Mortgagee Letter 2015-01 table (0.45\\u20131.05%)\",\n \"base_loan_threshold_usd\": 726200,\n \"upfront_mip_rate\": 0.0175,\n \"definitions\": {\n  \"term\": \"gt15 = loan term over 15 years; le15 = 15 years or less\",\n  \"base_loan\": \"le726200 = base loan amount up to $726,200; gt726200 = above\",\n  \"ltv\": \"loan-to-value bands as in the letter: le90 (<=90%), 90to95 (>90 to <=95), gt95 (>95); for le15: le90/gt90 (<=726,200) and le78/78to90/gt90 (>726,200)\"\n },\n \"cells\": [\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 55,\n   \"annual_mip_rate\": 0.0055\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 75,\n   \"annual_mip_rate\": 0.0075\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le78\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"78to90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 65,\n   \"annual_mip_rate\": 0.0065\n  }\n ],\n \"contract\": {\n  \"required_qualifiers\": [\n   \"term\",\n   \"base loan amount vs $726,200\",\n   \"LTV band\",\n   \"case number assignment date on or after 2023-03-20\"\n  ],\n  \"does_not_establish\": [\n   \"the premium for case numbers assigned before 2023-03-20\",\n   \"the premium on HECM/reverse or Title I loans\",\n   \"the exact monthly amount, which HUD amortises on the average outstanding balance\"\n  ],\n  \"safe_sentence_template\": \"For an FHA forward loan with a case number assigned on or after 20 March 2023, a base loan amount {base_loan} and LTV {ltv} on a term {term}, the annual MIP is {annual_mip_rate_pct} of the base loan amount (HUD Mortgagee Letter 2023-05).\"\n },\n \"machine_readable_by\": \"FinanceRateCalc, from the public HUD letter; not an official HUD file; CC BY 4.0; corrections: https://financeratecalc.com/corrections.html\",\n \"verify\": \"https://financeratecalc.com/verify.html\",\n \"sha256\": \"425451eaa45ef8a9be1d3fae2288f1906e06a91aeb3d8b320c511e70f876d466\"\n}\n\nToday is October 2026. For an FHA purchase loan with a base loan amount of $800,000, a loan-to-value ratio of 75.0% and a 15-year term, with the FHA case number assigned this year, what is the annual mortgage insurance premium (MIP) rate? Answer first with the rate as a percentage of the loan amount (for example 0.00%), then name the HUD policy document that sets it.",
     "answer": "# Answer\n\n**Annual MIP Rate: 0.40%**\n\n**Policy Document: HUD Mortgagee Letter 2023-05**\n\n## Explanation\n\nBased on the rule parameters:\n- **Base loan amount**: $800,000 (exceeds $726,200 threshold \u2192 `gt726200`)\n- **LTV**: 75.0% (falls in the \u226478% band \u2192 `le78`)\n- **Loan term**: 15 years (\u226415 years \u2192 `le15`)\n- **Case number assigned**: 2026 (on or after 2023-03-20 \u2713)\n\nThis matches the cell:\n```\nterm: le15\nbase_loan: gt726200\nltv: le78\nannual_mip_rate: 0.004 (or 0.40%)\n```",
     "first_rate": 0.4,
     "correct": false,
     "stale_rate_present": false,
     "mentions_2023_change": true,
     "mentions_ml_2023_05": true
    }
   ]
  },
  {
   "generated": "2026-10-10T18:15:03Z",
   "purpose": "Stale-rule probe: do models quote the FHA annual MIP rate that HUD replaced in March 2023?",
   "truth_source": "HUD Mortgagee Letter 2023-05 (effective 2023-03-20), base-loan threshold $726,200",
   "summary": {
    "model": "claude-sonnet-4-5-20250929",
    "condition": "with_rule",
    "n": 10,
    "correct": 9,
    "stale_rate_present": 0,
    "mentions_2023_change": 10,
    "errors": 0
   },
   "rows": [
    {
     "qid": "Q01",
     "amount": 300000,
     "ltv": 96.5,
     "term": 30,
     "truth": 0.55,
     "question": "You have this machine-readable copy of the rule (treat it as the source):\n{\n \"rule_id\": \"frc:rule:hud-ml-2023-05-annual-mip\",\n \"title\": \"FHA annual mortgage insurance premium (MIP) rates, forward mortgages\",\n \"issuer_of_rule\": \"U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05\",\n \"effective_from\": \"2023-03-20\",\n \"effective_to\": null,\n \"supersedes\": \"Mortgagee Letter 2015-01 table (0.45\\u20131.05%)\",\n \"base_loan_threshold_usd\": 726200,\n \"upfront_mip_rate\": 0.0175,\n \"definitions\": {\n  \"term\": \"gt15 = loan term over 15 years; le15 = 15 years or less\",\n  \"base_loan\": \"le726200 = base loan amount up to $726,200; gt726200 = above\",\n  \"ltv\": \"loan-to-value bands as in the letter: le90 (<=90%), 90to95 (>90 to <=95), gt95 (>95); for le15: le90/gt90 (<=726,200) and le78/78to90/gt90 (>726,200)\"\n },\n \"cells\": [\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 55,\n   \"annual_mip_rate\": 0.0055\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 75,\n   \"annual_mip_rate\": 0.0075\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le78\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"78to90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 65,\n   \"annual_mip_rate\": 0.0065\n  }\n ],\n \"contract\": {\n  \"required_qualifiers\": [\n   \"term\",\n   \"base loan amount vs $726,200\",\n   \"LTV band\",\n   \"case number assignment date on or after 2023-03-20\"\n  ],\n  \"does_not_establish\": [\n   \"the premium for case numbers assigned before 2023-03-20\",\n   \"the premium on HECM/reverse or Title I loans\",\n   \"the exact monthly amount, which HUD amortises on the average outstanding balance\"\n  ],\n  \"safe_sentence_template\": \"For an FHA forward loan with a case number assigned on or after 20 March 2023, a base loan amount {base_loan} and LTV {ltv} on a term {term}, the annual MIP is {annual_mip_rate_pct} of the base loan amount (HUD Mortgagee Letter 2023-05).\"\n },\n \"machine_readable_by\": \"FinanceRateCalc, from the public HUD letter; not an official HUD file; CC BY 4.0; corrections: https://financeratecalc.com/corrections.html\",\n \"verify\": \"https://financeratecalc.com/verify.html\",\n \"sha256\": \"425451eaa45ef8a9be1d3fae2288f1906e06a91aeb3d8b320c511e70f876d466\"\n}\n\nToday is October 2026. For an FHA purchase loan with a base loan amount of $300,000, a loan-to-value ratio of 96.5% and a 30-year term, with the FHA case number assigned this year, what is the annual mortgage insurance premium (MIP) rate? Answer first with the rate as a percentage of the loan amount (for example 0.00%), then name the HUD policy document that sets it.",
     "answer": "Based on the rule provided, for an FHA purchase loan with:\n- Base loan amount: $300,000 (\u2264 $726,200)\n- LTV: 96.5% (> 95%)\n- Term: 30 years (> 15 years)\n- Case number assigned in October 2026 (on or after 2023-03-20)\n\nThe annual MIP rate is **0.55%** of the loan amount.\n\nThis rate is established by **HUD Mortgagee Letter 2023-05**.",
     "first_rate": 0.55,
     "correct": true,
     "stale_rate_present": false,
     "mentions_2023_change": true,
     "mentions_ml_2023_05": true
    },
    {
     "qid": "Q02",
     "amount": 300000,
     "ltv": 90.0,
     "term": 30,
     "truth": 0.5,
     "question": "You have this machine-readable copy of the rule (treat it as the source):\n{\n \"rule_id\": \"frc:rule:hud-ml-2023-05-annual-mip\",\n \"title\": \"FHA annual mortgage insurance premium (MIP) rates, forward mortgages\",\n \"issuer_of_rule\": \"U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05\",\n \"effective_from\": \"2023-03-20\",\n \"effective_to\": null,\n \"supersedes\": \"Mortgagee Letter 2015-01 table (0.45\\u20131.05%)\",\n \"base_loan_threshold_usd\": 726200,\n \"upfront_mip_rate\": 0.0175,\n \"definitions\": {\n  \"term\": \"gt15 = loan term over 15 years; le15 = 15 years or less\",\n  \"base_loan\": \"le726200 = base loan amount up to $726,200; gt726200 = above\",\n  \"ltv\": \"loan-to-value bands as in the letter: le90 (<=90%), 90to95 (>90 to <=95), gt95 (>95); for le15: le90/gt90 (<=726,200) and le78/78to90/gt90 (>726,200)\"\n },\n \"cells\": [\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 55,\n   \"annual_mip_rate\": 0.0055\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 75,\n   \"annual_mip_rate\": 0.0075\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le78\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"78to90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 65,\n   \"annual_mip_rate\": 0.0065\n  }\n ],\n \"contract\": {\n  \"required_qualifiers\": [\n   \"term\",\n   \"base loan amount vs $726,200\",\n   \"LTV band\",\n   \"case number assignment date on or after 2023-03-20\"\n  ],\n  \"does_not_establish\": [\n   \"the premium for case numbers assigned before 2023-03-20\",\n   \"the premium on HECM/reverse or Title I loans\",\n   \"the exact monthly amount, which HUD amortises on the average outstanding balance\"\n  ],\n  \"safe_sentence_template\": \"For an FHA forward loan with a case number assigned on or after 20 March 2023, a base loan amount {base_loan} and LTV {ltv} on a term {term}, the annual MIP is {annual_mip_rate_pct} of the base loan amount (HUD Mortgagee Letter 2023-05).\"\n },\n \"machine_readable_by\": \"FinanceRateCalc, from the public HUD letter; not an official HUD file; CC BY 4.0; corrections: https://financeratecalc.com/corrections.html\",\n \"verify\": \"https://financeratecalc.com/verify.html\",\n \"sha256\": \"425451eaa45ef8a9be1d3fae2288f1906e06a91aeb3d8b320c511e70f876d466\"\n}\n\nToday is October 2026. For an FHA purchase loan with a base loan amount of $300,000, a loan-to-value ratio of 90.0% and a 30-year term, with the FHA case number assigned this year, what is the annual mortgage insurance premium (MIP) rate? Answer first with the rate as a percentage of the loan amount (for example 0.00%), then name the HUD policy document that sets it.",
     "answer": "Based on the rule provided, for an FHA purchase loan with:\n- Base loan amount: $300,000 (\u2264 $726,200)\n- LTV: 90.0% (\u2264 90%)\n- Term: 30 years (> 15 years)\n- Case number assigned in October 2026 (on or after 2023-03-20)\n\nThe annual MIP rate is **0.50%** of the loan amount.\n\nThis rate is established by **U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05**.",
     "first_rate": 0.5,
     "correct": true,
     "stale_rate_present": false,
     "mentions_2023_change": true,
     "mentions_ml_2023_05": true
    },
    {
     "qid": "Q03",
     "amount": 300000,
     "ltv": 94.0,
     "term": 30,
     "truth": 0.5,
     "question": "You have this machine-readable copy of the rule (treat it as the source):\n{\n \"rule_id\": \"frc:rule:hud-ml-2023-05-annual-mip\",\n \"title\": \"FHA annual mortgage insurance premium (MIP) rates, forward mortgages\",\n \"issuer_of_rule\": \"U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05\",\n \"effective_from\": \"2023-03-20\",\n \"effective_to\": null,\n \"supersedes\": \"Mortgagee Letter 2015-01 table (0.45\\u20131.05%)\",\n \"base_loan_threshold_usd\": 726200,\n \"upfront_mip_rate\": 0.0175,\n \"definitions\": {\n  \"term\": \"gt15 = loan term over 15 years; le15 = 15 years or less\",\n  \"base_loan\": \"le726200 = base loan amount up to $726,200; gt726200 = above\",\n  \"ltv\": \"loan-to-value bands as in the letter: le90 (<=90%), 90to95 (>90 to <=95), gt95 (>95); for le15: le90/gt90 (<=726,200) and le78/78to90/gt90 (>726,200)\"\n },\n \"cells\": [\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 55,\n   \"annual_mip_rate\": 0.0055\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 75,\n   \"annual_mip_rate\": 0.0075\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le78\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"78to90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 65,\n   \"annual_mip_rate\": 0.0065\n  }\n ],\n \"contract\": {\n  \"required_qualifiers\": [\n   \"term\",\n   \"base loan amount vs $726,200\",\n   \"LTV band\",\n   \"case number assignment date on or after 2023-03-20\"\n  ],\n  \"does_not_establish\": [\n   \"the premium for case numbers assigned before 2023-03-20\",\n   \"the premium on HECM/reverse or Title I loans\",\n   \"the exact monthly amount, which HUD amortises on the average outstanding balance\"\n  ],\n  \"safe_sentence_template\": \"For an FHA forward loan with a case number assigned on or after 20 March 2023, a base loan amount {base_loan} and LTV {ltv} on a term {term}, the annual MIP is {annual_mip_rate_pct} of the base loan amount (HUD Mortgagee Letter 2023-05).\"\n },\n \"machine_readable_by\": \"FinanceRateCalc, from the public HUD letter; not an official HUD file; CC BY 4.0; corrections: https://financeratecalc.com/corrections.html\",\n \"verify\": \"https://financeratecalc.com/verify.html\",\n \"sha256\": \"425451eaa45ef8a9be1d3fae2288f1906e06a91aeb3d8b320c511e70f876d466\"\n}\n\nToday is October 2026. For an FHA purchase loan with a base loan amount of $300,000, a loan-to-value ratio of 94.0% and a 30-year term, with the FHA case number assigned this year, what is the annual mortgage insurance premium (MIP) rate? Answer first with the rate as a percentage of the loan amount (for example 0.00%), then name the HUD policy document that sets it.",
     "answer": "Based on the rule provided, for an FHA purchase loan with:\n- Base loan amount: $300,000 (\u2264 $726,200)\n- LTV: 94.0% (falls in the 90to95 band: >90% to \u226495%)\n- Term: 30 years (> 15 years)\n- Case number assigned: October 2026 (on or after 2023-03-20)\n\nThe annual MIP rate is **0.50%** of the loan amount.\n\nThis rate is established by **HUD Mortgagee Letter 2023-05**.",
     "first_rate": 0.5,
     "correct": true,
     "stale_rate_present": false,
     "mentions_2023_change": true,
     "mentions_ml_2023_05": true
    },
    {
     "qid": "Q04",
     "amount": 800000,
     "ltv": 96.5,
     "term": 30,
     "truth": 0.75,
     "question": "You have this machine-readable copy of the rule (treat it as the source):\n{\n \"rule_id\": \"frc:rule:hud-ml-2023-05-annual-mip\",\n \"title\": \"FHA annual mortgage insurance premium (MIP) rates, forward mortgages\",\n \"issuer_of_rule\": \"U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05\",\n \"effective_from\": \"2023-03-20\",\n \"effective_to\": null,\n \"supersedes\": \"Mortgagee Letter 2015-01 table (0.45\\u20131.05%)\",\n \"base_loan_threshold_usd\": 726200,\n \"upfront_mip_rate\": 0.0175,\n \"definitions\": {\n  \"term\": \"gt15 = loan term over 15 years; le15 = 15 years or less\",\n  \"base_loan\": \"le726200 = base loan amount up to $726,200; gt726200 = above\",\n  \"ltv\": \"loan-to-value bands as in the letter: le90 (<=90%), 90to95 (>90 to <=95), gt95 (>95); for le15: le90/gt90 (<=726,200) and le78/78to90/gt90 (>726,200)\"\n },\n \"cells\": [\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 55,\n   \"annual_mip_rate\": 0.0055\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 75,\n   \"annual_mip_rate\": 0.0075\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le78\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"78to90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 65,\n   \"annual_mip_rate\": 0.0065\n  }\n ],\n \"contract\": {\n  \"required_qualifiers\": [\n   \"term\",\n   \"base loan amount vs $726,200\",\n   \"LTV band\",\n   \"case number assignment date on or after 2023-03-20\"\n  ],\n  \"does_not_establish\": [\n   \"the premium for case numbers assigned before 2023-03-20\",\n   \"the premium on HECM/reverse or Title I loans\",\n   \"the exact monthly amount, which HUD amortises on the average outstanding balance\"\n  ],\n  \"safe_sentence_template\": \"For an FHA forward loan with a case number assigned on or after 20 March 2023, a base loan amount {base_loan} and LTV {ltv} on a term {term}, the annual MIP is {annual_mip_rate_pct} of the base loan amount (HUD Mortgagee Letter 2023-05).\"\n },\n \"machine_readable_by\": \"FinanceRateCalc, from the public HUD letter; not an official HUD file; CC BY 4.0; corrections: https://financeratecalc.com/corrections.html\",\n \"verify\": \"https://financeratecalc.com/verify.html\",\n \"sha256\": \"425451eaa45ef8a9be1d3fae2288f1906e06a91aeb3d8b320c511e70f876d466\"\n}\n\nToday is October 2026. For an FHA purchase loan with a base loan amount of $800,000, a loan-to-value ratio of 96.5% and a 30-year term, with the FHA case number assigned this year, what is the annual mortgage insurance premium (MIP) rate? Answer first with the rate as a percentage of the loan amount (for example 0.00%), then name the HUD policy document that sets it.",
     "answer": "Based on the rule provided, for an FHA purchase loan with:\n- Base loan amount: $800,000 (greater than $726,200)\n- LTV: 96.5% (falls in the \"gt95\" band, >95%)\n- Term: 30 years (greater than 15 years)\n- Case number assigned: October 2026 (on or after 2023-03-20)\n\nThe annual MIP rate is **0.75%** of the loan amount.\n\nThis rate is established by **U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05**.",
     "first_rate": 0.75,
     "correct": true,
     "stale_rate_present": false,
     "mentions_2023_change": true,
     "mentions_ml_2023_05": true
    },
    {
     "qid": "Q05",
     "amount": 800000,
     "ltv": 92.0,
     "term": 30,
     "truth": 0.7,
     "question": "You have this machine-readable copy of the rule (treat it as the source):\n{\n \"rule_id\": \"frc:rule:hud-ml-2023-05-annual-mip\",\n \"title\": \"FHA annual mortgage insurance premium (MIP) rates, forward mortgages\",\n \"issuer_of_rule\": \"U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05\",\n \"effective_from\": \"2023-03-20\",\n \"effective_to\": null,\n \"supersedes\": \"Mortgagee Letter 2015-01 table (0.45\\u20131.05%)\",\n \"base_loan_threshold_usd\": 726200,\n \"upfront_mip_rate\": 0.0175,\n \"definitions\": {\n  \"term\": \"gt15 = loan term over 15 years; le15 = 15 years or less\",\n  \"base_loan\": \"le726200 = base loan amount up to $726,200; gt726200 = above\",\n  \"ltv\": \"loan-to-value bands as in the letter: le90 (<=90%), 90to95 (>90 to <=95), gt95 (>95); for le15: le90/gt90 (<=726,200) and le78/78to90/gt90 (>726,200)\"\n },\n \"cells\": [\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 55,\n   \"annual_mip_rate\": 0.0055\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 75,\n   \"annual_mip_rate\": 0.0075\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le78\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"78to90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 65,\n   \"annual_mip_rate\": 0.0065\n  }\n ],\n \"contract\": {\n  \"required_qualifiers\": [\n   \"term\",\n   \"base loan amount vs $726,200\",\n   \"LTV band\",\n   \"case number assignment date on or after 2023-03-20\"\n  ],\n  \"does_not_establish\": [\n   \"the premium for case numbers assigned before 2023-03-20\",\n   \"the premium on HECM/reverse or Title I loans\",\n   \"the exact monthly amount, which HUD amortises on the average outstanding balance\"\n  ],\n  \"safe_sentence_template\": \"For an FHA forward loan with a case number assigned on or after 20 March 2023, a base loan amount {base_loan} and LTV {ltv} on a term {term}, the annual MIP is {annual_mip_rate_pct} of the base loan amount (HUD Mortgagee Letter 2023-05).\"\n },\n \"machine_readable_by\": \"FinanceRateCalc, from the public HUD letter; not an official HUD file; CC BY 4.0; corrections: https://financeratecalc.com/corrections.html\",\n \"verify\": \"https://financeratecalc.com/verify.html\",\n \"sha256\": \"425451eaa45ef8a9be1d3fae2288f1906e06a91aeb3d8b320c511e70f876d466\"\n}\n\nToday is October 2026. For an FHA purchase loan with a base loan amount of $800,000, a loan-to-value ratio of 92.0% and a 30-year term, with the FHA case number assigned this year, what is the annual mortgage insurance premium (MIP) rate? Answer first with the rate as a percentage of the loan amount (for example 0.00%), then name the HUD policy document that sets it.",
     "answer": "Based on the rule provided, for an FHA purchase loan with:\n- Base loan amount: $800,000 (greater than $726,200)\n- LTV: 92.0% (falls in the 90to95 band: >90% to \u226495%)\n- Term: 30 years (greater than 15 years)\n- Case number assigned: October 2026 (on or after March 20, 2023)\n\nThe annual MIP rate is **0.70%** of the loan amount.\n\nThis rate is established by **HUD Mortgagee Letter 2023-05**.",
     "first_rate": 0.7,
     "correct": true,
     "stale_rate_present": false,
     "mentions_2023_change": true,
     "mentions_ml_2023_05": true
    },
    {
     "qid": "Q06",
     "amount": 300000,
     "ltv": 96.5,
     "term": 15,
     "truth": 0.4,
     "question": "You have this machine-readable copy of the rule (treat it as the source):\n{\n \"rule_id\": \"frc:rule:hud-ml-2023-05-annual-mip\",\n \"title\": \"FHA annual mortgage insurance premium (MIP) rates, forward mortgages\",\n \"issuer_of_rule\": \"U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05\",\n \"effective_from\": \"2023-03-20\",\n \"effective_to\": null,\n \"supersedes\": \"Mortgagee Letter 2015-01 table (0.45\\u20131.05%)\",\n \"base_loan_threshold_usd\": 726200,\n \"upfront_mip_rate\": 0.0175,\n \"definitions\": {\n  \"term\": \"gt15 = loan term over 15 years; le15 = 15 years or less\",\n  \"base_loan\": \"le726200 = base loan amount up to $726,200; gt726200 = above\",\n  \"ltv\": \"loan-to-value bands as in the letter: le90 (<=90%), 90to95 (>90 to <=95), gt95 (>95); for le15: le90/gt90 (<=726,200) and le78/78to90/gt90 (>726,200)\"\n },\n \"cells\": [\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 55,\n   \"annual_mip_rate\": 0.0055\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 75,\n   \"annual_mip_rate\": 0.0075\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le78\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"78to90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 65,\n   \"annual_mip_rate\": 0.0065\n  }\n ],\n \"contract\": {\n  \"required_qualifiers\": [\n   \"term\",\n   \"base loan amount vs $726,200\",\n   \"LTV band\",\n   \"case number assignment date on or after 2023-03-20\"\n  ],\n  \"does_not_establish\": [\n   \"the premium for case numbers assigned before 2023-03-20\",\n   \"the premium on HECM/reverse or Title I loans\",\n   \"the exact monthly amount, which HUD amortises on the average outstanding balance\"\n  ],\n  \"safe_sentence_template\": \"For an FHA forward loan with a case number assigned on or after 20 March 2023, a base loan amount {base_loan} and LTV {ltv} on a term {term}, the annual MIP is {annual_mip_rate_pct} of the base loan amount (HUD Mortgagee Letter 2023-05).\"\n },\n \"machine_readable_by\": \"FinanceRateCalc, from the public HUD letter; not an official HUD file; CC BY 4.0; corrections: https://financeratecalc.com/corrections.html\",\n \"verify\": \"https://financeratecalc.com/verify.html\",\n \"sha256\": \"425451eaa45ef8a9be1d3fae2288f1906e06a91aeb3d8b320c511e70f876d466\"\n}\n\nToday is October 2026. For an FHA purchase loan with a base loan amount of $300,000, a loan-to-value ratio of 96.5% and a 15-year term, with the FHA case number assigned this year, what is the annual mortgage insurance premium (MIP) rate? Answer first with the rate as a percentage of the loan amount (for example 0.00%), then name the HUD policy document that sets it.",
     "answer": "Based on the rule provided, for an FHA purchase loan with:\n- Base loan amount: $300,000 (\u2264 $726,200)\n- LTV: 96.5% (> 90%)\n- Term: 15 years (\u2264 15 years)\n- Case number assigned: October 2026 (on or after 2023-03-20)\n\nThe annual MIP rate is **0.40%** of the loan amount.\n\nThis rate is established by **HUD Mortgagee Letter 2023-05**.",
     "first_rate": 0.4,
     "correct": true,
     "stale_rate_present": false,
     "mentions_2023_change": true,
     "mentions_ml_2023_05": true
    },
    {
     "qid": "Q07",
     "amount": 300000,
     "ltv": 85.0,
     "term": 15,
     "truth": 0.15,
     "question": "You have this machine-readable copy of the rule (treat it as the source):\n{\n \"rule_id\": \"frc:rule:hud-ml-2023-05-annual-mip\",\n \"title\": \"FHA annual mortgage insurance premium (MIP) rates, forward mortgages\",\n \"issuer_of_rule\": \"U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05\",\n \"effective_from\": \"2023-03-20\",\n \"effective_to\": null,\n \"supersedes\": \"Mortgagee Letter 2015-01 table (0.45\\u20131.05%)\",\n \"base_loan_threshold_usd\": 726200,\n \"upfront_mip_rate\": 0.0175,\n \"definitions\": {\n  \"term\": \"gt15 = loan term over 15 years; le15 = 15 years or less\",\n  \"base_loan\": \"le726200 = base loan amount up to $726,200; gt726200 = above\",\n  \"ltv\": \"loan-to-value bands as in the letter: le90 (<=90%), 90to95 (>90 to <=95), gt95 (>95); for le15: le90/gt90 (<=726,200) and le78/78to90/gt90 (>726,200)\"\n },\n \"cells\": [\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 55,\n   \"annual_mip_rate\": 0.0055\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 75,\n   \"annual_mip_rate\": 0.0075\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le78\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"78to90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 65,\n   \"annual_mip_rate\": 0.0065\n  }\n ],\n \"contract\": {\n  \"required_qualifiers\": [\n   \"term\",\n   \"base loan amount vs $726,200\",\n   \"LTV band\",\n   \"case number assignment date on or after 2023-03-20\"\n  ],\n  \"does_not_establish\": [\n   \"the premium for case numbers assigned before 2023-03-20\",\n   \"the premium on HECM/reverse or Title I loans\",\n   \"the exact monthly amount, which HUD amortises on the average outstanding balance\"\n  ],\n  \"safe_sentence_template\": \"For an FHA forward loan with a case number assigned on or after 20 March 2023, a base loan amount {base_loan} and LTV {ltv} on a term {term}, the annual MIP is {annual_mip_rate_pct} of the base loan amount (HUD Mortgagee Letter 2023-05).\"\n },\n \"machine_readable_by\": \"FinanceRateCalc, from the public HUD letter; not an official HUD file; CC BY 4.0; corrections: https://financeratecalc.com/corrections.html\",\n \"verify\": \"https://financeratecalc.com/verify.html\",\n \"sha256\": \"425451eaa45ef8a9be1d3fae2288f1906e06a91aeb3d8b320c511e70f876d466\"\n}\n\nToday is October 2026. For an FHA purchase loan with a base loan amount of $300,000, a loan-to-value ratio of 85.0% and a 15-year term, with the FHA case number assigned this year, what is the annual mortgage insurance premium (MIP) rate? Answer first with the rate as a percentage of the loan amount (for example 0.00%), then name the HUD policy document that sets it.",
     "answer": "Based on the rule provided, for an FHA purchase loan with:\n- Base loan amount: $300,000 (\u2264 $726,200)\n- LTV: 85.0% (\u2264 90%)\n- Term: 15 years (le15)\n- Case number assigned in October 2026 (after March 20, 2023)\n\nThe annual MIP rate is **0.15%** of the loan amount.\n\nThis rate is established by **U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05**.",
     "first_rate": 0.15,
     "correct": true,
     "stale_rate_present": false,
     "mentions_2023_change": true,
     "mentions_ml_2023_05": true
    },
    {
     "qid": "Q08",
     "amount": 800000,
     "ltv": 95.0,
     "term": 15,
     "truth": 0.65,
     "question": "You have this machine-readable copy of the rule (treat it as the source):\n{\n \"rule_id\": \"frc:rule:hud-ml-2023-05-annual-mip\",\n \"title\": \"FHA annual mortgage insurance premium (MIP) rates, forward mortgages\",\n \"issuer_of_rule\": \"U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05\",\n \"effective_from\": \"2023-03-20\",\n \"effective_to\": null,\n \"supersedes\": \"Mortgagee Letter 2015-01 table (0.45\\u20131.05%)\",\n \"base_loan_threshold_usd\": 726200,\n \"upfront_mip_rate\": 0.0175,\n \"definitions\": {\n  \"term\": \"gt15 = loan term over 15 years; le15 = 15 years or less\",\n  \"base_loan\": \"le726200 = base loan amount up to $726,200; gt726200 = above\",\n  \"ltv\": \"loan-to-value bands as in the letter: le90 (<=90%), 90to95 (>90 to <=95), gt95 (>95); for le15: le90/gt90 (<=726,200) and le78/78to90/gt90 (>726,200)\"\n },\n \"cells\": [\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 55,\n   \"annual_mip_rate\": 0.0055\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 75,\n   \"annual_mip_rate\": 0.0075\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le78\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"78to90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 65,\n   \"annual_mip_rate\": 0.0065\n  }\n ],\n \"contract\": {\n  \"required_qualifiers\": [\n   \"term\",\n   \"base loan amount vs $726,200\",\n   \"LTV band\",\n   \"case number assignment date on or after 2023-03-20\"\n  ],\n  \"does_not_establish\": [\n   \"the premium for case numbers assigned before 2023-03-20\",\n   \"the premium on HECM/reverse or Title I loans\",\n   \"the exact monthly amount, which HUD amortises on the average outstanding balance\"\n  ],\n  \"safe_sentence_template\": \"For an FHA forward loan with a case number assigned on or after 20 March 2023, a base loan amount {base_loan} and LTV {ltv} on a term {term}, the annual MIP is {annual_mip_rate_pct} of the base loan amount (HUD Mortgagee Letter 2023-05).\"\n },\n \"machine_readable_by\": \"FinanceRateCalc, from the public HUD letter; not an official HUD file; CC BY 4.0; corrections: https://financeratecalc.com/corrections.html\",\n \"verify\": \"https://financeratecalc.com/verify.html\",\n \"sha256\": \"425451eaa45ef8a9be1d3fae2288f1906e06a91aeb3d8b320c511e70f876d466\"\n}\n\nToday is October 2026. For an FHA purchase loan with a base loan amount of $800,000, a loan-to-value ratio of 95.0% and a 15-year term, with the FHA case number assigned this year, what is the annual mortgage insurance premium (MIP) rate? Answer first with the rate as a percentage of the loan amount (for example 0.00%), then name the HUD policy document that sets it.",
     "answer": "Based on the rule provided, for an FHA purchase loan with:\n- Base loan amount: $800,000 (greater than $726,200)\n- LTV: 95.0% (falls in the 78to90 band, which is >78% to \u226490%)\n- Term: 15 years (le15)\n- Case number assigned: October 2026 (after March 20, 2023)\n\nThe annual MIP rate is **0.40%** of the loan amount.\n\nThe policy document that sets this rate is **HUD Mortgagee Letter 2023-05**.",
     "first_rate": 0.4,
     "correct": false,
     "stale_rate_present": false,
     "mentions_2023_change": true,
     "mentions_ml_2023_05": true
    },
    {
     "qid": "Q09",
     "amount": 800000,
     "ltv": 80.0,
     "term": 15,
     "truth": 0.4,
     "question": "You have this machine-readable copy of the rule (treat it as the source):\n{\n \"rule_id\": \"frc:rule:hud-ml-2023-05-annual-mip\",\n \"title\": \"FHA annual mortgage insurance premium (MIP) rates, forward mortgages\",\n \"issuer_of_rule\": \"U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05\",\n \"effective_from\": \"2023-03-20\",\n \"effective_to\": null,\n \"supersedes\": \"Mortgagee Letter 2015-01 table (0.45\\u20131.05%)\",\n \"base_loan_threshold_usd\": 726200,\n \"upfront_mip_rate\": 0.0175,\n \"definitions\": {\n  \"term\": \"gt15 = loan term over 15 years; le15 = 15 years or less\",\n  \"base_loan\": \"le726200 = base loan amount up to $726,200; gt726200 = above\",\n  \"ltv\": \"loan-to-value bands as in the letter: le90 (<=90%), 90to95 (>90 to <=95), gt95 (>95); for le15: le90/gt90 (<=726,200) and le78/78to90/gt90 (>726,200)\"\n },\n \"cells\": [\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 55,\n   \"annual_mip_rate\": 0.0055\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 75,\n   \"annual_mip_rate\": 0.0075\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le78\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"78to90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 65,\n   \"annual_mip_rate\": 0.0065\n  }\n ],\n \"contract\": {\n  \"required_qualifiers\": [\n   \"term\",\n   \"base loan amount vs $726,200\",\n   \"LTV band\",\n   \"case number assignment date on or after 2023-03-20\"\n  ],\n  \"does_not_establish\": [\n   \"the premium for case numbers assigned before 2023-03-20\",\n   \"the premium on HECM/reverse or Title I loans\",\n   \"the exact monthly amount, which HUD amortises on the average outstanding balance\"\n  ],\n  \"safe_sentence_template\": \"For an FHA forward loan with a case number assigned on or after 20 March 2023, a base loan amount {base_loan} and LTV {ltv} on a term {term}, the annual MIP is {annual_mip_rate_pct} of the base loan amount (HUD Mortgagee Letter 2023-05).\"\n },\n \"machine_readable_by\": \"FinanceRateCalc, from the public HUD letter; not an official HUD file; CC BY 4.0; corrections: https://financeratecalc.com/corrections.html\",\n \"verify\": \"https://financeratecalc.com/verify.html\",\n \"sha256\": \"425451eaa45ef8a9be1d3fae2288f1906e06a91aeb3d8b320c511e70f876d466\"\n}\n\nToday is October 2026. For an FHA purchase loan with a base loan amount of $800,000, a loan-to-value ratio of 80.0% and a 15-year term, with the FHA case number assigned this year, what is the annual mortgage insurance premium (MIP) rate? Answer first with the rate as a percentage of the loan amount (for example 0.00%), then name the HUD policy document that sets it.",
     "answer": "Based on the rule provided, for an FHA purchase loan with:\n- Base loan amount: $800,000 (greater than $726,200)\n- LTV: 80.0% (falls in the \"78to90\" band, which is >78% to \u226490%)\n- Term: 15 years (le15)\n- Case number assigned: October 2026 (after March 20, 2023, so this rule applies)\n\nThe annual MIP rate is **0.40%** of the loan amount.\n\nThis rate is established by **U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05**.",
     "first_rate": 0.4,
     "correct": true,
     "stale_rate_present": false,
     "mentions_2023_change": true,
     "mentions_ml_2023_05": true
    },
    {
     "qid": "Q10",
     "amount": 800000,
     "ltv": 75.0,
     "term": 15,
     "truth": 0.15,
     "question": "You have this machine-readable copy of the rule (treat it as the source):\n{\n \"rule_id\": \"frc:rule:hud-ml-2023-05-annual-mip\",\n \"title\": \"FHA annual mortgage insurance premium (MIP) rates, forward mortgages\",\n \"issuer_of_rule\": \"U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05\",\n \"effective_from\": \"2023-03-20\",\n \"effective_to\": null,\n \"supersedes\": \"Mortgagee Letter 2015-01 table (0.45\\u20131.05%)\",\n \"base_loan_threshold_usd\": 726200,\n \"upfront_mip_rate\": 0.0175,\n \"definitions\": {\n  \"term\": \"gt15 = loan term over 15 years; le15 = 15 years or less\",\n  \"base_loan\": \"le726200 = base loan amount up to $726,200; gt726200 = above\",\n  \"ltv\": \"loan-to-value bands as in the letter: le90 (<=90%), 90to95 (>90 to <=95), gt95 (>95); for le15: le90/gt90 (<=726,200) and le78/78to90/gt90 (>726,200)\"\n },\n \"cells\": [\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 50,\n   \"annual_mip_rate\": 0.005\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 55,\n   \"annual_mip_rate\": 0.0055\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"90to95\",\n   \"annual_mip_bps\": 70,\n   \"annual_mip_rate\": 0.007\n  },\n  {\n   \"term\": \"gt15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt95\",\n   \"annual_mip_bps\": 75,\n   \"annual_mip_rate\": 0.0075\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"le90\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"le726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"le78\",\n   \"annual_mip_bps\": 15,\n   \"annual_mip_rate\": 0.0015\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"78to90\",\n   \"annual_mip_bps\": 40,\n   \"annual_mip_rate\": 0.004\n  },\n  {\n   \"term\": \"le15\",\n   \"base_loan\": \"gt726200\",\n   \"ltv\": \"gt90\",\n   \"annual_mip_bps\": 65,\n   \"annual_mip_rate\": 0.0065\n  }\n ],\n \"contract\": {\n  \"required_qualifiers\": [\n   \"term\",\n   \"base loan amount vs $726,200\",\n   \"LTV band\",\n   \"case number assignment date on or after 2023-03-20\"\n  ],\n  \"does_not_establish\": [\n   \"the premium for case numbers assigned before 2023-03-20\",\n   \"the premium on HECM/reverse or Title I loans\",\n   \"the exact monthly amount, which HUD amortises on the average outstanding balance\"\n  ],\n  \"safe_sentence_template\": \"For an FHA forward loan with a case number assigned on or after 20 March 2023, a base loan amount {base_loan} and LTV {ltv} on a term {term}, the annual MIP is {annual_mip_rate_pct} of the base loan amount (HUD Mortgagee Letter 2023-05).\"\n },\n \"machine_readable_by\": \"FinanceRateCalc, from the public HUD letter; not an official HUD file; CC BY 4.0; corrections: https://financeratecalc.com/corrections.html\",\n \"verify\": \"https://financeratecalc.com/verify.html\",\n \"sha256\": \"425451eaa45ef8a9be1d3fae2288f1906e06a91aeb3d8b320c511e70f876d466\"\n}\n\nToday is October 2026. For an FHA purchase loan with a base loan amount of $800,000, a loan-to-value ratio of 75.0% and a 15-year term, with the FHA case number assigned this year, what is the annual mortgage insurance premium (MIP) rate? Answer first with the rate as a percentage of the loan amount (for example 0.00%), then name the HUD policy document that sets it.",
     "answer": "Based on the rule provided, for an FHA purchase loan with:\n- Base loan amount: $800,000 (greater than $726,200)\n- LTV: 75.0% (\u226478%)\n- Term: 15 years (le15)\n- Case number assigned in October 2026 (after March 20, 2023)\n\nThe annual MIP rate is **0.15%** of the loan amount.\n\nThis rate is established by **U.S. Department of Housing and Urban Development, Mortgagee Letter 2023-05**.",
     "first_rate": 0.15,
     "correct": true,
     "stale_rate_present": false,
     "mentions_2023_change": true,
     "mentions_ml_2023_05": true
    }
   ]
  }
 ],
 "summary": [
  {
   "model": "claude-haiku-4-5-20251001",
   "condition": "with_rule",
   "n": 10,
   "correct": 7,
   "stale_rate_present": 0,
   "mentions_2023_change": 10,
   "errors": 0
  },
  {
   "model": "claude-sonnet-4-5-20250929",
   "condition": "with_rule",
   "n": 10,
   "correct": 9,
   "stale_rate_present": 0,
   "mentions_2023_change": 10,
   "errors": 0
  }
 ],
 "regraded": "2026-10-10: extractor fixed to skip the restated LTV percentage (first version took the first percentage in the answer); answers unchanged"
}