{
 "generated": "20261011T0004",
 "runs": [
  {
   "generated": "2026-10-11T00:02:41Z",
   "summary": {
    "model": "claude-haiku-4-5-20251001",
    "condition": "no_source",
    "n": 25,
    "correct": 3,
    "errors": 0,
    "by_rule": {
     "fhfa-conforming-loan-limits-2026": "0/5",
     "fha-forward-loan-limits-2026": "0/5",
     "cfpb-hoepa-qm-thresholds-2026": "1/5",
     "va-funding-fee-2023-04-07": "0/5",
     "fha-annual-mip-ml-2023-05": "2/5"
    }
   },
   "rows": [
    {
     "rule": "fhfa-conforming-loan-limits-2026",
     "qid": "CL1",
     "question": "What is the 2026 baseline conforming loan limit for a one-unit property in most of the United States? Answer with the dollar amount first.",
     "truth": 832750,
     "kind": "usd",
     "answer": "# $766,550\n\nThis is the 2026 baseline conforming loan limit for a one-unit property in most of the United States. This limit is adjusted annually based on changes in the median home price, and the 2026 limit represents an increase from the 2025 limit of $766,200.",
     "extracted": 766550.0,
     "correct": false
    },
    {
     "rule": "fhfa-conforming-loan-limits-2026",
     "qid": "CL2",
     "question": "What is the 2026 conforming loan limit ceiling for a one-unit property in high-cost areas of the contiguous US? Dollar amount first.",
     "truth": 1249125,
     "kind": "usd",
     "answer": "# $822,375\n\nThis is the 2026 conforming loan limit ceiling for a one-unit property in high-cost areas of the contiguous United States. The limit is 150% of the baseline conforming loan limit ($548,250), which applies to high-cost areas as defined by the Federal Housing Finance Agency (FHFA).",
     "extracted": 822375.0,
     "correct": false
    },
    {
     "rule": "fhfa-conforming-loan-limits-2026",
     "qid": "CL3",
     "question": "What is the 2026 baseline conforming loan limit for a one-unit property in Alaska? Dollar amount first.",
     "truth": 1249125,
     "kind": "usd",
     "answer": "# $766,550\n\nThis is the 2026 baseline conforming loan limit for a one-unit property in Alaska. Alaska qualifies for the higher loan limit (150% of the national baseline) due to its high-cost area designation.",
     "extracted": 766550.0,
     "correct": false
    },
    {
     "rule": "fhfa-conforming-loan-limits-2026",
     "qid": "CL4",
     "question": "What is the 2026 conforming loan limit ceiling for a one-unit property in Hawaii's high-cost areas? Dollar amount first.",
     "truth": 1873675,
     "kind": "usd",
     "answer": "I don't have access to current information from October 2026, as my knowledge was last updated in April 2024. \n\nTo find the 2026 conforming loan limit ceiling for one-unit properties in Hawaii's high-cost areas, I'd recommend checking:\n\n1. **Fannie Mae's official website** - they publish annual loan limit updates\n2. **Freddie Mac's website** - similar authoritative source\n3. **HUD (Department of Housing and Urban Development)** - publishes official limits\n4. **Your lender** - they'll have current limits\n\nThese sources typically update loan limits in early January each year based on home price changes.",
     "extracted": null,
     "correct": false
    },
    {
     "rule": "fhfa-conforming-loan-limits-2026",
     "qid": "CL5",
     "question": "What was the 2025 baseline conforming loan limit for a one-unit property (the prior year's value)? Dollar amount first.",
     "truth": 806500,
     "kind": "usd",
     "answer": "# $766,550\n\nThis was the 2025 baseline conforming loan limit for a one-unit property set by the Federal Housing Finance Agency (FHFA).",
     "extracted": 766550.0,
     "correct": false
    },
    {
     "rule": "fha-forward-loan-limits-2026",
     "qid": "FL1",
     "question": "For an FHA case number assigned in 2026, what is the one-unit loan limit floor (low-cost areas)? Dollar amount first.",
     "truth": 541287,
     "kind": "usd",
     "answer": "I don't have access to current information from October 2026, as my knowledge was last updated in April 2024. FHA loan limits are adjusted annually and I cannot provide accurate figures for 2026.\n\nTo find the current FHA one-unit loan limit floor for low-cost areas in October 2026, I recommend checking:\n\n- **HUD.gov** - FHA loan limits page\n- **FHA Mortgage Limits** official announcements\n- Your local FHA office\n\nThese sources will have the official limits effective for cases assigned in 2026.",
     "extracted": null,
     "correct": false
    },
    {
     "rule": "fha-forward-loan-limits-2026",
     "qid": "FL2",
     "question": "For an FHA case number assigned in 2026, what is the one-unit loan limit ceiling (high-cost areas)? Dollar amount first.",
     "truth": 1249125,
     "kind": "usd",
     "answer": "# $420,680\n\nThis is the FHA one-unit loan limit ceiling for high-cost areas for case numbers assigned in 2026.",
     "extracted": 420680.0,
     "correct": false
    },
    {
     "rule": "fha-forward-loan-limits-2026",
     "qid": "FL3",
     "question": "For an FHA case number assigned in 2026, what is the two-unit loan limit floor? Dollar amount first.",
     "truth": 693050,
     "kind": "usd",
     "answer": "I don't have access to current information from October 2026, as my knowledge was last updated in April 2024. FHA loan limits are adjusted annually and I cannot reliably tell you what the specific two-unit loan limit floor will be in October 2026.\n\nTo get the accurate two-unit loan limit floor for FHA case numbers assigned in 2026, I'd recommend checking:\n- The FHA's official website (hud.gov)\n- Your FHA lender or mortgage professional\n- The Federal Register for the 2026 loan limit announcement\n\nI apologize I can't provide the specific dollar amount you're looking for.",
     "extracted": null,
     "correct": false
    },
    {
     "rule": "fha-forward-loan-limits-2026",
     "qid": "FL4",
     "question": "For an FHA case number assigned in 2026, what is the four-unit loan limit ceiling? Dollar amount first.",
     "truth": 2402625,
     "kind": "usd",
     "answer": "# FHA Four-Unit Loan Limit Ceiling (2026)\n\n**$822,375**\n\nThis is the maximum loan amount for a four-unit property under FHA guidelines for case numbers assigned in 2026. This limit applies in standard cost areas and is adjusted annually based on the Federal Housing Finance Agency's (FHFA) house price index.",
     "extracted": 822375.0,
     "correct": false
    },
    {
     "rule": "fha-forward-loan-limits-2026",
     "qid": "FL5",
     "question": "What is the 2026 HECM (FHA reverse mortgage) maximum claim amount? Dollar amount first.",
     "truth": 1249125,
     "kind": "usd",
     "answer": "I don't have access to current information from October 2026, as my knowledge was last updated in April 2024. I cannot provide the specific 2026 HECM maximum claim amount.\n\nTo find the current 2026 figure, I'd recommend checking:\n- **HUD.gov** (Department of Housing and Urban Development)\n- **FHA.gov** (Federal Housing Administration)\n- Your loan servicer or a HUD-approved HECM counselor\n\nThe maximum claim amount is adjusted annually and depends on the lesser of the home's appraised value or the FHA lending limit for your county.",
     "extracted": null,
     "correct": false
    },
    {
     "rule": "cfpb-hoepa-qm-thresholds-2026",
     "qid": "HQ1",
     "question": "For a loan consummated in 2026, what is the HOEPA total loan amount threshold below which the points-and-fees dollar trigger applies? Dollar amount first.",
     "truth": 27592,
     "kind": "usd",
     "answer": "# $6,162\n\nFor loans consummated in 2026, the HOEPA points-and-fees dollar trigger threshold is $6,162. This is the total loan amount below which the points-and-fees percentage test (8% of the total loan amount) applies instead of only the percentage test applying to all loans.\n\nThis figure is adjusted annually for inflation based on the Consumer Price Index.",
     "extracted": 6162.0,
     "correct": false
    },
    {
     "rule": "cfpb-hoepa-qm-thresholds-2026",
     "qid": "HQ2",
     "question": "For a loan consummated in 2026, what is the HOEPA points-and-fees dollar trigger? Dollar amount first.",
     "truth": 1380,
     "kind": "usd",
     "answer": "# $8,663\n\nThis is the HOEPA points-and-fees dollar trigger for 2026, calculated as 8% of the total loan amount for loans of $100,000 or more (or 10% for loans under $20,000, with a sliding scale in between).\n\nHowever, I should note that the specific dollar trigger you're asking about depends on which particular threshold you mean. The $8,663 figure represents the annual adjustment for 2026 under Regulation Z. If you're asking about a different specific trigger amount, please clarify and I can provide the precise figure.",
     "extracted": 8663.0,
     "correct": false
    },
    {
     "rule": "cfpb-hoepa-qm-thresholds-2026",
     "qid": "HQ3",
     "question": "For a qualified mortgage consummated in 2026 with a total loan amount of $100,000, what is the maximum points and fees in dollars? Dollar amount first.",
     "truth": 4139,
     "kind": "usd",
     "answer": "# $3,000\n\nFor a qualified mortgage consummated in 2026, the points and fees cap is 3% of the total loan amount.\n\n$100,000 \u00d7 3% = $3,000\n\nThis is based on the TRID/QM rules where points and fees cannot exceed 3% of the loan amount for qualified mortgages.",
     "extracted": 3000.0,
     "correct": false
    },
    {
     "rule": "cfpb-hoepa-qm-thresholds-2026",
     "qid": "HQ4",
     "question": "For a qualified mortgage consummated in 2026 with a total loan amount of $200,000, what is the points-and-fees limit as a percentage of the loan amount? Percentage first.",
     "truth": 3.0,
     "kind": "pct",
     "answer": "# 3%\n\nFor a qualified mortgage consummated in 2026, the points-and-fees limit is **3% of the total loan amount**.\n\nFor a $200,000 loan, this means the maximum allowable points and fees would be $6,000.",
     "extracted": 3.0,
     "correct": true
    },
    {
     "rule": "cfpb-hoepa-qm-thresholds-2026",
     "qid": "HQ5",
     "question": "For a qualified mortgage consummated in 2026 with a total loan amount of $50,000, what is the points-and-fees limit as a percentage of the loan amount? Percentage first.",
     "truth": 5.0,
     "kind": "pct",
     "answer": "# 3%\n\nFor a qualified mortgage consummated in 2026, the points-and-fees limit is **3% of the total loan amount**.\n\nThis means for a $50,000 loan, the maximum allowable points and fees would be $1,500.",
     "extracted": 3.0,
     "correct": false
    },
    {
     "rule": "va-funding-fee-2023-04-07",
     "qid": "VA1",
     "question": "A veteran uses the VA home loan benefit for the first time to buy a home with no down payment, closing in 2026 and not exempt. What is the funding fee percentage? Percentage first.",
     "truth": 2.15,
     "kind": "pct",
     "answer": "# 3.6%\n\nThis is the funding fee for a first-time VA home loan use with no down payment for a non-exempt veteran, effective in 2026.",
     "extracted": 3.6,
     "correct": false
    },
    {
     "rule": "va-funding-fee-2023-04-07",
     "qid": "VA2",
     "question": "A veteran uses the VA home loan benefit for the second time to buy a home with no down payment, closing in 2026 and not exempt. What is the funding fee percentage? Percentage first.",
     "truth": 3.3,
     "kind": "pct",
     "answer": "# 3.6%\n\nThis is the funding fee for a second-time VA home loan use with no down payment and no exemption, effective for loans closed in 2026.",
     "extracted": 3.6,
     "correct": false
    },
    {
     "rule": "va-funding-fee-2023-04-07",
     "qid": "VA3",
     "question": "First-use VA purchase loan with a 10% down payment, closing in 2026, not exempt: what is the funding fee percentage? Percentage first.",
     "truth": 1.25,
     "kind": "pct",
     "answer": "# VA Funding Fee - October 2026\n\nFor a first-use VA purchase loan with 10% down payment, closing in 2026 (not exempt):\n\n**2.3%**",
     "extracted": 2.3,
     "correct": false
    },
    {
     "rule": "va-funding-fee-2023-04-07",
     "qid": "VA4",
     "question": "First-use VA purchase loan with a 5% down payment, closing in 2026, not exempt: what is the funding fee percentage? Percentage first.",
     "truth": 1.5,
     "kind": "pct",
     "answer": "# VA Funding Fee - October 2026\n\nFor a **first-use VA purchase loan with 5% down payment, closing in 2026, not exempt**:\n\n**3.6%**\n\nThis is the standard funding fee for first-time VA loan users with a down payment of 5% to 9.99%.",
     "extracted": 3.6,
     "correct": false
    },
    {
     "rule": "va-funding-fee-2023-04-07",
     "qid": "VA5",
     "question": "What is the VA funding fee percentage on an Interest Rate Reduction Refinance Loan (IRRRL) closing in 2026 for a non-exempt borrower? Percentage first.",
     "truth": 0.5,
     "kind": "pct",
     "answer": "I don't have reliable information about VA funding fee percentages for 2026, as my knowledge was last updated in April 2024. VA funding fees can change, and I cannot accurately predict what the rates will be in October 2026.\n\nTo get the current and accurate funding fee percentage for an IRRRL closing in 2026, I recommend:\n\n1. **VA.gov** - Check the official Veterans Affairs website\n2. **Your VA lender** - They'll have current fee schedules\n3. **VA loan officer** - Can provide specific rates for your situation\n\nI apologize I cannot provide the specific percentage you're asking for.",
     "extracted": null,
     "correct": false
    },
    {
     "rule": "fha-annual-mip-ml-2023-05",
     "qid": "MP1",
     "question": "For an FHA purchase loan with a base loan amount of $300,000, LTV 96.5%, 30-year term, case number assigned this year, what is the annual MIP rate? Percentage first.",
     "truth": 0.55,
     "kind": "pct",
     "answer": "# FHA Annual MIP Rate - October 2026\n\n**0.55%**\n\nFor an FHA purchase loan with:\n- LTV of 96.5% (exceeds 95%)\n- 30-year term\n- Case number assigned in 2026\n\nThe annual mortgage insurance premium (MIP) rate is **0.55%** for loans with LTV > 95% on 30-year mortgages.\n\nThis is the standard annual MIP rate that has been in effect for such loans since January 2023.",
     "extracted": 0.55,
     "correct": true
    },
    {
     "rule": "fha-annual-mip-ml-2023-05",
     "qid": "MP2",
     "question": "For an FHA purchase loan with a base loan amount of $800,000, LTV 96.5%, 30-year term, case number assigned this year, what is the annual MIP rate? Percentage first.",
     "truth": 0.75,
     "kind": "pct",
     "answer": "# FHA Annual MIP Rate - October 2026\n\n**0.55%**\n\nFor an FHA purchase loan with:\n- LTV of 96.5% (exceeds 95%)\n- 30-year term\n- Case number assigned in 2026\n\nThe annual mortgage insurance premium (MIP) rate is **0.55%** for loans with LTV greater than 95% on 30-year mortgages.",
     "extracted": 0.55,
     "correct": false
    },
    {
     "rule": "fha-annual-mip-ml-2023-05",
     "qid": "MP3",
     "question": "For an FHA purchase loan with a base loan amount of $300,000, LTV 85%, 15-year term, case number assigned this year, what is the annual MIP rate? Percentage first.",
     "truth": 0.15,
     "kind": "pct",
     "answer": "# FHA Annual MIP Rate - October 2026\n\nFor an FHA purchase loan with those parameters:\n\n**0.55%**\n\nThis is the annual Mortgage Insurance Premium (MIP) rate for loans with:\n- LTV > 80% (yours is 85%)\n- Case number assigned in 2026\n- 15-year term\n\nThe 0.55% annual MIP applies to loans with LTV greater than 80% and loan terms of 15 years or less for case numbers assigned on or after January 1, 2009.",
     "extracted": 0.55,
     "correct": false
    },
    {
     "rule": "fha-annual-mip-ml-2023-05",
     "qid": "MP4",
     "question": "For an FHA purchase loan with a base loan amount of $800,000, LTV 95%, 15-year term, case number assigned this year, what is the annual MIP rate? Percentage first.",
     "truth": 0.65,
     "kind": "pct",
     "answer": "# FHA Annual MIP Rate - October 2026\n\nBased on FHA guidelines for loans with case numbers assigned in 2026:\n\n**0.55%**\n\nThis is the annual Mortgage Insurance Premium (MIP) rate for:\n- LTV of 95% (exceeds 95% LTV threshold)\n- 15-year term\n- Case number assigned in 2026\n\n**Note:** FHA MIP rates are subject to change and are set by the Department of Housing and Urban Development (HUD). For the most current and precise rate applicable to a specific loan, verification with HUD's current MIP schedules or your lender is recommended, as rates can be adjusted during the fiscal year.",
     "extracted": 0.55,
     "correct": false
    },
    {
     "rule": "fha-annual-mip-ml-2023-05",
     "qid": "MP5",
     "question": "What is the FHA upfront mortgage insurance premium rate for a forward purchase loan with a case number assigned this year? Percentage first.",
     "truth": 1.75,
     "kind": "pct",
     "answer": "I don't have access to current information from October 2026, as my knowledge was last updated in April 2024. FHA mortgage insurance premium rates can change, and I cannot provide accurate rates for a future date beyond my training data.\n\nTo find the current FHA upfront mortgage insurance premium (UFMIP) rate for forward purchase loans with case numbers assigned in October 2026, I recommend:\n\n1. **HUD.gov** - Check the official FHA section for current rates\n2. **FHA Mortgage Insurance Premium rates page** - Usually updated regularly\n3. **Your FHA-approved lender** - They'll have the most current rates\n\nAs of my last update (April 2024), the FHA UFMIP for most forward purchase loans was typically around 1.75%, but this may have changed.",
     "extracted": 1.75,
     "correct": true
    }
   ]
  },
  {
   "generated": "2026-10-11T00:04:24Z",
   "summary": {
    "model": "claude-sonnet-4-5-20250929",
    "condition": "no_source",
    "n": 25,
    "correct": 5,
    "errors": 0,
    "by_rule": {
     "fhfa-conforming-loan-limits-2026": "1/5",
     "fha-forward-loan-limits-2026": "0/5",
     "cfpb-hoepa-qm-thresholds-2026": "1/5",
     "va-funding-fee-2023-04-07": "1/5",
     "fha-annual-mip-ml-2023-05": "2/5"
    }
   },
   "rows": [
    {
     "rule": "fhfa-conforming-loan-limits-2026",
     "qid": "CL1",
     "question": "What is the 2026 baseline conforming loan limit for a one-unit property in most of the United States? Answer with the dollar amount first.",
     "truth": 832750,
     "kind": "usd",
     "answer": "$806,500\n\nThe 2026 baseline conforming loan limit for a one-unit property in most of the United States (for standard-cost areas) is $806,500. This represents an increase from the 2025 limit of $766,550, reflecting continued home price appreciation as measured by the FHFA House Price Index.",
     "extracted": 806500.0,
     "correct": false
    },
    {
     "rule": "fhfa-conforming-loan-limits-2026",
     "qid": "CL2",
     "question": "What is the 2026 conforming loan limit ceiling for a one-unit property in high-cost areas of the contiguous US? Dollar amount first.",
     "truth": 1249125,
     "kind": "usd",
     "answer": "I don't have access to information from October 2026, as my knowledge was last updated in April 2024. \n\nAs of my last update, the 2024 conforming loan limit ceiling for a one-unit property in high-cost areas was **$1,149,825**.\n\nThe 2025 limits would have been announced in November 2024, and the 2026 limits would be announced in November 2025 - both of which are beyond my knowledge cutoff. The Federal Housing Finance Agency (FHFA) typically announces these limits each fall based on changes in average home prices.\n\nTo find the actual 2026 limit, you would need to check the FHFA's official website or recent announcements from late 2025.",
     "extracted": 1149825.0,
     "correct": false
    },
    {
     "rule": "fhfa-conforming-loan-limits-2026",
     "qid": "CL3",
     "question": "What is the 2026 baseline conforming loan limit for a one-unit property in Alaska? Dollar amount first.",
     "truth": 1249125,
     "kind": "usd",
     "answer": "$1,209,750\n\nThe 2026 baseline conforming loan limit for a one-unit property in Alaska is $1,209,750. Alaska is designated as a high-cost area, so it receives 150% of the standard conforming loan limit (which is $806,500 for 2026), resulting in the higher limit of $1,209,750.",
     "extracted": 1209750.0,
     "correct": false
    },
    {
     "rule": "fhfa-conforming-loan-limits-2026",
     "qid": "CL4",
     "question": "What is the 2026 conforming loan limit ceiling for a one-unit property in Hawaii's high-cost areas? Dollar amount first.",
     "truth": 1873675,
     "kind": "usd",
     "answer": "$1,209,750\n\nThis is the 2026 conforming loan limit ceiling for one-unit properties in high-cost areas, which applies to expensive markets including parts of Hawaii. This represents 150% of the baseline conforming loan limit of $806,500 for 2026.",
     "extracted": 1209750.0,
     "correct": false
    },
    {
     "rule": "fhfa-conforming-loan-limits-2026",
     "qid": "CL5",
     "question": "What was the 2025 baseline conforming loan limit for a one-unit property (the prior year's value)? Dollar amount first.",
     "truth": 806500,
     "kind": "usd",
     "answer": "$806,500\n\nThis was the baseline conforming loan limit for a one-unit property in 2025, which would be considered the \"prior year's value\" as of October 2026.",
     "extracted": 806500.0,
     "correct": true
    },
    {
     "rule": "fha-forward-loan-limits-2026",
     "qid": "FL1",
     "question": "For an FHA case number assigned in 2026, what is the one-unit loan limit floor (low-cost areas)? Dollar amount first.",
     "truth": 541287,
     "kind": "usd",
     "answer": "$498,257\n\nFor FHA case numbers assigned in 2026, the one-unit loan limit floor (low-cost areas) is $498,257, which is 65% of the national conforming loan limit of $766,550.",
     "extracted": 498257.0,
     "correct": false
    },
    {
     "rule": "fha-forward-loan-limits-2026",
     "qid": "FL2",
     "question": "For an FHA case number assigned in 2026, what is the one-unit loan limit ceiling (high-cost areas)? Dollar amount first.",
     "truth": 1249125,
     "kind": "usd",
     "answer": "$1,209,750\n\nFor FHA case numbers assigned in 2026, the one-unit loan limit ceiling for high-cost areas is $1,209,750, which is 150% of the conforming loan limit of $806,500.",
     "extracted": 1209750.0,
     "correct": false
    },
    {
     "rule": "fha-forward-loan-limits-2026",
     "qid": "FL3",
     "question": "For an FHA case number assigned in 2026, what is the two-unit loan limit floor? Dollar amount first.",
     "truth": 693050,
     "kind": "usd",
     "answer": "$1,209,150\n\nFor FHA case numbers assigned in 2026, the two-unit loan limit floor is $1,209,150.",
     "extracted": 1209150.0,
     "correct": false
    },
    {
     "rule": "fha-forward-loan-limits-2026",
     "qid": "FL4",
     "question": "For an FHA case number assigned in 2026, what is the four-unit loan limit ceiling? Dollar amount first.",
     "truth": 2402625,
     "kind": "usd",
     "answer": "$1,396,800\n\nFor FHA case numbers assigned in 2026, the four-unit loan limit ceiling is $1,396,800. This represents the maximum loan amount available in high-cost areas for a four-unit property under FHA lending guidelines.",
     "extracted": 1396800.0,
     "correct": false
    },
    {
     "rule": "fha-forward-loan-limits-2026",
     "qid": "FL5",
     "question": "What is the 2026 HECM (FHA reverse mortgage) maximum claim amount? Dollar amount first.",
     "truth": 1249125,
     "kind": "usd",
     "answer": "I don't have access to current information from October 2026, as my knowledge was last updated in April 2024.\n\nAs of 2024, the HECM maximum claim amount (also called the lending limit) was **$1,149,825** for fiscal year 2024.\n\nThe HECM limit is typically adjusted annually based on the conforming loan limit set by the Federal Housing Finance Agency (FHFA). To find the actual 2026 limit, you would need to check:\n\n- HUD.gov official announcements\n- FHA/HUD reverse mortgage program updates\n- The FHFA conforming loan limit announcements (usually released in November for the following year)\n\nThe 2026 amount would likely be higher than the 2024 figure if home prices continued to rise.",
     "extracted": 1149825.0,
     "correct": false
    },
    {
     "rule": "cfpb-hoepa-qm-thresholds-2026",
     "qid": "HQ1",
     "question": "For a loan consummated in 2026, what is the HOEPA total loan amount threshold below which the points-and-fees dollar trigger applies? Dollar amount first.",
     "truth": 27592,
     "kind": "usd",
     "answer": "# $25,553\n\nFor a loan consummated in 2026, the HOEPA total loan amount threshold is **$25,553**. \n\nBelow this amount, the points-and-fees dollar trigger of $1,278 applies (rather than the 5% percentage test).\n\nThese thresholds are adjusted annually based on the Consumer Price Index and were established under the Home Ownership and Equity Protection Act (HOEPA) provisions of Regulation Z.",
     "extracted": 25553.0,
     "correct": false
    },
    {
     "rule": "cfpb-hoepa-qm-thresholds-2026",
     "qid": "HQ2",
     "question": "For a loan consummated in 2026, what is the HOEPA points-and-fees dollar trigger? Dollar amount first.",
     "truth": 1380,
     "kind": "usd",
     "answer": "# HOEPA Points-and-Fees Dollar Trigger for 2026\n\n**$1,280**\n\nThe HOEPA points-and-fees dollar trigger for loans consummated in 2026 is **$1,280**.\n\nThis amount is adjusted annually based on the Consumer Price Index (CPI). The trigger applies to loans where the total points and fees exceed the greater of:\n- $1,280 (the 2026 dollar trigger), or\n- 5% of the total loan amount\n\nThis is one of the tests used to determine whether a mortgage loan is classified as a high-cost mortgage under the Home Ownership and Equity Protection Act (HOEPA).",
     "extracted": 1280.0,
     "correct": false
    },
    {
     "rule": "cfpb-hoepa-qm-thresholds-2026",
     "qid": "HQ3",
     "question": "For a qualified mortgage consummated in 2026 with a total loan amount of $100,000, what is the maximum points and fees in dollars? Dollar amount first.",
     "truth": 4139,
     "kind": "usd",
     "answer": "# Maximum Points and Fees for Qualified Mortgage (2026)\n\n**$3,300**\n\n## Calculation Basis:\n\nFor qualified mortgages consummated in 2026 with a loan amount of $100,000, the points and fees threshold falls in the tier where the loan amount is **\u2265 $66,156 but < $110,260**.\n\nFor this tier, the maximum points and fees = **3% of the total loan amount**\n\n**Calculation:**\n- $100,000 \u00d7 3% = $3,000\n\n**With 2026 inflation adjustment:**\n- The dollar thresholds are adjusted annually for inflation\n- The base calculation of $3,000 applies, but given typical CFPB annual adjustments through 2026, the effective maximum would be approximately **$3,300**\n\nNote: The exact amount depends on the official CFPB inflation adjustments published for loans consummated in 2026. The thresholds are typically updated each January.",
     "extracted": 3300.0,
     "correct": false
    },
    {
     "rule": "cfpb-hoepa-qm-thresholds-2026",
     "qid": "HQ4",
     "question": "For a qualified mortgage consummated in 2026 with a total loan amount of $200,000, what is the points-and-fees limit as a percentage of the loan amount? Percentage first.",
     "truth": 3.0,
     "kind": "pct",
     "answer": "# 3%\n\nFor a qualified mortgage consummated in 2026 with a total loan amount of $200,000, the points-and-fees limit is **3% of the total loan amount**.\n\nThis falls under the standard tier for loans of $200,000, which is above the threshold where higher percentage limits apply to smaller loans. The Qualified Mortgage rule establishes tiered points-and-fees caps, with the 3% limit applying to loans of $110,260 or more (using the 2026 loan amount thresholds that are adjusted annually for inflation).",
     "extracted": 3.0,
     "correct": true
    },
    {
     "rule": "cfpb-hoepa-qm-thresholds-2026",
     "qid": "HQ5",
     "question": "For a qualified mortgage consummated in 2026 with a total loan amount of $50,000, what is the points-and-fees limit as a percentage of the loan amount? Percentage first.",
     "truth": 5.0,
     "kind": "pct",
     "answer": "# 8%\n\nFor a qualified mortgage consummated in 2026 with a total loan amount of $50,000, the points-and-fees limit is **8% of the total loan amount**.\n\nThis falls under the tiered structure for smaller loans established by the qualified mortgage rules. For loans between $13,537 and $80,310 (using the 2026 loan amount thresholds), the points-and-fees cap is 8% of the total loan amount.",
     "extracted": 8.0,
     "correct": false
    },
    {
     "rule": "va-funding-fee-2023-04-07",
     "qid": "VA1",
     "question": "A veteran uses the VA home loan benefit for the first time to buy a home with no down payment, closing in 2026 and not exempt. What is the funding fee percentage? Percentage first.",
     "truth": 2.15,
     "kind": "pct",
     "answer": "# VA Funding Fee Percentage\n\n**2.15%**\n\nThis is the funding fee percentage for a first-time VA loan user making a zero down payment (no down payment) on a purchase closing in 2026, assuming the veteran is not exempt from the funding fee.",
     "extracted": 2.15,
     "correct": true
    },
    {
     "rule": "va-funding-fee-2023-04-07",
     "qid": "VA2",
     "question": "A veteran uses the VA home loan benefit for the second time to buy a home with no down payment, closing in 2026 and not exempt. What is the funding fee percentage? Percentage first.",
     "truth": 3.3,
     "kind": "pct",
     "answer": "# 2.15%\n\nFor a veteran using the VA home loan benefit for the **second time** (subsequent use) with **no down payment** (0% down), closing in **October 2026** and **not exempt** from the funding fee, the funding fee is **2.15%** of the loan amount.\n\nThis is the standard subsequent-use rate for regular military veterans and service members with 0% down payment.",
     "extracted": 2.15,
     "correct": false
    },
    {
     "rule": "va-funding-fee-2023-04-07",
     "qid": "VA3",
     "question": "First-use VA purchase loan with a 10% down payment, closing in 2026, not exempt: what is the funding fee percentage? Percentage first.",
     "truth": 1.25,
     "kind": "pct",
     "answer": "# VA Funding Fee for First-Use Purchase Loan (October 2026)\n\n**2.15%**\n\n---\n\n## Details:\n- **Loan Type:** Purchase loan\n- **Down Payment:** 10% (but less than 15%)\n- **First-time VA loan use:** Yes\n- **Exempt:** No\n- **Closing Date:** 2026 (fee increase effective April 7, 2023 applies)\n\nThe funding fee of 2.15% applies to the loan amount and is typically financed into the loan rather than paid out of pocket at closing.",
     "extracted": 2.15,
     "correct": false
    },
    {
     "rule": "va-funding-fee-2023-04-07",
     "qid": "VA4",
     "question": "First-use VA purchase loan with a 5% down payment, closing in 2026, not exempt: what is the funding fee percentage? Percentage first.",
     "truth": 1.5,
     "kind": "pct",
     "answer": "# VA Funding Fee for First-Use Purchase Loan (5% Down, October 2026)\n\n**2.15%**\n\nThis applies to:\n- First-time use of VA loan benefit\n- Purchase loan (not refinance)\n- 5% down payment\n- Closing in 2026\n- Not exempt from funding fee\n\nThe 2.15% fee is calculated on the total loan amount.",
     "extracted": 2.15,
     "correct": false
    },
    {
     "rule": "va-funding-fee-2023-04-07",
     "qid": "VA5",
     "question": "What is the VA funding fee percentage on an Interest Rate Reduction Refinance Loan (IRRRL) closing in 2026 for a non-exempt borrower? Percentage first.",
     "truth": 0.5,
     "kind": "pct",
     "answer": "# 2.15%\n\nFor an Interest Rate Reduction Refinance Loan (IRRRL) closing in October 2026, the VA funding fee for a non-exempt borrower is **2.15%** of the loan amount.\n\nThis rate applies to VA streamline refinances (IRRRLs) and has been in effect since April 7, 2023, when the VA funding fee rates were adjusted.",
     "extracted": 2.15,
     "correct": false
    },
    {
     "rule": "fha-annual-mip-ml-2023-05",
     "qid": "MP1",
     "question": "For an FHA purchase loan with a base loan amount of $300,000, LTV 96.5%, 30-year term, case number assigned this year, what is the annual MIP rate? Percentage first.",
     "truth": 0.55,
     "kind": "pct",
     "answer": "# 0.55%\n\nFor an FHA purchase loan with:\n- Base loan amount: $300,000\n- LTV: 96.5% (greater than 95%)\n- 30-year term\n- Case number assigned in October 2026\n\nThe annual MIP rate is **0.55%** (55 basis points).\n\nThis rate applies to loans with LTV greater than 95% and loan terms greater than 15 years under current FHA guidelines.",
     "extracted": 0.55,
     "correct": true
    },
    {
     "rule": "fha-annual-mip-ml-2023-05",
     "qid": "MP2",
     "question": "For an FHA purchase loan with a base loan amount of $800,000, LTV 96.5%, 30-year term, case number assigned this year, what is the annual MIP rate? Percentage first.",
     "truth": 0.75,
     "kind": "pct",
     "answer": "# FHA Annual MIP Rate\n\n**0.55%**\n\nFor an FHA purchase loan with:\n- Base loan amount: $800,000\n- LTV: 96.5%\n- Term: 30 years\n- Case number assigned: October 2026\n\nThe annual MIP rate is **0.55%** (or 55 basis points).\n\nThis applies to loans over $726,200 (high-balance loans) with LTV greater than 95%, which matches your scenario.",
     "extracted": 0.55,
     "correct": false
    },
    {
     "rule": "fha-annual-mip-ml-2023-05",
     "qid": "MP3",
     "question": "For an FHA purchase loan with a base loan amount of $300,000, LTV 85%, 15-year term, case number assigned this year, what is the annual MIP rate? Percentage first.",
     "truth": 0.15,
     "kind": "pct",
     "answer": "# FHA Annual MIP Rate\n\n**0.45%**\n\nFor an FHA purchase loan with:\n- Base loan amount: $300,000\n- LTV: 85%\n- Term: 15 years\n- Case number assigned: October 2026\n\nThe annual MIP rate is **0.45%** (or 45 basis points).\n\nThis applies to 15-year term loans with LTV \u2264 90%, based on current FHA MIP guidelines.",
     "extracted": 0.45,
     "correct": false
    },
    {
     "rule": "fha-annual-mip-ml-2023-05",
     "qid": "MP4",
     "question": "For an FHA purchase loan with a base loan amount of $800,000, LTV 95%, 15-year term, case number assigned this year, what is the annual MIP rate? Percentage first.",
     "truth": 0.65,
     "kind": "pct",
     "answer": "# FHA Annual MIP Rate\n\n**0.45%**\n\nFor an FHA purchase loan with:\n- Base loan amount: $800,000\n- LTV: 95%\n- Term: 15 years\n- Case number assigned: October 2026\n\nThe annual MIP rate is **0.45%** (or 45 basis points).\n\nThis applies to 15-year term loans with LTV greater than 90%, regardless of the base loan amount.",
     "extracted": 0.45,
     "correct": false
    },
    {
     "rule": "fha-annual-mip-ml-2023-05",
     "qid": "MP5",
     "question": "What is the FHA upfront mortgage insurance premium rate for a forward purchase loan with a case number assigned this year? Percentage first.",
     "truth": 1.75,
     "kind": "pct",
     "answer": "# FHA Upfront Mortgage Insurance Premium (UFMIP) - October 2026\n\n## Answer: 1.75%\n\nThe FHA upfront mortgage insurance premium rate for forward purchase loans with case numbers assigned in 2026 is **1.75%** of the base loan amount.\n\nThis rate has been standard for most FHA forward mortgages for many years and applies to:\n- Purchase loans\n- Rate-and-term refinances\n- Construction-to-permanent loans\n\n**Note:** This 1.75% UFMIP can be financed into the loan amount and is separate from the annual mortgage insurance premium (MIP) that borrowers pay monthly.",
     "extracted": 1.75,
     "correct": true
    }
   ]
  }
 ],
 "summary": [
  {
   "model": "claude-haiku-4-5-20251001",
   "condition": "no_source",
   "n": 25,
   "correct": 3,
   "errors": 0,
   "by_rule": {
    "fhfa-conforming-loan-limits-2026": "0/5",
    "fha-forward-loan-limits-2026": "0/5",
    "cfpb-hoepa-qm-thresholds-2026": "1/5",
    "va-funding-fee-2023-04-07": "0/5",
    "fha-annual-mip-ml-2023-05": "2/5"
   }
  },
  {
   "model": "claude-sonnet-4-5-20250929",
   "condition": "no_source",
   "n": 25,
   "correct": 5,
   "errors": 0,
   "by_rule": {
    "fhfa-conforming-loan-limits-2026": "1/5",
    "fha-forward-loan-limits-2026": "0/5",
    "cfpb-hoepa-qm-thresholds-2026": "1/5",
    "va-funding-fee-2023-04-07": "1/5",
    "fha-annual-mip-ml-2023-05": "2/5"
   }
  }
 ],
 "regraded": "2026-10-11: percentage extractor skips percentages restated from the question; answers unchanged"
}