{
 "generated": "20261011T1037",
 "runs": [
  {
   "generated": "2026-10-11T10:36:14Z",
   "summary": {
    "model": "claude-haiku-4-5-20251001",
    "condition": "no_source",
    "n": 30,
    "correct": 8,
    "errors": 0,
    "by_rule": {
     "fhfa-conforming-loan-limits-2026": "1/6",
     "fha-forward-loan-limits-2026": "1/6",
     "cfpb-hoepa-qm-thresholds-2026": "2/6",
     "va-funding-fee-2023-04-07": "1/6",
     "fha-annual-mip-ml-2023-05": "3/6"
    },
    "absence_correct": 5,
    "absence_n": 5,
    "absence_invented": 0
   },
   "rows": [
    {
     "rule": "fhfa-conforming-loan-limits-2026",
     "qid": "CL1",
     "question": "What is the 2026 baseline conforming loan limit for a one-unit property in most of the United States? Answer with the dollar amount first.",
     "truth": 832750,
     "kind": "usd",
     "answer": "# $766,550\n\nThis is the 2026 baseline conforming loan limit for a one-unit property in most of the United States. This limit is adjusted annually based on changes in the median home price, and the 2026 limit represents an increase from the 2025 limit of $766,200.",
     "extracted": 766550.0,
     "correct": false
    },
    {
     "rule": "fhfa-conforming-loan-limits-2026",
     "qid": "CL2",
     "question": "What is the 2026 conforming loan limit ceiling for a one-unit property in high-cost areas of the contiguous US? Dollar amount first.",
     "truth": 1249125,
     "kind": "usd",
     "answer": "# $822,375\n\nThis is the 2026 conforming loan limit ceiling for a one-unit property in high-cost areas of the contiguous United States. The limit is 150% of the baseline conforming loan limit ($548,250), which applies to high-cost areas as defined by the Federal Housing Finance Agency (FHFA).",
     "extracted": 822375.0,
     "correct": false
    },
    {
     "rule": "fhfa-conforming-loan-limits-2026",
     "qid": "CL3",
     "question": "What is the 2026 baseline conforming loan limit for a one-unit property in Alaska? Dollar amount first.",
     "truth": 1249125,
     "kind": "usd",
     "answer": "# $766,550\n\nThis is the 2026 baseline conforming loan limit for a one-unit property in Alaska. Alaska qualifies for the higher loan limit (150% of the national baseline) due to its high cost of living and housing costs.",
     "extracted": 766550.0,
     "correct": false
    },
    {
     "rule": "fhfa-conforming-loan-limits-2026",
     "qid": "CL4",
     "question": "What is the 2026 conforming loan limit ceiling for a one-unit property in Hawaii's high-cost areas? Dollar amount first.",
     "truth": 1873675,
     "kind": "usd",
     "answer": "# $822,375\n\nThis is the 2026 conforming loan limit ceiling for a one-unit property in Hawaii's high-cost areas. Hawaii qualifies for the higher loan limits under the Housing and Economic Recovery Act (HERA) provisions, which allow limits up to 150% of the national conforming limit in high-cost areas.",
     "extracted": 822375.0,
     "correct": false
    },
    {
     "rule": "fhfa-conforming-loan-limits-2026",
     "qid": "CL5",
     "question": "What was the 2025 baseline conforming loan limit for a one-unit property (the prior year's value)? Dollar amount first.",
     "truth": 806500,
     "kind": "usd",
     "answer": "# $766,550\n\nThis was the 2025 baseline conforming loan limit for a one-unit property set by the Federal Housing Finance Agency (FHFA).",
     "extracted": 766550.0,
     "correct": false
    },
    {
     "rule": "fha-forward-loan-limits-2026",
     "qid": "FL1",
     "question": "For an FHA case number assigned in 2026, what is the one-unit loan limit floor (low-cost areas)? Dollar amount first.",
     "truth": 541287,
     "kind": "usd",
     "answer": "I don't have access to current information from October 2026, as my knowledge was last updated in April 2024. FHA loan limits are adjusted annually and I cannot provide accurate figures for 2026.\n\nTo find the current FHA one-unit loan limit floor for low-cost areas in October 2026, I recommend checking:\n\n- **HUD.gov** - FHA loan limits page\n- **FHA Mortgage Limits** official announcements\n- Your local FHA office\n\nThese sources will have the official limits effective for cases assigned in 2026.",
     "extracted": null,
     "correct": false
    },
    {
     "rule": "fha-forward-loan-limits-2026",
     "qid": "FL2",
     "question": "For an FHA case number assigned in 2026, what is the one-unit loan limit ceiling (high-cost areas)? Dollar amount first.",
     "truth": 1249125,
     "kind": "usd",
     "answer": "# $420,680\n\nThis is the FHA one-unit loan limit ceiling for high-cost areas for case numbers assigned in 2026. The limit is set at 150% of the national conforming loan limit, which for 2026 is $280,453, resulting in a high-cost area ceiling of $420,680.",
     "extracted": 420680.0,
     "correct": false
    },
    {
     "rule": "fha-forward-loan-limits-2026",
     "qid": "FL3",
     "question": "For an FHA case number assigned in 2026, what is the two-unit loan limit floor? Dollar amount first.",
     "truth": 693050,
     "kind": "usd",
     "answer": "I don't have access to current information from October 2026, as my knowledge was last updated in April 2024. FHA loan limits are adjusted annually and I cannot reliably tell you what the specific two-unit loan limit floor will be in October 2026.\n\nTo get the accurate two-unit loan limit floor for FHA case numbers assigned in 2026, I'd recommend checking:\n- The FHA's official website (hud.gov)\n- Your FHA lender or mortgage professional\n- The Federal Register for the 2026 loan limit announcement\n\nI apologize I can't provide the specific dollar amount you're looking for.",
     "extracted": null,
     "correct": false
    },
    {
     "rule": "fha-forward-loan-limits-2026",
     "qid": "FL4",
     "question": "For an FHA case number assigned in 2026, what is the four-unit loan limit ceiling? Dollar amount first.",
     "truth": 2402625,
     "kind": "usd",
     "answer": "# FHA Four-Unit Loan Limit Ceiling (2026)\n\n**$822,375**\n\nThis is the maximum loan amount for a four-unit property under FHA guidelines for case numbers assigned in 2026. This limit applies in standard cost areas and is adjusted annually based on the Federal Housing Finance Agency's (FHFA) house price index.",
     "extracted": 822375.0,
     "correct": false
    },
    {
     "rule": "fha-forward-loan-limits-2026",
     "qid": "FL5",
     "question": "What is the 2026 HECM (FHA reverse mortgage) maximum claim amount? Dollar amount first.",
     "truth": 1249125,
     "kind": "usd",
     "answer": "I don't have access to current information from October 2026, as my knowledge was last updated in April 2024. I cannot provide the specific 2026 HECM maximum claim amount.\n\nTo find the current 2026 figure, I'd recommend checking:\n- **HUD.gov** (Department of Housing and Urban Development)\n- **FHA.gov** (Federal Housing Administration)\n- **AARP** or other reverse mortgage resources\n\nThe maximum claim amount is adjusted annually and depends on the FHA lending limit for your county, so it varies by location.",
     "extracted": null,
     "correct": false
    },
    {
     "rule": "cfpb-hoepa-qm-thresholds-2026",
     "qid": "HQ1",
     "question": "For a loan consummated in 2026, what is the HOEPA total loan amount threshold below which the points-and-fees dollar trigger applies? Dollar amount first.",
     "truth": 27592,
     "kind": "usd",
     "answer": "# $6,162\n\nFor loans consummated in 2026, the HOEPA total loan amount threshold is $6,162. Below this amount, the points-and-fees dollar trigger applies (rather than the percentage-based trigger).\n\nThis threshold is adjusted annually for inflation based on the Consumer Price Index, as required under the Home Ownership and Equity Protection Act (HOEPA).",
     "extracted": 6162.0,
     "correct": false
    },
    {
     "rule": "cfpb-hoepa-qm-thresholds-2026",
     "qid": "HQ2",
     "question": "For a loan consummated in 2026, what is the HOEPA points-and-fees dollar trigger? Dollar amount first.",
     "truth": 1380,
     "kind": "usd",
     "answer": "# $8,663\n\nThis is the HOEPA points-and-fees dollar trigger for 2026, calculated as 8% of the total loan amount for loans of $100,000 or more (or 10% for loans under $20,000, with a sliding scale in between).\n\nHowever, I should note that the specific dollar trigger you're asking about depends on which particular threshold you mean. The $8,663 figure represents the annual adjustment for 2026 under Regulation Z. If you're asking about a different specific trigger amount, please clarify and I can provide the precise figure.",
     "extracted": 8663.0,
     "correct": false
    },
    {
     "rule": "cfpb-hoepa-qm-thresholds-2026",
     "qid": "HQ3",
     "question": "For a qualified mortgage consummated in 2026 with a total loan amount of $100,000, what is the maximum points and fees in dollars? Dollar amount first.",
     "truth": 4139,
     "kind": "usd",
     "answer": "# $3,000\n\nFor a qualified mortgage consummated in 2026, the points and fees cap is 3% of the total loan amount.\n\n$100,000 \u00d7 3% = $3,000\n\nThis is based on the TRID/QM rules where points and fees cannot exceed 3% of the loan amount for qualified mortgages.",
     "extracted": 3000.0,
     "correct": false
    },
    {
     "rule": "cfpb-hoepa-qm-thresholds-2026",
     "qid": "HQ4",
     "question": "For a qualified mortgage consummated in 2026 with a total loan amount of $200,000, what is the points-and-fees limit as a percentage of the loan amount? Percentage first.",
     "truth": 3.0,
     "kind": "pct",
     "answer": "# 3%\n\nFor a qualified mortgage consummated in 2026, the points-and-fees limit is **3% of the total loan amount**.\n\nThis means for a $200,000 loan, the maximum allowable points and fees would be $6,000.",
     "extracted": 3.0,
     "correct": true
    },
    {
     "rule": "cfpb-hoepa-qm-thresholds-2026",
     "qid": "HQ5",
     "question": "For a qualified mortgage consummated in 2026 with a total loan amount of $50,000, what is the points-and-fees limit as a percentage of the loan amount? Percentage first.",
     "truth": 5.0,
     "kind": "pct",
     "answer": "# Points and Fees Limit for 2026\n\n**3%**\n\nFor a qualified mortgage consummated in 2026 with a loan amount of $50,000, the points-and-fees limit is **3% of the loan amount**, which equals **$1,500**.\n\nThis is the standard cap under Regulation Z (Truth in Lending Act) for qualified mortgages, adjusted annually for inflation but remaining at 3% for loans of $50,000 and above.",
     "extracted": 3.0,
     "correct": false
    },
    {
     "rule": "va-funding-fee-2023-04-07",
     "qid": "VA1",
     "question": "A veteran uses the VA home loan benefit for the first time to buy a home with no down payment, closing in 2026 and not exempt. What is the funding fee percentage? Percentage first.",
     "truth": 2.15,
     "kind": "pct",
     "answer": "# 3.6%\n\nThis is the funding fee for a first-time VA home loan use with no down payment for a non-exempt veteran, effective in 2026.",
     "extracted": 3.6,
     "correct": false
    },
    {
     "rule": "va-funding-fee-2023-04-07",
     "qid": "VA2",
     "question": "A veteran uses the VA home loan benefit for the second time to buy a home with no down payment, closing in 2026 and not exempt. What is the funding fee percentage? Percentage first.",
     "truth": 3.3,
     "kind": "pct",
     "answer": "# 3.6%\n\nThis is the funding fee for a second-time VA home loan use with no down payment and no exemption, effective for loans closed in 2026.",
     "extracted": 3.6,
     "correct": false
    },
    {
     "rule": "va-funding-fee-2023-04-07",
     "qid": "VA3",
     "question": "First-use VA purchase loan with a 10% down payment, closing in 2026, not exempt: what is the funding fee percentage? Percentage first.",
     "truth": 1.25,
     "kind": "pct",
     "answer": "# VA Funding Fee - October 2026\n\nFor a first-use VA purchase loan with 10% down payment, closing in 2026, not exempt:\n\n**2.3%**",
     "extracted": 2.3,
     "correct": false
    },
    {
     "rule": "va-funding-fee-2023-04-07",
     "qid": "VA4",
     "question": "First-use VA purchase loan with a 5% down payment, closing in 2026, not exempt: what is the funding fee percentage? Percentage first.",
     "truth": 1.5,
     "kind": "pct",
     "answer": "# VA Funding Fee - October 2026\n\nFor a **first-use VA purchase loan with 5% down payment, closing in 2026, not exempt**:\n\n**3.6%**\n\nThis is the standard funding fee for first-time VA loan users with a down payment of 5% to 9.99%.",
     "extracted": 3.6,
     "correct": false
    },
    {
     "rule": "va-funding-fee-2023-04-07",
     "qid": "VA5",
     "question": "What is the VA funding fee percentage on an Interest Rate Reduction Refinance Loan (IRRRL) closing in 2026 for a non-exempt borrower? Percentage first.",
     "truth": 0.5,
     "kind": "pct",
     "answer": "# 0.55%\n\nThis is the VA funding fee percentage for an IRRRL (Interest Rate Reduction Refinance Loan) for a non-exempt borrower closing in 2026. IRRRLs have a reduced funding fee compared to other VA loan types, and this rate has been in effect for several years.",
     "extracted": 0.55,
     "correct": false
    },
    {
     "rule": "fha-annual-mip-ml-2023-05",
     "qid": "MP1",
     "question": "For an FHA purchase loan with a base loan amount of $300,000, LTV 96.5%, 30-year term, case number assigned this year, what is the annual MIP rate? Percentage first.",
     "truth": 0.55,
     "kind": "pct",
     "answer": "# FHA Annual MIP Rate - October 2026\n\n**0.55%**\n\nFor an FHA purchase loan with:\n- LTV of 96.5% (exceeds 95%)\n- 30-year term\n- Case number assigned in 2026\n\nThe annual mortgage insurance premium (MIP) rate is **0.55%** for loans with LTV > 95% on 30-year mortgages.\n\nThis is the standard annual MIP rate that has been in effect for such loans since January 2023.",
     "extracted": 0.55,
     "correct": true
    },
    {
     "rule": "fha-annual-mip-ml-2023-05",
     "qid": "MP2",
     "question": "For an FHA purchase loan with a base loan amount of $800,000, LTV 96.5%, 30-year term, case number assigned this year, what is the annual MIP rate? Percentage first.",
     "truth": 0.75,
     "kind": "pct",
     "answer": "# FHA Annual MIP Rate - October 2026\n\n**0.55%**\n\nFor an FHA purchase loan with:\n- LTV of 96.5% (exceeds 95%)\n- 30-year term\n- Case number assigned in 2026\n\nThe annual mortgage insurance premium (MIP) rate is **0.55%** for loans with LTV > 95% on 30-year mortgages.\n\nThis is the standard annual MIP rate that has been in effect for such loans and applies to your scenario.",
     "extracted": 0.55,
     "correct": false
    },
    {
     "rule": "fha-annual-mip-ml-2023-05",
     "qid": "MP3",
     "question": "For an FHA purchase loan with a base loan amount of $300,000, LTV 85%, 15-year term, case number assigned this year, what is the annual MIP rate? Percentage first.",
     "truth": 0.15,
     "kind": "pct",
     "answer": "# FHA Annual MIP Rate - October 2026\n\nFor an FHA purchase loan with those parameters, the **annual MIP rate is 0.55%**.\n\nThis applies to loans with:\n- LTV > 80% (your 85% LTV qualifies)\n- Case number assigned in 2026\n- 15-year term\n\nThe 0.55% annual MIP has been the standard rate for most FHA loans meeting these criteria since 2015.",
     "extracted": 0.55,
     "correct": false
    },
    {
     "rule": "fha-annual-mip-ml-2023-05",
     "qid": "MP4",
     "question": "For an FHA purchase loan with a base loan amount of $800,000, LTV 95%, 15-year term, case number assigned this year, what is the annual MIP rate? Percentage first.",
     "truth": 0.65,
     "kind": "pct",
     "answer": "# FHA Annual MIP Rate - October 2026\n\nBased on FHA guidelines for loans with case numbers assigned in 2026:\n\n**0.55%**\n\nThis is the annual Mortgage Insurance Premium (MIP) rate for:\n- LTV of 95% (high LTV)\n- 15-year term\n- Case number assigned in 2026\n\n**Note:** This rate applies to the annual MIP charged on the outstanding loan balance. The upfront MIP (typically 1.75% of the base loan amount) would be added separately to the loan amount at closing.",
     "extracted": 0.55,
     "correct": false
    },
    {
     "rule": "fha-annual-mip-ml-2023-05",
     "qid": "MP5",
     "question": "What is the FHA upfront mortgage insurance premium rate for a forward purchase loan with a case number assigned this year? Percentage first.",
     "truth": 1.75,
     "kind": "pct",
     "answer": "I don't have access to current information from October 2026, as my knowledge was last updated in April 2024. FHA mortgage insurance premium rates can change, and I cannot provide accurate rates for a future date beyond my training data.\n\nTo find the current FHA upfront mortgage insurance premium (UFMIP) rate for forward purchase loans with case numbers assigned in October 2026, I recommend:\n\n1. **HUD.gov** - Check the official FHA section for current rates\n2. **FHA Mortgage Insurance Premium rates page** - Usually updated regularly\n3. **Your FHA-approved lender** - They'll have the most current rates\n\nAs of my last update (April 2024), the FHA UFMIP for most forward purchase loans was typically around 1.75%, but this may have changed.",
     "extracted": 1.75,
     "correct": true
    },
    {
     "rule": "fha-annual-mip-ml-2023-05",
     "qid": "AB1",
     "question": "Under the FHA annual MIP rule for case numbers assigned this year, is there a reduced MIP rate for properties in designated rural areas? If yes, give the rate; if the rule has no such provision, say so.",
     "truth": null,
     "kind": "absent",
     "answer": "I don't have reliable information about FHA MIP rules specifically for October 2026, as that is beyond my training data cutoff (April 2024). FHA mortgage insurance premium rates and eligibility rules are subject to change through regulatory updates and policy decisions that I cannot predict.\n\nTo get accurate information about current FHA annual MIP rates for rural properties in October 2026, I'd recommend:\n\n1. **HUD.gov** - Check the official FHA section for current MIP rates\n2. **FHA Mortgage Insurance Premium rates page** - Usually updated annually\n3. **Contact an FHA-approved lender** - They'll have current rate information\n4. **HUD's Federal Register notices** - Where rate changes are officially published\n\nI apologize I cannot give you a definitive answer for this specific future date.",
     "extracted": null,
     "correct": true,
     "invented_value": false
    },
    {
     "rule": "va-funding-fee-2023-04-07",
     "qid": "AB2",
     "question": "Under the current VA funding fee table, what is the specific fee percentage for a first-use purchase with exactly 7.5% down payment, if the table lists a separate band for 7.5%? If there is no separate band, say so and name the band that applies.",
     "truth": null,
     "kind": "absent_band",
     "answer": "I don't have access to current VA funding fee tables as of October 2026. My training data has a knowledge cutoff in April 2024, and VA funding fee structures can be updated by the Department of Veterans Affairs.\n\nTo get the accurate, current funding fee percentage for your specific scenario, I recommend:\n\n1. **VA.gov** - Check the official VA website's loan benefits section\n2. **VA Loan servicers** - Contact your lender directly\n3. **VA regional office** - Call your local VA office\n\nThey can provide the exact fee percentage that applies to a first-use purchase with 7.5% down payment under the current fee table in effect.",
     "extracted": null,
     "correct": true,
     "invented_value": false
    },
    {
     "rule": "fhfa-conforming-loan-limits-2026",
     "qid": "AB3",
     "question": "What is the 2026 conforming loan limit for a five-unit residential property? If the rule does not define a five-unit limit, say so.",
     "truth": null,
     "kind": "absent",
     "answer": "# 2026 Conforming Loan Limit for Five-Unit Property\n\nThe rule does not define a five-unit limit.\n\nUnder current GSE (Fannie Mae and Freddie Mac) guidelines, conforming loan limits are established for:\n- 1-unit properties\n- 2-unit properties\n- 3-unit properties\n- 4-unit properties\n\nFive-unit and larger multifamily properties fall outside the conforming loan limit framework and are typically financed through commercial or portfolio lending programs rather than conforming mortgages.",
     "extracted": null,
     "correct": true,
     "invented_value": false
    },
    {
     "rule": "cfpb-hoepa-qm-thresholds-2026",
     "qid": "AB4",
     "question": "For loans consummated in 2026, what is the HOEPA points-and-fees dollar trigger specifically for manufactured housing loans, if Regulation Z sets a separate trigger for them? If it does not, say so.",
     "truth": null,
     "kind": "absent",
     "answer": "# HOEPA Points-and-Fees Trigger for Manufactured Housing Loans (2026)\n\nRegulation Z does **not** set a separate points-and-fees dollar trigger specifically for manufactured housing loans under HOEPA.\n\nAll covered loans subject to HOEPA are subject to the same points-and-fees threshold, which is adjusted annually for inflation. For 2026, you would need to consult the Federal Reserve's official adjustment notice (typically published in the Federal Register in late 2025), but the trigger applies uniformly across loan types unless Regulation Z explicitly provides otherwise\u2014which it does not for manufactured housing.\n\nIf you need the specific 2026 dollar amount, I'd recommend checking the Federal Reserve's official guidance or the Federal Register for the annual HOEPA adjustment.",
     "extracted": null,
     "correct": true,
     "invented_value": false
    },
    {
     "rule": "fha-forward-loan-limits-2026",
     "qid": "AB5",
     "question": "For an FHA case number assigned in 2026, what is the loan limit for a condominium unit, if HUD sets a separate condo-specific limit? If there is no separate condo limit, say so.",
     "truth": null,
     "kind": "absent",
     "answer": "I don't have access to current information from October 2026, as my knowledge was last updated in April 2024. I cannot reliably tell you what FHA loan limits HUD will have set for that time period.\n\nTo get accurate information about FHA loan limits for condominiums in October 2026, I'd recommend:\n\n1. **Visiting HUD.gov** - Check the official FHA loan limits page\n2. **Contacting an FHA-approved lender** - They maintain current limit information\n3. **Calling HUD directly** - 1-800-CALL-FHA\n\nHUD does periodically adjust loan limits and may have different limits for condos versus single-family properties, but I cannot confirm what those specific limits are for October 2026.",
     "extracted": null,
     "correct": true,
     "invented_value": false
    }
   ]
  },
  {
   "generated": "2026-10-11T10:37:54Z",
   "summary": {
    "model": "claude-sonnet-4-5-20250929",
    "condition": "no_source",
    "n": 30,
    "correct": 9,
    "errors": 0,
    "by_rule": {
     "fhfa-conforming-loan-limits-2026": "1/6",
     "fha-forward-loan-limits-2026": "1/6",
     "cfpb-hoepa-qm-thresholds-2026": "2/6",
     "va-funding-fee-2023-04-07": "2/6",
     "fha-annual-mip-ml-2023-05": "3/6"
    },
    "absence_correct": 5,
    "absence_n": 5,
    "absence_invented": 0
   },
   "rows": [
    {
     "rule": "fhfa-conforming-loan-limits-2026",
     "qid": "CL1",
     "question": "What is the 2026 baseline conforming loan limit for a one-unit property in most of the United States? Answer with the dollar amount first.",
     "truth": 832750,
     "kind": "usd",
     "answer": "$806,500\n\nThe 2026 baseline conforming loan limit for a one-unit property in most of the United States (for standard-cost areas) is $806,500. This represents an increase from the 2025 limit of $766,550, reflecting continued home price appreciation as measured by the FHFA House Price Index.",
     "extracted": 806500.0,
     "correct": false
    },
    {
     "rule": "fhfa-conforming-loan-limits-2026",
     "qid": "CL2",
     "question": "What is the 2026 conforming loan limit ceiling for a one-unit property in high-cost areas of the contiguous US? Dollar amount first.",
     "truth": 1249125,
     "kind": "usd",
     "answer": "I don't have access to information from October 2026, as my knowledge was last updated in April 2024. \n\nAs of my last update, the 2024 conforming loan limit ceiling for a one-unit property in high-cost areas was **$1,149,825**.\n\nThe 2025 and 2026 limits would be announced by the Federal Housing Finance Agency (FHFA) in November of the preceding year (so November 2024 for 2025 limits, and November 2025 for 2026 limits). These limits are adjusted annually based on changes in the national average home price.\n\nTo find the actual 2026 limit, you would need to check the FHFA's official announcements from November 2025.",
     "extracted": 1149825.0,
     "correct": false
    },
    {
     "rule": "fhfa-conforming-loan-limits-2026",
     "qid": "CL3",
     "question": "What is the 2026 baseline conforming loan limit for a one-unit property in Alaska? Dollar amount first.",
     "truth": 1249125,
     "kind": "usd",
     "answer": "$1,209,750\n\nThe 2026 baseline conforming loan limit for a one-unit property in Alaska is $1,209,750. Alaska is designated as a high-cost area, so it receives 150% of the standard conforming loan limit (which is $806,500 for 2026), resulting in the higher limit of $1,209,750.",
     "extracted": 1209750.0,
     "correct": false
    },
    {
     "rule": "fhfa-conforming-loan-limits-2026",
     "qid": "CL4",
     "question": "What is the 2026 conforming loan limit ceiling for a one-unit property in Hawaii's high-cost areas? Dollar amount first.",
     "truth": 1873675,
     "kind": "usd",
     "answer": "$1,209,750\n\nThis is the 2026 conforming loan limit ceiling for one-unit properties in high-cost areas, which applies to expensive markets including parts of Hawaii. The Federal Housing Finance Agency (FHFA) announced this limit for 2026, representing an increase from the 2025 ceiling of $1,174,550.",
     "extracted": 1209750.0,
     "correct": false
    },
    {
     "rule": "fhfa-conforming-loan-limits-2026",
     "qid": "CL5",
     "question": "What was the 2025 baseline conforming loan limit for a one-unit property (the prior year's value)? Dollar amount first.",
     "truth": 806500,
     "kind": "usd",
     "answer": "$766,550\n\nThis was the baseline conforming loan limit for a one-unit property in 2025, which would have been the prior year's value from the perspective of October 2026.",
     "extracted": 766550.0,
     "correct": false
    },
    {
     "rule": "fha-forward-loan-limits-2026",
     "qid": "FL1",
     "question": "For an FHA case number assigned in 2026, what is the one-unit loan limit floor (low-cost areas)? Dollar amount first.",
     "truth": 541287,
     "kind": "usd",
     "answer": "$498,257\n\nFor FHA case numbers assigned in 2026, the one-unit loan limit floor (low-cost areas) is $498,257, which is 65% of the national conforming loan limit of $766,550.",
     "extracted": 498257.0,
     "correct": false
    },
    {
     "rule": "fha-forward-loan-limits-2026",
     "qid": "FL2",
     "question": "For an FHA case number assigned in 2026, what is the one-unit loan limit ceiling (high-cost areas)? Dollar amount first.",
     "truth": 1249125,
     "kind": "usd",
     "answer": "$1,209,750\n\nFor FHA case numbers assigned in 2026, the one-unit loan limit ceiling for high-cost areas is $1,209,750, which is 150% of the conforming loan limit of $806,500.",
     "extracted": 1209750.0,
     "correct": false
    },
    {
     "rule": "fha-forward-loan-limits-2026",
     "qid": "FL3",
     "question": "For an FHA case number assigned in 2026, what is the two-unit loan limit floor? Dollar amount first.",
     "truth": 693050,
     "kind": "usd",
     "answer": "$1,209,150\n\nFor FHA case numbers assigned in 2026, the two-unit loan limit floor is $1,209,150.",
     "extracted": 1209150.0,
     "correct": false
    },
    {
     "rule": "fha-forward-loan-limits-2026",
     "qid": "FL4",
     "question": "For an FHA case number assigned in 2026, what is the four-unit loan limit ceiling? Dollar amount first.",
     "truth": 2402625,
     "kind": "usd",
     "answer": "$1,396,800\n\nFor FHA case numbers assigned in 2026, the four-unit loan limit ceiling is $1,396,800. This represents the maximum loan amount available in high-cost areas for a four-unit property under FHA lending guidelines.",
     "extracted": 1396800.0,
     "correct": false
    },
    {
     "rule": "fha-forward-loan-limits-2026",
     "qid": "FL5",
     "question": "What is the 2026 HECM (FHA reverse mortgage) maximum claim amount? Dollar amount first.",
     "truth": 1249125,
     "kind": "usd",
     "answer": "I don't have access to current information from October 2026, as my knowledge was last updated in April 2024.\n\nAs of 2024, the HECM maximum claim amount (also called the lending limit) was **$1,149,825** for fiscal year 2024.\n\nThe HECM limit is typically adjusted annually based on the conforming loan limit set by the Federal Housing Finance Agency (FHFA). To find the actual 2026 limit, you would need to check:\n\n- HUD.gov official announcements\n- FHA/HUD reverse mortgage program updates\n- The FHFA conforming loan limit announcements (usually released in November for the following year)\n\nThe 2026 amount would likely be higher than the 2024 figure if home prices continued to rise.",
     "extracted": 1149825.0,
     "correct": false
    },
    {
     "rule": "cfpb-hoepa-qm-thresholds-2026",
     "qid": "HQ1",
     "question": "For a loan consummated in 2026, what is the HOEPA total loan amount threshold below which the points-and-fees dollar trigger applies? Dollar amount first.",
     "truth": 27592,
     "kind": "usd",
     "answer": "# $27,200\n\nFor loans consummated in 2026, the HOEPA total loan amount threshold is **$27,200**. \n\nBelow this threshold, the points-and-fees dollar trigger of **$1,360** applies (rather than the 5% percentage test).\n\nAt or above $27,200, the 5% points-and-fees test applies for determining HOEPA coverage.",
     "extracted": 27200.0,
     "correct": false
    },
    {
     "rule": "cfpb-hoepa-qm-thresholds-2026",
     "qid": "HQ2",
     "question": "For a loan consummated in 2026, what is the HOEPA points-and-fees dollar trigger? Dollar amount first.",
     "truth": 1380,
     "kind": "usd",
     "answer": "# HOEPA Points-and-Fees Dollar Trigger for 2026\n\n**$1,280**\n\nThe HOEPA points-and-fees dollar trigger for loans consummated in 2026 is **$1,280**.\n\nThis amount is adjusted annually based on the Consumer Price Index (CPI). The Bureau of Consumer Financial Protection publishes the updated threshold each year, typically effective January 1st.\n\nFor a loan to be considered a high-cost mortgage under HOEPA, the total points and fees must exceed the **lesser of**:\n- 5% of the total loan amount, OR\n- **$1,280** (the 2026 dollar trigger)",
     "extracted": 1280.0,
     "correct": false
    },
    {
     "rule": "cfpb-hoepa-qm-thresholds-2026",
     "qid": "HQ3",
     "question": "For a qualified mortgage consummated in 2026 with a total loan amount of $100,000, what is the maximum points and fees in dollars? Dollar amount first.",
     "truth": 4139,
     "kind": "usd",
     "answer": "# Maximum Points and Fees for Qualified Mortgage (2026)\n\n**$3,300**\n\n## Calculation Basis:\n\nFor qualified mortgages consummated in 2026 with a loan amount of $100,000, the points and fees threshold falls in the tier where the loan amount is **\u2265 $66,156 but < $110,260**.\n\nFor this tier, the maximum points and fees = **3% of the total loan amount**\n\n**Calculation:**\n- $100,000 \u00d7 3% = $3,000\n\n**Plus annual inflation adjustment from base year (2014) to 2026:**\n- The $3,000 base amount is subject to annual adjustments based on the Consumer Price Index\n- With typical CPI adjustments through 2026, the threshold would be approximately **$3,300**\n\n(Note: The exact amount depends on the official CFPB annual adjustment published for 2026, but $3,300 is the reasonable estimate based on historical CPI trends.)",
     "extracted": 3300.0,
     "correct": false
    },
    {
     "rule": "cfpb-hoepa-qm-thresholds-2026",
     "qid": "HQ4",
     "question": "For a qualified mortgage consummated in 2026 with a total loan amount of $200,000, what is the points-and-fees limit as a percentage of the loan amount? Percentage first.",
     "truth": 3.0,
     "kind": "pct",
     "answer": "# 3%\n\nFor a qualified mortgage consummated in 2026 with a total loan amount of $200,000, the points-and-fees limit is **3% of the total loan amount**.\n\nThis falls under the standard tier for loans of $125,911 or more (using the 2026 threshold adjustments), where the points and fees cannot exceed 3% of the total loan amount.",
     "extracted": 3.0,
     "correct": true
    },
    {
     "rule": "cfpb-hoepa-qm-thresholds-2026",
     "qid": "HQ5",
     "question": "For a qualified mortgage consummated in 2026 with a total loan amount of $50,000, what is the points-and-fees limit as a percentage of the loan amount? Percentage first.",
     "truth": 5.0,
     "kind": "pct",
     "answer": "# 8%\n\nFor a qualified mortgage consummated in 2026 with a total loan amount of $50,000, the points-and-fees limit is **8% of the total loan amount**.\n\nThis falls under the tiered structure for smaller loans established by the qualified mortgage rules. For loans between $13,000 and less than $65,000 (using the 2026 thresholds), the points-and-fees cap is 8% of the total loan amount.",
     "extracted": 8.0,
     "correct": false
    },
    {
     "rule": "va-funding-fee-2023-04-07",
     "qid": "VA1",
     "question": "A veteran uses the VA home loan benefit for the first time to buy a home with no down payment, closing in 2026 and not exempt. What is the funding fee percentage? Percentage first.",
     "truth": 2.15,
     "kind": "pct",
     "answer": "# VA Funding Fee Percentage\n\n**2.15%**\n\nThis is the funding fee for a first-time VA loan user making a zero down payment (0% down) on a purchase closing in 2026, assuming the veteran is not exempt from the funding fee.",
     "extracted": 2.15,
     "correct": true
    },
    {
     "rule": "va-funding-fee-2023-04-07",
     "qid": "VA2",
     "question": "A veteran uses the VA home loan benefit for the second time to buy a home with no down payment, closing in 2026 and not exempt. What is the funding fee percentage? Percentage first.",
     "truth": 3.3,
     "kind": "pct",
     "answer": "# 2.15%\n\nIn October 2026, for a veteran using the VA home loan benefit for the **second time** (subsequent use) with **no down payment** (0% down), the funding fee is **2.15%**.\n\nThis applies to:\n- Subsequent use of the VA loan benefit\n- 0% down payment\n- Closing in 2026\n- Not exempt from the funding fee",
     "extracted": 2.15,
     "correct": false
    },
    {
     "rule": "va-funding-fee-2023-04-07",
     "qid": "VA3",
     "question": "First-use VA purchase loan with a 10% down payment, closing in 2026, not exempt: what is the funding fee percentage? Percentage first.",
     "truth": 1.25,
     "kind": "pct",
     "answer": "# VA Funding Fee for First-Use Purchase Loan (October 2026)\n\n**2.15%**\n\n---\n\n## Details:\n- **Loan Type:** Purchase loan\n- **Down Payment:** 10% (but less than 15%)\n- **First-Time Use:** Yes\n- **Exempt:** No\n- **Closing Date:** 2026 (after April 7, 2023 fee increase)\n\nThe funding fee of 2.15% applies to the loan amount and can be financed into the loan.",
     "extracted": 2.15,
     "correct": false
    },
    {
     "rule": "va-funding-fee-2023-04-07",
     "qid": "VA4",
     "question": "First-use VA purchase loan with a 5% down payment, closing in 2026, not exempt: what is the funding fee percentage? Percentage first.",
     "truth": 1.5,
     "kind": "pct",
     "answer": "# VA Funding Fee for First-Use Purchase Loan (5% Down, October 2026)\n\n**2.15%**\n\nThis applies to:\n- First-time use of VA loan benefit\n- Purchase loan (not refinance)\n- 5% down payment\n- Closing in 2026\n- Not exempt from funding fee\n\nThe 2.15% fee is calculated on the total loan amount.",
     "extracted": 2.15,
     "correct": false
    },
    {
     "rule": "va-funding-fee-2023-04-07",
     "qid": "VA5",
     "question": "What is the VA funding fee percentage on an Interest Rate Reduction Refinance Loan (IRRRL) closing in 2026 for a non-exempt borrower? Percentage first.",
     "truth": 0.5,
     "kind": "pct",
     "answer": "# 2.15%\n\nFor an Interest Rate Reduction Refinance Loan (IRRRL) closing in October 2026, the VA funding fee for a non-exempt borrower is **2.15%**.\n\nThis rate applies to VA streamline refinances (IRRRLs) and has been in effect since April 7, 2023, when the VA funding fee rates were adjusted pursuant to the Blue Water Navy Vietnam Veterans Act of 2019.",
     "extracted": 2.15,
     "correct": false
    },
    {
     "rule": "fha-annual-mip-ml-2023-05",
     "qid": "MP1",
     "question": "For an FHA purchase loan with a base loan amount of $300,000, LTV 96.5%, 30-year term, case number assigned this year, what is the annual MIP rate? Percentage first.",
     "truth": 0.55,
     "kind": "pct",
     "answer": "# FHA Annual MIP Rate\n\n**0.55%**\n\nFor an FHA purchase loan with:\n- Base loan amount: $300,000\n- LTV: 96.5% (greater than 95%)\n- Term: 30 years\n- Case number assigned: 2026\n\nThe annual MIP rate is **0.55%** (or 55 basis points).\n\nThis rate applies to loans with LTV greater than 95% and loan terms greater than 15 years, which matches your scenario.",
     "extracted": 0.55,
     "correct": true
    },
    {
     "rule": "fha-annual-mip-ml-2023-05",
     "qid": "MP2",
     "question": "For an FHA purchase loan with a base loan amount of $800,000, LTV 96.5%, 30-year term, case number assigned this year, what is the annual MIP rate? Percentage first.",
     "truth": 0.75,
     "kind": "pct",
     "answer": "# FHA Annual MIP Rate\n\n**0.55%**\n\nFor an FHA purchase loan with:\n- Base loan amount: $800,000\n- LTV: 96.5%\n- Term: 30 years\n- Case number assigned: October 2026\n\nThe annual MIP rate is **0.55%** (or 55 basis points).\n\nThis applies to loans over $726,200 (high-balance loans) with LTV greater than 95%, which matches your scenario.",
     "extracted": 0.55,
     "correct": false
    },
    {
     "rule": "fha-annual-mip-ml-2023-05",
     "qid": "MP3",
     "question": "For an FHA purchase loan with a base loan amount of $300,000, LTV 85%, 15-year term, case number assigned this year, what is the annual MIP rate? Percentage first.",
     "truth": 0.15,
     "kind": "pct",
     "answer": "# FHA Annual MIP Rate\n\n**0.45%**\n\nFor an FHA purchase loan with:\n- Base loan amount: $300,000\n- LTV: 85%\n- Term: 15 years\n- Case number assigned: October 2026\n\nThe annual MIP rate is **0.45%** (or 45 basis points).\n\nThis applies to 15-year term loans with LTV \u2264 90%.",
     "extracted": 0.45,
     "correct": false
    },
    {
     "rule": "fha-annual-mip-ml-2023-05",
     "qid": "MP4",
     "question": "For an FHA purchase loan with a base loan amount of $800,000, LTV 95%, 15-year term, case number assigned this year, what is the annual MIP rate? Percentage first.",
     "truth": 0.65,
     "kind": "pct",
     "answer": "# FHA Annual MIP Rate\n\n**0.45%**\n\nFor an FHA purchase loan with:\n- Base loan amount: $800,000\n- LTV: 95%\n- Term: 15 years\n- Case number assigned: October 2026\n\nThe annual MIP rate is **0.45%** (or 45 basis points).\n\nThis applies to 15-year term loans with LTV greater than 90%, regardless of the base loan amount.",
     "extracted": 0.45,
     "correct": false
    },
    {
     "rule": "fha-annual-mip-ml-2023-05",
     "qid": "MP5",
     "question": "What is the FHA upfront mortgage insurance premium rate for a forward purchase loan with a case number assigned this year? Percentage first.",
     "truth": 1.75,
     "kind": "pct",
     "answer": "# FHA Upfront Mortgage Insurance Premium (UFMIP) - October 2026\n\n## Answer: 1.75%\n\nThe FHA upfront mortgage insurance premium rate for a forward purchase loan with a case number assigned in 2026 is **1.75%** of the base loan amount.\n\n---\n\n## Key Details:\n\n- **Rate**: 1.75% of the base loan amount\n- **Loan Type**: Forward purchase mortgage\n- **Payment**: Typically financed into the loan amount\n- **Applies to**: Most standard FHA purchase loans\n\nThis rate has been the standard UFMIP rate for FHA forward mortgages for many years and remains in effect for case numbers assigned in 2026.\n\n**Note**: This is separate from the annual mortgage insurance premium (MIP) that borrowers also pay monthly.",
     "extracted": 1.75,
     "correct": true
    },
    {
     "rule": "fha-annual-mip-ml-2023-05",
     "qid": "AB1",
     "question": "Under the FHA annual MIP rule for case numbers assigned this year, is there a reduced MIP rate for properties in designated rural areas? If yes, give the rate; if the rule has no such provision, say so.",
     "truth": null,
     "kind": "absent",
     "answer": "Based on FHA guidelines, there is **no special reduced MIP rate provision specifically for properties in designated rural areas** under the standard FHA annual MIP structure.\n\nThe FHA annual MIP rates are determined by:\n- Loan-to-value (LTV) ratio\n- Loan term (\u226415 years or >15 years)\n- Base loan amount\n\nFor case numbers assigned in 2026, the standard annual MIP rates apply uniformly regardless of whether the property is in a rural or urban area. Rural area designations do not factor into FHA's MIP rate calculations.\n\n**Note:** While FHA doesn't offer rural-specific MIP reductions, the USDA offers a separate rural housing loan program with its own guarantee fee structure that may be more favorable for eligible rural properties.",
     "extracted": null,
     "correct": true,
     "invented_value": false
    },
    {
     "rule": "va-funding-fee-2023-04-07",
     "qid": "AB2",
     "question": "Under the current VA funding fee table, what is the specific fee percentage for a first-use purchase with exactly 7.5% down payment, if the table lists a separate band for 7.5%? If there is no separate band, say so and name the band that applies.",
     "truth": null,
     "kind": "absent_band",
     "answer": "I don't have access to current VA funding fee tables as of October 2026, as my knowledge was last updated in April 2024.\n\nHowever, based on the VA funding fee structure that existed through my last update, **there is no separate band for exactly 7.5% down payment**. \n\nThe band that would apply is **5% to less than 10% down payment**, which for first-time use on a purchase carried a funding fee of **1.5%**.\n\nTo get the current October 2026 rates, I'd recommend checking:\n- VA.gov's official funding fee page\n- Contacting a VA-approved lender\n- Reviewing the most recent VA funding fee tables\n\nNote that Congress can change these fees, so verification with current sources is important for your specific situation.",
     "extracted": 5.0,
     "correct": true,
     "invented_value": false
    },
    {
     "rule": "fhfa-conforming-loan-limits-2026",
     "qid": "AB3",
     "question": "What is the 2026 conforming loan limit for a five-unit residential property? If the rule does not define a five-unit limit, say so.",
     "truth": null,
     "kind": "absent",
     "answer": "According to the conforming loan limit rules, there is **no five-unit limit defined**. \n\nThe conforming loan limits are established for:\n- One-unit properties\n- Two-unit properties\n- Three-unit properties\n- Four-unit properties\n\nThe regulations do not provide a conforming loan limit category for five-unit residential properties. Properties with five or more units would typically fall outside the conforming loan program and would need to be financed through other means, such as commercial real estate loans.",
     "extracted": null,
     "correct": true,
     "invented_value": false
    },
    {
     "rule": "cfpb-hoepa-qm-thresholds-2026",
     "qid": "AB4",
     "question": "For loans consummated in 2026, what is the HOEPA points-and-fees dollar trigger specifically for manufactured housing loans, if Regulation Z sets a separate trigger for them? If it does not, say so.",
     "truth": null,
     "kind": "absent",
     "answer": "As of October 2026, Regulation Z does **not** set a separate HOEPA points-and-fees dollar trigger specifically for manufactured housing loans.\n\nThe HOEPA points-and-fees triggers apply uniformly to all covered transactions, including manufactured housing loans. For 2026, the dollar trigger would be the inflation-adjusted amount (typically announced by the CFPB in mid-2025 for the 2026 calendar year), which applies to all covered loans regardless of whether they are for site-built homes or manufactured housing.\n\nManufactured housing loans are subject to the same HOEPA coverage tests as other mortgage loans: the points-and-fees percentage test (currently 5% of the total loan amount for loans \u2265$25,532, or 8% for smaller loans, using 2024 thresholds) and the uniform dollar trigger.",
     "extracted": 5.0,
     "correct": true,
     "invented_value": false
    },
    {
     "rule": "fha-forward-loan-limits-2026",
     "qid": "AB5",
     "question": "For an FHA case number assigned in 2026, what is the loan limit for a condominium unit, if HUD sets a separate condo-specific limit? If there is no separate condo limit, say so.",
     "truth": null,
     "kind": "absent",
     "answer": "# FHA Condominium Loan Limits (2026)\n\n**There is no separate condo-specific limit.**\n\nFor FHA case numbers assigned in 2026, condominium units follow the **same loan limits as single-family homes** based on the area's median home prices. The limits are:\n\n- **Low-cost areas**: $498,257 (floor)\n- **High-cost areas**: Up to $1,149,825 (ceiling)\n- **Varies by county** between these amounts\n\nThe FHA does not establish different loan limits specifically for condominiums versus single-family homes. A one-unit condominium has the same maximum loan limit as a one-unit detached house in the same county.\n\n**Note**: While the loan limits are the same, condominiums must meet additional FHA requirements, such as being in an FHA-approved condominium project, but this doesn't affect the maximum loan amount available.",
     "extracted": "$498,257",
     "correct": true,
     "invented_value": false
    }
   ]
  }
 ],
 "summary": [
  {
   "model": "claude-haiku-4-5-20251001",
   "condition": "no_source",
   "n": 30,
   "correct": 8,
   "errors": 0,
   "by_rule": {
    "fhfa-conforming-loan-limits-2026": "1/6",
    "fha-forward-loan-limits-2026": "1/6",
    "cfpb-hoepa-qm-thresholds-2026": "2/6",
    "va-funding-fee-2023-04-07": "1/6",
    "fha-annual-mip-ml-2023-05": "3/6"
   },
   "absence_correct": 5,
   "absence_n": 5,
   "absence_invented": 0
  },
  {
   "model": "claude-sonnet-4-5-20250929",
   "condition": "no_source",
   "n": 30,
   "correct": 9,
   "errors": 0,
   "by_rule": {
    "fhfa-conforming-loan-limits-2026": "1/6",
    "fha-forward-loan-limits-2026": "1/6",
    "cfpb-hoepa-qm-thresholds-2026": "2/6",
    "va-funding-fee-2023-04-07": "2/6",
    "fha-annual-mip-ml-2023-05": "3/6"
   },
   "absence_correct": 5,
   "absence_n": 5,
   "absence_invented": 0
  }
 ],
 "regraded": "2026-10-11: absence detector made robust to markdown bold and to abstention phrasing; answers unchanged"
}