# LLM Normalizer v1.1 Eval Run

- run_id: eval-vHNdfS-Ccc
- timestamp: 2026-03-23T15:57:42.766Z
- mode: single-pass-strict
- use_mock: false
- cases_total: 30
- prompt_version: normalizer_v1_1_2

## Metrics vs Baseline

| Metric | Current | Baseline | Delta |
|---|---:|---:|---:|
| schema_validation_pass_rate | 100.00% | 100.00% | 0.00 |
| intent_class_accuracy | 96.67% | 72.73% | +23.94 |
| route_hint_accuracy | 100.00% | 90.91% | +9.09 |
| causal_flag_accuracy | 100.00% | 81.82% | +18.18 |
| high_confidence_error_rate | 0.00% | 9.09% | -9.09 |

## Class Accuracy

| Intent class | Passed/Total | Accuracy |
|---|---:|---:|
| cross_entity | 10/10 | 100.00% |
| heavy_analytical | 5/5 | 100.00% |
| drilldown_explain | 5/5 | 100.00% |
| rule_based_account_control | 5/5 | 100.00% |
| anomaly_probe | 2/2 | 100.00% |
| ambiguous_human_query | 1/1 | 100.00% |
| period_close_risk | 1/2 | 50.00% |

## Budget

- requests_total: 30
- retries_used: 0

## Mismatches

- V11-OT-005: expected(period_close_risk / batch_refresh_then_store) -> actual(heavy_analytical / batch_refresh_then_store). Route chosen correctly, but intent_class drifted into a neighboring taxonomy bucket.

## Bad Confidence Cases

No bad-confidence cases.
