1.1 KiB
1.1 KiB
Address V1 Acceptance Pack (Draft)
Дата: 2026-03-29
Required files in run folder
README.mdrun_summary.jsonaddress_case_matrix.mdchat_export_address_live.mddebug_payloads/live_call_inventory_address.jsonbefore_after_metrics.jsonlimitations_register.md
Minimal metrics
address_mode_routing_accuracyaddress_intent_resolution_raterequired_filter_resolution_ratelive_call_success_ratefactual_non_empty_ratefalse_factual_rate
Two mandatory suites
A) Runtime/Routing suite
Checks:
- mode routing;
- intent resolution;
- query shape detection;
- limited reason taxonomy;
- no false factual.
B) Positive Evidence suite
Checks:
- non-empty factual responses on pre-selected known-positive live cases;
- recipe-level positive yield;
- anchor resolution quality for counterparty/contract/account.
Acceptance targets (V1)
address_intent_resolution_rate >= 0.9live_call_success_rate >= 0.9false_factual_rate = 0- no deep-analysis regression
- known-positive factual hit-rate must be tracked separately from broad dry-run prompts