Initial import NDC_1C

2026-03-26 10:38:25 +03:00
commit a162d77ef7
2943 changed files with 3615871 additions and 0 deletions
@@ -0,0 +1,19 @@
+# Benchmark Final Verdict
+
+## Verdict
+
+`adopt_ready_for_pilot`
+
+## Key numbers
+
+- Questions total: `35`
+- Route mismatches: `1`
+- Degraded answers: `0`
+- Avg latency ms: `705.63`
+- p95 latency ms: `1571.9`
+
+## Recommendation
+
+1. Fix ontology unknown mapping hotspots.
+2. Tune heavy-route threshold (`store_feature_risk` vs `batch_refresh_then_store`).
+3. Implement full production orchestration runtime.
@@ -0,0 +1,39 @@
+# Benchmark Questions (35)
+
+| ID | Class | Expected route | Question |
+| --- | --- | --- | --- |
+| Q01 | simple_factual | store_canonical | Сальдо счета 68.02 за июнь 2020? |
+| Q02 | simple_factual | live_mcp_drilldown | Документ по номеру и его ссылка. |
+| Q03 | simple_factual | store_canonical | Типовая проводка по реализации. |
+| Q04 | simple_factual | store_canonical | Контрагент с максимумом оборота. |
+| Q05 | simple_factual | store_canonical | Договоры топ-контрагента. |
+| Q06 | drilldown_explain | hybrid_store_plus_live | Объясни сальдо через движения. |
+| Q07 | drilldown_explain | live_mcp_drilldown | Почему проводка на этот счет? |
+| Q08 | drilldown_explain | live_mcp_drilldown | Цепочка документ -> проводки -> субконто. |
+| Q09 | drilldown_explain | live_mcp_drilldown | Источник регистра для строки движения. |
+| Q10 | drilldown_explain | live_mcp_drilldown | Почему выбрано это субконто3? |
+| Q11 | cross_entity | hybrid_store_plus_live | Свяжи документы покупателей и проводки. |
+| Q12 | cross_entity | hybrid_store_plus_live | Свяжи контрагентов, договоры и проводки. |
+| Q13 | cross_entity | store_canonical | Номенклатура, склад, обороты за июнь. |
+| Q14 | cross_entity | hybrid_store_plus_live | Регистр и первичный документ. |
+| Q15 | cross_entity | store_canonical | По счету: контрагенты и договоры. |
+| Q16 | period_trend | store_feature_risk | Обороты июня против мая. |
+| Q17 | period_trend | store_feature_risk | Недельные всплески в июне. |
+| Q18 | period_trend | store_feature_risk | Кто дал резкий рост активности. |
+| Q19 | period_trend | store_feature_risk | Аномальный рост расходных операций? |
+| Q20 | period_trend | store_feature_risk | Динамика НДС к соседним периодам. |
+| Q21 | anomaly_control | store_feature_risk | Нетипичные корреспонденции счетов. |
+| Q22 | anomaly_control | store_feature_risk | Незакрытые хвосты по расчетам. |
+| Q23 | anomaly_control | store_feature_risk | Дублирующиеся проводки. |
+| Q24 | anomaly_control | store_feature_risk | Пустые или странные субконто. |
+| Q25 | anomaly_control | store_feature_risk | Узлы с подозрительно большим degree. |
+| Q26 | heavy_analytical | batch_refresh_then_store | Полный риск-срез за июнь. |
+| Q27 | heavy_analytical | batch_refresh_then_store | Рейтинг риск-счетов. |
+| Q28 | heavy_analytical | batch_refresh_then_store | Рейтинг риск-контрагентов. |
+| Q29 | heavy_analytical | store_feature_risk | Baseline closed/open periods. |
+| Q30 | heavy_analytical | batch_refresh_then_store | Company anomaly summary. |
+| Q31 | ambiguous_fuzzy | store_feature_risk | Что по налогам и рискам? |
+| Q32 | ambiguous_fuzzy | store_feature_risk | Что странное в расходах? |
+| Q33 | ambiguous_fuzzy | store_feature_risk | Самые рисковые контрагенты? |
+| Q34 | ambiguous_fuzzy | hybrid_store_plus_live | Что с 68.02? |
+| Q35 | ambiguous_fuzzy | store_feature_risk | Проверить документы июня. |
@@ -0,0 +1,17 @@
+# Benchmark Route Analysis
+
+- Total mismatches: `1`
+
+## Route confusion matrix
+
+- `batch_refresh_then_store` -> batch_refresh_then_store:4
+- `hybrid_store_plus_live` -> hybrid_store_plus_live:5
+- `live_mcp_drilldown` -> live_mcp_drilldown:5
+- `store_canonical` -> store_canonical:6
+- `store_feature_risk` -> batch_refresh_then_store:1, store_feature_risk:14
+
+## Mismatch by class
+
+| Class | Mismatch count |
+| --- | --- |
+| period_trend | 1 |
@@ -0,0 +1,39 @@
+# Benchmark Run Report
+
+## Aggregate statistics
+
+| Metric | Value |
+| --- | --- |
+| questions_total | 35 |
+| avg_latency_ms | 705.63 |
+| median_latency_ms | 405 |
+| p90_latency_ms | 1562.0 |
+| p95_latency_ms | 1571.9 |
+| avg_context_size | 2435.37 |
+| live_route_count | 10 |
+| store_route_count | 20 |
+| batch_route_count | 5 |
+| route_mismatch_count | 1 |
+| degraded_answers_count | 0 |
+
+## Route distribution
+
+| Route | Count |
+| --- | --- |
+| batch_refresh_then_store | 5 |
+| hybrid_store_plus_live | 5 |
+| live_mcp_drilldown | 5 |
+| store_canonical | 6 |
+| store_feature_risk | 14 |
+
+## Question class distribution
+
+| Class | Count |
+| --- | --- |
+| ambiguous_fuzzy | 5 |
+| anomaly_control | 5 |
+| cross_entity | 5 |
+| drilldown_explain | 5 |
+| heavy_analytical | 5 |
+| period_trend | 5 |
+| simple_factual | 5 |
@@ -0,0 +1,27 @@
+# LLM-like Simulation Profile
+
+Simulation mode: `4o-mini-like` (controlled emulation)
+
+## Constraints
+
+- Store-first retrieval policy.
+- Compact planning and bounded context.
+- Limited live calls for drill-down only.
+- Avoid expensive heavy live scans.
+
+## Route timing baseline (ms)
+
+| Route | Planning | Retrieval | Generation | Context |
+| --- | --- | --- | --- | --- |
+| live_mcp_drilldown | 95 | 780 | 180 | 2900 |
+| store_canonical | 70 | 170 | 130 | 1700 |
+| store_feature_risk | 82 | 190 | 150 | 2200 |
+| hybrid_store_plus_live | 112 | 560 | 170 | 3050 |
+| batch_refresh_then_store | 135 | 1240 | 210 | 3600 |
+
+## Active run context
+
+- Slice window: `2020-06`
+- Refresh latest run: `6f6c622c254e4e79a86ccdbd140b1631`
+- Feature latest run: `c1daa35506474be19331f21cf663282a`
+- Risk latest run: `b167c610c8b84dd79ca0357e72422c7f`
@@ -0,0 +1,50 @@
+# Ontology & Mapping Audit
+
+## Core metrics
+
+| Metric | Value |
+| --- | --- |
+| entity_classes_total | 42 |
+| covered_entity_classes | 42 |
+| uncovered_entity_classes | 0 |
+| relation_types_total | 25 |
+| correctly_typed_relations | 1909 |
+| unknown_relations | 102 |
+| conflicting_mappings_count | 1 |
+| link_coverage_pct | 100.0 |
+| semantic_coverage_pct | 94.9279 |
+
+## Top problematic source entity types
+
+| Source entity | Unknown relations |
+| --- | --- |
+| DocumentJournal_БанковскиеВыписки | 30 |
+| DocumentJournal_ЖурналОпераций | 16 |
+| Document_СписаниеСРасчетногоСчета | 14 |
+| Document_РеализацияТоваровУслуг | 12 |
+| Document_СчетФактураВыданный | 8 |
+| Document_ОперацияБух | 5 |
+| AccumulationRegister_СтраховыеВзносыСведенияОДоходах_RecordType | 4 |
+| DocumentJournal_КассовыеДокументы | 4 |
+| Document_РасходныйКассовыйОрдер | 4 |
+| AccumulationRegister_НДФЛСведенияОДоходах_RecordType | 3 |
+| AccumulationRegister_НДФЛПредоставленныеСтандартныеВычетыФизЛиц_RecordType | 1 |
+| Document_СчетНаОплатуПокупателю | 1 |
+
+## Top problematic relation fields
+
+| Source field | Unknown relations |
+| --- | --- |
+| ВидОперации | 34 |
+| Информация | 16 |
+| СубконтоДт1 | 15 |
+| Руководитель_Key | 8 |
+| ГлавныйБухгалтер_Key | 8 |
+| СпособЗаполнения | 5 |
+| ВидДохода_Key | 4 |
+| СтатьяДоходовИРасходовПоТаре_Key | 4 |
+| КодДохода_Key | 3 |
+| СубконтоДт2 | 3 |
+| КодВычета_Key | 1 |
+| СтруктурнаяЕдиница_Key | 1 |
+
@@ -0,0 +1,37 @@
+# Orchestration Policy Spec
+
+## Decision tree
+
+- exact object trace or posting chain -> `live_mcp_drilldown`
+- simple factual in loaded slice -> `store_canonical`
+- trend/anomaly/risk -> `store_feature_risk`
+- heavy whole-slice with freshness gap -> `batch_refresh_then_store`
+- low confidence fallback -> `hybrid_store_plus_live`
+
+## Routing rules
+
+- Prefer store answers when freshness allows.
+- Use live bridge only for drill-down evidence.
+- Do not run uncapped heavy live scans.
+- Trigger refresh/features/risk for stale context.
+- Apply retrieval/context budget before fallback.
+
+## Source priorities
+
+| Scenario | Priority order |
+| --- | --- |
+| simple_factual | canonical_store -> mcp_runtime_bridge |
+| drilldown_explain | mcp_runtime_bridge -> canonical_store |
+| period_trend | feature_store -> risk_store -> canonical_store |
+| anomaly_control | risk_store -> feature_store -> canonical_store |
+| heavy_analytical | batch_refresh_then_store -> feature_store -> risk_store |
+| ambiguous_fuzzy | feature_store -> canonical_store -> mcp_runtime_bridge |
+
+## Timeout budget (ms)
+
+| Budget | Value |
+| --- | --- |
+| planning | 200 |
+| retrieval_soft_limit | 1200 |
+| retrieval_hard_limit | 2500 |
+| response_generation | 600 |
@@ -0,0 +1,20 @@
+# Slice Ingestion Report
+
+Validation date: 2026-03-23T11:04:31.558207+00:00  
+Slice window: `2020-06` (`2020-06-01T00:00:00+00:00` -> `2020-07-01T00:00:00+00:00`)
+
+- Snapshot file: `logs\pre_report_snapshot_2020_2020-06_semantic_v2.json`
+- Profile file: `X:\1C\NDC_1C\logs\pre_report_activity_2020.json`
+- Snapshot entities: `409`
+- Snapshot links: `2011`
+- Refresh run id: `6f6c622c254e4e79a86ccdbd140b1631`
+- Entities written: `409`
+- Links written: `2011`
+- Checkpoints updated: `42`
+- Canonical entities total: `769`
+- Canonical links total: `3700`
+- Feature run status: `success`
+- Feature metrics written: `202`
+- Risk run status: `success`
+- Risk patterns written: `2`
+- Risk global score: `0.977351`