gendesign/backend
Light1YT 1f490b7915 feat(forecasting): read-only OOS backtest of §9.6 rate-sensitivity (#978)
Add scripts/backtest_rate_sensitivity.py — STRICTLY READ-ONLY out-of-sample
validation gate for the §9.6 engine (#1009). Monthly sold-units from Source B
(objective_lots) EKB-wide + per class, aligned to monthly key_rate, time-ordered
holdout (fit oldest 70%, test newest), point-in-time OOS directional hit-rate +
in-sample-vs-OOS honesty block + per-tier lift + coin-flip+lag-stability verdict.
Deterministic, no LLM, no DB writes. CLI --since/--holdout-frac/--classes/--json.
36 unit tests on synthetic.

VERDICT (run vs prod 2026-06-03): EKB-wide OOS hit-rate 0.148 (< 0.5 coin-flip),
lag unstable → §9.6 engine NOT OOS-validated → stays ADVISORY. Likely confounded
by Source B survivorship bias (recent-month inflation → spurious trend); clean
re-validation needs Source A depth (13mo now, deepens weekly) or survivorship
correction. The harness re-validates when data improves.
2026-06-03 14:32:18 +05:00
..
alembic ops: alembic baseline, pre-commit, TIGER cleanup, pg_dump scripts 2026-04-26 13:08:51 +03:00
app feat(exporters): Site Finder report PDF exporter (#989, 955-A3) (#1023) 2026-06-03 09:09:30 +00:00
db/init ops: alembic baseline, pre-commit, TIGER cleanup, pg_dump scripts 2026-04-26 13:08:51 +03:00
output feat(geo): NSPD bulk-fetcher без Playwright + resume-friendly UI 2026-05-11 08:53:28 +03:00
scripts feat(forecasting): read-only OOS backtest of §9.6 rate-sensitivity (#978) 2026-06-03 14:32:18 +05:00
tests feat(forecasting): read-only OOS backtest of §9.6 rate-sensitivity (#978) 2026-06-03 14:32:18 +05:00
.dockerignore fix(scraper): диагностируем «кнопка не работает» — Redis lock + task_received log 2026-04-28 23:17:42 +03:00
.env.example refactor(security): убрать X-Admin-Token (Caddy basic_auth достаточен) (#437) 2026-05-23 10:41:22 +00:00
.env.runtime.example sprint1: nspd scraper industrialization, per-bucket elasticity, cadastre cross-check, sentry releases 2026-04-30 21:51:19 +03:00
alembic.ini ops: alembic baseline, pre-commit, TIGER cleanup, pg_dump scripts 2026-04-26 13:08:51 +03:00
debug.log feat(geo): NSPD bulk-fetcher без Playwright + resume-friendly UI 2026-05-11 08:53:28 +03:00
Dockerfile fix(scraper): диагностируем «кнопка не работает» — Redis lock + task_received log 2026-04-28 23:17:42 +03:00
pyproject.toml feat(rbac): role-based access control via X-Authenticated-User middleware (#585) 2026-05-26 06:18:40 +00:00
uv.lock feat(rbac): role-based access control via X-Authenticated-User middleware (#585) 2026-05-26 06:18:40 +00:00