991 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Light1YT	e9585bcd3b	test(suite): re-align drifted tests with current code (CI-rehab 2/3) ... Suite was uncollectable for a while → code evolved, mocks didn't (42 failed / 5 errors → 1687 passed / 0 failed / 0 errors). TEST-ONLY, no app code changed, no real bugs found (code-reviewed ✅ — no test weakened to fake-green). - best_layouts: sum_deals→deals_window rename; velocity-scaling direction for new SF-01 divisors (last_month=1.0/last_year=12.0) - quarter_dump_lookup: 7→10-tuple mock rows (risks/opportunity/red_lines cols); fix early-exit call-counts for the cad_zouit fallback (#232) - cadastre_bulk: add xmin/ymin/xmax/ymax to harvest-quarter db mock - nspd_client: add required QuarterDump.opportunity - TopLayoutRow: add required is_oversold - analyze_{market_price,recent_permits,inline_weights}: SQL-signature dispatch instead of fragile positional db.execute indices (SF-B5 query reorder; also fixes a double-POST geom-starvation false-negative) - custom_pois: move centroid >15km so center_bonus=0 isolates custom-POI delta - layout/report PDF: runtime WeasyPrint probe (skip macOS dev, RUN on CI) - mv_layout SQL: normalize +psycopg DSN + connectivity-probe skipif - admin token tests: skip (X-Admin-Token gate removed #437/#426; protection is Caddy basic_auth + RBAC, covered by test_rbac) Refs #944.	2026-06-03 19:05:43 +05:00
Light1YT	0247f13fb6	test(rbac): test-mode bypass so api/v1 suite can authenticate (CI-rehab 1/3) ... The whole backend api/v1 test suite hits `app` via TestClient mimo Caddy, so rbac_guard (app/main.py) 401'd every authed request (no X-Authenticated-User) — 112 tests red, the suite effectively dead (which is how #994's district 500 shipped uncaught). Add `settings.testing` (default False — prod RBAC untouched) + a strictly-gated bypass at the top of rbac_guard; tests/conftest.py enables it (env TESTING=1 + settings.testing=True before app import). Security: bypass fires ONLY when settings.testing is True, which is set NOWHERE in prod (default False; only tests/conftest.py flips it). RBAC's 401/403 logic stays covered by tests/test_rbac.py (its own middleware copy, ignores the flag). Effect: 112 → 42 failed, 1590 → 1660 passed. Remaining 42 (+5 mv_layout env errors) are stale-mock/assertion drift + env-required tests — fixed in CI-rehab 2/3. Foundation for a real Forgejo pytest gate (3/3). Refs #944.	2026-06-03 18:29:20 +05:00
Light1YT	c8ab3e8be9	fix(analyze): district KeyError 500 in #994 persist + revive by-bbox tests ... LIVE BUG (from #994, already merged): the analysis_runs persist call-site in analyze_parcel extracted district via result_payload["district"]["district_name"] — but a district dict without that key (real data: partial district lookup) raised KeyError OUTSIDE the best-effort SAVEPOINT (extraction is at the call site, not inside persist_analysis_run) → 500 on the LIVE /analyze endpoint. Fix: .get("district_name") → None instead of raising. Caught by reviving the analyze test suite (below). Test-infra (the suite was un-runnable, which is why the bug shipped): - Lazy-import WeasyPrint in layout_tz_pdf.py + trade_in_pdf.py (matches the existing report_pdf.py / snapshot_pdf.py pattern). The eager top-level imports made `app.main` (→ parcels/trade_in routers) un-importable on hosts without WeasyPrint native libs (e.g. macOS dev), breaking pytest COLLECTION of the whole api/v1 suite. WeasyPrint is still imported when a PDF is actually rendered. - tests/conftest.py: autouse fixture clears app.dependency_overrides after each test (anti-leak — a leaked get_db override caused real-DB connection attempts). - test_parcel_by_bbox.py: rewrite get_db mocking from patch("...get_db") (a no-op — FastAPI Depends holds the original ref) to app.dependency_overrides[get_db], add explicit X-Authenticated-User header (RBAC gate), patch latest_run_dates, + a new test asserting last_analysis_date from a latest run (#994). 5/5 green. NOTE: reviving collectability exposes PRE-EXISTING rot in other api/v1 suites (analyze/admin/best_layouts: RBAC-header + stale-assertion/mock drift) — those are NOT regressions from this PR (they were uncollectable before) and are tracked separately for a deliberate suite-rehab + CI test-gate effort. Refs #994.	2026-06-03 18:04:37 +05:00
Light1YT	72eae3bc9b	feat(parcels): persist analysis runs + real last_analysis_date (#994) ... Persist each successful POST /analyze into analysis_runs (migration 127): best-effort SAVEPOINT-wrapped INSERT in a thin analysis_runs repository, then explicit db.commit() (get_db has no commit-on-success; SAVEPOINT RELEASE alone does not persist — without the commit the row rolls back on request teardown, a silent no-op caught in code review). A persist failure never breaks the response or poisons the session. Result serialized via jsonable_encoder→ json.dumps (handles embedded Pydantic models/dates); confidence/status normalized to satisfy the 127 CHECK constraints (unknown→NULL/'complete'). Populate by-bbox last_analysis_date from v_analysis_runs_latest via a single batch query (no N+1), replacing the #307 placeholder. The read is best-effort wrapped too — a view-missing deploy window or future drift must not 500 the map (falls back to last_analysis_date=None). Additive only — analyze response shape unchanged. Tests: by-bbox suite patches latest_run_dates (mock-db returns same rows for any query) + new test asserts ISO last_analysis_date from a latest run. Analyze mock-suite unaffected (graceful side_effect overflow + best-effort persist absorb the extra INSERT). Incidental: ruff-format fixed one pre-existing f-string spacing (line ~2391) the format hook flags on touch. Closes #994. Refs #961.	2026-06-03 17:36:01 +05:00
Light1YT	0f194de069	feat(db): analysis_runs versioned store + latest-view §22 (#993) ... Migration 127: durable, versioned, re-openable persistence for Site Finder analysis runs (the §22 API result + forecast/recommendation/report snapshot). One row = one completed analysis of a parcel (frozen result jsonb = SiteFinderReport.as_dict() #987, schema_version for versioned re-open). Append-mostly (history/versioning — never overwrites prior runs → TABLE not MV). Replaces the last_analysis_date=None placeholder (parcels.py:1026,1092): "date of last analysis" + "current analysis of parcel" now come from v_analysis_runs_latest (DISTINCT ON cad_num, max created_at, deterministic id-DESC tiebreak — mirrors v_supply_layers_latest m.125). created_by = X-Authenticated-User identity, nullable TEXT, NO FK (no users table; precedent m.90/m.119; background/Celery runs have no author). result/ params/segment as JSONB (report shape evolves); district/confidence/status denormalized out for filter/sort. status + confidence CHECK-guarded. Idempotent (CREATE TABLE/INDEX IF NOT EXISTS + CREATE OR REPLACE VIEW). Dry-run-verified vs prod catalog (DDL applies clean in rolled-back txn; DISTINCT ON latest-wins confirmed). Foundation for #994 persist + #992 contract. Closes #993. Refs #961.	2026-06-03 17:14:47 +05:00
Light1YT	c06dc0f5d6	feat(db): Dom.РФ housing/escrow → macro_indicator §7.10 (#946, partial) ... Migration 126: aggregate already-scraped domrf_kn_sale_graph + domrf_kn_objects into monthly macro_indicator series (source=domrf): housing_price_per_m2 (area-weighted, latest-snapshot deduped — naive SUM double-counts 2.7x), new_contracts_volume (Σ contracted ДДУ/mo), escrow_objects_count (escrow FLAG, not balances — caveat documented). Regions sverdl (region_cd=66) + rf (all scraped — currently = sverdl, domrf_kn covers region 66 only). Idempotent ON CONFLICT DO UPDATE; dry-run-verified vs prod (price ~156k ₽/m², dedup 45792→16853, escrow 460). Pure SQL, data already scraped. EMISS CPI/income (§7.11) DEFERRED: fedstat.ru WAF-blocks non-browser clients (JA3) — needs stealth.py browser-fetch generalization (separate effort, low priority while §9.6 forecast is advisory). Refs #946.	2026-06-03 17:05:33 +05:00
bot-backend	e46993dfa8	feat(#978b): Source A + detrend in rate-sensitivity backtest (#1025)	2026-06-03 09:51:48 +00:00
bot-backend	6f06ca7f16	feat(forecasting): read-only OOS backtest of §9.6 rate-sensitivity (#978) (#1024)	2026-06-03 09:33:02 +00:00
bot-backend	12162a0abb	feat(exporters): Site Finder report PDF exporter (#989, 955-A3) (#1023)	2026-06-03 09:09:30 +00:00
bot-backend	299f2365fb	feat(exporters): Excel exporter for SiteFinderReport (#991, 955-A5) (#1022)	2026-06-03 08:57:00 +00:00
bot-backend	fc312fe606	feat(forecasting): §13 report assembler (#988, 955-A2) (#1021)	2026-06-03 08:51:23 +00:00
bot-backend	47fe5a55eb	feat(forecasting): §15 confidence engine v2 (#990, 955-A4) (#1020)	2026-06-03 08:41:07 +00:00
bot-backend	75c9b34987	feat(forecasting): §13 SiteFinderReport object (#987, 955-A1) (#1019)	2026-06-03 08:33:01 +00:00
bot-backend	008f9d9ed1	feat(forecasting): §25 six special indices (#986, 954-C) (#1018)	2026-06-03 08:24:08 +00:00
bot-backend	98dea0315a	feat(forecasting): §14.2 product scoring card (#985, 954-B) (#1017)	2026-06-03 08:11:54 +00:00
bot-backend	8057468c13	feat(forecasting): §11 macro-scenarios (#984, 954-A) (#1016)	2026-06-03 07:59:22 +00:00
bot-backend	691ccef4b7	feat(forecasting): class/commercial/USP §10.2/10.4/10.5 + §16 (#983, 953-B) (#1015)	2026-06-03 07:52:24 +00:00
bot-backend	72e9b24f2c	feat(recommend): horizon-aware recommend_mix opt-in overlay (#982, 953-A) (#1014)	2026-06-03 07:40:33 +00:00
bot-backend	489e380f1e	feat(forecasting): what-to-build ranker + MAI proxy (#981, 952-B) (#1013)	2026-06-03 07:07:17 +00:00
bot-backend	70ffa399fc	feat(forecasting): demand-supply forecast engine (#980, 952-A) (#1012)	2026-06-03 06:56:33 +00:00
bot-backend	9758e21cbd	feat(forecasting): §9.4 demand-normalization coefficient (#951f, advisory) (#1011)	2026-06-03 06:28:14 +00:00
bot-backend	69ad6c87fc	feat(forecasting): §9.5 macro coefficient (#951e, advisory) (#1010)	2026-06-03 06:20:04 +00:00
bot-backend	f41e2536d8	feat(forecasting): §9.6 key-rate sensitivity module (#951d, advisory) (#1009)	2026-06-03 06:06:16 +00:00
bot-backend	c7bfc9e22a	feat(forecasting): monthly sales series builder for §9.6 (#951c) (#1008)	2026-06-03 05:52:33 +00:00
bot-backend	ace3b99508	feat(forecasting): monthly macro series + regime classifier (#951b) (#1007)	2026-06-03 05:37:43 +00:00
lekss361	a10592847d	feat(site_finder): future-supply-pressure index (#950 Step 6) (#1006)	2026-06-03 05:10:08 +00:00
Light1YT	ae85f19993	feat(workers): supply-layers refresh task + weekly beat (#950 Step 5) (#1005)	2026-06-02 20:47:05 +00:00
Light1YT	900802264a	feat(site-finder): supply_layers v2 compute service (#950 EPIC6 step3+4) (#1004)	2026-06-02 20:34:26 +00:00
Light1YT	33ecbda689	feat(db): supply_layers store + latest view (#950 PR B) (#1003)	2026-06-02 20:21:04 +00:00
Light1YT	420cda2831	feat(domrf): persist domrf_kn_objects.free_flats (#950 PR A) (#1002)	2026-06-02 20:06:29 +00:00
Light1YT	59be55f80e	feat(site-finder): per-competitor relevance_weight (#949 PR B) (#1000)	2026-06-02 19:45:38 +00:00
Light1YT	45d61ecff0	feat(site_finder): market-metrics service (#949 PR A, §9.2) (#997)	2026-06-02 19:26:26 +00:00
Light1YT	c78c6ec2d0	feat(site-finder): live CBR key-rate scraper → macro_indicator (#945 PR B) (#964)	2026-06-02 19:05:57 +00:00
Light1YT	dbae4b0bda	feat(site-finder): macro_indicator table + backfill + reader (#945 PR A) (#963)	2026-06-02 18:41:28 +00:00
lekss361	6e2bb80690	Merge pull request 'fix(tradein): collapse CRM block + density so input form fits laptops' (#943) from fix/tradein-form-fit-laptops into main ... Reviewed-on: #943	2026-06-01 08:02:47 +00:00
bot-backend	702f322b22	fix(tradein): collapse CRM block + density so form fits laptops ... Форма ввода (10 полей + CRM-блок 221px) не помещалась в .form-card (max-height 100vh-104px) на ноутбуках: переполнение 58px @1440×900, ~158px @13" MacBook. CRM «для менеджера» теперь сворачиваемый (по умолчанию закрыт, открывается по клику) + лёгкое уплотнение отступов (.field 12→9, form-body/foot padding). Высота формы 854→646px → влезает без скролла на 1366×768 / 1440×900 / 13" MacBook @100%. Sub-720 — fallback на скролл-фикс из этой же ветки. Проверено вживую (injection) на проде, tsc --noEmit clean.	2026-06-01 10:58:43 +03:00
lekss361	8751fe819b	Merge pull request 'fix(tradein): praktika wordmark logo + form button cutoff on short viewports' (#942) from fix/tradein-praktika-logo-form-scroll into main ... Reviewed-on: #942	2026-06-01 07:18:49 +00:00
bot-backend	ed15559f80	fix(tradein): praktika wordmark logo + form button cutoff on short viewports ... Logo «поехало»: brands.logo_url хотлинкал квадратный знак logo-pink.svg (viewBox 69×69, preserveAspectRatio=none, без width/height) → CSS height:24/width:auto рендерил его 300×24 расплющенным. Self-host полного wordmark (символ #i-logo-new, viewBox 1498×194) в /trade-in/brands/praktika.svg; миграция 099 перенаправляет brands.logo_url; Topbar рендерит только wordmark (убран дублирующий текст-название); .brand-logo защищён object-fit:contain + max-width. Кнопка «Оценить» обрезалась @100% на 13" MacBook: .form-card max-height+overflow:hidden выдавливал .form-foot когда flex-shrink тела не срабатывал. Теперь скроллом владеет карточка (overflow-y:auto), body overflow-y:visible, foot flex-shrink:0. Проверено вживую на проде 1280×720.	2026-06-01 10:15:49 +03:00
lekss361	a23e650fae	fix(tradein): system-curl subprocess transport for Yandex SERP over SOCKS5 (#940) ... Co-authored-by: lekss361 <lekss361@gendsgn.local> Co-committed-by: lekss361 <lekss361@gendsgn.local>	2026-05-31 22:39:06 +00:00
bot-backend	921c14e054	feat(trade-in): OfferCard — убрать редактируемую цену + ползунок торга, разбивка на дефолтах (#939) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-31 22:31:20 +00:00
bot-backend	567549c3aa	feat(tradein): cian full-load secondary-only — drop novostroyki at parse (#938) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-31 21:35:32 +00:00
lekss361	d93e96fb0c	feat(tradein): checkpoint/resume for yandex full-load — survive restart (#930) (#937) ... Co-authored-by: lekss361 <lekss361@gendsgn.local> Co-committed-by: lekss361 <lekss361@gendsgn.local>	2026-05-31 21:34:23 +00:00
bot-backend	3294bc2021	fix(tradein): exclude novostroyki from radius-median comp pool (#935) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-31 21:33:23 +00:00
lekss361	571980c56e	feat(tradein): ppm²-tier segmentation of asking→sold ratio (#928, flag OFF) (#934) ... Co-authored-by: lekss361 <lekss361@gendsgn.local> Co-committed-by: lekss361 <lekss361@gendsgn.local>	2026-05-31 21:22:39 +00:00
bot-backend	846c5014c6	feat(tradein): checkpoint/resume for cian full-load — survive restart (#930) (#932) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-31 21:11:48 +00:00
lekss361	2bcccdf619	feat(tradein): exhaustive Yandex realty load — adaptive room×price + concurrency (#931) ... Co-authored-by: lekss361 <lekss361@gendsgn.local> Co-committed-by: lekss361 <lekss361@gendsgn.local>	2026-05-31 21:10:26 +00:00
bot-backend	5e94d558b5	perf(tradein): cian full-load incremental save + concurrent pagination (#929) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-31 20:27:27 +00:00
bot-backend	ecf8add2ce	fix(browser): pageError.location needs valid defaults, not just optional chaining (#918 follow-up) (#927) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-31 20:15:39 +00:00
bot-backend	0883f6d0f1	feat(tradein): exhaustive Cian EKB secondary load — room×price partitioning (#926) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-31 19:54:19 +00:00
lekss361	26c0b94131	Merge pull request 'fix(tradein): add cian_proxy_url to test _mock_settings — unblock deploy (#923)' (#925) from fix/cian-proxy-test-mock into main ... Reviewed-on: #925	2026-05-31 19:34:41 +00:00