1307 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
lekss361	7d8d12f5a6	Merge pull request 'fix(sql): v_supply_layers_latest keep dev_group_name in DISTINCT ON key (#1650)' (#1688) from fix/supply-view-devgroup-key-1650 into main	2026-06-17 17:55:31 +00:00
lekss361	435f7249d0	Merge pull request 'fix(scrapers): disambiguate EMISS yearly vs Q1 in dedup key (#1606)' (#1687) from fix/emiss-period-dedup-1606 into main	2026-06-17 17:55:27 +00:00
lekss361	b92d3aeb65	Merge pull request 'fix(forecasting): correct _geo_weight unknown floor so far projects rank low (#1633)' (#1685) from fix/geo-weight-floor-1633 into main	2026-06-17 17:55:17 +00:00
lekss361	a1adf2fd19	Merge pull request 'fix(forecasting): count non-zero observations in normalize guard (#1638)' (#1683) from fix/normalize-zero-fill-guard-1638 into main	2026-06-17 17:55:12 +00:00
lekss361	c0454d8905	Merge pull request 'fix(llm): INN redaction requires context anchor, stop eating large numbers (#1640)' (#1682) from fix/inn-regex-context-1640 into main	2026-06-17 17:55:06 +00:00
lekss361	e075f01870	Merge pull request 'fix(site-finder): robust is_residential_zone detection for NSPD zone codes (#1353)' (#1681) from fix/residential-zone-detect-1353 into main	2026-06-17 17:55:01 +00:00
lekss361	f826a37345	Merge pull request 'fix(parcels): _score_label honor «хорошо»=25→«отлично» boundary (#1357)' (#1680) from fix/score-label-threshold-1357 into main	2026-06-17 17:54:57 +00:00
lekss361	7d5962e7b4	Merge pull request 'fix(site-finder): normalize POI weighted score to 0..100 on backend (#1486)' (#1674) from fix/poi-score-scale-1486 into main	2026-06-17 17:54:52 +00:00
bot-backend	b534579e1b	fix(site-finder): correct POI-score mock shape+values, routing empty assert (#1486 review) ... - Rename top_poi → items in poi-score.json to match PoiScoreResponse TS type (mock was cast as PoiScoreResponse but had wrong field name → items undefined at runtime in MOCK_POI_SCORE mode → PoiList2Gis crashed at [...items].sort) - Recompute all score_contribution values using backend formula (weight / _MAX_STRAIGHT_SCORE * 100, _MAX_STRAIGHT_SCORE=0.315) and poi_weighted_score=19.9 (was 72, which was inconsistent with the new normalization) - Add assert result.poi_weighted_score == 0.0 to test_routing_decay_empty_db to match the straight-line empty-db assertion - Remove stale comment in PoiList2Gis.tsx saying normalization needs fixing in site-finder-api.ts (already done backend-side in this PR)	2026-06-17 20:47:01 +03:00
lekss361	ba83c36bf4	Merge pull request 'fix(sql): dedup deals-to-district assignment in ekb districts median refresh (#1352)' (#1678) from fix/district-median-dedup-1352 into main	2026-06-17 17:45:31 +00:00
lekss361	11fe22b49a	Merge pull request 'fix(cadastre): cad_territorial_zones MULTIPOLYGON typmod + ST_Multi coercion (#1344)' (#1673) from fix/cad-zones-multipolygon-1344 into main	2026-06-17 17:45:26 +00:00
lekss361	cf21ff76a9	Merge pull request 'fix(forecasting): cap trend_ratio by v_rec magnitude when v_prior==0 (#1508)' (#1679) from fix/trend-ratio-vprior-zero-1508 into main	2026-06-17 17:45:13 +00:00
lekss361	ea32f064c1	Merge pull request 'fix(site-finder): non-overlapping L2/L3 ready_dt windows, stop double-count of 13-24mo supply (#1355)' (#1677) from fix/supply-layers-overlap-1355 into main	2026-06-17 17:45:08 +00:00
lekss361	3dcddae647	Merge pull request 'fix(tradein): trade-in PDF cover uses estimate.expires_at, not hardcoded +30d (#1530)' (#1676) from fix/pdf-expires-at-1530 into main	2026-06-17 17:45:03 +00:00
lekss361	3ffba9f8a8	Merge pull request 'fix(analytics): align portfolio series to area buckets in quartirography (#1406)' (#1675) from fix/quartirography-area-bucket-1406 into main	2026-06-17 17:44:58 +00:00
lekss361	79c5068e96	Merge pull request 'fix(analytics): drop false market verdict from per-object Sold % KpiCard (#1407)' (#1672) from fix/sold-pct-market-verdict-1407 into main	2026-06-17 17:44:47 +00:00
bot-backend	e4975c486f	fix(forecasting): correct _geo_weight decay/floor so far projects get low weight (#1633) ... _GEO_WEIGHT_UNKNOWN was 0.1, which equals exp(−6.9/3)≈0.10 (weight of a confirmed-far project at ~6.9 km). Projects beyond that distance got a weight *below* 0.1, meaning unknown-coordinate projects outweighed confirmed-far ones — an inversion of the documented intent. Lowered to 0.05 (≈ exp(−3) = exp(−9 km / scale)), restoring the correct hierarchy: confirmed-close > confirmed-far > unknown. Updated TestGeoWeight (hardcoded 0.1 expectation) and TestCannibalizationTrueMode (overlap × floor comment/value) accordingly. Added two new assertions in TestGeoWeight that enforce the hierarchy monotonically and verify unknown < exp(−6.9/3).	2026-06-17 20:44:00 +03:00
bot-backend	5c5be890ab	fix(llm): INN redaction requires context/checksum, stop eating large numbers (#1640) ... _INN_RE now requires an explicit ИНН/inn keyword anchor (case-insensitive) within ~20 chars before a 10/12-digit block. Bare digit sequences without the keyword are no longer candidates — eliminates false-positives on large monetary amounts such as 1 200 000 000 (which coincidentally passes the ФНС checksum). Checksum validation is kept as a second gate to avoid redacting e.g. «ИНН 1234567890» with bad digits. _inn_repl updated to use match.group(1) (digit-only capture group) instead of the full match that now also includes the keyword prefix. 7 new regression tests in test_redaction.py: bare large numbers not redacted, keyword-cued real INNs (10/12 digit) still redacted, bad-checksum + keyword left intact, latin «inn:» accepted.	2026-06-17 20:41:39 +03:00
bot-backend	9dbfb03a3d	fix(scrapers): disambiguate EMISS yearly vs Q1 in dedup key (#1606) ... _YEAR_PERIODS ('год') → month=1 collided with Q1 ('I квартал') → month=1 for the same region/year: both produced obs_date=YYYY-01-01, so the second series in the XML silently overwrote the first in the in-memory by_key dict. Fix: add _emiss_period_granularity() and extend the dedup key from (region, obs_date) to (region, obs_date, granularity). 'year' and 'quarter' are now distinct slots, so both rows survive the parser and reach the upsert. Test: test_yearly_and_q1_both_survive_dedup verifies len==2 with both values present; test_period_granularity covers all classification branches.	2026-06-17 20:39:52 +03:00
bot-backend	494155654e	fix(forecasting): count non-zero observations in normalize guard, not zero-filled buckets (#1638) ... _count_full_years treated units=0 as a valid observation, so a series where fill_month_grid zero-filled every month still accumulated 3 full years and passed the _MIN_FULL_YEARS guard. Zero-filled months carry no seasonal signal, so they must be skipped in the year counter — the same way None values already were. Fix: skip v==0 alongside v is None in _count_full_years. Add four tests: zero-filled 36-month series → n_full_years=0/applied=False; partial-coverage years (only 6 non-zero months/year) → not counted as full; real non-zero series still passes guard; normalize_demand on zero-filled SalesSeries returns series unchanged.	2026-06-17 20:39:00 +03:00
bot-backend	986514be3e	fix(sql): v_supply_layers_latest keep dev_group_name in DISTINCT ON key (#1650)	2026-06-17 20:37:46 +03:00
bot-backend	3fd06228ff	fix(site-finder): robust is_residential_zone detection for NSPD zone codes (#1353) ... NSPD quarter-dump territorial_zones (layer 875838) does NOT store ПЗЗ letter codes in properties — zone_code receives the cadastral reg number ("66:41-7.14") or None, never a "Ж-1" style code. The old prefix check (startswith "Ж-"/"Ж1" …) therefore never matched real NSPD data, silently marking every dump-sourced parcel as non-residential (PZZ_NOT_RESIDENTIAL blocker). Fix: three-tier detection in is_residential_zone: 1. Regex ^Ж on zone_code — handles PKK6/pzz_zones_ekb sources ("Ж-1", "Жс") 2. NSPD subcategory from raw_props — subcategory=2 (Жилые зоны, 221 ЕКБ objects) and subcategory=3 (Смешанное использование, 126 objects) → residential; subcategory=1 (ИЖС) excluded — МКД not permitted there 3. zone_name substring "жил" — fallback for non-standard sources compute_gate_verdict now passes nspd_zoning["raw_props"] to is_residential_zone.	2026-06-17 20:33:48 +03:00
bot-backend	d0a409f873	fix(parcels): _score_label honor documented «хорошо»=25 threshold, close band gap (#1357)	2026-06-17 20:30:19 +03:00
bot-backend	cf36151dbc	fix(forecasting): cap trend_ratio by v_rec magnitude when v_prior==0 (#1508) ... When v_prior == 0 and v_rec > 0, the old code unconditionally assigned trend_ratio = 2.0, producing an artificial 2x jump even for districts with negligible recent velocity. New formula: ratio = 1.0 + min(1.0, v_rec / _REF_VELOCITY) * (_TREND_CAP_VPRIOR_ZERO - 1.0) Where: _REF_VELOCITY = 10.0 (monthly flats/corpus — EKB "well-performing" benchmark) _TREND_CAP_VPRIOR_ZERO = 1.5 (max ratio for the v_prior==0 case) Tiny v_rec (e.g. 1 flat/month) → ratio ≈ 1.05 (near neutral) Large v_rec (≥ 10 flat/month) → ratio → 1.5 (capped, below old hard 2.0) v_prior > 0 branch is unchanged. Also fixes pre-existing ruff violations in the same file (E401 multi-import, E701 inline colon, E722 bare except, F401 unused import) so ruff check passes clean.	2026-06-17 20:29:46 +03:00
bot-backend	04d1a64e25	fix(sql): dedup deals-to-district assignment in ekb districts median refresh (#1352) ... Replace ST_Intersects(district.geom, quarter.geom) with ST_Within(ST_Centroid(quarter.geom), district.geom) so each cadastral quarter is assigned to exactly one district. Eliminates 85 double-counted quarter-district pairs and 307 spurious deal-district rows that were skewing PERCENTILE_CONT medians. Function signature unchanged; no backend code changes required.	2026-06-17 20:29:34 +03:00
bot-backend	be68ba8f54	fix(site-finder): non-overlapping L2/L3 ready_dt windows, stop double-count of 13-24mo supply (#1355)	2026-06-17 20:29:09 +03:00
bot-backend	f8ea119d22	fix(tradein): trade-in PDF cover uses estimate.expires_at, not hardcoded +30d (#1530)	2026-06-17 20:27:57 +03:00
bot-backend	68eb6ded89	fix(site-finder): normalize POI weighted score to 0..100 on backend (#1486) ... Backend now computes poi_weighted_score and per-POI score_contribution in 0..100 range. Normalization denominator = sum of top-7 category weights / 100 (straight-line mode) or sum of top-7 category weights (routing-decay mode). Frontend stops reconstructing score from raw weight × 100.	2026-06-17 20:26:35 +03:00
bot-backend	26ae507c11	fix(analytics): align portfolio series to area buckets in quartirography (#1406) ... Switch portfolio source from domrf_region_aggregates (room_count_type ONE/TWO/THREE/FOUR) to domrf_flat_area_distribution (area_bucket FROM_0_TO_25…FROM_100), aggregated into the same 5 area buckets as the deals series. Both series now share the same axis and are directly comparable. Frontend portfolioMap simplified to direct bucket key lookup.	2026-06-17 20:25:17 +03:00
bot-backend	13327e5a2c	fix(cadastre): cad_territorial_zones MULTIPOLYGON typmod + ST_Multi coercion (#1344)	2026-06-17 20:23:56 +03:00
lekss361	18da92ccc7	Merge pull request 'fix(week-review): дожим — 4 фикса (#1569, #1590, #1642, #801)' (#1662) from fix/week-review-finish into main	2026-06-17 17:23:10 +00:00
bot-backend	66afac8bb3	fix(analytics): drop false market verdict from per-object Sold % KpiCard (#1407)	2026-06-17 20:22:29 +03:00
bot-backend	20efc3bf64	merge: resolve conflicts with main (#1660) into week-review-finish ... 5 conflicts resolved: - redaction.py: merged INN checksum + _PHONE_LOCAL_RE + _Repl alias from main - recommendation.py: kept commercial_sell_through_pct rename (#1635) - report_pdf.py: kept _scenario_deficit_cell + int|None return type (#1590) - parcel.py: kept main's detailed docstring (functionally identical) - alembic/env.py: kept HEAD (app.models import in __init__ already covers all)	2026-06-17 20:21:06 +03:00
bot-backend	14f3ef2019	fix(week-review): backend-аудит v2 — 82 фиксов (#1660) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-06-17 17:13:38 +00:00
lekss361	50db2b82aa	Merge pull request 'fix(site-finder): nearest_top3 metro from osm_poi_ekb (#1667)' (#1670) from fix/1667-metro-block into main	2026-06-17 17:13:17 +00:00
lekss361	e4b80938a0	Merge pull request 'docs(site-finder): analyze confidence by-design distinct from §15 (#1668)' (#1671) from fix/1668-analyze-confidence into main	2026-06-17 17:13:07 +00:00
lekss361	184e429526	Merge pull request 'fix(workers): schedule mv_layout_velocity refresh (#1666)' (#1669) from fix/1666-layout-velocity-beat into main	2026-06-17 17:12:54 +00:00
bot-backend	829f046852	feat(scripts): Potrace floor-plan vectorization spike (#299) (#1663) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-06-17 17:12:48 +00:00
Light1YT	d3a53ae475	docs(site-finder): clarify analyze confidence is by-design distinct from §15 (#1668) ... _compute_confidence docstring claimed "stub до G1/G2/D1/D2" — те эшелоны уже отгружены, формулировка устарела. Это намеренно отдельная метрика: надёжность site-finder скоринга (coverage POI/район/рынок), НЕ форсайтный §15 confidence_engine (надёжность прогноза спроса/цены над форсайт-входами, которых в analyze hot-path нет). Поведение не меняется — резолв документацией. Closes #1668	2026-06-17 18:47:07 +05:00
Light1YT	7072d7803e	fix(site-finder): compute nearest_top3 metro from osm_poi_ekb (#1667) ... Replace bare metro_block placeholder ({"nearest_top3": None}, blocked on a never-merged 22h metro scraper) with a direct KNN query against osm_poi_ekb category='metro_stop' (loaded by poi_loader). Returns 3 nearest stations with name + rounded distance_m; empty list when none nearby (vs None on error), SAVEPOINT + try/except like adjacent SF-B5 blocks. No frontend consumer yet. Closes #1667	2026-06-17 18:44:29 +05:00
Light1YT	7276edc885	fix(workers): schedule mv_layout_velocity refresh in Celery beat (#1666) ... mv_layout_velocity (powers best_layouts, #113) refreshed only via manual refresh_layout_velocity() → prod data silently went stale. Add Celery task mirroring refresh_quarter_price_index, register in celery_app include, add weekly beat entry (Sun 03:00 MSK, outside the monday heavy-refresh cluster). Closes #1666	2026-06-17 18:40:01 +05:00
Light1YT	764db61734	fix(exporters): annotate scenario deficit horizon in docx/pptx (#1590 follow-up) ... report_docx и report_pptx рендерили bare _scenario_deficit_index под захардкоженной шапкой «(12 мес)» — при fallback на другой горизонт подпись лгала. Переключил оба на _scenario_deficit_cell (как в report_md): per-cell аннотация «(гор. N мес)» при N != 12. Закрывает code-review major по #1590.	2026-06-17 14:35:48 +05:00
Light1YT	c9ba595abe	refactor(forecasting): rename commercial_share_pct → commercial_sell_through_pct (#1635) ... Внутренний recommendation→product_scoring контракт-ключ был мислейблом: величина — темп распродажи нежилого (sell-through, прокси ликвидности/спроса), а НЕ доля нежилого в объёме застройки. Переименован ключ + исправлены reason/docstring/комментарии у потребителя _score_commercial. Числовая логика не изменена. Ключ внутренний (нет frontend/schema/openapi-потребителей) → rename контракт-безопасен. pytest 171 passed. Closes #1635	2026-06-17 13:32:03 +05:00
lekss361	f8779c0812	feat(yandex): switch SERP scraping to JSON gate-API (bypasses bandwidth tarpit) (#1665)	2026-06-17 08:20:46 +00:00
lekss361	edaadc7685	Merge pull request 'fix(yandex): rotate proxy IP + retry on tarpit-timeout/captcha in combos sweep' (#1664) from fix/yandex-rotate-on-tarpit into main ... Reviewed-on: #1664	2026-06-17 07:13:48 +00:00
bot-backend	b19c4a0b8c	fix(tradein): yandex fetch_around rotate-on-tarpit + retry (combos sweep resilience) ... Add _YANDEX_TARPIT_MAX_RETRIES=2 constant and rewrite fetch_around with a loop: on status_code==0 (curl exit 28, bandwidth tarpit) or captcha detected, call _rotate_ip() + sleep(2s) and retry. Non-zero non-200 codes (404 etc.) return [] immediately without rotation. Mirrors the existing exhaustive-path pattern in _walk_price_range. 4 new unit tests cover: tarpit→rotate→success, captcha→rotate→success, exhausted retries→empty, 404→no-rotate.	2026-06-17 10:12:24 +03:00
Light1YT	249182b678	fix(week-review): дожим ревью — #1569, #1590, #1642 + feat #801 MSW-preview ... Финиш-волна по cross-file/partial остаткам аудита + a11y-харнесс. Полностью (4): #1569 alembic регистрирует все ORM-модели (+убран фантомный Parcel) · #1590 «Индекс дефицита» больше не лжёт на fallback-горизонте (report_pdf+report_md) · #1642 thumbs mtime-freshness (нет устаревшей миниатюры) · #801 /__preview/estimate mock-render для axe/lighthouse (env-gated bypass). Частично (остаток cross-file/домен, открыты): #1593 #1635 #1640. needs-leha (открыт): #1650 (нужна новая миграция вьюхи supply-слоёв). Verify: tsc --noEmit 0; py_compile OK. Closes #1569 Closes #1590 Closes #1642 Closes #801	2026-06-17 11:24:34 +05:00
lekss361	7a88964ef5	fix(avito): scale per-anchor timeout for detail-enrich + durable SERP counters (#1661)	2026-06-17 06:07:50 +00:00
lekss361	4811920d28	fix(tradein): yandex combos watchdog timeout (P0) + deploy scraper filter gap (#1659) ... Co-authored-by: lekss361 <lekss361@gendsgn.local> Co-committed-by: lekss361 <lekss361@gendsgn.local>	2026-06-16 20:22:27 +00:00
lekss361	e7901bc1e8	feat(tradein): yandex city sweep — EKB-center rooms×price combos (replaces 5-anchor shallow) (#1658)	2026-06-16 19:57:37 +00:00