69 commits

Author	SHA1	Message	Date
bot-backend	a9a489bba5	refactor(tradein): убрать dead listing_segment param из _fetch_anchor_comps + негативные guard-asserts (review fixup, #1186) ... - Удалён параметр listing_segment: str | None = None из сигнатуры _fetch_anchor_comps (guard хардкожен в SQL-блоках Tier A/C, параметр не использовался) - Убраны seg_counts / target_segment в caller-блоке SAME-BUILDING ANCHOR (~L2174) - Docstring Tier C обновлён: «вторичка-канон guard (#1186): NULL = legacy вторичка» - test_segment_guard_1186.py: добавлены 4 негативных assert'а: · no bare = 'vtorichka' без IS NULL OR · no deprecated <> / != 'novostroyki' form · _fetch_anchor_comps не содержит listing_segment в сигнатуре · Tier C не использует CAST(:segment AS text) (параметрическую форму)	2026-06-12 12:01:00 +03:00
bot-backend	b70ae46885	fix(tradein): guard listing_segment во всех читателях listings — novostroyki вне comps (#1186) ... Канон-предикат: (listing_segment IS NULL OR listing_segment = 'vtorichka') NULL = legacy вторичка до миграции 011 (sweep'ы были secondary-only) — отбрасывать нельзя. Затронуты все SELECT-пути, влияющие на оценку и корректирующие коэффициенты: - estimator.py: _COMMON_WHERE (Tier S/H), Tier W inline, Tier A anchor (добавлен впервые), Tier C anchor (заменён с параметрического CAST(:segment) на канон — прежний вариант отбрасывал NULL-строки при segment='vtorichka'). - asking_to_sold_ratio.py: ask_side, ask_global (_REDERIVE_SQL); bounds (_REDERIVE_BOUNDS_SQL); ask_tiered, ask_side_all, ask_global (_REDERIVE_TIERED_SQL) — 6 мест. - sber_index.py: reconciliation-запрос (диагностический asking-median). Не затронуты: скрейперы/scrape_pipeline, search matview (catalog display, не оценка), admin stats, geocoding, cian price history, matching — обосновано в инвентаризации. Тесты: новый test_segment_guard_1186.py (статика SQL + поведение mock); обновлён test_asking_to_sold_ratio.py (subset-тест нормализует guard, добавленный в refresh но отсутствующий в 080-seed).	2026-06-12 11:52:09 +03:00
bot-backend	3294bc2021	fix(tradein): exclude novostroyki from radius-median comp pool (#935) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-31 21:33:23 +00:00
lekss361	571980c56e	feat(tradein): ppm²-tier segmentation of asking→sold ratio (#928, flag OFF) (#934) ... Co-authored-by: lekss361 <lekss361@gendsgn.local> Co-committed-by: lekss361 <lekss361@gendsgn.local>	2026-05-31 21:22:39 +00:00
lekss361	4999c877ae	feat(tradein): СберИндекс time-adjust for frozen Rosreestr ДКП + per-dashboard filter fix (#794) (#919) ... Co-authored-by: lekss361 <lekss361@gendsgn.local> Co-committed-by: lekss361 <lekss361@gendsgn.local>	2026-05-31 18:48:22 +00:00
bot-backend	42de30cd5c	refactor(tradein): unify kadastr_num -> cadastral_number (#732) ... p3 naming-consistency (cadastral cols 0% filled). Migration 094_cadastral_unify.sql (idempotent DO-block IF EXISTS): drop+recreate listings_search_mv (MV) + v_data_quality (view), RENAME deals/house_metadata kadastr_num->cadastral_number, DROP listings.kadastr_num + listings_kadastr_idx. Code SQL-string renames in search_query/estimator/base (Lot dataclass field NOT renamed). 240 tests pass. WARN: destructive DDL auto-applies to prod on deploy -> MERGE-GATE post-demo. Reviewer: verify recreated MV/view DDL vs LIVE pg_get_viewdef before apply (reconstructed from migration history 050/046, not live capture). Refs #732	2026-05-31 15:41:52 +03:00
bot-backend	ec82742456	feat(tradein): same-building anchor safe-guard (#755) ... CLIENT-VISIBLE pricing (killer-factor, demo 2026-06-01). The same-building anchor replaced headline median/range/confidence with an over-confident premium on as few as 2 same-building asking comps. Human-chosen (Anton) 3-part safe-guard, all implemented: 1. min_comps 2 -> 4: anchor fires only with >=4 same-building comps. 2. confidence cap: at <5 anchor comps, confidence cannot be 'high' -> medium. 3. MAD-clip: drop price_per_m2 outliers among anchor comps before aggregation (k=estimate_sb_mad_k=3.5); if <min_comps survive, anchor does NOT fire (fallback to radius-median). Guards against price typos inflating anchor. Anchor still REPLACES the headline (uplift-no-replace variant NOT chosen). quarter-index/radius-tier/asking-sold untouched. 8 new unit tests; 61 anchor tests pass, ruff clean. MERGE-GATE (client-visible, like #764/#858): do NOT merge without a green backtest #763 (held-out MAPE <= 18.7% + canonical A/B Малышева 125 / Заводская 44а). Backtest needs live DB — pre-merge human/qa step. Refs #755, #694	2026-05-31 12:19:50 +03:00
bot-backend	3f31d1f409	fix(estimator): sanity-clamp quarter-index factor (#859) (#863) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-31 07:20:59 +00:00
bot-backend	b16a45ef87	feat(tradein): per-cadastral-quarter price index in estimator (#764) (#858) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-31 06:53:21 +00:00
bot-backend	fd75f4d47a	perf(estimator): executemany batch insert in _save_yandex_history_items (Refs #826) (#832) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 20:07:06 +00:00
bot-backend	b736d7b7e0	feat(estimator): exclude city-centroid listings from radius analogs (Refs #769 Part E) ... Закрывает последнюю часть #769 (A1/A2/B/C/D в #798/#804). Finding #17: bare-city адреса геокодились в city-центроид и сохранялись как точные lat/lon → mislocated листинги участвовали в radius ST_DWithin-аналогах. - 089: ALTER TABLE listings ADD COLUMN IF NOT EXISTS geo_precision text (idempot). - ScrapedLot.geo_precision + проброс в save_listings. - geocode_missing.py: geo_precision='city' через существующий _geocode_is_coarse. - estimator _fetch_analogs Tier H+W: + AND (geo_precision IS DISTINCT FROM 'city'). NULL проходит (консервативно, сдвига до backfill нет). Pricing не тронут. 7 тестов; 270 passed, ruff clean.	2026-05-30 21:22:21 +03:00
bot-backend	4c275e04ea	fix(tradein): word-boundary street match + cian unescape robustness (Refs #769 A1+D) (#798) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 17:18:33 +00:00
bot-backend	ec84637abf	fix(estimator): expected_sold guard listings_clean → median_price>0 (Refs #773) (#784) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 16:39:08 +00:00
bot-backend	34a13d71c3	fix(tradein): sync n_analogs to anchor count when anchor drives headline (#695) (#739) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 15:25:35 +00:00
bot-backend	2b3eb0b23d	fix(tradein): confidence_explanation no longer contradicts counters (#695) (#738) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 15:10:31 +00:00
bot-backend	066fab11d3	fix(tradein): sanitize ДКП deal outliers (floor / ppm²) (#699) (#733) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 14:31:44 +00:00
bot-backend	a79cf7d5e0	fix(tradein): coarse-geo downgrade no longer shielded by Tier C anchor (#693) (#720) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 12:34:11 +00:00
bot-backend	0e2bba78b7	fix(tradein): coarse-geo downgrade works without DaData on prod (#693) (#718) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 12:08:56 +00:00
bot-backend	961a3caf2b	fix(tradein): surface same-building comps as analogs when anchor fires (#694) (#708) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 09:21:20 +00:00
bot-backend	9d94beae4f	fix(tradein): flag coarse-geo estimates as low-confidence (#693) (#707) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 08:58:23 +00:00
bot-backend	f04728297b	fix(tradein): run same-building anchor without radius analogs (#691) (#704) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 08:34:24 +00:00
bot-backend	705eebfca3	feat(tradein): enrich /estimate response for web map, distribution, exposure & trend (#685) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 07:32:40 +00:00
bot-backend	6fac54642a	fix(tradein): distinct asking median vs expected-sold price (no double-discount) (#682) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 06:35:46 +00:00
bot-backend	3361e434d4	feat(tradein): refine same-building anchor for within-building heterogeneity (#681) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 05:49:46 +00:00
bot-backend	351ec88104	fix(tradein): feed raw payload.address to same-building anchor (geocode-independent) (#680) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-29 23:17:09 +00:00
bot-backend	b5c26d2723	fix(tradein): harden same-building anchor address normalizer for prod formats (#677) (#679) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-29 22:21:29 +00:00
bot-backend	03a3296332	feat(tradein): same-building anchor estimator (#651/#652 v2) behind flag (#677) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-29 21:01:21 +00:00
bot-backend	96f02d37f3	feat(tradein): blend Avito IMV anchor into estimate + ДКП corridor advisory (#651, #652) (#674) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-29 17:42:06 +00:00
bot-backend	29679a9545	fix(tradein): time-budget estimate enrichment + observable errors to stop opaque 502 (#654) (#673) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-29 17:22:02 +00:00
bot-backend	47fdd6e4df	fix(tradein): scope GET /history to caller, close cross-pilot data leak (#656) (#670) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-29 15:59:03 +00:00
Light1YT	35bd0238ef	feat(tradein): estimator additive expected_sold price (#648 S3) (#661)	2026-05-29 13:37:33 +00:00
Light1YT	e4b5f14939	test(tradein): estimator pure-helper unit tests + fix None crash in _filter_outliers (#580) (#640)	2026-05-29 08:24:18 +00:00
Light1YT	d842811390	refactor(tradein): normalize repair_state raw→enum at ingest (#621) (#629)	2026-05-28 15:18:11 +00:00
Light1YT	33ee00c065	feat(tradein): калибровка repair-коэффициентов с base 1.0 (#7) ... _REPAIR_COEF → tunable market-эвристика: needs_repair=0.94, standard=1.00 (baseline no-op; было 0.98 — срезало 2% с каждой standard-оценки), good=1.05, excellent=1.10. Деривация из данных отклонена: listings.repair_state покрытие ~2%, сырые un-normalized значения, медианы confounded площадью (issue #7). + regression-тест (читает _REPAIR_COEF динамически — переживёт рекалибровку): ratio excellent/needs_repair, standard/None no-op, наличие/отсутствие note. Поправлен mislabeled comment над _IMV_HOUSE_TYPE_MAP. _IMV_REPAIR_MAP не тронут. code-reviewer: ✅ APPROVE no critical/minor. Tests: 5 new + 7 cian-integration. Ruff clean. Closes #7	2026-05-28 16:15:54 +05:00
Light1YT	492dd0aba6	feat(tradein): бейдж точности адреса (qc_geo) на карточке оценки (accuracy #1) ... Честность к пользователю: показываем насколько точно определён адрес — «до дома» / «до улицы» / «приблизительно» — рядом с confidence. - schemas/trade_in.py: address_precision: Literal["house","street","approximate"]|None - estimator.py: _qc_geo_to_precision (qc_geo 0→house, 1→street, ≥2→approximate, None→None), set в основном return + _empty_estimate - api/v1/trade_in.py: get_estimate + estimate_pdf теперь rehydrate'ят DaData-поля (canonical_address, house_cadnum, house_fias_id, address_precision, metro_nearest) из row — раньше на ?id= reopen / в PDF вся Q1-обогащёнка пропадала (поймал code-reviewer). Колонки уже persisted, фикс read-path. - frontend: AddressPrecision type + precision-badge в HeroSummary (.card-meta), токены --success/--accent-2/--bg-card-alt, без новых токенов. Канон: tech-analyst (план) → backend-engineer + frontend-engineer → code-reviewer (✅ APPROVE, поймал reopen-path gap) → fold-in fix. Tests: 7 passed, tsc clean, ruff clean. match_house_readonly wiring отложен (fast-follow).	2026-05-28 15:37:33 +05:00
Light1YT	30a80ee608	feat(tradein): same-building матчинг аналогов по house_id (#6) ... Estimator теперь резолвит target-адрес в КАНОНИЧЕСКИЙ house_id (read-only, без создания записи) и матчит аналоги по listings.house_id_fk — детерминированный Tier S «тот же дом» вместо хрупкого address-string prefix match. 99% листингов слинкованы с houses, поэтому это срабатывает уже сегодня и точнее работает между разнородными источниками (Avito/Cian/Yandex форматируют адрес по-разному). - matching/houses.py: match_house_readonly() — read-only target→house резолвер (cadastr_exact → fingerprint → geo_proximity 50m), без INSERT / house_sources / advisory lock. Возвращает None если уверенного match нет. - estimator.estimate_quality: после geocode+DaData резолвит target_house_id (cadastr от DaData → cadastr_exact заработает по мере backfill houses), graceful. - estimator._fetch_analogs: новый param target_house_id + канонический Tier S (WHERE house_id_fk = target) ПЕРЕД address-prefix Tier S (теперь fallback). tier label 'S' сохранён (frontend уже рендерит). Эффект: вместо «похожие в радиусе 800-1000м» — «вот что в ЭТОМ доме», прямой выигрыш в точности оценки. Foundation под cadastr/FIAS exact match (DaData Q1/Q3). Tests: 9 новых (match_house_readonly tiers + never-inserts + canonical Tier S fires/fallback/too-few). Ruff clean. Pre-existing 4 fail в test_estimator_source_quota (unpack 2≠3, красные на main до этого PR) — не затронуты.	2026-05-28 13:55:51 +05:00
Light1YT	a7fa1a4ffa	feat(tradein): DaData on-demand enrichment в estimate flow (PR Q1) ... Добавляет app/services/dadata.py — async client для DaData /clean/address, обогащающий target адрес canonical-формой, kadastr_num, ФИАС, координатами и ближайшим метро. Migration 069 расширяет trade_in_estimates 6 nullable колонками; estimator.estimate_quality вызывает service после geocode и сохраняет результат в основной INSERT. AggregatedEstimate отдаёт canonical_address / house_cadnum / house_fias_id / metro_nearest наружу. Service graceful: пустые credentials / quota 429 / 5xx / network fail → None, estimator продолжает работу. Demo tier 100 req/день — хватит для low-traffic prod и тестов. ENV: DADATA_API_TOKEN, DADATA_API_SECRET. Tests: 20 unit-тестов через httpx.MockTransport, zero real DaData calls. Покрыто: happy path, отсутствие creds, короткий адрес, timeout/network, HTTP 429/401/403/500/502/503, пустой массив, malformed shape, partial payload, coerce строковых qc-кодов в int, проверка request body+headers. Закладывает базу для PR Q2 (frontend DaData Suggest, 10k/день free) и PR Q3 (backfill 339 NULL-coords houses) — обе используют тот же сервис.	2026-05-27 18:50:12 +05:00
Light1YT	64e0d6f4e7	feat(tradein): estimator deals tier (PR M, #564 Phase 3) (#600)	2026-05-27 12:40:09 +00:00
lekss361	33c4c84467	feat(tradein): этаж/этажность optional + best test presets по deal count (#558)	2026-05-24 21:44:44 +00:00
lekss361	8c540ecec6	fix(tradein): extract_street_name handles Nominatim reverse format (#557)	2026-05-24 21:03:42 +00:00
lekss361	a63e459e25	feat(tradein): GET /street-deals — ДКП-сделки Росреестра по улице target адреса (#555)	2026-05-24 20:05:48 +00:00
lekss361	596842df8d	fix(tradein): filter ДКП-only in rosreestr importer + re-enable deals (#549)	2026-05-24 19:42:28 +00:00
lekss361	08cf615ad7	feat(tradein/cian): surface valuation chart + rent + change-pct on /trade-in (#530)	2026-05-24 14:32:54 +00:00
lekss361	c8675ce6e2	feat(yandex-valuation): link history rows to houses via match_or_create_house (#531)	2026-05-24 14:28:30 +00:00
lekss361	c6ab419100	feat(tradein-sql): bootstrap houses + link 98.8% of listings (Phase A+B) (#527)	2026-05-24 14:17:32 +00:00
lekss361	45ee0a2945	fix(tradein-estimator): extend cohort filter to Tier S + Tier H, fix late_soviet overlap (#522)	2026-05-24 13:14:59 +00:00
lekss361	7cc7fafeeb	feat(tradein-estimator): cohort filter + Tier 0 for analog selection quality (#519)	2026-05-24 13:04:58 +00:00
lekss361	a0d50bd282	feat(tradein-estimator): tiered house-match S→H→W (#507)	2026-05-24 12:41:12 +00:00
lekss361	6cda0cf8d3	fix(tradein-estimator): restore CAST in IS NOT NULL predicates (revert audit #9, prod fix) (#518)	2026-05-24 12:35:28 +00:00
lekss361	9402702f32	feat(tradein-estimator): unique-address-based confidence threshold (#513)	2026-05-24 11:52:00 +00:00