211 commits

Author	SHA1	Message	Date
bot-backend	5d2af47b87	fix(tradein): cian SERP warm-up GET для seed cookies (_CIAN_GK/_yasc) (T2) (#846) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-31 06:01:30 +00:00
bot-backend	08509b1b78	fix(scrapers): normalize cian descriptionMinhash list[int]→str + silent-0 guard (Refs #836) (#840) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 20:28:56 +00:00
bot-backend	80a063b482	feat(observability): sentry alert on N consecutive scraper failures (Refs #827) (#833) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 20:10:29 +00:00
bot-backend	fd75f4d47a	perf(estimator): executemany batch insert in _save_yandex_history_items (Refs #826) (#832) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 20:07:06 +00:00
bot-backend	f7deed096b	fix(scrapers): avito per-card parse_failures counter + logging (Refs #823) (#830) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 20:01:50 +00:00
bot-backend	2739973285	fix(scrapers): COALESCE-backfill listing_date/area_m2 in save_listings ON CONFLICT (Refs #821) (#829) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 19:58:06 +00:00
bot-backend	01593be438	feat(scrapers): route cian sessions through mobile proxy (Refs #806) (#818) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 19:10:36 +00:00
bot-backend	7bd5a834dc	fix(tradein): cian _cianConfig concat-формат + auth из header-frontend (#639) (#819) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 19:08:01 +00:00
bot-backend	b736d7b7e0	feat(estimator): exclude city-centroid listings from radius analogs (Refs #769 Part E) ... Закрывает последнюю часть #769 (A1/A2/B/C/D в #798/#804). Finding #17: bare-city адреса геокодились в city-центроид и сохранялись как точные lat/lon → mislocated листинги участвовали в radius ST_DWithin-аналогах. - 089: ALTER TABLE listings ADD COLUMN IF NOT EXISTS geo_precision text (idempot). - ScrapedLot.geo_precision + проброс в save_listings. - geocode_missing.py: geo_precision='city' через существующий _geocode_is_coarse. - estimator _fetch_analogs Tier H+W: + AND (geo_precision IS DISTINCT FROM 'city'). NULL проходит (консервативно, сдвига до backfill нет). Pricing не тронут. 7 тестов; 270 passed, ruff clean.	2026-05-30 21:22:21 +03:00
bot-backend	950d0f60de	fix(tradein): sweep shared-session (SERP+detail) через mobile proxy (#623) (#805) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 18:07:37 +00:00
bot-backend	a9e4aecb54	fix(tradein): data-layer tail A2+B+C — trgm index, FDW options, matview refresh (Refs #769) (#804) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 17:40:54 +00:00
bot-backend	c76785308b	feat(scrapers/n1): извлекать floor/total_floors из ведущего N/M-токена (Refs #795) (#802) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 17:31:13 +00:00
bot-backend	4c275e04ea	fix(tradein): word-boundary street match + cian unescape robustness (Refs #769 A1+D) (#798) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 17:18:33 +00:00
bot-backend	87a5de0cae	feat(db): quarter_price_index FDW foreign table + monthly refresh (Refs #762) (#797) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 17:16:28 +00:00
bot-backend	3653f020b6	fix(ratio): ppm² потолок asking→sold в конфиг, default 1.2M (Refs #767) (#790) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 16:57:09 +00:00
bot-backend	38d44f46b7	fix(pdf): brand-spoof + median=0 empty-state + SSRF + дисклеймер + sources (Refs #772) (#789) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 16:55:56 +00:00
bot-backend	96027357b5	feat(tradein): Avito mobile proxy egress + firewall detect + MSK date (#623, #726) (#788) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 16:52:35 +00:00
bot-backend	8f2ff10a1c	fix(cian): verify_session на curl_cffi impersonate — ban != cookies expired (Refs #768) (#785) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 16:40:54 +00:00
bot-backend	ec84637abf	fix(estimator): expected_sold guard listings_clean → median_price>0 (Refs #773) (#784) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 16:39:08 +00:00
bot-backend	30ae4841a4	fix(scrapers): yandex area из embedded-state JSON (Refs #775) (#783) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 16:38:12 +00:00
bot-backend	489666c735	fix(tradein): avito content-block (HTTP-200) не маскируется под end-of-pagination (Refs #754) (#779) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 16:28:23 +00:00
bot-backend	bcd035034a	fix(tradein): SSRF host-allowlist на admin scrape + удалён dead ADMIN_TOKEN (Refs #756) (#778) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 16:27:19 +00:00
bot-backend	9954f4962f	fix(tradein): /sales-vs-listings street_only не house_linked (Refs #757) (#777) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 16:26:08 +00:00
bot-backend	79a79004cf	fix(scrapers): stable dedup_hash — drop price_rub + strip URL query (Refs #753) (#761) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 16:10:27 +00:00
bot-backend	2226b16cd3	fix(scheduler): atomic _claim_run via advisory xact lock (Refs #750) (#752) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 16:04:33 +00:00
bot-backend	a74591d7cc	fix(tradein): atomic conditional quota increment — close TOCTOU (#747) (#749) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 15:52:34 +00:00
bot-backend	6762a532eb	feat(scrapers): wire N1.ru city sweep — pipeline + scheduler + admin endpoint (#575) (#745) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 15:43:38 +00:00
bot-backend	34a13d71c3	fix(tradein): sync n_analogs to anchor count when anchor drives headline (#695) (#739) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 15:25:35 +00:00
bot-backend	2b3eb0b23d	fix(tradein): confidence_explanation no longer contradicts counters (#695) (#738) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 15:10:31 +00:00
bot-backend	83f3d70859	docs(tradein): clarify n_analogs vs analogs[] top-10 cap (#698) (#737) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 15:00:48 +00:00
bot-backend	ef7b5f8c54	feat(tradein): insufficient_data flag on AggregatedEstimate (#697) (#734) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 14:40:04 +00:00
bot-backend	066fab11d3	fix(tradein): sanitize ДКП deal outliers (floor / ppm²) (#699) (#733) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 14:31:44 +00:00
bot-backend	e94929159b	fix(scrapers): avito listing_date from sortTimeStamp JSON (#726) (#729) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 14:13:38 +00:00
bot-backend	575d9abbf7	feat(tradein): add data_quality flag to /sales-vs-listings (#721) (#723) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 13:21:08 +00:00
bot-backend	a79cf7d5e0	fix(tradein): coarse-geo downgrade no longer shielded by Tier C anchor (#693) (#720) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 12:34:11 +00:00
bot-backend	0e2bba78b7	fix(tradein): coarse-geo downgrade works without DaData on prod (#693) (#718) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 12:08:56 +00:00
bot-backend	466774dbd8	fix(tradein): rehydrate POST-only fields on GET /estimate/{id} (#696) (#710) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 11:05:52 +00:00
bot-backend	cffc91a1d8	test(tradein): fix /houses test broken by IDOR guard — unblock deploy (#690) (#709) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 09:34:31 +00:00
bot-backend	961a3caf2b	fix(tradein): surface same-building comps as analogs when anchor fires (#694) (#708) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 09:21:20 +00:00
bot-backend	9d94beae4f	fix(tradein): flag coarse-geo estimates as low-confidence (#693) (#707) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 08:58:23 +00:00
bot-backend	737599e690	fix(tradein): scope GET /estimate/{id} + /pdf to owner, close IDOR (#690) (#702) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 08:56:51 +00:00
bot-backend	f04728297b	fix(tradein): run same-building anchor without radius analogs (#691) (#704) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 08:34:24 +00:00
bot-backend	705eebfca3	feat(tradein): enrich /estimate response for web map, distribution, exposure & trend (#685) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 07:32:40 +00:00
bot-backend	f43d593cf6	feat(tradein): brand-by-account + result IA redesign (distinct asking/sale prices) (#683) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 06:45:14 +00:00
bot-backend	6fac54642a	fix(tradein): distinct asking median vs expected-sold price (no double-discount) (#682) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 06:35:46 +00:00
bot-backend	3361e434d4	feat(tradein): refine same-building anchor for within-building heterogeneity (#681) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 05:49:46 +00:00
bot-backend	351ec88104	fix(tradein): feed raw payload.address to same-building anchor (geocode-independent) (#680) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-29 23:17:09 +00:00
bot-backend	b5c26d2723	fix(tradein): harden same-building anchor address normalizer for prod formats (#677) (#679) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-29 22:21:29 +00:00
bot-backend	03a3296332	feat(tradein): same-building anchor estimator (#651/#652 v2) behind flag (#677) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-29 21:01:21 +00:00
bot-backend	be63b249b5	chore(tradein): close pre-commit ruff gap + add CI pytest gate (#666) (#675) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-29 19:18:48 +00:00