1628 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
lekss361	7639dfe5fd	Merge pull request 'fix(scrapers): avito pipeline — новостройки house graceful + AvitoBlockedError per-item не крашит прогон (#1820)' (#1822) from fix/avito-pipeline-novostroyki-blocks into main ... Reviewed-on: #1822	2026-06-20 06:57:55 +00:00
lekss361	dae2b5a5d9	Merge pull request 'fix(tradein/ui): убрать debug cache-key, гейт тонких графиков, разграничить динамику цен' (#1821) from fix/tradein-estimate-ui-cleanup-v2 into main ... Reviewed-on: #1821	2026-06-20 06:55:03 +00:00
bot-backend	cd91d5e279	fix(scrapers): avito pipeline — новостройки house graceful (без housePage), AvitoBlockedError per-item не крашит прогон (#1820)	2026-06-20 09:53:46 +03:00
bot-backend	237c18597f	fix(tradein/ui): убрать debug cache-key, гейт тонких графиков, дедуп динамики цен	2026-06-20 09:49:15 +03:00
lekss361	86f4602f1d	Merge pull request 'feat(tradein-frontend): единая scrapers-страница — табы, proxy-health+rotate, runs-история (scrapers UI Phase 1)' (#1819) from feat/scrapers-unified-page into main ... Reviewed-on: #1819	2026-06-20 06:40:55 +00:00
lekss361	3fa35be26e	Merge pull request 'feat(admin): unified scrape/runs + scraper/health + rotate-ip API (scrapers UI Phase 1)' (#1818) from feat/scraper-admin-apis into main ... Reviewed-on: #1818	2026-06-20 06:40:35 +00:00
bot-backend	dd339d3302	feat(tradein-frontend): единая scrapers-страница — табы Avito/Cian/Yandex, proxy-health+rotate, runs-история, консолидация триггеров, удалён cian-cookies редирект	2026-06-20 09:33:07 +03:00
bot-backend	2f88a71915	feat(admin): unified scrape/runs + scraper/health + rotate-ip API для единой scrapers-страницы	2026-06-20 09:25:57 +03:00
lekss361	faa1af9c56	Merge pull request 'fix(tradein/estimator): расширить corridor-clamp slack 0.25→0.40 для премиума без own-листингов' (#1817) from fix/tradein-corridor-slack-040 into main ... Reviewed-on: #1817	2026-06-20 06:19:13 +00:00
bot-backend	3cb11355e6	fix(tradein/estimator): расширить corridor-clamp slack 0.25→0.40 для премиума без own-листингов	2026-06-20 09:16:00 +03:00
lekss361	3ff4e067e2	Merge pull request 'fix(scrapers): avito_detail_backfill — снапшот ЕКБ+active, detail browser-only без curl-fallback на бан (#1814)' (#1815) from fix/avito-detail-backfill-ekb-browser-only into main ... Reviewed-on: #1815	2026-06-20 05:34:18 +00:00
bot-backend	37fc50ad08	fix(scrapers): avito_detail_backfill — снапшот ЕКБ+active, detail browser-only без curl-fallback на бан (#1814)	2026-06-19 21:58:35 +03:00
lekss361	2402287d64	Merge pull request 'feat(browser): per-provider page pacing + resource-block tuning — снизить proxy fan-out (#1812)' (#1813) from feat/browser-reduce-page-fanout into main ... Reviewed-on: #1813	2026-06-19 18:30:13 +00:00
bot-backend	59b5d15752	feat(browser): block font/media + per-provider page pacing — снизить proxy fan-out (#1812)	2026-06-19 21:28:09 +03:00
lekss361	ebdd70a38d	Merge pull request 'feat(scrapers): avito SERP дефолт на BrowserFetcher (camoufox), curl_cffi fallback (#1805)' (#1809) from feat/avito-serp-browser-default into main ... Reviewed-on: #1809	2026-06-19 17:53:12 +00:00
lekss361	65cec74cca	Merge pull request 'feat(scrapers): cian SERP на BrowserFetcher (camoufox), снят code-side rotate (#1806)' (#1810) from feat/cian-serp-browser into main ... Reviewed-on: #1810	2026-06-19 17:51:59 +00:00
lekss361	c88170b680	Merge pull request 'fix(tradein-frontend): Мера estimate — hydration #418 + photos 422 (#1803 #1804)' (#1808) from fix/mera-estimate-ui-artifacts into main ... Reviewed-on: #1808	2026-06-19 17:49:44 +00:00
bot-backend	cbc20cfe54	fix(tradein-frontend): Мера estimate — hydration #418 + photos 422 graceful (#1803 #1804) ... #1803 HeroTransparency: formatRuDateTime добавляет timeZone:"UTC" (SSR Node UTC vs клиент Europe/Moscow давали разный час → React minified error #418). Date.now() fallback (data_freshness_minutes без last_scraped_at) вынесен в useEffect/useState — не выполняется при SSR. #1804 PhotoUpload: guard isRealEstimateId() проверяет UUID4 regex и отклоняет preview-0000-... — GET/POST /photos с фейковым ID больше не слаются → нет 422. Счётчик показывает «— / 12» вместо «0 / 12», input disabled в preview-режиме.	2026-06-19 20:44:28 +03:00
bot-backend	93f7c9ae3f	feat(scrapers): avito SERP дефолт на BrowserFetcher (camoufox), curl_cffi fallback (#1805)	2026-06-19 20:42:04 +03:00
bot-backend	b1fb0c5711	feat(scrapers): cian SERP на BrowserFetcher (camoufox), снят code-side rotate (#1806)	2026-06-19 20:41:44 +03:00
lekss361	abbe0b871d	Merge pull request 'fix(tradein/estimator): clamp premium headline к коридору сделок + робастный anchor (#1795)' (#1807) from fix/tradein-estimator-premium-clamp-1795 into main ... Reviewed-on: #1807	2026-06-19 17:37:58 +00:00
bot-backend	494f2e00e0	fix(tradein/estimator): clamp premium headline к коридору сделок + робастный anchor (#1795)	2026-06-19 20:34:48 +03:00
lekss361	a534dece06	Merge pull request 'test(browser): удалить устаревшие pool-routing тесты (CI red после #1793)' (#1802) from fix/remove-obsolete-browser-pool-tests into main ... Reviewed-on: #1802	2026-06-19 17:13:50 +00:00
bot-backend	8467cc647f	test(browser): remove obsolete pool-routing tests (FEATURE_BROWSER_POOL_ENABLED/_build_proxy_map removed in #1793 per-provider rewrite; routing covered by browser/test_server.py)	2026-06-19 20:12:51 +03:00
lekss361	2e3291abc9	Merge pull request 'fix(scrapers): cian_detail — ceiling из offer.building.ceilingHeight, repair из decoration (#1791)' (#1800) from feat/cian-detail-field-mapping into main ... Reviewed-on: #1800	2026-06-19 17:07:14 +00:00
lekss361	95069a3daf	Merge pull request 'fix(scrapers): yandex_detail — area/ceiling/kitchen из INITIAL_STATE, покрытие area 63%→~95% (#1792)' (#1799) from feat/yandex-detail-field-coverage into main ... Reviewed-on: #1799	2026-06-19 17:07:02 +00:00
bot-backend	2d3ca78b0b	fix(scrapers): cian_detail — ceiling/repair актуальные пути state (#1791) ... ceiling_height на detail-странице лежит в offer.building.ceilingHeight, а не offer.ceilingHeight (всегда null) → было 0% покрытия. repairType часто пустой, структурное значение приходит как offer.decoration ('preFine'/...) — читаем оба + добавлен preFine->needs_repair и case-insensitive lookup в нормализаторе. kitchen/description пути уже верны (offer.kitchenArea/offer.description) — низкое покрытие = мёртвый CIAN_PROXY_URL, не маппинг. Регресс-тест на реальной карточке 330982715.	2026-06-19 19:57:18 +03:00
lekss361	7c9a3cf09d	Merge pull request 'fix(tradein-browser): camoufox hardening — block_images/webrtc + форс МСК tz (#1796)' (#1798) from fix/tradein-browser-camoufox-hardening into main ... Reviewed-on: #1798	2026-06-19 16:50:24 +00:00
bot-backend	b5f439a095	fix(tradein-browser): camoufox hardening — block_images/webrtc + forced MSK tz ... Со всеми знаниями из ресёрча camoufox (#1796 Avito anti-bot): - block_images=True — быстрее грузит (HTML/JSON, без рендера картинок). - block_webrtc=True — закрывает WebRTC-leak реального IP мимо прокси. - config timezone=Europe/Moscow — форсим +3 МСК: geoip+БэкКоннект (ротация IP на каждый запрос) давал геолик tz↔IP (Ульяновск UTC+4 при выходе МСК/СПб).	2026-06-19 19:49:14 +03:00
bot-backend	0084efc12a	fix(scrapers): yandex_detail — area/ceiling из структурного блока, покрытие area 63%->~95% (#1792)	2026-06-19 19:37:51 +03:00
lekss361	059fa83589	Merge pull request 'fix(scrapers): avito_houses — отзывы/история/тип ЖК долетают (виджет-payload вложен глубже) (#1789)' (#1797) from feat/avito-houses-mfe-state into main ... Reviewed-on: #1797	2026-06-19 16:27:03 +00:00
bot-backend	464e9faf7b	fix(scrapers): avito_houses читает MFE props-вложенность виджетов — отзывы/история/тип ЖК теперь долетают (#1789)	2026-06-19 19:21:49 +03:00
lekss361	4755f8bd13	Merge pull request 'feat(browser): per-provider concurrency — параллель между поставщиками, ≤1 коннект на поставщика (#1793)' (#1794) from feat/browser-per-provider-concurrency into main ... Reviewed-on: #1794	2026-06-19 16:02:13 +00:00
lekss361	fb7b3323e4	Merge pull request 'fix(tradein): verify=False для WFS геопортала ЕКБ (российский CA-серт)' (#1788) from fix/tradein-ekb-geoportal-ssl-verify into main ... Reviewed-on: #1788	2026-06-19 16:02:04 +00:00
bot-backend	1578dd5a5d	fixup(browser): source-fallback routing, lazy launch, test stability (#1793 review)	2026-06-19 19:00:10 +03:00
bot-backend	77ae4ca779	feat(browser): per-provider concurrency — параллель между поставщиками, ≤1 коннект на поставщика (#1793)	2026-06-19 18:52:55 +03:00
bot-backend	112e5cc2f1	fix(tradein): verify=False for EKB geoportal WFS (Russian-CA cert) ... The geoportal serves a Russian national-CA (Минцифры) TLS cert absent from httpx's default trust store → CERTIFICATE_VERIFY_FAILED, loader fetched 0. Public read-only data → verify=False (same as the curl -k used in recon).	2026-06-19 18:19:03 +03:00
lekss361	7494255180	Merge pull request 'fix(tradein): чинит main-red — патч _geoportal_house_match в cadastral-тесте (хвост #1786)' (#1787) from fix/tradein-geoportal-test-cadastral into main ... Reviewed-on: #1787	2026-06-19 15:07:31 +00:00
bot-backend	91b04a1851	test(tradein): patch _geoportal_house_match in cadastral-before-yandex test ... #1786 merged before the test fix landed → main red on test_geocode_uses_cadastral_before_yandex. The new geoportal house-match tier runs first in geocode(); this legacy cadastral test must mock it to None so it exercises the cadastral forward path (else the MagicMock db row leaks through the new tier as lat=1.0).	2026-06-19 18:06:28 +03:00
lekss361	7bf39e24df	Merge pull request 'fix(db): #1781 backfill listings.house_id_fk from house_sources (cian novostroyki)' (#1784) from fix/1781-cian-novostroyki-fk-backfill into main ... Reviewed-on: #1784	2026-06-19 14:56:09 +00:00
lekss361	84ceb9d300	Merge pull request 'feat(tradein): ингест зданий из геопортала ЕКБ + tier в геокодере (полный кадастр города)' (#1786) from feat/tradein-ekb-geoportal-buildings into main ... Reviewed-on: #1786	2026-06-19 14:55:43 +00:00
bot-backend	64d113d649	feat(tradein): EKB geoportal building ingest + geocoder tier (complete city buildings)	2026-06-19 17:51:07 +03:00
Light1YT	8adbbef88c	fix(db): #1781 backfill listings.house_id_fk from house_sources ... The realtime FK mirror (base.py:607-616) only landed 2026-06-17 (e63b21e). Listings matched into house_sources before that — notably 9205 cian novostroyki frozen at 2026-05-31 — never had house_id_fk mirrored back, breaking the canonical "same-building via house_id_fk" estimator path (93% of active cian novostroyki had NULL fk citywide). Add data/sql/130_backfill_listings_house_id_fk.sql: deterministic source-id backfill via house_sources (ext_source, ext_id → house_id), idempotent (WHERE house_id_fk IS NULL), no fuzzy/address fallback. Prod (read-only): 9235/9235 target rows resolve deterministically, zero unresolvable. One-time backlog drain; future rows linked in realtime by the e63b21e mirror.	2026-06-19 16:20:32 +05:00
lekss361	190accc4a7	Merge pull request 'feat(tradein): фронт передаёт координаты выбранной подсказки в /estimate (Variant A, frontend)' (#1783) from feat/tradein-estimate-send-coords into main ... Reviewed-on: #1783	2026-06-19 11:17:31 +00:00
lekss361	9701d3289d	Merge pull request 'feat(tradein): /estimate принимает координаты от автокомплита, минует geocode (Variant A, backend)' (#1782) from feat/tradein-estimate-accept-coords into main ... Reviewed-on: #1782	2026-06-19 11:16:51 +00:00
bot-backend	ce0aaa4fb1	feat(tradein): send picked autocomplete coords to /estimate (Variant A)	2026-06-19 14:16:08 +03:00
bot-backend	99e2a5d75c	feat(tradein): estimate accepts client-provided coords, skips geocode (Variant A)	2026-06-19 14:15:02 +03:00
lekss361	41b3f08303	Merge pull request 'fix(tradein): чинит кадастр-матчер геокодера — резолв адресов из своей базы (~60% упавших)' (#1780) from fix/tradein-cadastral-geocode-matcher into main ... Reviewed-on: #1780	2026-06-19 11:11:13 +00:00
bot-backend	c2a1dc8aeb	fix(tradein): parse street+house for cadastral geocode match (resolve ~60% of failing addresses from local DB)	2026-06-19 14:04:12 +03:00
lekss361	be3a5df8eb	Merge pull request 'fix(tradein): удалить white-label бренд «Практика» целиком (БД + маппинг + ассеты)' (#1779) from fix/tradein-remove-praktika-brand into main ... Reviewed-on: #1779	2026-06-19 10:09:38 +00:00