8 commits

Author	SHA1	Message	Date
bot-backend	7ce758419a	feat(tradein): avito city-sweep — IMV enrichment phase (один прогон = SERP+detail+houses+IMV) ... Встраивает IMV-оценку домов как финальную фазу run_avito_city_sweep. Один запуск sweep'а теперь наполняет: listings (SERP) + detail-обогащение + houses (catalog/reviews/sellers) + IMV-оценку тронутых домов. - scrape_pipeline: добавлен enrich_imv param, CitySweepCounters.imv_attempted/ imv_enriched/imv_failed, PipelineResult.touched_house_ids (собирается при houses-enrichment из save_house_catalog_enrichment['house_id']). После всех anchor'ов — IMV-фаза: process_houses_imv_batch для touched_house_ids, cooperative cancel check, graceful per-house error handling (не валит sweep). - house_imv_backfill: добавлена process_houses_imv_batch — тонкая обёртка для обработки конкретного set[house_id] (пропускает imv_status=ok, дома без coords). - admin: CitySweepStartRequest.enrich_imv: bool = True + проброс в sweep. - tests: 14 новых тестов (enrich_imv=True/False, counters, cancel-before-IMV, IMV crash graceful, process_houses_imv_batch empty, API param).	2026-05-31 10:06:37 +03:00
bot-backend	01593be438	feat(scrapers): route cian sessions through mobile proxy (Refs #806) (#818) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 19:10:36 +00:00
bot-backend	950d0f60de	fix(tradein): sweep shared-session (SERP+detail) через mobile proxy (#623) (#805) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 18:07:37 +00:00
bot-backend	6762a532eb	feat(scrapers): wire N1.ru city sweep — pipeline + scheduler + admin endpoint (#575) (#745) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 15:43:38 +00:00
Light1YT	7ec19b3536	feat(scheduler): dormant Yandex Realty city-sweep (#561) (#642)	2026-05-29 08:50:10 +00:00
lekss361	222389cba9	fix(tradein/avito): anti-bot hardening — sleep + abort + shared session (#487)	2026-05-23 20:08:40 +00:00
lekss361	2914ff2ef2	feat(tradein): city sweep — auto ЕКБ pipeline (#477) ... Stage 4d: full city sweep ЕКБ (5 anchors × N pages + enrichment + cooperative cancel). - avito.py fetch_around(pages=N) — pagination backward compat default=1 - scrape_pipeline.run_avito_city_sweep — anchors loop + heartbeat + cancel check - scrape_runs.py utility (create/heartbeat/done/failed/cancelled/list_recent) - admin.py 3 endpoints: start (BackgroundTasks) / runs / cancel - migration 051 ADD COLUMN IF NOT EXISTS + DROP/ADD CHECK constraint (text+CHECK, не enum — safe в transaction) - deploy/avito-city-sweep.sh с random delay 0-3h (anti-pattern) - 16 offline tests Deep review approved: migration idempotent, cancel priority correct (mark_done guarded by status='running'), no SQL injection, psycopg v3 compliant.	2026-05-23 14:38:07 +00:00
lekss361	eb4764f75a	feat(tradein): scrape_pipeline.py — Avito full orchestrator (search → houses → detail) (#451)	2026-05-23 12:55:13 +00:00