12 commits

Author	SHA1	Message	Date
bot-backend	f65c33413c	fix(tradein): avito house-link из detail SSR — SERP-карточка JS-only (#871) ... SERP-карточка отдаёт house-link («узнать больше о доме») только после client-side JS → в SSR-HTML, который тянет curl_cffi, его нет (verified live: SERP SSR 0/41 vs rendered DOM 21/60) → avito house-enrich мёртв (unique_houses=0 всегда). Detail-страница в SSR house-link содержит, а её мы и так фетчим для top-N. - avito_detail.py: house_catalog_url extraction fallback с nd-jk-details-button (новостройки) на любой a[href*='/catalog/houses/'] (вторичка) + strip ?context. - scrape_pipeline.py: Step 5b — энричим дома, найденные через detail-страницы (дедуп против SERP-derived Step 4). - test: secondary-маркер без nd-jk + query strip. Closes #871	2026-05-31 11:24:12 +03:00
bot-backend	10b4b02446	fix(tradein): cian sweep houses-phase — JOIN house_sources + graceful (не fatal) (#868) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-31 07:59:26 +00:00
bot-backend	60353beaaf	feat(tradein): yandex city-sweep — один прогон SERP+address-enrich (#867) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-31 07:43:13 +00:00
bot-backend	f2a123e2aa	feat(tradein): cian city-sweep — один прогон SERP+detail(+price-history)+houses (#864) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-31 07:24:34 +00:00
bot-backend	d78ae9f649	feat(tradein): avito city-sweep — IMV-фаза (один прогон = SERP+detail+houses+IMV) (#861) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-31 07:09:42 +00:00
bot-backend	01593be438	feat(scrapers): route cian sessions through mobile proxy (Refs #806) (#818) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 19:10:36 +00:00
bot-backend	950d0f60de	fix(tradein): sweep shared-session (SERP+detail) через mobile proxy (#623) (#805) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 18:07:37 +00:00
bot-backend	6762a532eb	feat(scrapers): wire N1.ru city sweep — pipeline + scheduler + admin endpoint (#575) (#745) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 15:43:38 +00:00
Light1YT	7ec19b3536	feat(scheduler): dormant Yandex Realty city-sweep (#561) (#642)	2026-05-29 08:50:10 +00:00
lekss361	222389cba9	fix(tradein/avito): anti-bot hardening — sleep + abort + shared session (#487)	2026-05-23 20:08:40 +00:00
lekss361	2914ff2ef2	feat(tradein): city sweep — auto ЕКБ pipeline (#477) ... Stage 4d: full city sweep ЕКБ (5 anchors × N pages + enrichment + cooperative cancel). - avito.py fetch_around(pages=N) — pagination backward compat default=1 - scrape_pipeline.run_avito_city_sweep — anchors loop + heartbeat + cancel check - scrape_runs.py utility (create/heartbeat/done/failed/cancelled/list_recent) - admin.py 3 endpoints: start (BackgroundTasks) / runs / cancel - migration 051 ADD COLUMN IF NOT EXISTS + DROP/ADD CHECK constraint (text+CHECK, не enum — safe в transaction) - deploy/avito-city-sweep.sh с random delay 0-3h (anti-pattern) - 16 offline tests Deep review approved: migration idempotent, cancel priority correct (mark_done guarded by status='running'), no SQL injection, psycopg v3 compliant.	2026-05-23 14:38:07 +00:00
lekss361	eb4764f75a	feat(tradein): scrape_pipeline.py — Avito full orchestrator (search → houses → detail) (#451)	2026-05-23 12:55:13 +00:00