gendesign/tradein-mvp/backend/tests/scrapers
bot-backend a9f71686a9 perf(tradein): cian full-load incremental save + concurrent pagination
Save-at-end → save per leaf-bucket (краш/бан больше не теряет накопленное).
Параллельная пагинация бакета (asyncio.gather + semaphore, concurrency=5) +
снижен delay floor (1.5s, выделенный прокси) → кратное ускорение. on_bucket
callback коммитит в БД сразу; cancel проверяется per-bucket.
2026-05-31 23:19:46 +03:00
..
__init__.py fix(tradein/avito): anti-bot hardening — sleep + abort + shared session (#487) 2026-05-23 20:08:40 +00:00
test_avito_anti_bot.py fix(tradein): sweep shared-session (SERP+detail) через mobile proxy (#623) (#805) 2026-05-30 18:07:37 +00:00
test_browser_fetcher.py fix(browser): local camoufox + HTTP wrapper, drop broken playwright WS server (#905) 2026-05-31 18:25:00 +03:00
test_cian_exhaustive.py perf(tradein): cian full-load incremental save + concurrent pagination 2026-05-31 23:19:46 +03:00
test_domclick.py fix(tradein): domklik source name, scraper delay, DataDome block detect (#796 fixup) 2026-05-31 17:21:30 +03:00