perf(tradein): cian full-load incremental save + concurrent pagination #929

Merged

bot-reviewer merged 2 commits from feat/cian-fullload-fast-incremental into main

2026-05-31 20:27:28 +00:00

Author	SHA1	Message	Date
bot-backend	2ebc3eeead	fix(tradein): drop undefined _cancelled assign in cian-full-load cancel path Review #929: _cancelled was removed earlier in the PR but a stray assignment remained → NameError on every cooperative cancel (common exit path). Variable unused; mark_done is called unconditionally next line.	2026-05-31 23:24:42 +03:00
bot-backend	a9f71686a9	perf(tradein): cian full-load incremental save + concurrent pagination Save-at-end → save per leaf-bucket (краш/бан больше не теряет накопленное). Параллельная пагинация бакета (asyncio.gather + semaphore, concurrency=5) + снижен delay floor (1.5s, выделенный прокси) → кратное ускорение. on_bucket callback коммитит в БД сразу; cancel проверяется per-bucket.	2026-05-31 23:19:46 +03:00

Author

SHA1

Message

Date

bot-backend

2ebc3eeead

fix(tradein): drop undefined _cancelled assign in cian-full-load cancel path

Review #929: _cancelled was removed earlier in the PR but a stray assignment
remained → NameError on every cooperative cancel (common exit path). Variable
unused; mark_done is called unconditionally next line.

2026-05-31 23:24:42 +03:00

bot-backend

a9f71686a9

perf(tradein): cian full-load incremental save + concurrent pagination

Save-at-end → save per leaf-bucket (краш/бан больше не теряет накопленное).
Параллельная пагинация бакета (asyncio.gather + semaphore, concurrency=5) +
снижен delay floor (1.5s, выделенный прокси) → кратное ускорение. on_bucket
callback коммитит в БД сразу; cancel проверяется per-bucket.

2026-05-31 23:19:46 +03:00