bot-backend
40c044e2a6
All checks were successful
CI / changes (push) Successful in 7s
CI / backend-tests (push) Has been skipped
CI / frontend-tests (push) Has been skipped
CI / openapi-codegen-check (push) Has been skipped
CI / changes (pull_request) Successful in 6s
CI / backend-tests (pull_request) Has been skipped
CI / frontend-tests (pull_request) Has been skipped
CI / openapi-codegen-check (pull_request) Has been skipped
- Compute _avito_anchor_timeout = ANCHOR_TIMEOUT_SEC + detail_top_n * 50s + 180s (houses). Eliminates false TimeoutError on anchors with many detail requests. - Refactor run_avito_city_sweep to use inner _avito_anchor_phases coroutine (mirrors Yandex/Cian pattern): counters updated immediately after SERP+save (nonlocal), before detail phase. TimeoutError in detail no longer erases lots_fetched/inserted. - Add consecutive-detail-timeout abort after 5 consecutive TimeoutErrors. - Update test_anchor_watchdog: new tests for timeout scaling formula and counter durability. - Update test_avito_anti_bot + test_sweep_imv_phase: patch AvitoScraper.fetch_around directly (run_avito_city_sweep no longer calls run_avito_pipeline); use ExitStack instead of starred-expression unpacking (invalid syntax in Python 3.12/3.14). |
||
|---|---|---|
| .. | ||
| exporters | ||
| matching | ||
| scrapers | ||
| __init__.py | ||
| account_quota.py | ||
| brand.py | ||
| cache.py | ||
| cian_price_history.py | ||
| cian_session.py | ||
| dadata.py | ||
| estimator.py | ||
| geocoder.py | ||
| house_imv_backfill.py | ||
| house_metadata.py | ||
| image_sanitizer.py | ||
| rosreestr_poll.py | ||
| sber_index.py | ||
| scheduler.py | ||
| scrape_pipeline.py | ||
| scrape_runs.py | ||
| scraper_settings.py | ||
| search_query.py | ||
| yandex_address_backfill.py | ||