bot-backend
ed4662e37b
All checks were successful
CI / frontend-tests (push) Has been skipped
CI / changes (push) Successful in 7s
CI / backend-tests (push) Has been skipped
CI / openapi-codegen-check (push) Has been skipped
CI / changes (pull_request) Successful in 6s
CI / backend-tests (pull_request) Has been skipped
CI / frontend-tests (pull_request) Has been skipped
CI / openapi-codegen-check (pull_request) Has been skipped
Fix A: scale asyncio.wait_for timeout in run_yandex_city_sweep for combos/center mode. Old 240s budget was sized for one geo anchor; with 30 combos × 3 pages × ~21s each = ~1890s+ of work, sweep timed out at 240s producing lots_fetched=0. Now computes: sweep_timeout = max(240, num_combos * max_pages * (delay + 12) + 300) For default 30×3×(9+12)+300 ≈ 2190s. Explicit-anchor mode keeps 240s. Fix B: add scrape_pipeline.py to the `scraper` path filter in deploy-tradein.yml so changes to sweep logic trigger scraper container recreate. Previously only scrapers/** and scheduler.py were covered, meaning #1658 deploy didn't recreate the scraper container. Tests: 2 new unit tests for timeout computation (pure arithmetic, no sleep) + explicit-anchor mode regression (wait_for called with 240s). Full suite: 1844 passed, 2 deselected. |
||
|---|---|---|
| .. | ||
| exporters | ||
| matching | ||
| scrapers | ||
| __init__.py | ||
| account_quota.py | ||
| brand.py | ||
| cache.py | ||
| cian_price_history.py | ||
| cian_session.py | ||
| dadata.py | ||
| estimator.py | ||
| geocoder.py | ||
| house_imv_backfill.py | ||
| house_metadata.py | ||
| image_sanitizer.py | ||
| rosreestr_poll.py | ||
| sber_index.py | ||
| scheduler.py | ||
| scrape_pipeline.py | ||
| scrape_runs.py | ||
| scraper_settings.py | ||
| search_query.py | ||
| yandex_address_backfill.py | ||