bot-backend
b19c4a0b8c
All checks were successful
CI / frontend-tests (push) Has been skipped
CI / openapi-codegen-check (push) Has been skipped
CI / changes (pull_request) Successful in 6s
CI / frontend-tests (pull_request) Has been skipped
CI / openapi-codegen-check (pull_request) Has been skipped
CI / changes (push) Successful in 8s
CI / backend-tests (push) Has been skipped
CI / backend-tests (pull_request) Has been skipped
Add _YANDEX_TARPIT_MAX_RETRIES=2 constant and rewrite fetch_around with a loop: on status_code==0 (curl exit 28, bandwidth tarpit) or captcha detected, call _rotate_ip() + sleep(2s) and retry. Non-zero non-200 codes (404 etc.) return [] immediately without rotation. Mirrors the existing exhaustive-path pattern in _walk_price_range. 4 new unit tests cover: tarpit→rotate→success, captcha→rotate→success, exhausted retries→empty, 404→no-rotate. |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| avito.py | ||
| avito_detail.py | ||
| avito_exceptions.py | ||
| avito_houses.py | ||
| avito_imv.py | ||
| base.py | ||
| browser_fetcher.py | ||
| cian.py | ||
| cian_detail.py | ||
| cian_newbuilding.py | ||
| cian_state_parser.py | ||
| cian_valuation.py | ||
| domclick.py | ||
| domclick_exceptions.py | ||
| repair_state_normalizer.py | ||
| snapshot_writer.py | ||
| yandex_detail.py | ||
| yandex_helpers.py | ||
| yandex_newbuilding.py | ||
| yandex_realty.py | ||
| yandex_valuation.py | ||