fix(scrapers): WAF-guard эндпоинтов + throttled catalog BrowserSession (#2445-D1/D2) #2459

Merged

bot-backend merged 2 commits from fix/catalog-waf-guard-throttle into main

2026-07-05 20:09:07 +00:00

Author	SHA1	Message	Date
bot-backend	987a929b09	chore(codegen): регенерация api-types.ts для i_understand_waf_risk (#2445-D1) All checks were successful CI Trade-In / changes (pull_request) Successful in 17s Details CI Trade-In / backend-tests (pull_request) Has been skipped Details CI Trade-In / frontend-checks (pull_request) Has been skipped Details CI / changes (pull_request) Successful in 7s Details CI / frontend-tests (pull_request) Successful in 57s Details CI / openapi-codegen-check (pull_request) Successful in 1m54s Details CI / backend-tests (pull_request) Successful in 14m45s Details	2026-07-06 00:53:08 +05:00
bot-backend	68d0575080	fix(scrapers): WAF re-trigger guard + throttled BrowserSession для DOM.РФ catalog (#2445-D1/D2) Some checks failed CI Trade-In / changes (pull_request) Successful in 12s Details CI / changes (pull_request) Successful in 11s Details CI Trade-In / backend-tests (pull_request) Has been skipped Details CI Trade-In / frontend-checks (pull_request) Has been skipped Details CI / frontend-tests (pull_request) Has been skipped Details CI / openapi-codegen-check (pull_request) Failing after 3m1s Details CI / backend-tests (pull_request) Successful in 15m39s Details D1: admin-эндпоинты /kn-catalog-objects + /kn-catalog-flats теперь требуют явный i_understand_waf_risk=true перед dispatch (иначе 400 со ссылкой на #2443), т.к. их beat отключён после WAF-бана 2026-05-24 и случайный re-trigger углубит бан. D2: обе catalog-BrowserSession (domrf_catalog_object.py + domrf_catalog.py flat-level) переиспользуют throttled settings.scrape_kn_* (concurrency=2, jitter 1200-3000ms, как scrape_kn после #1945) вместо молчаливого наследования дефолта stealth.py (concurrency=8, 600-1500ms). Обновлены устаревшие комментарии config.py/stealth.py. Refs #2445	2026-07-06 00:44:19 +05:00