lekss361 1ccb44687c fix(scrapers): bypass DOM.РФ WAF + update renamed extras endpoints ... DOM.РФ накатил WAF между 2026-05-17 и 2026-05-24 на /сервисы/api/object/*/*. Без session cookies (___dmpkit___, domain_sid) — все запросы → 403 + WAF challenge HTML. Cookies выдаются после visit на /сервисы/каталог-новостроек/. Дополнительно DOM.РФ переименовал 6 endpoints (photos, 5 × doc_*) — старые URLs возвращают тот же WAF catch-all. Run 26 (2026-05-24): 15,340 fail requests (1534 obj × 10 endpoints). Extras snapshots не обновлялись с 2026-05-17. - stealth.py: BrowserSession.warm_up() — visit catalog listing, кэшит WAF cookies - domrf_kn.py: warm_up() перед Phase A/B/C (покрывает все extras запросы) - domrf_catalog_object.py: warm_up() перед SSR HTML fetch batch		2026-05-24 13:26:22 +03:00
..
cadastre	fix(#265 review): CRS 3857→4326 + stable zone_id hash + rename 102 + tx comment	2026-05-17 10:45:52 +03:00
etl	feat(etl): fuzzy matcher v2 — pruned threshold 0.85→0.80 for objective mapping coverage	2026-05-17 16:28:20 +03:00
exporters	feat(sf-b7): GET /parcels/{cad}/snapshot.pdf — 1-page WeasyPrint export (#334)	2026-05-17 21:11:03 +00:00
generative	deploy.yml: sync compose+Caddyfile from git, reload caddy after up	2026-04-26 13:31:26 +03:00
photos	fix ui lag	2026-04-27 20:26:55 +03:00
scrapers	fix(scrapers): bypass DOM.РФ WAF + update renamed extras endpoints	2026-05-24 13:26:22 +03:00
site_finder	feat(sf-b6): GET /parcels/{cad}/poi-score — weighted top-7 (#333)	2026-05-17 21:11:25 +00:00
__init__.py	init	2026-04-25 13:45:19 +03:00
analytics_queries.py	fix(22k): quartirography — use f.flat_type not f.type (column doesn't exist) (#312)	2026-05-17 16:09:00 +00:00
analytics_refresh.py	fix(scrape): SQLAlchemy text() парсил ':00:' regex как named-param	2026-04-30 23:16:11 +03:00
job_settings.py	fix(cadastre,nspd_sync): SQL syntax bugs surfaced by ekb_full v2 (#186)	2026-05-15 19:18:43 +03:00
objective_etl.py	fix(worker): port objective_etl from psycopg2 → psycopg v3	2026-05-11 12:07:57 +03:00
objective_sync_config.py	feat(objective): full sync pipeline + dynamic admin config	2026-05-10 19:54:15 +03:00