eac5a49a3a
All checks were successful
CI Trade-In / changes (pull_request) Successful in 7s
CI / changes (pull_request) Successful in 8s
CI Trade-In / frontend-checks (pull_request) Has been skipped
CI / backend-tests (pull_request) Has been skipped
CI / frontend-tests (pull_request) Has been skipped
CI / openapi-codegen-check (pull_request) Has been skipped
CI Trade-In / backend-tests (pull_request) Successful in 50s
The СДЕЛКИ open-data portal moved off /opendata/ (Bitrix redesign); the old flat dataset URL now returns HTTP 200 with Content-Type text/html (soft-404) instead of 404, so check_new_quarter_available() falsely reported every quarter as available. /opendata/f.json also no longer serves JSON. Rewrite the check to parse the new https://rosreestr.gov.ru/data-sets/ Apache autoindex: decode each folder/file href as cp1251 percent-encoding (portal does not use utf-8), locate the target quarter folder and dataset_СДЕЛКИ file, then HEAD it and require Content-Type: application/zip AND Content-Length > 100 KB before treating it as available — a bare 200 is no longer sufficient. Also send a browser User-Agent and verify=False (RU TLS root CA, same pattern as sber_index.py) since rosreestr.gov.ru 403s plain httpx requests. Public signatures and the poll_rosreestr_new_quarter() return dict are unchanged. rosreestr_dataset_url() now builds a best-effort cp1251-encoded link into /data-sets/ (verified byte-for-byte against the live portal) for the alert message; detection itself never depends on this guess. |
||
|---|---|---|
| .. | ||
| exporters | ||
| matching | ||
| __init__.py | ||
| account_quota.py | ||
| brand.py | ||
| buildings_query.py | ||
| cache.py | ||
| cian_price_history.py | ||
| cian_session.py | ||
| dadata.py | ||
| domclick_session.py | ||
| estimator.py | ||
| gar_flats_loader.py | ||
| geocoder.py | ||
| house_dedup_merge.py | ||
| house_imv_backfill.py | ||
| house_metadata.py | ||
| image_sanitizer.py | ||
| location_coef.py | ||
| product_handlers.py | ||
| proxy_pool.py | ||
| rosreestr_poll.py | ||
| sber_index.py | ||
| scheduler.py | ||
| scrape_runs.py | ||
| scraper_adapters.py | ||
| scraper_settings.py | ||
| search_query.py | ||
| yandex_address_backfill.py | ||
| yandex_price_history.py | ||
| zhkh_flats_loader.py | ||