fix(scrapers): geocode-missing listings nightly scheduler — listings geom coverage backfill (all sources) #1549

Merged

lekss361 merged 2 commits from fix/geocode-missing-listings-scheduler into main

2026-06-16 08:32:23 +00:00

Author	SHA1	Message	Date
bot-backend	17fa6544a2	fix(geocode): set geocode_tried_at on successful geocode UPDATE All checks were successful CI / changes (push) Successful in 8s Details CI / backend-tests (push) Has been skipped Details CI / changes (pull_request) Successful in 6s Details CI / frontend-tests (push) Has been skipped Details CI / openapi-codegen-check (push) Has been skipped Details CI / backend-tests (pull_request) Has been skipped Details CI / frontend-tests (pull_request) Has been skipped Details CI / openapi-codegen-check (pull_request) Has been skipped Details Add geocode_tried_at = NOW() to the success UPDATE SET clause so successfully-geocoded listings record their attempt time, matching the per-ID admin endpoint contract and the column spec.	2026-06-16 10:07:51 +03:00
bot-backend	a56420bdfb	fix(tradein): wire nightly geocode backfill для listings в in-app scheduler All checks were successful CI / changes (push) Successful in 7s Details CI / backend-tests (push) Has been skipped Details CI / frontend-tests (push) Has been skipped Details CI / openapi-codegen-check (push) Has been skipped Details Root cause: 7674 avito/yandex/n1 listings з null-geom мають ненульовий address, але geocode_tried_at IS NULL — OS cron геокодує тільки deals, ніколи listings. Parts: - geocode_missing.py: WHERE додає geocode_tried_at IS NULL OR tried_at < 7d (loop-safe); при failure (geo=None / exception) позначаємо tried_at=NOW(). Новий run_geocode_missing_listings: batch loop з wall-clock budget (30m), update_heartbeat / mark_done / mark_failed lifecycle через scrape_runs. - scheduler.py: trigger_geocode_missing_listings_run + dispatch elif. - migration 110: seed scrape_schedules row (enabled=true, window 06-09 UTC). - tests: оновлено 2 тести (commit на tried_at UPDATE); +7 нових тестів. 1794 passed.	2026-06-16 10:01:49 +03:00