History

lekss361 7575999ad9 feat(tradein): backfill yandex listings.address with house number from detail page 3354 active yandex listings on prod (region 66) had street-only addresses like 'улица Горького' — Yandex valuation endpoint can't resolve them. Detail page <title> contains the full address with house number (e.g. 'Екатеринбург, улица Горького, 36'). Backfill script fetches /offer/<id>/ via curl_cffi chrome120 (plain httpx returns CSR shell), parses <title>, updates DB. Smoke verified: 5/5 enriched correctly. Idempotent (skip-recent + ON CONFLICT in downstream sweep). Rate-limited 3s default. --dry-run for safe preview.		2026-05-24 22:52:34 +03:00
..
backfill-house-imv.py	fix(tradein-phase-c): prepend region prefix for IMV geocoder (#540 )	2026-05-24 15:39:56 +00:00
backfill-yandex-addresses-ekb.py	feat(tradein): backfill yandex listings.address with house number from detail page	2026-05-24 22:52:34 +03:00
backfill_001_address_fingerprints.py	feat(tradein): Phase 1.3 backfill scripts — fingerprints + house/listing_sources (#475 )	2026-05-23 14:29:39 +00:00
backfill_002_house_sources.sql	feat(tradein): Phase 1.3 backfill scripts — fingerprints + house/listing_sources (#475 )	2026-05-23 14:29:39 +00:00
backfill_003_listing_sources.sql	feat(tradein): Phase 1.3 backfill scripts — fingerprints + house/listing_sources (#475 )	2026-05-23 14:29:39 +00:00
cian_backfill_all.sh	feat(tradein/cian): valuation backfill + runner script для prod (#539 )	2026-05-24 15:16:45 +00:00
probe-confidence-distribution.py	feat(tradein-estimator): unique-address-based confidence threshold (#513 )	2026-05-24 11:52:00 +00:00
probe-imv-by-address.py	feat(tradein-imv): retry with cleaned address + categorize errors (#505 )	2026-05-24 11:04:24 +00:00
README.md	feat(tradein): Phase 1.3 backfill scripts — fingerprints + house/listing_sources (#475 )	2026-05-23 14:29:39 +00:00
sweep-yandex-valuation-ekb.py	feat(tradein-sweep): --require-house-number filter (default on) (#536 )	2026-05-24 15:03:40 +00:00
upload-cian-cookies.sh	fix(tradein): убрать require_admin полностью — Caddy basic_auth достаточен (#474 )	2026-05-23 14:21:01 +00:00

README.md

tradein-mvp scripts -- backfill

One-shot manual operator scripts. NOT auto-applied by deploy.yml (which only runs tradein-mvp/backend/data/sql/NN_*.sql).

Order

Run in numbered sequence after PR #470 (matching module) merged:

cd tradein-mvp/backend
export DATABASE_URL="postgresql+psycopg://user:pass@host:5432/tradein"

# 001 -- backfill houses.address_fingerprint (Python, idempotent)
uv run python ../scripts/backfill_001_address_fingerprints.py

# 002 -- backfill house_sources link rows (SQL, idempotent)
psql "${DATABASE_URL/postgresql+psycopg/postgresql}" -f ../scripts/backfill_002_house_sources.sql

# 003 -- backfill listing_sources link rows (SQL, idempotent)
psql "${DATABASE_URL/postgresql+psycopg/postgresql}" -f ../scripts/backfill_003_listing_sources.sql

All scripts idempotent -- re-running is safe (ON CONFLICT DO NOTHING on the SQL; row-level UPDATE WHERE NULL on the Python).

Other scripts

upload-cian-cookies.sh -- one-shot Cian session cookie upload (see inline docs)