gendesign/tradein-mvp/scripts
lekss361 136202dc80
All checks were successful
Deploy Trade-In / changes (push) Successful in 5s
Deploy Trade-In / build-backend (push) Has been skipped
Deploy Trade-In / build-frontend (push) Has been skipped
Deploy Trade-In / deploy (push) Successful in 32s
feat(tradein/scripts): local Playwright runners для Cian backfill (bypass server-IP anti-bot) (#553)
2026-05-24 20:00:59 +00:00
..
local-cian feat(tradein/scripts): local Playwright runners для Cian backfill (bypass server-IP anti-bot) (#553) 2026-05-24 20:00:59 +00:00
avito-playwright-sweep.py feat(tradein-scripts): scrapers + probes + Phase C improvements (#551) 2026-05-24 19:58:38 +00:00
backfill-house-imv.py feat(tradein-scripts): scrapers + probes + Phase C improvements (#551) 2026-05-24 19:58:38 +00:00
backfill-yandex-addresses-ekb.py feat(tradein-scripts): scrapers + probes + Phase C improvements (#551) 2026-05-24 19:58:38 +00:00
backfill_001_address_fingerprints.py feat(tradein): Phase 1.3 backfill scripts — fingerprints + house/listing_sources (#475) 2026-05-23 14:29:39 +00:00
backfill_002_house_sources.sql feat(tradein): Phase 1.3 backfill scripts — fingerprints + house/listing_sources (#475) 2026-05-23 14:29:39 +00:00
backfill_003_listing_sources.sql feat(tradein): Phase 1.3 backfill scripts — fingerprints + house/listing_sources (#475) 2026-05-23 14:29:39 +00:00
cian_backfill_all.sh feat(tradein/cian): valuation backfill + runner script для prod (#539) 2026-05-24 15:16:45 +00:00
inspect-houses-html.py feat(tradein-scripts): scrapers + probes + Phase C improvements (#551) 2026-05-24 19:58:38 +00:00
inspect-search-html.py feat(tradein-scripts): scrapers + probes + Phase C improvements (#551) 2026-05-24 19:58:38 +00:00
local-sweep-ekb-cian.py feat(tradein-scripts): scrapers + probes + Phase C improvements (#551) 2026-05-24 19:58:38 +00:00
local-sweep-ekb-yandex.py feat(tradein-scripts): scrapers + probes + Phase C improvements (#551) 2026-05-24 19:58:38 +00:00
local-sweep-ekb.py feat(tradein-scripts): scrapers + probes + Phase C improvements (#551) 2026-05-24 19:58:38 +00:00
probe-avito-1anchor.py feat(tradein-scripts): scrapers + probes + Phase C improvements (#551) 2026-05-24 19:58:38 +00:00
probe-confidence-distribution.py feat(tradein-estimator): unique-address-based confidence threshold (#513) 2026-05-24 11:52:00 +00:00
probe-db-counts.py feat(tradein-scripts): scrapers + probes + Phase C improvements (#551) 2026-05-24 19:58:38 +00:00
probe-db-leak-full.py feat(tradein-scripts): scrapers + probes + Phase C improvements (#551) 2026-05-24 19:58:38 +00:00
probe-db-region-leak.py feat(tradein-scripts): scrapers + probes + Phase C improvements (#551) 2026-05-24 19:58:38 +00:00
probe-db-url-leak.py feat(tradein-scripts): scrapers + probes + Phase C improvements (#551) 2026-05-24 19:58:38 +00:00
probe-imv-by-address.py feat(tradein-imv): retry with cleaned address + categorize errors (#505) 2026-05-24 11:04:24 +00:00
probe-migration-028.py feat(tradein-scripts): scrapers + probes + Phase C improvements (#551) 2026-05-24 19:58:38 +00:00
probe-migration-status.py feat(tradein-scripts): scrapers + probes + Phase C improvements (#551) 2026-05-24 19:58:38 +00:00
probe-parser-region-filter.py feat(tradein-scripts): scrapers + probes + Phase C improvements (#551) 2026-05-24 19:58:38 +00:00
README.md feat(tradein): Phase 1.3 backfill scripts — fingerprints + house/listing_sources (#475) 2026-05-23 14:29:39 +00:00
sweep-yandex-valuation-ekb.py feat(tradein-sweep): --require-house-number filter (default on) (#536) 2026-05-24 15:03:40 +00:00
test-playwright.py feat(tradein-scripts): scrapers + probes + Phase C improvements (#551) 2026-05-24 19:58:38 +00:00
upload-cian-cookies.sh fix(tradein): убрать require_admin полностью — Caddy basic_auth достаточен (#474) 2026-05-23 14:21:01 +00:00

tradein-mvp scripts -- backfill

One-shot manual operator scripts. NOT auto-applied by deploy.yml (which only runs tradein-mvp/backend/data/sql/NN_*.sql).

Order

Run in numbered sequence after PR #470 (matching module) merged:

cd tradein-mvp/backend
export DATABASE_URL="postgresql+psycopg://user:pass@host:5432/tradein"

# 001 -- backfill houses.address_fingerprint (Python, idempotent)
uv run python ../scripts/backfill_001_address_fingerprints.py

# 002 -- backfill house_sources link rows (SQL, idempotent)
psql "${DATABASE_URL/postgresql+psycopg/postgresql}" -f ../scripts/backfill_002_house_sources.sql

# 003 -- backfill listing_sources link rows (SQL, idempotent)
psql "${DATABASE_URL/postgresql+psycopg/postgresql}" -f ../scripts/backfill_003_listing_sources.sql

All scripts idempotent -- re-running is safe (ON CONFLICT DO NOTHING on the SQL; row-level UPDATE WHERE NULL on the Python).

Other scripts

  • upload-cian-cookies.sh -- one-shot Cian session cookie upload (see inline docs)