Commit graph

5 commits

Author SHA1 Message Date
2e44f48291 feat(tradein/cian): promote kitchen/mortgage/apartments + normalize house_type (#2008)
All checks were successful
CI / openapi-codegen-check (pull_request) Has been skipped
CI / changes (pull_request) Successful in 7s
CI / backend-tests (pull_request) Has been skipped
CI / frontend-tests (pull_request) Has been skipped
Class B (дашборд покрытия / matching, НЕ valuation — estimator их пока не читает,
follow-up #2012): cian SERP теперь промоутит kitchen_area_m2 + mortgage_available и
новые колонки is_apartments / is_rosreestr_checked из карточки в listings (раньше
лежали только в raw_payload). Проведены через save_listings обоими upsert-путями
(ON CONFLICT EXCLUDED + reconcile UPDATE) через COALESCE — re-scrape источника без
поля не затирает значение.

Class A: house_type нормализуется через общий house_type_normalizer — cian
materialType (monolithBrick / gasSilicateBlock / stalin / ...) != каноничному enum
→ estimator soft-penalty ложно штрафовал аналог. Сырой materialType сохраняется в
raw_payload['raw_material_type']. Backfill старых cian-строк — миграция 141
(idempotent, scope source='cian', только мапимые camelCase токены).
2026-06-27 20:54:36 +03:00
1d5b081cb4 fix(cian): recover new-build house via cadastral anchor + listings (source,source_id) dedup (#1773) (#1912)
Some checks failed
Deploy Trade-In / changes (push) Successful in 13s
Deploy Trade-In / build-frontend (push) Has been skipped
Deploy Trade-In / build-browser (push) Has been skipped
Deploy Trade-In / test (push) Successful in 1m28s
Deploy Trade-In / deploy (push) Failing after 46s
Deploy Trade-In / build-backend (push) Successful in 50s
cian new-build cadastral anchor + listings (source,source_id) dedup (#1773): migration 133 (deep-reviewed data-loss-safe). Refs #1773
2026-06-26 07:45:22 +00:00
b1fb0c5711 feat(scrapers): cian SERP на BrowserFetcher (camoufox), снят code-side rotate (#1806)
All checks were successful
CI / changes (pull_request) Successful in 6s
CI / backend-tests (pull_request) Has been skipped
CI / frontend-tests (pull_request) Has been skipped
CI / openapi-codegen-check (pull_request) Has been skipped
2026-06-19 20:41:44 +03:00
08509b1b78 fix(scrapers): normalize cian descriptionMinhash list[int]→str + silent-0 guard (Refs #836) (#840)
Some checks failed
Deploy Trade-In / build-frontend (push) Has been skipped
Deploy Trade-In / changes (push) Successful in 5s
Deploy Trade-In / test (push) Failing after 25s
Deploy Trade-In / build-backend (push) Has been skipped
Deploy Trade-In / deploy (push) Has been skipped
Co-authored-by: bot-backend <bot-backend@gendsgn.local>
Co-committed-by: bot-backend <bot-backend@gendsgn.local>
2026-05-30 20:28:56 +00:00
4f0319297e feat(tradein): cian.py SERP refactor — state-based extraction (137 fields, no jitter) (#450)
All checks were successful
Deploy Trade-In / deploy (push) Successful in 19s
Deploy Trade-In / changes (push) Successful in 4s
Deploy Trade-In / build-frontend (push) Has been skipped
Deploy Trade-In / build-backend (push) Successful in 39s
2026-05-23 12:52:04 +00:00