feat(scraper-kit): copy remaining sweep orchestrators (yandex/cian/domclick/full-load), strangler (#2135 F2) #2174

Merged
lekss361 merged 1 commit from feat/scraper-kit-pipeline-copy2 into main 2026-07-02 17:29:06 +00:00
Owner

Часть #2135 (Epic #2126, шаг F, второй срез). Завершает копирование pipeline-оркестрации. Strangler — боевой scrape_pipeline.py НЕ тронут, инертно.

Скопировано

Все 7 оставшихся sweep в scraper_kit/orchestration/pipeline.py: yandex/cian/domclick city_sweep + avito_newbuilding + 3 full_load. Развязка как F1 (config/matcher/enrichment/runs/providers); ban-rotation переиспользует _try_rotate_within_budget.

Contracts + adapter (синхронно, guard зелёный)

+3 метода в EnrichmentJobs (yandex price-history/address) + синхронизация RealEnrichmentJobs. Guard-тесты зелёные.

Golden-parity (8 тестов)

City-sweeps полная parity (yandex/cian/domclick), newbuilding полная, full_load smoke.

Verify

  • боевое не тронуто; grep from app в orchestration пусто; ruff clean; 27 passed
Часть #2135 (Epic #2126, шаг F, второй срез). Завершает копирование pipeline-оркестрации. **Strangler** — боевой `scrape_pipeline.py` НЕ тронут, инертно. ## Скопировано Все 7 оставшихся sweep в `scraper_kit/orchestration/pipeline.py`: yandex/cian/domclick city_sweep + avito_newbuilding + 3 full_load. Развязка как F1 (config/matcher/enrichment/runs/providers); ban-rotation переиспользует `_try_rotate_within_budget`. ## Contracts + adapter (синхронно, guard зелёный) +3 метода в `EnrichmentJobs` (yandex price-history/address) + синхронизация `RealEnrichmentJobs`. Guard-тесты зелёные. ## Golden-parity ✅ (8 тестов) City-sweeps полная parity (yandex/cian/domclick), newbuilding полная, full_load smoke. ## Verify - боевое не тронуто; grep `from app` в orchestration пусто; ruff clean; 27 passed
lekss361 added 1 commit 2026-07-02 17:28:58 +00:00
feat(scraper-kit): copy remaining sweep orchestrators (yandex/cian/domclick/full-load), strangler (#2135 F2)
All checks were successful
CI / openapi-codegen-check (pull_request) Has been skipped
CI / changes (pull_request) Successful in 6s
CI / backend-tests (pull_request) Has been skipped
CI / frontend-tests (pull_request) Has been skipped
e176ae99af
lekss361 merged commit abdb413a99 into main 2026-07-02 17:29:06 +00:00
lekss361 deleted branch feat/scraper-kit-pipeline-copy2 2026-07-02 17:29:06 +00:00
Sign in to join this conversation.
No reviewers
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: lekss361/gendesign#2174
No description provided.