lekss361/gendesign
1
0
Fork 0
Code Issues 57 Pull requests Projects Releases Packages Wiki Activity Actions

feat(workers): supply-layers refresh task + weekly beat (#950 Step 5) #1005

Merged
Light1YT merged 1 commit from feat/950d-supply-layers-worker into main 2026-06-02 20:47:06 +00:00
Conversation 0 Commits 1 Files changed 4 +579
Light1YT commented 2026-06-02 20:47:03 +00:00
Owner
Copy link

Site Finder v2 / EPIC 6 — #950 Step 5. Детерминированный, без LLM. Часть #944.

Celery-таск tasks.supply_layers_refresh считает L1/L2/L3 по каждому district Свердловской через supply_layers.compute_all_layers и UPSERT-ит в supply_layers (m.125) по uq_supply_layers_logical, обновляя все mutable-колонки (никогда key).

  • Coherent snapshot: один date.today() на весь батч → same-day re-run идемпотентен.
  • Resilience: per-row SAVEPOINT (begin_nested) + per-district guard → плохая строка/район не валит недельный батч.
  • District set data-driven: UNION objective_lots.district + domrf_kn_objects.district_name region_cd=66 (не хардкод 8 имён).
  • Beat: Mon 06:00 МСК (после scrape_kn 04:15, что обновляет free_flats — источник L2). Таск добавлен в celery_app include (beat резолвит по имени).

11 unit-тестов (ON CONFLICT contract + savepoint + coherent snapshot). code-reviewer opus OK (UPSERT/NULLS-NOT-DISTINCT точно совпадает с constraint, binds выровнены 1:1). Refs #950

**Site Finder v2 / EPIC 6 — #950 Step 5.** Детерминированный, без LLM. Часть #944. Celery-таск `tasks.supply_layers_refresh` считает L1/L2/L3 по каждому district Свердловской через `supply_layers.compute_all_layers` и UPSERT-ит в `supply_layers` (m.125) по `uq_supply_layers_logical`, обновляя все mutable-колонки (никогда key). - **Coherent snapshot:** один `date.today()` на весь батч → same-day re-run идемпотентен. - **Resilience:** per-row SAVEPOINT (begin_nested) + per-district guard → плохая строка/район не валит недельный батч. - **District set data-driven:** UNION `objective_lots.district` + `domrf_kn_objects.district_name region_cd=66` (не хардкод 8 имён). - **Beat:** Mon 06:00 МСК (после scrape_kn 04:15, что обновляет free_flats — источник L2). Таск добавлен в celery_app include (beat резолвит по имени). **11 unit-тестов** (ON CONFLICT contract + savepoint + coherent snapshot). code-reviewer opus OK (UPSERT/NULLS-NOT-DISTINCT точно совпадает с constraint, binds выровнены 1:1). Refs #950
Light1YT added 1 commit 2026-06-02 20:47:04 +00:00 
Celery task tasks.supply_layers_refresh computes L1/L2/L3 supply layers per
Sverdlovsk district via supply_layers.compute_all_layers and UPSERTs into
supply_layers (m.125) on uq_supply_layers_logical, updating all mutable cols
(units/area/expected_online_date/confidence/method/computed_at), never the key.
Coherent single date.today() snapshot_date across the batch; per-row SAVEPOINT
(begin_nested) so a bad row/district can't abort the weekly batch; per-district
guard. District set is data-driven (UNION of objective_lots.district and
domrf_kn_objects.district_name region_cd=66), not hardcoded.

Registered weekly Mon 06:00 МСК (after scrape_kn 04:15 that refreshes free_flats,
the L2 source). Adds the task module to celery_app include (beat resolves by
name). 11 unit tests asserting the ON CONFLICT contract + savepoint + coherent
snapshot.
Light1YT merged commit ae85f19993 into main 2026-06-02 20:47:06 +00:00
Light1YT deleted branch feat/950d-supply-layers-worker 2026-06-02 20:47:06 +00:00
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels   
admin

Admin UI / internal tools / pipeline tracker

  
analytics

Аналитика данных / matching

  
auth

Authentication / authorization / multi-tenancy

  
automation

Автоматизация / cron / scheduler

  
bug

Something isn't working

  
business

Коммерческая воронка / пилоты / pipeline / реестр ПО

  
chore

Operational housekeeping

  
ci

Forgejo Actions / build pipeline

  
compliance

152-ФЗ / реестр ПО / legal / TOS

  
data

Data sources, parsers, ETL

  
data-moat

Уникальные данные — sales tracker, CRM aggregation

  
docs

README / runbooks / onboarding

  
duplicate

This issue or pull request already exists

  
dx

Developer experience / build speed

  
enhancement

New feature or request

  
Fable 5 ревью

Находки полного мульти-агентного ревью (Claude Fable 5, 2026-06-09)

  
feedback/max

Feedback from Max (Senior partner)

  
generative

Generative Design — concept generation engine

  
GG-форсайт

Новое ТЗ от Ген Геныча (июнь 2026): Site Finder v2 — ИИ-прогноз продуктовой стратегии девелопера. Актуальный приоритет.

  
needs-discussion

Pending team sync / decision

  
needs-human

Human review/decision required

  
observability

Monitoring / metrics / logs / Sentry / Uptime

  
pause-bots

Kill-switch — all autonomous bots pause

  
performance

Latency / throughput / DB query tuning

  
priority/p0

Critical / production-blocker

  
priority/p1

High priority

  
priority/p2

Normal priority

  
priority/p3

Низкий приоритет (follow-up, tech-debt)

  
scope/backend

Backend Python — FastAPI, Celery, scrapers

  
scope/db

DB migrations, indexes, SQL

  
scope/devops

docker-compose, Caddy, workflows

  
scope/frontend

Frontend — Next.js, React, TypeScript

  
scope/qa

Tests, smoke, Playwright

  
scrapers

Скрапперы (Avito/Cian/Yandex/Rosreestr)

  
security

Security audit / secrets / vulnerabilities

  
site-finder

Site Finder scoring quality & data layer

  
stage/1

Stage 1: Generative MVP (нед 2-7)

  
stage/2

Stage 2: Site Finder MVP (нед 8-12)

  
status/blocked

Blocked — needs human intervention

  
status/done

Closed, completed

  
status/needs-analysis

Raw/fuzzy task filed by human — auto-analyst подхватывает: code-archeology + декомпозиция в actionable scope/* + status/ready (или split на под-issues)

  
status/needs-fix

Reviewer/QA вернул worker на доработку — worker сам чинит свой PR (fixup), НЕ требует human (в отличие от status/blocked)

  
status/qa

PR merged, awaiting smoke test

  
status/ready

Ready for pickup by worker bot

  
status/review

PR open, awaiting code review

  
status/wip

Work in progress (worker claimed)

  
tech-debt

Технический долг

  
tradein

Trade-In MVP проект

  
ux

User experience / responsive / conversion

  
week ревью 1

Week review 1 — находки multi-agent аудита проекта (2026-06-14)

  
wontfix

This will not be worked on

  
вторичка

Trade-In Estimator — проект оценки вторичного жилья

  
ИРД

Исходно-разрешительная документация — слой ограничений участка для analyze-таблицы

No labels
admin
analytics
auth
automation
bug
business
chore
ci
compliance
data
data-moat
docs
duplicate
dx
enhancement
Fable 5 ревью
feedback/max
generative
GG-форсайт
needs-discussion
needs-human
observability
pause-bots
performance
priority/p0
priority/p1
priority/p2
priority/p3
scope/backend
scope/db
scope/devops
scope/frontend
scope/qa
scrapers
security
site-finder
stage/1
stage/2
status/blocked
status/done
status/needs-analysis
status/needs-fix
status/qa
status/ready
status/review
status/wip
tech-debt
tradein
ux
week ревью 1
wontfix
вторичка
ИРД
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: lekss361/gendesign#1005
No description provided.
Delete branch "feat/950d-supply-layers-worker"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?