lekss361/gendesign
1
0
Fork 0
Code Issues 57 Pull requests Projects Releases Packages Wiki Activity Actions

feat(site-finder): OSM engineering-networks loader + endpoint (#1746) #1930

Merged
bot-backend merged 2 commits from feat/1746-osm-utility-networks into main 2026-06-26 20:01:01 +00:00
Conversation 0 Commits 2 Files changed 10 +1094
bot-backend commented 2026-06-26 19:43:45 +00:00
Collaborator
Copy link

No-B2B open-data источник инженерных сетей ЕКБ через OSM Overpass (живой тест: 3081+ utility-элементов). Зеркалит noise_loader + poi-sync.

  • Table osm_utility_infrastructure_ekb (migration 100): geom(Geometry,4326) — линии И точки, GIST-индекс, UNIQUE(osm_type, osm_id) для идемпотентного UPSERT. BEGIN/COMMIT.
  • Loader utility_infrastructure_loader.py: Overpass (rate-limit 1 req/s, httpx + UA), классификация infrastructure_kind (power/water/gas/heat/communication/sewage), per-element SAVEPOINT UPSERT.
  • Schedule: Celery task + weekly beat (пн 04:00 МСК, после noise-sync).
  • Endpoint GET /api/v1/parcels/{cad}/utility-infrastructure?radius_m=: инж.сети в радиусе центроида (ST_DWithin) + summary по видам.
  • Codegen: api-types.ts регенерирован (новый endpoint + 3 схемы), diff +98/0.
  • Full suite: 3556 passed, 0 failed. ruff clean.

Открытые источники задокументированы в #1746 (OSM сейчас + NSPD-доп-слои follow-up). Снимает B2B-зависимость #52 п.1 для базового слоя сетей. Frontend-рендер на карту — отдельная задача frontend-контрибьютора.

Refs #1746, #103, #52

No-B2B open-data источник инженерных сетей ЕКБ через **OSM Overpass** (живой тест: 3081+ utility-элементов). Зеркалит `noise_loader` + poi-sync. - **Table** `osm_utility_infrastructure_ekb` (migration 100): `geom(Geometry,4326)` — линии И точки, GIST-индекс, `UNIQUE(osm_type, osm_id)` для идемпотентного UPSERT. BEGIN/COMMIT. - **Loader** `utility_infrastructure_loader.py`: Overpass (rate-limit 1 req/s, httpx + UA), классификация `infrastructure_kind` (power/water/gas/heat/communication/sewage), per-element SAVEPOINT UPSERT. - **Schedule**: Celery task + weekly beat (пн 04:00 МСК, после noise-sync). - **Endpoint** `GET /api/v1/parcels/{cad}/utility-infrastructure?radius_m=`: инж.сети в радиусе центроида (ST_DWithin) + summary по видам. - **Codegen**: api-types.ts регенерирован (новый endpoint + 3 схемы), diff +98/0. - **Full suite**: 3556 passed, 0 failed. ruff clean. Открытые источники задокументированы в #1746 (OSM сейчас + NSPD-доп-слои follow-up). Снимает B2B-зависимость #52 п.1 для базового слоя сетей. Frontend-рендер на карту — отдельная задача frontend-контрибьютора. Refs #1746, #103, #52
bot-backend added 1 commit 2026-06-26 19:43:46 +00:00
feat(site-finder): OSM engineering-networks loader + endpoint (#1746)
All checks were successful
CI / changes (pull_request) Successful in 6s
Details
CI / frontend-tests (pull_request) Successful in 54s
Details
CI / openapi-codegen-check (pull_request) Successful in 2m12s
Details
CI / backend-tests (pull_request) Successful in 11m19s
Details
42ed1f8a93 
No-B2B open-data путь (Overpass) для инженерных сетей ЕКБ: ЛЭП/подстанции/
опоры, трубопроводы (газ/вода/канализация), ЦТП, вышки связи.

- Миграция 100_osm_utility_infrastructure_ekb.sql: таблица + GIST-индекс,
  UNIQUE(osm_type, osm_id) для идемпотентного UPSERT, geom(Geometry,4326)
  (линии И точки).
- Loader utility_infrastructure_loader.py: Overpass-запросы (rate-limit 1 req/s),
  классификация в infrastructure_kind (power/water/gas/heat/communication/sewage),
  per-element SAVEPOINT UPSERT. Зеркалит noise_loader (геом-хелперы переиспользованы).
- Celery task + weekly beat (понедельник 04:00 МСК, после noise-sync).
- Endpoint GET /api/v1/parcels/{cad}/utility-infrastructure: инж.сети в радиусе
  центроида участка (ST_DWithin) + summary по видам сети. Зеркалит connection-points.
- Тесты: loader (Overpass-парсинг/UPSERT/SAVEPOINT/фильтры) + endpoint (mock DB).
- Codegen: api-types.ts регенерирован (новый endpoint + 3 схемы).
Light1YT added 1 commit 2026-06-26 19:49:07 +00:00
chore: rename migration 100→170 (next free seq; 100-105 taken, max=169) (#1746)
All checks were successful
CI / changes (pull_request) Successful in 6s
Details
CI / frontend-tests (pull_request) Successful in 1m0s
Details
CI / openapi-codegen-check (pull_request) Successful in 1m57s
Details
CI / backend-tests (pull_request) Successful in 11m13s
Details
8d1e483271
bot-backend merged commit 3753079dee into main 2026-06-26 20:01:01 +00:00
bot-backend deleted branch feat/1746-osm-utility-networks 2026-06-26 20:01:01 +00:00
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels   
admin

Admin UI / internal tools / pipeline tracker

  
analytics

Аналитика данных / matching

  
auth

Authentication / authorization / multi-tenancy

  
automation

Автоматизация / cron / scheduler

  
bug

Something isn't working

  
business

Коммерческая воронка / пилоты / pipeline / реестр ПО

  
chore

Operational housekeeping

  
ci

Forgejo Actions / build pipeline

  
compliance

152-ФЗ / реестр ПО / legal / TOS

  
data

Data sources, parsers, ETL

  
data-moat

Уникальные данные — sales tracker, CRM aggregation

  
docs

README / runbooks / onboarding

  
duplicate

This issue or pull request already exists

  
dx

Developer experience / build speed

  
enhancement

New feature or request

  
Fable 5 ревью

Находки полного мульти-агентного ревью (Claude Fable 5, 2026-06-09)

  
feedback/max

Feedback from Max (Senior partner)

  
generative

Generative Design — concept generation engine

  
GG-форсайт

Новое ТЗ от Ген Геныча (июнь 2026): Site Finder v2 — ИИ-прогноз продуктовой стратегии девелопера. Актуальный приоритет.

  
needs-discussion

Pending team sync / decision

  
needs-human

Human review/decision required

  
observability

Monitoring / metrics / logs / Sentry / Uptime

  
pause-bots

Kill-switch — all autonomous bots pause

  
performance

Latency / throughput / DB query tuning

  
priority/p0

Critical / production-blocker

  
priority/p1

High priority

  
priority/p2

Normal priority

  
priority/p3

Низкий приоритет (follow-up, tech-debt)

  
scope/backend

Backend Python — FastAPI, Celery, scrapers

  
scope/db

DB migrations, indexes, SQL

  
scope/devops

docker-compose, Caddy, workflows

  
scope/frontend

Frontend — Next.js, React, TypeScript

  
scope/qa

Tests, smoke, Playwright

  
scrapers

Скрапперы (Avito/Cian/Yandex/Rosreestr)

  
security

Security audit / secrets / vulnerabilities

  
site-finder

Site Finder scoring quality & data layer

  
stage/1

Stage 1: Generative MVP (нед 2-7)

  
stage/2

Stage 2: Site Finder MVP (нед 8-12)

  
status/blocked

Blocked — needs human intervention

  
status/done

Closed, completed

  
status/needs-analysis

Raw/fuzzy task filed by human — auto-analyst подхватывает: code-archeology + декомпозиция в actionable scope/* + status/ready (или split на под-issues)

  
status/needs-fix

Reviewer/QA вернул worker на доработку — worker сам чинит свой PR (fixup), НЕ требует human (в отличие от status/blocked)

  
status/qa

PR merged, awaiting smoke test

  
status/ready

Ready for pickup by worker bot

  
status/review

PR open, awaiting code review

  
status/wip

Work in progress (worker claimed)

  
tech-debt

Технический долг

  
tradein

Trade-In MVP проект

  
ux

User experience / responsive / conversion

  
week ревью 1

Week review 1 — находки multi-agent аудита проекта (2026-06-14)

  
wontfix

This will not be worked on

  
вторичка

Trade-In Estimator — проект оценки вторичного жилья

  
ИРД

Исходно-разрешительная документация — слой ограничений участка для analyze-таблицы

No labels
admin
analytics
auth
automation
bug
business
chore
ci
compliance
data
data-moat
docs
duplicate
dx
enhancement
Fable 5 ревью
feedback/max
generative
GG-форсайт
needs-discussion
needs-human
observability
pause-bots
performance
priority/p0
priority/p1
priority/p2
priority/p3
scope/backend
scope/db
scope/devops
scope/frontend
scope/qa
scrapers
security
site-finder
stage/1
stage/2
status/blocked
status/done
status/needs-analysis
status/needs-fix
status/qa
status/ready
status/review
status/wip
tech-debt
tradein
ux
week ревью 1
wontfix
вторичка
ИРД
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
2 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: lekss361/gendesign#1930
No description provided.
Delete branch "feat/1746-osm-utility-networks"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?