lekss361/gendesign
1
0
Fork 0
Code Issues 57 Pull requests Projects Releases Packages Wiki Activity Actions

feat(tradein): sber-index freshness monitor (п.1 observability) #2503

Merged
bot-backend merged 1 commit from fix/tradein-sber-freshness-monitor into main 2026-07-12 20:31:20 +00:00
Conversation 0 Commits 1 Files changed 4 +509
bot-backend commented 2026-07-12 20:29:04 +00:00
Collaborator
Copy link

п.1 — sber staleness → freshness-monitor (observability, зеркало deals_freshness_monitor)

Staleness СберИндекса ранее тонула в per-estimate warning (estimator._load_sber_index_series #audit-5a). NB: sber-pull НЕ сломан (enabled, monthly, next 07-17; источник инхерентно лагает 1-2мес) — закрываю именно observability-gap.

  • tasks/sber_freshness_monitor.py (new): evaluate_sber_freshness (frozen-now, testable) + check_sber_freshness (SELECT max(period_month) c #R2-H1 secondary-only фильтром → verdict → лог → counters). Зеркалит deals_freshness_monitor дословно (структура/стиль/counters).
  • product_handlers._job_sber_freshness_monitor + registry; seed-миграция 180 (scrape_schedules, daily 09-10 UTC, lag_allowance_days=25).
  • Порог 60д (35 + 25 lag-allowance) — не шумит на штатном лаге, алертит на застревании >~2мес.
  • Live: age 72д → alert=1 (текущий дрейф surface`ится). Estimator adjustment НЕ тронут.

Тесты: 42 passed (sber+deals monitor + manifest); ruff clean. NB: лог WARNING (breadcrumb, не GlitchTip-issue — sber-лаг ниже severity чем deals); поднять до ERROR если ops нужен issue.

## п.1 — sber staleness → freshness-monitor (observability, зеркало deals_freshness_monitor) Staleness СберИндекса ранее тонула в per-estimate warning (`estimator._load_sber_index_series` #audit-5a). NB: sber-pull НЕ сломан (enabled, monthly, next 07-17; источник инхерентно лагает 1-2мес) — закрываю именно observability-gap. - `tasks/sber_freshness_monitor.py` (new): `evaluate_sber_freshness` (frozen-now, testable) + `check_sber_freshness` (SELECT max(period_month) c #R2-H1 secondary-only фильтром → verdict → лог → counters). Зеркалит deals_freshness_monitor дословно (структура/стиль/counters). - `product_handlers._job_sber_freshness_monitor` + registry; seed-миграция 180 (scrape_schedules, daily 09-10 UTC, `lag_allowance_days=25`). - Порог 60д (35 + 25 lag-allowance) — не шумит на штатном лаге, алертит на застревании >~2мес. - Live: age 72д → **alert=1** (текущий дрейф surface`ится). Estimator adjustment НЕ тронут. Тесты: 42 passed (sber+deals monitor + manifest); ruff clean. NB: лог WARNING (breadcrumb, не GlitchTip-issue — sber-лаг ниже severity чем deals); поднять до ERROR если ops нужен issue.
bot-backend added 1 commit 2026-07-12 20:29:05 +00:00
feat(tradein): монитор свежести СберИндекса (audit п.1)
All checks were successful
CI Trade-In / changes (pull_request) Successful in 8s
Details
CI / changes (pull_request) Successful in 7s
Details
CI / backend-tests (pull_request) Has been skipped
Details
CI / frontend-tests (pull_request) Has been skipped
Details
CI / openapi-codegen-check (pull_request) Has been skipped
Details
CI Trade-In / frontend-checks (pull_request) Has been skipped
Details
CI Trade-In / backend-tests (pull_request) Successful in 51s
Details
07275c3c97 
Добавляет sber_freshness_monitor по образцу deals_freshness_monitor:
staleness данных СберИндекса теперь видна на MONITOR-частоте, а не тонет
в per-estimate warning'ах estimator._load_sber_index_series (#audit-5a).

- app/tasks/sber_freshness_monitor.py: чистая evaluate_sber_freshness()
  (frozen-now, без БД) + check_sber_freshness() (один SELECT
  max(period_month) вторичного сегмента по региону, #R2-H1 фильтр как в
  эстиматоре; WARNING при stale, mark_done при алерте — это монитор, не
  сбой; mark_failed только при пустой таблице).
- app/services/product_handlers.py: _job_sber_freshness_monitor + Handler
  в build_product_handlers (run_in_executor, как deals-монитор).
- data/sql/180_seed_sber_freshness_monitor.sql: seed scrape_schedules
  (enabled, daily 09:00-10:00 UTC, lag_allowance_days=25).
- tests/test_sber_freshness_monitor.py: frozen-now (fresh/stale/границы) +
  FakeDB (fresh/stale/empty/кастомный lag) + свойства миграции + registry.

Порог алерта: sber_index_max_age_days (35) + lag_allowance (25) = 60д.
+25 — запас на инхерентный лаг публикации источника (1-2 мес), чтобы не
шуметь на штатном отставании. Прод 2026-07-12: max=2026-05-01, age=72д >
60 → alert=1.
bot-backend merged commit 73f932d60a into main 2026-07-12 20:31:20 +00:00
bot-backend deleted branch fix/tradein-sber-freshness-monitor 2026-07-12 20:31:20 +00:00
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels   
admin

Admin UI / internal tools / pipeline tracker

  
analytics

Аналитика данных / matching

  
auth

Authentication / authorization / multi-tenancy

  
automation

Автоматизация / cron / scheduler

  
bug

Something isn't working

  
business

Коммерческая воронка / пилоты / pipeline / реестр ПО

  
chore

Operational housekeeping

  
ci

Forgejo Actions / build pipeline

  
compliance

152-ФЗ / реестр ПО / legal / TOS

  
data

Data sources, parsers, ETL

  
data-moat

Уникальные данные — sales tracker, CRM aggregation

  
docs

README / runbooks / onboarding

  
duplicate

This issue or pull request already exists

  
dx

Developer experience / build speed

  
enhancement

New feature or request

  
Fable 5 ревью

Находки полного мульти-агентного ревью (Claude Fable 5, 2026-06-09)

  
feedback/max

Feedback from Max (Senior partner)

  
generative

Generative Design — concept generation engine

  
GG-форсайт

Новое ТЗ от Ген Геныча (июнь 2026): Site Finder v2 — ИИ-прогноз продуктовой стратегии девелопера. Актуальный приоритет.

  
needs-discussion

Pending team sync / decision

  
needs-human

Human review/decision required

  
observability

Monitoring / metrics / logs / Sentry / Uptime

  
pause-bots

Kill-switch — all autonomous bots pause

  
performance

Latency / throughput / DB query tuning

  
priority/p0

Critical / production-blocker

  
priority/p1

High priority

  
priority/p2

Normal priority

  
priority/p3

Низкий приоритет (follow-up, tech-debt)

  
scope/backend

Backend Python — FastAPI, Celery, scrapers

  
scope/db

DB migrations, indexes, SQL

  
scope/devops

docker-compose, Caddy, workflows

  
scope/frontend

Frontend — Next.js, React, TypeScript

  
scope/qa

Tests, smoke, Playwright

  
scrapers

Скрапперы (Avito/Cian/Yandex/Rosreestr)

  
security

Security audit / secrets / vulnerabilities

  
site-finder

Site Finder scoring quality & data layer

  
stage/1

Stage 1: Generative MVP (нед 2-7)

  
stage/2

Stage 2: Site Finder MVP (нед 8-12)

  
status/blocked

Blocked — needs human intervention

  
status/done

Closed, completed

  
status/needs-analysis

Raw/fuzzy task filed by human — auto-analyst подхватывает: code-archeology + декомпозиция в actionable scope/* + status/ready (или split на под-issues)

  
status/needs-fix

Reviewer/QA вернул worker на доработку — worker сам чинит свой PR (fixup), НЕ требует human (в отличие от status/blocked)

  
status/qa

PR merged, awaiting smoke test

  
status/ready

Ready for pickup by worker bot

  
status/review

PR open, awaiting code review

  
status/wip

Work in progress (worker claimed)

  
tech-debt

Технический долг

  
tradein

Trade-In MVP проект

  
ux

User experience / responsive / conversion

  
week ревью 1

Week review 1 — находки multi-agent аудита проекта (2026-06-14)

  
wontfix

This will not be worked on

  
вторичка

Trade-In Estimator — проект оценки вторичного жилья

  
ИРД

Исходно-разрешительная документация — слой ограничений участка для analyze-таблицы

No labels
admin
analytics
auth
automation
bug
business
chore
ci
compliance
data
data-moat
docs
duplicate
dx
enhancement
Fable 5 ревью
feedback/max
generative
GG-форсайт
needs-discussion
needs-human
observability
pause-bots
performance
priority/p0
priority/p1
priority/p2
priority/p3
scope/backend
scope/db
scope/devops
scope/frontend
scope/qa
scrapers
security
site-finder
stage/1
stage/2
status/blocked
status/done
status/needs-analysis
status/needs-fix
status/qa
status/ready
status/review
status/wip
tech-debt
tradein
ux
week ревью 1
wontfix
вторичка
ИРД
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: lekss361/gendesign#2503
No description provided.
Delete branch "fix/tradein-sber-freshness-monitor"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?