gendesign/backend/app/services
lekss361 54cff64109 fix(bug-22a): fill ON CONFLICT gaps for flat_number/living_area/wall_type/energy_eff in kn scraper
Audit of kn-API payload for issue #297 sub-task 22a:

Object-level (/kn/object list endpoint):
- wallType, energyEff, objClass: absent from API payload (0/1516 objects).
  obj_class already fixed in SF#15 via aiDescription regex.
  wall_type/energy_eff: no data source exists.

Flat-level (/portal-kn/api/sales/portal/table):
- number → flat_number: mapped correctly in _norm_flat().
- livingArea → living_area: mapped correctly in _norm_flat().
- Root cause for 0% DB coverage: UPSERT_FLAT_SQL ON CONFLICT did not include
  flat_number, living_area, is_studio, total_area, rooms, floor, num_floors —
  existing rows (hash-id, inserted before direct flatId became available)
  were never updated on subsequent scrapes.

Fix:
- UPSERT_FLAT_SQL ON CONFLICT: add COALESCE updates for all 7 flat fields.
- UPSERT_OBJECT_SQL ON CONFLICT: add COALESCE for wall_type + energy_eff
  (obj_class was already updating, now also COALESCE to preserve existing value).
- Add migration 108 (idempotent DDL guard + coverage NOTICE).

Coverage will improve on next scrape; no backfill possible (flat raw not stored).

Closes #297 sub-task 22a.
2026-05-17 17:54:18 +03:00
..
cadastre fix(#265 review): CRS 3857→4326 + stable zone_id hash + rename 102 + tx comment 2026-05-17 10:45:52 +03:00
etl feat(etl): fuzzy matcher v2 — pruned threshold 0.85→0.80 for objective mapping coverage 2026-05-17 16:28:20 +03:00
exporters feat(layouts): PDF ТЗ endpoint + BestLayoutsBlock UI (#113 PR D) (#199) 2026-05-16 09:53:05 +00:00
generative deploy.yml: sync compose+Caddyfile from git, reload caddy after up 2026-04-26 13:31:26 +03:00
photos fix ui lag 2026-04-27 20:26:55 +03:00
scrapers fix(bug-22a): fill ON CONFLICT gaps for flat_number/living_area/wall_type/energy_eff in kn scraper 2026-05-17 17:54:18 +03:00
site_finder fix(sf-21b): weighted AVG in _INLINE_VELOCITY_SQL (best_layouts.py) 2026-05-17 16:56:22 +03:00
__init__.py init 2026-04-25 13:45:19 +03:00
analytics_queries.py fix(recommend): cad_buildings.floors is INTEGER, not TEXT 2026-05-16 18:29:35 +03:00
analytics_refresh.py fix(scrape): SQLAlchemy text() парсил ':00:' regex как named-param 2026-04-30 23:16:11 +03:00
job_settings.py fix(cadastre,nspd_sync): SQL syntax bugs surfaced by ekb_full v2 (#186) 2026-05-15 19:18:43 +03:00
objective_etl.py fix(worker): port objective_etl from psycopg2 → psycopg v3 2026-05-11 12:07:57 +03:00
objective_sync_config.py feat(objective): full sync pipeline + dynamic admin config 2026-05-10 19:54:15 +03:00