171 commits

Author	SHA1	Message	Date
bot-backend	12162a0abb	feat(exporters): Site Finder report PDF exporter (#989, 955-A3) (#1023)	2026-06-03 09:09:30 +00:00
bot-backend	299f2365fb	feat(exporters): Excel exporter for SiteFinderReport (#991, 955-A5) (#1022)	2026-06-03 08:57:00 +00:00
bot-backend	fc312fe606	feat(forecasting): §13 report assembler (#988, 955-A2) (#1021)	2026-06-03 08:51:23 +00:00
bot-backend	47fe5a55eb	feat(forecasting): §15 confidence engine v2 (#990, 955-A4) (#1020)	2026-06-03 08:41:07 +00:00
bot-backend	75c9b34987	feat(forecasting): §13 SiteFinderReport object (#987, 955-A1) (#1019)	2026-06-03 08:33:01 +00:00
bot-backend	008f9d9ed1	feat(forecasting): §25 six special indices (#986, 954-C) (#1018)	2026-06-03 08:24:08 +00:00
bot-backend	98dea0315a	feat(forecasting): §14.2 product scoring card (#985, 954-B) (#1017)	2026-06-03 08:11:54 +00:00
bot-backend	8057468c13	feat(forecasting): §11 macro-scenarios (#984, 954-A) (#1016)	2026-06-03 07:59:22 +00:00
bot-backend	691ccef4b7	feat(forecasting): class/commercial/USP §10.2/10.4/10.5 + §16 (#983, 953-B) (#1015)	2026-06-03 07:52:24 +00:00
bot-backend	72e9b24f2c	feat(recommend): horizon-aware recommend_mix opt-in overlay (#982, 953-A) (#1014)	2026-06-03 07:40:33 +00:00
bot-backend	489e380f1e	feat(forecasting): what-to-build ranker + MAI proxy (#981, 952-B) (#1013)	2026-06-03 07:07:17 +00:00
bot-backend	70ffa399fc	feat(forecasting): demand-supply forecast engine (#980, 952-A) (#1012)	2026-06-03 06:56:33 +00:00
bot-backend	9758e21cbd	feat(forecasting): §9.4 demand-normalization coefficient (#951f, advisory) (#1011)	2026-06-03 06:28:14 +00:00
bot-backend	69ad6c87fc	feat(forecasting): §9.5 macro coefficient (#951e, advisory) (#1010)	2026-06-03 06:20:04 +00:00
bot-backend	f41e2536d8	feat(forecasting): §9.6 key-rate sensitivity module (#951d, advisory) (#1009)	2026-06-03 06:06:16 +00:00
bot-backend	c7bfc9e22a	feat(forecasting): monthly sales series builder for §9.6 (#951c) (#1008)	2026-06-03 05:52:33 +00:00
bot-backend	ace3b99508	feat(forecasting): monthly macro series + regime classifier (#951b) (#1007)	2026-06-03 05:37:43 +00:00
lekss361	a10592847d	feat(site_finder): future-supply-pressure index (#950 Step 6) (#1006)	2026-06-03 05:10:08 +00:00
Light1YT	900802264a	feat(site-finder): supply_layers v2 compute service (#950 EPIC6 step3+4) (#1004)	2026-06-02 20:34:26 +00:00
Light1YT	420cda2831	feat(domrf): persist domrf_kn_objects.free_flats (#950 PR A) (#1002)	2026-06-02 20:06:29 +00:00
Light1YT	59be55f80e	feat(site-finder): per-competitor relevance_weight (#949 PR B) (#1000)	2026-06-02 19:45:38 +00:00
Light1YT	45d61ecff0	feat(site_finder): market-metrics service (#949 PR A, §9.2) (#997)	2026-06-02 19:26:26 +00:00
Light1YT	c78c6ec2d0	feat(site-finder): live CBR key-rate scraper → macro_indicator (#945 PR B) (#964)	2026-06-02 19:05:57 +00:00
Light1YT	dbae4b0bda	feat(site-finder): macro_indicator table + backfill + reader (#945 PR A) (#963)	2026-06-02 18:41:28 +00:00
bot-backend	87a5de0cae	feat(db): quarter_price_index FDW foreign table + monthly refresh (Refs #762) (#797) ... Co-authored-by: bot-backend <bot-backend@gendsgn.local> Co-committed-by: bot-backend <bot-backend@gendsgn.local>	2026-05-30 17:16:28 +00:00
Light1YT	6cb3d7515c	fix(tradein): per-bucket velocity formula + realistic срок продажи (#574) (#631)	2026-05-28 15:35:16 +00:00
Light1YT	4e4762f234	fix(tradein): backfill kn obj_class (parser + 3-pass) (#572) (#628)	2026-05-28 15:04:32 +00:00
Light1YT	609ac8ea9d	fix(tradein): backfill kn price_per_m2 via sale_graph + peer median (#573) (#625)	2026-05-28 13:50:45 +00:00
lekss361	099b8e4b59	fix(scrapers): DOM.РФ KN extras — bypass WAF + update renamed endpoints (#503)	2026-05-24 10:53:28 +00:00
lekss361	9ffeee7ed2	feat(22d): admin UI buttons (skip/force) + reduce catalog jitter 800→300ms (#352)	2026-05-17 23:38:22 +00:00
lekss361	e5498682ba	fix(22d): commit outer transaction in scrape_catalog_objects orchestrator ... PR #335 использовал `with db.begin_nested():` SAVEPOINT для per-row UPDATE, но outer transaction никогда не commit'ился. После цикла Celery task закрывал session (`db.close()` в finally) → autobegin'd outer tx rollback → все UPDATE'ы теряются. Симптом: task завершается с processed=3 succeeded=3, в Glitchtip нет ошибок, но в БД ни одного catalog_scraped_at != NULL. Fix: добавлен db.commit() после цикла + rollback на ошибку commit'а.	2026-05-18 01:10:06 +03:00
lekss361	0567ad2130	feat(22d): domrf_catalog_object scraper — fill ~25 NULL kn_objects cols from SSR __NEXT_DATA__ (#335)	2026-05-17 21:26:22 +00:00
lekss361	b013fd886c	feat(sf-b6): GET /parcels/{cad}/poi-score — weighted top-7 (#333)	2026-05-17 21:11:25 +00:00
lekss361	4040cba4c0	feat(sf-b7): GET /parcels/{cad}/snapshot.pdf — 1-page WeasyPrint export (#334)	2026-05-17 21:11:03 +00:00
lekss361	2aa33e0eb8	fix(stealth): bump Semaphore 6->8 for higher concurrency in gather ... Per-object 7 endpoints через asyncio.gather упираются в semaphore limit. 6 -> 8 — ещё +33% concurrency для batch fetch'а.	2026-05-17 23:04:51 +03:00
lekss361	0f289c05b1	fix(scrape-kn): real documents endpoints (5x) + skip obj_checks 404 + sem 3->6 ... PR #322 used placeholder URLs: - /api/object/{id}/documents -> 404 (Playwright showed: 5 real endpoints: document/rpd / developer/report / project/documentation / documentation/other / document/permits). Replaced with 5 parallel fetches + merge into single upsert_documents call. - /api/object/{id}/checks -> 404. 6 checkboxes likely inline in bulk kn/object payload; endpoint /checks does not exist. Commented out _fetch_obj_checks_safe with TODO for separate investigation PR. - BrowserSession Semaphore(3) -> Semaphore(6) — double concurrency for intra-object gather. GlitchTip: kn_scrape_failures run #19 showed 40 failures each for both placeholder endpoints across first 30 objects of 1532.	2026-05-17 22:59:44 +03:00
lekss361	f2983c86d7	feat(scrape-kn): parallel Phase B/C + wire obj_checks + documents + is_ekb auto-derive (#322)	2026-05-17 19:40:16 +00:00
lekss361	3978aa5905	feat(trade-in): TI-2 PDF export 4-page + frontend enable button (#319)	2026-05-17 17:16:48 +00:00
lekss361	389e141ec9	fix(scrape-objective): stream-parse lots_pf via ijson to avoid OOM (#315)	2026-05-17 16:37:30 +00:00
lekss361	fd2b09b806	fix(22k): quartirography — use f.flat_type not f.type (column doesn't exist) (#312)	2026-05-17 16:09:00 +00:00
lekss361	f8c382f885	feat(22k): object page — full exposure 9 blocks (sales/quartirography/metro/photos/docs/specs/checks) (#310)	2026-05-17 15:56:39 +00:00
lekss361	4bed58b43c	feat(22d): domrf_catalog.py scraper for per-flat price/status from SSR HTML (#309)	2026-05-17 15:40:01 +00:00
lekss361	b37e011aaa	feat(22c): domrf_kn_flat_plans new table + parser stub (#308)	2026-05-17 15:39:34 +00:00
lekss361	6612c1cd2b	feat(22begh): schema extension — flats+6 / objects+30 / developers+4 / metro_top3 (#306)	2026-05-17 15:26:59 +00:00
lekss361	171a029997	feat(22i): domrf_kn_documents new table + parser (#305)	2026-05-17 15:21:31 +00:00
lekss361	3183abe41b	fix(22j): DEDUP domrf_kn_infrastructure + ON CONFLICT (issue #297) (#304)	2026-05-17 15:15:03 +00:00
lekss361	0b12a55eb6	fix(bug-22a): map missing kn-API fields (flat_number/living_area/wall_type/energy_eff) + backfill (#302)	2026-05-17 14:59:02 +00:00
lekss361	bfe16ae71b	fix(sf-16): derive price_per_m2 from price_rub in _norm_flat + backfill SQL (#298)	2026-05-17 14:32:23 +00:00
lekss361	e054395464	Merge pull request 'fix(sf-15): extract obj_class from aiDescription (DOM.РФ list API never returns objClass)' (#293) from fix/sf-15-obj-class-scraping into main	2026-05-17 14:18:49 +00:00
lekss361	3daf2a1fb1	fix(sf-15): extract obj_class from aiDescription (DOM.RF list API never returns objClass field) ... Add _extract_obj_class_from_ai() with regex patterns for Комфорт/Бизнес/Премиум/Элит/Стандарт. _norm_object() uses it as fallback; objClass from API still takes priority if ever returned. Add backfill SQL 105 to retroactively populate existing rows from raw JSON payloads. Coverage: ~1806/4548 rows will be filled; remainder NULL is expected (Нежилое/no AI desc).	2026-05-17 17:02:07 +03:00