7 commits

Author	SHA1	Message	Date
Light1YT	e0fff9cfb0	fix(week-review): backend-аудит v2 — 82 issue (#1560-1656) ... Имплементация фиксов 2-го аудита backend/app/** (после merge #1543). Воркер на файл, точечные правки. Верификация: py_compile 58/58 .py. Полностью исправлено (82). Оставлены открытыми (13): partial/needs-cross-file/needs-leha — #1569, #1590, #1593, #1606, #1609, #1617, #1633, #1635, #1637, #1638, #1640, #1642, #1650. Closes #1560 Closes #1561 Closes #1562 Closes #1563 Closes #1564 Closes #1565 Closes #1566 Closes #1567 Closes #1570 Closes #1571 Closes #1572 Closes #1573 Closes #1574 Closes #1576 Closes #1577 Closes #1578 Closes #1579 Closes #1580 Closes #1581 Closes #1582 Closes #1583 Closes #1584 Closes #1585 Closes #1586 Closes #1587 Closes #1588 Closes #1589 Closes #1591 Closes #1592 Closes #1594 Closes #1595 Closes #1596 Closes #1597 Closes #1598 Closes #1599 Closes #1600 Closes #1601 Closes #1602 Closes #1603 Closes #1604 Closes #1605 Closes #1607 Closes #1608 Closes #1610 Closes #1611 Closes #1612 Closes #1613 Closes #1614 Closes #1615 Closes #1616 Closes #1618 Closes #1619 Closes #1620 Closes #1621 Closes #1622 Closes #1623 Closes #1624 Closes #1625 Closes #1626 Closes #1627 Closes #1628 Closes #1629 Closes #1630 Closes #1631 Closes #1632 Closes #1634 Closes #1636 Closes #1639 Closes #1641 Closes #1643 Closes #1644 Closes #1645 Closes #1646 Closes #1647 Closes #1648 Closes #1649 Closes #1651 Closes #1652 Closes #1653 Closes #1654 Closes #1655 Closes #1656	2026-06-17 01:30:52 +05:00
Light1YT	86e9ea2937	fix(week-review): автофиксы код-ревью — 169 issue (label «week ревью 1») ... Многоагентный аудит + имплементация: один воркер на файл, точечные правки. Верификация: py_compile (47/47 .py) + tsc --noEmit (0 ошибок). Unit-тесты не прогонялись (окружение не поднято: rollup native dep / нет pytest-venv). Полностью исправлено (169): #1336, #1337, #1339, #1340, #1341, #1342, #1343, #1345, #1346, #1348, #1349, #1350, #1351, #1354, #1356, #1358, #1359, #1360, #1362, #1364, #1365, #1366, #1367, #1368, #1369, #1370, #1371, #1372, #1373, #1374, #1375, #1376, #1377, #1378, #1379, #1380, #1381, #1382, #1384, #1385, #1386, #1387, #1388, #1389, #1390, #1391, #1392, #1394, #1395, #1396, #1397, #1399, #1400, #1401, #1402, #1403, #1404, #1408, #1409, #1410, #1411, #1412, #1413, #1414, #1415, #1416, #1417, #1418, #1420, #1423, #1425, #1426, #1427, #1428, #1429, #1430, #1431, #1432, #1433, #1434, #1435, #1437, #1438, #1439, #1440, #1441, #1442, #1443, #1444, #1445, #1446, #1447, #1448, #1449, #1450, #1451, #1452, #1453, #1454, #1455, #1456, #1457, #1458, #1459, #1460, #1461, #1462, #1463, #1464, #1465, #1466, #1467, #1468, #1469, #1471, #1472, #1473, #1474, #1476, #1478, #1479, #1481, #1482, #1483, #1484, #1485, #1487, #1488, #1489, #1490, #1491, #1492, #1493, #1494, #1495, #1496, #1497, #1499, #1500, #1501, #1502, #1504, #1505, #1506, #1507, #1510, #1514, #1515, #1516, #1517, #1518, #1519, #1521, #1522, #1523, #1524, #1525, #1526, #1527, #1528, #1529, #1531, #1532, #1533, #1534, #1535, #1536, #1537, #1538 Частично (9, in-file часть, остаток cross-file): #1361, #1419, #1422, #1424, #1470, #1475, #1477, #1480, #1498 Требуют cross-file (3, не тронуты): #1338, #1363, #1421 Пропущено (1): #1539 Не входило в партию: 22 needs-Leha issue (нужны решения владельца). Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>	2026-06-15 20:21:11 +05:00
Light1YT	c29f4aef57	fix(llm): cap серверного Retry-After через _MAX_BACKOFF_S=30s (#1209) ... В complete-loop'е min(...,30) применялся ТОЛЬКО к exponential backoff'у (else-ветка). Серверный Retry-After уходил в time.sleep как есть. _parse_retry_after принимает любое число секунд ("86400".isdigit() → True), а provider'ы шлют Retry-After до 86400с при quota-exhaustion (OpenAI, CDN-503). Эффект: time.sleep блокирует поток anyio-threadpool на часы (до 48ч при llm_max_retries=2). Async-консьюмер (chat.py) мостится через run_in_threadpool — поток держит токен пула (~40 потоков, общий с sync Depends(get_db)) и DB-сессию → пул исчерпывается → стопор приложения. Patch: вынес кап на module-level _MAX_BACKOFF_S=30s, применяю к ОБЕИМ веткам (Retry-After И exp.backoff). raw_wait логируется отдельно для наблюдаемости (видно когда провайдер просил больше). Новый юнит-тест test_rate_limited_retry_after_capped: provider шлёт retry_after=86400 → time.sleep вызывается с 30 (не 86400). 14/14 client тестов + 55/55 LLM-suite зелёные. ruff clean. Closes #1209	2026-06-13 06:07:46 +00:00
Light1YT	f12c03588d	fix(llm): close §19 redaction regex gaps for bare phone / CAPS name / bare SNILS (#1207) ... `_PHONE_RE` требовал префикс +7/8 + хотя бы один разделитель → copy-paste форма «79221234567»/«89221234567» (самая частая) уходила в OpenAI как есть. `_FULLNAME_RE` требовал строчные после первой буквы → стандарт ЕГРН/паспортных выписок «ИВАНОВ ИВАН ИВАНОВИЧ» не матчил. СНИЛС без разделителей не покрывался вообще (`_SNILS_RE` ждёт формат «NNN-NNN-NNN NN»). Для chat-пути scrub — единственный барьер перед OpenAI (SafePayload.text без allowlist'а), при llm_enabled=True PII покидает РФ (нарушение §19/152-ФЗ). Patch: - _PHONE_BARE_RE: (?<!\d)[78]\d{10}(?!\d) — 11-значные с префиксом 7/8. - _SNILS_BARE_RE: (?<!\d)\d{11}(?!\d) — любые 11-значные без разделителей. - _FULLNAME_RE: альтернатива в каждом слове — Titlecase | CAPS-2+. - Конфликт phone-bare vs SNILS-bare разрешён порядком в _PII_PATTERNS: phone раньше SNILS (7/8-префикс семантически точнее). - INN (ровно 10/12) с SNILS-bare не пересекается по длине. 8 новых юнит-тестов покрывают все три дыры + конфликт-резолюцию. 24/24 redaction тестов + 55/55 LLM-suite зелёные. Closes #1207	2026-06-13 09:56:58 +05:00
Light1YT	645b3c14a3	fix(chat): clean квартирография rendering in chat_system prompt (v2, #957) ... Live chat rendered the recommended unit-mix as a garbled rank-hyphen-type list ("2-1-к", "3-2-к" = "rank 2: 1-к"). Add rule 6 to chat_system@v2: list квартирография/segments by clean TYPE (студия / 1-к / 2-к / 3-к / 80+ м²) + share %, no ordinal-number-hyphen-type concatenation. Bumped prompt version 1->2 (versioned-prompt convention). Test locks v2 + the rule. Refs #957	2026-06-09 15:07:14 +05:00
Light1YT	fceaaf9a2c	feat(chat): LLM tool-loop + §19 redaction wiring for #957 (Step 2+3) ... Add the LLM prose-composition path for the parcel-forecast chat, layered over the deterministic Step-1 fallback which stays the safety net. - chat/tools.py: 5 read-only section tools (exec_summary, product_recommendation, forecast, risks, scenarios) — pure slices of the loaded report dict, no DB/ recompute, graceful on missing sections. market_now (raw analyze blob) and meta are deliberately NOT exposed -> highest-PII data cannot reach the LLM. - chat/safe_payload.py: the §19 gate — single place that builds the outbound SafePayload from a section-aggregate allowlist; honors is_confidential hard-block. - chat/orchestrator.py: manual tool-call loop with call-cap/termination, real grounded_in provenance; any LLMResult.ok=False (disabled/timeout/rate_limited/ redaction_refused/call_cap/provider_error/empty) degrades to the deterministic answer. - llm/prompts.py: versioned chat_system@v1 — answer only from sections, never fabricate numbers, advisory tone, decline out-of-scope. - api/v1/chat.py: branch on settings.llm_enabled; sync complete bridged via run_in_threadpool. Default-off -> deterministic path, no provider built. - Tests: fake provider only (no network), planted-secret redaction-boundary + per-reason fallback + call-cap + numbers-from-report coverage. Refs #957	2026-06-08 17:45:01 +05:00
Light1YT	4af7ba5a40	feat(llm): foundational LLM infra package with §19 redaction + deterministic fallback (#960) ... Optional external-OpenAI layer over the deterministic forecasting engine. Gated by llm_enabled (default False) so prod makes no network calls until deliberately enabled. Allowlist-first SafePayload contract + is_confidential hard-block + RU-PII regex scrub (mandatory on the external path). Abstract LLMProvider seam (is_external) for a future RU-hosted provider. Sync httpx core (Celery-friendly); tool/function-calling pass-through; timeout + bounded 429/5xx retry + per-request call cap, all degrading to fallback. Raw httpx (no openai SDK -> no pyproject/lock drift). 47 tests, ruff + mypy clean. Refs #960	2026-06-08 15:44:16 +05:00